2024-09-21T01:20:33.579 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-21T01:20:33.603 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-21T01:20:33.705 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913381 branch: wip-pdonnell-testing-20240920.212106-debug description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/fuse objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/1 standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/no 5-quiesce/with-quiesce 6-workunit/direct_io}} email: pdonnell@redhat.com first_in_suite: false job_id: '7913381' kernel: kdb: 1 sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-pdonnell-testing-20240920.212106-debug ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd max_mds: 1 session_timeout: 300 standby_replay: true cluster-conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 2 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: client mount timeout: 30 debug cephsqlite: 20 debug client: 20 debug mgr: 20 debug ms: 1 mgr/snap_schedule/allow_m_granularity: true mgr/snap_schedule/dump_on_update: true mgr/snap_schedule/log_level: debug mon warn on pool no app: false mon: mon op complaint time: 120 osd: osd op complaint time: 180 conf: mgr: cephsqlite lock renewal timeout: 900000 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10000 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - fs.*is degraded - filesystem is degraded - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - filesystem is offline - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - insufficient standby MDS daemons available - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy mgr-modules: - snap_schedule sha1: 1843221895adccfb3b692060251dd6a0183bc410 subvols: create: 2 subvol_options: --namespace-isolated ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.root_rsnaps - mds_server.req_mksnap_latency.avgcount - mds_server.req_rmsnap_latency.avgcount dry_run: true install: ceph: flavor: default sha1: 1843221895adccfb3b692060251dd6a0183bc410 kclient: client.0: mount_subvol_num: 1 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-pdonnell-testing-20240920.212106-debug sha1: 1843221895adccfb3b692060251dd6a0183bc410 owner: scheduled_pdonnell@teuthology priority: 90 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 7864 sha1: 1843221895adccfb3b692060251dd6a0183bc410 sleep_before_teardown: 0 subset: 67/512 suite: fs suite_branch: wip-pdonnell-testing-20240920.212106-debug suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 1843221895adccfb3b692060251dd6a0183bc410 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi083.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBApDQPyoj7MMrkWfZ4GIj8Khe3ozl0SXoUn5DaIoeFff68zHmsOFw49+O9rS8Xm+s/RJLu0NhVo3m63ehPo6Dqg= smithi119.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPZnP4ZcsWSgyFrBoOXKKb8Zu7oifxRyy3BPvzw5RR8ND4/8iOfirpYWM43NCud6+Xfit4wn319MCVDi2OlKFjM= smithi142.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCECEzir9FlXcmDvxiRiCs7c8bedIru3he0ONhUNCrZFFNXmA7m4BpzpkU1W1PvjsuuDwFts9XxXH65QTFHYZoc= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - ceph-fuse: null - check-counter: {} - exec: mon.a: - ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m - ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - date +%s > START_TIME - full_sequential_finally: - exec: mon.a: - date +%s > END_TIME - START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - quiescer: null - workunit: clients: all: - direct_io teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-20_23:48:22 tube: smithi user: pdonnell verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2902 2024-09-21T01:20:33.705 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa; will attempt to use it 2024-09-21T01:20:33.705 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa/tasks 2024-09-21T01:20:33.706 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-21T01:20:33.707 INFO:teuthology.task.internal:Checking packages... 2024-09-21T01:20:33.725 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '1843221895adccfb3b692060251dd6a0183bc410' 2024-09-21T01:20:33.726 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-21T01:20:33.726 INFO:teuthology.packaging:ref: None 2024-09-21T01:20:33.726 INFO:teuthology.packaging:tag: None 2024-09-21T01:20:33.726 INFO:teuthology.packaging:branch: wip-pdonnell-testing-20240920.212106-debug 2024-09-21T01:20:33.726 INFO:teuthology.packaging:sha1: 1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T01:20:33.726 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-pdonnell-testing-20240920.212106-debug 2024-09-21T01:20:33.871 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-5120.g18432218 2024-09-21T01:20:33.872 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-21T01:20:33.879 INFO:teuthology.task.internal:no buildpackages task found 2024-09-21T01:20:33.879 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-21T01:20:33.891 INFO:teuthology.task.internal:Saving configuration 2024-09-21T01:20:33.913 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-21T01:20:33.920 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-21T01:20:33.944 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi083.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913381', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-21 01:15:29.463008', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBApDQPyoj7MMrkWfZ4GIj8Khe3ozl0SXoUn5DaIoeFff68zHmsOFw49+O9rS8Xm+s/RJLu0NhVo3m63ehPo6Dqg='} 2024-09-21T01:20:33.966 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi119.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913381', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-21 01:15:29.464719', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPZnP4ZcsWSgyFrBoOXKKb8Zu7oifxRyy3BPvzw5RR8ND4/8iOfirpYWM43NCud6+Xfit4wn319MCVDi2OlKFjM='} 2024-09-21T01:20:33.986 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi142.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913381', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-21 01:15:29.461078', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCECEzir9FlXcmDvxiRiCs7c8bedIru3he0ONhUNCrZFFNXmA7m4BpzpkU1W1PvjsuuDwFts9XxXH65QTFHYZoc='} 2024-09-21T01:20:33.986 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-21T01:20:33.992 INFO:teuthology.task.internal:roles: ubuntu@smithi083.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-09-21T01:20:33.992 INFO:teuthology.task.internal:roles: ubuntu@smithi119.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-09-21T01:20:33.993 INFO:teuthology.task.internal:roles: ubuntu@smithi142.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-09-21T01:20:33.993 INFO:teuthology.run_tasks:Running task console_log... 2024-09-21T01:20:34.080 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f84835d4160>, signals=[15]) 2024-09-21T01:20:34.080 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-21T01:20:34.086 INFO:teuthology.task.internal:Opening connections... 2024-09-21T01:20:34.086 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi083.front.sepia.ceph.com 2024-09-21T01:20:34.088 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T01:20:34.162 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi119.front.sepia.ceph.com 2024-09-21T01:20:34.162 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T01:20:34.235 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi142.front.sepia.ceph.com 2024-09-21T01:20:34.236 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T01:20:34.312 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-21T01:20:34.318 DEBUG:teuthology.orchestra.run.smithi083:> uname -m 2024-09-21T01:20:34.336 INFO:teuthology.orchestra.run.smithi083.stdout:x86_64 2024-09-21T01:20:34.336 DEBUG:teuthology.orchestra.run.smithi083:> cat /etc/os-release 2024-09-21T01:20:34.394 INFO:teuthology.orchestra.run.smithi083.stdout:NAME="CentOS Stream" 2024-09-21T01:20:34.394 INFO:teuthology.orchestra.run.smithi083.stdout:VERSION="9" 2024-09-21T01:20:34.394 INFO:teuthology.orchestra.run.smithi083.stdout:ID="centos" 2024-09-21T01:20:34.394 INFO:teuthology.orchestra.run.smithi083.stdout:ID_LIKE="rhel fedora" 2024-09-21T01:20:34.394 INFO:teuthology.orchestra.run.smithi083.stdout:VERSION_ID="9" 2024-09-21T01:20:34.394 INFO:teuthology.orchestra.run.smithi083.stdout:PLATFORM_ID="platform:el9" 2024-09-21T01:20:34.394 INFO:teuthology.orchestra.run.smithi083.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-21T01:20:34.395 INFO:teuthology.orchestra.run.smithi083.stdout:ANSI_COLOR="0;31" 2024-09-21T01:20:34.395 INFO:teuthology.orchestra.run.smithi083.stdout:LOGO="fedora-logo-icon" 2024-09-21T01:20:34.395 INFO:teuthology.orchestra.run.smithi083.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-21T01:20:34.395 INFO:teuthology.orchestra.run.smithi083.stdout:HOME_URL="https://centos.org/" 2024-09-21T01:20:34.395 INFO:teuthology.orchestra.run.smithi083.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-21T01:20:34.395 INFO:teuthology.orchestra.run.smithi083.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-21T01:20:34.395 INFO:teuthology.orchestra.run.smithi083.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-21T01:20:34.395 INFO:teuthology.lock.ops:Updating smithi083.front.sepia.ceph.com on lock server 2024-09-21T01:20:34.415 DEBUG:teuthology.orchestra.run.smithi119:> uname -m 2024-09-21T01:20:34.434 INFO:teuthology.orchestra.run.smithi119.stdout:x86_64 2024-09-21T01:20:34.434 DEBUG:teuthology.orchestra.run.smithi119:> cat /etc/os-release 2024-09-21T01:20:34.492 INFO:teuthology.orchestra.run.smithi119.stdout:NAME="CentOS Stream" 2024-09-21T01:20:34.492 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION="9" 2024-09-21T01:20:34.492 INFO:teuthology.orchestra.run.smithi119.stdout:ID="centos" 2024-09-21T01:20:34.492 INFO:teuthology.orchestra.run.smithi119.stdout:ID_LIKE="rhel fedora" 2024-09-21T01:20:34.492 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION_ID="9" 2024-09-21T01:20:34.492 INFO:teuthology.orchestra.run.smithi119.stdout:PLATFORM_ID="platform:el9" 2024-09-21T01:20:34.492 INFO:teuthology.orchestra.run.smithi119.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-21T01:20:34.493 INFO:teuthology.orchestra.run.smithi119.stdout:ANSI_COLOR="0;31" 2024-09-21T01:20:34.493 INFO:teuthology.orchestra.run.smithi119.stdout:LOGO="fedora-logo-icon" 2024-09-21T01:20:34.493 INFO:teuthology.orchestra.run.smithi119.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-21T01:20:34.493 INFO:teuthology.orchestra.run.smithi119.stdout:HOME_URL="https://centos.org/" 2024-09-21T01:20:34.493 INFO:teuthology.orchestra.run.smithi119.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-21T01:20:34.493 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-21T01:20:34.493 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-21T01:20:34.493 INFO:teuthology.lock.ops:Updating smithi119.front.sepia.ceph.com on lock server 2024-09-21T01:20:34.515 DEBUG:teuthology.orchestra.run.smithi142:> uname -m 2024-09-21T01:20:34.535 INFO:teuthology.orchestra.run.smithi142.stdout:x86_64 2024-09-21T01:20:34.535 DEBUG:teuthology.orchestra.run.smithi142:> cat /etc/os-release 2024-09-21T01:20:34.595 INFO:teuthology.orchestra.run.smithi142.stdout:NAME="CentOS Stream" 2024-09-21T01:20:34.595 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION="9" 2024-09-21T01:20:34.595 INFO:teuthology.orchestra.run.smithi142.stdout:ID="centos" 2024-09-21T01:20:34.595 INFO:teuthology.orchestra.run.smithi142.stdout:ID_LIKE="rhel fedora" 2024-09-21T01:20:34.595 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION_ID="9" 2024-09-21T01:20:34.595 INFO:teuthology.orchestra.run.smithi142.stdout:PLATFORM_ID="platform:el9" 2024-09-21T01:20:34.595 INFO:teuthology.orchestra.run.smithi142.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-21T01:20:34.595 INFO:teuthology.orchestra.run.smithi142.stdout:ANSI_COLOR="0;31" 2024-09-21T01:20:34.595 INFO:teuthology.orchestra.run.smithi142.stdout:LOGO="fedora-logo-icon" 2024-09-21T01:20:34.595 INFO:teuthology.orchestra.run.smithi142.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-21T01:20:34.596 INFO:teuthology.orchestra.run.smithi142.stdout:HOME_URL="https://centos.org/" 2024-09-21T01:20:34.596 INFO:teuthology.orchestra.run.smithi142.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-21T01:20:34.596 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-21T01:20:34.596 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-21T01:20:34.596 INFO:teuthology.lock.ops:Updating smithi142.front.sepia.ceph.com on lock server 2024-09-21T01:20:34.615 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-21T01:20:34.629 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-21T01:20:34.636 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-21T01:20:34.636 DEBUG:teuthology.orchestra.run.smithi083:> test '!' -e /home/ubuntu/cephtest 2024-09-21T01:20:34.639 DEBUG:teuthology.orchestra.run.smithi119:> test '!' -e /home/ubuntu/cephtest 2024-09-21T01:20:34.641 DEBUG:teuthology.orchestra.run.smithi142:> test '!' -e /home/ubuntu/cephtest 2024-09-21T01:20:34.658 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-21T01:20:34.664 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-21T01:20:34.664 DEBUG:teuthology.orchestra.run.smithi083:> test -z $(ls -A /var/lib/ceph) 2024-09-21T01:20:34.696 DEBUG:teuthology.orchestra.run.smithi119:> test -z $(ls -A /var/lib/ceph) 2024-09-21T01:20:34.698 DEBUG:teuthology.orchestra.run.smithi142:> test -z $(ls -A /var/lib/ceph) 2024-09-21T01:20:34.958 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-21T01:20:35.039 INFO:teuthology.run_tasks:Running task kernel... 2024-09-21T01:20:35.053 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-21T01:20:35.053 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}, 'mon.c': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-21T01:20:35.054 DEBUG:teuthology.orchestra.run.smithi083:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-21T01:20:35.054 DEBUG:teuthology.orchestra.run.smithi119:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-21T01:20:35.054 DEBUG:teuthology.orchestra.run.smithi142:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-21T01:20:35.072 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T01:20:35.072 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T01:20:35.073 DEBUG:teuthology.orchestra.run.smithi083:> uname -r 2024-09-21T01:20:35.073 DEBUG:teuthology.orchestra.run.smithi119:> uname -r 2024-09-21T01:20:35.074 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T01:20:35.074 DEBUG:teuthology.orchestra.run.smithi142:> uname -r 2024-09-21T01:20:35.131 INFO:teuthology.orchestra.run.smithi083.stdout:5.14.0-503.el9.x86_64 2024-09-21T01:20:35.131 INFO:teuthology.task.kernel:Running kernel on smithi083: 5.14.0-503.el9.x86_64 2024-09-21T01:20:35.131 DEBUG:teuthology.orchestra.run.smithi083:> sudo yum install -y kernel 2024-09-21T01:20:35.134 INFO:teuthology.orchestra.run.smithi142.stdout:5.14.0-503.el9.x86_64 2024-09-21T01:20:35.134 INFO:teuthology.orchestra.run.smithi119.stdout:5.14.0-503.el9.x86_64 2024-09-21T01:20:35.134 INFO:teuthology.task.kernel:Running kernel on smithi142: 5.14.0-503.el9.x86_64 2024-09-21T01:20:35.134 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum install -y kernel 2024-09-21T01:20:35.134 INFO:teuthology.task.kernel:Running kernel on smithi119: 5.14.0-503.el9.x86_64 2024-09-21T01:20:35.135 DEBUG:teuthology.orchestra.run.smithi119:> sudo yum install -y kernel 2024-09-21T01:20:37.317 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Stream 9 - BaseOS 19 MB/s | 8.3 MB 00:00 2024-09-21T01:20:37.438 INFO:teuthology.orchestra.run.smithi119.stdout:CentOS Stream 9 - BaseOS 15 MB/s | 8.3 MB 00:00 2024-09-21T01:20:37.605 INFO:teuthology.orchestra.run.smithi083.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.3 MB 00:00 2024-09-21T01:20:39.323 INFO:teuthology.orchestra.run.smithi083.stdout:CentOS Stream 9 - AppStream 31 MB/s | 20 MB 00:00 2024-09-21T01:20:41.443 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Stream 9 - AppStream 6.6 MB/s | 20 MB 00:03 2024-09-21T01:20:46.160 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Stream 9 - CRB 10 MB/s | 6.5 MB 00:00 2024-09-21T01:20:47.165 INFO:teuthology.orchestra.run.smithi083.stdout:CentOS Stream 9 - CRB 1.6 MB/s | 6.5 MB 00:04 2024-09-21T01:20:48.094 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Stream 9 - Extras packages 27 kB/s | 19 kB 00:00 2024-09-21T01:20:48.616 INFO:teuthology.orchestra.run.smithi083.stdout:CentOS Stream 9 - Extras packages 81 kB/s | 19 kB 00:00 2024-09-21T01:20:49.386 INFO:teuthology.orchestra.run.smithi083.stdout:Extra Packages for Enterprise Linux 35 MB/s | 23 MB 00:00 2024-09-21T01:20:50.484 INFO:teuthology.orchestra.run.smithi142.stdout:Extra Packages for Enterprise Linux 10 MB/s | 23 MB 00:02 2024-09-21T01:20:54.826 INFO:teuthology.orchestra.run.smithi083.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-09-21T01:20:55.921 INFO:teuthology.orchestra.run.smithi142.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-09-21T01:20:56.629 INFO:teuthology.orchestra.run.smithi119.stdout:CentOS Stream 9 - AppStream 1.1 MB/s | 20 MB 00:18 2024-09-21T01:20:56.732 INFO:teuthology.orchestra.run.smithi083.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-21T01:20:56.732 INFO:teuthology.orchestra.run.smithi083.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-21T01:20:56.827 INFO:teuthology.orchestra.run.smithi083.stdout:Dependencies resolved. 2024-09-21T01:20:56.834 INFO:teuthology.orchestra.run.smithi083.stdout:================================================================================ 2024-09-21T01:20:56.834 INFO:teuthology.orchestra.run.smithi083.stdout: Package Architecture Version Repository Size 2024-09-21T01:20:56.834 INFO:teuthology.orchestra.run.smithi083.stdout:================================================================================ 2024-09-21T01:20:56.834 INFO:teuthology.orchestra.run.smithi083.stdout:Installing: 2024-09-21T01:20:56.834 INFO:teuthology.orchestra.run.smithi083.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-21T01:20:56.834 INFO:teuthology.orchestra.run.smithi083.stdout:Installing dependencies: 2024-09-21T01:20:56.834 INFO:teuthology.orchestra.run.smithi083.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-21T01:20:56.834 INFO:teuthology.orchestra.run.smithi083.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-21T01:20:56.834 INFO:teuthology.orchestra.run.smithi083.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-21T01:20:56.834 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T01:20:56.834 INFO:teuthology.orchestra.run.smithi083.stdout:Transaction Summary 2024-09-21T01:20:56.834 INFO:teuthology.orchestra.run.smithi083.stdout:================================================================================ 2024-09-21T01:20:56.835 INFO:teuthology.orchestra.run.smithi083.stdout:Install 4 Packages 2024-09-21T01:20:56.835 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T01:20:56.835 INFO:teuthology.orchestra.run.smithi083.stdout:Total download size: 79 M 2024-09-21T01:20:56.835 INFO:teuthology.orchestra.run.smithi083.stdout:Installed size: 126 M 2024-09-21T01:20:56.835 INFO:teuthology.orchestra.run.smithi083.stdout:Downloading Packages: 2024-09-21T01:20:57.410 INFO:teuthology.orchestra.run.smithi083.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 65 kB/s | 36 kB 00:00 2024-09-21T01:20:57.819 INFO:teuthology.orchestra.run.smithi142.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-21T01:20:57.819 INFO:teuthology.orchestra.run.smithi142.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-21T01:20:57.920 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-09-21T01:20:57.924 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-21T01:20:57.925 INFO:teuthology.orchestra.run.smithi142.stdout: Package Architecture Version Repository Size 2024-09-21T01:20:57.925 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-21T01:20:57.925 INFO:teuthology.orchestra.run.smithi142.stdout:Installing: 2024-09-21T01:20:57.925 INFO:teuthology.orchestra.run.smithi142.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-21T01:20:57.925 INFO:teuthology.orchestra.run.smithi142.stdout:Installing dependencies: 2024-09-21T01:20:57.925 INFO:teuthology.orchestra.run.smithi142.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-21T01:20:57.925 INFO:teuthology.orchestra.run.smithi142.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-21T01:20:57.925 INFO:teuthology.orchestra.run.smithi142.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-21T01:20:57.925 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-21T01:20:57.925 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2024-09-21T01:20:57.925 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-09-21T01:20:57.925 INFO:teuthology.orchestra.run.smithi142.stdout:Install 4 Packages 2024-09-21T01:20:57.925 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-21T01:20:57.926 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 79 M 2024-09-21T01:20:57.926 INFO:teuthology.orchestra.run.smithi142.stdout:Installed size: 126 M 2024-09-21T01:20:57.926 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2024-09-21T01:20:58.322 INFO:teuthology.orchestra.run.smithi142.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 123 kB/s | 36 kB 00:00 2024-09-21T01:20:59.803 INFO:teuthology.orchestra.run.smithi083.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 5.3 MB/s | 16 MB 00:02 2024-09-21T01:21:01.946 INFO:teuthology.orchestra.run.smithi119.stdout:CentOS Stream 9 - CRB 4.3 MB/s | 6.5 MB 00:01 2024-09-21T01:21:03.388 INFO:teuthology.orchestra.run.smithi119.stdout:CentOS Stream 9 - Extras packages 87 kB/s | 19 kB 00:00 2024-09-21T01:21:04.071 INFO:teuthology.orchestra.run.smithi142.stdout:(2/4): kernel-modules-core-5.14.0-508.el9.x86_6 5.0 MB/s | 29 MB 00:05 2024-09-21T01:21:04.201 INFO:teuthology.orchestra.run.smithi119.stdout:Extra Packages for Enterprise Linux 33 MB/s | 23 MB 00:00 2024-09-21T01:21:05.319 INFO:teuthology.orchestra.run.smithi083.stdout:(3/4): kernel-modules-core-5.14.0-508.el9.x86_6 3.6 MB/s | 29 MB 00:07 2024-09-21T01:21:05.613 INFO:teuthology.orchestra.run.smithi142.stdout:(3/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 4.6 MB/s | 35 MB 00:07 2024-09-21T01:21:05.763 INFO:teuthology.orchestra.run.smithi142.stdout:(4/4): kernel-core-5.14.0-508.el9.x86_64.rpm 2.0 MB/s | 16 MB 00:07 2024-09-21T01:21:05.764 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2024-09-21T01:21:05.764 INFO:teuthology.orchestra.run.smithi142.stdout:Total 10 MB/s | 79 MB 00:07 2024-09-21T01:21:06.449 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2024-09-21T01:21:06.796 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2024-09-21T01:21:06.797 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2024-09-21T01:21:07.740 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2024-09-21T01:21:07.740 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2024-09-21T01:21:07.935 INFO:teuthology.orchestra.run.smithi083.stdout:(4/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 3.1 MB/s | 35 MB 00:11 2024-09-21T01:21:07.935 INFO:teuthology.orchestra.run.smithi083.stdout:-------------------------------------------------------------------------------- 2024-09-21T01:21:07.936 INFO:teuthology.orchestra.run.smithi083.stdout:Total 7.1 MB/s | 79 MB 00:11 2024-09-21T01:21:08.621 INFO:teuthology.orchestra.run.smithi083.stdout:Running transaction check 2024-09-21T01:21:08.984 INFO:teuthology.orchestra.run.smithi083.stdout:Transaction check succeeded. 2024-09-21T01:21:08.984 INFO:teuthology.orchestra.run.smithi083.stdout:Running transaction test 2024-09-21T01:21:09.773 INFO:teuthology.orchestra.run.smithi119.stdout:lab-extras 37 kB/s | 1.7 kB 00:00 2024-09-21T01:21:09.928 INFO:teuthology.orchestra.run.smithi083.stdout:Transaction test succeeded. 2024-09-21T01:21:09.928 INFO:teuthology.orchestra.run.smithi083.stdout:Running transaction 2024-09-21T01:21:10.161 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2024-09-21T01:21:10.837 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-21T01:21:10.921 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T01:21:11.654 INFO:teuthology.orchestra.run.smithi119.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-21T01:21:11.655 INFO:teuthology.orchestra.run.smithi119.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-21T01:21:11.741 INFO:teuthology.orchestra.run.smithi119.stdout:Dependencies resolved. 2024-09-21T01:21:11.752 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2024-09-21T01:21:11.752 INFO:teuthology.orchestra.run.smithi119.stdout: Package Architecture Version Repository Size 2024-09-21T01:21:11.752 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2024-09-21T01:21:11.752 INFO:teuthology.orchestra.run.smithi119.stdout:Installing: 2024-09-21T01:21:11.752 INFO:teuthology.orchestra.run.smithi119.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-21T01:21:11.752 INFO:teuthology.orchestra.run.smithi119.stdout:Installing dependencies: 2024-09-21T01:21:11.752 INFO:teuthology.orchestra.run.smithi119.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-21T01:21:11.752 INFO:teuthology.orchestra.run.smithi119.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-21T01:21:11.752 INFO:teuthology.orchestra.run.smithi119.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-21T01:21:11.752 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-21T01:21:11.753 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction Summary 2024-09-21T01:21:11.753 INFO:teuthology.orchestra.run.smithi119.stdout:================================================================================ 2024-09-21T01:21:11.753 INFO:teuthology.orchestra.run.smithi119.stdout:Install 4 Packages 2024-09-21T01:21:11.753 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-21T01:21:11.753 INFO:teuthology.orchestra.run.smithi119.stdout:Total download size: 79 M 2024-09-21T01:21:11.753 INFO:teuthology.orchestra.run.smithi119.stdout:Installed size: 126 M 2024-09-21T01:21:11.753 INFO:teuthology.orchestra.run.smithi119.stdout:Downloading Packages: 2024-09-21T01:21:11.891 INFO:teuthology.orchestra.run.smithi119.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 399 kB/s | 36 kB 00:00 2024-09-21T01:21:12.353 INFO:teuthology.orchestra.run.smithi083.stdout: Preparing : 1/1 2024-09-21T01:21:12.442 INFO:teuthology.orchestra.run.smithi119.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 24 MB/s | 16 MB 00:00 2024-09-21T01:21:12.759 INFO:teuthology.orchestra.run.smithi119.stdout:(3/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 36 MB/s | 35 MB 00:00 2024-09-21T01:21:12.998 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-21T01:21:13.076 INFO:teuthology.orchestra.run.smithi119.stdout:(4/4): kernel-modules-core-5.14.0-508.el9.x86_6 24 MB/s | 29 MB 00:01 2024-09-21T01:21:13.076 INFO:teuthology.orchestra.run.smithi119.stdout:-------------------------------------------------------------------------------- 2024-09-21T01:21:13.076 INFO:teuthology.orchestra.run.smithi119.stdout:Total 60 MB/s | 79 MB 00:01 2024-09-21T01:21:13.089 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T01:21:13.676 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T01:21:13.752 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction check 2024-09-21T01:21:13.796 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T01:21:14.109 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction check succeeded. 2024-09-21T01:21:14.109 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction test 2024-09-21T01:21:15.050 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction test succeeded. 2024-09-21T01:21:15.050 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction 2024-09-21T01:21:15.835 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T01:21:15.983 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T01:21:17.492 INFO:teuthology.orchestra.run.smithi119.stdout: Preparing : 1/1 2024-09-21T01:21:18.289 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-21T01:21:18.370 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T01:21:18.635 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T01:21:18.763 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-21T01:21:20.800 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T01:21:20.941 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-21T01:21:21.110 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T01:21:21.256 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T01:21:23.626 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T01:21:25.770 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T01:21:26.061 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T01:21:26.181 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-21T01:21:30.999 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T01:22:02.047 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T01:22:02.087 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-21T01:22:02.432 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-21T01:22:02.432 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-21T01:22:02.432 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T01:22:02.432 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T01:22:03.298 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T01:22:03.298 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-21T01:22:03.298 INFO:teuthology.orchestra.run.smithi142.stdout:Installed: 2024-09-21T01:22:03.298 INFO:teuthology.orchestra.run.smithi142.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-21T01:22:03.298 INFO:teuthology.orchestra.run.smithi142.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-21T01:22:03.298 INFO:teuthology.orchestra.run.smithi142.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-21T01:22:03.298 INFO:teuthology.orchestra.run.smithi142.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-21T01:22:03.299 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-21T01:22:03.299 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-09-21T01:22:03.674 DEBUG:teuthology.orchestra.run.smithi142:> rpm -q kernel | sort -rV | head -n 1 2024-09-21T01:22:03.764 INFO:teuthology.orchestra.run.smithi142.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-21T01:22:03.765 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-21T01:22:03.765 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-21T01:22:03.765 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-21T01:22:03.765 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-21T01:22:03.765 INFO:teuthology.task.kernel:Installing distro kernel on mon.c... 2024-09-21T01:22:03.766 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi142.front.sepia.ceph.com, path=None, version=distro) 2024-09-21T01:22:03.766 DEBUG:teuthology.orchestra.run.smithi142:> rpm -q kernel | sort -rV | head -n 1 2024-09-21T01:22:03.824 INFO:teuthology.orchestra.run.smithi142.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-21T01:22:03.824 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-21T01:22:03.824 DEBUG:teuthology.orchestra.run.smithi142:> sudo rpm -qi grub2-tools 2024-09-21T01:22:03.858 INFO:teuthology.orchestra.run.smithi142.stdout:Name : grub2-tools 2024-09-21T01:22:03.858 INFO:teuthology.orchestra.run.smithi142.stdout:Epoch : 1 2024-09-21T01:22:03.858 INFO:teuthology.orchestra.run.smithi142.stdout:Version : 2.06 2024-09-21T01:22:03.858 INFO:teuthology.orchestra.run.smithi142.stdout:Release : 82.el9 2024-09-21T01:22:03.858 INFO:teuthology.orchestra.run.smithi142.stdout:Architecture: x86_64 2024-09-21T01:22:03.859 INFO:teuthology.orchestra.run.smithi142.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-21T01:22:03.859 INFO:teuthology.orchestra.run.smithi142.stdout:Group : Unspecified 2024-09-21T01:22:03.859 INFO:teuthology.orchestra.run.smithi142.stdout:Size : 8274670 2024-09-21T01:22:03.859 INFO:teuthology.orchestra.run.smithi142.stdout:License : GPLv3+ 2024-09-21T01:22:03.859 INFO:teuthology.orchestra.run.smithi142.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-21T01:22:03.859 INFO:teuthology.orchestra.run.smithi142.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-21T01:22:03.859 INFO:teuthology.orchestra.run.smithi142.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-21T01:22:03.859 INFO:teuthology.orchestra.run.smithi142.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-21T01:22:03.859 INFO:teuthology.orchestra.run.smithi142.stdout:Packager : builder@centos.org 2024-09-21T01:22:03.859 INFO:teuthology.orchestra.run.smithi142.stdout:Vendor : CentOS 2024-09-21T01:22:03.859 INFO:teuthology.orchestra.run.smithi142.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-21T01:22:03.859 INFO:teuthology.orchestra.run.smithi142.stdout:Summary : Support tools for GRUB. 2024-09-21T01:22:03.859 INFO:teuthology.orchestra.run.smithi142.stdout:Description : 2024-09-21T01:22:03.859 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-21T01:22:03.860 INFO:teuthology.orchestra.run.smithi142.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-21T01:22:03.860 INFO:teuthology.orchestra.run.smithi142.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-21T01:22:03.860 INFO:teuthology.orchestra.run.smithi142.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-21T01:22:03.860 INFO:teuthology.orchestra.run.smithi142.stdout:hardware devices. 2024-09-21T01:22:03.860 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-21T01:22:03.860 INFO:teuthology.orchestra.run.smithi142.stdout:This subpackage provides tools for support of all platforms. 2024-09-21T01:22:03.861 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-21T01:22:03.861 INFO:teuthology.task.kernel:Updating grub on smithi142 to boot 5.14.0-508.el9.x86_64 2024-09-21T01:22:03.861 DEBUG:teuthology.orchestra.run.smithi142:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-21T01:22:04.025 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T01:22:04.070 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-21T01:22:04.429 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-21T01:22:04.430 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-21T01:22:04.430 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T01:22:04.430 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T01:22:04.518 INFO:teuthology.orchestra.run.smithi142.stderr:Generating grub configuration file ... 2024-09-21T01:22:05.245 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T01:22:05.245 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T01:22:05.245 INFO:teuthology.orchestra.run.smithi083.stdout:Installed: 2024-09-21T01:22:05.245 INFO:teuthology.orchestra.run.smithi083.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-21T01:22:05.246 INFO:teuthology.orchestra.run.smithi083.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-21T01:22:05.246 INFO:teuthology.orchestra.run.smithi083.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-21T01:22:05.246 INFO:teuthology.orchestra.run.smithi083.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-21T01:22:05.246 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T01:22:05.246 INFO:teuthology.orchestra.run.smithi083.stdout:Complete! 2024-09-21T01:22:05.608 DEBUG:teuthology.orchestra.run.smithi083:> rpm -q kernel | sort -rV | head -n 1 2024-09-21T01:22:05.692 INFO:teuthology.orchestra.run.smithi083.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-21T01:22:05.692 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-21T01:22:05.692 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-21T01:22:05.692 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-21T01:22:05.692 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-21T01:22:05.692 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-21T01:22:05.692 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi083.front.sepia.ceph.com, path=None, version=distro) 2024-09-21T01:22:05.693 DEBUG:teuthology.orchestra.run.smithi083:> rpm -q kernel | sort -rV | head -n 1 2024-09-21T01:22:05.751 INFO:teuthology.orchestra.run.smithi083.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-21T01:22:05.752 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-21T01:22:05.752 DEBUG:teuthology.orchestra.run.smithi083:> sudo rpm -qi grub2-tools 2024-09-21T01:22:05.783 INFO:teuthology.orchestra.run.smithi083.stdout:Name : grub2-tools 2024-09-21T01:22:05.784 INFO:teuthology.orchestra.run.smithi083.stdout:Epoch : 1 2024-09-21T01:22:05.784 INFO:teuthology.orchestra.run.smithi083.stdout:Version : 2.06 2024-09-21T01:22:05.784 INFO:teuthology.orchestra.run.smithi083.stdout:Release : 82.el9 2024-09-21T01:22:05.784 INFO:teuthology.orchestra.run.smithi083.stdout:Architecture: x86_64 2024-09-21T01:22:05.784 INFO:teuthology.orchestra.run.smithi083.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-21T01:22:05.784 INFO:teuthology.orchestra.run.smithi083.stdout:Group : Unspecified 2024-09-21T01:22:05.784 INFO:teuthology.orchestra.run.smithi083.stdout:Size : 8274670 2024-09-21T01:22:05.784 INFO:teuthology.orchestra.run.smithi083.stdout:License : GPLv3+ 2024-09-21T01:22:05.784 INFO:teuthology.orchestra.run.smithi083.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-21T01:22:05.784 INFO:teuthology.orchestra.run.smithi083.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-21T01:22:05.784 INFO:teuthology.orchestra.run.smithi083.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-21T01:22:05.785 INFO:teuthology.orchestra.run.smithi083.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-21T01:22:05.785 INFO:teuthology.orchestra.run.smithi083.stdout:Packager : builder@centos.org 2024-09-21T01:22:05.785 INFO:teuthology.orchestra.run.smithi083.stdout:Vendor : CentOS 2024-09-21T01:22:05.785 INFO:teuthology.orchestra.run.smithi083.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-21T01:22:05.785 INFO:teuthology.orchestra.run.smithi083.stdout:Summary : Support tools for GRUB. 2024-09-21T01:22:05.785 INFO:teuthology.orchestra.run.smithi083.stdout:Description : 2024-09-21T01:22:05.785 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T01:22:05.785 INFO:teuthology.orchestra.run.smithi083.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-21T01:22:05.785 INFO:teuthology.orchestra.run.smithi083.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-21T01:22:05.785 INFO:teuthology.orchestra.run.smithi083.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-21T01:22:05.785 INFO:teuthology.orchestra.run.smithi083.stdout:hardware devices. 2024-09-21T01:22:05.785 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T01:22:05.786 INFO:teuthology.orchestra.run.smithi083.stdout:This subpackage provides tools for support of all platforms. 2024-09-21T01:22:05.786 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-21T01:22:05.786 INFO:teuthology.task.kernel:Updating grub on smithi083 to boot 5.14.0-508.el9.x86_64 2024-09-21T01:22:05.787 DEBUG:teuthology.orchestra.run.smithi083:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-21T01:22:05.876 INFO:teuthology.orchestra.run.smithi142.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-21T01:22:05.903 INFO:teuthology.orchestra.run.smithi142.stderr:done 2024-09-21T01:22:05.912 DEBUG:teuthology.orchestra.run.smithi142:> mktemp 2024-09-21T01:22:05.928 INFO:teuthology.orchestra.run.smithi142.stdout:/tmp/tmp.s8E0UbGP6b 2024-09-21T01:22:05.928 DEBUG:teuthology.orchestra.run.smithi142:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.s8E0UbGP6b 2024-09-21T01:22:06.003 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 0666 /tmp/tmp.s8E0UbGP6b 2024-09-21T01:22:06.141 DEBUG:teuthology.orchestra.remote:smithi142:/tmp/tmp.s8E0UbGP6b is 6KB 2024-09-21T01:22:06.189 DEBUG:teuthology.orchestra.run.smithi142:> rm -fr /tmp/tmp.s8E0UbGP6b 2024-09-21T01:22:06.203 DEBUG:teuthology.orchestra.run.smithi142:> sudo /bin/ls /boot/loader/entries || true 2024-09-21T01:22:06.266 INFO:teuthology.orchestra.run.smithi142.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-21T01:22:06.267 INFO:teuthology.orchestra.run.smithi142.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-21T01:22:06.267 INFO:teuthology.orchestra.run.smithi142.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-21T01:22:06.267 INFO:teuthology.orchestra.run.smithi142.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-21T01:22:06.268 DEBUG:teuthology.orchestra.run.smithi142:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-21T01:22:06.421 DEBUG:teuthology.orchestra.run.smithi142:> sudo shutdown -r now 2024-09-21T01:22:06.422 INFO:teuthology.orchestra.run.smithi083.stderr:Generating grub configuration file ... 2024-09-21T01:22:07.762 INFO:teuthology.orchestra.run.smithi083.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-21T01:22:07.789 INFO:teuthology.orchestra.run.smithi083.stderr:done 2024-09-21T01:22:07.792 DEBUG:teuthology.orchestra.run.smithi083:> mktemp 2024-09-21T01:22:07.807 INFO:teuthology.orchestra.run.smithi083.stdout:/tmp/tmp.YH3sYwLCvW 2024-09-21T01:22:07.807 DEBUG:teuthology.orchestra.run.smithi083:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.YH3sYwLCvW 2024-09-21T01:22:07.873 DEBUG:teuthology.orchestra.run.smithi083:> sudo chmod 0666 /tmp/tmp.YH3sYwLCvW 2024-09-21T01:22:08.017 DEBUG:teuthology.orchestra.remote:smithi083:/tmp/tmp.YH3sYwLCvW is 6KB 2024-09-21T01:22:08.036 DEBUG:teuthology.orchestra.run.smithi083:> rm -fr /tmp/tmp.YH3sYwLCvW 2024-09-21T01:22:08.050 DEBUG:teuthology.orchestra.run.smithi083:> sudo /bin/ls /boot/loader/entries || true 2024-09-21T01:22:08.113 INFO:teuthology.orchestra.run.smithi083.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-21T01:22:08.113 INFO:teuthology.orchestra.run.smithi083.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-21T01:22:08.113 INFO:teuthology.orchestra.run.smithi083.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-21T01:22:08.113 INFO:teuthology.orchestra.run.smithi083.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-21T01:22:08.115 DEBUG:teuthology.orchestra.run.smithi083:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-21T01:22:08.285 DEBUG:teuthology.orchestra.run.smithi083:> sudo shutdown -r now 2024-09-21T01:22:09.104 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T01:22:09.143 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-21T01:22:09.497 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-21T01:22:09.497 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-21T01:22:09.497 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T01:22:09.497 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T01:22:10.393 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T01:22:10.393 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-21T01:22:10.393 INFO:teuthology.orchestra.run.smithi119.stdout:Installed: 2024-09-21T01:22:10.393 INFO:teuthology.orchestra.run.smithi119.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-21T01:22:10.393 INFO:teuthology.orchestra.run.smithi119.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-21T01:22:10.393 INFO:teuthology.orchestra.run.smithi119.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-21T01:22:10.393 INFO:teuthology.orchestra.run.smithi119.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-21T01:22:10.393 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-21T01:22:10.393 INFO:teuthology.orchestra.run.smithi119.stdout:Complete! 2024-09-21T01:22:10.739 DEBUG:teuthology.orchestra.run.smithi119:> rpm -q kernel | sort -rV | head -n 1 2024-09-21T01:22:10.833 INFO:teuthology.orchestra.run.smithi119.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-21T01:22:10.834 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-21T01:22:10.834 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-21T01:22:10.834 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-21T01:22:10.834 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-21T01:22:10.834 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-09-21T01:22:10.834 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi119.front.sepia.ceph.com, path=None, version=distro) 2024-09-21T01:22:10.834 DEBUG:teuthology.orchestra.run.smithi119:> rpm -q kernel | sort -rV | head -n 1 2024-09-21T01:22:10.893 INFO:teuthology.orchestra.run.smithi119.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-21T01:22:10.894 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-21T01:22:10.894 DEBUG:teuthology.orchestra.run.smithi119:> sudo rpm -qi grub2-tools 2024-09-21T01:22:10.933 INFO:teuthology.orchestra.run.smithi119.stdout:Name : grub2-tools 2024-09-21T01:22:10.933 INFO:teuthology.orchestra.run.smithi119.stdout:Epoch : 1 2024-09-21T01:22:10.933 INFO:teuthology.orchestra.run.smithi119.stdout:Version : 2.06 2024-09-21T01:22:10.934 INFO:teuthology.orchestra.run.smithi119.stdout:Release : 82.el9 2024-09-21T01:22:10.934 INFO:teuthology.orchestra.run.smithi119.stdout:Architecture: x86_64 2024-09-21T01:22:10.934 INFO:teuthology.orchestra.run.smithi119.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-21T01:22:10.934 INFO:teuthology.orchestra.run.smithi119.stdout:Group : Unspecified 2024-09-21T01:22:10.934 INFO:teuthology.orchestra.run.smithi119.stdout:Size : 8274670 2024-09-21T01:22:10.934 INFO:teuthology.orchestra.run.smithi119.stdout:License : GPLv3+ 2024-09-21T01:22:10.934 INFO:teuthology.orchestra.run.smithi119.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-21T01:22:10.934 INFO:teuthology.orchestra.run.smithi119.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-21T01:22:10.934 INFO:teuthology.orchestra.run.smithi119.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-21T01:22:10.934 INFO:teuthology.orchestra.run.smithi119.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-21T01:22:10.934 INFO:teuthology.orchestra.run.smithi119.stdout:Packager : builder@centos.org 2024-09-21T01:22:10.934 INFO:teuthology.orchestra.run.smithi119.stdout:Vendor : CentOS 2024-09-21T01:22:10.934 INFO:teuthology.orchestra.run.smithi119.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-21T01:22:10.934 INFO:teuthology.orchestra.run.smithi119.stdout:Summary : Support tools for GRUB. 2024-09-21T01:22:10.934 INFO:teuthology.orchestra.run.smithi119.stdout:Description : 2024-09-21T01:22:10.934 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-21T01:22:10.935 INFO:teuthology.orchestra.run.smithi119.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-21T01:22:10.935 INFO:teuthology.orchestra.run.smithi119.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-21T01:22:10.935 INFO:teuthology.orchestra.run.smithi119.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-21T01:22:10.935 INFO:teuthology.orchestra.run.smithi119.stdout:hardware devices. 2024-09-21T01:22:10.935 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-21T01:22:10.935 INFO:teuthology.orchestra.run.smithi119.stdout:This subpackage provides tools for support of all platforms. 2024-09-21T01:22:10.935 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-21T01:22:10.936 INFO:teuthology.task.kernel:Updating grub on smithi119 to boot 5.14.0-508.el9.x86_64 2024-09-21T01:22:10.936 DEBUG:teuthology.orchestra.run.smithi119:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-21T01:22:11.558 INFO:teuthology.orchestra.run.smithi119.stderr:Generating grub configuration file ... 2024-09-21T01:22:12.899 INFO:teuthology.orchestra.run.smithi119.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-21T01:22:12.928 INFO:teuthology.orchestra.run.smithi119.stderr:done 2024-09-21T01:22:12.930 DEBUG:teuthology.orchestra.run.smithi119:> mktemp 2024-09-21T01:22:12.947 INFO:teuthology.orchestra.run.smithi119.stdout:/tmp/tmp.E1FFUvdTn3 2024-09-21T01:22:12.947 DEBUG:teuthology.orchestra.run.smithi119:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.E1FFUvdTn3 2024-09-21T01:22:13.014 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod 0666 /tmp/tmp.E1FFUvdTn3 2024-09-21T01:22:13.159 DEBUG:teuthology.orchestra.remote:smithi119:/tmp/tmp.E1FFUvdTn3 is 6KB 2024-09-21T01:22:13.206 DEBUG:teuthology.orchestra.run.smithi119:> rm -fr /tmp/tmp.E1FFUvdTn3 2024-09-21T01:22:13.220 DEBUG:teuthology.orchestra.run.smithi119:> sudo /bin/ls /boot/loader/entries || true 2024-09-21T01:22:13.283 INFO:teuthology.orchestra.run.smithi119.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-21T01:22:13.283 INFO:teuthology.orchestra.run.smithi119.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-21T01:22:13.283 INFO:teuthology.orchestra.run.smithi119.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-21T01:22:13.283 INFO:teuthology.orchestra.run.smithi119.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-21T01:22:13.284 DEBUG:teuthology.orchestra.run.smithi119:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-21T01:22:13.440 DEBUG:teuthology.orchestra.run.smithi119:> sudo shutdown -r now 2024-09-21T01:22:36.449 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2024-09-21T01:22:36.449 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi142.front.sepia.ceph.com' 2024-09-21T01:22:36.449 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T01:22:38.289 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-21T01:22:38.289 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi083.front.sepia.ceph.com' 2024-09-21T01:22:38.290 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T01:22:43.448 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-09-21T01:22:43.448 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2024-09-21T01:22:43.449 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T01:22:54.835 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.142 2024-09-21T01:22:56.623 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.83 2024-09-21T01:23:01.999 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.119 2024-09-21T01:23:03.838 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi142.front.sepia.ceph.com' 2024-09-21T01:23:03.838 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T01:23:05.626 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi083.front.sepia.ceph.com' 2024-09-21T01:23:05.626 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T01:23:06.895 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.142 2024-09-21T01:23:08.687 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.83 2024-09-21T01:23:11.001 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2024-09-21T01:23:11.002 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T01:23:14.063 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.119 2024-09-21T01:23:18.898 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi142.front.sepia.ceph.com' 2024-09-21T01:23:18.899 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T01:23:20.689 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi083.front.sepia.ceph.com' 2024-09-21T01:23:20.690 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T01:23:26.066 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2024-09-21T01:23:26.067 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T01:23:37.327 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.142 2024-09-21T01:23:39.119 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.83 2024-09-21T01:23:52.340 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi142.front.sepia.ceph.com' 2024-09-21T01:23:52.340 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T01:23:52.708 DEBUG:teuthology.orchestra.run.smithi142:> true 2024-09-21T01:23:53.080 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi142.front.sepia.ceph.com' 2024-09-21T01:23:53.080 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-508.el9.x86_64"... 2024-09-21T01:23:53.080 DEBUG:teuthology.orchestra.run.smithi142:> uname -r 2024-09-21T01:23:53.094 INFO:teuthology.orchestra.run.smithi142.stdout:5.14.0-508.el9.x86_64 2024-09-21T01:23:53.094 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-21T01:23:53.094 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-21T01:23:53.094 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-21T01:23:54.095 INFO:teuthology.task.kernel:Enabling kdb on mon.c... 2024-09-21T01:23:54.095 DEBUG:teuthology.orchestra.run.smithi142:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-21T01:23:54.119 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi083.front.sepia.ceph.com' 2024-09-21T01:23:54.120 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T01:23:54.220 INFO:teuthology.orchestra.run.smithi142.stdout:ttyS1 2024-09-21T01:23:54.245 DEBUG:teuthology.parallel:result is None 2024-09-21T01:23:54.398 DEBUG:teuthology.orchestra.run.smithi083:> true 2024-09-21T01:23:54.937 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi083.front.sepia.ceph.com' 2024-09-21T01:23:54.938 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-508.el9.x86_64"... 2024-09-21T01:23:54.938 DEBUG:teuthology.orchestra.run.smithi083:> uname -r 2024-09-21T01:23:54.983 INFO:teuthology.orchestra.run.smithi083.stdout:5.14.0-508.el9.x86_64 2024-09-21T01:23:54.984 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-21T01:23:54.984 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-21T01:23:54.984 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-21T01:23:55.984 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-21T01:23:55.985 DEBUG:teuthology.orchestra.run.smithi083:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-21T01:23:56.071 INFO:teuthology.orchestra.run.smithi083.stdout:ttyS1 2024-09-21T01:23:56.095 DEBUG:teuthology.parallel:result is None 2024-09-21T01:23:57.909 DEBUG:teuthology.orchestra.run.smithi119:> true 2024-09-21T01:23:58.297 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi119.front.sepia.ceph.com' 2024-09-21T01:23:58.297 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-508.el9.x86_64"... 2024-09-21T01:23:58.297 DEBUG:teuthology.orchestra.run.smithi119:> uname -r 2024-09-21T01:23:58.312 INFO:teuthology.orchestra.run.smithi119.stdout:5.14.0-508.el9.x86_64 2024-09-21T01:23:58.312 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-21T01:23:58.312 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-21T01:23:58.312 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-21T01:23:59.313 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-09-21T01:23:59.314 DEBUG:teuthology.orchestra.run.smithi119:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-21T01:23:59.400 INFO:teuthology.orchestra.run.smithi119.stdout:ttyS1 2024-09-21T01:23:59.428 DEBUG:teuthology.parallel:result is None 2024-09-21T01:23:59.428 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-21T01:23:59.436 INFO:teuthology.task.internal:Creating test directory... 2024-09-21T01:23:59.436 DEBUG:teuthology.orchestra.run.smithi083:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-21T01:23:59.438 DEBUG:teuthology.orchestra.run.smithi119:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-21T01:23:59.441 DEBUG:teuthology.orchestra.run.smithi142:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-21T01:23:59.459 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-21T01:23:59.520 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-21T01:23:59.528 INFO:teuthology.task.internal:Creating archive directory... 2024-09-21T01:23:59.529 DEBUG:teuthology.orchestra.run.smithi083:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-21T01:23:59.531 DEBUG:teuthology.orchestra.run.smithi119:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-21T01:23:59.533 DEBUG:teuthology.orchestra.run.smithi142:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-21T01:23:59.663 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-21T01:23:59.670 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-21T01:23:59.670 DEBUG:teuthology.orchestra.run.smithi083:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-21T01:23:59.672 DEBUG:teuthology.orchestra.run.smithi119:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-21T01:23:59.675 DEBUG:teuthology.orchestra.run.smithi142:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-21T01:23:59.704 INFO:teuthology.orchestra.run.smithi083.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T01:23:59.708 INFO:teuthology.orchestra.run.smithi142.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T01:23:59.713 INFO:teuthology.orchestra.run.smithi119.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T01:23:59.715 INFO:teuthology.orchestra.run.smithi083.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T01:23:59.720 INFO:teuthology.orchestra.run.smithi142.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T01:23:59.723 INFO:teuthology.orchestra.run.smithi119.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T01:23:59.724 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-21T01:23:59.731 INFO:teuthology.task.internal:Configuring sudo... 2024-09-21T01:23:59.731 DEBUG:teuthology.orchestra.run.smithi083:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-21T01:23:59.759 DEBUG:teuthology.orchestra.run.smithi119:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-21T01:23:59.768 DEBUG:teuthology.orchestra.run.smithi142:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-21T01:23:59.810 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-21T01:23:59.818 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-21T01:23:59.818 DEBUG:teuthology.orchestra.run.smithi083:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-21T01:23:59.827 DEBUG:teuthology.orchestra.run.smithi119:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-21T01:23:59.852 DEBUG:teuthology.orchestra.run.smithi142:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-21T01:23:59.868 DEBUG:teuthology.orchestra.run.smithi083:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T01:23:59.922 DEBUG:teuthology.orchestra.run.smithi083:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T01:23:59.979 DEBUG:teuthology.orchestra.run.smithi083:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T01:24:00.060 DEBUG:teuthology.orchestra.run.smithi083:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T01:24:00.103 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-09-21T01:24:00.103 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-21T01:24:00.169 DEBUG:teuthology.orchestra.run.smithi119:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T01:24:00.210 DEBUG:teuthology.orchestra.run.smithi119:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T01:24:00.317 DEBUG:teuthology.orchestra.run.smithi119:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T01:24:00.359 DEBUG:teuthology.orchestra.run.smithi119:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T01:24:00.398 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-21T01:24:00.398 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-21T01:24:00.462 DEBUG:teuthology.orchestra.run.smithi142:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T01:24:00.507 DEBUG:teuthology.orchestra.run.smithi142:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T01:24:00.559 DEBUG:teuthology.orchestra.run.smithi142:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T01:24:00.642 DEBUG:teuthology.orchestra.run.smithi142:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T01:24:00.685 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-09-21T01:24:00.686 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-21T01:24:00.751 DEBUG:teuthology.orchestra.run.smithi083:> sudo service rsyslog restart 2024-09-21T01:24:00.754 DEBUG:teuthology.orchestra.run.smithi119:> sudo service rsyslog restart 2024-09-21T01:24:00.756 DEBUG:teuthology.orchestra.run.smithi142:> sudo service rsyslog restart 2024-09-21T01:24:00.802 INFO:teuthology.orchestra.run.smithi083.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T01:24:00.808 INFO:teuthology.orchestra.run.smithi119.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T01:24:00.843 INFO:teuthology.orchestra.run.smithi142.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T01:24:01.321 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-21T01:24:01.328 INFO:teuthology.task.internal:Starting timer... 2024-09-21T01:24:01.328 INFO:teuthology.run_tasks:Running task pcp... 2024-09-21T01:24:01.338 INFO:teuthology.run_tasks:Running task selinux... 2024-09-21T01:24:01.345 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0']} 2024-09-21T01:24:01.346 DEBUG:teuthology.orchestra.run.smithi083:> sudo service auditd rotate 2024-09-21T01:24:01.386 INFO:teuthology.orchestra.run.smithi083.stdout:Rotating logs: 2024-09-21T01:24:01.387 DEBUG:teuthology.orchestra.run.smithi119:> sudo service auditd rotate 2024-09-21T01:24:01.529 INFO:teuthology.orchestra.run.smithi119.stdout:Rotating logs: 2024-09-21T01:24:01.533 DEBUG:teuthology.orchestra.run.smithi142:> sudo service auditd rotate 2024-09-21T01:24:01.575 INFO:teuthology.orchestra.run.smithi142.stdout:Rotating logs: 2024-09-21T01:24:01.577 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-21T01:24:01.577 DEBUG:teuthology.orchestra.run.smithi083:> /usr/sbin/getenforce 2024-09-21T01:24:01.624 INFO:teuthology.orchestra.run.smithi083.stdout:Permissive 2024-09-21T01:24:01.624 DEBUG:teuthology.orchestra.run.smithi119:> /usr/sbin/getenforce 2024-09-21T01:24:01.699 INFO:teuthology.orchestra.run.smithi119.stdout:Permissive 2024-09-21T01:24:01.699 DEBUG:teuthology.orchestra.run.smithi142:> /usr/sbin/getenforce 2024-09-21T01:24:01.731 INFO:teuthology.orchestra.run.smithi142.stdout:Permissive 2024-09-21T01:24:01.731 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi083.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi119.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi142.front.sepia.ceph.com': 'permissive'} 2024-09-21T01:24:01.732 DEBUG:teuthology.orchestra.run.smithi083:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T01:24:01.761 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T01:24:01.762 DEBUG:teuthology.orchestra.run.smithi119:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T01:24:01.825 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T01:24:01.825 DEBUG:teuthology.orchestra.run.smithi142:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T01:24:01.853 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T01:24:01.854 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-21T01:24:01.854 DEBUG:teuthology.orchestra.run.smithi083:> sudo /usr/sbin/setenforce permissive 2024-09-21T01:24:01.883 DEBUG:teuthology.orchestra.run.smithi119:> sudo /usr/sbin/setenforce permissive 2024-09-21T01:24:01.913 DEBUG:teuthology.orchestra.run.smithi142:> sudo /usr/sbin/setenforce permissive 2024-09-21T01:24:01.948 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-21T01:24:01.957 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-21T01:24:01.959 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-21T01:24:02.060 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-21T01:24:02.069 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-21T01:24:02.070 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi083.front.sepia.ceph.com,smithi119.front.sepia.ceph.com,smithi142.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-21T01:27:52.223 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi083.front.sepia.ceph.com'), Remote(name='ubuntu@smithi119.front.sepia.ceph.com'), Remote(name='ubuntu@smithi142.front.sepia.ceph.com')] 2024-09-21T01:27:52.224 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi083.front.sepia.ceph.com' 2024-09-21T01:27:52.225 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T01:27:52.300 DEBUG:teuthology.orchestra.run.smithi083:> true 2024-09-21T01:27:52.378 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi083.front.sepia.ceph.com' 2024-09-21T01:27:52.378 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2024-09-21T01:27:52.379 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T01:27:52.453 DEBUG:teuthology.orchestra.run.smithi119:> true 2024-09-21T01:27:52.542 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi119.front.sepia.ceph.com' 2024-09-21T01:27:52.542 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi142.front.sepia.ceph.com' 2024-09-21T01:27:52.543 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T01:27:52.622 DEBUG:teuthology.orchestra.run.smithi142:> true 2024-09-21T01:27:52.702 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi142.front.sepia.ceph.com' 2024-09-21T01:27:52.702 INFO:teuthology.run_tasks:Running task clock... 2024-09-21T01:27:52.713 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-21T01:27:52.713 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-21T01:27:52.713 DEBUG:teuthology.orchestra.run.smithi083:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T01:27:52.715 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-21T01:27:52.716 DEBUG:teuthology.orchestra.run.smithi119:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T01:27:52.718 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-21T01:27:52.718 DEBUG:teuthology.orchestra.run.smithi142:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T01:27:52.743 INFO:teuthology.orchestra.run.smithi083.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-21T01:27:52.745 INFO:teuthology.orchestra.run.smithi119.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-21T01:27:52.758 INFO:teuthology.orchestra.run.smithi083.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-21T01:27:52.760 INFO:teuthology.orchestra.run.smithi119.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-21T01:27:52.773 INFO:teuthology.orchestra.run.smithi142.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-21T01:27:52.784 INFO:teuthology.orchestra.run.smithi119.stderr:sudo: ntpd: command not found 2024-09-21T01:27:52.784 INFO:teuthology.orchestra.run.smithi083.stderr:sudo: ntpd: command not found 2024-09-21T01:27:52.789 INFO:teuthology.orchestra.run.smithi142.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-21T01:27:52.795 INFO:teuthology.orchestra.run.smithi119.stdout:506 Cannot talk to daemon 2024-09-21T01:27:52.795 INFO:teuthology.orchestra.run.smithi083.stdout:506 Cannot talk to daemon 2024-09-21T01:27:52.809 INFO:teuthology.orchestra.run.smithi119.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-21T01:27:52.810 INFO:teuthology.orchestra.run.smithi083.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-21T01:27:52.814 INFO:teuthology.orchestra.run.smithi142.stderr:sudo: ntpd: command not found 2024-09-21T01:27:52.823 INFO:teuthology.orchestra.run.smithi119.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-21T01:27:52.824 INFO:teuthology.orchestra.run.smithi083.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-21T01:27:52.826 INFO:teuthology.orchestra.run.smithi142.stdout:506 Cannot talk to daemon 2024-09-21T01:27:52.840 INFO:teuthology.orchestra.run.smithi142.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-21T01:27:52.854 INFO:teuthology.orchestra.run.smithi142.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-21T01:27:52.876 INFO:teuthology.orchestra.run.smithi119.stderr:bash: line 1: ntpq: command not found 2024-09-21T01:27:52.878 INFO:teuthology.orchestra.run.smithi083.stderr:bash: line 1: ntpq: command not found 2024-09-21T01:27:52.879 INFO:teuthology.orchestra.run.smithi119.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T01:27:52.879 INFO:teuthology.orchestra.run.smithi119.stdout:=============================================================================== 2024-09-21T01:27:52.880 INFO:teuthology.orchestra.run.smithi119.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T01:27:52.880 INFO:teuthology.orchestra.run.smithi119.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T01:27:52.880 INFO:teuthology.orchestra.run.smithi119.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T01:27:52.880 INFO:teuthology.orchestra.run.smithi119.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T01:27:52.881 INFO:teuthology.orchestra.run.smithi083.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T01:27:52.881 INFO:teuthology.orchestra.run.smithi083.stdout:=============================================================================== 2024-09-21T01:27:52.881 INFO:teuthology.orchestra.run.smithi083.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T01:27:52.881 INFO:teuthology.orchestra.run.smithi083.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T01:27:52.881 INFO:teuthology.orchestra.run.smithi083.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T01:27:52.881 INFO:teuthology.orchestra.run.smithi083.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T01:27:52.913 INFO:teuthology.orchestra.run.smithi142.stderr:bash: line 1: ntpq: command not found 2024-09-21T01:27:52.916 INFO:teuthology.orchestra.run.smithi142.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T01:27:52.916 INFO:teuthology.orchestra.run.smithi142.stdout:=============================================================================== 2024-09-21T01:27:52.916 INFO:teuthology.orchestra.run.smithi142.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T01:27:52.916 INFO:teuthology.orchestra.run.smithi142.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T01:27:52.916 INFO:teuthology.orchestra.run.smithi142.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T01:27:52.916 INFO:teuthology.orchestra.run.smithi142.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T01:27:52.917 INFO:teuthology.run_tasks:Running task install... 2024-09-21T01:27:52.924 DEBUG:teuthology.task.install:project ceph 2024-09-21T01:27:52.924 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '1843221895adccfb3b692060251dd6a0183bc410'}} 2024-09-21T01:27:52.924 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '1843221895adccfb3b692060251dd6a0183bc410'} 2024-09-21T01:27:52.924 INFO:teuthology.task.install:Using flavor: default 2024-09-21T01:27:52.930 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-21T01:27:52.930 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-21T01:27:52.930 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'tag': None, 'wait_for_package': False} 2024-09-21T01:27:52.931 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T01:27:52.932 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'tag': None, 'wait_for_package': False} 2024-09-21T01:27:52.932 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T01:27:52.933 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'tag': None, 'wait_for_package': False} 2024-09-21T01:27:52.933 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T01:27:53.089 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/ 2024-09-21T01:27:53.090 INFO:teuthology.task.install.rpm:Package version is 19.3.0-5120.g18432218 2024-09-21T01:27:53.093 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/ 2024-09-21T01:27:53.093 INFO:teuthology.task.install.rpm:Package version is 19.3.0-5120.g18432218 2024-09-21T01:27:53.097 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/ 2024-09-21T01:27:53.097 INFO:teuthology.task.install.rpm:Package version is 19.3.0-5120.g18432218 2024-09-21T01:27:53.197 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-21T01:27:53.198 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-09-21T01:27:53.198 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-21T01:27:53.206 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-21T01:27:53.207 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-21T01:27:53.207 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-21T01:27:53.210 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-21T01:27:53.210 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-09-21T01:27:53.210 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-21T01:27:53.224 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-21T01:27:53.225 DEBUG:teuthology.orchestra.run.smithi142:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1843221895adccfb3b692060251dd6a0183bc410/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-21T01:27:53.232 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-21T01:27:53.232 DEBUG:teuthology.orchestra.run.smithi119:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1843221895adccfb3b692060251dd6a0183bc410/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-21T01:27:53.237 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-21T01:27:53.237 DEBUG:teuthology.orchestra.run.smithi083:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1843221895adccfb3b692060251dd6a0183bc410/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-21T01:27:53.290 DEBUG:teuthology.orchestra.run.smithi142:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-21T01:27:53.299 DEBUG:teuthology.orchestra.run.smithi119:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-21T01:27:53.303 DEBUG:teuthology.orchestra.run.smithi083:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-21T01:27:53.366 DEBUG:teuthology.orchestra.run.smithi142:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-21T01:27:53.374 DEBUG:teuthology.orchestra.run.smithi119:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-21T01:27:53.379 DEBUG:teuthology.orchestra.run.smithi083:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-21T01:27:53.429 INFO:teuthology.orchestra.run.smithi142.stdout:check_obsoletes = 1 2024-09-21T01:27:53.431 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum clean all 2024-09-21T01:27:53.437 INFO:teuthology.orchestra.run.smithi119.stdout:check_obsoletes = 1 2024-09-21T01:27:53.439 DEBUG:teuthology.orchestra.run.smithi119:> sudo yum clean all 2024-09-21T01:27:53.444 INFO:teuthology.orchestra.run.smithi083.stdout:check_obsoletes = 1 2024-09-21T01:27:53.445 DEBUG:teuthology.orchestra.run.smithi083:> sudo yum clean all 2024-09-21T01:27:53.658 INFO:teuthology.orchestra.run.smithi142.stdout:45 files removed 2024-09-21T01:27:53.670 INFO:teuthology.orchestra.run.smithi119.stdout:45 files removed 2024-09-21T01:27:53.675 INFO:teuthology.orchestra.run.smithi083.stdout:45 files removed 2024-09-21T01:27:53.685 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-21T01:27:53.697 DEBUG:teuthology.orchestra.run.smithi119:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-21T01:27:53.702 DEBUG:teuthology.orchestra.run.smithi083:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-21T01:27:54.237 INFO:teuthology.orchestra.run.smithi119.stdout:ceph packages for x86_64 333 kB/s | 84 kB 00:00 2024-09-21T01:27:54.246 INFO:teuthology.orchestra.run.smithi142.stdout:ceph packages for x86_64 304 kB/s | 84 kB 00:00 2024-09-21T01:27:54.250 INFO:teuthology.orchestra.run.smithi083.stdout:ceph packages for x86_64 320 kB/s | 84 kB 00:00 2024-09-21T01:27:54.521 INFO:teuthology.orchestra.run.smithi119.stdout:ceph noarch packages 101 kB/s | 24 kB 00:00 2024-09-21T01:27:54.530 INFO:teuthology.orchestra.run.smithi142.stdout:ceph noarch packages 100 kB/s | 24 kB 00:00 2024-09-21T01:27:54.534 INFO:teuthology.orchestra.run.smithi083.stdout:ceph noarch packages 100 kB/s | 24 kB 00:00 2024-09-21T01:27:54.788 INFO:teuthology.orchestra.run.smithi119.stdout:ceph source packages 8.3 kB/s | 1.9 kB 00:00 2024-09-21T01:27:54.814 INFO:teuthology.orchestra.run.smithi142.stdout:ceph source packages 7.7 kB/s | 1.9 kB 00:00 2024-09-21T01:27:54.818 INFO:teuthology.orchestra.run.smithi083.stdout:ceph source packages 7.7 kB/s | 1.9 kB 00:00 2024-09-21T01:27:55.339 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Stream 9 - BaseOS 17 MB/s | 8.3 MB 00:00 2024-09-21T01:27:55.485 INFO:teuthology.orchestra.run.smithi083.stdout:CentOS Stream 9 - BaseOS 13 MB/s | 8.3 MB 00:00 2024-09-21T01:27:55.555 INFO:teuthology.orchestra.run.smithi119.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.3 MB 00:00 2024-09-21T01:27:57.307 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Stream 9 - AppStream 22 MB/s | 20 MB 00:00 2024-09-21T01:27:57.470 INFO:teuthology.orchestra.run.smithi083.stdout:CentOS Stream 9 - AppStream 22 MB/s | 20 MB 00:00 2024-09-21T01:28:01.791 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Stream 9 - CRB 11 MB/s | 6.5 MB 00:00 2024-09-21T01:28:03.358 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Stream 9 - Extras packages 81 kB/s | 19 kB 00:00 2024-09-21T01:28:04.304 INFO:teuthology.orchestra.run.smithi142.stdout:Extra Packages for Enterprise Linux 28 MB/s | 23 MB 00:00 2024-09-21T01:28:04.354 INFO:teuthology.orchestra.run.smithi083.stdout:CentOS Stream 9 - CRB 2.1 MB/s | 6.5 MB 00:03 2024-09-21T01:28:05.913 INFO:teuthology.orchestra.run.smithi083.stdout:CentOS Stream 9 - Extras packages 105 kB/s | 19 kB 00:00 2024-09-21T01:28:07.159 INFO:teuthology.orchestra.run.smithi083.stdout:Extra Packages for Enterprise Linux 20 MB/s | 23 MB 00:01 2024-09-21T01:28:08.013 INFO:teuthology.orchestra.run.smithi119.stdout:CentOS Stream 9 - AppStream 1.8 MB/s | 20 MB 00:11 2024-09-21T01:28:09.760 INFO:teuthology.orchestra.run.smithi142.stdout:lab-extras 20 kB/s | 1.7 kB 00:00 2024-09-21T01:28:11.998 INFO:teuthology.orchestra.run.smithi142.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T01:28:11.999 INFO:teuthology.orchestra.run.smithi142.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T01:28:12.012 INFO:teuthology.orchestra.run.smithi142.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-21T01:28:12.013 INFO:teuthology.orchestra.run.smithi142.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-21T01:28:12.014 INFO:teuthology.orchestra.run.smithi142.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-21T01:28:12.015 INFO:teuthology.orchestra.run.smithi142.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-21T01:28:12.017 INFO:teuthology.orchestra.run.smithi142.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-21T01:28:12.019 INFO:teuthology.orchestra.run.smithi142.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-21T01:28:12.020 INFO:teuthology.orchestra.run.smithi142.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-21T01:28:12.083 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-09-21T01:28:12.098 INFO:teuthology.orchestra.run.smithi142.stdout:======================================================================================= 2024-09-21T01:28:12.098 INFO:teuthology.orchestra.run.smithi142.stdout: Package Arch Version Repository Size 2024-09-21T01:28:12.098 INFO:teuthology.orchestra.run.smithi142.stdout:======================================================================================= 2024-09-21T01:28:12.098 INFO:teuthology.orchestra.run.smithi142.stdout:Installing: 2024-09-21T01:28:12.098 INFO:teuthology.orchestra.run.smithi142.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-21T01:28:12.098 INFO:teuthology.orchestra.run.smithi142.stdout: ceph x86_64 2:19.3.0-5120.g18432218.el9 ceph 6.6 k 2024-09-21T01:28:12.098 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-base x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.5 M 2024-09-21T01:28:12.098 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 873 k 2024-09-21T01:28:12.098 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T01:28:12.098 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr x86_64 2:19.3.0-5120.g18432218.el9 ceph 1.5 M 2024-09-21T01:28:12.099 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 154 k 2024-09-21T01:28:12.099 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-dashboard noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 14 M 2024-09-21T01:28:12.099 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 7.4 M 2024-09-21T01:28:12.099 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-rook noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 49 k 2024-09-21T01:28:12.099 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-radosgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 10 M 2024-09-21T01:28:12.099 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-test x86_64 2:19.3.0-5120.g18432218.el9 ceph 40 M 2024-09-21T01:28:12.099 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-volume noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 285 k 2024-09-21T01:28:12.099 INFO:teuthology.orchestra.run.smithi142.stdout: cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 784 k 2024-09-21T01:28:12.099 INFO:teuthology.orchestra.run.smithi142.stdout: cephfs-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 226 k 2024-09-21T01:28:12.100 INFO:teuthology.orchestra.run.smithi142.stdout: cephfs-shell x86_64 2:19.3.0-5120.g18432218.el9 ceph 27 k 2024-09-21T01:28:12.100 INFO:teuthology.orchestra.run.smithi142.stdout: cephfs-top noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 18 k 2024-09-21T01:28:12.100 INFO:teuthology.orchestra.run.smithi142.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-21T01:28:12.100 INFO:teuthology.orchestra.run.smithi142.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-21T01:28:12.100 INFO:teuthology.orchestra.run.smithi142.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-21T01:28:12.100 INFO:teuthology.orchestra.run.smithi142.stdout: libcephfs-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 32 k 2024-09-21T01:28:12.100 INFO:teuthology.orchestra.run.smithi142.stdout: libcephfs2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 766 k 2024-09-21T01:28:12.101 INFO:teuthology.orchestra.run.smithi142.stdout: librados-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 127 k 2024-09-21T01:28:12.101 INFO:teuthology.orchestra.run.smithi142.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-21T01:28:12.101 INFO:teuthology.orchestra.run.smithi142.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-21T01:28:12.101 INFO:teuthology.orchestra.run.smithi142.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-21T01:28:12.101 INFO:teuthology.orchestra.run.smithi142.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-21T01:28:12.101 INFO:teuthology.orchestra.run.smithi142.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-21T01:28:12.101 INFO:teuthology.orchestra.run.smithi142.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-21T01:28:12.101 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cephfs x86_64 2:19.3.0-5120.g18432218.el9 ceph 161 k 2024-09-21T01:28:12.101 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rados x86_64 2:19.3.0-5120.g18432218.el9 ceph 321 k 2024-09-21T01:28:12.101 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 307 k 2024-09-21T01:28:12.101 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 99 k 2024-09-21T01:28:12.101 INFO:teuthology.orchestra.run.smithi142.stdout: rbd-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 86 k 2024-09-21T01:28:12.102 INFO:teuthology.orchestra.run.smithi142.stdout: rbd-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.1 M 2024-09-21T01:28:12.102 INFO:teuthology.orchestra.run.smithi142.stdout: rbd-nbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 170 k 2024-09-21T01:28:12.102 INFO:teuthology.orchestra.run.smithi142.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-21T01:28:12.102 INFO:teuthology.orchestra.run.smithi142.stdout:Upgrading: 2024-09-21T01:28:12.102 INFO:teuthology.orchestra.run.smithi142.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-21T01:28:12.102 INFO:teuthology.orchestra.run.smithi142.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-21T01:28:12.102 INFO:teuthology.orchestra.run.smithi142.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-21T01:28:12.102 INFO:teuthology.orchestra.run.smithi142.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-21T01:28:12.102 INFO:teuthology.orchestra.run.smithi142.stdout: librados2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.4 M 2024-09-21T01:28:12.102 INFO:teuthology.orchestra.run.smithi142.stdout: librbd1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.2 M 2024-09-21T01:28:12.102 INFO:teuthology.orchestra.run.smithi142.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-21T01:28:12.102 INFO:teuthology.orchestra.run.smithi142.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-21T01:28:12.102 INFO:teuthology.orchestra.run.smithi142.stdout:Installing dependencies: 2024-09-21T01:28:12.102 INFO:teuthology.orchestra.run.smithi142.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-21T01:28:12.103 INFO:teuthology.orchestra.run.smithi142.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-21T01:28:12.103 INFO:teuthology.orchestra.run.smithi142.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-21T01:28:12.103 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 20 M 2024-09-21T01:28:12.103 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-grafana-dashboards noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 34 k 2024-09-21T01:28:12.103 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mds x86_64 2:19.3.0-5120.g18432218.el9 ceph 2.3 M 2024-09-21T01:28:12.103 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-modules-core noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 292 k 2024-09-21T01:28:12.103 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mon x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.0 M 2024-09-21T01:28:12.103 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-osd x86_64 2:19.3.0-5120.g18432218.el9 ceph 18 M 2024-09-21T01:28:12.103 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-prometheus-alerts noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 16 k 2024-09-21T01:28:12.103 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-selinux x86_64 2:19.3.0-5120.g18432218.el9 ceph 25 k 2024-09-21T01:28:12.103 INFO:teuthology.orchestra.run.smithi142.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-21T01:28:12.103 INFO:teuthology.orchestra.run.smithi142.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-21T01:28:12.104 INFO:teuthology.orchestra.run.smithi142.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-21T01:28:12.104 INFO:teuthology.orchestra.run.smithi142.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-21T01:28:12.104 INFO:teuthology.orchestra.run.smithi142.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-21T01:28:12.104 INFO:teuthology.orchestra.run.smithi142.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-21T01:28:12.104 INFO:teuthology.orchestra.run.smithi142.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-21T01:28:12.104 INFO:teuthology.orchestra.run.smithi142.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-21T01:28:12.104 INFO:teuthology.orchestra.run.smithi142.stdout: libcephsqlite x86_64 2:19.3.0-5120.g18432218.el9 ceph 158 k 2024-09-21T01:28:12.104 INFO:teuthology.orchestra.run.smithi142.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-21T01:28:12.104 INFO:teuthology.orchestra.run.smithi142.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-21T01:28:12.104 INFO:teuthology.orchestra.run.smithi142.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-21T01:28:12.104 INFO:teuthology.orchestra.run.smithi142.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-21T01:28:12.105 INFO:teuthology.orchestra.run.smithi142.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-21T01:28:12.105 INFO:teuthology.orchestra.run.smithi142.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-21T01:28:12.105 INFO:teuthology.orchestra.run.smithi142.stdout: libradosstriper1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 507 k 2024-09-21T01:28:12.105 INFO:teuthology.orchestra.run.smithi142.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-21T01:28:12.105 INFO:teuthology.orchestra.run.smithi142.stdout: librgw2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.3 M 2024-09-21T01:28:12.105 INFO:teuthology.orchestra.run.smithi142.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-21T01:28:12.105 INFO:teuthology.orchestra.run.smithi142.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-21T01:28:12.105 INFO:teuthology.orchestra.run.smithi142.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-21T01:28:12.105 INFO:teuthology.orchestra.run.smithi142.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-21T01:28:12.105 INFO:teuthology.orchestra.run.smithi142.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-21T01:28:12.105 INFO:teuthology.orchestra.run.smithi142.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-21T01:28:12.105 INFO:teuthology.orchestra.run.smithi142.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-21T01:28:12.105 INFO:teuthology.orchestra.run.smithi142.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-21T01:28:12.105 INFO:teuthology.orchestra.run.smithi142.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-21T01:28:12.106 INFO:teuthology.orchestra.run.smithi142.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-21T01:28:12.106 INFO:teuthology.orchestra.run.smithi142.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-21T01:28:12.106 INFO:teuthology.orchestra.run.smithi142.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-21T01:28:12.106 INFO:teuthology.orchestra.run.smithi142.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-21T01:28:12.106 INFO:teuthology.orchestra.run.smithi142.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-21T01:28:12.106 INFO:teuthology.orchestra.run.smithi142.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-21T01:28:12.106 INFO:teuthology.orchestra.run.smithi142.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-21T01:28:12.106 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-21T01:28:12.106 INFO:teuthology.orchestra.run.smithi142.stdout: python3-ceph-argparse x86_64 2:19.3.0-5120.g18432218.el9 ceph 45 k 2024-09-21T01:28:12.106 INFO:teuthology.orchestra.run.smithi142.stdout: python3-ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T01:28:12.106 INFO:teuthology.orchestra.run.smithi142.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-21T01:28:12.106 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-21T01:28:12.107 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-21T01:28:12.107 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-21T01:28:12.107 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-21T01:28:12.107 INFO:teuthology.orchestra.run.smithi142.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-21T01:28:12.107 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-21T01:28:12.107 INFO:teuthology.orchestra.run.smithi142.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-21T01:28:12.107 INFO:teuthology.orchestra.run.smithi142.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-21T01:28:12.107 INFO:teuthology.orchestra.run.smithi142.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-21T01:28:12.107 INFO:teuthology.orchestra.run.smithi142.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-21T01:28:12.107 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-21T01:28:12.107 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-21T01:28:12.107 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-21T01:28:12.107 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-21T01:28:12.108 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-21T01:28:12.108 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-21T01:28:12.108 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-21T01:28:12.108 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-21T01:28:12.108 INFO:teuthology.orchestra.run.smithi142.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-21T01:28:12.108 INFO:teuthology.orchestra.run.smithi142.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-21T01:28:12.108 INFO:teuthology.orchestra.run.smithi142.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-21T01:28:12.108 INFO:teuthology.orchestra.run.smithi142.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-21T01:28:12.108 INFO:teuthology.orchestra.run.smithi142.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-21T01:28:12.108 INFO:teuthology.orchestra.run.smithi142.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-21T01:28:12.108 INFO:teuthology.orchestra.run.smithi142.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-21T01:28:12.108 INFO:teuthology.orchestra.run.smithi142.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-21T01:28:12.108 INFO:teuthology.orchestra.run.smithi142.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-21T01:28:12.109 INFO:teuthology.orchestra.run.smithi142.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-21T01:28:12.109 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-21T01:28:12.109 INFO:teuthology.orchestra.run.smithi142.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-21T01:28:12.109 INFO:teuthology.orchestra.run.smithi142.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-21T01:28:12.109 INFO:teuthology.orchestra.run.smithi142.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-21T01:28:12.109 INFO:teuthology.orchestra.run.smithi142.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-21T01:28:12.109 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-21T01:28:12.109 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-21T01:28:12.109 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-21T01:28:12.110 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-21T01:28:12.110 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-21T01:28:12.110 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-21T01:28:12.110 INFO:teuthology.orchestra.run.smithi142.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-21T01:28:12.110 INFO:teuthology.orchestra.run.smithi142.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-21T01:28:12.110 INFO:teuthology.orchestra.run.smithi142.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-21T01:28:12.110 INFO:teuthology.orchestra.run.smithi142.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-21T01:28:12.110 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-21T01:28:12.110 INFO:teuthology.orchestra.run.smithi142.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-21T01:28:12.110 INFO:teuthology.orchestra.run.smithi142.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-21T01:28:12.110 INFO:teuthology.orchestra.run.smithi142.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-21T01:28:12.110 INFO:teuthology.orchestra.run.smithi142.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-21T01:28:12.110 INFO:teuthology.orchestra.run.smithi142.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-21T01:28:12.111 INFO:teuthology.orchestra.run.smithi142.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-21T01:28:12.111 INFO:teuthology.orchestra.run.smithi142.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-21T01:28:12.111 INFO:teuthology.orchestra.run.smithi142.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-21T01:28:12.111 INFO:teuthology.orchestra.run.smithi142.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-21T01:28:12.111 INFO:teuthology.orchestra.run.smithi142.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-21T01:28:12.111 INFO:teuthology.orchestra.run.smithi142.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-21T01:28:12.111 INFO:teuthology.orchestra.run.smithi142.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-21T01:28:12.111 INFO:teuthology.orchestra.run.smithi142.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-21T01:28:12.111 INFO:teuthology.orchestra.run.smithi142.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-21T01:28:12.111 INFO:teuthology.orchestra.run.smithi142.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-21T01:28:12.111 INFO:teuthology.orchestra.run.smithi142.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-21T01:28:12.111 INFO:teuthology.orchestra.run.smithi142.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-21T01:28:12.111 INFO:teuthology.orchestra.run.smithi142.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-21T01:28:12.112 INFO:teuthology.orchestra.run.smithi142.stdout:Installing weak dependencies: 2024-09-21T01:28:12.112 INFO:teuthology.orchestra.run.smithi142.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-21T01:28:12.112 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-21T01:28:12.112 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2024-09-21T01:28:12.112 INFO:teuthology.orchestra.run.smithi142.stdout:======================================================================================= 2024-09-21T01:28:12.112 INFO:teuthology.orchestra.run.smithi142.stdout:Install 149 Packages 2024-09-21T01:28:12.112 INFO:teuthology.orchestra.run.smithi142.stdout:Upgrade 8 Packages 2024-09-21T01:28:12.112 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-21T01:28:12.113 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 228 M 2024-09-21T01:28:12.113 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2024-09-21T01:28:12.322 INFO:teuthology.orchestra.run.smithi119.stdout:CentOS Stream 9 - CRB 14 MB/s | 6.5 MB 00:00 2024-09-21T01:28:12.557 INFO:teuthology.orchestra.run.smithi083.stdout:lab-extras 26 kB/s | 1.7 kB 00:00 2024-09-21T01:28:12.820 INFO:teuthology.orchestra.run.smithi142.stdout:(1/157): ceph-19.3.0-5120.g18432218.el9.x86_64. 53 kB/s | 6.6 kB 00:00 2024-09-21T01:28:13.003 INFO:teuthology.orchestra.run.smithi142.stdout:(2/157): ceph-fuse-19.3.0-5120.g18432218.el9.x8 4.7 MB/s | 873 kB 00:00 2024-09-21T01:28:13.095 INFO:teuthology.orchestra.run.smithi142.stdout:(3/157): ceph-immutable-object-cache-19.3.0-512 1.6 MB/s | 148 kB 00:00 2024-09-21T01:28:13.187 INFO:teuthology.orchestra.run.smithi142.stdout:(4/157): ceph-base-19.3.0-5120.g18432218.el9.x8 11 MB/s | 5.5 MB 00:00 2024-09-21T01:28:13.295 INFO:teuthology.orchestra.run.smithi142.stdout:(5/157): ceph-mgr-19.3.0-5120.g18432218.el9.x86 14 MB/s | 1.5 MB 00:00 2024-09-21T01:28:13.346 INFO:teuthology.orchestra.run.smithi142.stdout:(6/157): ceph-mds-19.3.0-5120.g18432218.el9.x86 9.1 MB/s | 2.3 MB 00:00 2024-09-21T01:28:13.530 INFO:teuthology.orchestra.run.smithi142.stdout:(7/157): ceph-mon-19.3.0-5120.g18432218.el9.x86 21 MB/s | 5.0 MB 00:00 2024-09-21T01:28:13.805 INFO:teuthology.orchestra.run.smithi142.stdout:(8/157): ceph-common-19.3.0-5120.g18432218.el9. 18 MB/s | 20 MB 00:01 2024-09-21T01:28:13.855 INFO:teuthology.orchestra.run.smithi142.stdout:(9/157): ceph-selinux-19.3.0-5120.g18432218.el9 505 kB/s | 25 kB 00:00 2024-09-21T01:28:14.122 INFO:teuthology.orchestra.run.smithi142.stdout:(10/157): ceph-radosgw-19.3.0-5120.g18432218.el 18 MB/s | 10 MB 00:00 2024-09-21T01:28:14.172 INFO:teuthology.orchestra.run.smithi142.stdout:(11/157): cephfs-mirror-19.3.0-5120.g18432218.e 4.4 MB/s | 226 kB 00:00 2024-09-21T01:28:14.173 INFO:teuthology.orchestra.run.smithi119.stdout:CentOS Stream 9 - Extras packages 36 kB/s | 19 kB 00:00 2024-09-21T01:28:14.339 INFO:teuthology.orchestra.run.smithi142.stdout:(12/157): ceph-osd-19.3.0-5120.g18432218.el9.x8 18 MB/s | 18 MB 00:00 2024-09-21T01:28:14.364 INFO:teuthology.orchestra.run.smithi142.stdout:(13/157): cephfs-shell-19.3.0-5120.g18432218.el 141 kB/s | 27 kB 00:00 2024-09-21T01:28:14.390 INFO:teuthology.orchestra.run.smithi142.stdout:(14/157): libcephfs-devel-19.3.0-5120.g18432218 637 kB/s | 32 kB 00:00 2024-09-21T01:28:14.440 INFO:teuthology.orchestra.run.smithi142.stdout:(15/157): libcephsqlite-19.3.0-5120.g18432218.e 3.1 MB/s | 158 kB 00:00 2024-09-21T01:28:14.465 INFO:teuthology.orchestra.run.smithi142.stdout:(16/157): libcephfs2-19.3.0-5120.g18432218.el9. 7.5 MB/s | 766 kB 00:00 2024-09-21T01:28:14.490 INFO:teuthology.orchestra.run.smithi142.stdout:(17/157): librados-devel-19.3.0-5120.g18432218. 2.5 MB/s | 127 kB 00:00 2024-09-21T01:28:14.549 INFO:teuthology.orchestra.run.smithi142.stdout:(18/157): libradosstriper1-19.3.0-5120.g1843221 5.9 MB/s | 507 kB 00:00 2024-09-21T01:28:14.616 INFO:teuthology.orchestra.run.smithi142.stdout:(19/157): python3-ceph-argparse-19.3.0-5120.g18 677 kB/s | 45 kB 00:00 2024-09-21T01:28:14.733 INFO:teuthology.orchestra.run.smithi142.stdout:(20/157): librgw2-19.3.0-5120.g18432218.el9.x86 22 MB/s | 5.3 MB 00:00 2024-09-21T01:28:14.734 INFO:teuthology.orchestra.run.smithi083.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T01:28:14.734 INFO:teuthology.orchestra.run.smithi083.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T01:28:14.746 INFO:teuthology.orchestra.run.smithi083.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-21T01:28:14.747 INFO:teuthology.orchestra.run.smithi083.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-21T01:28:14.748 INFO:teuthology.orchestra.run.smithi083.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-21T01:28:14.748 INFO:teuthology.orchestra.run.smithi083.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-21T01:28:14.750 INFO:teuthology.orchestra.run.smithi083.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-21T01:28:14.752 INFO:teuthology.orchestra.run.smithi083.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-21T01:28:14.753 INFO:teuthology.orchestra.run.smithi083.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-21T01:28:14.759 INFO:teuthology.orchestra.run.smithi142.stdout:(21/157): python3-ceph-common-19.3.0-5120.g1843 1.0 MB/s | 148 kB 00:00 2024-09-21T01:28:14.784 INFO:teuthology.orchestra.run.smithi142.stdout:(22/157): python3-cephfs-19.3.0-5120.g18432218. 3.1 MB/s | 161 kB 00:00 2024-09-21T01:28:14.817 INFO:teuthology.orchestra.run.smithi142.stdout:(23/157): python3-rados-19.3.0-5120.g18432218.e 5.4 MB/s | 321 kB 00:00 2024-09-21T01:28:14.817 INFO:teuthology.orchestra.run.smithi083.stdout:Dependencies resolved. 2024-09-21T01:28:14.827 INFO:teuthology.orchestra.run.smithi083.stdout:======================================================================================= 2024-09-21T01:28:14.828 INFO:teuthology.orchestra.run.smithi083.stdout: Package Arch Version Repository Size 2024-09-21T01:28:14.828 INFO:teuthology.orchestra.run.smithi083.stdout:======================================================================================= 2024-09-21T01:28:14.828 INFO:teuthology.orchestra.run.smithi083.stdout:Installing: 2024-09-21T01:28:14.828 INFO:teuthology.orchestra.run.smithi083.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-21T01:28:14.828 INFO:teuthology.orchestra.run.smithi083.stdout: ceph x86_64 2:19.3.0-5120.g18432218.el9 ceph 6.6 k 2024-09-21T01:28:14.828 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-base x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.5 M 2024-09-21T01:28:14.828 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 873 k 2024-09-21T01:28:14.828 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T01:28:14.828 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mgr x86_64 2:19.3.0-5120.g18432218.el9 ceph 1.5 M 2024-09-21T01:28:14.828 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mgr-cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 154 k 2024-09-21T01:28:14.828 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mgr-dashboard noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 14 M 2024-09-21T01:28:14.829 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 7.4 M 2024-09-21T01:28:14.829 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mgr-rook noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 49 k 2024-09-21T01:28:14.829 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-radosgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 10 M 2024-09-21T01:28:14.829 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-test x86_64 2:19.3.0-5120.g18432218.el9 ceph 40 M 2024-09-21T01:28:14.829 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-volume noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 285 k 2024-09-21T01:28:14.829 INFO:teuthology.orchestra.run.smithi083.stdout: cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 784 k 2024-09-21T01:28:14.829 INFO:teuthology.orchestra.run.smithi083.stdout: cephfs-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 226 k 2024-09-21T01:28:14.829 INFO:teuthology.orchestra.run.smithi083.stdout: cephfs-shell x86_64 2:19.3.0-5120.g18432218.el9 ceph 27 k 2024-09-21T01:28:14.829 INFO:teuthology.orchestra.run.smithi083.stdout: cephfs-top noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 18 k 2024-09-21T01:28:14.829 INFO:teuthology.orchestra.run.smithi083.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-21T01:28:14.829 INFO:teuthology.orchestra.run.smithi083.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-21T01:28:14.829 INFO:teuthology.orchestra.run.smithi083.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-21T01:28:14.830 INFO:teuthology.orchestra.run.smithi083.stdout: libcephfs-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 32 k 2024-09-21T01:28:14.830 INFO:teuthology.orchestra.run.smithi083.stdout: libcephfs2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 766 k 2024-09-21T01:28:14.830 INFO:teuthology.orchestra.run.smithi083.stdout: librados-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 127 k 2024-09-21T01:28:14.830 INFO:teuthology.orchestra.run.smithi083.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-21T01:28:14.830 INFO:teuthology.orchestra.run.smithi083.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-21T01:28:14.830 INFO:teuthology.orchestra.run.smithi083.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-21T01:28:14.830 INFO:teuthology.orchestra.run.smithi083.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-21T01:28:14.830 INFO:teuthology.orchestra.run.smithi083.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-21T01:28:14.830 INFO:teuthology.orchestra.run.smithi083.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-21T01:28:14.830 INFO:teuthology.orchestra.run.smithi083.stdout: python3-cephfs x86_64 2:19.3.0-5120.g18432218.el9 ceph 161 k 2024-09-21T01:28:14.830 INFO:teuthology.orchestra.run.smithi083.stdout: python3-rados x86_64 2:19.3.0-5120.g18432218.el9 ceph 321 k 2024-09-21T01:28:14.830 INFO:teuthology.orchestra.run.smithi083.stdout: python3-rbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 307 k 2024-09-21T01:28:14.831 INFO:teuthology.orchestra.run.smithi083.stdout: python3-rgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 99 k 2024-09-21T01:28:14.831 INFO:teuthology.orchestra.run.smithi083.stdout: rbd-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 86 k 2024-09-21T01:28:14.831 INFO:teuthology.orchestra.run.smithi083.stdout: rbd-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.1 M 2024-09-21T01:28:14.831 INFO:teuthology.orchestra.run.smithi083.stdout: rbd-nbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 170 k 2024-09-21T01:28:14.831 INFO:teuthology.orchestra.run.smithi083.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-21T01:28:14.831 INFO:teuthology.orchestra.run.smithi083.stdout:Upgrading: 2024-09-21T01:28:14.831 INFO:teuthology.orchestra.run.smithi083.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-21T01:28:14.831 INFO:teuthology.orchestra.run.smithi083.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-21T01:28:14.831 INFO:teuthology.orchestra.run.smithi083.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-21T01:28:14.831 INFO:teuthology.orchestra.run.smithi083.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-21T01:28:14.831 INFO:teuthology.orchestra.run.smithi083.stdout: librados2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.4 M 2024-09-21T01:28:14.831 INFO:teuthology.orchestra.run.smithi083.stdout: librbd1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.2 M 2024-09-21T01:28:14.832 INFO:teuthology.orchestra.run.smithi083.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-21T01:28:14.832 INFO:teuthology.orchestra.run.smithi083.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-21T01:28:14.832 INFO:teuthology.orchestra.run.smithi083.stdout:Installing dependencies: 2024-09-21T01:28:14.832 INFO:teuthology.orchestra.run.smithi083.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-21T01:28:14.832 INFO:teuthology.orchestra.run.smithi083.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-21T01:28:14.832 INFO:teuthology.orchestra.run.smithi083.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-21T01:28:14.832 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 20 M 2024-09-21T01:28:14.832 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-grafana-dashboards noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 34 k 2024-09-21T01:28:14.832 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mds x86_64 2:19.3.0-5120.g18432218.el9 ceph 2.3 M 2024-09-21T01:28:14.832 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mgr-modules-core noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 292 k 2024-09-21T01:28:14.832 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mon x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.0 M 2024-09-21T01:28:14.832 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-osd x86_64 2:19.3.0-5120.g18432218.el9 ceph 18 M 2024-09-21T01:28:14.832 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-prometheus-alerts noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 16 k 2024-09-21T01:28:14.833 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-selinux x86_64 2:19.3.0-5120.g18432218.el9 ceph 25 k 2024-09-21T01:28:14.833 INFO:teuthology.orchestra.run.smithi083.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-21T01:28:14.833 INFO:teuthology.orchestra.run.smithi083.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-21T01:28:14.833 INFO:teuthology.orchestra.run.smithi083.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-21T01:28:14.833 INFO:teuthology.orchestra.run.smithi083.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-21T01:28:14.833 INFO:teuthology.orchestra.run.smithi083.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-21T01:28:14.833 INFO:teuthology.orchestra.run.smithi083.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-21T01:28:14.833 INFO:teuthology.orchestra.run.smithi083.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-21T01:28:14.833 INFO:teuthology.orchestra.run.smithi083.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-21T01:28:14.833 INFO:teuthology.orchestra.run.smithi083.stdout: libcephsqlite x86_64 2:19.3.0-5120.g18432218.el9 ceph 158 k 2024-09-21T01:28:14.833 INFO:teuthology.orchestra.run.smithi083.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-21T01:28:14.833 INFO:teuthology.orchestra.run.smithi083.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-21T01:28:14.833 INFO:teuthology.orchestra.run.smithi083.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-21T01:28:14.834 INFO:teuthology.orchestra.run.smithi083.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-21T01:28:14.834 INFO:teuthology.orchestra.run.smithi083.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-21T01:28:14.834 INFO:teuthology.orchestra.run.smithi083.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-21T01:28:14.834 INFO:teuthology.orchestra.run.smithi083.stdout: libradosstriper1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 507 k 2024-09-21T01:28:14.834 INFO:teuthology.orchestra.run.smithi083.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-21T01:28:14.834 INFO:teuthology.orchestra.run.smithi083.stdout: librgw2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.3 M 2024-09-21T01:28:14.834 INFO:teuthology.orchestra.run.smithi083.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-21T01:28:14.834 INFO:teuthology.orchestra.run.smithi083.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-21T01:28:14.834 INFO:teuthology.orchestra.run.smithi083.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-21T01:28:14.834 INFO:teuthology.orchestra.run.smithi083.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-21T01:28:14.834 INFO:teuthology.orchestra.run.smithi083.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-21T01:28:14.834 INFO:teuthology.orchestra.run.smithi083.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-21T01:28:14.835 INFO:teuthology.orchestra.run.smithi083.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-21T01:28:14.835 INFO:teuthology.orchestra.run.smithi083.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-21T01:28:14.835 INFO:teuthology.orchestra.run.smithi083.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-21T01:28:14.835 INFO:teuthology.orchestra.run.smithi083.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-21T01:28:14.835 INFO:teuthology.orchestra.run.smithi083.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-21T01:28:14.835 INFO:teuthology.orchestra.run.smithi083.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-21T01:28:14.835 INFO:teuthology.orchestra.run.smithi083.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-21T01:28:14.835 INFO:teuthology.orchestra.run.smithi083.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-21T01:28:14.836 INFO:teuthology.orchestra.run.smithi083.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-21T01:28:14.836 INFO:teuthology.orchestra.run.smithi083.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-21T01:28:14.836 INFO:teuthology.orchestra.run.smithi083.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-21T01:28:14.836 INFO:teuthology.orchestra.run.smithi083.stdout: python3-ceph-argparse x86_64 2:19.3.0-5120.g18432218.el9 ceph 45 k 2024-09-21T01:28:14.836 INFO:teuthology.orchestra.run.smithi083.stdout: python3-ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T01:28:14.836 INFO:teuthology.orchestra.run.smithi083.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-21T01:28:14.836 INFO:teuthology.orchestra.run.smithi083.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-21T01:28:14.836 INFO:teuthology.orchestra.run.smithi083.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-21T01:28:14.836 INFO:teuthology.orchestra.run.smithi083.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-21T01:28:14.836 INFO:teuthology.orchestra.run.smithi083.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-21T01:28:14.837 INFO:teuthology.orchestra.run.smithi083.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-21T01:28:14.837 INFO:teuthology.orchestra.run.smithi083.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-21T01:28:14.837 INFO:teuthology.orchestra.run.smithi083.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-21T01:28:14.837 INFO:teuthology.orchestra.run.smithi083.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-21T01:28:14.837 INFO:teuthology.orchestra.run.smithi083.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-21T01:28:14.837 INFO:teuthology.orchestra.run.smithi083.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-21T01:28:14.837 INFO:teuthology.orchestra.run.smithi083.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-21T01:28:14.837 INFO:teuthology.orchestra.run.smithi083.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-21T01:28:14.837 INFO:teuthology.orchestra.run.smithi083.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-21T01:28:14.838 INFO:teuthology.orchestra.run.smithi083.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-21T01:28:14.838 INFO:teuthology.orchestra.run.smithi083.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-21T01:28:14.838 INFO:teuthology.orchestra.run.smithi083.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-21T01:28:14.838 INFO:teuthology.orchestra.run.smithi083.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-21T01:28:14.838 INFO:teuthology.orchestra.run.smithi083.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-21T01:28:14.838 INFO:teuthology.orchestra.run.smithi083.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-21T01:28:14.838 INFO:teuthology.orchestra.run.smithi083.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-21T01:28:14.838 INFO:teuthology.orchestra.run.smithi083.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-21T01:28:14.838 INFO:teuthology.orchestra.run.smithi083.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-21T01:28:14.838 INFO:teuthology.orchestra.run.smithi083.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-21T01:28:14.839 INFO:teuthology.orchestra.run.smithi083.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-21T01:28:14.839 INFO:teuthology.orchestra.run.smithi083.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-21T01:28:14.839 INFO:teuthology.orchestra.run.smithi083.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-21T01:28:14.839 INFO:teuthology.orchestra.run.smithi083.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-21T01:28:14.839 INFO:teuthology.orchestra.run.smithi083.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-21T01:28:14.839 INFO:teuthology.orchestra.run.smithi083.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-21T01:28:14.839 INFO:teuthology.orchestra.run.smithi083.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-21T01:28:14.839 INFO:teuthology.orchestra.run.smithi083.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-21T01:28:14.839 INFO:teuthology.orchestra.run.smithi083.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-21T01:28:14.839 INFO:teuthology.orchestra.run.smithi083.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-21T01:28:14.840 INFO:teuthology.orchestra.run.smithi083.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-21T01:28:14.840 INFO:teuthology.orchestra.run.smithi083.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-21T01:28:14.840 INFO:teuthology.orchestra.run.smithi083.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-21T01:28:14.840 INFO:teuthology.orchestra.run.smithi083.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-21T01:28:14.840 INFO:teuthology.orchestra.run.smithi083.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-21T01:28:14.840 INFO:teuthology.orchestra.run.smithi083.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-21T01:28:14.840 INFO:teuthology.orchestra.run.smithi083.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-21T01:28:14.840 INFO:teuthology.orchestra.run.smithi083.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-21T01:28:14.840 INFO:teuthology.orchestra.run.smithi083.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-21T01:28:14.840 INFO:teuthology.orchestra.run.smithi083.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-21T01:28:14.840 INFO:teuthology.orchestra.run.smithi083.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-21T01:28:14.840 INFO:teuthology.orchestra.run.smithi083.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-21T01:28:14.841 INFO:teuthology.orchestra.run.smithi083.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-21T01:28:14.841 INFO:teuthology.orchestra.run.smithi083.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-21T01:28:14.841 INFO:teuthology.orchestra.run.smithi083.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-21T01:28:14.841 INFO:teuthology.orchestra.run.smithi083.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-21T01:28:14.841 INFO:teuthology.orchestra.run.smithi083.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-21T01:28:14.841 INFO:teuthology.orchestra.run.smithi083.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-21T01:28:14.841 INFO:teuthology.orchestra.run.smithi083.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-21T01:28:14.841 INFO:teuthology.orchestra.run.smithi083.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-21T01:28:14.841 INFO:teuthology.orchestra.run.smithi083.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-21T01:28:14.841 INFO:teuthology.orchestra.run.smithi083.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-21T01:28:14.841 INFO:teuthology.orchestra.run.smithi083.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-21T01:28:14.841 INFO:teuthology.orchestra.run.smithi083.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-21T01:28:14.842 INFO:teuthology.orchestra.run.smithi083.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-21T01:28:14.842 INFO:teuthology.orchestra.run.smithi083.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-21T01:28:14.842 INFO:teuthology.orchestra.run.smithi083.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-21T01:28:14.842 INFO:teuthology.orchestra.run.smithi083.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-21T01:28:14.842 INFO:teuthology.orchestra.run.smithi083.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-21T01:28:14.842 INFO:teuthology.orchestra.run.smithi083.stdout:Installing weak dependencies: 2024-09-21T01:28:14.842 INFO:teuthology.orchestra.run.smithi083.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-21T01:28:14.842 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T01:28:14.842 INFO:teuthology.orchestra.run.smithi083.stdout:Transaction Summary 2024-09-21T01:28:14.842 INFO:teuthology.orchestra.run.smithi083.stdout:======================================================================================= 2024-09-21T01:28:14.842 INFO:teuthology.orchestra.run.smithi083.stdout:Install 149 Packages 2024-09-21T01:28:14.843 INFO:teuthology.orchestra.run.smithi083.stdout:Upgrade 8 Packages 2024-09-21T01:28:14.843 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T01:28:14.843 INFO:teuthology.orchestra.run.smithi083.stdout:Total download size: 228 M 2024-09-21T01:28:14.843 INFO:teuthology.orchestra.run.smithi083.stdout:Downloading Packages: 2024-09-21T01:28:14.851 INFO:teuthology.orchestra.run.smithi142.stdout:(24/157): python3-rbd-19.3.0-5120.g18432218.el9 4.5 MB/s | 307 kB 00:00 2024-09-21T01:28:14.876 INFO:teuthology.orchestra.run.smithi142.stdout:(25/157): python3-rgw-19.3.0-5120.g18432218.el9 1.7 MB/s | 99 kB 00:00 2024-09-21T01:28:14.901 INFO:teuthology.orchestra.run.smithi142.stdout:(26/157): rbd-fuse-19.3.0-5120.g18432218.el9.x8 1.7 MB/s | 86 kB 00:00 2024-09-21T01:28:14.952 INFO:teuthology.orchestra.run.smithi142.stdout:(27/157): rbd-nbd-19.3.0-5120.g18432218.el9.x86 3.3 MB/s | 170 kB 00:00 2024-09-21T01:28:14.994 INFO:teuthology.orchestra.run.smithi119.stdout:Extra Packages for Enterprise Linux 32 MB/s | 23 MB 00:00 2024-09-21T01:28:15.011 INFO:teuthology.orchestra.run.smithi142.stdout:(28/157): ceph-grafana-dashboards-19.3.0-5120.g 589 kB/s | 34 kB 00:00 2024-09-21T01:28:15.103 INFO:teuthology.orchestra.run.smithi142.stdout:(29/157): rbd-mirror-19.3.0-5120.g18432218.el9. 14 MB/s | 3.1 MB 00:00 2024-09-21T01:28:15.128 INFO:teuthology.orchestra.run.smithi142.stdout:(30/157): ceph-mgr-cephadm-19.3.0-5120.g1843221 1.3 MB/s | 154 kB 00:00 2024-09-21T01:28:15.453 INFO:teuthology.orchestra.run.smithi142.stdout:(31/157): ceph-mgr-diskprediction-local-19.3.0- 23 MB/s | 7.4 MB 00:00 2024-09-21T01:28:15.520 INFO:teuthology.orchestra.run.smithi142.stdout:(32/157): ceph-mgr-modules-core-19.3.0-5120.g18 4.3 MB/s | 292 kB 00:00 2024-09-21T01:28:15.579 INFO:teuthology.orchestra.run.smithi142.stdout:(33/157): ceph-mgr-rook-19.3.0-5120.g18432218.e 849 kB/s | 49 kB 00:00 2024-09-21T01:28:15.637 INFO:teuthology.orchestra.run.smithi142.stdout:(34/157): ceph-prometheus-alerts-19.3.0-5120.g1 282 kB/s | 16 kB 00:00 2024-09-21T01:28:15.712 INFO:teuthology.orchestra.run.smithi142.stdout:(35/157): ceph-volume-19.3.0-5120.g18432218.el9 3.7 MB/s | 285 kB 00:00 2024-09-21T01:28:15.796 INFO:teuthology.orchestra.run.smithi142.stdout:(36/157): cephadm-19.3.0-5120.g18432218.el9.noa 9.2 MB/s | 784 kB 00:00 2024-09-21T01:28:15.816 INFO:teuthology.orchestra.run.smithi083.stdout:(1/157): ceph-19.3.0-5120.g18432218.el9.x86_64. 37 kB/s | 6.6 kB 00:00 2024-09-21T01:28:16.067 INFO:teuthology.orchestra.run.smithi083.stdout:(2/157): ceph-fuse-19.3.0-5120.g18432218.el9.x8 3.4 MB/s | 873 kB 00:00 2024-09-21T01:28:16.142 INFO:teuthology.orchestra.run.smithi083.stdout:(3/157): ceph-base-19.3.0-5120.g18432218.el9.x8 11 MB/s | 5.5 MB 00:00 2024-09-21T01:28:16.172 INFO:teuthology.orchestra.run.smithi142.stdout:(37/157): ceph-test-19.3.0-5120.g18432218.el9.x 17 MB/s | 40 MB 00:02 2024-09-21T01:28:16.175 INFO:teuthology.orchestra.run.smithi083.stdout:(4/157): ceph-immutable-object-cache-19.3.0-512 1.3 MB/s | 148 kB 00:00 2024-09-21T01:28:16.197 INFO:teuthology.orchestra.run.smithi142.stdout:(38/157): cephfs-top-19.3.0-5120.g18432218.el9. 46 kB/s | 18 kB 00:00 2024-09-21T01:28:16.243 INFO:teuthology.orchestra.run.smithi083.stdout:(5/157): ceph-mds-19.3.0-5120.g18432218.el9.x86 23 MB/s | 2.3 MB 00:00 2024-09-21T01:28:16.381 INFO:teuthology.orchestra.run.smithi142.stdout:(39/157): ceph-mgr-dashboard-19.3.0-5120.g18432 11 MB/s | 14 MB 00:01 2024-09-21T01:28:16.406 INFO:teuthology.orchestra.run.smithi142.stdout:(40/157): fuse-2.9.9-16.el9.x86_64.rpm 342 kB/s | 80 kB 00:00 2024-09-21T01:28:16.460 INFO:teuthology.orchestra.run.smithi083.stdout:(6/157): ceph-mgr-19.3.0-5120.g18432218.el9.x86 5.3 MB/s | 1.5 MB 00:00 2024-09-21T01:28:16.523 INFO:teuthology.orchestra.run.smithi142.stdout:(41/157): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.1 MB/s | 253 kB 00:00 2024-09-21T01:28:16.543 INFO:teuthology.orchestra.run.smithi083.stdout:(7/157): ceph-mon-19.3.0-5120.g18432218.el9.x86 17 MB/s | 5.0 MB 00:00 2024-09-21T01:28:16.548 INFO:teuthology.orchestra.run.smithi142.stdout:(42/157): libquadmath-11.5.0-2.el9.x86_64.rpm 1.1 MB/s | 191 kB 00:00 2024-09-21T01:28:16.606 INFO:teuthology.orchestra.run.smithi142.stdout:(43/157): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 106 kB 00:00 2024-09-21T01:28:16.640 INFO:teuthology.orchestra.run.smithi142.stdout:(44/157): python3-cryptography-36.0.1-4.el9.x86 10 MB/s | 1.2 MB 00:00 2024-09-21T01:28:16.665 INFO:teuthology.orchestra.run.smithi142.stdout:(45/157): python3-pycparser-2.20-6.el9.noarch.r 2.3 MB/s | 135 kB 00:00 2024-09-21T01:28:16.691 INFO:teuthology.orchestra.run.smithi142.stdout:(46/157): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-09-21T01:28:16.724 INFO:teuthology.orchestra.run.smithi142.stdout:(47/157): libgfortran-11.5.0-2.el9.x86_64.rpm 1.5 MB/s | 801 kB 00:00 2024-09-21T01:28:16.749 INFO:teuthology.orchestra.run.smithi142.stdout:(48/157): python3-urllib3-1.26.5-6.el9.noarch.r 2.5 MB/s | 215 kB 00:00 2024-09-21T01:28:16.794 INFO:teuthology.orchestra.run.smithi083.stdout:(8/157): ceph-common-19.3.0-5120.g18432218.el9. 17 MB/s | 20 MB 00:01 2024-09-21T01:28:16.852 INFO:teuthology.orchestra.run.smithi083.stdout:(9/157): ceph-selinux-19.3.0-5120.g18432218.el9 434 kB/s | 25 kB 00:00 2024-09-21T01:28:16.867 INFO:teuthology.orchestra.run.smithi142.stdout:(49/157): boost-program-options-1.75.0-8.el9.x8 915 kB/s | 107 kB 00:00 2024-09-21T01:28:16.900 INFO:teuthology.orchestra.run.smithi142.stdout:(50/157): automake-1.16.2-8.el9.noarch.rpm 3.2 MB/s | 689 kB 00:00 2024-09-21T01:28:16.917 INFO:teuthology.orchestra.run.smithi142.stdout:(51/157): elfutils-libelf-devel-0.191-4.el9.x86 433 kB/s | 22 kB 00:00 2024-09-21T01:28:16.959 INFO:teuthology.orchestra.run.smithi142.stdout:(52/157): bison-3.7.4-5.el9.x86_64.rpm 3.9 MB/s | 943 kB 00:00 2024-09-21T01:28:16.976 INFO:teuthology.orchestra.run.smithi142.stdout:(53/157): flexiblas-3.0.4-8.el9.x86_64.rpm 557 kB/s | 33 kB 00:00 2024-09-21T01:28:17.001 INFO:teuthology.orchestra.run.smithi142.stdout:(54/157): flex-2.6.4-9.el9.x86_64.rpm 3.0 MB/s | 313 kB 00:00 2024-09-21T01:28:17.018 INFO:teuthology.orchestra.run.smithi142.stdout:(55/157): flexiblas-openblas-openmp-3.0.4-8.el9 437 kB/s | 18 kB 00:00 2024-09-21T01:28:17.035 INFO:teuthology.orchestra.run.smithi142.stdout:(56/157): libaio-devel-0.3.111-13.el9.x86_64.rp 331 kB/s | 11 kB 00:00 2024-09-21T01:28:17.060 INFO:teuthology.orchestra.run.smithi142.stdout:(57/157): libnbd-1.20.2-2.el9.x86_64.rpm 4.0 MB/s | 171 kB 00:00 2024-09-21T01:28:17.127 INFO:teuthology.orchestra.run.smithi142.stdout:(58/157): flexiblas-netlib-3.0.4-8.el9.x86_64.r 18 MB/s | 3.0 MB 00:00 2024-09-21T01:28:17.153 INFO:teuthology.orchestra.run.smithi142.stdout:(59/157): librabbitmq-0.11.0-7.el9.x86_64.rpm 493 kB/s | 45 kB 00:00 2024-09-21T01:28:17.178 INFO:teuthology.orchestra.run.smithi142.stdout:(60/157): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.1 MB/s | 160 kB 00:00 2024-09-21T01:28:17.211 INFO:teuthology.orchestra.run.smithi083.stdout:(10/157): ceph-radosgw-19.3.0-5120.g18432218.el 16 MB/s | 10 MB 00:00 2024-09-21T01:28:17.212 INFO:teuthology.orchestra.run.smithi142.stdout:(61/157): libtool-2.4.6-46.el9.x86_64.rpm 9.7 MB/s | 581 kB 00:00 2024-09-21T01:28:17.237 INFO:teuthology.orchestra.run.smithi142.stdout:(62/157): libuuid-devel-2.37.4-20.el9.x86_64.rp 418 kB/s | 24 kB 00:00 2024-09-21T01:28:17.269 INFO:teuthology.orchestra.run.smithi083.stdout:(11/157): cephfs-mirror-19.3.0-5120.g18432218.e 3.8 MB/s | 226 kB 00:00 2024-09-21T01:28:17.270 INFO:teuthology.orchestra.run.smithi142.stdout:(63/157): librdkafka-1.6.1-102.el9.x86_64.rpm 4.5 MB/s | 662 kB 00:00 2024-09-21T01:28:17.296 INFO:teuthology.orchestra.run.smithi142.stdout:(64/157): libzstd-devel-1.5.1-2.el9.x86_64.rpm 566 kB/s | 47 kB 00:00 2024-09-21T01:28:17.329 INFO:teuthology.orchestra.run.smithi142.stdout:(65/157): lua-5.4.4-4.el9.x86_64.rpm 3.1 MB/s | 188 kB 00:00 2024-09-21T01:28:17.344 INFO:teuthology.orchestra.run.smithi083.stdout:(12/157): cephfs-shell-19.3.0-5120.g18432218.el 360 kB/s | 27 kB 00:00 2024-09-21T01:28:17.354 INFO:teuthology.orchestra.run.smithi142.stdout:(66/157): openblas-0.3.26-2.el9.x86_64.rpm 660 kB/s | 38 kB 00:00 2024-09-21T01:28:17.380 INFO:teuthology.orchestra.run.smithi142.stdout:(67/157): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.0 MB/s | 292 kB 00:00 2024-09-21T01:28:17.445 INFO:teuthology.orchestra.run.smithi083.stdout:(13/157): libcephfs-devel-19.3.0-5120.g18432218 318 kB/s | 32 kB 00:00 2024-09-21T01:28:17.472 INFO:teuthology.orchestra.run.smithi142.stdout:(68/157): openssl-devel-3.2.2-6.el9.x86_64.rpm 38 MB/s | 4.4 MB 00:00 2024-09-21T01:28:17.545 INFO:teuthology.orchestra.run.smithi083.stdout:(14/157): libcephfs2-19.3.0-5120.g18432218.el9. 7.5 MB/s | 766 kB 00:00 2024-09-21T01:28:17.547 INFO:teuthology.orchestra.run.smithi142.stdout:(69/157): openblas-openmp-0.3.26-2.el9.x86_64.r 23 MB/s | 4.9 MB 00:00 2024-09-21T01:28:17.581 INFO:teuthology.orchestra.run.smithi142.stdout:(70/157): postgresql-13.16-1.el9.x86_64.rpm 7.9 MB/s | 1.6 MB 00:00 2024-09-21T01:28:17.606 INFO:teuthology.orchestra.run.smithi142.stdout:(71/157): postgresql-private-libs-13.16-1.el9.x 2.3 MB/s | 137 kB 00:00 2024-09-21T01:28:17.640 INFO:teuthology.orchestra.run.smithi142.stdout:(72/157): postgresql-contrib-13.16-1.el9.x86_64 5.3 MB/s | 910 kB 00:00 2024-09-21T01:28:17.681 INFO:teuthology.orchestra.run.smithi142.stdout:(73/157): protobuf-3.14.0-13.el9.x86_64.rpm 13 MB/s | 1.0 MB 00:00 2024-09-21T01:28:17.707 INFO:teuthology.orchestra.run.smithi142.stdout:(74/157): python3-attrs-20.3.0-7.el9.noarch.rpm 1.3 MB/s | 87 kB 00:00 2024-09-21T01:28:17.720 INFO:teuthology.orchestra.run.smithi083.stdout:(15/157): ceph-osd-19.3.0-5120.g18432218.el9.x8 14 MB/s | 18 MB 00:01 2024-09-21T01:28:17.746 INFO:teuthology.orchestra.run.smithi083.stdout:(16/157): libcephsqlite-19.3.0-5120.g18432218.e 791 kB/s | 158 kB 00:00 2024-09-21T01:28:17.757 INFO:teuthology.orchestra.run.smithi142.stdout:(75/157): python3-colorama-0.4.6-3.el9.noarch.r 1.2 MB/s | 61 kB 00:00 2024-09-21T01:28:17.771 INFO:teuthology.orchestra.run.smithi083.stdout:(17/157): librados-devel-19.3.0-5120.g18432218. 2.5 MB/s | 127 kB 00:00 2024-09-21T01:28:17.796 INFO:teuthology.orchestra.run.smithi083.stdout:(18/157): libradosstriper1-19.3.0-5120.g1843221 9.9 MB/s | 507 kB 00:00 2024-09-21T01:28:17.833 INFO:teuthology.orchestra.run.smithi142.stdout:(76/157): postgresql-server-13.16-1.el9.x86_64. 23 MB/s | 5.8 MB 00:00 2024-09-21T01:28:17.847 INFO:teuthology.orchestra.run.smithi083.stdout:(19/157): python3-ceph-argparse-19.3.0-5120.g18 900 kB/s | 45 kB 00:00 2024-09-21T01:28:17.858 INFO:teuthology.orchestra.run.smithi142.stdout:(77/157): python3-devel-3.9.19-8.el9.x86_64.rpm 2.4 MB/s | 245 kB 00:00 2024-09-21T01:28:17.891 INFO:teuthology.orchestra.run.smithi142.stdout:(78/157): python3-jinja2-2.11.3-6.el9.noarch.rp 4.2 MB/s | 248 kB 00:00 2024-09-21T01:28:17.922 INFO:teuthology.orchestra.run.smithi083.stdout:(20/157): python3-ceph-common-19.3.0-5120.g1843 1.9 MB/s | 148 kB 00:00 2024-09-21T01:28:17.950 INFO:teuthology.orchestra.run.smithi142.stdout:(79/157): python3-jsonpatch-1.21-16.el9.noarch. 278 kB/s | 26 kB 00:00 2024-09-21T01:28:17.976 INFO:teuthology.orchestra.run.smithi142.stdout:(80/157): python3-jsonpointer-2.0-4.el9.noarch. 228 kB/s | 19 kB 00:00 2024-09-21T01:28:18.009 INFO:teuthology.orchestra.run.smithi142.stdout:(81/157): python3-mako-1.1.4-6.el9.noarch.rpm 2.9 MB/s | 172 kB 00:00 2024-09-21T01:28:18.034 INFO:teuthology.orchestra.run.smithi142.stdout:(82/157): python3-markupsafe-1.1.1-12.el9.x86_6 593 kB/s | 35 kB 00:00 2024-09-21T01:28:18.065 INFO:teuthology.orchestra.run.smithi083.stdout:(21/157): python3-cephfs-19.3.0-5120.g18432218. 1.1 MB/s | 161 kB 00:00 2024-09-21T01:28:18.110 INFO:teuthology.orchestra.run.smithi142.stdout:(83/157): python3-babel-2.9.1-2.el9.noarch.rpm 14 MB/s | 6.0 MB 00:00 2024-09-21T01:28:18.143 INFO:teuthology.orchestra.run.smithi142.stdout:(84/157): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.3 MB/s | 250 kB 00:00 2024-09-21T01:28:18.148 INFO:teuthology.orchestra.run.smithi083.stdout:(22/157): librgw2-19.3.0-5120.g18432218.el9.x86 14 MB/s | 5.3 MB 00:00 2024-09-21T01:28:18.169 INFO:teuthology.orchestra.run.smithi142.stdout:(85/157): python3-oauthlib-3.1.1-5.el9.noarch.r 3.7 MB/s | 222 kB 00:00 2024-09-21T01:28:18.181 INFO:teuthology.orchestra.run.smithi083.stdout:(23/157): python3-rados-19.3.0-5120.g18432218.e 2.7 MB/s | 321 kB 00:00 2024-09-21T01:28:18.194 INFO:teuthology.orchestra.run.smithi142.stdout:(86/157): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-09-21T01:28:18.207 INFO:teuthology.orchestra.run.smithi083.stdout:(24/157): python3-rbd-19.3.0-5120.g18432218.el9 5.1 MB/s | 307 kB 00:00 2024-09-21T01:28:18.219 INFO:teuthology.orchestra.run.smithi142.stdout:(87/157): python3-prettytable-0.7.2-27.el9.noar 844 kB/s | 42 kB 00:00 2024-09-21T01:28:18.232 INFO:teuthology.orchestra.run.smithi083.stdout:(25/157): python3-rgw-19.3.0-5120.g18432218.el9 1.9 MB/s | 99 kB 00:00 2024-09-21T01:28:18.244 INFO:teuthology.orchestra.run.smithi142.stdout:(88/157): python3-protobuf-3.14.0-13.el9.noarch 5.3 MB/s | 269 kB 00:00 2024-09-21T01:28:18.266 INFO:teuthology.orchestra.run.smithi083.stdout:(26/157): rbd-fuse-19.3.0-5120.g18432218.el9.x8 1.4 MB/s | 86 kB 00:00 2024-09-21T01:28:18.270 INFO:teuthology.orchestra.run.smithi142.stdout:(89/157): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-09-21T01:28:18.295 INFO:teuthology.orchestra.run.smithi142.stdout:(90/157): python3-pyasn1-modules-0.4.8-6.el9.no 5.4 MB/s | 279 kB 00:00 2024-09-21T01:28:18.312 INFO:teuthology.orchestra.run.smithi142.stdout:(91/157): python3-pytz-2021.1-5.el9.noarch.rpm 1.2 MB/s | 51 kB 00:00 2024-09-21T01:28:18.324 INFO:teuthology.orchestra.run.smithi083.stdout:(27/157): rbd-nbd-19.3.0-5120.g18432218.el9.x86 2.9 MB/s | 170 kB 00:00 2024-09-21T01:28:18.329 INFO:teuthology.orchestra.run.smithi142.stdout:(92/157): python3-requests-oauthlib-1.3.0-12.el 1.6 MB/s | 54 kB 00:00 2024-09-21T01:28:18.413 INFO:teuthology.orchestra.run.smithi142.stdout:(93/157): python3-numpy-1.20.1-5.el9.x86_64.rpm 13 MB/s | 5.1 MB 00:00 2024-09-21T01:28:18.425 INFO:teuthology.orchestra.run.smithi083.stdout:(28/157): rbd-mirror-19.3.0-5120.g18432218.el9. 16 MB/s | 3.1 MB 00:00 2024-09-21T01:28:18.438 INFO:teuthology.orchestra.run.smithi142.stdout:(94/157): python3-toml-0.10.2-6.el9.noarch.rpm 384 kB/s | 42 kB 00:00 2024-09-21T01:28:18.450 INFO:teuthology.orchestra.run.smithi083.stdout:(29/157): ceph-grafana-dashboards-19.3.0-5120.g 274 kB/s | 34 kB 00:00 2024-09-21T01:28:18.463 INFO:teuthology.orchestra.run.smithi142.stdout:(95/157): python3-wcwidth-0.2.5-8.el9.noarch.rp 885 kB/s | 44 kB 00:00 2024-09-21T01:28:18.484 INFO:teuthology.orchestra.run.smithi083.stdout:(30/157): ceph-mgr-cephadm-19.3.0-5120.g1843221 2.6 MB/s | 154 kB 00:00 2024-09-21T01:28:18.496 INFO:teuthology.orchestra.run.smithi142.stdout:(96/157): qatlib-24.02.0-1.el9.x86_64.rpm 3.7 MB/s | 221 kB 00:00 2024-09-21T01:28:18.522 INFO:teuthology.orchestra.run.smithi142.stdout:(97/157): qatlib-service-24.02.0-1.el9.x86_64.r 613 kB/s | 36 kB 00:00 2024-09-21T01:28:18.547 INFO:teuthology.orchestra.run.smithi142.stdout:(98/157): qatzip-libs-1.2.0-1.el9.x86_64.rpm 943 kB/s | 47 kB 00:00 2024-09-21T01:28:18.581 INFO:teuthology.orchestra.run.smithi142.stdout:(99/157): socat-1.7.4.1-6.el9.x86_64.rpm 5.1 MB/s | 304 kB 00:00 2024-09-21T01:28:18.606 INFO:teuthology.orchestra.run.smithi142.stdout:(100/157): uuid-1.6.2-55.el9.x86_64.rpm 989 kB/s | 58 kB 00:00 2024-09-21T01:28:18.631 INFO:teuthology.orchestra.run.smithi142.stdout:(101/157): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.9 MB/s | 96 kB 00:00 2024-09-21T01:28:18.656 INFO:teuthology.orchestra.run.smithi142.stdout:(102/157): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-21T01:28:18.682 INFO:teuthology.orchestra.run.smithi142.stdout:(103/157): zlib-devel-1.2.11-41.el9.x86_64.rpm 893 kB/s | 45 kB 00:00 2024-09-21T01:28:18.707 INFO:teuthology.orchestra.run.smithi142.stdout:(104/157): lua-devel-5.4.4-4.el9.x86_64.rpm 444 kB/s | 22 kB 00:00 2024-09-21T01:28:18.757 INFO:teuthology.orchestra.run.smithi142.stdout:(105/157): protobuf-compiler-3.14.0-13.el9.x86_ 11 MB/s | 863 kB 00:00 2024-09-21T01:28:18.799 INFO:teuthology.orchestra.run.smithi142.stdout:(106/157): abseil-cpp-20211102.0-3.el9.x86_64.r 5.8 MB/s | 548 kB 00:00 2024-09-21T01:28:18.824 INFO:teuthology.orchestra.run.smithi142.stdout:(107/157): grpc-data-1.46.7-10.el9.noarch.rpm 846 kB/s | 19 kB 00:00 2024-09-21T01:28:18.851 INFO:teuthology.orchestra.run.smithi083.stdout:(31/157): ceph-test-19.3.0-5120.g18432218.el9.x 20 MB/s | 40 MB 00:01 2024-09-21T01:28:18.867 INFO:teuthology.orchestra.run.smithi142.stdout:(108/157): gperftools-libs-2.9.1-3.el9.x86_64.r 2.8 MB/s | 308 kB 00:00 2024-09-21T01:28:18.894 INFO:teuthology.orchestra.run.smithi142.stdout:(109/157): libarrow-doc-9.0.0-11.el9.noarch.rpm 963 kB/s | 26 kB 00:00 2024-09-21T01:28:18.901 INFO:teuthology.orchestra.run.smithi083.stdout:(32/157): ceph-mgr-modules-core-19.3.0-5120.g18 5.7 MB/s | 292 kB 00:00 2024-09-21T01:28:18.919 INFO:teuthology.orchestra.run.smithi142.stdout:(110/157): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-21T01:28:18.953 INFO:teuthology.orchestra.run.smithi142.stdout:(111/157): libunwind-1.6.2-1.el9.x86_64.rpm 2.0 MB/s | 67 kB 00:00 2024-09-21T01:28:18.976 INFO:teuthology.orchestra.run.smithi083.stdout:(33/157): ceph-mgr-rook-19.3.0-5120.g18432218.e 660 kB/s | 49 kB 00:00 2024-09-21T01:28:18.986 INFO:teuthology.orchestra.run.smithi142.stdout:(112/157): luarocks-3.9.2-5.el9.noarch.rpm 4.4 MB/s | 151 kB 00:00 2024-09-21T01:28:19.037 INFO:teuthology.orchestra.run.smithi142.stdout:(113/157): parquet-libs-9.0.0-11.el9.x86_64.rpm 16 MB/s | 839 kB 00:00 2024-09-21T01:28:19.127 INFO:teuthology.orchestra.run.smithi083.stdout:(34/157): ceph-mgr-diskprediction-local-19.3.0- 11 MB/s | 7.4 MB 00:00 2024-09-21T01:28:19.151 INFO:teuthology.orchestra.run.smithi083.stdout:(35/157): ceph-prometheus-alerts-19.3.0-5120.g1 94 kB/s | 16 kB 00:00 2024-09-21T01:28:19.204 INFO:teuthology.orchestra.run.smithi142.stdout:(114/157): python3-scipy-1.6.2-8.el9.x86_64.rpm 18 MB/s | 16 MB 00:00 2024-09-21T01:28:19.279 INFO:teuthology.orchestra.run.smithi142.stdout:(115/157): libarrow-9.0.0-11.el9.x86_64.rpm 9.7 MB/s | 4.4 MB 00:00 2024-09-21T01:28:19.305 INFO:teuthology.orchestra.run.smithi142.stdout:(116/157): python3-cachetools-4.2.4-1.el9.noarc 1.4 MB/s | 32 kB 00:00 2024-09-21T01:28:19.310 INFO:teuthology.orchestra.run.smithi083.stdout:(36/157): ceph-mgr-dashboard-19.3.0-5120.g18432 16 MB/s | 14 MB 00:00 2024-09-21T01:28:19.330 INFO:teuthology.orchestra.run.smithi142.stdout:(117/157): python3-bcrypt-3.2.2-1.el9.x86_64.rp 347 kB/s | 43 kB 00:00 2024-09-21T01:28:19.335 INFO:teuthology.orchestra.run.smithi083.stdout:(37/157): ceph-volume-19.3.0-5120.g18432218.el9 1.5 MB/s | 285 kB 00:00 2024-09-21T01:28:19.355 INFO:teuthology.orchestra.run.smithi142.stdout:(118/157): python3-certifi-2023.05.07-4.el9.noa 281 kB/s | 14 kB 00:00 2024-09-21T01:28:19.361 INFO:teuthology.orchestra.run.smithi083.stdout:(38/157): cephfs-top-19.3.0-5120.g18432218.el9. 368 kB/s | 18 kB 00:00 2024-09-21T01:28:19.381 INFO:teuthology.orchestra.run.smithi142.stdout:(119/157): python3-asyncssh-2.13.2-5.el9.noarch 1.6 MB/s | 548 kB 00:00 2024-09-21T01:28:19.395 INFO:teuthology.orchestra.run.smithi083.stdout:(39/157): cephadm-19.3.0-5120.g18432218.el9.noa 3.2 MB/s | 784 kB 00:00 2024-09-21T01:28:19.405 INFO:teuthology.orchestra.run.smithi142.stdout:(120/157): python3-cheroot-8.6.0-4.el9.noarch.r 2.2 MB/s | 172 kB 00:00 2024-09-21T01:28:19.439 INFO:teuthology.orchestra.run.smithi142.stdout:(121/157): python3-cherrypy-18.6.1-2.el9.noarch 4.2 MB/s | 358 kB 00:00 2024-09-21T01:28:19.464 INFO:teuthology.orchestra.run.smithi142.stdout:(122/157): python3-cmd2-2.4.2-2.el9.noarch.rpm 3.5 MB/s | 303 kB 00:00 2024-09-21T01:28:19.478 INFO:teuthology.orchestra.run.smithi083.stdout:(40/157): fuse-2.9.9-16.el9.x86_64.rpm 561 kB/s | 80 kB 00:00 2024-09-21T01:28:19.489 INFO:teuthology.orchestra.run.smithi142.stdout:(123/157): python3-google-auth-2.34.0-1.el9.noa 2.6 MB/s | 220 kB 00:00 2024-09-21T01:28:19.512 INFO:teuthology.orchestra.run.smithi083.stdout:(41/157): libquadmath-11.5.0-2.el9.x86_64.rpm 1.6 MB/s | 191 kB 00:00 2024-09-21T01:28:19.515 INFO:teuthology.orchestra.run.smithi142.stdout:(124/157): python3-grpcio-tools-1.46.7-10.el9.x 2.8 MB/s | 144 kB 00:00 2024-09-21T01:28:19.540 INFO:teuthology.orchestra.run.smithi142.stdout:(125/157): python3-jaraco-8.2.1-3.el9.noarch.rp 212 kB/s | 11 kB 00:00 2024-09-21T01:28:19.554 INFO:teuthology.orchestra.run.smithi083.stdout:(42/157): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.3 MB/s | 253 kB 00:00 2024-09-21T01:28:19.565 INFO:teuthology.orchestra.run.smithi142.stdout:(126/157): python3-jaraco-classes-3.2.1-5.el9.n 352 kB/s | 18 kB 00:00 2024-09-21T01:28:19.579 INFO:teuthology.orchestra.run.smithi083.stdout:(43/157): libgfortran-11.5.0-2.el9.x86_64.rpm 3.6 MB/s | 801 kB 00:00 2024-09-21T01:28:19.591 INFO:teuthology.orchestra.run.smithi142.stdout:(127/157): python3-jaraco-collections-3.0.0-8.e 463 kB/s | 23 kB 00:00 2024-09-21T01:28:19.604 INFO:teuthology.orchestra.run.smithi083.stdout:(44/157): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 106 kB 00:00 2024-09-21T01:28:19.616 INFO:teuthology.orchestra.run.smithi142.stdout:(128/157): python3-jaraco-functools-3.5.0-2.el9 387 kB/s | 19 kB 00:00 2024-09-21T01:28:19.629 INFO:teuthology.orchestra.run.smithi083.stdout:(45/157): python3-pycparser-2.20-6.el9.noarch.r 2.6 MB/s | 135 kB 00:00 2024-09-21T01:28:19.641 INFO:teuthology.orchestra.run.smithi142.stdout:(129/157): python3-jaraco-text-3.2.0-6.el9.noar 392 kB/s | 20 kB 00:00 2024-09-21T01:28:19.655 INFO:teuthology.orchestra.run.smithi083.stdout:(46/157): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-09-21T01:28:19.667 INFO:teuthology.orchestra.run.smithi142.stdout:(130/157): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-21T01:28:19.692 INFO:teuthology.orchestra.run.smithi142.stdout:(131/157): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-21T01:28:19.713 INFO:teuthology.orchestra.run.smithi083.stdout:(47/157): python3-urllib3-1.26.5-6.el9.noarch.r 2.5 MB/s | 215 kB 00:00 2024-09-21T01:28:19.717 INFO:teuthology.orchestra.run.smithi142.stdout:(132/157): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-21T01:28:19.751 INFO:teuthology.orchestra.run.smithi142.stdout:(133/157): python3-pecan-1.4.2-3.el9.noarch.rpm 8.0 MB/s | 272 kB 00:00 2024-09-21T01:28:19.755 INFO:teuthology.orchestra.run.smithi083.stdout:(48/157): python3-cryptography-36.0.1-4.el9.x86 5.0 MB/s | 1.2 MB 00:00 2024-09-21T01:28:19.776 INFO:teuthology.orchestra.run.smithi142.stdout:(134/157): python3-portend-3.1.0-2.el9.noarch.r 662 kB/s | 16 kB 00:00 2024-09-21T01:28:19.810 INFO:teuthology.orchestra.run.smithi142.stdout:(135/157): python3-kubernetes-26.1.0-2.el9.noar 5.3 MB/s | 1.0 MB 00:00 2024-09-21T01:28:19.826 INFO:teuthology.orchestra.run.smithi142.stdout:(136/157): python3-pyperclip-1.8.2-2.el9.noarch 1.7 MB/s | 28 kB 00:00 2024-09-21T01:28:19.831 INFO:teuthology.orchestra.run.smithi083.stdout:(49/157): automake-1.16.2-8.el9.noarch.rpm 3.8 MB/s | 689 kB 00:00 2024-09-21T01:28:19.852 INFO:teuthology.orchestra.run.smithi142.stdout:(137/157): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.2 MB/s | 90 kB 00:00 2024-09-21T01:28:19.865 INFO:teuthology.orchestra.run.smithi083.stdout:(50/157): elfutils-libelf-devel-0.191-4.el9.x86 651 kB/s | 22 kB 00:00 2024-09-21T01:28:19.869 INFO:teuthology.orchestra.run.smithi142.stdout:(138/157): python3-repoze-lru-0.7-16.el9.noarch 728 kB/s | 31 kB 00:00 2024-09-21T01:28:19.886 INFO:teuthology.orchestra.run.smithi142.stdout:(139/157): python3-rsa-4.9-2.el9.noarch.rpm 3.5 MB/s | 59 kB 00:00 2024-09-21T01:28:19.890 INFO:teuthology.orchestra.run.smithi083.stdout:(51/157): boost-program-options-1.75.0-8.el9.x8 797 kB/s | 107 kB 00:00 2024-09-21T01:28:19.911 INFO:teuthology.orchestra.run.smithi142.stdout:(140/157): python3-routes-2.5.1-5.el9.noarch.rp 3.1 MB/s | 188 kB 00:00 2024-09-21T01:28:19.915 INFO:teuthology.orchestra.run.smithi083.stdout:(52/157): flex-2.6.4-9.el9.x86_64.rpm 6.1 MB/s | 313 kB 00:00 2024-09-21T01:28:19.936 INFO:teuthology.orchestra.run.smithi142.stdout:(141/157): python3-tempora-5.0.0-2.el9.noarch.r 713 kB/s | 36 kB 00:00 2024-09-21T01:28:19.940 INFO:teuthology.orchestra.run.smithi083.stdout:(53/157): flexiblas-3.0.4-8.el9.x86_64.rpm 652 kB/s | 33 kB 00:00 2024-09-21T01:28:19.962 INFO:teuthology.orchestra.run.smithi142.stdout:(142/157): python3-typing-extensions-4.12.2-2.e 1.4 MB/s | 74 kB 00:00 2024-09-21T01:28:19.982 INFO:teuthology.orchestra.run.smithi083.stdout:(54/157): bison-3.7.4-5.el9.x86_64.rpm 3.4 MB/s | 943 kB 00:00 2024-09-21T01:28:19.987 INFO:teuthology.orchestra.run.smithi142.stdout:(143/157): python3-websocket-client-1.2.3-2.el9 3.6 MB/s | 90 kB 00:00 2024-09-21T01:28:20.008 INFO:teuthology.orchestra.run.smithi083.stdout:(55/157): flexiblas-openblas-openmp-3.0.4-8.el9 272 kB/s | 18 kB 00:00 2024-09-21T01:28:20.012 INFO:teuthology.orchestra.run.smithi142.stdout:(144/157): python3-webob-1.8.8-2.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-09-21T01:28:20.033 INFO:teuthology.orchestra.run.smithi083.stdout:(56/157): libaio-devel-0.3.111-13.el9.x86_64.rp 222 kB/s | 11 kB 00:00 2024-09-21T01:28:20.054 INFO:teuthology.orchestra.run.smithi142.stdout:(145/157): python3-grpcio-1.46.7-10.el9.x86_64. 3.3 MB/s | 2.0 MB 00:00 2024-09-21T01:28:20.067 INFO:teuthology.orchestra.run.smithi083.stdout:(57/157): libnbd-1.20.2-2.el9.x86_64.rpm 2.9 MB/s | 171 kB 00:00 2024-09-21T01:28:20.080 INFO:teuthology.orchestra.run.smithi142.stdout:(146/157): python3-zc-lockfile-2.0-10.el9.noarc 298 kB/s | 20 kB 00:00 2024-09-21T01:28:20.100 INFO:teuthology.orchestra.run.smithi083.stdout:(58/157): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.3 MB/s | 160 kB 00:00 2024-09-21T01:28:20.105 INFO:teuthology.orchestra.run.smithi142.stdout:(147/157): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-21T01:28:20.126 INFO:teuthology.orchestra.run.smithi083.stdout:(59/157): librabbitmq-0.11.0-7.el9.x86_64.rpm 773 kB/s | 45 kB 00:00 2024-09-21T01:28:20.130 INFO:teuthology.orchestra.run.smithi142.stdout:(148/157): python3-werkzeug-2.0.3-3.el9.1.noarc 2.9 MB/s | 427 kB 00:00 2024-09-21T01:28:20.176 INFO:teuthology.orchestra.run.smithi083.stdout:(60/157): flexiblas-netlib-3.0.4-8.el9.x86_64.r 11 MB/s | 3.0 MB 00:00 2024-09-21T01:28:20.180 INFO:teuthology.orchestra.run.smithi142.stdout:(149/157): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-21T01:28:20.218 INFO:teuthology.orchestra.run.smithi083.stdout:(61/157): librdkafka-1.6.1-102.el9.x86_64.rpm 5.5 MB/s | 662 kB 00:00 2024-09-21T01:28:20.268 INFO:teuthology.orchestra.run.smithi083.stdout:(62/157): libuuid-devel-2.37.4-20.el9.x86_64.rp 266 kB/s | 24 kB 00:00 2024-09-21T01:28:20.272 INFO:teuthology.orchestra.run.smithi142.stdout:(150/157): NetworkManager-1.51.0-1.el9.x86_64.r 25 MB/s | 2.3 MB 00:00 2024-09-21T01:28:20.293 INFO:teuthology.orchestra.run.smithi083.stdout:(63/157): libzstd-devel-1.5.1-2.el9.x86_64.rpm 631 kB/s | 47 kB 00:00 2024-09-21T01:28:20.319 INFO:teuthology.orchestra.run.smithi083.stdout:(64/157): libtool-2.4.6-46.el9.x86_64.rpm 2.9 MB/s | 581 kB 00:00 2024-09-21T01:28:20.325 INFO:teuthology.orchestra.run.smithi119.stdout:lab-extras 34 kB/s | 1.7 kB 00:00 2024-09-21T01:28:20.348 INFO:teuthology.orchestra.run.smithi142.stdout:(151/157): NetworkManager-libnm-1.51.0-1.el9.x8 24 MB/s | 1.8 MB 00:00 2024-09-21T01:28:20.352 INFO:teuthology.orchestra.run.smithi083.stdout:(65/157): lua-5.4.4-4.el9.x86_64.rpm 3.1 MB/s | 188 kB 00:00 2024-09-21T01:28:20.377 INFO:teuthology.orchestra.run.smithi083.stdout:(66/157): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.6 MB/s | 292 kB 00:00 2024-09-21T01:28:20.403 INFO:teuthology.orchestra.run.smithi083.stdout:(67/157): openblas-0.3.26-2.el9.x86_64.rpm 460 kB/s | 38 kB 00:00 2024-09-21T01:28:20.415 INFO:teuthology.orchestra.run.smithi142.stdout:(152/157): librados2-19.3.0-5120.g18432218.el9. 11 MB/s | 3.4 MB 00:00 2024-09-21T01:28:20.440 INFO:teuthology.orchestra.run.smithi142.stdout:(153/157): NetworkManager-team-1.51.0-1.el9.x86 444 kB/s | 41 kB 00:00 2024-09-21T01:28:20.495 INFO:teuthology.orchestra.run.smithi083.stdout:(68/157): openssl-devel-3.2.2-6.el9.x86_64.rpm 38 MB/s | 4.4 MB 00:00 2024-09-21T01:28:20.524 INFO:teuthology.orchestra.run.smithi142.stdout:(154/157): librbd1-19.3.0-5120.g18432218.el9.x8 8.0 MB/s | 3.2 MB 00:00 2024-09-21T01:28:20.537 INFO:teuthology.orchestra.run.smithi083.stdout:(69/157): postgresql-13.16-1.el9.x86_64.rpm 12 MB/s | 1.6 MB 00:00 2024-09-21T01:28:20.549 INFO:teuthology.orchestra.run.smithi142.stdout:(155/157): NetworkManager-tui-1.51.0-1.el9.x86_ 1.8 MB/s | 249 kB 00:00 2024-09-21T01:28:20.570 INFO:teuthology.orchestra.run.smithi083.stdout:(70/157): postgresql-contrib-13.16-1.el9.x86_64 12 MB/s | 910 kB 00:00 2024-09-21T01:28:20.591 INFO:teuthology.orchestra.run.smithi142.stdout:(156/157): openssl-3.2.2-6.el9.x86_64.rpm 9.0 MB/s | 1.4 MB 00:00 2024-09-21T01:28:20.595 INFO:teuthology.orchestra.run.smithi083.stdout:(71/157): postgresql-private-libs-13.16-1.el9.x 2.3 MB/s | 137 kB 00:00 2024-09-21T01:28:20.663 INFO:teuthology.orchestra.run.smithi083.stdout:(72/157): openblas-openmp-0.3.26-2.el9.x86_64.r 16 MB/s | 4.9 MB 00:00 2024-09-21T01:28:20.704 INFO:teuthology.orchestra.run.smithi083.stdout:(73/157): protobuf-3.14.0-13.el9.x86_64.rpm 9.3 MB/s | 1.0 MB 00:00 2024-09-21T01:28:20.708 INFO:teuthology.orchestra.run.smithi142.stdout:(157/157): openssl-libs-3.2.2-6.el9.x86_64.rpm 13 MB/s | 2.4 MB 00:00 2024-09-21T01:28:20.715 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2024-09-21T01:28:20.715 INFO:teuthology.orchestra.run.smithi142.stdout:Total 26 MB/s | 228 MB 00:08 2024-09-21T01:28:20.730 INFO:teuthology.orchestra.run.smithi083.stdout:(74/157): python3-attrs-20.3.0-7.el9.noarch.rpm 1.3 MB/s | 87 kB 00:00 2024-09-21T01:28:20.780 INFO:teuthology.orchestra.run.smithi083.stdout:(75/157): python3-colorama-0.4.6-3.el9.noarch.r 1.2 MB/s | 61 kB 00:00 2024-09-21T01:28:20.855 INFO:teuthology.orchestra.run.smithi083.stdout:(76/157): postgresql-server-13.16-1.el9.x86_64. 20 MB/s | 5.8 MB 00:00 2024-09-21T01:28:20.881 INFO:teuthology.orchestra.run.smithi083.stdout:(77/157): python3-devel-3.9.19-8.el9.x86_64.rpm 2.4 MB/s | 245 kB 00:00 2024-09-21T01:28:20.906 INFO:teuthology.orchestra.run.smithi083.stdout:(78/157): python3-jinja2-2.11.3-6.el9.noarch.rp 4.8 MB/s | 248 kB 00:00 2024-09-21T01:28:20.931 INFO:teuthology.orchestra.run.smithi083.stdout:(79/157): python3-jsonpatch-1.21-16.el9.noarch. 508 kB/s | 26 kB 00:00 2024-09-21T01:28:20.957 INFO:teuthology.orchestra.run.smithi083.stdout:(80/157): python3-jsonpointer-2.0-4.el9.noarch. 381 kB/s | 19 kB 00:00 2024-09-21T01:28:20.982 INFO:teuthology.orchestra.run.smithi083.stdout:(81/157): python3-mako-1.1.4-6.el9.noarch.rpm 3.4 MB/s | 172 kB 00:00 2024-09-21T01:28:21.008 INFO:teuthology.orchestra.run.smithi083.stdout:(82/157): python3-markupsafe-1.1.1-12.el9.x86_6 693 kB/s | 35 kB 00:00 2024-09-21T01:28:21.091 INFO:teuthology.orchestra.run.smithi083.stdout:(83/157): python3-babel-2.9.1-2.el9.noarch.rpm 15 MB/s | 6.0 MB 00:00 2024-09-21T01:28:21.125 INFO:teuthology.orchestra.run.smithi083.stdout:(84/157): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.1 MB/s | 250 kB 00:00 2024-09-21T01:28:21.150 INFO:teuthology.orchestra.run.smithi083.stdout:(85/157): python3-oauthlib-3.1.1-5.el9.noarch.r 3.7 MB/s | 222 kB 00:00 2024-09-21T01:28:21.175 INFO:teuthology.orchestra.run.smithi083.stdout:(86/157): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-09-21T01:28:21.200 INFO:teuthology.orchestra.run.smithi083.stdout:(87/157): python3-prettytable-0.7.2-27.el9.noar 841 kB/s | 42 kB 00:00 2024-09-21T01:28:21.226 INFO:teuthology.orchestra.run.smithi083.stdout:(88/157): python3-protobuf-3.14.0-13.el9.noarch 5.2 MB/s | 269 kB 00:00 2024-09-21T01:28:21.251 INFO:teuthology.orchestra.run.smithi083.stdout:(89/157): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-09-21T01:28:21.276 INFO:teuthology.orchestra.run.smithi083.stdout:(90/157): python3-pyasn1-modules-0.4.8-6.el9.no 5.4 MB/s | 279 kB 00:00 2024-09-21T01:28:21.293 INFO:teuthology.orchestra.run.smithi083.stdout:(91/157): python3-pytz-2021.1-5.el9.noarch.rpm 1.2 MB/s | 51 kB 00:00 2024-09-21T01:28:21.310 INFO:teuthology.orchestra.run.smithi083.stdout:(92/157): python3-requests-oauthlib-1.3.0-12.el 1.6 MB/s | 54 kB 00:00 2024-09-21T01:28:21.386 INFO:teuthology.orchestra.run.smithi083.stdout:(93/157): python3-numpy-1.20.1-5.el9.x86_64.rpm 13 MB/s | 5.1 MB 00:00 2024-09-21T01:28:21.402 INFO:teuthology.orchestra.run.smithi083.stdout:(94/157): python3-toml-0.10.2-6.el9.noarch.rpm 453 kB/s | 42 kB 00:00 2024-09-21T01:28:21.419 INFO:teuthology.orchestra.run.smithi083.stdout:(95/157): python3-wcwidth-0.2.5-8.el9.noarch.rp 1.3 MB/s | 44 kB 00:00 2024-09-21T01:28:21.453 INFO:teuthology.orchestra.run.smithi083.stdout:(96/157): qatlib-24.02.0-1.el9.x86_64.rpm 4.3 MB/s | 221 kB 00:00 2024-09-21T01:28:21.470 INFO:teuthology.orchestra.run.smithi083.stdout:(97/157): qatlib-service-24.02.0-1.el9.x86_64.r 715 kB/s | 36 kB 00:00 2024-09-21T01:28:21.487 INFO:teuthology.orchestra.run.smithi083.stdout:(98/157): qatzip-libs-1.2.0-1.el9.x86_64.rpm 1.4 MB/s | 47 kB 00:00 2024-09-21T01:28:21.512 INFO:teuthology.orchestra.run.smithi083.stdout:(99/157): socat-1.7.4.1-6.el9.x86_64.rpm 7.1 MB/s | 304 kB 00:00 2024-09-21T01:28:21.537 INFO:teuthology.orchestra.run.smithi083.stdout:(100/157): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-09-21T01:28:21.563 INFO:teuthology.orchestra.run.smithi083.stdout:(101/157): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.9 MB/s | 96 kB 00:00 2024-09-21T01:28:21.588 INFO:teuthology.orchestra.run.smithi083.stdout:(102/157): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-21T01:28:21.613 INFO:teuthology.orchestra.run.smithi083.stdout:(103/157): zlib-devel-1.2.11-41.el9.x86_64.rpm 896 kB/s | 45 kB 00:00 2024-09-21T01:28:21.689 INFO:teuthology.orchestra.run.smithi083.stdout:(104/157): lua-devel-5.4.4-4.el9.x86_64.rpm 223 kB/s | 22 kB 00:00 2024-09-21T01:28:21.856 INFO:teuthology.orchestra.run.smithi083.stdout:(105/157): python3-scipy-1.6.2-8.el9.x86_64.rpm 29 MB/s | 16 MB 00:00 2024-09-21T01:28:21.914 INFO:teuthology.orchestra.run.smithi083.stdout:(106/157): abseil-cpp-20211102.0-3.el9.x86_64.r 2.4 MB/s | 548 kB 00:00 2024-09-21T01:28:21.940 INFO:teuthology.orchestra.run.smithi083.stdout:(107/157): grpc-data-1.46.7-10.el9.noarch.rpm 780 kB/s | 19 kB 00:00 2024-09-21T01:28:21.949 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2024-09-21T01:28:21.965 INFO:teuthology.orchestra.run.smithi083.stdout:(108/157): gperftools-libs-2.9.1-3.el9.x86_64.r 2.8 MB/s | 308 kB 00:00 2024-09-21T01:28:21.990 INFO:teuthology.orchestra.run.smithi083.stdout:(109/157): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-21T01:28:22.016 INFO:teuthology.orchestra.run.smithi083.stdout:(110/157): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-21T01:28:22.049 INFO:teuthology.orchestra.run.smithi083.stdout:(111/157): protobuf-compiler-3.14.0-13.el9.x86_ 1.9 MB/s | 863 kB 00:00 2024-09-21T01:28:22.075 INFO:teuthology.orchestra.run.smithi083.stdout:(112/157): libunwind-1.6.2-1.el9.x86_64.rpm 1.1 MB/s | 67 kB 00:00 2024-09-21T01:28:22.102 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2024-09-21T01:28:22.102 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2024-09-21T01:28:22.133 INFO:teuthology.orchestra.run.smithi083.stdout:(113/157): luarocks-3.9.2-5.el9.noarch.rpm 1.8 MB/s | 151 kB 00:00 2024-09-21T01:28:22.175 INFO:teuthology.orchestra.run.smithi083.stdout:(114/157): parquet-libs-9.0.0-11.el9.x86_64.rpm 8.8 MB/s | 839 kB 00:00 2024-09-21T01:28:22.200 INFO:teuthology.orchestra.run.smithi083.stdout:(115/157): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-21T01:28:22.226 INFO:teuthology.orchestra.run.smithi083.stdout:(116/157): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-21T01:28:22.293 INFO:teuthology.orchestra.run.smithi083.stdout:(117/157): libarrow-9.0.0-11.el9.x86_64.rpm 13 MB/s | 4.4 MB 00:00 2024-09-21T01:28:22.318 INFO:teuthology.orchestra.run.smithi083.stdout:(118/157): python3-certifi-2023.05.07-4.el9.noa 153 kB/s | 14 kB 00:00 2024-09-21T01:28:22.352 INFO:teuthology.orchestra.run.smithi083.stdout:(119/157): python3-asyncssh-2.13.2-5.el9.noarch 2.5 MB/s | 548 kB 00:00 2024-09-21T01:28:22.377 INFO:teuthology.orchestra.run.smithi083.stdout:(120/157): python3-cheroot-8.6.0-4.el9.noarch.r 2.0 MB/s | 172 kB 00:00 2024-09-21T01:28:22.402 INFO:teuthology.orchestra.run.smithi083.stdout:(121/157): python3-cherrypy-18.6.1-2.el9.noarch 4.2 MB/s | 358 kB 00:00 2024-09-21T01:28:22.427 INFO:teuthology.orchestra.run.smithi083.stdout:(122/157): python3-cmd2-2.4.2-2.el9.noarch.rpm 3.9 MB/s | 303 kB 00:00 2024-09-21T01:28:22.453 INFO:teuthology.orchestra.run.smithi083.stdout:(123/157): python3-google-auth-2.34.0-1.el9.noa 2.8 MB/s | 220 kB 00:00 2024-09-21T01:28:22.486 INFO:teuthology.orchestra.run.smithi083.stdout:(124/157): python3-grpcio-tools-1.46.7-10.el9.x 2.4 MB/s | 144 kB 00:00 2024-09-21T01:28:22.512 INFO:teuthology.orchestra.run.smithi083.stdout:(125/157): python3-jaraco-8.2.1-3.el9.noarch.rp 183 kB/s | 11 kB 00:00 2024-09-21T01:28:22.512 INFO:teuthology.orchestra.run.smithi119.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T01:28:22.513 INFO:teuthology.orchestra.run.smithi119.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T01:28:22.528 INFO:teuthology.orchestra.run.smithi119.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-21T01:28:22.529 INFO:teuthology.orchestra.run.smithi119.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-21T01:28:22.530 INFO:teuthology.orchestra.run.smithi119.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-21T01:28:22.531 INFO:teuthology.orchestra.run.smithi119.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-21T01:28:22.533 INFO:teuthology.orchestra.run.smithi119.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-21T01:28:22.535 INFO:teuthology.orchestra.run.smithi119.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-21T01:28:22.537 INFO:teuthology.orchestra.run.smithi083.stdout:(126/157): python3-jaraco-classes-3.2.1-5.el9.n 351 kB/s | 18 kB 00:00 2024-09-21T01:28:22.537 INFO:teuthology.orchestra.run.smithi119.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-21T01:28:22.562 INFO:teuthology.orchestra.run.smithi083.stdout:(127/157): python3-jaraco-collections-3.0.0-8.e 462 kB/s | 23 kB 00:00 2024-09-21T01:28:22.587 INFO:teuthology.orchestra.run.smithi083.stdout:(128/157): python3-jaraco-functools-3.5.0-2.el9 386 kB/s | 19 kB 00:00 2024-09-21T01:28:22.601 INFO:teuthology.orchestra.run.smithi119.stdout:Dependencies resolved. 2024-09-21T01:28:22.613 INFO:teuthology.orchestra.run.smithi083.stdout:(129/157): python3-jaraco-text-3.2.0-6.el9.noar 390 kB/s | 20 kB 00:00 2024-09-21T01:28:22.626 INFO:teuthology.orchestra.run.smithi119.stdout:======================================================================================= 2024-09-21T01:28:22.626 INFO:teuthology.orchestra.run.smithi119.stdout: Package Arch Version Repository Size 2024-09-21T01:28:22.626 INFO:teuthology.orchestra.run.smithi119.stdout:======================================================================================= 2024-09-21T01:28:22.626 INFO:teuthology.orchestra.run.smithi119.stdout:Installing: 2024-09-21T01:28:22.626 INFO:teuthology.orchestra.run.smithi119.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-21T01:28:22.626 INFO:teuthology.orchestra.run.smithi119.stdout: ceph x86_64 2:19.3.0-5120.g18432218.el9 ceph 6.6 k 2024-09-21T01:28:22.626 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-base x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.5 M 2024-09-21T01:28:22.626 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 873 k 2024-09-21T01:28:22.626 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T01:28:22.626 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr x86_64 2:19.3.0-5120.g18432218.el9 ceph 1.5 M 2024-09-21T01:28:22.627 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 154 k 2024-09-21T01:28:22.627 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-dashboard noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 14 M 2024-09-21T01:28:22.627 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 7.4 M 2024-09-21T01:28:22.627 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-rook noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 49 k 2024-09-21T01:28:22.627 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-radosgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 10 M 2024-09-21T01:28:22.627 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-test x86_64 2:19.3.0-5120.g18432218.el9 ceph 40 M 2024-09-21T01:28:22.627 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-volume noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 285 k 2024-09-21T01:28:22.627 INFO:teuthology.orchestra.run.smithi119.stdout: cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 784 k 2024-09-21T01:28:22.627 INFO:teuthology.orchestra.run.smithi119.stdout: cephfs-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 226 k 2024-09-21T01:28:22.627 INFO:teuthology.orchestra.run.smithi119.stdout: cephfs-shell x86_64 2:19.3.0-5120.g18432218.el9 ceph 27 k 2024-09-21T01:28:22.627 INFO:teuthology.orchestra.run.smithi119.stdout: cephfs-top noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 18 k 2024-09-21T01:28:22.627 INFO:teuthology.orchestra.run.smithi119.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-21T01:28:22.627 INFO:teuthology.orchestra.run.smithi119.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-21T01:28:22.627 INFO:teuthology.orchestra.run.smithi119.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-21T01:28:22.628 INFO:teuthology.orchestra.run.smithi119.stdout: libcephfs-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 32 k 2024-09-21T01:28:22.628 INFO:teuthology.orchestra.run.smithi119.stdout: libcephfs2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 766 k 2024-09-21T01:28:22.628 INFO:teuthology.orchestra.run.smithi119.stdout: librados-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 127 k 2024-09-21T01:28:22.628 INFO:teuthology.orchestra.run.smithi119.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-21T01:28:22.628 INFO:teuthology.orchestra.run.smithi119.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-21T01:28:22.628 INFO:teuthology.orchestra.run.smithi119.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-21T01:28:22.628 INFO:teuthology.orchestra.run.smithi119.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-21T01:28:22.628 INFO:teuthology.orchestra.run.smithi119.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-21T01:28:22.628 INFO:teuthology.orchestra.run.smithi119.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-21T01:28:22.628 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cephfs x86_64 2:19.3.0-5120.g18432218.el9 ceph 161 k 2024-09-21T01:28:22.628 INFO:teuthology.orchestra.run.smithi119.stdout: python3-rados x86_64 2:19.3.0-5120.g18432218.el9 ceph 321 k 2024-09-21T01:28:22.628 INFO:teuthology.orchestra.run.smithi119.stdout: python3-rbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 307 k 2024-09-21T01:28:22.628 INFO:teuthology.orchestra.run.smithi119.stdout: python3-rgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 99 k 2024-09-21T01:28:22.628 INFO:teuthology.orchestra.run.smithi119.stdout: rbd-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 86 k 2024-09-21T01:28:22.628 INFO:teuthology.orchestra.run.smithi119.stdout: rbd-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.1 M 2024-09-21T01:28:22.629 INFO:teuthology.orchestra.run.smithi119.stdout: rbd-nbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 170 k 2024-09-21T01:28:22.629 INFO:teuthology.orchestra.run.smithi119.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-21T01:28:22.629 INFO:teuthology.orchestra.run.smithi119.stdout:Upgrading: 2024-09-21T01:28:22.629 INFO:teuthology.orchestra.run.smithi119.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-21T01:28:22.629 INFO:teuthology.orchestra.run.smithi119.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-21T01:28:22.629 INFO:teuthology.orchestra.run.smithi119.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-21T01:28:22.629 INFO:teuthology.orchestra.run.smithi119.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-21T01:28:22.629 INFO:teuthology.orchestra.run.smithi119.stdout: librados2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.4 M 2024-09-21T01:28:22.629 INFO:teuthology.orchestra.run.smithi119.stdout: librbd1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.2 M 2024-09-21T01:28:22.629 INFO:teuthology.orchestra.run.smithi119.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-21T01:28:22.629 INFO:teuthology.orchestra.run.smithi119.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-21T01:28:22.629 INFO:teuthology.orchestra.run.smithi119.stdout:Installing dependencies: 2024-09-21T01:28:22.629 INFO:teuthology.orchestra.run.smithi119.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-21T01:28:22.629 INFO:teuthology.orchestra.run.smithi119.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-21T01:28:22.629 INFO:teuthology.orchestra.run.smithi119.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-21T01:28:22.629 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 20 M 2024-09-21T01:28:22.630 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-grafana-dashboards noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 34 k 2024-09-21T01:28:22.630 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mds x86_64 2:19.3.0-5120.g18432218.el9 ceph 2.3 M 2024-09-21T01:28:22.630 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-modules-core noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 292 k 2024-09-21T01:28:22.630 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mon x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.0 M 2024-09-21T01:28:22.630 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-osd x86_64 2:19.3.0-5120.g18432218.el9 ceph 18 M 2024-09-21T01:28:22.630 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-prometheus-alerts noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 16 k 2024-09-21T01:28:22.630 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-selinux x86_64 2:19.3.0-5120.g18432218.el9 ceph 25 k 2024-09-21T01:28:22.630 INFO:teuthology.orchestra.run.smithi119.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-21T01:28:22.630 INFO:teuthology.orchestra.run.smithi119.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-21T01:28:22.630 INFO:teuthology.orchestra.run.smithi119.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-21T01:28:22.630 INFO:teuthology.orchestra.run.smithi119.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-21T01:28:22.630 INFO:teuthology.orchestra.run.smithi119.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-21T01:28:22.631 INFO:teuthology.orchestra.run.smithi119.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-21T01:28:22.631 INFO:teuthology.orchestra.run.smithi119.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-21T01:28:22.631 INFO:teuthology.orchestra.run.smithi119.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-21T01:28:22.631 INFO:teuthology.orchestra.run.smithi119.stdout: libcephsqlite x86_64 2:19.3.0-5120.g18432218.el9 ceph 158 k 2024-09-21T01:28:22.631 INFO:teuthology.orchestra.run.smithi119.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-21T01:28:22.631 INFO:teuthology.orchestra.run.smithi119.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-21T01:28:22.631 INFO:teuthology.orchestra.run.smithi119.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-21T01:28:22.631 INFO:teuthology.orchestra.run.smithi119.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-21T01:28:22.631 INFO:teuthology.orchestra.run.smithi119.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-21T01:28:22.631 INFO:teuthology.orchestra.run.smithi119.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-21T01:28:22.631 INFO:teuthology.orchestra.run.smithi119.stdout: libradosstriper1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 507 k 2024-09-21T01:28:22.631 INFO:teuthology.orchestra.run.smithi119.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-21T01:28:22.631 INFO:teuthology.orchestra.run.smithi119.stdout: librgw2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.3 M 2024-09-21T01:28:22.631 INFO:teuthology.orchestra.run.smithi119.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-21T01:28:22.631 INFO:teuthology.orchestra.run.smithi119.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-21T01:28:22.632 INFO:teuthology.orchestra.run.smithi119.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-21T01:28:22.632 INFO:teuthology.orchestra.run.smithi119.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-21T01:28:22.632 INFO:teuthology.orchestra.run.smithi119.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-21T01:28:22.632 INFO:teuthology.orchestra.run.smithi119.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-21T01:28:22.632 INFO:teuthology.orchestra.run.smithi119.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-21T01:28:22.632 INFO:teuthology.orchestra.run.smithi119.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-21T01:28:22.632 INFO:teuthology.orchestra.run.smithi119.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-21T01:28:22.632 INFO:teuthology.orchestra.run.smithi119.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-21T01:28:22.632 INFO:teuthology.orchestra.run.smithi119.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-21T01:28:22.632 INFO:teuthology.orchestra.run.smithi119.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-21T01:28:22.632 INFO:teuthology.orchestra.run.smithi119.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-21T01:28:22.632 INFO:teuthology.orchestra.run.smithi119.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-21T01:28:22.632 INFO:teuthology.orchestra.run.smithi119.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-21T01:28:22.632 INFO:teuthology.orchestra.run.smithi119.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-21T01:28:22.633 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-21T01:28:22.633 INFO:teuthology.orchestra.run.smithi119.stdout: python3-ceph-argparse x86_64 2:19.3.0-5120.g18432218.el9 ceph 45 k 2024-09-21T01:28:22.633 INFO:teuthology.orchestra.run.smithi119.stdout: python3-ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T01:28:22.633 INFO:teuthology.orchestra.run.smithi119.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-21T01:28:22.633 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-21T01:28:22.633 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-21T01:28:22.633 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-21T01:28:22.633 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-21T01:28:22.633 INFO:teuthology.orchestra.run.smithi119.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-21T01:28:22.633 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-21T01:28:22.633 INFO:teuthology.orchestra.run.smithi119.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-21T01:28:22.633 INFO:teuthology.orchestra.run.smithi119.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-21T01:28:22.633 INFO:teuthology.orchestra.run.smithi119.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-21T01:28:22.633 INFO:teuthology.orchestra.run.smithi119.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-21T01:28:22.633 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-21T01:28:22.634 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-21T01:28:22.634 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-21T01:28:22.634 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-21T01:28:22.634 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-21T01:28:22.634 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-21T01:28:22.634 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-21T01:28:22.634 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-21T01:28:22.634 INFO:teuthology.orchestra.run.smithi119.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-21T01:28:22.634 INFO:teuthology.orchestra.run.smithi119.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-21T01:28:22.634 INFO:teuthology.orchestra.run.smithi119.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-21T01:28:22.634 INFO:teuthology.orchestra.run.smithi119.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-21T01:28:22.634 INFO:teuthology.orchestra.run.smithi119.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-21T01:28:22.634 INFO:teuthology.orchestra.run.smithi119.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-21T01:28:22.634 INFO:teuthology.orchestra.run.smithi119.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-21T01:28:22.635 INFO:teuthology.orchestra.run.smithi119.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-21T01:28:22.635 INFO:teuthology.orchestra.run.smithi119.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-21T01:28:22.635 INFO:teuthology.orchestra.run.smithi119.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-21T01:28:22.635 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-21T01:28:22.635 INFO:teuthology.orchestra.run.smithi119.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-21T01:28:22.635 INFO:teuthology.orchestra.run.smithi119.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-21T01:28:22.635 INFO:teuthology.orchestra.run.smithi119.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-21T01:28:22.635 INFO:teuthology.orchestra.run.smithi119.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-21T01:28:22.635 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-21T01:28:22.635 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-21T01:28:22.635 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-21T01:28:22.635 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-21T01:28:22.635 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-21T01:28:22.635 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-21T01:28:22.636 INFO:teuthology.orchestra.run.smithi119.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-21T01:28:22.636 INFO:teuthology.orchestra.run.smithi119.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-21T01:28:22.636 INFO:teuthology.orchestra.run.smithi119.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-21T01:28:22.636 INFO:teuthology.orchestra.run.smithi119.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-21T01:28:22.636 INFO:teuthology.orchestra.run.smithi119.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-21T01:28:22.636 INFO:teuthology.orchestra.run.smithi119.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-21T01:28:22.636 INFO:teuthology.orchestra.run.smithi119.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-21T01:28:22.636 INFO:teuthology.orchestra.run.smithi119.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-21T01:28:22.636 INFO:teuthology.orchestra.run.smithi119.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-21T01:28:22.636 INFO:teuthology.orchestra.run.smithi119.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-21T01:28:22.636 INFO:teuthology.orchestra.run.smithi119.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-21T01:28:22.636 INFO:teuthology.orchestra.run.smithi119.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-21T01:28:22.636 INFO:teuthology.orchestra.run.smithi119.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-21T01:28:22.636 INFO:teuthology.orchestra.run.smithi119.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-21T01:28:22.637 INFO:teuthology.orchestra.run.smithi119.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-21T01:28:22.637 INFO:teuthology.orchestra.run.smithi119.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-21T01:28:22.637 INFO:teuthology.orchestra.run.smithi119.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-21T01:28:22.637 INFO:teuthology.orchestra.run.smithi119.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-21T01:28:22.637 INFO:teuthology.orchestra.run.smithi119.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-21T01:28:22.637 INFO:teuthology.orchestra.run.smithi119.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-21T01:28:22.637 INFO:teuthology.orchestra.run.smithi119.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-21T01:28:22.637 INFO:teuthology.orchestra.run.smithi119.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-21T01:28:22.637 INFO:teuthology.orchestra.run.smithi119.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-21T01:28:22.637 INFO:teuthology.orchestra.run.smithi119.stdout:Installing weak dependencies: 2024-09-21T01:28:22.637 INFO:teuthology.orchestra.run.smithi119.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-21T01:28:22.637 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-21T01:28:22.637 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction Summary 2024-09-21T01:28:22.637 INFO:teuthology.orchestra.run.smithi119.stdout:======================================================================================= 2024-09-21T01:28:22.638 INFO:teuthology.orchestra.run.smithi119.stdout:Install 149 Packages 2024-09-21T01:28:22.638 INFO:teuthology.orchestra.run.smithi119.stdout:Upgrade 8 Packages 2024-09-21T01:28:22.638 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-21T01:28:22.638 INFO:teuthology.orchestra.run.smithi083.stdout:(130/157): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-21T01:28:22.639 INFO:teuthology.orchestra.run.smithi119.stdout:Total download size: 228 M 2024-09-21T01:28:22.639 INFO:teuthology.orchestra.run.smithi119.stdout:Downloading Packages: 2024-09-21T01:28:22.663 INFO:teuthology.orchestra.run.smithi083.stdout:(131/157): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-21T01:28:22.689 INFO:teuthology.orchestra.run.smithi083.stdout:(132/157): python3-natsort-7.1.1-5.el9.noarch.r 2.2 MB/s | 58 kB 00:00 2024-09-21T01:28:22.722 INFO:teuthology.orchestra.run.smithi083.stdout:(133/157): python3-kubernetes-26.1.0-2.el9.noar 7.6 MB/s | 1.0 MB 00:00 2024-09-21T01:28:22.748 INFO:teuthology.orchestra.run.smithi083.stdout:(134/157): python3-pecan-1.4.2-3.el9.noarch.rpm 4.5 MB/s | 272 kB 00:00 2024-09-21T01:28:22.765 INFO:teuthology.orchestra.run.smithi083.stdout:(135/157): python3-portend-3.1.0-2.el9.noarch.r 388 kB/s | 16 kB 00:00 2024-09-21T01:28:22.782 INFO:teuthology.orchestra.run.smithi083.stdout:(136/157): python3-pyperclip-1.8.2-2.el9.noarch 1.7 MB/s | 28 kB 00:00 2024-09-21T01:28:22.807 INFO:teuthology.orchestra.run.smithi083.stdout:(137/157): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.5 MB/s | 90 kB 00:00 2024-09-21T01:28:22.832 INFO:teuthology.orchestra.run.smithi083.stdout:(138/157): python3-repoze-lru-0.7-16.el9.noarch 612 kB/s | 31 kB 00:00 2024-09-21T01:28:22.858 INFO:teuthology.orchestra.run.smithi083.stdout:(139/157): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-21T01:28:22.883 INFO:teuthology.orchestra.run.smithi083.stdout:(140/157): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-09-21T01:28:22.908 INFO:teuthology.orchestra.run.smithi083.stdout:(141/157): python3-tempora-5.0.0-2.el9.noarch.r 713 kB/s | 36 kB 00:00 2024-09-21T01:28:22.933 INFO:teuthology.orchestra.run.smithi083.stdout:(142/157): python3-typing-extensions-4.12.2-2.e 1.4 MB/s | 74 kB 00:00 2024-09-21T01:28:22.984 INFO:teuthology.orchestra.run.smithi083.stdout:(143/157): python3-grpcio-1.46.7-10.el9.x86_64. 3.5 MB/s | 2.0 MB 00:00 2024-09-21T01:28:23.009 INFO:teuthology.orchestra.run.smithi083.stdout:(144/157): python3-websocket-client-1.2.3-2.el9 1.2 MB/s | 90 kB 00:00 2024-09-21T01:28:23.035 INFO:teuthology.orchestra.run.smithi083.stdout:(145/157): python3-webob-1.8.8-2.el9.noarch.rpm 1.8 MB/s | 230 kB 00:00 2024-09-21T01:28:23.060 INFO:teuthology.orchestra.run.smithi083.stdout:(146/157): python3-zc-lockfile-2.0-10.el9.noarc 397 kB/s | 20 kB 00:00 2024-09-21T01:28:23.085 INFO:teuthology.orchestra.run.smithi083.stdout:(147/157): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-21T01:28:23.173 INFO:teuthology.orchestra.run.smithi083.stdout:(148/157): python3-werkzeug-2.0.3-3.el9.1.noarc 2.2 MB/s | 427 kB 00:00 2024-09-21T01:28:23.221 INFO:teuthology.orchestra.run.smithi083.stdout:(149/157): thrift-0.15.0-2.el9.x86_64.rpm 9.8 MB/s | 1.6 MB 00:00 2024-09-21T01:28:23.347 INFO:teuthology.orchestra.run.smithi083.stdout:(150/157): librados2-19.3.0-5120.g18432218.el9. 13 MB/s | 3.4 MB 00:00 2024-09-21T01:28:23.542 INFO:teuthology.orchestra.run.smithi119.stdout:(1/157): ceph-19.3.0-5120.g18432218.el9.x86_64. 46 kB/s | 6.6 kB 00:00 2024-09-21T01:28:23.547 INFO:teuthology.orchestra.run.smithi083.stdout:(151/157): librbd1-19.3.0-5120.g18432218.el9.x8 8.5 MB/s | 3.2 MB 00:00 2024-09-21T01:28:23.639 INFO:teuthology.orchestra.run.smithi083.stdout:(152/157): NetworkManager-team-1.51.0-1.el9.x86 446 kB/s | 41 kB 00:00 2024-09-21T01:28:23.731 INFO:teuthology.orchestra.run.smithi083.stdout:(153/157): NetworkManager-tui-1.51.0-1.el9.x86_ 2.7 MB/s | 249 kB 00:00 2024-09-21T01:28:23.768 INFO:teuthology.orchestra.run.smithi119.stdout:(2/157): ceph-fuse-19.3.0-5120.g18432218.el9.x8 3.8 MB/s | 873 kB 00:00 2024-09-21T01:28:23.790 INFO:teuthology.orchestra.run.smithi083.stdout:(154/157): NetworkManager-1.51.0-1.el9.x86_64.r 4.1 MB/s | 2.3 MB 00:00 2024-09-21T01:28:23.860 INFO:teuthology.orchestra.run.smithi119.stdout:(3/157): ceph-base-19.3.0-5120.g18432218.el9.x8 12 MB/s | 5.5 MB 00:00 2024-09-21T01:28:23.882 INFO:teuthology.orchestra.run.smithi083.stdout:(155/157): NetworkManager-libnm-1.51.0-1.el9.x8 3.4 MB/s | 1.8 MB 00:00 2024-09-21T01:28:23.885 INFO:teuthology.orchestra.run.smithi119.stdout:(4/157): ceph-immutable-object-cache-19.3.0-512 1.2 MB/s | 148 kB 00:00 2024-09-21T01:28:24.010 INFO:teuthology.orchestra.run.smithi119.stdout:(5/157): ceph-mds-19.3.0-5120.g18432218.el9.x86 15 MB/s | 2.3 MB 00:00 2024-09-21T01:28:24.032 INFO:teuthology.orchestra.run.smithi083.stdout:(156/157): openssl-3.2.2-6.el9.x86_64.rpm 4.5 MB/s | 1.4 MB 00:00 2024-09-21T01:28:24.128 INFO:teuthology.orchestra.run.smithi119.stdout:(6/157): ceph-mgr-19.3.0-5120.g18432218.el9.x86 6.3 MB/s | 1.5 MB 00:00 2024-09-21T01:28:24.261 INFO:teuthology.orchestra.run.smithi119.stdout:(7/157): ceph-mon-19.3.0-5120.g18432218.el9.x86 20 MB/s | 5.0 MB 00:00 2024-09-21T01:28:24.401 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2024-09-21T01:28:24.402 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2024-09-21T01:28:24.486 INFO:teuthology.orchestra.run.smithi119.stdout:(8/157): ceph-common-19.3.0-5120.g18432218.el9. 18 MB/s | 20 MB 00:01 2024-09-21T01:28:24.515 INFO:teuthology.orchestra.run.smithi083.stdout:(157/157): openssl-libs-3.2.2-6.el9.x86_64.rpm 3.3 MB/s | 2.4 MB 00:00 2024-09-21T01:28:24.521 INFO:teuthology.orchestra.run.smithi083.stdout:-------------------------------------------------------------------------------- 2024-09-21T01:28:24.521 INFO:teuthology.orchestra.run.smithi083.stdout:Total 24 MB/s | 228 MB 00:09 2024-09-21T01:28:24.528 INFO:teuthology.orchestra.run.smithi119.stdout:(9/157): ceph-selinux-19.3.0-5120.g18432218.el9 607 kB/s | 25 kB 00:00 2024-09-21T01:28:24.837 INFO:teuthology.orchestra.run.smithi119.stdout:(10/157): ceph-radosgw-19.3.0-5120.g18432218.el 18 MB/s | 10 MB 00:00 2024-09-21T01:28:24.887 INFO:teuthology.orchestra.run.smithi119.stdout:(11/157): cephfs-mirror-19.3.0-5120.g18432218.e 4.4 MB/s | 226 kB 00:00 2024-09-21T01:28:24.954 INFO:teuthology.orchestra.run.smithi119.stdout:(12/157): cephfs-shell-19.3.0-5120.g18432218.el 407 kB/s | 27 kB 00:00 2024-09-21T01:28:25.012 INFO:teuthology.orchestra.run.smithi119.stdout:(13/157): libcephfs-devel-19.3.0-5120.g18432218 546 kB/s | 32 kB 00:00 2024-09-21T01:28:25.138 INFO:teuthology.orchestra.run.smithi119.stdout:(14/157): libcephfs2-19.3.0-5120.g18432218.el9. 6.0 MB/s | 766 kB 00:00 2024-09-21T01:28:25.213 INFO:teuthology.orchestra.run.smithi119.stdout:(15/157): libcephsqlite-19.3.0-5120.g18432218.e 2.1 MB/s | 158 kB 00:00 2024-09-21T01:28:25.280 INFO:teuthology.orchestra.run.smithi119.stdout:(16/157): librados-devel-19.3.0-5120.g18432218. 1.9 MB/s | 127 kB 00:00 2024-09-21T01:28:25.380 INFO:teuthology.orchestra.run.smithi119.stdout:(17/157): libradosstriper1-19.3.0-5120.g1843221 5.0 MB/s | 507 kB 00:00 2024-09-21T01:28:25.740 INFO:teuthology.orchestra.run.smithi083.stdout:Running transaction check 2024-09-21T01:28:25.881 INFO:teuthology.orchestra.run.smithi119.stdout:(18/157): ceph-osd-19.3.0-5120.g18432218.el9.x8 10 MB/s | 18 MB 00:01 2024-09-21T01:28:25.892 INFO:teuthology.orchestra.run.smithi083.stdout:Transaction check succeeded. 2024-09-21T01:28:25.892 INFO:teuthology.orchestra.run.smithi083.stdout:Running transaction test 2024-09-21T01:28:26.231 INFO:teuthology.orchestra.run.smithi119.stdout:(19/157): ceph-test-19.3.0-5120.g18432218.el9.x 23 MB/s | 40 MB 00:01 2024-09-21T01:28:26.256 INFO:teuthology.orchestra.run.smithi119.stdout:(20/157): python3-ceph-argparse-19.3.0-5120.g18 120 kB/s | 45 kB 00:00 2024-09-21T01:28:26.281 INFO:teuthology.orchestra.run.smithi119.stdout:(21/157): python3-ceph-common-19.3.0-5120.g1843 2.9 MB/s | 148 kB 00:00 2024-09-21T01:28:26.315 INFO:teuthology.orchestra.run.smithi119.stdout:(22/157): python3-cephfs-19.3.0-5120.g18432218. 2.7 MB/s | 161 kB 00:00 2024-09-21T01:28:26.340 INFO:teuthology.orchestra.run.smithi119.stdout:(23/157): python3-rados-19.3.0-5120.g18432218.e 5.4 MB/s | 321 kB 00:00 2024-09-21T01:28:26.416 INFO:teuthology.orchestra.run.smithi119.stdout:(24/157): librgw2-19.3.0-5120.g18432218.el9.x86 5.1 MB/s | 5.3 MB 00:01 2024-09-21T01:28:26.441 INFO:teuthology.orchestra.run.smithi119.stdout:(25/157): python3-rgw-19.3.0-5120.g18432218.el9 994 kB/s | 99 kB 00:00 2024-09-21T01:28:26.466 INFO:teuthology.orchestra.run.smithi119.stdout:(26/157): rbd-fuse-19.3.0-5120.g18432218.el9.x8 1.7 MB/s | 86 kB 00:00 2024-09-21T01:28:26.499 INFO:teuthology.orchestra.run.smithi119.stdout:(27/157): python3-rbd-19.3.0-5120.g18432218.el9 1.6 MB/s | 307 kB 00:00 2024-09-21T01:28:26.534 INFO:teuthology.orchestra.run.smithi119.stdout:(28/157): rbd-nbd-19.3.0-5120.g18432218.el9.x86 2.5 MB/s | 170 kB 00:00 2024-09-21T01:28:26.558 INFO:teuthology.orchestra.run.smithi119.stdout:(29/157): ceph-grafana-dashboards-19.3.0-5120.g 585 kB/s | 34 kB 00:00 2024-09-21T01:28:26.592 INFO:teuthology.orchestra.run.smithi119.stdout:(30/157): ceph-mgr-cephadm-19.3.0-5120.g1843221 2.6 MB/s | 154 kB 00:00 2024-09-21T01:28:26.651 INFO:teuthology.orchestra.run.smithi119.stdout:(31/157): rbd-mirror-19.3.0-5120.g18432218.el9. 15 MB/s | 3.1 MB 00:00 2024-09-21T01:28:26.709 INFO:teuthology.orchestra.run.smithi119.stdout:(32/157): ceph-mgr-modules-core-19.3.0-5120.g18 4.9 MB/s | 292 kB 00:00 2024-09-21T01:28:26.768 INFO:teuthology.orchestra.run.smithi119.stdout:(33/157): ceph-mgr-rook-19.3.0-5120.g18432218.e 846 kB/s | 49 kB 00:00 2024-09-21T01:28:26.818 INFO:teuthology.orchestra.run.smithi119.stdout:(34/157): ceph-prometheus-alerts-19.3.0-5120.g1 329 kB/s | 16 kB 00:00 2024-09-21T01:28:26.885 INFO:teuthology.orchestra.run.smithi119.stdout:(35/157): ceph-volume-19.3.0-5120.g18432218.el9 4.2 MB/s | 285 kB 00:00 2024-09-21T01:28:26.969 INFO:teuthology.orchestra.run.smithi119.stdout:(36/157): cephadm-19.3.0-5120.g18432218.el9.noa 9.2 MB/s | 784 kB 00:00 2024-09-21T01:28:27.053 INFO:teuthology.orchestra.run.smithi119.stdout:(37/157): ceph-mgr-diskprediction-local-19.3.0- 16 MB/s | 7.4 MB 00:00 2024-09-21T01:28:27.070 INFO:teuthology.orchestra.run.smithi119.stdout:(38/157): cephfs-top-19.3.0-5120.g18432218.el9. 183 kB/s | 18 kB 00:00 2024-09-21T01:28:27.162 INFO:teuthology.orchestra.run.smithi119.stdout:(39/157): fuse-2.9.9-16.el9.x86_64.rpm 736 kB/s | 80 kB 00:00 2024-09-21T01:28:27.220 INFO:teuthology.orchestra.run.smithi119.stdout:(40/157): libquadmath-11.5.0-2.el9.x86_64.rpm 3.2 MB/s | 191 kB 00:00 2024-09-21T01:28:27.262 INFO:teuthology.orchestra.run.smithi119.stdout:(41/157): libgfortran-11.5.0-2.el9.x86_64.rpm 4.1 MB/s | 801 kB 00:00 2024-09-21T01:28:27.287 INFO:teuthology.orchestra.run.smithi119.stdout:(42/157): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.7 MB/s | 253 kB 00:00 2024-09-21T01:28:27.329 INFO:teuthology.orchestra.run.smithi119.stdout:(43/157): python3-ply-3.11-14.el9.noarch.rpm 2.5 MB/s | 106 kB 00:00 2024-09-21T01:28:27.513 INFO:teuthology.orchestra.run.smithi119.stdout:(44/157): ceph-mgr-dashboard-19.3.0-5120.g18432 15 MB/s | 14 MB 00:00 2024-09-21T01:28:27.538 INFO:teuthology.orchestra.run.smithi119.stdout:(45/157): python3-pycparser-2.20-6.el9.noarch.r 648 kB/s | 135 kB 00:00 2024-09-21T01:28:27.572 INFO:teuthology.orchestra.run.smithi119.stdout:(46/157): python3-requests-2.25.1-8.el9.noarch. 2.1 MB/s | 125 kB 00:00 2024-09-21T01:28:27.605 INFO:teuthology.orchestra.run.smithi119.stdout:(47/157): python3-cryptography-36.0.1-4.el9.x86 3.6 MB/s | 1.2 MB 00:00 2024-09-21T01:28:27.689 INFO:teuthology.orchestra.run.smithi119.stdout:(48/157): python3-urllib3-1.26.5-6.el9.noarch.r 1.4 MB/s | 215 kB 00:00 2024-09-21T01:28:27.839 INFO:teuthology.orchestra.run.smithi119.stdout:(49/157): automake-1.16.2-8.el9.noarch.rpm 2.5 MB/s | 689 kB 00:00 2024-09-21T01:28:27.864 INFO:teuthology.orchestra.run.smithi119.stdout:(50/157): boost-program-options-1.75.0-8.el9.x8 610 kB/s | 107 kB 00:00 2024-09-21T01:28:27.898 INFO:teuthology.orchestra.run.smithi119.stdout:(51/157): bison-3.7.4-5.el9.x86_64.rpm 3.2 MB/s | 943 kB 00:00 2024-09-21T01:28:27.923 INFO:teuthology.orchestra.run.smithi119.stdout:(52/157): elfutils-libelf-devel-0.191-4.el9.x86 258 kB/s | 22 kB 00:00 2024-09-21T01:28:27.948 INFO:teuthology.orchestra.run.smithi119.stdout:(53/157): flexiblas-3.0.4-8.el9.x86_64.rpm 655 kB/s | 33 kB 00:00 2024-09-21T01:28:27.999 INFO:teuthology.orchestra.run.smithi119.stdout:(54/157): flexiblas-openblas-openmp-3.0.4-8.el9 363 kB/s | 18 kB 00:00 2024-09-21T01:28:28.032 INFO:teuthology.orchestra.run.smithi119.stdout:(55/157): flex-2.6.4-9.el9.x86_64.rpm 1.8 MB/s | 313 kB 00:00 2024-09-21T01:28:28.058 INFO:teuthology.orchestra.run.smithi119.stdout:(56/157): libaio-devel-0.3.111-13.el9.x86_64.rp 190 kB/s | 11 kB 00:00 2024-09-21T01:28:28.083 INFO:teuthology.orchestra.run.smithi119.stdout:(57/157): libnbd-1.20.2-2.el9.x86_64.rpm 3.3 MB/s | 171 kB 00:00 2024-09-21T01:28:28.142 INFO:teuthology.orchestra.run.smithi119.stdout:(58/157): flexiblas-netlib-3.0.4-8.el9.x86_64.r 14 MB/s | 3.0 MB 00:00 2024-09-21T01:28:28.167 INFO:teuthology.orchestra.run.smithi083.stdout:Transaction test succeeded. 2024-09-21T01:28:28.170 INFO:teuthology.orchestra.run.smithi119.stdout:(59/157): librabbitmq-0.11.0-7.el9.x86_64.rpm 541 kB/s | 45 kB 00:00 2024-09-21T01:28:28.170 INFO:teuthology.orchestra.run.smithi083.stdout:Running transaction 2024-09-21T01:28:28.192 INFO:teuthology.orchestra.run.smithi119.stdout:(60/157): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.2 MB/s | 160 kB 00:00 2024-09-21T01:28:28.218 INFO:teuthology.orchestra.run.smithi119.stdout:(61/157): librdkafka-1.6.1-102.el9.x86_64.rpm 8.6 MB/s | 662 kB 00:00 2024-09-21T01:28:28.251 INFO:teuthology.orchestra.run.smithi119.stdout:(62/157): libtool-2.4.6-46.el9.x86_64.rpm 6.8 MB/s | 581 kB 00:00 2024-09-21T01:28:28.276 INFO:teuthology.orchestra.run.smithi119.stdout:(63/157): libuuid-devel-2.37.4-20.el9.x86_64.rp 292 kB/s | 24 kB 00:00 2024-09-21T01:28:28.310 INFO:teuthology.orchestra.run.smithi119.stdout:(64/157): libzstd-devel-1.5.1-2.el9.x86_64.rpm 513 kB/s | 47 kB 00:00 2024-09-21T01:28:28.344 INFO:teuthology.orchestra.run.smithi119.stdout:(65/157): lua-5.4.4-4.el9.x86_64.rpm 2.7 MB/s | 188 kB 00:00 2024-09-21T01:28:28.369 INFO:teuthology.orchestra.run.smithi119.stdout:(66/157): openblas-0.3.26-2.el9.x86_64.rpm 659 kB/s | 38 kB 00:00 2024-09-21T01:28:28.394 INFO:teuthology.orchestra.run.smithi119.stdout:(67/157): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.0 MB/s | 292 kB 00:00 2024-09-21T01:28:28.503 INFO:teuthology.orchestra.run.smithi119.stdout:(68/157): postgresql-13.16-1.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-09-21T01:28:28.570 INFO:teuthology.orchestra.run.smithi119.stdout:(69/157): openblas-openmp-0.3.26-2.el9.x86_64.r 22 MB/s | 4.9 MB 00:00 2024-09-21T01:28:28.612 INFO:teuthology.orchestra.run.smithi119.stdout:(70/157): postgresql-contrib-13.16-1.el9.x86_64 8.2 MB/s | 910 kB 00:00 2024-09-21T01:28:28.637 INFO:teuthology.orchestra.run.smithi119.stdout:(71/157): postgresql-private-libs-13.16-1.el9.x 2.0 MB/s | 137 kB 00:00 2024-09-21T01:28:28.713 INFO:teuthology.orchestra.run.smithi119.stdout:(72/157): protobuf-3.14.0-13.el9.x86_64.rpm 13 MB/s | 1.0 MB 00:00 2024-09-21T01:28:28.779 INFO:teuthology.orchestra.run.smithi119.stdout:(73/157): openssl-devel-3.2.2-6.el9.x86_64.rpm 11 MB/s | 4.4 MB 00:00 2024-09-21T01:28:28.805 INFO:teuthology.orchestra.run.smithi119.stdout:(74/157): python3-attrs-20.3.0-7.el9.noarch.rpm 952 kB/s | 87 kB 00:00 2024-09-21T01:28:28.855 INFO:teuthology.orchestra.run.smithi119.stdout:(75/157): python3-colorama-0.4.6-3.el9.noarch.r 1.2 MB/s | 61 kB 00:00 2024-09-21T01:28:28.955 INFO:teuthology.orchestra.run.smithi119.stdout:(76/157): postgresql-server-13.16-1.el9.x86_64. 17 MB/s | 5.8 MB 00:00 2024-09-21T01:28:28.980 INFO:teuthology.orchestra.run.smithi119.stdout:(77/157): python3-devel-3.9.19-8.el9.x86_64.rpm 1.9 MB/s | 245 kB 00:00 2024-09-21T01:28:29.056 INFO:teuthology.orchestra.run.smithi119.stdout:(78/157): python3-jinja2-2.11.3-6.el9.noarch.rp 2.4 MB/s | 248 kB 00:00 2024-09-21T01:28:29.081 INFO:teuthology.orchestra.run.smithi119.stdout:(79/157): python3-jsonpatch-1.21-16.el9.noarch. 255 kB/s | 26 kB 00:00 2024-09-21T01:28:29.106 INFO:teuthology.orchestra.run.smithi119.stdout:(80/157): python3-jsonpointer-2.0-4.el9.noarch. 380 kB/s | 19 kB 00:00 2024-09-21T01:28:29.182 INFO:teuthology.orchestra.run.smithi119.stdout:(81/157): python3-babel-2.9.1-2.el9.noarch.rpm 15 MB/s | 6.0 MB 00:00 2024-09-21T01:28:29.207 INFO:teuthology.orchestra.run.smithi119.stdout:(82/157): python3-markupsafe-1.1.1-12.el9.x86_6 347 kB/s | 35 kB 00:00 2024-09-21T01:28:29.232 INFO:teuthology.orchestra.run.smithi119.stdout:(83/157): python3-mako-1.1.4-6.el9.noarch.rpm 1.1 MB/s | 172 kB 00:00 2024-09-21T01:28:29.266 INFO:teuthology.orchestra.run.smithi119.stdout:(84/157): python3-numpy-f2py-1.20.1-5.el9.x86_6 4.2 MB/s | 250 kB 00:00 2024-09-21T01:28:29.291 INFO:teuthology.orchestra.run.smithi119.stdout:(85/157): python3-oauthlib-3.1.1-5.el9.noarch.r 3.7 MB/s | 222 kB 00:00 2024-09-21T01:28:29.324 INFO:teuthology.orchestra.run.smithi119.stdout:(86/157): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 77 kB 00:00 2024-09-21T01:28:29.350 INFO:teuthology.orchestra.run.smithi119.stdout:(87/157): python3-prettytable-0.7.2-27.el9.noar 721 kB/s | 42 kB 00:00 2024-09-21T01:28:29.383 INFO:teuthology.orchestra.run.smithi119.stdout:(88/157): python3-protobuf-3.14.0-13.el9.noarch 4.5 MB/s | 269 kB 00:00 2024-09-21T01:28:29.409 INFO:teuthology.orchestra.run.smithi119.stdout:(89/157): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.6 MB/s | 159 kB 00:00 2024-09-21T01:28:29.476 INFO:teuthology.orchestra.run.smithi119.stdout:(90/157): python3-numpy-1.20.1-5.el9.x86_64.rpm 17 MB/s | 5.1 MB 00:00 2024-09-21T01:28:29.501 INFO:teuthology.orchestra.run.smithi119.stdout:(91/157): python3-pytz-2021.1-5.el9.noarch.rpm 555 kB/s | 51 kB 00:00 2024-09-21T01:28:29.526 INFO:teuthology.orchestra.run.smithi119.stdout:(92/157): python3-pyasn1-modules-0.4.8-6.el9.no 1.9 MB/s | 279 kB 00:00 2024-09-21T01:28:29.552 INFO:teuthology.orchestra.run.smithi119.stdout:(93/157): python3-requests-oauthlib-1.3.0-12.el 707 kB/s | 54 kB 00:00 2024-09-21T01:28:29.577 INFO:teuthology.orchestra.run.smithi119.stdout:(94/157): python3-toml-0.10.2-6.el9.noarch.rpm 825 kB/s | 42 kB 00:00 2024-09-21T01:28:29.611 INFO:teuthology.orchestra.run.smithi119.stdout:(95/157): python3-wcwidth-0.2.5-8.el9.noarch.rp 756 kB/s | 44 kB 00:00 2024-09-21T01:28:29.644 INFO:teuthology.orchestra.run.smithi119.stdout:(96/157): qatlib-24.02.0-1.el9.x86_64.rpm 3.2 MB/s | 221 kB 00:00 2024-09-21T01:28:29.670 INFO:teuthology.orchestra.run.smithi119.stdout:(97/157): qatlib-service-24.02.0-1.el9.x86_64.r 613 kB/s | 36 kB 00:00 2024-09-21T01:28:29.695 INFO:teuthology.orchestra.run.smithi119.stdout:(98/157): qatzip-libs-1.2.0-1.el9.x86_64.rpm 947 kB/s | 47 kB 00:00 2024-09-21T01:28:29.737 INFO:teuthology.orchestra.run.smithi119.stdout:(99/157): socat-1.7.4.1-6.el9.x86_64.rpm 4.4 MB/s | 304 kB 00:00 2024-09-21T01:28:29.762 INFO:teuthology.orchestra.run.smithi119.stdout:(100/157): uuid-1.6.2-55.el9.x86_64.rpm 863 kB/s | 58 kB 00:00 2024-09-21T01:28:29.795 INFO:teuthology.orchestra.run.smithi119.stdout:(101/157): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.6 MB/s | 96 kB 00:00 2024-09-21T01:28:29.821 INFO:teuthology.orchestra.run.smithi119.stdout:(102/157): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.1 MB/s | 64 kB 00:00 2024-09-21T01:28:29.846 INFO:teuthology.orchestra.run.smithi119.stdout:(103/157): zlib-devel-1.2.11-41.el9.x86_64.rpm 890 kB/s | 45 kB 00:00 2024-09-21T01:28:30.072 INFO:teuthology.orchestra.run.smithi119.stdout:(104/157): python3-scipy-1.6.2-8.el9.x86_64.rpm 29 MB/s | 16 MB 00:00 2024-09-21T01:28:30.130 INFO:teuthology.orchestra.run.smithi119.stdout:(105/157): abseil-cpp-20211102.0-3.el9.x86_64.r 9.3 MB/s | 548 kB 00:00 2024-09-21T01:28:30.155 INFO:teuthology.orchestra.run.smithi119.stdout:(106/157): gperftools-libs-2.9.1-3.el9.x86_64.r 12 MB/s | 308 kB 00:00 2024-09-21T01:28:30.189 INFO:teuthology.orchestra.run.smithi119.stdout:(107/157): grpc-data-1.46.7-10.el9.noarch.rpm 756 kB/s | 19 kB 00:00 2024-09-21T01:28:30.298 INFO:teuthology.orchestra.run.smithi119.stdout:(108/157): libarrow-9.0.0-11.el9.x86_64.rpm 41 MB/s | 4.4 MB 00:00 2024-09-21T01:28:30.331 INFO:teuthology.orchestra.run.smithi119.stdout:(109/157): libarrow-doc-9.0.0-11.el9.noarch.rpm 998 kB/s | 26 kB 00:00 2024-09-21T01:28:30.358 INFO:teuthology.orchestra.run.smithi119.stdout:(110/157): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-21T01:28:30.382 INFO:teuthology.orchestra.run.smithi119.stdout:(111/157): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-21T01:28:30.407 INFO:teuthology.orchestra.run.smithi119.stdout:(112/157): luarocks-3.9.2-5.el9.noarch.rpm 5.9 MB/s | 151 kB 00:00 2024-09-21T01:28:30.441 INFO:teuthology.orchestra.run.smithi119.stdout:(113/157): parquet-libs-9.0.0-11.el9.x86_64.rpm 25 MB/s | 839 kB 00:00 2024-09-21T01:28:30.474 INFO:teuthology.orchestra.run.smithi119.stdout:(114/157): python3-asyncssh-2.13.2-5.el9.noarch 16 MB/s | 548 kB 00:00 2024-09-21T01:28:30.491 INFO:teuthology.orchestra.run.smithi119.stdout:(115/157): lua-devel-5.4.4-4.el9.x86_64.rpm 33 kB/s | 22 kB 00:00 2024-09-21T01:28:30.516 INFO:teuthology.orchestra.run.smithi119.stdout:(116/157): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.0 MB/s | 43 kB 00:00 2024-09-21T01:28:30.691 INFO:teuthology.orchestra.run.smithi119.stdout:(117/157): python3-certifi-2023.05.07-4.el9.noa 87 kB/s | 14 kB 00:00 2024-09-21T01:28:30.717 INFO:teuthology.orchestra.run.smithi119.stdout:(118/157): python3-cheroot-8.6.0-4.el9.noarch.r 7.3 MB/s | 172 kB 00:00 2024-09-21T01:28:30.742 INFO:teuthology.orchestra.run.smithi119.stdout:(119/157): python3-cachetools-4.2.4-1.el9.noarc 128 kB/s | 32 kB 00:00 2024-09-21T01:28:30.776 INFO:teuthology.orchestra.run.smithi119.stdout:(120/157): python3-cherrypy-18.6.1-2.el9.noarch 6.0 MB/s | 358 kB 00:00 2024-09-21T01:28:30.790 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2024-09-21T01:28:30.801 INFO:teuthology.orchestra.run.smithi119.stdout:(121/157): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.1 MB/s | 303 kB 00:00 2024-09-21T01:28:30.835 INFO:teuthology.orchestra.run.smithi119.stdout:(122/157): python3-google-auth-2.34.0-1.el9.noa 3.7 MB/s | 220 kB 00:00 2024-09-21T01:28:30.860 INFO:teuthology.orchestra.run.smithi119.stdout:(123/157): python3-grpcio-tools-1.46.7-10.el9.x 5.6 MB/s | 144 kB 00:00 2024-09-21T01:28:30.885 INFO:teuthology.orchestra.run.smithi119.stdout:(124/157): python3-jaraco-8.2.1-3.el9.noarch.rp 428 kB/s | 11 kB 00:00 2024-09-21T01:28:30.895 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/165 2024-09-21T01:28:30.911 INFO:teuthology.orchestra.run.smithi119.stdout:(125/157): python3-jaraco-classes-3.2.1-5.el9.n 710 kB/s | 18 kB 00:00 2024-09-21T01:28:30.936 INFO:teuthology.orchestra.run.smithi119.stdout:(126/157): python3-jaraco-collections-3.0.0-8.e 928 kB/s | 23 kB 00:00 2024-09-21T01:28:30.936 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-09-21T01:28:30.961 INFO:teuthology.orchestra.run.smithi119.stdout:(127/157): python3-jaraco-functools-3.5.0-2.el9 784 kB/s | 19 kB 00:00 2024-09-21T01:28:30.987 INFO:teuthology.orchestra.run.smithi119.stdout:(128/157): python3-jaraco-text-3.2.0-6.el9.noar 792 kB/s | 20 kB 00:00 2024-09-21T01:28:31.054 INFO:teuthology.orchestra.run.smithi119.stdout:(129/157): python3-grpcio-1.46.7-10.el9.x86_64. 8.1 MB/s | 2.0 MB 00:00 2024-09-21T01:28:31.079 INFO:teuthology.orchestra.run.smithi119.stdout:(130/157): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-21T01:28:31.104 INFO:teuthology.orchestra.run.smithi119.stdout:(131/157): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-21T01:28:31.138 INFO:teuthology.orchestra.run.smithi119.stdout:(132/157): python3-kubernetes-26.1.0-2.el9.noar 6.8 MB/s | 1.0 MB 00:00 2024-09-21T01:28:31.163 INFO:teuthology.orchestra.run.smithi119.stdout:(133/157): python3-natsort-7.1.1-5.el9.noarch.r 988 kB/s | 58 kB 00:00 2024-09-21T01:28:31.188 INFO:teuthology.orchestra.run.smithi119.stdout:(134/157): python3-portend-3.1.0-2.el9.noarch.r 658 kB/s | 16 kB 00:00 2024-09-21T01:28:31.197 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-09-21T01:28:31.214 INFO:teuthology.orchestra.run.smithi119.stdout:(135/157): python3-pyOpenSSL-21.0.0-1.el9.noarc 3.5 MB/s | 90 kB 00:00 2024-09-21T01:28:31.229 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-09-21T01:28:31.239 INFO:teuthology.orchestra.run.smithi119.stdout:(136/157): python3-pecan-1.4.2-3.el9.noarch.rpm 2.6 MB/s | 272 kB 00:00 2024-09-21T01:28:31.255 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-09-21T01:28:31.264 INFO:teuthology.orchestra.run.smithi119.stdout:(137/157): python3-pyperclip-1.8.2-2.el9.noarch 561 kB/s | 28 kB 00:00 2024-09-21T01:28:31.289 INFO:teuthology.orchestra.run.smithi119.stdout:(138/157): python3-repoze-lru-0.7-16.el9.noarch 615 kB/s | 31 kB 00:00 2024-09-21T01:28:31.312 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-09-21T01:28:31.315 INFO:teuthology.orchestra.run.smithi119.stdout:(139/157): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-21T01:28:31.340 INFO:teuthology.orchestra.run.smithi119.stdout:(140/157): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-09-21T01:28:31.365 INFO:teuthology.orchestra.run.smithi119.stdout:(141/157): python3-tempora-5.0.0-2.el9.noarch.r 712 kB/s | 36 kB 00:00 2024-09-21T01:28:31.390 INFO:teuthology.orchestra.run.smithi119.stdout:(142/157): python3-typing-extensions-4.12.2-2.e 1.4 MB/s | 74 kB 00:00 2024-09-21T01:28:31.432 INFO:teuthology.orchestra.run.smithi119.stdout:(143/157): protobuf-compiler-3.14.0-13.el9.x86_ 544 kB/s | 863 kB 00:01 2024-09-21T01:28:31.458 INFO:teuthology.orchestra.run.smithi119.stdout:(144/157): python3-websocket-client-1.2.3-2.el9 1.3 MB/s | 90 kB 00:00 2024-09-21T01:28:31.491 INFO:teuthology.orchestra.run.smithi119.stdout:(145/157): python3-webob-1.8.8-2.el9.noarch.rpm 1.8 MB/s | 230 kB 00:00 2024-09-21T01:28:31.517 INFO:teuthology.orchestra.run.smithi119.stdout:(146/157): python3-zc-lockfile-2.0-10.el9.noarc 392 kB/s | 20 kB 00:00 2024-09-21T01:28:31.542 INFO:teuthology.orchestra.run.smithi119.stdout:(147/157): re2-20211101-20.el9.x86_64.rpm 3.9 MB/s | 191 kB 00:00 2024-09-21T01:28:31.584 INFO:teuthology.orchestra.run.smithi119.stdout:(148/157): python3-werkzeug-2.0.3-3.el9.1.noarc 2.8 MB/s | 427 kB 00:00 2024-09-21T01:28:31.634 INFO:teuthology.orchestra.run.smithi119.stdout:(149/157): thrift-0.15.0-2.el9.x86_64.rpm 14 MB/s | 1.6 MB 00:00 2024-09-21T01:28:31.665 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-09-21T01:28:31.797 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T01:28:31.826 INFO:teuthology.orchestra.run.smithi119.stdout:(150/157): librados2-19.3.0-5120.g18432218.el9. 12 MB/s | 3.4 MB 00:00 2024-09-21T01:28:31.893 INFO:teuthology.orchestra.run.smithi119.stdout:(151/157): librbd1-19.3.0-5120.g18432218.el9.x8 10 MB/s | 3.2 MB 00:00 2024-09-21T01:28:31.924 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T01:28:31.957 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T01:28:31.977 INFO:teuthology.orchestra.run.smithi119.stdout:(152/157): NetworkManager-team-1.51.0-1.el9.x86 490 kB/s | 41 kB 00:00 2024-09-21T01:28:32.049 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T01:28:32.054 INFO:teuthology.orchestra.run.smithi119.stdout:(153/157): NetworkManager-tui-1.51.0-1.el9.x86_ 3.2 MB/s | 249 kB 00:00 2024-09-21T01:28:32.078 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T01:28:32.116 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/165 2024-09-21T01:28:32.178 INFO:teuthology.orchestra.run.smithi119.stdout:(154/157): NetworkManager-1.51.0-1.el9.x86_64.r 4.3 MB/s | 2.3 MB 00:00 2024-09-21T01:28:32.292 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 12/165 2024-09-21T01:28:32.319 INFO:teuthology.orchestra.run.smithi119.stdout:(155/157): NetworkManager-libnm-1.51.0-1.el9.x8 3.7 MB/s | 1.8 MB 00:00 2024-09-21T01:28:32.350 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : postgresql-13.16-1.el9.x86_64 13/165 2024-09-21T01:28:32.353 INFO:teuthology.orchestra.run.smithi119.stdout:(156/157): openssl-3.2.2-6.el9.x86_64.rpm 4.5 MB/s | 1.4 MB 00:00 2024-09-21T01:28:32.387 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T01:28:32.499 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T01:28:32.530 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T01:28:32.593 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T01:28:32.614 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T01:28:32.641 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T01:28:32.847 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T01:28:32.903 INFO:teuthology.orchestra.run.smithi119.stdout:(157/157): openssl-libs-3.2.2-6.el9.x86_64.rpm 3.3 MB/s | 2.4 MB 00:00 2024-09-21T01:28:32.910 INFO:teuthology.orchestra.run.smithi119.stdout:-------------------------------------------------------------------------------- 2024-09-21T01:28:32.910 INFO:teuthology.orchestra.run.smithi119.stdout:Total 22 MB/s | 228 MB 00:10 2024-09-21T01:28:33.033 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T01:28:33.129 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 18/165 2024-09-21T01:28:33.244 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T01:28:33.314 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T01:28:33.566 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T01:28:33.686 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : re2-1:20211101-20.el9.x86_64 20/165 2024-09-21T01:28:33.733 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/165 2024-09-21T01:28:33.770 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/165 2024-09-21T01:28:33.844 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/165 2024-09-21T01:28:33.904 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/165 2024-09-21T01:28:33.944 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/165 2024-09-21T01:28:33.988 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/165 2024-09-21T01:28:34.021 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/165 2024-09-21T01:28:34.048 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2024-09-21T01:28:34.117 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2024-09-21T01:28:34.158 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction check 2024-09-21T01:28:34.171 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/165 2024-09-21T01:28:34.201 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/165 2024-09-21T01:28:34.245 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/165 2024-09-21T01:28:34.313 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction check succeeded. 2024-09-21T01:28:34.313 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction test 2024-09-21T01:28:34.326 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/165 2024-09-21T01:28:34.372 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 34/165 2024-09-21T01:28:34.416 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 35/165 2024-09-21T01:28:34.444 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 36/165 2024-09-21T01:28:34.513 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/165 2024-09-21T01:28:34.559 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/165 2024-09-21T01:28:34.632 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/165 2024-09-21T01:28:34.730 INFO:teuthology.orchestra.run.smithi083.stdout: Preparing : 1/1 2024-09-21T01:28:34.765 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/165 2024-09-21T01:28:34.819 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/165 2024-09-21T01:28:34.861 INFO:teuthology.orchestra.run.smithi083.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/165 2024-09-21T01:28:34.902 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-09-21T01:28:34.964 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-09-21T01:28:35.003 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-09-21T01:28:35.029 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-09-21T01:28:35.086 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-09-21T01:28:35.354 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/165 2024-09-21T01:28:35.429 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-09-21T01:28:35.431 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/165 2024-09-21T01:28:35.461 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/165 2024-09-21T01:28:35.514 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/165 2024-09-21T01:28:35.550 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 46/165 2024-09-21T01:28:35.563 INFO:teuthology.orchestra.run.smithi083.stdout: Upgrading : librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T01:28:35.593 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/165 2024-09-21T01:28:35.672 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T01:28:35.698 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T01:28:35.735 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/165 2024-09-21T01:28:35.789 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T01:28:35.794 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/165 2024-09-21T01:28:35.828 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T01:28:35.866 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/165 2024-09-21T01:28:35.885 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/165 2024-09-21T01:28:35.942 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/165 2024-09-21T01:28:36.023 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/165 2024-09-21T01:28:36.034 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 12/165 2024-09-21T01:28:36.063 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 53/165 2024-09-21T01:28:36.092 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : postgresql-13.16-1.el9.x86_64 13/165 2024-09-21T01:28:36.099 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 54/165 2024-09-21T01:28:36.128 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T01:28:36.154 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/165 2024-09-21T01:28:36.190 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/165 2024-09-21T01:28:36.233 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/165 2024-09-21T01:28:36.240 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T01:28:36.271 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T01:28:36.275 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/165 2024-09-21T01:28:36.334 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T01:28:36.364 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T01:28:36.384 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T01:28:36.411 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/165 2024-09-21T01:28:36.469 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/165 2024-09-21T01:28:36.510 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 61/165 2024-09-21T01:28:36.563 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T01:28:36.607 INFO:teuthology.orchestra.run.smithi119.stdout:Transaction test succeeded. 2024-09-21T01:28:36.608 INFO:teuthology.orchestra.run.smithi119.stdout:Running transaction 2024-09-21T01:28:36.620 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/165 2024-09-21T01:28:36.661 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 63/165 2024-09-21T01:28:36.708 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/165 2024-09-21T01:28:36.740 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T01:28:36.743 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 65/165 2024-09-21T01:28:36.771 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/165 2024-09-21T01:28:36.871 INFO:teuthology.orchestra.run.smithi083.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 18/165 2024-09-21T01:28:36.874 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/165 2024-09-21T01:28:36.988 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T01:28:37.013 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/165 2024-09-21T01:28:37.062 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/165 2024-09-21T01:28:37.064 INFO:teuthology.orchestra.run.smithi083.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T01:28:37.094 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/165 2024-09-21T01:28:37.131 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/165 2024-09-21T01:28:37.171 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/165 2024-09-21T01:28:37.203 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/165 2024-09-21T01:28:37.232 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/165 2024-09-21T01:28:37.267 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/165 2024-09-21T01:28:37.292 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T01:28:37.301 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/165 2024-09-21T01:28:37.350 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/165 2024-09-21T01:28:37.393 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/165 2024-09-21T01:28:37.404 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : re2-1:20211101-20.el9.x86_64 20/165 2024-09-21T01:28:37.441 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/165 2024-09-21T01:28:37.478 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/165 2024-09-21T01:28:37.479 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/165 2024-09-21T01:28:37.532 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/165 2024-09-21T01:28:37.541 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/165 2024-09-21T01:28:37.571 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/165 2024-09-21T01:28:37.587 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/165 2024-09-21T01:28:37.628 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/165 2024-09-21T01:28:37.674 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/165 2024-09-21T01:28:37.679 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/165 2024-09-21T01:28:37.713 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/165 2024-09-21T01:28:37.722 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/165 2024-09-21T01:28:37.741 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2024-09-21T01:28:37.810 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2024-09-21T01:28:37.863 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/165 2024-09-21T01:28:37.893 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/165 2024-09-21T01:28:37.943 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/165 2024-09-21T01:28:38.025 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/165 2024-09-21T01:28:38.065 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 34/165 2024-09-21T01:28:38.108 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 35/165 2024-09-21T01:28:38.136 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 36/165 2024-09-21T01:28:38.207 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/165 2024-09-21T01:28:38.251 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/165 2024-09-21T01:28:38.325 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/165 2024-09-21T01:28:38.445 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/165 2024-09-21T01:28:38.461 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/165 2024-09-21T01:28:38.495 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/165 2024-09-21T01:28:38.512 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/165 2024-09-21T01:28:38.537 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/165 2024-09-21T01:28:38.637 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/165 2024-09-21T01:28:38.683 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 88/165 2024-09-21T01:28:38.728 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 89/165 2024-09-21T01:28:38.815 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 90/165 2024-09-21T01:28:38.856 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 91/165 2024-09-21T01:28:39.031 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/165 2024-09-21T01:28:39.047 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : openblas-0.3.26-2.el9.x86_64 92/165 2024-09-21T01:28:39.079 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 93/165 2024-09-21T01:28:39.107 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/165 2024-09-21T01:28:39.137 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/165 2024-09-21T01:28:39.156 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/165 2024-09-21T01:28:39.180 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/165 2024-09-21T01:28:39.218 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 46/165 2024-09-21T01:28:39.269 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/165 2024-09-21T01:28:39.435 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/165 2024-09-21T01:28:39.487 INFO:teuthology.orchestra.run.smithi083.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/165 2024-09-21T01:28:39.580 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/165 2024-09-21T01:28:39.644 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/165 2024-09-21T01:28:39.716 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/165 2024-09-21T01:28:39.748 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 53/165 2024-09-21T01:28:39.793 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 54/165 2024-09-21T01:28:39.808 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/165 2024-09-21T01:28:39.848 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/165 2024-09-21T01:28:39.883 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/165 2024-09-21T01:28:39.926 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/165 2024-09-21T01:28:39.927 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/165 2024-09-21T01:28:39.970 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/165 2024-09-21T01:28:40.104 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/165 2024-09-21T01:28:40.137 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/165 2024-09-21T01:28:40.178 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 61/165 2024-09-21T01:28:40.310 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/165 2024-09-21T01:28:40.347 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 63/165 2024-09-21T01:28:40.400 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/165 2024-09-21T01:28:40.433 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 65/165 2024-09-21T01:28:40.456 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/165 2024-09-21T01:28:40.621 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/165 2024-09-21T01:28:40.881 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/165 2024-09-21T01:28:40.914 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/165 2024-09-21T01:28:40.960 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/165 2024-09-21T01:28:40.993 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/165 2024-09-21T01:28:41.032 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/165 2024-09-21T01:28:41.064 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/165 2024-09-21T01:28:41.093 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/165 2024-09-21T01:28:41.136 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/165 2024-09-21T01:28:41.170 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/165 2024-09-21T01:28:41.203 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/165 2024-09-21T01:28:41.211 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/165 2024-09-21T01:28:41.246 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/165 2024-09-21T01:28:41.282 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/165 2024-09-21T01:28:41.310 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2024-09-21T01:28:41.333 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/165 2024-09-21T01:28:41.343 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 100/165 2024-09-21T01:28:41.385 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/165 2024-09-21T01:28:41.416 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/165 2024-09-21T01:28:41.517 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/165 2024-09-21T01:28:41.575 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/165 2024-09-21T01:28:41.677 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2024-09-21T01:28:41.723 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T01:28:41.815 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T01:28:41.844 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 103/165 2024-09-21T01:28:41.880 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2024-09-21T01:28:42.287 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/165 2024-09-21T01:28:42.342 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/165 2024-09-21T01:28:42.376 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/165 2024-09-21T01:28:42.393 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/165 2024-09-21T01:28:42.434 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T01:28:42.475 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/165 2024-09-21T01:28:42.505 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T01:28:42.522 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 88/165 2024-09-21T01:28:42.527 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 107/165 2024-09-21T01:28:42.567 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 89/165 2024-09-21T01:28:42.663 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 90/165 2024-09-21T01:28:42.703 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 91/165 2024-09-21T01:28:42.887 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : openblas-0.3.26-2.el9.x86_64 92/165 2024-09-21T01:28:42.926 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 93/165 2024-09-21T01:28:42.960 INFO:teuthology.orchestra.run.smithi119.stdout: Preparing : 1/1 2024-09-21T01:28:43.003 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/165 2024-09-21T01:28:43.107 INFO:teuthology.orchestra.run.smithi119.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/165 2024-09-21T01:28:43.146 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-09-21T01:28:43.199 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-09-21T01:28:43.241 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-09-21T01:28:43.266 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-09-21T01:28:43.321 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-09-21T01:28:43.654 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/165 2024-09-21T01:28:43.659 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-09-21T01:28:43.757 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/165 2024-09-21T01:28:43.792 INFO:teuthology.orchestra.run.smithi119.stdout: Upgrading : librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T01:28:43.919 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T01:28:43.951 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T01:28:44.043 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T01:28:44.073 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T01:28:44.103 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/165 2024-09-21T01:28:44.274 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 12/165 2024-09-21T01:28:44.328 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : postgresql-13.16-1.el9.x86_64 13/165 2024-09-21T01:28:44.357 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T01:28:44.463 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T01:28:44.491 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T01:28:44.554 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T01:28:44.575 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T01:28:44.601 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T01:28:44.802 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T01:28:44.830 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T01:28:44.866 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T01:28:44.967 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T01:28:45.025 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/165 2024-09-21T01:28:45.090 INFO:teuthology.orchestra.run.smithi119.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 18/165 2024-09-21T01:28:45.124 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/165 2024-09-21T01:28:45.152 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2024-09-21T01:28:45.185 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 100/165 2024-09-21T01:28:45.219 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T01:28:45.283 INFO:teuthology.orchestra.run.smithi119.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T01:28:45.440 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T01:28:45.477 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T01:28:45.496 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T01:28:45.510 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2024-09-21T01:28:45.565 INFO:teuthology.orchestra.run.smithi083.stdout: Upgrading : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T01:28:45.569 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T01:28:45.569 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-21T01:28:45.569 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-21T01:28:45.569 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-21T01:28:45.603 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T01:28:45.609 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : re2-1:20211101-20.el9.x86_64 20/165 2024-09-21T01:28:45.637 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/165 2024-09-21T01:28:45.657 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T01:28:45.680 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/165 2024-09-21T01:28:45.695 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 103/165 2024-09-21T01:28:45.739 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2024-09-21T01:28:45.763 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/165 2024-09-21T01:28:45.823 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/165 2024-09-21T01:28:45.855 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/165 2024-09-21T01:28:45.899 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/165 2024-09-21T01:28:45.931 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/165 2024-09-21T01:28:45.959 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2024-09-21T01:28:46.032 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2024-09-21T01:28:46.081 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/165 2024-09-21T01:28:46.120 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/165 2024-09-21T01:28:46.172 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/165 2024-09-21T01:28:46.235 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/165 2024-09-21T01:28:46.253 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/165 2024-09-21T01:28:46.268 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T01:28:46.292 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 34/165 2024-09-21T01:28:46.322 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T01:28:46.334 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 35/165 2024-09-21T01:28:46.344 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 107/165 2024-09-21T01:28:46.363 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 36/165 2024-09-21T01:28:46.432 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/165 2024-09-21T01:28:46.508 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/165 2024-09-21T01:28:46.585 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/165 2024-09-21T01:28:46.743 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/165 2024-09-21T01:28:46.805 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/165 2024-09-21T01:28:47.332 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/165 2024-09-21T01:28:47.417 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/165 2024-09-21T01:28:47.454 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/165 2024-09-21T01:28:47.497 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/165 2024-09-21T01:28:47.535 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 46/165 2024-09-21T01:28:47.578 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/165 2024-09-21T01:28:47.729 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/165 2024-09-21T01:28:47.780 INFO:teuthology.orchestra.run.smithi119.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/165 2024-09-21T01:28:47.871 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/165 2024-09-21T01:28:47.936 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/165 2024-09-21T01:28:48.016 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/165 2024-09-21T01:28:48.048 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 53/165 2024-09-21T01:28:48.084 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 54/165 2024-09-21T01:28:48.130 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/165 2024-09-21T01:28:48.167 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/165 2024-09-21T01:28:48.209 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/165 2024-09-21T01:28:48.252 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/165 2024-09-21T01:28:48.387 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/165 2024-09-21T01:28:48.429 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/165 2024-09-21T01:28:48.537 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 61/165 2024-09-21T01:28:48.887 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T01:28:48.909 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/165 2024-09-21T01:28:48.925 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T01:28:48.946 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 63/165 2024-09-21T01:28:48.987 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/165 2024-09-21T01:28:49.019 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 65/165 2024-09-21T01:28:49.044 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/165 2024-09-21T01:28:49.140 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/165 2024-09-21T01:28:49.262 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/165 2024-09-21T01:28:49.304 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/165 2024-09-21T01:28:49.333 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/165 2024-09-21T01:28:49.366 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/165 2024-09-21T01:28:49.406 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/165 2024-09-21T01:28:49.438 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/165 2024-09-21T01:28:49.468 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/165 2024-09-21T01:28:49.496 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T01:28:49.502 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/165 2024-09-21T01:28:49.537 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T01:28:49.544 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/165 2024-09-21T01:28:49.585 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/165 2024-09-21T01:28:49.620 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/165 2024-09-21T01:28:49.629 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T01:28:49.629 INFO:teuthology.orchestra.run.smithi083.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-21T01:28:49.629 INFO:teuthology.orchestra.run.smithi083.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-21T01:28:49.629 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T01:28:49.671 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T01:28:49.706 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/165 2024-09-21T01:28:49.750 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/165 2024-09-21T01:28:49.781 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/165 2024-09-21T01:28:49.884 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/165 2024-09-21T01:28:49.941 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/165 2024-09-21T01:28:50.670 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/165 2024-09-21T01:28:50.713 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/165 2024-09-21T01:28:50.747 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/165 2024-09-21T01:28:50.845 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/165 2024-09-21T01:28:50.902 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 88/165 2024-09-21T01:28:50.955 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 89/165 2024-09-21T01:28:51.042 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 90/165 2024-09-21T01:28:51.085 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 91/165 2024-09-21T01:28:51.270 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : openblas-0.3.26-2.el9.x86_64 92/165 2024-09-21T01:28:51.299 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 93/165 2024-09-21T01:28:51.377 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/165 2024-09-21T01:28:52.034 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/165 2024-09-21T01:28:52.156 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/165 2024-09-21T01:28:53.409 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/165 2024-09-21T01:28:53.486 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/165 2024-09-21T01:28:53.544 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2024-09-21T01:28:53.572 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 100/165 2024-09-21T01:28:53.907 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2024-09-21T01:28:53.960 INFO:teuthology.orchestra.run.smithi119.stdout: Upgrading : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T01:28:54.043 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T01:28:54.078 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 103/165 2024-09-21T01:28:54.219 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2024-09-21T01:28:54.714 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/165 2024-09-21T01:28:54.738 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T01:28:54.809 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T01:28:54.840 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 107/165 2024-09-21T01:28:57.145 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T01:28:57.186 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T01:28:57.451 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T01:28:57.451 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /sys 2024-09-21T01:28:57.451 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /proc 2024-09-21T01:28:57.451 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /mnt 2024-09-21T01:28:57.452 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /var/tmp 2024-09-21T01:28:57.452 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /home 2024-09-21T01:28:57.452 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /root 2024-09-21T01:28:57.452 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /tmp 2024-09-21T01:28:57.452 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-21T01:28:57.622 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T01:28:57.638 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T01:28:57.638 INFO:teuthology.orchestra.run.smithi142.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T01:28:57.638 INFO:teuthology.orchestra.run.smithi142.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-21T01:28:57.638 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-21T01:28:57.754 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T01:28:57.798 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T01:28:57.891 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T01:28:57.891 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-21T01:28:57.891 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-21T01:28:57.891 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-21T01:28:57.932 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T01:28:59.207 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T01:28:59.233 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T01:28:59.233 INFO:teuthology.orchestra.run.smithi142.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T01:28:59.234 INFO:teuthology.orchestra.run.smithi142.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-21T01:28:59.234 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T01:28:59.234 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T01:28:59.234 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-21T01:28:59.459 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T01:28:59.482 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T01:28:59.482 INFO:teuthology.orchestra.run.smithi142.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T01:28:59.482 INFO:teuthology.orchestra.run.smithi142.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-21T01:28:59.483 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T01:28:59.483 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T01:28:59.483 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-21T01:28:59.952 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T01:28:59.976 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T01:28:59.976 INFO:teuthology.orchestra.run.smithi142.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T01:28:59.976 INFO:teuthology.orchestra.run.smithi142.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-21T01:28:59.976 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T01:28:59.976 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T01:28:59.976 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-21T01:29:00.084 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2024-09-21T01:29:00.132 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/165 2024-09-21T01:29:00.187 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/165 2024-09-21T01:29:00.370 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/165 2024-09-21T01:29:00.421 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/165 2024-09-21T01:29:00.490 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/165 2024-09-21T01:29:00.577 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/165 2024-09-21T01:29:00.717 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/165 2024-09-21T01:29:00.771 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/165 2024-09-21T01:29:00.803 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/165 2024-09-21T01:29:00.831 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : fuse-2.9.9-16.el9.x86_64 125/165 2024-09-21T01:29:01.248 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T01:29:01.279 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T01:29:01.311 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 127/165 2024-09-21T01:29:01.385 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 128/165 2024-09-21T01:29:01.419 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T01:29:01.658 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T01:29:01.659 INFO:teuthology.orchestra.run.smithi083.stdout:skipping the directory /sys 2024-09-21T01:29:01.659 INFO:teuthology.orchestra.run.smithi083.stdout:skipping the directory /proc 2024-09-21T01:29:01.659 INFO:teuthology.orchestra.run.smithi083.stdout:skipping the directory /mnt 2024-09-21T01:29:01.659 INFO:teuthology.orchestra.run.smithi083.stdout:skipping the directory /var/tmp 2024-09-21T01:29:01.659 INFO:teuthology.orchestra.run.smithi083.stdout:skipping the directory /home 2024-09-21T01:29:01.659 INFO:teuthology.orchestra.run.smithi083.stdout:skipping the directory /root 2024-09-21T01:29:01.659 INFO:teuthology.orchestra.run.smithi083.stdout:skipping the directory /tmp 2024-09-21T01:29:01.659 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T01:29:01.834 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T01:29:01.850 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T01:29:01.850 INFO:teuthology.orchestra.run.smithi083.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T01:29:01.850 INFO:teuthology.orchestra.run.smithi083.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-21T01:29:01.850 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T01:29:03.413 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T01:29:03.439 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T01:29:03.439 INFO:teuthology.orchestra.run.smithi083.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T01:29:03.440 INFO:teuthology.orchestra.run.smithi083.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-21T01:29:03.440 INFO:teuthology.orchestra.run.smithi083.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T01:29:03.440 INFO:teuthology.orchestra.run.smithi083.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T01:29:03.440 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T01:29:03.671 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T01:29:03.695 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T01:29:03.695 INFO:teuthology.orchestra.run.smithi083.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T01:29:03.695 INFO:teuthology.orchestra.run.smithi083.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-21T01:29:03.695 INFO:teuthology.orchestra.run.smithi083.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T01:29:03.695 INFO:teuthology.orchestra.run.smithi083.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T01:29:03.695 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T01:29:04.164 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T01:29:04.187 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T01:29:04.187 INFO:teuthology.orchestra.run.smithi083.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T01:29:04.187 INFO:teuthology.orchestra.run.smithi083.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-21T01:29:04.187 INFO:teuthology.orchestra.run.smithi083.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T01:29:04.187 INFO:teuthology.orchestra.run.smithi083.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T01:29:04.188 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T01:29:04.294 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2024-09-21T01:29:04.351 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/165 2024-09-21T01:29:04.406 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/165 2024-09-21T01:29:04.557 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T01:29:04.589 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/165 2024-09-21T01:29:04.617 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T01:29:04.640 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/165 2024-09-21T01:29:04.717 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/165 2024-09-21T01:29:04.806 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/165 2024-09-21T01:29:04.953 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/165 2024-09-21T01:29:04.990 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/165 2024-09-21T01:29:05.022 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/165 2024-09-21T01:29:05.050 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : fuse-2.9.9-16.el9.x86_64 125/165 2024-09-21T01:29:05.518 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T01:29:05.549 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T01:29:05.573 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T01:29:05.581 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 127/165 2024-09-21T01:29:05.609 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T01:29:05.647 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 128/165 2024-09-21T01:29:05.672 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T01:29:05.720 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T01:29:05.884 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 132/165 2024-09-21T01:29:05.911 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T01:29:05.935 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T01:29:05.935 INFO:teuthology.orchestra.run.smithi142.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T01:29:05.935 INFO:teuthology.orchestra.run.smithi142.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-21T01:29:05.935 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T01:29:05.935 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T01:29:05.935 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-21T01:29:05.987 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T01:29:05.998 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T01:29:06.097 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-2:19.3.0-5120.g18432218.el9.x86_64 135/165 2024-09-21T01:29:06.159 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 136/165 2024-09-21T01:29:07.121 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libtool-2.4.6-46.el9.x86_64 137/165 2024-09-21T01:29:07.156 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T01:29:07.180 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T01:29:07.180 INFO:teuthology.orchestra.run.smithi142.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T01:29:07.180 INFO:teuthology.orchestra.run.smithi142.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-21T01:29:07.180 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T01:29:07.180 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T01:29:07.180 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-21T01:29:07.223 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T01:29:07.246 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T01:29:07.247 INFO:teuthology.orchestra.run.smithi142.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T01:29:07.247 INFO:teuthology.orchestra.run.smithi142.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-21T01:29:07.247 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-21T01:29:07.299 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T01:29:07.323 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T01:29:07.323 INFO:teuthology.orchestra.run.smithi142.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T01:29:07.323 INFO:teuthology.orchestra.run.smithi142.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-21T01:29:07.323 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T01:29:07.323 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T01:29:07.323 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-21T01:29:07.641 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T01:29:07.665 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T01:29:07.665 INFO:teuthology.orchestra.run.smithi142.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T01:29:07.665 INFO:teuthology.orchestra.run.smithi142.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-21T01:29:07.665 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T01:29:07.665 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T01:29:07.666 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-21T01:29:08.848 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T01:29:08.912 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T01:29:09.740 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T01:29:09.740 INFO:teuthology.orchestra.run.smithi119.stdout:skipping the directory /sys 2024-09-21T01:29:09.740 INFO:teuthology.orchestra.run.smithi119.stdout:skipping the directory /proc 2024-09-21T01:29:09.740 INFO:teuthology.orchestra.run.smithi119.stdout:skipping the directory /mnt 2024-09-21T01:29:09.740 INFO:teuthology.orchestra.run.smithi119.stdout:skipping the directory /var/tmp 2024-09-21T01:29:09.740 INFO:teuthology.orchestra.run.smithi119.stdout:skipping the directory /home 2024-09-21T01:29:09.740 INFO:teuthology.orchestra.run.smithi119.stdout:skipping the directory /root 2024-09-21T01:29:09.740 INFO:teuthology.orchestra.run.smithi119.stdout:skipping the directory /tmp 2024-09-21T01:29:09.741 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-21T01:29:09.869 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T01:29:09.904 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T01:29:09.909 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T01:29:09.925 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T01:29:09.925 INFO:teuthology.orchestra.run.smithi119.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T01:29:09.925 INFO:teuthology.orchestra.run.smithi119.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-21T01:29:09.925 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-21T01:29:10.017 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T01:29:10.195 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 132/165 2024-09-21T01:29:10.256 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T01:29:10.280 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T01:29:10.281 INFO:teuthology.orchestra.run.smithi083.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T01:29:10.281 INFO:teuthology.orchestra.run.smithi083.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-21T01:29:10.281 INFO:teuthology.orchestra.run.smithi083.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T01:29:10.281 INFO:teuthology.orchestra.run.smithi083.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T01:29:10.281 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T01:29:10.331 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T01:29:10.343 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T01:29:10.442 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-2:19.3.0-5120.g18432218.el9.x86_64 135/165 2024-09-21T01:29:10.505 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 136/165 2024-09-21T01:29:11.468 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libtool-2.4.6-46.el9.x86_64 137/165 2024-09-21T01:29:11.501 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T01:29:11.525 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T01:29:11.525 INFO:teuthology.orchestra.run.smithi083.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T01:29:11.525 INFO:teuthology.orchestra.run.smithi083.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-21T01:29:11.525 INFO:teuthology.orchestra.run.smithi083.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T01:29:11.525 INFO:teuthology.orchestra.run.smithi083.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T01:29:11.525 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T01:29:11.546 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T01:29:11.573 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T01:29:11.574 INFO:teuthology.orchestra.run.smithi119.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T01:29:11.574 INFO:teuthology.orchestra.run.smithi119.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-21T01:29:11.574 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T01:29:11.574 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T01:29:11.574 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-21T01:29:11.576 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T01:29:11.600 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T01:29:11.600 INFO:teuthology.orchestra.run.smithi083.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T01:29:11.600 INFO:teuthology.orchestra.run.smithi083.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-21T01:29:11.600 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T01:29:11.660 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T01:29:11.662 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 142/165 2024-09-21T01:29:11.684 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T01:29:11.684 INFO:teuthology.orchestra.run.smithi083.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T01:29:11.684 INFO:teuthology.orchestra.run.smithi083.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-21T01:29:11.684 INFO:teuthology.orchestra.run.smithi083.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T01:29:11.684 INFO:teuthology.orchestra.run.smithi083.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T01:29:11.684 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T01:29:11.703 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 143/165 2024-09-21T01:29:11.752 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 144/165 2024-09-21T01:29:11.792 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 145/165 2024-09-21T01:29:11.814 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T01:29:11.820 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 146/165 2024-09-21T01:29:11.837 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T01:29:11.837 INFO:teuthology.orchestra.run.smithi119.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T01:29:11.837 INFO:teuthology.orchestra.run.smithi119.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-21T01:29:11.837 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T01:29:11.838 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T01:29:11.838 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-21T01:29:12.011 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T01:29:12.028 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 147/165 2024-09-21T01:29:12.035 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T01:29:12.035 INFO:teuthology.orchestra.run.smithi083.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T01:29:12.035 INFO:teuthology.orchestra.run.smithi083.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-21T01:29:12.035 INFO:teuthology.orchestra.run.smithi083.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T01:29:12.035 INFO:teuthology.orchestra.run.smithi083.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T01:29:12.035 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T01:29:12.074 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 148/165 2024-09-21T01:29:12.105 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 149/165 2024-09-21T01:29:12.134 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 150/165 2024-09-21T01:29:12.181 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 151/165 2024-09-21T01:29:12.314 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T01:29:12.338 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T01:29:12.338 INFO:teuthology.orchestra.run.smithi119.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T01:29:12.338 INFO:teuthology.orchestra.run.smithi119.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-21T01:29:12.338 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T01:29:12.338 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T01:29:12.338 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-21T01:29:12.444 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2024-09-21T01:29:12.501 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/165 2024-09-21T01:29:12.556 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/165 2024-09-21T01:29:12.742 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/165 2024-09-21T01:29:12.790 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/165 2024-09-21T01:29:12.791 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T01:29:12.828 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T01:29:12.849 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T01:29:12.867 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/165 2024-09-21T01:29:12.956 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/165 2024-09-21T01:29:13.095 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/165 2024-09-21T01:29:13.132 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/165 2024-09-21T01:29:13.164 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/165 2024-09-21T01:29:13.191 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : fuse-2.9.9-16.el9.x86_64 125/165 2024-09-21T01:29:13.601 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T01:29:13.631 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T01:29:13.663 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 127/165 2024-09-21T01:29:13.664 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 153/165 2024-09-21T01:29:13.730 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 128/165 2024-09-21T01:29:13.750 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 154/165 2024-09-21T01:29:13.754 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T01:29:13.798 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 155/165 2024-09-21T01:29:13.885 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : flex-2.6.4-9.el9.x86_64 156/165 2024-09-21T01:29:13.919 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : bison-3.7.4-5.el9.x86_64 157/165 2024-09-21T01:29:13.945 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 158/165 2024-09-21T01:29:13.971 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 159/165 2024-09-21T01:29:13.971 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T01:29:14.055 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T01:29:14.055 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T01:29:14.147 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T01:29:14.181 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 162/165 2024-09-21T01:29:14.186 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T01:29:14.186 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T01:29:14.374 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T01:29:14.375 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T01:29:14.450 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T01:29:14.515 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T01:29:16.018 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 142/165 2024-09-21T01:29:16.065 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 143/165 2024-09-21T01:29:16.114 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 144/165 2024-09-21T01:29:16.146 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 145/165 2024-09-21T01:29:16.173 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 146/165 2024-09-21T01:29:16.398 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 147/165 2024-09-21T01:29:16.462 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 148/165 2024-09-21T01:29:16.492 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 149/165 2024-09-21T01:29:16.522 INFO:teuthology.orchestra.run.smithi083.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 150/165 2024-09-21T01:29:16.568 INFO:teuthology.orchestra.run.smithi083.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 151/165 2024-09-21T01:29:16.924 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T01:29:16.977 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T01:29:17.215 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T01:29:17.258 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T01:29:17.278 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T01:29:17.936 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T01:29:17.969 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T01:29:18.081 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T01:29:18.100 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 153/165 2024-09-21T01:29:18.188 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 154/165 2024-09-21T01:29:18.239 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 155/165 2024-09-21T01:29:18.252 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 132/165 2024-09-21T01:29:18.279 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T01:29:18.303 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T01:29:18.303 INFO:teuthology.orchestra.run.smithi119.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T01:29:18.303 INFO:teuthology.orchestra.run.smithi119.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-21T01:29:18.303 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T01:29:18.303 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T01:29:18.303 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-21T01:29:18.331 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : flex-2.6.4-9.el9.x86_64 156/165 2024-09-21T01:29:18.355 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T01:29:18.367 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T01:29:18.375 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : bison-3.7.4-5.el9.x86_64 157/165 2024-09-21T01:29:18.408 INFO:teuthology.orchestra.run.smithi083.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 158/165 2024-09-21T01:29:18.434 INFO:teuthology.orchestra.run.smithi083.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 159/165 2024-09-21T01:29:18.434 INFO:teuthology.orchestra.run.smithi083.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T01:29:18.465 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-2:19.3.0-5120.g18432218.el9.x86_64 135/165 2024-09-21T01:29:18.517 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 136/165 2024-09-21T01:29:18.519 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T01:29:18.519 INFO:teuthology.orchestra.run.smithi083.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T01:29:18.603 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T01:29:18.627 INFO:teuthology.orchestra.run.smithi083.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 162/165 2024-09-21T01:29:18.633 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T01:29:18.633 INFO:teuthology.orchestra.run.smithi083.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T01:29:18.830 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T01:29:18.830 INFO:teuthology.orchestra.run.smithi083.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T01:29:18.922 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T01:29:18.988 INFO:teuthology.orchestra.run.smithi083.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T01:29:19.478 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libtool-2.4.6-46.el9.x86_64 137/165 2024-09-21T01:29:19.507 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T01:29:19.531 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T01:29:19.531 INFO:teuthology.orchestra.run.smithi119.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T01:29:19.531 INFO:teuthology.orchestra.run.smithi119.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-21T01:29:19.531 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T01:29:19.531 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T01:29:19.531 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-21T01:29:19.574 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T01:29:19.598 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T01:29:19.598 INFO:teuthology.orchestra.run.smithi119.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T01:29:19.598 INFO:teuthology.orchestra.run.smithi119.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-21T01:29:19.598 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-21T01:29:19.650 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T01:29:19.674 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T01:29:19.674 INFO:teuthology.orchestra.run.smithi119.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T01:29:19.674 INFO:teuthology.orchestra.run.smithi119.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-21T01:29:19.674 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T01:29:19.674 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T01:29:19.674 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-21T01:29:19.992 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T01:29:20.016 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T01:29:20.016 INFO:teuthology.orchestra.run.smithi119.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T01:29:20.016 INFO:teuthology.orchestra.run.smithi119.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-21T01:29:20.016 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T01:29:20.016 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T01:29:20.016 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-21T01:29:20.838 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T01:29:20.838 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-2:19.3.0-5120.g18432218.el9.x86_64 1/165 2024-09-21T01:29:20.838 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2/165 2024-09-21T01:29:20.838 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 3/165 2024-09-21T01:29:20.838 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 4/165 2024-09-21T01:29:20.838 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-5120.g18432 5/165 2024-09-21T01:29:20.838 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 6/165 2024-09-21T01:29:20.838 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 7/165 2024-09-21T01:29:20.839 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T01:29:20.839 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T01:29:20.839 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T01:29:20.839 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 11/165 2024-09-21T01:29:20.839 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 12/165 2024-09-21T01:29:20.839 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 13/165 2024-09-21T01:29:20.839 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T01:29:20.839 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 15/165 2024-09-21T01:29:20.839 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 16/165 2024-09-21T01:29:20.839 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 17/165 2024-09-21T01:29:20.839 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 18/165 2024-09-21T01:29:20.839 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 19/165 2024-09-21T01:29:20.839 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 20/165 2024-09-21T01:29:20.839 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 21/165 2024-09-21T01:29:20.839 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 22/165 2024-09-21T01:29:20.839 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 23/165 2024-09-21T01:29:20.840 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 24/165 2024-09-21T01:29:20.840 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 25/165 2024-09-21T01:29:20.840 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 26/165 2024-09-21T01:29:20.840 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 27/165 2024-09-21T01:29:20.840 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 28/165 2024-09-21T01:29:20.840 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 29/165 2024-09-21T01:29:20.840 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 30/165 2024-09-21T01:29:20.840 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 31/165 2024-09-21T01:29:20.840 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 32/165 2024-09-21T01:29:20.840 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 33/165 2024-09-21T01:29:20.840 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 34/165 2024-09-21T01:29:20.840 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 35/165 2024-09-21T01:29:20.840 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 36/165 2024-09-21T01:29:20.840 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 37/165 2024-09-21T01:29:20.840 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : cephadm-2:19.3.0-5120.g18432218.el9.noarch 38/165 2024-09-21T01:29:20.840 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 39/165 2024-09-21T01:29:20.841 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/165 2024-09-21T01:29:20.841 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/165 2024-09-21T01:29:20.841 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/165 2024-09-21T01:29:20.841 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/165 2024-09-21T01:29:20.841 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/165 2024-09-21T01:29:20.841 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/165 2024-09-21T01:29:20.841 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/165 2024-09-21T01:29:20.841 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/165 2024-09-21T01:29:20.841 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/165 2024-09-21T01:29:20.841 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/165 2024-09-21T01:29:20.841 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/165 2024-09-21T01:29:20.841 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/165 2024-09-21T01:29:20.841 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/165 2024-09-21T01:29:20.841 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/165 2024-09-21T01:29:20.841 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/165 2024-09-21T01:29:20.841 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/165 2024-09-21T01:29:20.842 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/165 2024-09-21T01:29:20.842 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/165 2024-09-21T01:29:20.842 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 58/165 2024-09-21T01:29:20.842 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 59/165 2024-09-21T01:29:20.842 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 60/165 2024-09-21T01:29:20.842 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 61/165 2024-09-21T01:29:20.842 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 62/165 2024-09-21T01:29:20.842 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 63/165 2024-09-21T01:29:20.842 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 64/165 2024-09-21T01:29:20.842 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 65/165 2024-09-21T01:29:20.842 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : lua-5.4.4-4.el9.x86_64 66/165 2024-09-21T01:29:20.842 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 67/165 2024-09-21T01:29:20.842 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 68/165 2024-09-21T01:29:20.842 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 69/165 2024-09-21T01:29:20.842 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : postgresql-13.16-1.el9.x86_64 70/165 2024-09-21T01:29:20.843 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 71/165 2024-09-21T01:29:20.843 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 72/165 2024-09-21T01:29:20.843 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 73/165 2024-09-21T01:29:20.843 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 74/165 2024-09-21T01:29:20.843 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/165 2024-09-21T01:29:20.843 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/165 2024-09-21T01:29:20.843 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 77/165 2024-09-21T01:29:20.843 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 78/165 2024-09-21T01:29:20.843 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 79/165 2024-09-21T01:29:20.843 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/165 2024-09-21T01:29:20.843 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/165 2024-09-21T01:29:20.844 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/165 2024-09-21T01:29:20.844 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/165 2024-09-21T01:29:20.844 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/165 2024-09-21T01:29:20.844 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/165 2024-09-21T01:29:20.844 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-09-21T01:29:20.844 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/165 2024-09-21T01:29:20.844 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/165 2024-09-21T01:29:20.844 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/165 2024-09-21T01:29:20.844 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/165 2024-09-21T01:29:20.844 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/165 2024-09-21T01:29:20.844 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/165 2024-09-21T01:29:20.844 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/165 2024-09-21T01:29:20.844 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/165 2024-09-21T01:29:20.844 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/165 2024-09-21T01:29:20.844 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/165 2024-09-21T01:29:20.844 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/165 2024-09-21T01:29:20.845 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/165 2024-09-21T01:29:20.845 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/165 2024-09-21T01:29:20.845 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 100/165 2024-09-21T01:29:20.845 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/165 2024-09-21T01:29:20.845 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 102/165 2024-09-21T01:29:20.845 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/165 2024-09-21T01:29:20.845 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 104/165 2024-09-21T01:29:20.845 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/165 2024-09-21T01:29:20.845 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/165 2024-09-21T01:29:20.845 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/165 2024-09-21T01:29:20.845 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 108/165 2024-09-21T01:29:20.845 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/165 2024-09-21T01:29:20.845 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 110/165 2024-09-21T01:29:20.845 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 111/165 2024-09-21T01:29:20.845 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/165 2024-09-21T01:29:20.845 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/165 2024-09-21T01:29:20.846 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 114/165 2024-09-21T01:29:20.846 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/165 2024-09-21T01:29:20.846 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/165 2024-09-21T01:29:20.846 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/165 2024-09-21T01:29:20.846 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/165 2024-09-21T01:29:20.846 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 119/165 2024-09-21T01:29:20.846 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/165 2024-09-21T01:29:20.846 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/165 2024-09-21T01:29:20.846 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/165 2024-09-21T01:29:20.846 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 123/165 2024-09-21T01:29:20.846 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 124/165 2024-09-21T01:29:20.846 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 125/165 2024-09-21T01:29:20.846 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 126/165 2024-09-21T01:29:20.846 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 127/165 2024-09-21T01:29:20.846 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 128/165 2024-09-21T01:29:20.847 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 129/165 2024-09-21T01:29:20.847 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 130/165 2024-09-21T01:29:20.847 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 131/165 2024-09-21T01:29:20.847 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 132/165 2024-09-21T01:29:20.847 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 133/165 2024-09-21T01:29:20.847 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 134/165 2024-09-21T01:29:20.847 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 135/165 2024-09-21T01:29:20.847 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 136/165 2024-09-21T01:29:20.847 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 137/165 2024-09-21T01:29:20.847 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 138/165 2024-09-21T01:29:20.847 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 139/165 2024-09-21T01:29:20.847 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 140/165 2024-09-21T01:29:20.847 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 141/165 2024-09-21T01:29:20.847 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 142/165 2024-09-21T01:29:20.848 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 143/165 2024-09-21T01:29:20.848 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 144/165 2024-09-21T01:29:20.848 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 145/165 2024-09-21T01:29:20.848 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 146/165 2024-09-21T01:29:20.848 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 147/165 2024-09-21T01:29:20.848 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : re2-1:20211101-20.el9.x86_64 148/165 2024-09-21T01:29:20.848 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 149/165 2024-09-21T01:29:20.848 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librados2-2:19.3.0-5120.g18432218.el9.x86_64 150/165 2024-09-21T01:29:20.848 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 151/165 2024-09-21T01:29:20.848 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 152/165 2024-09-21T01:29:20.848 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-09-21T01:29:20.848 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 154/165 2024-09-21T01:29:20.848 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 155/165 2024-09-21T01:29:20.848 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 156/165 2024-09-21T01:29:20.849 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 157/165 2024-09-21T01:29:20.849 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 158/165 2024-09-21T01:29:20.849 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 159/165 2024-09-21T01:29:20.849 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 160/165 2024-09-21T01:29:20.849 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 161/165 2024-09-21T01:29:20.849 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 162/165 2024-09-21T01:29:20.849 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/165 2024-09-21T01:29:20.849 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 164/165 2024-09-21T01:29:23.267 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T01:29:23.267 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-21T01:29:23.267 INFO:teuthology.orchestra.run.smithi142.stdout:Upgraded: 2024-09-21T01:29:23.267 INFO:teuthology.orchestra.run.smithi142.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-21T01:29:23.267 INFO:teuthology.orchestra.run.smithi142.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-21T01:29:23.267 INFO:teuthology.orchestra.run.smithi142.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-21T01:29:23.268 INFO:teuthology.orchestra.run.smithi142.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-21T01:29:23.268 INFO:teuthology.orchestra.run.smithi142.stdout: librados2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:29:23.268 INFO:teuthology.orchestra.run.smithi142.stdout: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:29:23.268 INFO:teuthology.orchestra.run.smithi142.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-21T01:29:23.268 INFO:teuthology.orchestra.run.smithi142.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-21T01:29:23.268 INFO:teuthology.orchestra.run.smithi142.stdout:Installed: 2024-09-21T01:29:23.268 INFO:teuthology.orchestra.run.smithi142.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-21T01:29:23.268 INFO:teuthology.orchestra.run.smithi142.stdout: automake-1.16.2-8.el9.noarch 2024-09-21T01:29:23.268 INFO:teuthology.orchestra.run.smithi142.stdout: bison-3.7.4-5.el9.x86_64 2024-09-21T01:29:23.268 INFO:teuthology.orchestra.run.smithi142.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-21T01:29:23.268 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:29:23.268 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:29:23.268 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:29:23.269 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:29:23.269 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-grafana-dashboards-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T01:29:23.269 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-immutable-object-cache-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:29:23.269 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:29:23.269 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:29:23.269 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T01:29:23.269 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T01:29:23.269 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-diskprediction-local-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T01:29:23.269 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T01:29:23.269 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T01:29:23.269 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:29:23.269 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:29:23.269 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-prometheus-alerts-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T01:29:23.269 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:29:23.269 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:29:23.270 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:29:23.270 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T01:29:23.270 INFO:teuthology.orchestra.run.smithi142.stdout: cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T01:29:23.270 INFO:teuthology.orchestra.run.smithi142.stdout: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:29:23.270 INFO:teuthology.orchestra.run.smithi142.stdout: cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:29:23.270 INFO:teuthology.orchestra.run.smithi142.stdout: cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T01:29:23.270 INFO:teuthology.orchestra.run.smithi142.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-21T01:29:23.270 INFO:teuthology.orchestra.run.smithi142.stdout: flex-2.6.4-9.el9.x86_64 2024-09-21T01:29:23.270 INFO:teuthology.orchestra.run.smithi142.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-21T01:29:23.270 INFO:teuthology.orchestra.run.smithi142.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-21T01:29:23.270 INFO:teuthology.orchestra.run.smithi142.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-21T01:29:23.270 INFO:teuthology.orchestra.run.smithi142.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-21T01:29:23.270 INFO:teuthology.orchestra.run.smithi142.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-21T01:29:23.271 INFO:teuthology.orchestra.run.smithi142.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-21T01:29:23.271 INFO:teuthology.orchestra.run.smithi142.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-21T01:29:23.271 INFO:teuthology.orchestra.run.smithi142.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-21T01:29:23.271 INFO:teuthology.orchestra.run.smithi142.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-21T01:29:23.271 INFO:teuthology.orchestra.run.smithi142.stdout: libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:29:23.271 INFO:teuthology.orchestra.run.smithi142.stdout: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:29:23.271 INFO:teuthology.orchestra.run.smithi142.stdout: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:29:23.271 INFO:teuthology.orchestra.run.smithi142.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-21T01:29:23.271 INFO:teuthology.orchestra.run.smithi142.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-21T01:29:23.271 INFO:teuthology.orchestra.run.smithi142.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-21T01:29:23.271 INFO:teuthology.orchestra.run.smithi142.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-21T01:29:23.271 INFO:teuthology.orchestra.run.smithi142.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-21T01:29:23.271 INFO:teuthology.orchestra.run.smithi142.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-21T01:29:23.271 INFO:teuthology.orchestra.run.smithi142.stdout: librados-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:29:23.271 INFO:teuthology.orchestra.run.smithi142.stdout: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:29:23.272 INFO:teuthology.orchestra.run.smithi142.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-21T01:29:23.272 INFO:teuthology.orchestra.run.smithi142.stdout: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:29:23.272 INFO:teuthology.orchestra.run.smithi142.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-21T01:29:23.272 INFO:teuthology.orchestra.run.smithi142.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-21T01:29:23.272 INFO:teuthology.orchestra.run.smithi142.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-21T01:29:23.272 INFO:teuthology.orchestra.run.smithi142.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-21T01:29:23.272 INFO:teuthology.orchestra.run.smithi142.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-21T01:29:23.272 INFO:teuthology.orchestra.run.smithi142.stdout: lua-5.4.4-4.el9.x86_64 2024-09-21T01:29:23.272 INFO:teuthology.orchestra.run.smithi142.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-21T01:29:23.272 INFO:teuthology.orchestra.run.smithi142.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-21T01:29:23.272 INFO:teuthology.orchestra.run.smithi142.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-21T01:29:23.272 INFO:teuthology.orchestra.run.smithi142.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-21T01:29:23.272 INFO:teuthology.orchestra.run.smithi142.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-21T01:29:23.272 INFO:teuthology.orchestra.run.smithi142.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-21T01:29:23.272 INFO:teuthology.orchestra.run.smithi142.stdout: postgresql-13.16-1.el9.x86_64 2024-09-21T01:29:23.273 INFO:teuthology.orchestra.run.smithi142.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-21T01:29:23.273 INFO:teuthology.orchestra.run.smithi142.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-21T01:29:23.273 INFO:teuthology.orchestra.run.smithi142.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-21T01:29:23.273 INFO:teuthology.orchestra.run.smithi142.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-21T01:29:23.273 INFO:teuthology.orchestra.run.smithi142.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-21T01:29:23.273 INFO:teuthology.orchestra.run.smithi142.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-21T01:29:23.273 INFO:teuthology.orchestra.run.smithi142.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-21T01:29:23.273 INFO:teuthology.orchestra.run.smithi142.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-21T01:29:23.273 INFO:teuthology.orchestra.run.smithi142.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-21T01:29:23.273 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-21T01:29:23.273 INFO:teuthology.orchestra.run.smithi142.stdout: python3-ceph-argparse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:29:23.273 INFO:teuthology.orchestra.run.smithi142.stdout: python3-ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:29:23.273 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:29:23.273 INFO:teuthology.orchestra.run.smithi142.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-21T01:29:23.273 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-21T01:29:23.274 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-21T01:29:23.274 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-21T01:29:23.274 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-21T01:29:23.274 INFO:teuthology.orchestra.run.smithi142.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-21T01:29:23.274 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-21T01:29:23.274 INFO:teuthology.orchestra.run.smithi142.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-21T01:29:23.274 INFO:teuthology.orchestra.run.smithi142.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-21T01:29:23.274 INFO:teuthology.orchestra.run.smithi142.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-21T01:29:23.274 INFO:teuthology.orchestra.run.smithi142.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-21T01:29:23.274 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-21T01:29:23.274 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-21T01:29:23.274 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-21T01:29:23.274 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-21T01:29:23.275 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-21T01:29:23.275 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-21T01:29:23.275 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-21T01:29:23.275 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-21T01:29:23.275 INFO:teuthology.orchestra.run.smithi142.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-21T01:29:23.275 INFO:teuthology.orchestra.run.smithi142.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-21T01:29:23.275 INFO:teuthology.orchestra.run.smithi142.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-21T01:29:23.275 INFO:teuthology.orchestra.run.smithi142.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-21T01:29:23.275 INFO:teuthology.orchestra.run.smithi142.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-21T01:29:23.275 INFO:teuthology.orchestra.run.smithi142.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-21T01:29:23.275 INFO:teuthology.orchestra.run.smithi142.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-21T01:29:23.275 INFO:teuthology.orchestra.run.smithi142.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-21T01:29:23.275 INFO:teuthology.orchestra.run.smithi142.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-21T01:29:23.275 INFO:teuthology.orchestra.run.smithi142.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-21T01:29:23.275 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-21T01:29:23.276 INFO:teuthology.orchestra.run.smithi142.stdout: python3-ply-3.11-14.el9.noarch 2024-09-21T01:29:23.276 INFO:teuthology.orchestra.run.smithi142.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-21T01:29:23.276 INFO:teuthology.orchestra.run.smithi142.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-21T01:29:23.276 INFO:teuthology.orchestra.run.smithi142.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-21T01:29:23.276 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-21T01:29:23.276 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-21T01:29:23.276 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-21T01:29:23.276 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-21T01:29:23.276 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-21T01:29:23.276 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-21T01:29:23.276 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:29:23.276 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:29:23.276 INFO:teuthology.orchestra.run.smithi142.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-21T01:29:23.276 INFO:teuthology.orchestra.run.smithi142.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-21T01:29:23.276 INFO:teuthology.orchestra.run.smithi142.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-21T01:29:23.277 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:29:23.277 INFO:teuthology.orchestra.run.smithi142.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-21T01:29:23.277 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-21T01:29:23.277 INFO:teuthology.orchestra.run.smithi142.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-21T01:29:23.277 INFO:teuthology.orchestra.run.smithi142.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-21T01:29:23.277 INFO:teuthology.orchestra.run.smithi142.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-21T01:29:23.277 INFO:teuthology.orchestra.run.smithi142.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-21T01:29:23.277 INFO:teuthology.orchestra.run.smithi142.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-21T01:29:23.277 INFO:teuthology.orchestra.run.smithi142.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-21T01:29:23.277 INFO:teuthology.orchestra.run.smithi142.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-21T01:29:23.277 INFO:teuthology.orchestra.run.smithi142.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-21T01:29:23.277 INFO:teuthology.orchestra.run.smithi142.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-21T01:29:23.277 INFO:teuthology.orchestra.run.smithi142.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-21T01:29:23.277 INFO:teuthology.orchestra.run.smithi142.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-21T01:29:23.278 INFO:teuthology.orchestra.run.smithi142.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-21T01:29:23.278 INFO:teuthology.orchestra.run.smithi142.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-21T01:29:23.278 INFO:teuthology.orchestra.run.smithi142.stdout: rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:29:23.278 INFO:teuthology.orchestra.run.smithi142.stdout: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:29:23.278 INFO:teuthology.orchestra.run.smithi142.stdout: rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:29:23.278 INFO:teuthology.orchestra.run.smithi142.stdout: re2-1:20211101-20.el9.x86_64 2024-09-21T01:29:23.278 INFO:teuthology.orchestra.run.smithi142.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-21T01:29:23.278 INFO:teuthology.orchestra.run.smithi142.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-21T01:29:23.278 INFO:teuthology.orchestra.run.smithi142.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-21T01:29:23.278 INFO:teuthology.orchestra.run.smithi142.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-21T01:29:23.278 INFO:teuthology.orchestra.run.smithi142.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-21T01:29:23.279 INFO:teuthology.orchestra.run.smithi142.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-21T01:29:23.279 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-21T01:29:23.279 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-09-21T01:29:23.704 DEBUG:teuthology.parallel:result is None 2024-09-21T01:29:24.052 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 142/165 2024-09-21T01:29:24.096 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 143/165 2024-09-21T01:29:24.136 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 144/165 2024-09-21T01:29:24.169 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 145/165 2024-09-21T01:29:24.196 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 146/165 2024-09-21T01:29:24.404 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 147/165 2024-09-21T01:29:24.451 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 148/165 2024-09-21T01:29:24.481 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 149/165 2024-09-21T01:29:24.511 INFO:teuthology.orchestra.run.smithi119.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 150/165 2024-09-21T01:29:24.549 INFO:teuthology.orchestra.run.smithi119.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 151/165 2024-09-21T01:29:25.144 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T01:29:25.179 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T01:29:25.200 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T01:29:25.660 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T01:29:25.660 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-2:19.3.0-5120.g18432218.el9.x86_64 1/165 2024-09-21T01:29:25.660 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2/165 2024-09-21T01:29:25.660 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 3/165 2024-09-21T01:29:25.660 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 4/165 2024-09-21T01:29:25.660 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-5120.g18432 5/165 2024-09-21T01:29:25.660 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 6/165 2024-09-21T01:29:25.660 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 7/165 2024-09-21T01:29:25.660 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T01:29:25.660 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T01:29:25.660 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T01:29:25.660 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 11/165 2024-09-21T01:29:25.661 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 12/165 2024-09-21T01:29:25.661 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 13/165 2024-09-21T01:29:25.661 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T01:29:25.661 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 15/165 2024-09-21T01:29:25.661 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 16/165 2024-09-21T01:29:25.661 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 17/165 2024-09-21T01:29:25.661 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 18/165 2024-09-21T01:29:25.661 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 19/165 2024-09-21T01:29:25.661 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 20/165 2024-09-21T01:29:25.661 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 21/165 2024-09-21T01:29:25.661 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 22/165 2024-09-21T01:29:25.661 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 23/165 2024-09-21T01:29:25.661 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 24/165 2024-09-21T01:29:25.661 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 25/165 2024-09-21T01:29:25.661 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 26/165 2024-09-21T01:29:25.662 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 27/165 2024-09-21T01:29:25.662 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 28/165 2024-09-21T01:29:25.662 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 29/165 2024-09-21T01:29:25.662 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 30/165 2024-09-21T01:29:25.662 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 31/165 2024-09-21T01:29:25.662 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 32/165 2024-09-21T01:29:25.662 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 33/165 2024-09-21T01:29:25.662 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 34/165 2024-09-21T01:29:25.662 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 35/165 2024-09-21T01:29:25.662 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 36/165 2024-09-21T01:29:25.662 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 37/165 2024-09-21T01:29:25.662 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : cephadm-2:19.3.0-5120.g18432218.el9.noarch 38/165 2024-09-21T01:29:25.662 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 39/165 2024-09-21T01:29:25.663 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/165 2024-09-21T01:29:25.663 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/165 2024-09-21T01:29:25.663 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/165 2024-09-21T01:29:25.663 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/165 2024-09-21T01:29:25.663 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/165 2024-09-21T01:29:25.663 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/165 2024-09-21T01:29:25.663 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/165 2024-09-21T01:29:25.663 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/165 2024-09-21T01:29:25.663 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/165 2024-09-21T01:29:25.663 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/165 2024-09-21T01:29:25.663 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/165 2024-09-21T01:29:25.663 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/165 2024-09-21T01:29:25.663 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/165 2024-09-21T01:29:25.663 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/165 2024-09-21T01:29:25.664 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/165 2024-09-21T01:29:25.664 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/165 2024-09-21T01:29:25.664 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/165 2024-09-21T01:29:25.664 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/165 2024-09-21T01:29:25.664 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 58/165 2024-09-21T01:29:25.664 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 59/165 2024-09-21T01:29:25.664 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 60/165 2024-09-21T01:29:25.664 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 61/165 2024-09-21T01:29:25.664 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 62/165 2024-09-21T01:29:25.664 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 63/165 2024-09-21T01:29:25.665 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 64/165 2024-09-21T01:29:25.665 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 65/165 2024-09-21T01:29:25.665 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : lua-5.4.4-4.el9.x86_64 66/165 2024-09-21T01:29:25.665 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 67/165 2024-09-21T01:29:25.665 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 68/165 2024-09-21T01:29:25.665 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 69/165 2024-09-21T01:29:25.665 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : postgresql-13.16-1.el9.x86_64 70/165 2024-09-21T01:29:25.665 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 71/165 2024-09-21T01:29:25.665 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 72/165 2024-09-21T01:29:25.665 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 73/165 2024-09-21T01:29:25.665 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 74/165 2024-09-21T01:29:25.665 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/165 2024-09-21T01:29:25.665 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/165 2024-09-21T01:29:25.666 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 77/165 2024-09-21T01:29:25.666 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 78/165 2024-09-21T01:29:25.666 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 79/165 2024-09-21T01:29:25.666 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/165 2024-09-21T01:29:25.666 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/165 2024-09-21T01:29:25.666 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/165 2024-09-21T01:29:25.666 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/165 2024-09-21T01:29:25.666 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/165 2024-09-21T01:29:25.666 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/165 2024-09-21T01:29:25.666 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-09-21T01:29:25.666 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/165 2024-09-21T01:29:25.666 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/165 2024-09-21T01:29:25.666 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/165 2024-09-21T01:29:25.667 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/165 2024-09-21T01:29:25.667 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/165 2024-09-21T01:29:25.667 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/165 2024-09-21T01:29:25.667 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/165 2024-09-21T01:29:25.667 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/165 2024-09-21T01:29:25.667 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/165 2024-09-21T01:29:25.667 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/165 2024-09-21T01:29:25.667 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/165 2024-09-21T01:29:25.667 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/165 2024-09-21T01:29:25.667 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/165 2024-09-21T01:29:25.667 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 100/165 2024-09-21T01:29:25.667 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/165 2024-09-21T01:29:25.667 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 102/165 2024-09-21T01:29:25.667 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/165 2024-09-21T01:29:25.668 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 104/165 2024-09-21T01:29:25.668 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/165 2024-09-21T01:29:25.668 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/165 2024-09-21T01:29:25.668 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/165 2024-09-21T01:29:25.668 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 108/165 2024-09-21T01:29:25.668 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/165 2024-09-21T01:29:25.668 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 110/165 2024-09-21T01:29:25.668 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 111/165 2024-09-21T01:29:25.668 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/165 2024-09-21T01:29:25.668 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/165 2024-09-21T01:29:25.668 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 114/165 2024-09-21T01:29:25.668 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/165 2024-09-21T01:29:25.668 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/165 2024-09-21T01:29:25.669 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/165 2024-09-21T01:29:25.669 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/165 2024-09-21T01:29:25.669 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 119/165 2024-09-21T01:29:25.669 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/165 2024-09-21T01:29:25.669 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/165 2024-09-21T01:29:25.669 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/165 2024-09-21T01:29:25.669 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 123/165 2024-09-21T01:29:25.669 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 124/165 2024-09-21T01:29:25.669 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 125/165 2024-09-21T01:29:25.669 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 126/165 2024-09-21T01:29:25.669 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 127/165 2024-09-21T01:29:25.669 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 128/165 2024-09-21T01:29:25.670 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 129/165 2024-09-21T01:29:25.670 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 130/165 2024-09-21T01:29:25.670 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 131/165 2024-09-21T01:29:25.670 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 132/165 2024-09-21T01:29:25.670 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 133/165 2024-09-21T01:29:25.670 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 134/165 2024-09-21T01:29:25.670 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 135/165 2024-09-21T01:29:25.670 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 136/165 2024-09-21T01:29:25.670 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 137/165 2024-09-21T01:29:25.670 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 138/165 2024-09-21T01:29:25.670 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 139/165 2024-09-21T01:29:25.670 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 140/165 2024-09-21T01:29:25.670 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 141/165 2024-09-21T01:29:25.671 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 142/165 2024-09-21T01:29:25.671 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 143/165 2024-09-21T01:29:25.671 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 144/165 2024-09-21T01:29:25.671 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 145/165 2024-09-21T01:29:25.671 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 146/165 2024-09-21T01:29:25.671 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 147/165 2024-09-21T01:29:25.671 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : re2-1:20211101-20.el9.x86_64 148/165 2024-09-21T01:29:25.671 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 149/165 2024-09-21T01:29:25.671 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : librados2-2:19.3.0-5120.g18432218.el9.x86_64 150/165 2024-09-21T01:29:25.671 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 151/165 2024-09-21T01:29:25.671 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 152/165 2024-09-21T01:29:25.671 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-09-21T01:29:25.671 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 154/165 2024-09-21T01:29:25.672 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 155/165 2024-09-21T01:29:25.672 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 156/165 2024-09-21T01:29:25.672 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 157/165 2024-09-21T01:29:25.672 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 158/165 2024-09-21T01:29:25.672 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 159/165 2024-09-21T01:29:25.672 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 160/165 2024-09-21T01:29:25.672 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 161/165 2024-09-21T01:29:25.672 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 162/165 2024-09-21T01:29:25.672 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/165 2024-09-21T01:29:25.672 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 164/165 2024-09-21T01:29:26.030 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 153/165 2024-09-21T01:29:26.117 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 154/165 2024-09-21T01:29:26.169 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 155/165 2024-09-21T01:29:26.269 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : flex-2.6.4-9.el9.x86_64 156/165 2024-09-21T01:29:26.303 INFO:teuthology.orchestra.run.smithi119.stdout: Installing : bison-3.7.4-5.el9.x86_64 157/165 2024-09-21T01:29:26.329 INFO:teuthology.orchestra.run.smithi119.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 158/165 2024-09-21T01:29:26.363 INFO:teuthology.orchestra.run.smithi119.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 159/165 2024-09-21T01:29:26.363 INFO:teuthology.orchestra.run.smithi119.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T01:29:26.447 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T01:29:26.447 INFO:teuthology.orchestra.run.smithi119.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T01:29:26.531 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T01:29:26.556 INFO:teuthology.orchestra.run.smithi119.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 162/165 2024-09-21T01:29:26.562 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T01:29:26.562 INFO:teuthology.orchestra.run.smithi119.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T01:29:26.741 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T01:29:26.742 INFO:teuthology.orchestra.run.smithi119.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T01:29:26.817 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T01:29:26.881 INFO:teuthology.orchestra.run.smithi119.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T01:29:28.242 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T01:29:28.242 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T01:29:28.242 INFO:teuthology.orchestra.run.smithi083.stdout:Upgraded: 2024-09-21T01:29:28.242 INFO:teuthology.orchestra.run.smithi083.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-21T01:29:28.242 INFO:teuthology.orchestra.run.smithi083.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-21T01:29:28.242 INFO:teuthology.orchestra.run.smithi083.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-21T01:29:28.242 INFO:teuthology.orchestra.run.smithi083.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-21T01:29:28.242 INFO:teuthology.orchestra.run.smithi083.stdout: librados2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:29:28.242 INFO:teuthology.orchestra.run.smithi083.stdout: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:29:28.242 INFO:teuthology.orchestra.run.smithi083.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-21T01:29:28.243 INFO:teuthology.orchestra.run.smithi083.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-21T01:29:28.243 INFO:teuthology.orchestra.run.smithi083.stdout:Installed: 2024-09-21T01:29:28.243 INFO:teuthology.orchestra.run.smithi083.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-21T01:29:28.243 INFO:teuthology.orchestra.run.smithi083.stdout: automake-1.16.2-8.el9.noarch 2024-09-21T01:29:28.243 INFO:teuthology.orchestra.run.smithi083.stdout: bison-3.7.4-5.el9.x86_64 2024-09-21T01:29:28.243 INFO:teuthology.orchestra.run.smithi083.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-21T01:29:28.243 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:29:28.243 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:29:28.243 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:29:28.243 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:29:28.243 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-grafana-dashboards-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T01:29:28.243 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-immutable-object-cache-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:29:28.243 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:29:28.243 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:29:28.244 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T01:29:28.244 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T01:29:28.244 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mgr-diskprediction-local-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T01:29:28.244 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T01:29:28.244 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T01:29:28.244 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:29:28.244 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:29:28.244 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-prometheus-alerts-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T01:29:28.244 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:29:28.244 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:29:28.244 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:29:28.244 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T01:29:28.244 INFO:teuthology.orchestra.run.smithi083.stdout: cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T01:29:28.244 INFO:teuthology.orchestra.run.smithi083.stdout: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:29:28.245 INFO:teuthology.orchestra.run.smithi083.stdout: cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:29:28.245 INFO:teuthology.orchestra.run.smithi083.stdout: cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T01:29:28.245 INFO:teuthology.orchestra.run.smithi083.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-21T01:29:28.245 INFO:teuthology.orchestra.run.smithi083.stdout: flex-2.6.4-9.el9.x86_64 2024-09-21T01:29:28.245 INFO:teuthology.orchestra.run.smithi083.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-21T01:29:28.245 INFO:teuthology.orchestra.run.smithi083.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-21T01:29:28.245 INFO:teuthology.orchestra.run.smithi083.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-21T01:29:28.245 INFO:teuthology.orchestra.run.smithi083.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-21T01:29:28.245 INFO:teuthology.orchestra.run.smithi083.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-21T01:29:28.245 INFO:teuthology.orchestra.run.smithi083.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-21T01:29:28.245 INFO:teuthology.orchestra.run.smithi083.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-21T01:29:28.245 INFO:teuthology.orchestra.run.smithi083.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-21T01:29:28.245 INFO:teuthology.orchestra.run.smithi083.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-21T01:29:28.245 INFO:teuthology.orchestra.run.smithi083.stdout: libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:29:28.245 INFO:teuthology.orchestra.run.smithi083.stdout: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:29:28.246 INFO:teuthology.orchestra.run.smithi083.stdout: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:29:28.246 INFO:teuthology.orchestra.run.smithi083.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-21T01:29:28.246 INFO:teuthology.orchestra.run.smithi083.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-21T01:29:28.246 INFO:teuthology.orchestra.run.smithi083.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-21T01:29:28.246 INFO:teuthology.orchestra.run.smithi083.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-21T01:29:28.246 INFO:teuthology.orchestra.run.smithi083.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-21T01:29:28.246 INFO:teuthology.orchestra.run.smithi083.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-21T01:29:28.246 INFO:teuthology.orchestra.run.smithi083.stdout: librados-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:29:28.246 INFO:teuthology.orchestra.run.smithi083.stdout: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:29:28.246 INFO:teuthology.orchestra.run.smithi083.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-21T01:29:28.246 INFO:teuthology.orchestra.run.smithi083.stdout: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:29:28.246 INFO:teuthology.orchestra.run.smithi083.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-21T01:29:28.246 INFO:teuthology.orchestra.run.smithi083.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-21T01:29:28.246 INFO:teuthology.orchestra.run.smithi083.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-21T01:29:28.247 INFO:teuthology.orchestra.run.smithi083.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-21T01:29:28.247 INFO:teuthology.orchestra.run.smithi083.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-21T01:29:28.247 INFO:teuthology.orchestra.run.smithi083.stdout: lua-5.4.4-4.el9.x86_64 2024-09-21T01:29:28.247 INFO:teuthology.orchestra.run.smithi083.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-21T01:29:28.247 INFO:teuthology.orchestra.run.smithi083.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-21T01:29:28.247 INFO:teuthology.orchestra.run.smithi083.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-21T01:29:28.247 INFO:teuthology.orchestra.run.smithi083.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-21T01:29:28.247 INFO:teuthology.orchestra.run.smithi083.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-21T01:29:28.247 INFO:teuthology.orchestra.run.smithi083.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-21T01:29:28.247 INFO:teuthology.orchestra.run.smithi083.stdout: postgresql-13.16-1.el9.x86_64 2024-09-21T01:29:28.247 INFO:teuthology.orchestra.run.smithi083.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-21T01:29:28.247 INFO:teuthology.orchestra.run.smithi083.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-21T01:29:28.247 INFO:teuthology.orchestra.run.smithi083.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-21T01:29:28.247 INFO:teuthology.orchestra.run.smithi083.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-21T01:29:28.248 INFO:teuthology.orchestra.run.smithi083.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-21T01:29:28.248 INFO:teuthology.orchestra.run.smithi083.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-21T01:29:28.248 INFO:teuthology.orchestra.run.smithi083.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-21T01:29:28.248 INFO:teuthology.orchestra.run.smithi083.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-21T01:29:28.248 INFO:teuthology.orchestra.run.smithi083.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-21T01:29:28.248 INFO:teuthology.orchestra.run.smithi083.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-21T01:29:28.248 INFO:teuthology.orchestra.run.smithi083.stdout: python3-ceph-argparse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:29:28.248 INFO:teuthology.orchestra.run.smithi083.stdout: python3-ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:29:28.248 INFO:teuthology.orchestra.run.smithi083.stdout: python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:29:28.248 INFO:teuthology.orchestra.run.smithi083.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-21T01:29:28.248 INFO:teuthology.orchestra.run.smithi083.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-21T01:29:28.248 INFO:teuthology.orchestra.run.smithi083.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-21T01:29:28.248 INFO:teuthology.orchestra.run.smithi083.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-21T01:29:28.248 INFO:teuthology.orchestra.run.smithi083.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-21T01:29:28.249 INFO:teuthology.orchestra.run.smithi083.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-21T01:29:28.249 INFO:teuthology.orchestra.run.smithi083.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-21T01:29:28.249 INFO:teuthology.orchestra.run.smithi083.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-21T01:29:28.249 INFO:teuthology.orchestra.run.smithi083.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-21T01:29:28.249 INFO:teuthology.orchestra.run.smithi083.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-21T01:29:28.249 INFO:teuthology.orchestra.run.smithi083.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-21T01:29:28.249 INFO:teuthology.orchestra.run.smithi083.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-21T01:29:28.249 INFO:teuthology.orchestra.run.smithi083.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-21T01:29:28.249 INFO:teuthology.orchestra.run.smithi083.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-21T01:29:28.249 INFO:teuthology.orchestra.run.smithi083.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-21T01:29:28.249 INFO:teuthology.orchestra.run.smithi083.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-21T01:29:28.249 INFO:teuthology.orchestra.run.smithi083.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-21T01:29:28.249 INFO:teuthology.orchestra.run.smithi083.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-21T01:29:28.249 INFO:teuthology.orchestra.run.smithi083.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-21T01:29:28.250 INFO:teuthology.orchestra.run.smithi083.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-21T01:29:28.250 INFO:teuthology.orchestra.run.smithi083.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-21T01:29:28.250 INFO:teuthology.orchestra.run.smithi083.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-21T01:29:28.250 INFO:teuthology.orchestra.run.smithi083.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-21T01:29:28.250 INFO:teuthology.orchestra.run.smithi083.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-21T01:29:28.250 INFO:teuthology.orchestra.run.smithi083.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-21T01:29:28.250 INFO:teuthology.orchestra.run.smithi083.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-21T01:29:28.250 INFO:teuthology.orchestra.run.smithi083.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-21T01:29:28.250 INFO:teuthology.orchestra.run.smithi083.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-21T01:29:28.250 INFO:teuthology.orchestra.run.smithi083.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-21T01:29:28.250 INFO:teuthology.orchestra.run.smithi083.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-21T01:29:28.250 INFO:teuthology.orchestra.run.smithi083.stdout: python3-ply-3.11-14.el9.noarch 2024-09-21T01:29:28.250 INFO:teuthology.orchestra.run.smithi083.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-21T01:29:28.250 INFO:teuthology.orchestra.run.smithi083.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-21T01:29:28.251 INFO:teuthology.orchestra.run.smithi083.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-21T01:29:28.251 INFO:teuthology.orchestra.run.smithi083.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-21T01:29:28.251 INFO:teuthology.orchestra.run.smithi083.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-21T01:29:28.251 INFO:teuthology.orchestra.run.smithi083.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-21T01:29:28.251 INFO:teuthology.orchestra.run.smithi083.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-21T01:29:28.251 INFO:teuthology.orchestra.run.smithi083.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-21T01:29:28.251 INFO:teuthology.orchestra.run.smithi083.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-21T01:29:28.251 INFO:teuthology.orchestra.run.smithi083.stdout: python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:29:28.251 INFO:teuthology.orchestra.run.smithi083.stdout: python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:29:28.251 INFO:teuthology.orchestra.run.smithi083.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-21T01:29:28.251 INFO:teuthology.orchestra.run.smithi083.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-21T01:29:28.251 INFO:teuthology.orchestra.run.smithi083.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-21T01:29:28.251 INFO:teuthology.orchestra.run.smithi083.stdout: python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:29:28.251 INFO:teuthology.orchestra.run.smithi083.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-21T01:29:28.252 INFO:teuthology.orchestra.run.smithi083.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-21T01:29:28.252 INFO:teuthology.orchestra.run.smithi083.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-21T01:29:28.252 INFO:teuthology.orchestra.run.smithi083.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-21T01:29:28.252 INFO:teuthology.orchestra.run.smithi083.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-21T01:29:28.252 INFO:teuthology.orchestra.run.smithi083.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-21T01:29:28.252 INFO:teuthology.orchestra.run.smithi083.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-21T01:29:28.252 INFO:teuthology.orchestra.run.smithi083.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-21T01:29:28.252 INFO:teuthology.orchestra.run.smithi083.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-21T01:29:28.252 INFO:teuthology.orchestra.run.smithi083.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-21T01:29:28.252 INFO:teuthology.orchestra.run.smithi083.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-21T01:29:28.252 INFO:teuthology.orchestra.run.smithi083.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-21T01:29:28.252 INFO:teuthology.orchestra.run.smithi083.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-21T01:29:28.252 INFO:teuthology.orchestra.run.smithi083.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-21T01:29:28.252 INFO:teuthology.orchestra.run.smithi083.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-21T01:29:28.253 INFO:teuthology.orchestra.run.smithi083.stdout: rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:29:28.253 INFO:teuthology.orchestra.run.smithi083.stdout: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:29:28.253 INFO:teuthology.orchestra.run.smithi083.stdout: rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:29:28.253 INFO:teuthology.orchestra.run.smithi083.stdout: re2-1:20211101-20.el9.x86_64 2024-09-21T01:29:28.253 INFO:teuthology.orchestra.run.smithi083.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-21T01:29:28.253 INFO:teuthology.orchestra.run.smithi083.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-21T01:29:28.253 INFO:teuthology.orchestra.run.smithi083.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-21T01:29:28.253 INFO:teuthology.orchestra.run.smithi083.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-21T01:29:28.253 INFO:teuthology.orchestra.run.smithi083.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-21T01:29:28.253 INFO:teuthology.orchestra.run.smithi083.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-21T01:29:28.253 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T01:29:28.254 INFO:teuthology.orchestra.run.smithi083.stdout:Complete! 2024-09-21T01:29:28.712 DEBUG:teuthology.parallel:result is None 2024-09-21T01:29:33.173 INFO:teuthology.orchestra.run.smithi119.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T01:29:33.173 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-2:19.3.0-5120.g18432218.el9.x86_64 1/165 2024-09-21T01:29:33.174 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2/165 2024-09-21T01:29:33.174 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 3/165 2024-09-21T01:29:33.174 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 4/165 2024-09-21T01:29:33.174 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-5120.g18432 5/165 2024-09-21T01:29:33.174 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 6/165 2024-09-21T01:29:33.174 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 7/165 2024-09-21T01:29:33.174 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T01:29:33.174 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T01:29:33.174 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T01:29:33.174 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 11/165 2024-09-21T01:29:33.174 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 12/165 2024-09-21T01:29:33.174 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 13/165 2024-09-21T01:29:33.175 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T01:29:33.175 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 15/165 2024-09-21T01:29:33.175 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 16/165 2024-09-21T01:29:33.175 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 17/165 2024-09-21T01:29:33.175 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 18/165 2024-09-21T01:29:33.175 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 19/165 2024-09-21T01:29:33.175 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 20/165 2024-09-21T01:29:33.175 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 21/165 2024-09-21T01:29:33.175 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 22/165 2024-09-21T01:29:33.175 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 23/165 2024-09-21T01:29:33.175 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 24/165 2024-09-21T01:29:33.175 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 25/165 2024-09-21T01:29:33.175 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 26/165 2024-09-21T01:29:33.176 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 27/165 2024-09-21T01:29:33.176 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 28/165 2024-09-21T01:29:33.186 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 29/165 2024-09-21T01:29:33.186 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 30/165 2024-09-21T01:29:33.187 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 31/165 2024-09-21T01:29:33.187 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 32/165 2024-09-21T01:29:33.187 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 33/165 2024-09-21T01:29:33.187 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 34/165 2024-09-21T01:29:33.187 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 35/165 2024-09-21T01:29:33.187 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 36/165 2024-09-21T01:29:33.187 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 37/165 2024-09-21T01:29:33.187 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : cephadm-2:19.3.0-5120.g18432218.el9.noarch 38/165 2024-09-21T01:29:33.187 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 39/165 2024-09-21T01:29:33.187 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/165 2024-09-21T01:29:33.187 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/165 2024-09-21T01:29:33.187 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/165 2024-09-21T01:29:33.187 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/165 2024-09-21T01:29:33.187 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/165 2024-09-21T01:29:33.188 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/165 2024-09-21T01:29:33.188 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/165 2024-09-21T01:29:33.188 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/165 2024-09-21T01:29:33.188 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/165 2024-09-21T01:29:33.188 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/165 2024-09-21T01:29:33.188 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/165 2024-09-21T01:29:33.188 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/165 2024-09-21T01:29:33.188 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/165 2024-09-21T01:29:33.188 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/165 2024-09-21T01:29:33.188 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/165 2024-09-21T01:29:33.188 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/165 2024-09-21T01:29:33.188 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/165 2024-09-21T01:29:33.188 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/165 2024-09-21T01:29:33.188 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 58/165 2024-09-21T01:29:33.188 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 59/165 2024-09-21T01:29:33.189 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 60/165 2024-09-21T01:29:33.189 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 61/165 2024-09-21T01:29:33.189 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 62/165 2024-09-21T01:29:33.189 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 63/165 2024-09-21T01:29:33.189 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 64/165 2024-09-21T01:29:33.189 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 65/165 2024-09-21T01:29:33.189 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : lua-5.4.4-4.el9.x86_64 66/165 2024-09-21T01:29:33.189 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 67/165 2024-09-21T01:29:33.189 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 68/165 2024-09-21T01:29:33.189 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 69/165 2024-09-21T01:29:33.189 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : postgresql-13.16-1.el9.x86_64 70/165 2024-09-21T01:29:33.189 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 71/165 2024-09-21T01:29:33.189 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 72/165 2024-09-21T01:29:33.189 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 73/165 2024-09-21T01:29:33.190 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 74/165 2024-09-21T01:29:33.190 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/165 2024-09-21T01:29:33.190 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/165 2024-09-21T01:29:33.190 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 77/165 2024-09-21T01:29:33.190 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 78/165 2024-09-21T01:29:33.190 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 79/165 2024-09-21T01:29:33.190 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/165 2024-09-21T01:29:33.190 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/165 2024-09-21T01:29:33.190 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/165 2024-09-21T01:29:33.190 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/165 2024-09-21T01:29:33.190 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/165 2024-09-21T01:29:33.190 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/165 2024-09-21T01:29:33.190 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-09-21T01:29:33.191 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/165 2024-09-21T01:29:33.191 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/165 2024-09-21T01:29:33.191 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/165 2024-09-21T01:29:33.191 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/165 2024-09-21T01:29:33.191 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/165 2024-09-21T01:29:33.191 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/165 2024-09-21T01:29:33.191 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/165 2024-09-21T01:29:33.191 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/165 2024-09-21T01:29:33.191 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/165 2024-09-21T01:29:33.191 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/165 2024-09-21T01:29:33.191 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/165 2024-09-21T01:29:33.191 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/165 2024-09-21T01:29:33.191 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/165 2024-09-21T01:29:33.191 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 100/165 2024-09-21T01:29:33.191 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/165 2024-09-21T01:29:33.192 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 102/165 2024-09-21T01:29:33.192 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/165 2024-09-21T01:29:33.192 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 104/165 2024-09-21T01:29:33.192 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/165 2024-09-21T01:29:33.192 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/165 2024-09-21T01:29:33.192 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/165 2024-09-21T01:29:33.192 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 108/165 2024-09-21T01:29:33.192 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/165 2024-09-21T01:29:33.192 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 110/165 2024-09-21T01:29:33.192 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 111/165 2024-09-21T01:29:33.192 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/165 2024-09-21T01:29:33.192 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/165 2024-09-21T01:29:33.192 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 114/165 2024-09-21T01:29:33.193 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/165 2024-09-21T01:29:33.193 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/165 2024-09-21T01:29:33.193 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/165 2024-09-21T01:29:33.193 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/165 2024-09-21T01:29:33.193 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 119/165 2024-09-21T01:29:33.193 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/165 2024-09-21T01:29:33.193 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/165 2024-09-21T01:29:33.193 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/165 2024-09-21T01:29:33.193 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 123/165 2024-09-21T01:29:33.193 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 124/165 2024-09-21T01:29:33.193 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 125/165 2024-09-21T01:29:33.193 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 126/165 2024-09-21T01:29:33.193 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 127/165 2024-09-21T01:29:33.193 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 128/165 2024-09-21T01:29:33.194 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 129/165 2024-09-21T01:29:33.194 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 130/165 2024-09-21T01:29:33.194 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 131/165 2024-09-21T01:29:33.194 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 132/165 2024-09-21T01:29:33.194 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 133/165 2024-09-21T01:29:33.194 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 134/165 2024-09-21T01:29:33.194 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 135/165 2024-09-21T01:29:33.194 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 136/165 2024-09-21T01:29:33.194 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 137/165 2024-09-21T01:29:33.194 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 138/165 2024-09-21T01:29:33.194 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 139/165 2024-09-21T01:29:33.194 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 140/165 2024-09-21T01:29:33.195 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 141/165 2024-09-21T01:29:33.195 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 142/165 2024-09-21T01:29:33.195 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 143/165 2024-09-21T01:29:33.195 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 144/165 2024-09-21T01:29:33.195 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 145/165 2024-09-21T01:29:33.195 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 146/165 2024-09-21T01:29:33.195 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 147/165 2024-09-21T01:29:33.195 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : re2-1:20211101-20.el9.x86_64 148/165 2024-09-21T01:29:33.195 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 149/165 2024-09-21T01:29:33.195 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : librados2-2:19.3.0-5120.g18432218.el9.x86_64 150/165 2024-09-21T01:29:33.195 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 151/165 2024-09-21T01:29:33.195 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 152/165 2024-09-21T01:29:33.195 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-09-21T01:29:33.196 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 154/165 2024-09-21T01:29:33.196 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 155/165 2024-09-21T01:29:33.196 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 156/165 2024-09-21T01:29:33.196 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 157/165 2024-09-21T01:29:33.196 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 158/165 2024-09-21T01:29:33.196 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 159/165 2024-09-21T01:29:33.196 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 160/165 2024-09-21T01:29:33.196 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 161/165 2024-09-21T01:29:33.196 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 162/165 2024-09-21T01:29:33.196 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/165 2024-09-21T01:29:33.196 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 164/165 2024-09-21T01:29:36.094 INFO:teuthology.orchestra.run.smithi119.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T01:29:36.094 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-21T01:29:36.094 INFO:teuthology.orchestra.run.smithi119.stdout:Upgraded: 2024-09-21T01:29:36.094 INFO:teuthology.orchestra.run.smithi119.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-21T01:29:36.094 INFO:teuthology.orchestra.run.smithi119.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-21T01:29:36.094 INFO:teuthology.orchestra.run.smithi119.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-21T01:29:36.094 INFO:teuthology.orchestra.run.smithi119.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-21T01:29:36.095 INFO:teuthology.orchestra.run.smithi119.stdout: librados2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:29:36.095 INFO:teuthology.orchestra.run.smithi119.stdout: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:29:36.095 INFO:teuthology.orchestra.run.smithi119.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-21T01:29:36.095 INFO:teuthology.orchestra.run.smithi119.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-21T01:29:36.095 INFO:teuthology.orchestra.run.smithi119.stdout:Installed: 2024-09-21T01:29:36.095 INFO:teuthology.orchestra.run.smithi119.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-21T01:29:36.095 INFO:teuthology.orchestra.run.smithi119.stdout: automake-1.16.2-8.el9.noarch 2024-09-21T01:29:36.095 INFO:teuthology.orchestra.run.smithi119.stdout: bison-3.7.4-5.el9.x86_64 2024-09-21T01:29:36.095 INFO:teuthology.orchestra.run.smithi119.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-21T01:29:36.095 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:29:36.095 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:29:36.095 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:29:36.095 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:29:36.096 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-grafana-dashboards-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T01:29:36.096 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-immutable-object-cache-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:29:36.096 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:29:36.096 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:29:36.096 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T01:29:36.096 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T01:29:36.096 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-diskprediction-local-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T01:29:36.096 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T01:29:36.096 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T01:29:36.096 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:29:36.096 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:29:36.096 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-prometheus-alerts-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T01:29:36.096 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:29:36.096 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:29:36.097 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:29:36.097 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T01:29:36.097 INFO:teuthology.orchestra.run.smithi119.stdout: cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T01:29:36.097 INFO:teuthology.orchestra.run.smithi119.stdout: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:29:36.097 INFO:teuthology.orchestra.run.smithi119.stdout: cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:29:36.097 INFO:teuthology.orchestra.run.smithi119.stdout: cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T01:29:36.097 INFO:teuthology.orchestra.run.smithi119.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-21T01:29:36.097 INFO:teuthology.orchestra.run.smithi119.stdout: flex-2.6.4-9.el9.x86_64 2024-09-21T01:29:36.097 INFO:teuthology.orchestra.run.smithi119.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-21T01:29:36.097 INFO:teuthology.orchestra.run.smithi119.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-21T01:29:36.097 INFO:teuthology.orchestra.run.smithi119.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-21T01:29:36.097 INFO:teuthology.orchestra.run.smithi119.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-21T01:29:36.097 INFO:teuthology.orchestra.run.smithi119.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-21T01:29:36.098 INFO:teuthology.orchestra.run.smithi119.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-21T01:29:36.098 INFO:teuthology.orchestra.run.smithi119.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-21T01:29:36.098 INFO:teuthology.orchestra.run.smithi119.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-21T01:29:36.098 INFO:teuthology.orchestra.run.smithi119.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-21T01:29:36.098 INFO:teuthology.orchestra.run.smithi119.stdout: libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:29:36.098 INFO:teuthology.orchestra.run.smithi119.stdout: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:29:36.098 INFO:teuthology.orchestra.run.smithi119.stdout: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:29:36.098 INFO:teuthology.orchestra.run.smithi119.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-21T01:29:36.098 INFO:teuthology.orchestra.run.smithi119.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-21T01:29:36.098 INFO:teuthology.orchestra.run.smithi119.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-21T01:29:36.098 INFO:teuthology.orchestra.run.smithi119.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-21T01:29:36.098 INFO:teuthology.orchestra.run.smithi119.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-21T01:29:36.098 INFO:teuthology.orchestra.run.smithi119.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-21T01:29:36.098 INFO:teuthology.orchestra.run.smithi119.stdout: librados-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:29:36.099 INFO:teuthology.orchestra.run.smithi119.stdout: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:29:36.099 INFO:teuthology.orchestra.run.smithi119.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-21T01:29:36.099 INFO:teuthology.orchestra.run.smithi119.stdout: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:29:36.099 INFO:teuthology.orchestra.run.smithi119.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-21T01:29:36.099 INFO:teuthology.orchestra.run.smithi119.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-21T01:29:36.099 INFO:teuthology.orchestra.run.smithi119.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-21T01:29:36.099 INFO:teuthology.orchestra.run.smithi119.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-21T01:29:36.099 INFO:teuthology.orchestra.run.smithi119.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-21T01:29:36.099 INFO:teuthology.orchestra.run.smithi119.stdout: lua-5.4.4-4.el9.x86_64 2024-09-21T01:29:36.099 INFO:teuthology.orchestra.run.smithi119.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-21T01:29:36.099 INFO:teuthology.orchestra.run.smithi119.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-21T01:29:36.099 INFO:teuthology.orchestra.run.smithi119.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-21T01:29:36.099 INFO:teuthology.orchestra.run.smithi119.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-21T01:29:36.099 INFO:teuthology.orchestra.run.smithi119.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-21T01:29:36.100 INFO:teuthology.orchestra.run.smithi119.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-21T01:29:36.100 INFO:teuthology.orchestra.run.smithi119.stdout: postgresql-13.16-1.el9.x86_64 2024-09-21T01:29:36.100 INFO:teuthology.orchestra.run.smithi119.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-21T01:29:36.100 INFO:teuthology.orchestra.run.smithi119.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-21T01:29:36.100 INFO:teuthology.orchestra.run.smithi119.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-21T01:29:36.100 INFO:teuthology.orchestra.run.smithi119.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-21T01:29:36.100 INFO:teuthology.orchestra.run.smithi119.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-21T01:29:36.100 INFO:teuthology.orchestra.run.smithi119.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-21T01:29:36.100 INFO:teuthology.orchestra.run.smithi119.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-21T01:29:36.100 INFO:teuthology.orchestra.run.smithi119.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-21T01:29:36.100 INFO:teuthology.orchestra.run.smithi119.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-21T01:29:36.100 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-21T01:29:36.100 INFO:teuthology.orchestra.run.smithi119.stdout: python3-ceph-argparse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:29:36.100 INFO:teuthology.orchestra.run.smithi119.stdout: python3-ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:29:36.101 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:29:36.101 INFO:teuthology.orchestra.run.smithi119.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-21T01:29:36.101 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-21T01:29:36.101 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-21T01:29:36.101 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-21T01:29:36.101 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-21T01:29:36.101 INFO:teuthology.orchestra.run.smithi119.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-21T01:29:36.101 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-21T01:29:36.101 INFO:teuthology.orchestra.run.smithi119.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-21T01:29:36.101 INFO:teuthology.orchestra.run.smithi119.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-21T01:29:36.101 INFO:teuthology.orchestra.run.smithi119.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-21T01:29:36.101 INFO:teuthology.orchestra.run.smithi119.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-21T01:29:36.101 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-21T01:29:36.101 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-21T01:29:36.102 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-21T01:29:36.102 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-21T01:29:36.102 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-21T01:29:36.102 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-21T01:29:36.102 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-21T01:29:36.102 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-21T01:29:36.102 INFO:teuthology.orchestra.run.smithi119.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-21T01:29:36.102 INFO:teuthology.orchestra.run.smithi119.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-21T01:29:36.102 INFO:teuthology.orchestra.run.smithi119.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-21T01:29:36.102 INFO:teuthology.orchestra.run.smithi119.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-21T01:29:36.102 INFO:teuthology.orchestra.run.smithi119.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-21T01:29:36.103 INFO:teuthology.orchestra.run.smithi119.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-21T01:29:36.103 INFO:teuthology.orchestra.run.smithi119.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-21T01:29:36.103 INFO:teuthology.orchestra.run.smithi119.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-21T01:29:36.103 INFO:teuthology.orchestra.run.smithi119.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-21T01:29:36.103 INFO:teuthology.orchestra.run.smithi119.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-21T01:29:36.103 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-21T01:29:36.103 INFO:teuthology.orchestra.run.smithi119.stdout: python3-ply-3.11-14.el9.noarch 2024-09-21T01:29:36.103 INFO:teuthology.orchestra.run.smithi119.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-21T01:29:36.103 INFO:teuthology.orchestra.run.smithi119.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-21T01:29:36.103 INFO:teuthology.orchestra.run.smithi119.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-21T01:29:36.103 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-21T01:29:36.103 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-21T01:29:36.103 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-21T01:29:36.103 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-21T01:29:36.104 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-21T01:29:36.104 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-21T01:29:36.104 INFO:teuthology.orchestra.run.smithi119.stdout: python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:29:36.104 INFO:teuthology.orchestra.run.smithi119.stdout: python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:29:36.104 INFO:teuthology.orchestra.run.smithi119.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-21T01:29:36.104 INFO:teuthology.orchestra.run.smithi119.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-21T01:29:36.104 INFO:teuthology.orchestra.run.smithi119.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-21T01:29:36.104 INFO:teuthology.orchestra.run.smithi119.stdout: python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:29:36.104 INFO:teuthology.orchestra.run.smithi119.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-21T01:29:36.104 INFO:teuthology.orchestra.run.smithi119.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-21T01:29:36.104 INFO:teuthology.orchestra.run.smithi119.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-21T01:29:36.104 INFO:teuthology.orchestra.run.smithi119.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-21T01:29:36.104 INFO:teuthology.orchestra.run.smithi119.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-21T01:29:36.105 INFO:teuthology.orchestra.run.smithi119.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-21T01:29:36.105 INFO:teuthology.orchestra.run.smithi119.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-21T01:29:36.105 INFO:teuthology.orchestra.run.smithi119.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-21T01:29:36.105 INFO:teuthology.orchestra.run.smithi119.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-21T01:29:36.105 INFO:teuthology.orchestra.run.smithi119.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-21T01:29:36.105 INFO:teuthology.orchestra.run.smithi119.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-21T01:29:36.105 INFO:teuthology.orchestra.run.smithi119.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-21T01:29:36.105 INFO:teuthology.orchestra.run.smithi119.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-21T01:29:36.105 INFO:teuthology.orchestra.run.smithi119.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-21T01:29:36.105 INFO:teuthology.orchestra.run.smithi119.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-21T01:29:36.105 INFO:teuthology.orchestra.run.smithi119.stdout: rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:29:36.105 INFO:teuthology.orchestra.run.smithi119.stdout: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:29:36.105 INFO:teuthology.orchestra.run.smithi119.stdout: rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T01:29:36.105 INFO:teuthology.orchestra.run.smithi119.stdout: re2-1:20211101-20.el9.x86_64 2024-09-21T01:29:36.106 INFO:teuthology.orchestra.run.smithi119.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-21T01:29:36.106 INFO:teuthology.orchestra.run.smithi119.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-21T01:29:36.106 INFO:teuthology.orchestra.run.smithi119.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-21T01:29:36.106 INFO:teuthology.orchestra.run.smithi119.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-21T01:29:36.106 INFO:teuthology.orchestra.run.smithi119.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-21T01:29:36.106 INFO:teuthology.orchestra.run.smithi119.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-21T01:29:36.106 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-21T01:29:36.106 INFO:teuthology.orchestra.run.smithi119.stdout:Complete! 2024-09-21T01:29:36.511 DEBUG:teuthology.parallel:result is None 2024-09-21T01:29:36.511 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T01:29:36.657 DEBUG:teuthology.orchestra.run.smithi083:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-21T01:29:36.683 INFO:teuthology.orchestra.run.smithi083.stdout:19.3.0-5120.g18432218.el9 2024-09-21T01:29:36.684 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-5120.g18432218.el9 2024-09-21T01:29:36.684 INFO:teuthology.task.install:The correct ceph version 19.3.0-5120.g18432218 is installed. 2024-09-21T01:29:36.686 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T01:29:36.825 DEBUG:teuthology.orchestra.run.smithi119:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-21T01:29:36.847 INFO:teuthology.orchestra.run.smithi119.stdout:19.3.0-5120.g18432218.el9 2024-09-21T01:29:36.847 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-5120.g18432218.el9 2024-09-21T01:29:36.847 INFO:teuthology.task.install:The correct ceph version 19.3.0-5120.g18432218 is installed. 2024-09-21T01:29:36.849 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T01:29:36.992 DEBUG:teuthology.orchestra.run.smithi142:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-21T01:29:37.019 INFO:teuthology.orchestra.run.smithi142.stdout:19.3.0-5120.g18432218.el9 2024-09-21T01:29:37.019 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-5120.g18432218.el9 2024-09-21T01:29:37.019 INFO:teuthology.task.install:The correct ceph version 19.3.0-5120.g18432218 is installed. 2024-09-21T01:29:37.021 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-21T01:29:37.021 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-09-21T01:29:37.021 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-21T01:29:37.053 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-21T01:29:37.053 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-21T01:29:37.079 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-09-21T01:29:37.079 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-21T01:29:37.110 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-21T01:29:37.110 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-09-21T01:29:37.110 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd of=/usr/bin/daemon-helper 2024-09-21T01:29:37.138 DEBUG:teuthology.orchestra.run.smithi083:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-21T01:29:37.205 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-21T01:29:37.205 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/usr/bin/daemon-helper 2024-09-21T01:29:37.229 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-21T01:29:37.294 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-09-21T01:29:37.294 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/usr/bin/daemon-helper 2024-09-21T01:29:37.324 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-21T01:29:37.395 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-21T01:29:37.395 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-09-21T01:29:37.395 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-21T01:29:37.423 DEBUG:teuthology.orchestra.run.smithi083:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-21T01:29:37.490 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-21T01:29:37.490 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-21T01:29:37.514 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-21T01:29:37.579 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-09-21T01:29:37.579 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-21T01:29:37.604 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-21T01:29:37.671 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-21T01:29:37.671 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-09-21T01:29:37.671 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd of=/usr/bin/stdin-killer 2024-09-21T01:29:37.699 DEBUG:teuthology.orchestra.run.smithi083:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-21T01:29:37.765 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-21T01:29:37.765 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/usr/bin/stdin-killer 2024-09-21T01:29:37.789 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-21T01:29:37.854 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-09-21T01:29:37.854 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/usr/bin/stdin-killer 2024-09-21T01:29:37.880 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-21T01:29:37.945 INFO:teuthology.run_tasks:Running task cephadm... 2024-09-21T01:29:38.034 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 1, 'session_timeout': 300, 'standby_replay': True}, 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 2, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'client mount timeout': 30, 'debug cephsqlite': 20, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1, 'mgr/snap_schedule/allow_m_granularity': True, 'mgr/snap_schedule/dump_on_update': True, 'mgr/snap_schedule/log_level': 'debug', 'mon warn on pool no app': False}, 'mon': {'mon op complaint time': 120}, 'osd': {'osd op complaint time': 180}}, 'conf': {'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10000}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'mgr-modules': ['snap_schedule'], 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated'}} 2024-09-21T01:29:38.034 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T01:29:38.034 INFO:tasks.cephadm:Cluster fsid is f7697ecc-77b8-11ef-baf5-efdc52797490 2024-09-21T01:29:38.035 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-09-21T01:29:38.035 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.83', 'mon.b': '172.21.15.119', 'mon.c': '172.21.15.142'} 2024-09-21T01:29:38.035 INFO:tasks.cephadm:First mon is mon.a on smithi083 2024-09-21T01:29:38.035 INFO:tasks.cephadm:First mgr is x 2024-09-21T01:29:38.035 INFO:tasks.cephadm:Normalizing hostnames... 2024-09-21T01:29:38.035 DEBUG:teuthology.orchestra.run.smithi083:> sudo hostname $(hostname -s) 2024-09-21T01:29:38.062 DEBUG:teuthology.orchestra.run.smithi119:> sudo hostname $(hostname -s) 2024-09-21T01:29:38.087 DEBUG:teuthology.orchestra.run.smithi142:> sudo hostname $(hostname -s) 2024-09-21T01:29:38.112 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-09-21T01:29:38.112 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T01:29:38.264 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=arm64,AVAILABLE_ARCH=arm64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/83190/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.3.0-5120-g18432218', 'node_name': '172.21.4.75+confusa13', 'job_name': 'ceph-dev-new-build/ARCH=arm64,AVAILABLE_ARCH=arm64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.3.0-5120.g18432218'}, 'url': 'https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-21 00:04:17.484514', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-pdonnell-testing-20240920.212106-debug', 'chacra_url': 'https://4.chacra.ceph.com/repos/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/', 'archs': ['x86_64', 'source', 'arm64'], 'distro': 'centos'}, {'status': 'ready', 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/83190/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.3.0-5120-g18432218', 'node_name': '172.21.2.22+braggi22', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.3.0-5120.g18432218'}, 'url': 'https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-20 22:54:16.499090', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-pdonnell-testing-20240920.212106-debug', 'chacra_url': 'https://3.chacra.ceph.com/repos/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/', 'archs': ['source', 'x86_64'], 'distro': 'centos'}] 2024-09-21T01:29:38.403 INFO:tasks.util.chacra:got chacra host 4.chacra.ceph.com, ref wip-pdonnell-testing-20240920.212106-debug, sha1 1843221895adccfb3b692060251dd6a0183bc410 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T01:29:38.404 INFO:tasks.cephadm:Discovered cachra url: https://4.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/x86_64/flavors/default/cephadm 2024-09-21T01:29:38.404 INFO:tasks.cephadm:Downloading cephadm from url: https://4.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/x86_64/flavors/default/cephadm 2024-09-21T01:29:38.405 DEBUG:teuthology.orchestra.run.smithi083:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-21T01:29:38.980 INFO:teuthology.orchestra.run.smithi083.stdout:-rw-r--r--. 1 ubuntu ubuntu 804283 Sep 21 01:29 /home/ubuntu/cephtest/cephadm 2024-09-21T01:29:38.980 DEBUG:teuthology.orchestra.run.smithi119:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-21T01:29:39.518 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r--. 1 ubuntu ubuntu 804283 Sep 21 01:29 /home/ubuntu/cephtest/cephadm 2024-09-21T01:29:39.518 DEBUG:teuthology.orchestra.run.smithi142:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-21T01:29:40.107 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-r--r--. 1 ubuntu ubuntu 804283 Sep 21 01:29 /home/ubuntu/cephtest/cephadm 2024-09-21T01:29:40.108 DEBUG:teuthology.orchestra.run.smithi083:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-21T01:29:40.127 DEBUG:teuthology.orchestra.run.smithi119:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-21T01:29:40.146 DEBUG:teuthology.orchestra.run.smithi142:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-21T01:29:40.180 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 on all hosts... 2024-09-21T01:29:40.180 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 pull 2024-09-21T01:29:40.182 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 pull 2024-09-21T01:29:40.189 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 pull 2024-09-21T01:29:41.809 INFO:teuthology.orchestra.run.smithi119.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410... 2024-09-21T01:29:41.852 INFO:teuthology.orchestra.run.smithi142.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410... 2024-09-21T01:29:41.913 INFO:teuthology.orchestra.run.smithi083.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410... 2024-09-21T01:30:55.873 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-21T01:30:55.873 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_version": "ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev)", 2024-09-21T01:30:55.873 INFO:teuthology.orchestra.run.smithi119.stdout: "image_id": "ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977", 2024-09-21T01:30:55.873 INFO:teuthology.orchestra.run.smithi119.stdout: "repo_digests": [ 2024-09-21T01:30:55.873 INFO:teuthology.orchestra.run.smithi119.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262" 2024-09-21T01:30:55.873 INFO:teuthology.orchestra.run.smithi119.stdout: ] 2024-09-21T01:30:55.873 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-21T01:30:59.372 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-09-21T01:30:59.373 INFO:teuthology.orchestra.run.smithi083.stdout: "ceph_version": "ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev)", 2024-09-21T01:30:59.373 INFO:teuthology.orchestra.run.smithi083.stdout: "image_id": "ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977", 2024-09-21T01:30:59.373 INFO:teuthology.orchestra.run.smithi083.stdout: "repo_digests": [ 2024-09-21T01:30:59.373 INFO:teuthology.orchestra.run.smithi083.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262" 2024-09-21T01:30:59.373 INFO:teuthology.orchestra.run.smithi083.stdout: ] 2024-09-21T01:30:59.373 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-09-21T01:31:02.810 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-09-21T01:31:02.810 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph_version": "ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev)", 2024-09-21T01:31:02.810 INFO:teuthology.orchestra.run.smithi142.stdout: "image_id": "ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977", 2024-09-21T01:31:02.810 INFO:teuthology.orchestra.run.smithi142.stdout: "repo_digests": [ 2024-09-21T01:31:02.811 INFO:teuthology.orchestra.run.smithi142.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262" 2024-09-21T01:31:02.811 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-09-21T01:31:02.811 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-09-21T01:31:02.837 DEBUG:teuthology.orchestra.run.smithi083:> sudo mkdir -p /etc/ceph 2024-09-21T01:31:02.871 DEBUG:teuthology.orchestra.run.smithi119:> sudo mkdir -p /etc/ceph 2024-09-21T01:31:02.904 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /etc/ceph 2024-09-21T01:31:02.932 DEBUG:teuthology.orchestra.run.smithi083:> sudo chmod 777 /etc/ceph 2024-09-21T01:31:02.961 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod 777 /etc/ceph 2024-09-21T01:31:02.989 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 777 /etc/ceph 2024-09-21T01:31:03.014 INFO:tasks.cephadm:Writing seed config... 2024-09-21T01:31:03.015 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-09-21T01:31:03.015 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-09-21T01:31:03.015 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-09-21T01:31:03.015 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-09-21T01:31:03.015 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-09-21T01:31:03.016 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-09-21T01:31:03.016 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-09-21T01:31:03.016 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-09-21T01:31:03.016 INFO:tasks.cephadm: override: [osd] bluestore compression mode = aggressive 2024-09-21T01:31:03.016 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-09-21T01:31:03.016 INFO:tasks.cephadm: override: [osd] debug bluefs = 20 2024-09-21T01:31:03.016 INFO:tasks.cephadm: override: [osd] debug bluestore = 20 2024-09-21T01:31:03.016 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-09-21T01:31:03.016 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-09-21T01:31:03.016 INFO:tasks.cephadm: override: [osd] debug rocksdb = 10 2024-09-21T01:31:03.016 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-09-21T01:31:03.017 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-09-21T01:31:03.017 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-09-21T01:31:03.017 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-09-21T01:31:03.017 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-09-21T01:31:03.017 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-09-21T01:31:03.017 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10000 2024-09-21T01:31:03.018 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-09-21T01:31:03.018 DEBUG:teuthology.orchestra.run.smithi083:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-09-21T01:31:03.036 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = f7697ecc-77b8-11ef-baf5-efdc52797490 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bluestore block size = 96636764160 bluestore compression mode = aggressive bluestore fsck on mount = True debug bluefs = 20 debug bluestore = 20 debug ms = 1 debug osd = 20 debug rocksdb = 10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd_max_omap_entries_per_request = 10000 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true 2024-09-21T01:31:03.036 DEBUG:teuthology.orchestra.run.smithi083:mon.a> sudo journalctl -f -n 0 -u ceph-f7697ecc-77b8-11ef-baf5-efdc52797490@mon.a.service 2024-09-21T01:31:03.079 DEBUG:teuthology.orchestra.run.smithi083:mgr.x> sudo journalctl -f -n 0 -u ceph-f7697ecc-77b8-11ef-baf5-efdc52797490@mgr.x.service 2024-09-21T01:31:03.121 INFO:tasks.cephadm:Bootstrapping... 2024-09-21T01:31:03.121 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 -v bootstrap --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.83 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-09-21T01:31:03.327 INFO:teuthology.orchestra.run.smithi083.stdout:-------------------------------------------------------------------------------- 2024-09-21T01:31:03.327 INFO:teuthology.orchestra.run.smithi083.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', '-v', 'bootstrap', '--fsid', 'f7697ecc-77b8-11ef-baf5-efdc52797490', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.83', '--skip-admin-label'] 2024-09-21T01:31:03.327 INFO:teuthology.orchestra.run.smithi083.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-09-21T01:31:03.328 INFO:teuthology.orchestra.run.smithi083.stdout:Verifying podman|docker is present... 2024-09-21T01:31:03.351 INFO:teuthology.orchestra.run.smithi083.stdout:/bin/podman: stdout 5.2.2 2024-09-21T01:31:03.352 INFO:teuthology.orchestra.run.smithi083.stdout:Verifying lvm2 is present... 2024-09-21T01:31:03.352 INFO:teuthology.orchestra.run.smithi083.stdout:Verifying time synchronization is in place... 2024-09-21T01:31:03.359 INFO:teuthology.orchestra.run.smithi083.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-21T01:31:03.359 INFO:teuthology.orchestra.run.smithi083.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-21T01:31:03.365 INFO:teuthology.orchestra.run.smithi083.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-21T01:31:03.366 INFO:teuthology.orchestra.run.smithi083.stdout:systemctl: stdout inactive 2024-09-21T01:31:03.372 INFO:teuthology.orchestra.run.smithi083.stdout:systemctl: stdout enabled 2024-09-21T01:31:03.379 INFO:teuthology.orchestra.run.smithi083.stdout:systemctl: stdout active 2024-09-21T01:31:03.379 INFO:teuthology.orchestra.run.smithi083.stdout:Unit chronyd.service is enabled and running 2024-09-21T01:31:03.379 INFO:teuthology.orchestra.run.smithi083.stdout:Repeating the final host check... 2024-09-21T01:31:03.401 INFO:teuthology.orchestra.run.smithi083.stdout:/bin/podman: stdout 5.2.2 2024-09-21T01:31:03.401 INFO:teuthology.orchestra.run.smithi083.stdout:podman (/bin/podman) version 5.2.2 is present 2024-09-21T01:31:03.401 INFO:teuthology.orchestra.run.smithi083.stdout:systemctl is present 2024-09-21T01:31:03.401 INFO:teuthology.orchestra.run.smithi083.stdout:lvcreate is present 2024-09-21T01:31:03.408 INFO:teuthology.orchestra.run.smithi083.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-21T01:31:03.408 INFO:teuthology.orchestra.run.smithi083.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-21T01:31:03.414 INFO:teuthology.orchestra.run.smithi083.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-21T01:31:03.414 INFO:teuthology.orchestra.run.smithi083.stdout:systemctl: stdout inactive 2024-09-21T01:31:03.420 INFO:teuthology.orchestra.run.smithi083.stdout:systemctl: stdout enabled 2024-09-21T01:31:03.427 INFO:teuthology.orchestra.run.smithi083.stdout:systemctl: stdout active 2024-09-21T01:31:03.427 INFO:teuthology.orchestra.run.smithi083.stdout:Unit chronyd.service is enabled and running 2024-09-21T01:31:03.427 INFO:teuthology.orchestra.run.smithi083.stdout:Host looks OK 2024-09-21T01:31:03.427 INFO:teuthology.orchestra.run.smithi083.stdout:Cluster fsid: f7697ecc-77b8-11ef-baf5-efdc52797490 2024-09-21T01:31:03.427 INFO:teuthology.orchestra.run.smithi083.stdout:Acquiring lock 140703644625552 on /run/cephadm/f7697ecc-77b8-11ef-baf5-efdc52797490.lock 2024-09-21T01:31:03.427 INFO:teuthology.orchestra.run.smithi083.stdout:Lock 140703644625552 acquired on /run/cephadm/f7697ecc-77b8-11ef-baf5-efdc52797490.lock 2024-09-21T01:31:03.428 INFO:teuthology.orchestra.run.smithi083.stdout:Verifying IP 172.21.15.83 port 3300 ... 2024-09-21T01:31:03.428 INFO:teuthology.orchestra.run.smithi083.stdout:Verifying IP 172.21.15.83 port 6789 ... 2024-09-21T01:31:03.428 INFO:teuthology.orchestra.run.smithi083.stdout:Base mon IP(s) is [172.21.15.83:3300, 172.21.15.83:6789], mon addrv is [v2:172.21.15.83:3300,v1:172.21.15.83:6789] 2024-09-21T01:31:03.431 INFO:teuthology.orchestra.run.smithi083.stdout:/sbin/ip: stdout default via 172.21.15.254 dev enp3s0f1 proto dhcp src 172.21.15.83 metric 100 2024-09-21T01:31:03.431 INFO:teuthology.orchestra.run.smithi083.stdout:/sbin/ip: stdout 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.83 metric 100 2024-09-21T01:31:03.433 INFO:teuthology.orchestra.run.smithi083.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-09-21T01:31:03.434 INFO:teuthology.orchestra.run.smithi083.stdout:/sbin/ip: stdout fe80::/64 dev enp3s0f1 proto kernel metric 1024 pref medium 2024-09-21T01:31:03.434 INFO:teuthology.orchestra.run.smithi083.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 100 pref medium 2024-09-21T01:31:03.436 INFO:teuthology.orchestra.run.smithi083.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-09-21T01:31:03.436 INFO:teuthology.orchestra.run.smithi083.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-09-21T01:31:03.436 INFO:teuthology.orchestra.run.smithi083.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-21T01:31:03.436 INFO:teuthology.orchestra.run.smithi083.stdout:/sbin/ip: stdout 5: enp3s0f1: mtu 1500 state UP qlen 1000 2024-09-21T01:31:03.436 INFO:teuthology.orchestra.run.smithi083.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:fe8f:ce91/64 scope link noprefixroute 2024-09-21T01:31:03.436 INFO:teuthology.orchestra.run.smithi083.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-21T01:31:03.437 INFO:teuthology.orchestra.run.smithi083.stdout:Mon IP `172.21.15.83` is in CIDR network `172.21.0.0/20` 2024-09-21T01:31:03.437 INFO:teuthology.orchestra.run.smithi083.stdout:Mon IP `172.21.15.83` is in CIDR network `172.21.0.0/20` 2024-09-21T01:31:03.437 INFO:teuthology.orchestra.run.smithi083.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-09-21T01:31:03.437 INFO:teuthology.orchestra.run.smithi083.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-09-21T01:31:03.438 INFO:teuthology.orchestra.run.smithi083.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410... 2024-09-21T01:31:03.941 INFO:teuthology.orchestra.run.smithi083.stdout:/bin/podman: stdout ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 2024-09-21T01:31:03.942 INFO:teuthology.orchestra.run.smithi083.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410... 2024-09-21T01:31:03.942 INFO:teuthology.orchestra.run.smithi083.stdout:/bin/podman: stderr Getting image source signatures 2024-09-21T01:31:03.942 INFO:teuthology.orchestra.run.smithi083.stdout:/bin/podman: stderr Copying blob sha256:8425bc7408d91b180e7fdc62f23e7ae6603757f4f36e9969a4eaf9fd9416b764 2024-09-21T01:31:03.942 INFO:teuthology.orchestra.run.smithi083.stdout:/bin/podman: stderr Copying blob sha256:e8b54c863393b7a8216a71737771b73b16a8e43ec7acf927c7faa175c255e551 2024-09-21T01:31:03.942 INFO:teuthology.orchestra.run.smithi083.stdout:/bin/podman: stderr Copying config sha256:ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 2024-09-21T01:31:03.942 INFO:teuthology.orchestra.run.smithi083.stdout:/bin/podman: stderr Writing manifest to image destination 2024-09-21T01:31:04.888 INFO:teuthology.orchestra.run.smithi083.stdout:ceph: stdout ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev) 2024-09-21T01:31:04.888 INFO:teuthology.orchestra.run.smithi083.stdout:Ceph version: ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev) 2024-09-21T01:31:04.888 INFO:teuthology.orchestra.run.smithi083.stdout:Extracting ceph user uid/gid from container image... 2024-09-21T01:31:05.885 INFO:teuthology.orchestra.run.smithi083.stdout:stat: stdout 167 167 2024-09-21T01:31:05.886 INFO:teuthology.orchestra.run.smithi083.stdout:Creating initial keys... 2024-09-21T01:31:06.740 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph-authtool: stdout AQDaIe5m5QJBDRAADGFViRgaZDdTlaBQDwmSwg== 2024-09-21T01:31:07.738 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph-authtool: stdout AQDbIe5mbYP5BBAAD0gawwdoZ2zW4KnagZxY8w== 2024-09-21T01:31:10.012 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph-authtool: stdout AQDcIe5mfz5AAxAAfXh+v0YixxKWYtfZXfg6iA== 2024-09-21T01:31:10.012 INFO:teuthology.orchestra.run.smithi083.stdout:Creating initial monmap... 2024-09-21T01:31:19.666 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-21T01:31:19.666 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-09-21T01:31:19.666 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to f7697ecc-77b8-11ef-baf5-efdc52797490 2024-09-21T01:31:19.667 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-21T01:31:19.667 INFO:teuthology.orchestra.run.smithi083.stdout:monmaptool for a [v2:172.21.15.83:3300,v1:172.21.15.83:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-21T01:31:19.667 INFO:teuthology.orchestra.run.smithi083.stdout:setting min_mon_release = quincy 2024-09-21T01:31:19.667 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/monmaptool: set fsid to f7697ecc-77b8-11ef-baf5-efdc52797490 2024-09-21T01:31:19.667 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-21T01:31:19.667 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T01:31:19.668 INFO:teuthology.orchestra.run.smithi083.stdout:Creating mon... 2024-09-21T01:31:20.791 INFO:teuthology.orchestra.run.smithi083.stdout:create mon.a on 2024-09-21T01:31:21.048 INFO:teuthology.orchestra.run.smithi083.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-09-21T01:31:21.196 INFO:teuthology.orchestra.run.smithi083.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-09-21T01:31:21.381 INFO:teuthology.orchestra.run.smithi083.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-f7697ecc-77b8-11ef-baf5-efdc52797490.target → /etc/systemd/system/ceph-f7697ecc-77b8-11ef-baf5-efdc52797490.target. 2024-09-21T01:31:21.381 INFO:teuthology.orchestra.run.smithi083.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-f7697ecc-77b8-11ef-baf5-efdc52797490.target → /etc/systemd/system/ceph-f7697ecc-77b8-11ef-baf5-efdc52797490.target. 2024-09-21T01:31:21.622 INFO:teuthology.orchestra.run.smithi083.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-f7697ecc-77b8-11ef-baf5-efdc52797490@mon.a 2024-09-21T01:31:21.622 INFO:teuthology.orchestra.run.smithi083.stdout:systemctl: stderr Failed to reset failed state of unit ceph-f7697ecc-77b8-11ef-baf5-efdc52797490@mon.a.service: Unit ceph-f7697ecc-77b8-11ef-baf5-efdc52797490@mon.a.service not loaded. 2024-09-21T01:31:21.796 INFO:teuthology.orchestra.run.smithi083.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-f7697ecc-77b8-11ef-baf5-efdc52797490.target.wants/ceph-f7697ecc-77b8-11ef-baf5-efdc52797490@mon.a.service → /etc/systemd/system/ceph-f7697ecc-77b8-11ef-baf5-efdc52797490@.service. 2024-09-21T01:31:22.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:22 smithi083 podman[30983]: 2024-09-21 01:31:21.936340911 +0000 UTC m=+0.016085034 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T01:31:22.263 INFO:teuthology.orchestra.run.smithi083.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-21T01:31:22.263 INFO:teuthology.orchestra.run.smithi083.stdout:systemctl: stdout disabled 2024-09-21T01:31:22.271 INFO:teuthology.orchestra.run.smithi083.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-21T01:31:22.271 INFO:teuthology.orchestra.run.smithi083.stdout:systemctl: stdout inactive 2024-09-21T01:31:22.271 INFO:teuthology.orchestra.run.smithi083.stdout:firewalld.service is not enabled 2024-09-21T01:31:22.271 INFO:teuthology.orchestra.run.smithi083.stdout:Not possible to enable service . firewalld.service is not available 2024-09-21T01:31:22.271 INFO:teuthology.orchestra.run.smithi083.stdout:Waiting for mon to start... 2024-09-21T01:31:22.271 INFO:teuthology.orchestra.run.smithi083.stdout:Waiting for mon... 2024-09-21T01:31:22.384 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:22 smithi083 podman[30983]: 2024-09-21 01:31:22.200150902 +0000 UTC m=+0.279895012 container init 58bf8587ec8ed6769929b31ed5f72422eb47516cffb75b0aac9c04794af1e8ac (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mon-a, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-21T01:31:22.384 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:22 smithi083 podman[30983]: 2024-09-21 01:31:22.203384075 +0000 UTC m=+0.283128186 container start 58bf8587ec8ed6769929b31ed5f72422eb47516cffb75b0aac9c04794af1e8ac (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mon-a, maintainer=Guillaume Abrioux , ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T01:31:22.385 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:22 smithi083 bash[30983]: 58bf8587ec8ed6769929b31ed5f72422eb47516cffb75b0aac9c04794af1e8ac 2024-09-21T01:31:22.385 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:22 smithi083 systemd[1]: Started Ceph mon.a for f7697ecc-77b8-11ef-baf5-efdc52797490. 2024-09-21T01:31:22.385 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:22 smithi083 ceph-mon[31002]: mkfs f7697ecc-77b8-11ef-baf5-efdc52797490 2024-09-21T01:31:22.385 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:22 smithi083 ceph-mon[31002]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-21T01:31:23.345 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:23 smithi083 ceph-mon[31002]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-21T01:31:23.345 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:23 smithi083 ceph-mon[31002]: monmap epoch 1 2024-09-21T01:31:23.345 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:23 smithi083 ceph-mon[31002]: fsid f7697ecc-77b8-11ef-baf5-efdc52797490 2024-09-21T01:31:23.345 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:23 smithi083 ceph-mon[31002]: last_changed 2024-09-21T01:31:12.791840+0000 2024-09-21T01:31:23.345 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:23 smithi083 ceph-mon[31002]: created 2024-09-21T01:31:12.791840+0000 2024-09-21T01:31:23.345 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:23 smithi083 ceph-mon[31002]: min_mon_release 19 (squid) 2024-09-21T01:31:23.345 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:23 smithi083 ceph-mon[31002]: election_strategy: 1 2024-09-21T01:31:23.345 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:23 smithi083 ceph-mon[31002]: 0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-21T01:31:23.346 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:23 smithi083 ceph-mon[31002]: fsmap 2024-09-21T01:31:23.346 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:23 smithi083 ceph-mon[31002]: osdmap e1: 0 total, 0 up, 0 in 2024-09-21T01:31:23.346 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:23 smithi083 ceph-mon[31002]: mgrmap e1: no daemons active 2024-09-21T01:31:23.346 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:23 smithi083 ceph-mon[31002]: from='client.? 172.21.15.83:0/2041164538' entity='client.admin' cmd={"prefix": "status"} : dispatch 2024-09-21T01:31:23.347 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout cluster: 2024-09-21T01:31:23.348 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout id: f7697ecc-77b8-11ef-baf5-efdc52797490 2024-09-21T01:31:23.349 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-09-21T01:31:23.349 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout 2024-09-21T01:31:23.349 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout services: 2024-09-21T01:31:23.349 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.50896s) 2024-09-21T01:31:23.349 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-09-21T01:31:23.349 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-09-21T01:31:23.349 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout 2024-09-21T01:31:23.349 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout data: 2024-09-21T01:31:23.349 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-09-21T01:31:23.349 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-09-21T01:31:23.349 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-09-21T01:31:23.349 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout pgs: 2024-09-21T01:31:23.349 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout 2024-09-21T01:31:23.350 INFO:teuthology.orchestra.run.smithi083.stdout:mon is available 2024-09-21T01:31:23.350 INFO:teuthology.orchestra.run.smithi083.stdout:Assimilating anything we can from ceph.conf... 2024-09-21T01:31:24.367 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout 2024-09-21T01:31:24.367 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout [global] 2024-09-21T01:31:24.367 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout fsid = f7697ecc-77b8-11ef-baf5-efdc52797490 2024-09-21T01:31:24.368 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-09-21T01:31:24.368 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.83:3300,v1:172.21.15.83:6789] 2024-09-21T01:31:24.368 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-21T01:31:24.368 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-21T01:31:24.368 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-21T01:31:24.368 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-21T01:31:24.368 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout 2024-09-21T01:31:24.368 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-21T01:31:24.368 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-21T01:31:24.368 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout 2024-09-21T01:31:24.368 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout [osd] 2024-09-21T01:31:24.368 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-21T01:31:24.368 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-21T01:31:24.368 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-21T01:31:24.368 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-21T01:31:24.368 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-21T01:31:24.369 INFO:teuthology.orchestra.run.smithi083.stdout:Generating new minimal ceph.conf... 2024-09-21T01:31:24.487 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:24 smithi083 ceph-mon[31002]: from='client.? 172.21.15.83:0/2238479646' entity='client.admin' cmd={"prefix": "config assimilate-conf"} : dispatch 2024-09-21T01:31:24.487 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:24 smithi083 ceph-mon[31002]: from='client.? 172.21.15.83:0/2238479646' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-09-21T01:31:25.553 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:25 smithi083 ceph-mon[31002]: from='client.? 172.21.15.83:0/3825012888' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:31:27.105 INFO:teuthology.orchestra.run.smithi083.stdout:Restarting the monitor... 2024-09-21T01:31:27.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:27 smithi083 systemd[1]: Stopping Ceph mon.a for f7697ecc-77b8-11ef-baf5-efdc52797490... 2024-09-21T01:31:27.747 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:27 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mon-a[30998]: 2024-09-21T01:31:27.429+0000 7faa2439e640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T01:31:27.747 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:27 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mon-a[30998]: 2024-09-21T01:31:27.429+0000 7faa2439e640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-09-21T01:31:27.747 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:27 smithi083 podman[31245]: 2024-09-21 01:31:27.481057003 +0000 UTC m=+0.196414549 container died 58bf8587ec8ed6769929b31ed5f72422eb47516cffb75b0aac9c04794af1e8ac (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mon-a, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-21T01:31:28.053 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:27 smithi083 podman[31245]: 2024-09-21 01:31:27.82931228 +0000 UTC m=+0.544669813 container cleanup 58bf8587ec8ed6769929b31ed5f72422eb47516cffb75b0aac9c04794af1e8ac (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mon-a, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.37.2, ceph=True) 2024-09-21T01:31:28.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:27 smithi083 bash[31245]: ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mon-a 2024-09-21T01:31:28.447 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 podman[31257]: 2024-09-21 01:31:28.097087733 +0000 UTC m=+0.616017467 container remove 58bf8587ec8ed6769929b31ed5f72422eb47516cffb75b0aac9c04794af1e8ac (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mon-a, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T01:31:28.448 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 systemd[1]: ceph-f7697ecc-77b8-11ef-baf5-efdc52797490@mon.a.service: Deactivated successfully. 2024-09-21T01:31:28.448 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 systemd[1]: Stopped Ceph mon.a for f7697ecc-77b8-11ef-baf5-efdc52797490. 2024-09-21T01:31:28.448 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 systemd[1]: Starting Ceph mon.a for f7697ecc-77b8-11ef-baf5-efdc52797490... 2024-09-21T01:31:28.698 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 podman[31351]: 2024-09-21 01:31:28.447859048 +0000 UTC m=+0.108482487 container create 97cefa149ed934e9d3d868ef7a5f16ab9720dc12c871746ef8f9529cb9f76a83 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mon-a, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_BRANCH=HEAD) 2024-09-21T01:31:28.698 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 podman[31351]: 2024-09-21 01:31:28.354507031 +0000 UTC m=+0.015130480 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T01:31:28.698 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 podman[31351]: 2024-09-21 01:31:28.658685835 +0000 UTC m=+0.319309279 container init 97cefa149ed934e9d3d868ef7a5f16ab9720dc12c871746ef8f9529cb9f76a83 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mon-a, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=) 2024-09-21T01:31:28.698 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 podman[31351]: 2024-09-21 01:31:28.661765662 +0000 UTC m=+0.322389093 container start 97cefa149ed934e9d3d868ef7a5f16ab9720dc12c871746ef8f9529cb9f76a83 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mon-a, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T01:31:28.698 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: set uid:gid to 167:167 (ceph:ceph) 2024-09-21T01:31:28.698 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev), process ceph-mon, pid 2 2024-09-21T01:31:28.699 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: pidfile_write: ignore empty --pid-file 2024-09-21T01:31:28.699 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: load: jerasure load: lrc 2024-09-21T01:31:28.699 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: RocksDB version: 7.9.2 2024-09-21T01:31:28.699 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Git sha 0 2024-09-21T01:31:28.699 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Compile date 2024-09-20 22:29:49 2024-09-21T01:31:28.699 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: DB SUMMARY 2024-09-21T01:31:28.699 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: DB Session ID: VV8N8LJZIGDYIQLNQPTT 2024-09-21T01:31:28.699 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: CURRENT file: CURRENT 2024-09-21T01:31:28.699 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: IDENTITY file: IDENTITY 2024-09-21T01:31:28.699 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-09-21T01:31:28.699 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-09-21T01:31:28.699 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 93734 ; 2024-09-21T01:31:28.700 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.error_if_exists: 0 2024-09-21T01:31:28.700 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.create_if_missing: 0 2024-09-21T01:31:28.700 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.paranoid_checks: 1 2024-09-21T01:31:28.700 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-21T01:31:28.700 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-21T01:31:28.700 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-21T01:31:28.700 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.env: 0x563b0e62fd60 2024-09-21T01:31:28.700 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.fs: PosixFileSystem 2024-09-21T01:31:28.700 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.info_log: 0x563b1318f360 2024-09-21T01:31:28.700 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.max_file_opening_threads: 16 2024-09-21T01:31:28.700 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.statistics: (nil) 2024-09-21T01:31:28.701 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.use_fsync: 0 2024-09-21T01:31:28.701 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.max_log_file_size: 0 2024-09-21T01:31:28.701 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-21T01:31:28.701 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-21T01:31:28.701 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.keep_log_file_num: 1000 2024-09-21T01:31:28.701 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.recycle_log_file_num: 0 2024-09-21T01:31:28.701 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.allow_fallocate: 1 2024-09-21T01:31:28.701 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.allow_mmap_reads: 0 2024-09-21T01:31:28.701 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.allow_mmap_writes: 0 2024-09-21T01:31:28.701 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.use_direct_reads: 0 2024-09-21T01:31:28.701 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-21T01:31:28.701 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.create_missing_column_families: 0 2024-09-21T01:31:28.701 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.db_log_dir: 2024-09-21T01:31:28.701 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.wal_dir: 2024-09-21T01:31:28.702 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-21T01:31:28.702 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-21T01:31:28.702 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-21T01:31:28.702 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-21T01:31:28.702 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-21T01:31:28.702 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-21T01:31:28.702 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.advise_random_on_open: 1 2024-09-21T01:31:28.702 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.db_write_buffer_size: 0 2024-09-21T01:31:28.702 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.write_buffer_manager: 0x563b13193d60 2024-09-21T01:31:28.702 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-21T01:31:28.702 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-21T01:31:28.702 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-21T01:31:28.702 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.rate_limiter: (nil) 2024-09-21T01:31:28.702 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-21T01:31:28.703 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.wal_recovery_mode: 2 2024-09-21T01:31:28.703 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.enable_thread_tracking: 0 2024-09-21T01:31:28.757 INFO:teuthology.orchestra.run.smithi083.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-09-21T01:31:28.975 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.enable_pipelined_write: 0 2024-09-21T01:31:28.975 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.unordered_write: 0 2024-09-21T01:31:28.975 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-21T01:31:28.975 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-21T01:31:28.976 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-21T01:31:28.976 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-21T01:31:28.976 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.row_cache: None 2024-09-21T01:31:28.976 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.wal_filter: None 2024-09-21T01:31:28.976 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-21T01:31:28.976 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.allow_ingest_behind: 0 2024-09-21T01:31:28.976 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.two_write_queues: 0 2024-09-21T01:31:28.976 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.manual_wal_flush: 0 2024-09-21T01:31:28.976 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.wal_compression: 0 2024-09-21T01:31:28.976 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.atomic_flush: 0 2024-09-21T01:31:28.976 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-21T01:31:28.976 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-21T01:31:28.976 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-21T01:31:28.977 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.log_readahead_size: 0 2024-09-21T01:31:28.977 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-21T01:31:28.977 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.best_efforts_recovery: 0 2024-09-21T01:31:28.977 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-21T01:31:28.977 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-21T01:31:28.977 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.allow_data_in_errors: 0 2024-09-21T01:31:28.977 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.db_host_id: __hostname__ 2024-09-21T01:31:28.977 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-21T01:31:28.977 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.max_background_jobs: 2 2024-09-21T01:31:28.977 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.max_background_compactions: -1 2024-09-21T01:31:28.977 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.max_subcompactions: 1 2024-09-21T01:31:28.977 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-21T01:31:28.977 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-21T01:31:28.977 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-21T01:31:28.978 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.max_total_wal_size: 0 2024-09-21T01:31:28.978 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-21T01:31:28.978 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-21T01:31:28.978 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-21T01:31:28.978 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-21T01:31:28.978 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.max_open_files: -1 2024-09-21T01:31:28.978 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.bytes_per_sync: 0 2024-09-21T01:31:28.978 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-21T01:31:28.978 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-21T01:31:28.978 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.compaction_readahead_size: 0 2024-09-21T01:31:28.978 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.max_background_flushes: -1 2024-09-21T01:31:28.978 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Compression algorithms supported: 2024-09-21T01:31:28.978 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: kZSTD supported: 0 2024-09-21T01:31:28.978 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: kXpressCompression supported: 0 2024-09-21T01:31:28.979 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: kBZip2Compression supported: 0 2024-09-21T01:31:28.979 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-21T01:31:28.979 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: kLZ4Compression supported: 1 2024-09-21T01:31:28.979 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: kZlibCompression supported: 1 2024-09-21T01:31:28.979 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: kLZ4HCCompression supported: 1 2024-09-21T01:31:28.979 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: kSnappyCompression supported: 1 2024-09-21T01:31:28.979 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-21T01:31:28.979 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-21T01:31:28.979 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-09-21T01:31:28.979 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-21T01:31:28.979 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-21T01:31:28.979 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.merge_operator: 2024-09-21T01:31:28.979 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.compaction_filter: None 2024-09-21T01:31:28.979 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.compaction_filter_factory: None 2024-09-21T01:31:28.979 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.sst_partitioner_factory: None 2024-09-21T01:31:28.980 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-21T01:31:28.980 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-21T01:31:28.980 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x563b1318efa0) 2024-09-21T01:31:28.980 INFO:journalctl@ceph.mon.a.smithi083.stdout: cache_index_and_filter_blocks: 1 2024-09-21T01:31:28.980 INFO:journalctl@ceph.mon.a.smithi083.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-21T01:31:28.980 INFO:journalctl@ceph.mon.a.smithi083.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-21T01:31:28.980 INFO:journalctl@ceph.mon.a.smithi083.stdout: pin_top_level_index_and_filter: 1 2024-09-21T01:31:28.980 INFO:journalctl@ceph.mon.a.smithi083.stdout: index_type: 0 2024-09-21T01:31:28.980 INFO:journalctl@ceph.mon.a.smithi083.stdout: data_block_index_type: 0 2024-09-21T01:31:28.980 INFO:journalctl@ceph.mon.a.smithi083.stdout: index_shortening: 1 2024-09-21T01:31:28.980 INFO:journalctl@ceph.mon.a.smithi083.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-21T01:31:28.980 INFO:journalctl@ceph.mon.a.smithi083.stdout: checksum: 4 2024-09-21T01:31:28.980 INFO:journalctl@ceph.mon.a.smithi083.stdout: no_block_cache: 0 2024-09-21T01:31:28.980 INFO:journalctl@ceph.mon.a.smithi083.stdout: block_cache: 0x563b0f153610 2024-09-21T01:31:28.980 INFO:journalctl@ceph.mon.a.smithi083.stdout: block_cache_name: BinnedLRUCache 2024-09-21T01:31:28.981 INFO:journalctl@ceph.mon.a.smithi083.stdout: block_cache_options: 2024-09-21T01:31:28.981 INFO:journalctl@ceph.mon.a.smithi083.stdout: capacity : 536870912 2024-09-21T01:31:28.981 INFO:journalctl@ceph.mon.a.smithi083.stdout: num_shard_bits : 4 2024-09-21T01:31:28.981 INFO:journalctl@ceph.mon.a.smithi083.stdout: strict_capacity_limit : 0 2024-09-21T01:31:28.981 INFO:journalctl@ceph.mon.a.smithi083.stdout: high_pri_pool_ratio: 0.000 2024-09-21T01:31:28.981 INFO:journalctl@ceph.mon.a.smithi083.stdout: block_cache_compressed: (nil) 2024-09-21T01:31:28.981 INFO:journalctl@ceph.mon.a.smithi083.stdout: persistent_cache: (nil) 2024-09-21T01:31:28.981 INFO:journalctl@ceph.mon.a.smithi083.stdout: block_size: 4096 2024-09-21T01:31:28.981 INFO:journalctl@ceph.mon.a.smithi083.stdout: block_size_deviation: 10 2024-09-21T01:31:28.981 INFO:journalctl@ceph.mon.a.smithi083.stdout: block_restart_interval: 16 2024-09-21T01:31:28.981 INFO:journalctl@ceph.mon.a.smithi083.stdout: index_block_restart_interval: 1 2024-09-21T01:31:28.981 INFO:journalctl@ceph.mon.a.smithi083.stdout: metadata_block_size: 4096 2024-09-21T01:31:28.982 INFO:journalctl@ceph.mon.a.smithi083.stdout: partition_filters: 0 2024-09-21T01:31:28.983 INFO:journalctl@ceph.mon.a.smithi083.stdout: use_delta_encoding: 1 2024-09-21T01:31:28.983 INFO:journalctl@ceph.mon.a.smithi083.stdout: filter_policy: bloomfilter 2024-09-21T01:31:28.983 INFO:journalctl@ceph.mon.a.smithi083.stdout: whole_key_filtering: 1 2024-09-21T01:31:28.983 INFO:journalctl@ceph.mon.a.smithi083.stdout: verify_compression: 0 2024-09-21T01:31:28.983 INFO:journalctl@ceph.mon.a.smithi083.stdout: read_amp_bytes_per_bit: 0 2024-09-21T01:31:28.983 INFO:journalctl@ceph.mon.a.smithi083.stdout: format_version: 5 2024-09-21T01:31:28.983 INFO:journalctl@ceph.mon.a.smithi083.stdout: enable_index_compression: 1 2024-09-21T01:31:28.983 INFO:journalctl@ceph.mon.a.smithi083.stdout: block_align: 0 2024-09-21T01:31:28.983 INFO:journalctl@ceph.mon.a.smithi083.stdout: max_auto_readahead_size: 262144 2024-09-21T01:31:28.983 INFO:journalctl@ceph.mon.a.smithi083.stdout: prepopulate_block_cache: 0 2024-09-21T01:31:28.983 INFO:journalctl@ceph.mon.a.smithi083.stdout: initial_auto_readahead_size: 8192 2024-09-21T01:31:28.983 INFO:journalctl@ceph.mon.a.smithi083.stdout: num_file_reads_for_auto_readahead: 2 2024-09-21T01:31:28.983 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.write_buffer_size: 33554432 2024-09-21T01:31:28.983 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.max_write_buffer_number: 2 2024-09-21T01:31:28.984 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.compression: NoCompression 2024-09-21T01:31:28.984 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.bottommost_compression: Disabled 2024-09-21T01:31:28.984 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.prefix_extractor: nullptr 2024-09-21T01:31:28.984 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-21T01:31:28.984 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.num_levels: 7 2024-09-21T01:31:28.984 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-21T01:31:28.984 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-21T01:31:28.984 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-21T01:31:28.984 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-21T01:31:28.984 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-21T01:31:28.984 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-21T01:31:28.984 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-21T01:31:28.984 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-21T01:31:28.985 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-21T01:31:28.985 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-21T01:31:28.985 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-21T01:31:28.985 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-21T01:31:28.985 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-21T01:31:28.985 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.compression_opts.level: 32767 2024-09-21T01:31:28.985 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.compression_opts.strategy: 0 2024-09-21T01:31:28.985 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-21T01:31:28.985 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-21T01:31:28.985 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-21T01:31:28.985 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-21T01:31:28.985 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.compression_opts.enabled: false 2024-09-21T01:31:28.985 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-21T01:31:28.986 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-21T01:31:28.986 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-21T01:31:28.986 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-21T01:31:28.986 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.target_file_size_base: 67108864 2024-09-21T01:31:28.986 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-21T01:31:28.986 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-21T01:31:28.986 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-21T01:31:28.986 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-21T01:31:28.986 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-21T01:31:28.986 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-21T01:31:28.986 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-21T01:31:28.986 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-21T01:31:28.986 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-21T01:31:28.986 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-21T01:31:28.987 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-21T01:31:28.987 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-21T01:31:28.987 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-21T01:31:28.987 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-21T01:31:28.987 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.arena_block_size: 1048576 2024-09-21T01:31:28.987 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-21T01:31:28.987 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-21T01:31:28.987 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.disable_auto_compactions: 0 2024-09-21T01:31:28.987 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-21T01:31:28.987 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-21T01:31:28.987 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-21T01:31:28.987 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-21T01:31:28.987 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-21T01:31:28.987 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-21T01:31:28.987 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-21T01:31:28.988 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-21T01:31:28.988 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-21T01:31:28.988 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-21T01:31:28.988 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-21T01:31:28.988 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.inplace_update_support: 0 2024-09-21T01:31:28.988 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-21T01:31:28.988 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-21T01:31:28.988 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-21T01:31:28.988 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-21T01:31:28.988 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.bloom_locality: 0 2024-09-21T01:31:28.988 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.max_successive_merges: 0 2024-09-21T01:31:28.988 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-21T01:31:28.988 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.paranoid_file_checks: 0 2024-09-21T01:31:28.988 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.force_consistency_checks: 1 2024-09-21T01:31:28.988 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.report_bg_io_stats: 0 2024-09-21T01:31:28.988 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.ttl: 2592000 2024-09-21T01:31:28.989 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-21T01:31:28.989 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-21T01:31:28.989 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-21T01:31:28.989 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.enable_blob_files: false 2024-09-21T01:31:28.989 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.min_blob_size: 0 2024-09-21T01:31:28.989 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.blob_file_size: 268435456 2024-09-21T01:31:28.989 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-21T01:31:28.989 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-21T01:31:28.989 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-21T01:31:28.989 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-21T01:31:28.989 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-21T01:31:28.989 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.blob_file_starting_level: 0 2024-09-21T01:31:28.989 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-21T01:31:28.989 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-09-21T01:31:28.990 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-09-21T01:31:28.990 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 9838f247-c513-4c25-9c52-5831a19d7e61 2024-09-21T01:31:28.990 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726882288698986, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-09-21T01:31:28.990 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-09-21T01:31:28.990 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726882288700104, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 90020, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 279, "table_properties": {"data_size": 88090, "index_size": 250, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 645, "raw_key_size": 11329, "raw_average_key_size": 47, "raw_value_size": 81682, "raw_average_value_size": 343, "num_data_blocks": 11, "num_entries": 238, "num_filter_entries": 238, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726882288, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "9838f247-c513-4c25-9c52-5831a19d7e61", "db_session_id": "VV8N8LJZIGDYIQLNQPTT", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-09-21T01:31:28.990 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726882288700207, "job": 1, "event": "recovery_finished"} 2024-09-21T01:31:28.990 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-09-21T01:31:28.990 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-21T01:31:28.990 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x563b131b2a80 2024-09-21T01:31:28.990 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: DB pointer 0x563b13f58000 2024-09-21T01:31:28.990 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-21T01:31:28.990 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-21T01:31:28.990 INFO:journalctl@ceph.mon.a.smithi083.stdout: ** DB Stats ** 2024-09-21T01:31:28.990 INFO:journalctl@ceph.mon.a.smithi083.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T01:31:28.991 INFO:journalctl@ceph.mon.a.smithi083.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-21T01:31:28.991 INFO:journalctl@ceph.mon.a.smithi083.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-21T01:31:28.991 INFO:journalctl@ceph.mon.a.smithi083.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T01:31:28.991 INFO:journalctl@ceph.mon.a.smithi083.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-21T01:31:28.991 INFO:journalctl@ceph.mon.a.smithi083.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-21T01:31:28.991 INFO:journalctl@ceph.mon.a.smithi083.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T01:31:28.991 INFO:journalctl@ceph.mon.a.smithi083.stdout: 2024-09-21T01:31:28.991 INFO:journalctl@ceph.mon.a.smithi083.stdout: ** Compaction Stats [default] ** 2024-09-21T01:31:28.991 INFO:journalctl@ceph.mon.a.smithi083.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-21T01:31:28.991 INFO:journalctl@ceph.mon.a.smithi083.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-21T01:31:28.991 INFO:journalctl@ceph.mon.a.smithi083.stdout: L0 2/0 89.77 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 127.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-21T01:31:28.991 INFO:journalctl@ceph.mon.a.smithi083.stdout: Sum 2/0 89.77 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 127.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-21T01:31:28.991 INFO:journalctl@ceph.mon.a.smithi083.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 127.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-21T01:31:28.991 INFO:journalctl@ceph.mon.a.smithi083.stdout: 2024-09-21T01:31:28.992 INFO:journalctl@ceph.mon.a.smithi083.stdout: ** Compaction Stats [default] ** 2024-09-21T01:31:28.992 INFO:journalctl@ceph.mon.a.smithi083.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-21T01:31:28.992 INFO:journalctl@ceph.mon.a.smithi083.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-21T01:31:28.992 INFO:journalctl@ceph.mon.a.smithi083.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 127.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-21T01:31:28.992 INFO:journalctl@ceph.mon.a.smithi083.stdout: 2024-09-21T01:31:28.992 INFO:journalctl@ceph.mon.a.smithi083.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-21T01:31:28.992 INFO:journalctl@ceph.mon.a.smithi083.stdout: 2024-09-21T01:31:28.992 INFO:journalctl@ceph.mon.a.smithi083.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T01:31:28.992 INFO:journalctl@ceph.mon.a.smithi083.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-21T01:31:28.992 INFO:journalctl@ceph.mon.a.smithi083.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-21T01:31:28.992 INFO:journalctl@ceph.mon.a.smithi083.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-21T01:31:28.992 INFO:journalctl@ceph.mon.a.smithi083.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-21T01:31:28.992 INFO:journalctl@ceph.mon.a.smithi083.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-21T01:31:28.992 INFO:journalctl@ceph.mon.a.smithi083.stdout: Cumulative compaction: 0.00 GB write, 25.81 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T01:31:28.993 INFO:journalctl@ceph.mon.a.smithi083.stdout: Interval compaction: 0.00 GB write, 25.81 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T01:31:28.993 INFO:journalctl@ceph.mon.a.smithi083.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-21T01:31:28.993 INFO:journalctl@ceph.mon.a.smithi083.stdout: Block cache BinnedLRUCache@0x563b0f153610#2 capacity: 512.00 MB usage: 1.28 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-09-21T01:31:28.993 INFO:journalctl@ceph.mon.a.smithi083.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.84 KB,0.000160933%) IndexBlock(2,0.44 KB,8.34465e-05%) Misc(1,0.00 KB,0%) 2024-09-21T01:31:28.993 INFO:journalctl@ceph.mon.a.smithi083.stdout: 2024-09-21T01:31:28.993 INFO:journalctl@ceph.mon.a.smithi083.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-21T01:31:28.993 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: starting mon.a rank 0 at public addrs [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] at bind addrs [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid f7697ecc-77b8-11ef-baf5-efdc52797490 2024-09-21T01:31:28.993 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: mon.a@-1(???) e1 preinit fsid f7697ecc-77b8-11ef-baf5-efdc52797490 2024-09-21T01:31:28.993 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: mon.a@-1(???).mds e1 new map 2024-09-21T01:31:28.993 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: mon.a@-1(???).mds e1 print_map 2024-09-21T01:31:28.993 INFO:journalctl@ceph.mon.a.smithi083.stdout: e1 2024-09-21T01:31:28.993 INFO:journalctl@ceph.mon.a.smithi083.stdout: btime 2024-09-21T01:31:22:250084+0000 2024-09-21T01:31:28.993 INFO:journalctl@ceph.mon.a.smithi083.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T01:31:28.993 INFO:journalctl@ceph.mon.a.smithi083.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T01:31:28.993 INFO:journalctl@ceph.mon.a.smithi083.stdout: legacy client fscid: -1 2024-09-21T01:31:28.994 INFO:journalctl@ceph.mon.a.smithi083.stdout: 2024-09-21T01:31:28.994 INFO:journalctl@ceph.mon.a.smithi083.stdout: No filesystems configured 2024-09-21T01:31:28.994 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-21T01:31:28.994 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T01:31:28.994 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T01:31:28.994 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T01:31:28.994 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-09-21T01:31:28.994 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 bash[31351]: 97cefa149ed934e9d3d868ef7a5f16ab9720dc12c871746ef8f9529cb9f76a83 2024-09-21T01:31:28.994 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 systemd[1]: Started Ceph mon.a for f7697ecc-77b8-11ef-baf5-efdc52797490. 2024-09-21T01:31:28.994 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-21T01:31:28.994 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: monmap epoch 1 2024-09-21T01:31:28.994 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: fsid f7697ecc-77b8-11ef-baf5-efdc52797490 2024-09-21T01:31:28.994 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: last_changed 2024-09-21T01:31:12.791840+0000 2024-09-21T01:31:28.994 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: created 2024-09-21T01:31:12.791840+0000 2024-09-21T01:31:28.995 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: min_mon_release 19 (squid) 2024-09-21T01:31:28.995 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: election_strategy: 1 2024-09-21T01:31:28.995 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: 0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-21T01:31:28.995 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: fsmap 2024-09-21T01:31:28.995 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: osdmap e1: 0 total, 0 up, 0 in 2024-09-21T01:31:28.995 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:28 smithi083 ceph-mon[31370]: mgrmap e1: no daemons active 2024-09-21T01:31:29.752 INFO:teuthology.orchestra.run.smithi083.stdout:Wrote config to /etc/ceph/ceph.conf 2024-09-21T01:31:29.773 INFO:teuthology.orchestra.run.smithi083.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-09-21T01:31:29.773 INFO:teuthology.orchestra.run.smithi083.stdout:Creating mgr... 2024-09-21T01:31:29.773 INFO:teuthology.orchestra.run.smithi083.stdout:Verifying port 0.0.0.0:9283 ... 2024-09-21T01:31:29.774 INFO:teuthology.orchestra.run.smithi083.stdout:Verifying port 0.0.0.0:8765 ... 2024-09-21T01:31:30.020 INFO:teuthology.orchestra.run.smithi083.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-f7697ecc-77b8-11ef-baf5-efdc52797490@mgr.x 2024-09-21T01:31:30.020 INFO:teuthology.orchestra.run.smithi083.stdout:systemctl: stderr Failed to reset failed state of unit ceph-f7697ecc-77b8-11ef-baf5-efdc52797490@mgr.x.service: Unit ceph-f7697ecc-77b8-11ef-baf5-efdc52797490@mgr.x.service not loaded. 2024-09-21T01:31:30.256 INFO:teuthology.orchestra.run.smithi083.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-f7697ecc-77b8-11ef-baf5-efdc52797490.target.wants/ceph-f7697ecc-77b8-11ef-baf5-efdc52797490@mgr.x.service → /etc/systemd/system/ceph-f7697ecc-77b8-11ef-baf5-efdc52797490@.service. 2024-09-21T01:31:30.279 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:30 smithi083 ceph-mon[31370]: from='client.? 172.21.15.83:0/1834168813' entity='client.admin' 2024-09-21T01:31:30.554 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 21 01:31:30 smithi083 podman[31583]: 2024-09-21 01:31:30.501099118 +0000 UTC m=+0.124484909 container create 8dfd8ae890885a6b23c8d73b3caab70055ba14befaacaeb0f8921e6256a2dd31 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mgr-x, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-21T01:31:30.867 INFO:teuthology.orchestra.run.smithi083.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-21T01:31:30.868 INFO:teuthology.orchestra.run.smithi083.stdout:systemctl: stdout disabled 2024-09-21T01:31:30.875 INFO:teuthology.orchestra.run.smithi083.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-21T01:31:30.875 INFO:teuthology.orchestra.run.smithi083.stdout:systemctl: stdout inactive 2024-09-21T01:31:30.875 INFO:teuthology.orchestra.run.smithi083.stdout:firewalld.service is not enabled 2024-09-21T01:31:30.875 INFO:teuthology.orchestra.run.smithi083.stdout:Not possible to enable service . firewalld.service is not available 2024-09-21T01:31:30.883 INFO:teuthology.orchestra.run.smithi083.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-21T01:31:30.883 INFO:teuthology.orchestra.run.smithi083.stdout:systemctl: stdout disabled 2024-09-21T01:31:30.891 INFO:teuthology.orchestra.run.smithi083.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-21T01:31:30.891 INFO:teuthology.orchestra.run.smithi083.stdout:systemctl: stdout inactive 2024-09-21T01:31:30.891 INFO:teuthology.orchestra.run.smithi083.stdout:firewalld.service is not enabled 2024-09-21T01:31:30.891 INFO:teuthology.orchestra.run.smithi083.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-09-21T01:31:30.891 INFO:teuthology.orchestra.run.smithi083.stdout:Waiting for mgr to start... 2024-09-21T01:31:30.891 INFO:teuthology.orchestra.run.smithi083.stdout:Waiting for mgr... 2024-09-21T01:31:31.004 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 21 01:31:30 smithi083 podman[31583]: 2024-09-21 01:31:30.778559395 +0000 UTC m=+0.401945186 container init 8dfd8ae890885a6b23c8d73b3caab70055ba14befaacaeb0f8921e6256a2dd31 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mgr-x, org.label-schema.build-date=20240731, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2024-09-21T01:31:31.005 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 21 01:31:30 smithi083 podman[31583]: 2024-09-21 01:31:30.781320123 +0000 UTC m=+0.404705915 container start 8dfd8ae890885a6b23c8d73b3caab70055ba14befaacaeb0f8921e6256a2dd31 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mgr-x, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-09-21T01:31:31.005 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 21 01:31:30 smithi083 bash[31583]: 8dfd8ae890885a6b23c8d73b3caab70055ba14befaacaeb0f8921e6256a2dd31 2024-09-21T01:31:31.005 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 21 01:31:30 smithi083 systemd[1]: Started Ceph mgr.x for f7697ecc-77b8-11ef-baf5-efdc52797490. 2024-09-21T01:31:31.553 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:31 smithi083 ceph-mon[31370]: from='client.? 172.21.15.83:0/3857977635' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-09-21T01:31:31.923 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout 2024-09-21T01:31:31.923 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout { 2024-09-21T01:31:31.923 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "fsid": "f7697ecc-77b8-11ef-baf5-efdc52797490", 2024-09-21T01:31:31.923 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "health": { 2024-09-21T01:31:31.924 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-21T01:31:31.924 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-21T01:31:31.924 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-21T01:31:31.924 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout }, 2024-09-21T01:31:31.924 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-21T01:31:31.924 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-21T01:31:31.924 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout 0 2024-09-21T01:31:31.924 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout ], 2024-09-21T01:31:31.924 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-21T01:31:31.924 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "a" 2024-09-21T01:31:31.924 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout ], 2024-09-21T01:31:31.924 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2024-09-21T01:31:31.924 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-21T01:31:31.924 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T01:31:31.924 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-21T01:31:31.925 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-21T01:31:31.925 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout }, 2024-09-21T01:31:31.925 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-21T01:31:31.925 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T01:31:31.925 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-21T01:31:31.925 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-21T01:31:31.925 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-21T01:31:31.925 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-21T01:31:31.925 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-21T01:31:31.925 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-21T01:31:31.928 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout }, 2024-09-21T01:31:31.928 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-21T01:31:31.928 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-21T01:31:31.928 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-21T01:31:31.928 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-21T01:31:31.928 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-21T01:31:31.928 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-21T01:31:31.928 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-21T01:31:31.929 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-21T01:31:31.929 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-21T01:31:31.929 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout }, 2024-09-21T01:31:31.929 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-21T01:31:31.929 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T01:31:31.929 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "btime": "2024-09-21T01:31:22:250084+0000", 2024-09-21T01:31:31.929 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-21T01:31:31.929 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-21T01:31:31.929 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout }, 2024-09-21T01:31:31.929 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-21T01:31:31.929 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-21T01:31:31.929 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-21T01:31:31.929 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-21T01:31:31.929 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-21T01:31:31.929 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-21T01:31:31.929 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "restful" 2024-09-21T01:31:31.929 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout ], 2024-09-21T01:31:31.930 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T01:31:31.930 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout }, 2024-09-21T01:31:31.930 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-21T01:31:31.930 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T01:31:31.930 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "modified": "2024-09-21T01:31:22.250944+0000", 2024-09-21T01:31:31.930 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T01:31:31.930 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout }, 2024-09-21T01:31:31.930 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-21T01:31:31.930 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout } 2024-09-21T01:31:31.930 INFO:teuthology.orchestra.run.smithi083.stdout:mgr not available, waiting (1/15)... 2024-09-21T01:31:34.806 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:34 smithi083 ceph-mon[31370]: from='client.? 172.21.15.83:0/1812076900' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-09-21T01:31:35.029 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout 2024-09-21T01:31:35.029 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout { 2024-09-21T01:31:35.029 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "fsid": "f7697ecc-77b8-11ef-baf5-efdc52797490", 2024-09-21T01:31:35.029 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "health": { 2024-09-21T01:31:35.030 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-21T01:31:35.030 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-21T01:31:35.030 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-21T01:31:35.030 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout }, 2024-09-21T01:31:35.030 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-21T01:31:35.030 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-21T01:31:35.030 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout 0 2024-09-21T01:31:35.031 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout ], 2024-09-21T01:31:35.031 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-21T01:31:35.031 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "a" 2024-09-21T01:31:35.031 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout ], 2024-09-21T01:31:35.031 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "quorum_age": 5, 2024-09-21T01:31:35.031 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-21T01:31:35.031 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T01:31:35.031 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-21T01:31:35.031 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-21T01:31:35.031 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout }, 2024-09-21T01:31:35.031 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-21T01:31:35.031 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T01:31:35.031 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-21T01:31:35.031 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-21T01:31:35.032 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-21T01:31:35.032 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-21T01:31:35.035 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-21T01:31:35.035 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-21T01:31:35.035 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout }, 2024-09-21T01:31:35.035 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-21T01:31:35.035 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-21T01:31:35.035 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-21T01:31:35.035 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-21T01:31:35.035 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-21T01:31:35.036 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-21T01:31:35.036 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-21T01:31:35.036 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-21T01:31:35.036 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-21T01:31:35.036 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout }, 2024-09-21T01:31:35.036 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-21T01:31:35.036 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T01:31:35.036 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "btime": "2024-09-21T01:31:22:250084+0000", 2024-09-21T01:31:35.036 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-21T01:31:35.036 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-21T01:31:35.036 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout }, 2024-09-21T01:31:35.036 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-21T01:31:35.036 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-21T01:31:35.036 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-21T01:31:35.036 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-21T01:31:35.037 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-21T01:31:35.037 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-21T01:31:35.037 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "restful" 2024-09-21T01:31:35.037 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout ], 2024-09-21T01:31:35.037 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T01:31:35.037 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout }, 2024-09-21T01:31:35.037 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-21T01:31:35.037 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T01:31:35.037 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "modified": "2024-09-21T01:31:22.250944+0000", 2024-09-21T01:31:35.037 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T01:31:35.037 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout }, 2024-09-21T01:31:35.037 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-21T01:31:35.037 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout } 2024-09-21T01:31:35.037 INFO:teuthology.orchestra.run.smithi083.stdout:mgr not available, waiting (2/15)... 2024-09-21T01:31:36.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:35 smithi083 ceph-mon[31370]: Activating manager daemon x 2024-09-21T01:31:36.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:35 smithi083 ceph-mon[31370]: mgrmap e2: x(active, starting, since 0.00348063s) 2024-09-21T01:31:36.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:35 smithi083 ceph-mon[31370]: from='mgr.14100 172.21.15.83:0/3850261203' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-09-21T01:31:36.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:35 smithi083 ceph-mon[31370]: from='mgr.14100 172.21.15.83:0/3850261203' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-09-21T01:31:36.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:35 smithi083 ceph-mon[31370]: from='mgr.14100 172.21.15.83:0/3850261203' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-09-21T01:31:36.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:35 smithi083 ceph-mon[31370]: from='mgr.14100 172.21.15.83:0/3850261203' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T01:31:36.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:35 smithi083 ceph-mon[31370]: from='mgr.14100 172.21.15.83:0/3850261203' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-21T01:31:36.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:35 smithi083 ceph-mon[31370]: Manager daemon x is now available 2024-09-21T01:31:36.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:35 smithi083 ceph-mon[31370]: from='mgr.14100 172.21.15.83:0/3850261203' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-21T01:31:36.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:35 smithi083 ceph-mon[31370]: from='mgr.14100 172.21.15.83:0/3850261203' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-21T01:31:36.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:35 smithi083 ceph-mon[31370]: from='mgr.14100 172.21.15.83:0/3850261203' entity='mgr.x' 2024-09-21T01:31:36.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:35 smithi083 ceph-mon[31370]: from='mgr.14100 172.21.15.83:0/3850261203' entity='mgr.x' 2024-09-21T01:31:36.305 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:35 smithi083 ceph-mon[31370]: from='mgr.14100 172.21.15.83:0/3850261203' entity='mgr.x' 2024-09-21T01:31:38.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:37 smithi083 ceph-mon[31370]: mgrmap e3: x(active, since 1.0078s) 2024-09-21T01:31:38.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:37 smithi083 ceph-mon[31370]: from='client.? 172.21.15.83:0/1392443636' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-09-21T01:31:38.244 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout 2024-09-21T01:31:38.244 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout { 2024-09-21T01:31:38.244 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "fsid": "f7697ecc-77b8-11ef-baf5-efdc52797490", 2024-09-21T01:31:38.244 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "health": { 2024-09-21T01:31:38.244 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-21T01:31:38.244 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-21T01:31:38.244 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-21T01:31:38.244 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout }, 2024-09-21T01:31:38.244 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-21T01:31:38.244 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-21T01:31:38.245 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout 0 2024-09-21T01:31:38.245 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout ], 2024-09-21T01:31:38.245 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-21T01:31:38.245 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "a" 2024-09-21T01:31:38.245 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout ], 2024-09-21T01:31:38.245 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "quorum_age": 9, 2024-09-21T01:31:38.245 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-21T01:31:38.245 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T01:31:38.245 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-21T01:31:38.245 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-21T01:31:38.245 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout }, 2024-09-21T01:31:38.245 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-21T01:31:38.245 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T01:31:38.245 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-21T01:31:38.245 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-21T01:31:38.245 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-21T01:31:38.249 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-21T01:31:38.249 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-21T01:31:38.249 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-21T01:31:38.249 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout }, 2024-09-21T01:31:38.249 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-21T01:31:38.249 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-21T01:31:38.249 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-21T01:31:38.249 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-21T01:31:38.249 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-21T01:31:38.249 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-21T01:31:38.249 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-21T01:31:38.249 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-21T01:31:38.249 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-21T01:31:38.249 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout }, 2024-09-21T01:31:38.250 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-21T01:31:38.250 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T01:31:38.250 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "btime": "2024-09-21T01:31:22:250084+0000", 2024-09-21T01:31:38.250 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-21T01:31:38.250 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-21T01:31:38.250 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout }, 2024-09-21T01:31:38.250 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-21T01:31:38.250 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-21T01:31:38.250 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-21T01:31:38.250 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-21T01:31:38.250 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-21T01:31:38.250 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-21T01:31:38.250 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "restful" 2024-09-21T01:31:38.250 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout ], 2024-09-21T01:31:38.251 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T01:31:38.251 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout }, 2024-09-21T01:31:38.251 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-21T01:31:38.251 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T01:31:38.251 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "modified": "2024-09-21T01:31:22.250944+0000", 2024-09-21T01:31:38.251 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T01:31:38.251 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout }, 2024-09-21T01:31:38.251 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-21T01:31:38.251 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout } 2024-09-21T01:31:38.251 INFO:teuthology.orchestra.run.smithi083.stdout:mgr is available 2024-09-21T01:31:39.053 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:38 smithi083 ceph-mon[31370]: mgrmap e4: x(active, since 2s) 2024-09-21T01:31:39.450 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout 2024-09-21T01:31:39.450 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout [global] 2024-09-21T01:31:39.450 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout fsid = f7697ecc-77b8-11ef-baf5-efdc52797490 2024-09-21T01:31:39.450 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-09-21T01:31:39.450 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.83:3300,v1:172.21.15.83:6789] 2024-09-21T01:31:39.450 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-21T01:31:39.450 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-21T01:31:39.450 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-21T01:31:39.451 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-21T01:31:39.451 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout 2024-09-21T01:31:39.451 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-21T01:31:39.451 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-21T01:31:39.451 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout 2024-09-21T01:31:39.451 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout [osd] 2024-09-21T01:31:39.451 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-21T01:31:39.451 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-21T01:31:39.451 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-21T01:31:39.451 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-21T01:31:39.451 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-21T01:31:39.451 INFO:teuthology.orchestra.run.smithi083.stdout:Enabling cephadm module... 2024-09-21T01:31:40.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:39 smithi083 ceph-mon[31370]: from='client.? 172.21.15.83:0/1856668393' entity='client.admin' cmd={"prefix": "config assimilate-conf"} : dispatch 2024-09-21T01:31:41.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:40 smithi083 ceph-mon[31370]: from='client.? 172.21.15.83:0/3781233690' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "cephadm"} : dispatch 2024-09-21T01:31:41.054 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 21 01:31:40 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mgr-x[31598]: ignoring --setuser ceph since I am not root 2024-09-21T01:31:41.054 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 21 01:31:40 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mgr-x[31598]: ignoring --setgroup ceph since I am not root 2024-09-21T01:31:42.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:41 smithi083 ceph-mon[31370]: from='client.? 172.21.15.83:0/3781233690' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-09-21T01:31:42.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:41 smithi083 ceph-mon[31370]: mgrmap e5: x(active, since 5s) 2024-09-21T01:31:42.722 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout { 2024-09-21T01:31:42.722 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-09-21T01:31:42.722 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-21T01:31:42.722 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-21T01:31:42.722 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-21T01:31:42.722 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout } 2024-09-21T01:31:42.722 INFO:teuthology.orchestra.run.smithi083.stdout:Waiting for the mgr to restart... 2024-09-21T01:31:42.722 INFO:teuthology.orchestra.run.smithi083.stdout:Waiting for mgr epoch 5... 2024-09-21T01:31:42.988 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:42 smithi083 ceph-mon[31370]: from='client.? 172.21.15.83:0/3519491999' entity='client.admin' cmd={"prefix": "mgr stat"} : dispatch 2024-09-21T01:31:46.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:45 smithi083 ceph-mon[31370]: Active manager daemon x restarted 2024-09-21T01:31:46.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:45 smithi083 ceph-mon[31370]: Activating manager daemon x 2024-09-21T01:31:46.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:45 smithi083 ceph-mon[31370]: osdmap e2: 0 total, 0 up, 0 in 2024-09-21T01:31:46.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:45 smithi083 ceph-mon[31370]: mgrmap e6: x(active, starting, since 0.00384861s) 2024-09-21T01:31:46.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:45 smithi083 ceph-mon[31370]: from='mgr.14118 172.21.15.83:0/345722104' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T01:31:46.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:45 smithi083 ceph-mon[31370]: from='mgr.14118 172.21.15.83:0/345722104' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-21T01:31:46.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:45 smithi083 ceph-mon[31370]: from='mgr.14118 172.21.15.83:0/345722104' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-09-21T01:31:46.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:45 smithi083 ceph-mon[31370]: from='mgr.14118 172.21.15.83:0/345722104' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-09-21T01:31:46.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:45 smithi083 ceph-mon[31370]: from='mgr.14118 172.21.15.83:0/345722104' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-09-21T01:31:46.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:45 smithi083 ceph-mon[31370]: Manager daemon x is now available 2024-09-21T01:31:47.439 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 21 01:31:47 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mgr-x[31598]: 2024-09-21T01:31:47.258+0000 7f90b3d3e640 -1 log_channel(cephadm) log [ERR] : [21/Sep/2024:01:31:47] ENGINE Error in HTTPServer.serve 2024-09-21T01:31:47.439 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 21 01:31:47 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mgr-x[31598]: Traceback (most recent call last): 2024-09-21T01:31:47.439 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 21 01:31:47 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mgr-x[31598]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T01:31:47.439 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 21 01:31:47 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mgr-x[31598]: self._connections.run(self.expiration_interval) 2024-09-21T01:31:47.439 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 21 01:31:47 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mgr-x[31598]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T01:31:47.439 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 21 01:31:47 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mgr-x[31598]: self._run(expiration_interval) 2024-09-21T01:31:47.439 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 21 01:31:47 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mgr-x[31598]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T01:31:47.439 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 21 01:31:47 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mgr-x[31598]: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T01:31:47.439 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 21 01:31:47 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mgr-x[31598]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T01:31:47.439 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 21 01:31:47 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mgr-x[31598]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T01:31:47.440 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 21 01:31:47 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mgr-x[31598]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T01:31:47.440 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 21 01:31:47 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mgr-x[31598]: s = self.context.wrap_socket( 2024-09-21T01:31:47.440 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 21 01:31:47 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mgr-x[31598]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T01:31:47.440 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 21 01:31:47 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mgr-x[31598]: return self.sslsocket_class._create( 2024-09-21T01:31:47.440 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 21 01:31:47 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mgr-x[31598]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T01:31:47.440 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 21 01:31:47 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mgr-x[31598]: self.do_handshake() 2024-09-21T01:31:47.440 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 21 01:31:47 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mgr-x[31598]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T01:31:47.440 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 21 01:31:47 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mgr-x[31598]: self._sslobj.do_handshake() 2024-09-21T01:31:47.440 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 21 01:31:47 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mgr-x[31598]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T01:31:47.440 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 21 01:31:47 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mgr-x[31598]: 2024-09-21T01:31:47.445 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout { 2024-09-21T01:31:47.445 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-09-21T01:31:47.445 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-21T01:31:47.445 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout } 2024-09-21T01:31:47.445 INFO:teuthology.orchestra.run.smithi083.stdout:mgr epoch 5 is available 2024-09-21T01:31:47.445 INFO:teuthology.orchestra.run.smithi083.stdout:Verifying orchestrator module is enabled... 2024-09-21T01:31:47.761 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:47 smithi083 ceph-mon[31370]: from='mgr.14118 172.21.15.83:0/345722104' entity='mgr.x' 2024-09-21T01:31:47.761 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:47 smithi083 ceph-mon[31370]: from='mgr.14118 172.21.15.83:0/345722104' entity='mgr.x' 2024-09-21T01:31:47.762 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:47 smithi083 ceph-mon[31370]: Found migration_current of "None". Setting to last migration. 2024-09-21T01:31:47.762 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:47 smithi083 ceph-mon[31370]: from='mgr.14118 172.21.15.83:0/345722104' entity='mgr.x' 2024-09-21T01:31:47.762 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:47 smithi083 ceph-mon[31370]: from='mgr.14118 172.21.15.83:0/345722104' entity='mgr.x' 2024-09-21T01:31:47.762 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:47 smithi083 ceph-mon[31370]: from='mgr.14118 172.21.15.83:0/345722104' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:31:47.762 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:47 smithi083 ceph-mon[31370]: from='mgr.14118 172.21.15.83:0/345722104' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:31:47.762 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:47 smithi083 ceph-mon[31370]: from='mgr.14118 172.21.15.83:0/345722104' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-21T01:31:47.762 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:47 smithi083 ceph-mon[31370]: from='mgr.14118 172.21.15.83:0/345722104' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-21T01:31:47.762 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:47 smithi083 ceph-mon[31370]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-21T01:31:47.762 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:47 smithi083 ceph-mon[31370]: mgrmap e7: x(active, since 1.00675s) 2024-09-21T01:31:47.762 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:47 smithi083 ceph-mon[31370]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-21T01:31:47.762 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:47 smithi083 ceph-mon[31370]: from='mgr.14118 172.21.15.83:0/345722104' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:31:48.804 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:48 smithi083 ceph-mon[31370]: [21/Sep/2024:01:31:47] ENGINE Bus STARTING 2024-09-21T01:31:48.804 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:48 smithi083 ceph-mon[31370]: [21/Sep/2024:01:31:47] ENGINE Serving on http://172.21.15.83:8765 2024-09-21T01:31:48.804 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:48 smithi083 ceph-mon[31370]: [21/Sep/2024:01:31:47] ENGINE Serving on https://172.21.15.83:7150 2024-09-21T01:31:48.804 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:48 smithi083 ceph-mon[31370]: [21/Sep/2024:01:31:47] ENGINE Bus STARTED 2024-09-21T01:31:48.804 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:48 smithi083 ceph-mon[31370]: [21/Sep/2024:01:31:47] ENGINE Error in HTTPServer.serve 2024-09-21T01:31:48.804 INFO:journalctl@ceph.mon.a.smithi083.stdout: Traceback (most recent call last): 2024-09-21T01:31:48.804 INFO:journalctl@ceph.mon.a.smithi083.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T01:31:48.804 INFO:journalctl@ceph.mon.a.smithi083.stdout: self._connections.run(self.expiration_interval) 2024-09-21T01:31:48.804 INFO:journalctl@ceph.mon.a.smithi083.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T01:31:48.804 INFO:journalctl@ceph.mon.a.smithi083.stdout: self._run(expiration_interval) 2024-09-21T01:31:48.804 INFO:journalctl@ceph.mon.a.smithi083.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T01:31:48.805 INFO:journalctl@ceph.mon.a.smithi083.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T01:31:48.805 INFO:journalctl@ceph.mon.a.smithi083.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T01:31:48.805 INFO:journalctl@ceph.mon.a.smithi083.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T01:31:48.805 INFO:journalctl@ceph.mon.a.smithi083.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T01:31:48.805 INFO:journalctl@ceph.mon.a.smithi083.stdout: s = self.context.wrap_socket( 2024-09-21T01:31:48.805 INFO:journalctl@ceph.mon.a.smithi083.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T01:31:48.805 INFO:journalctl@ceph.mon.a.smithi083.stdout: return self.sslsocket_class._create( 2024-09-21T01:31:48.805 INFO:journalctl@ceph.mon.a.smithi083.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T01:31:48.805 INFO:journalctl@ceph.mon.a.smithi083.stdout: self.do_handshake() 2024-09-21T01:31:48.805 INFO:journalctl@ceph.mon.a.smithi083.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T01:31:48.805 INFO:journalctl@ceph.mon.a.smithi083.stdout: self._sslobj.do_handshake() 2024-09-21T01:31:48.805 INFO:journalctl@ceph.mon.a.smithi083.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T01:31:48.805 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:48 smithi083 ceph-mon[31370]: from='client.? 172.21.15.83:0/4129695029' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "orchestrator"} : dispatch 2024-09-21T01:31:48.985 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr module 'orchestrator' is already enabled (always-on) 2024-09-21T01:31:48.985 INFO:teuthology.orchestra.run.smithi083.stdout:Setting orchestrator backend to cephadm... 2024-09-21T01:31:49.553 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:49 smithi083 ceph-mon[31370]: from='client.? 172.21.15.83:0/4129695029' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "orchestrator"}]': finished 2024-09-21T01:31:49.554 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:49 smithi083 ceph-mon[31370]: mgrmap e8: x(active, since 2s) 2024-09-21T01:31:50.712 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:50 smithi083 ceph-mon[31370]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:31:50.712 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:50 smithi083 ceph-mon[31370]: from='mgr.14118 172.21.15.83:0/345722104' entity='mgr.x' 2024-09-21T01:31:50.712 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:50 smithi083 ceph-mon[31370]: from='mgr.14118 172.21.15.83:0/345722104' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:31:51.239 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout value unchanged 2024-09-21T01:31:51.239 INFO:teuthology.orchestra.run.smithi083.stdout:Generating ssh key... 2024-09-21T01:31:51.656 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:51 smithi083 ceph-mon[31370]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:31:52.243 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 21 01:31:51 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mgr-x[31598]: Generating public/private rsa key pair. 2024-09-21T01:31:52.243 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 21 01:31:51 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mgr-x[31598]: Your identification has been saved in /tmp/tmpvncin90a/key 2024-09-21T01:31:52.243 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 21 01:31:51 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mgr-x[31598]: Your public key has been saved in /tmp/tmpvncin90a/key.pub 2024-09-21T01:31:52.243 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 21 01:31:51 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mgr-x[31598]: The key fingerprint is: 2024-09-21T01:31:52.243 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 21 01:31:51 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mgr-x[31598]: SHA256:FApQTd0CmRSyZmmjrpMzfHzwkP6OEzISDQI+QKITsCk ceph-f7697ecc-77b8-11ef-baf5-efdc52797490 2024-09-21T01:31:52.243 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 21 01:31:51 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mgr-x[31598]: The key's randomart image is: 2024-09-21T01:31:52.243 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 21 01:31:51 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mgr-x[31598]: +---[RSA 3072]----+ 2024-09-21T01:31:52.243 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 21 01:31:51 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mgr-x[31598]: |X..o++=*.. | 2024-09-21T01:31:52.244 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 21 01:31:51 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mgr-x[31598]: |B+ =+.o.. | 2024-09-21T01:31:52.244 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 21 01:31:51 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mgr-x[31598]: |E= B . .. | 2024-09-21T01:31:52.244 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 21 01:31:51 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mgr-x[31598]: |o.o= . . | 2024-09-21T01:31:52.244 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 21 01:31:51 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mgr-x[31598]: | .. . S | 2024-09-21T01:31:52.244 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 21 01:31:51 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mgr-x[31598]: |.+ = | 2024-09-21T01:31:52.244 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 21 01:31:51 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mgr-x[31598]: |o.* = | 2024-09-21T01:31:52.244 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 21 01:31:51 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mgr-x[31598]: |=o =.o | 2024-09-21T01:31:52.244 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 21 01:31:51 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mgr-x[31598]: |.+..=o | 2024-09-21T01:31:52.244 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 21 01:31:51 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mgr-x[31598]: +----[SHA256]-----+ 2024-09-21T01:31:52.855 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:52 smithi083 ceph-mon[31370]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:31:52.855 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:52 smithi083 ceph-mon[31370]: Generating ssh key... 2024-09-21T01:31:52.855 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:52 smithi083 ceph-mon[31370]: from='mgr.14118 172.21.15.83:0/345722104' entity='mgr.x' 2024-09-21T01:31:52.855 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:52 smithi083 ceph-mon[31370]: from='mgr.14118 172.21.15.83:0/345722104' entity='mgr.x' 2024-09-21T01:31:53.627 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDmcVojWFQRL3aIMbWRtF3KimCpnEeQGbEsvk4VDn73zSYZzHTmCz8YMQZuqc1NqEjXizIB9a0AW2NmW9I9WdhPtWJ8+cD0DsKZo1mImWlGEmW9MQxyEUDx6jZKz+sYMJVciOei46xVyQ3D6rflPe6m5o9i4EgKWt3cbCrWkPxsQG1Hx4VPkrJuJ82kCWrnRHy5FnpKpKIPJPXJ3FqZmkDbBVP6tdo7evNgxnmrY+ZNzBGjOpcIIqSGjYET9Qxe2czqcpZ15D+gG0Ngiyhr3oWKOyv9oWw6C8OA0o4MX5FKHKiLjB1PIHJkPvn/AqwmAE2seVOtMuq32yotFNhxQsWAx1tVk5J0BfCiqap89FYLF2GDVyjDxbM+T/PqOgHuGb3MyrbYzwNyBwQ0rx5BQoWFFTUIkfXhGD30JOo/PqD51HZVzhWfS14Sbk/f/SUMqlOmuUieVqAdgW76XlWKaJQq06VMo+T1i5lRa04zByJOCDr9DQqOmdNsduhiKGPGNu0= ceph-f7697ecc-77b8-11ef-baf5-efdc52797490 2024-09-21T01:31:53.628 INFO:teuthology.orchestra.run.smithi083.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-09-21T01:31:53.628 INFO:teuthology.orchestra.run.smithi083.stdout:Adding key to root@localhost authorized_keys... 2024-09-21T01:31:53.638 INFO:teuthology.orchestra.run.smithi083.stdout:Adding host smithi083... 2024-09-21T01:31:54.044 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:53 smithi083 ceph-mon[31370]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:31:54.973 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:54 smithi083 ceph-mon[31370]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi083", "addr": "172.21.15.83", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:31:56.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:55 smithi083 ceph-mon[31370]: Deploying cephadm binary to smithi083 2024-09-21T01:31:58.071 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout Added host 'smithi083' with addr '172.21.15.83' 2024-09-21T01:31:58.072 INFO:teuthology.orchestra.run.smithi083.stdout:Deploying unmanaged mon service... 2024-09-21T01:31:58.310 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:58 smithi083 ceph-mon[31370]: from='mgr.14118 172.21.15.83:0/345722104' entity='mgr.x' 2024-09-21T01:31:58.310 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:58 smithi083 ceph-mon[31370]: Added host smithi083 2024-09-21T01:31:58.310 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:58 smithi083 ceph-mon[31370]: from='mgr.14118 172.21.15.83:0/345722104' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:31:59.440 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-09-21T01:31:59.440 INFO:teuthology.orchestra.run.smithi083.stdout:Deploying unmanaged mgr service... 2024-09-21T01:32:00.009 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:59 smithi083 ceph-mon[31370]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:32:00.009 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:59 smithi083 ceph-mon[31370]: Saving service mon spec with placement count:5 2024-09-21T01:32:00.009 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:31:59 smithi083 ceph-mon[31370]: from='mgr.14118 172.21.15.83:0/345722104' entity='mgr.x' 2024-09-21T01:32:01.026 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-09-21T01:32:01.554 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:01 smithi083 ceph-mon[31370]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:32:01.554 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:01 smithi083 ceph-mon[31370]: Saving service mgr spec with placement count:2 2024-09-21T01:32:01.554 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:01 smithi083 ceph-mon[31370]: from='mgr.14118 172.21.15.83:0/345722104' entity='mgr.x' 2024-09-21T01:32:01.554 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:01 smithi083 ceph-mon[31370]: from='mgr.14118 172.21.15.83:0/345722104' entity='mgr.x' 2024-09-21T01:32:01.554 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:01 smithi083 ceph-mon[31370]: from='mgr.14118 172.21.15.83:0/345722104' entity='mgr.x' 2024-09-21T01:32:02.785 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:02 smithi083 ceph-mon[31370]: from='client.? 172.21.15.83:0/2344977583' entity='client.admin' 2024-09-21T01:32:03.584 INFO:teuthology.orchestra.run.smithi083.stdout:Enabling the dashboard module... 2024-09-21T01:32:04.092 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:03 smithi083 ceph-mon[31370]: from='client.? 172.21.15.83:0/4137886750' entity='client.admin' 2024-09-21T01:32:04.092 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:03 smithi083 ceph-mon[31370]: from='mgr.14118 172.21.15.83:0/345722104' entity='mgr.x' 2024-09-21T01:32:05.155 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:04 smithi083 ceph-mon[31370]: from='client.? 172.21.15.83:0/553152204' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "dashboard"} : dispatch 2024-09-21T01:32:05.155 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:04 smithi083 ceph-mon[31370]: from='mgr.14118 172.21.15.83:0/345722104' entity='mgr.x' 2024-09-21T01:32:05.155 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 21 01:32:05 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mgr-x[31598]: ignoring --setuser ceph since I am not root 2024-09-21T01:32:05.156 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 21 01:32:05 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mgr-x[31598]: ignoring --setgroup ceph since I am not root 2024-09-21T01:32:06.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:05 smithi083 ceph-mon[31370]: from='client.? 172.21.15.83:0/553152204' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-09-21T01:32:06.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:05 smithi083 ceph-mon[31370]: mgrmap e9: x(active, since 19s) 2024-09-21T01:32:07.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:07 smithi083 ceph-mon[31370]: from='client.? 172.21.15.83:0/1788170353' entity='client.admin' cmd={"prefix": "mgr stat"} : dispatch 2024-09-21T01:32:07.581 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout { 2024-09-21T01:32:07.581 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-09-21T01:32:07.581 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-21T01:32:07.581 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-21T01:32:07.581 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-21T01:32:07.581 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout } 2024-09-21T01:32:07.581 INFO:teuthology.orchestra.run.smithi083.stdout:Waiting for the mgr to restart... 2024-09-21T01:32:07.582 INFO:teuthology.orchestra.run.smithi083.stdout:Waiting for mgr epoch 9... 2024-09-21T01:32:10.401 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:10 smithi083 ceph-mon[31370]: Active manager daemon x restarted 2024-09-21T01:32:10.401 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:10 smithi083 ceph-mon[31370]: Activating manager daemon x 2024-09-21T01:32:10.401 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:10 smithi083 ceph-mon[31370]: osdmap e3: 0 total, 0 up, 0 in 2024-09-21T01:32:10.401 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:10 smithi083 ceph-mon[31370]: mgrmap e10: x(active, starting, since 0.00413119s) 2024-09-21T01:32:10.401 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:10 smithi083 ceph-mon[31370]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T01:32:10.401 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:10 smithi083 ceph-mon[31370]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-21T01:32:10.402 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:10 smithi083 ceph-mon[31370]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-09-21T01:32:10.402 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:10 smithi083 ceph-mon[31370]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-09-21T01:32:10.402 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:10 smithi083 ceph-mon[31370]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-09-21T01:32:10.402 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:10 smithi083 ceph-mon[31370]: Manager daemon x is now available 2024-09-21T01:32:11.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:11 smithi083 ceph-mon[31370]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:32:11.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:11 smithi083 ceph-mon[31370]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-21T01:32:11.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:11 smithi083 ceph-mon[31370]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-21T01:32:11.461 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:11 smithi083 ceph-mon[31370]: mgrmap e11: x(active, since 1.00678s) 2024-09-21T01:32:11.728 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 21 01:32:11 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mgr-x[31598]: 2024-09-21T01:32:11.475+0000 7fb186dfe640 -1 log_channel(cephadm) log [ERR] : [21/Sep/2024:01:32:11] ENGINE Error in HTTPServer.serve 2024-09-21T01:32:11.729 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 21 01:32:11 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mgr-x[31598]: Traceback (most recent call last): 2024-09-21T01:32:11.729 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 21 01:32:11 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mgr-x[31598]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T01:32:11.729 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 21 01:32:11 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mgr-x[31598]: self._connections.run(self.expiration_interval) 2024-09-21T01:32:11.729 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 21 01:32:11 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mgr-x[31598]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T01:32:11.729 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 21 01:32:11 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mgr-x[31598]: self._run(expiration_interval) 2024-09-21T01:32:11.729 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 21 01:32:11 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mgr-x[31598]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T01:32:11.729 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 21 01:32:11 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mgr-x[31598]: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T01:32:11.729 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 21 01:32:11 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mgr-x[31598]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T01:32:11.729 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 21 01:32:11 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mgr-x[31598]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T01:32:11.729 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 21 01:32:11 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mgr-x[31598]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T01:32:11.729 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 21 01:32:11 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mgr-x[31598]: s = self.context.wrap_socket( 2024-09-21T01:32:11.730 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 21 01:32:11 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mgr-x[31598]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T01:32:11.730 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 21 01:32:11 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mgr-x[31598]: return self.sslsocket_class._create( 2024-09-21T01:32:11.730 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 21 01:32:11 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mgr-x[31598]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T01:32:11.730 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 21 01:32:11 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mgr-x[31598]: self.do_handshake() 2024-09-21T01:32:11.730 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 21 01:32:11 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mgr-x[31598]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T01:32:11.730 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 21 01:32:11 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mgr-x[31598]: self._sslobj.do_handshake() 2024-09-21T01:32:11.730 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 21 01:32:11 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mgr-x[31598]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T01:32:11.730 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 21 01:32:11 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mgr-x[31598]: 2024-09-21T01:32:11.731 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout { 2024-09-21T01:32:11.731 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-09-21T01:32:11.731 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-21T01:32:11.731 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout } 2024-09-21T01:32:11.731 INFO:teuthology.orchestra.run.smithi083.stdout:mgr epoch 9 is available 2024-09-21T01:32:11.731 INFO:teuthology.orchestra.run.smithi083.stdout:Using certmgr to generate dashboard self-signed certificate... 2024-09-21T01:32:12.424 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:12 smithi083 ceph-mon[31370]: [21/Sep/2024:01:32:11] ENGINE Bus STARTING 2024-09-21T01:32:12.424 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:12 smithi083 ceph-mon[31370]: [21/Sep/2024:01:32:11] ENGINE Serving on https://172.21.15.83:7150 2024-09-21T01:32:12.424 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:12 smithi083 ceph-mon[31370]: [21/Sep/2024:01:32:11] ENGINE Error in HTTPServer.serve 2024-09-21T01:32:12.424 INFO:journalctl@ceph.mon.a.smithi083.stdout: Traceback (most recent call last): 2024-09-21T01:32:12.424 INFO:journalctl@ceph.mon.a.smithi083.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T01:32:12.424 INFO:journalctl@ceph.mon.a.smithi083.stdout: self._connections.run(self.expiration_interval) 2024-09-21T01:32:12.425 INFO:journalctl@ceph.mon.a.smithi083.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T01:32:12.425 INFO:journalctl@ceph.mon.a.smithi083.stdout: self._run(expiration_interval) 2024-09-21T01:32:12.425 INFO:journalctl@ceph.mon.a.smithi083.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T01:32:12.425 INFO:journalctl@ceph.mon.a.smithi083.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T01:32:12.425 INFO:journalctl@ceph.mon.a.smithi083.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T01:32:12.425 INFO:journalctl@ceph.mon.a.smithi083.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T01:32:12.425 INFO:journalctl@ceph.mon.a.smithi083.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T01:32:12.425 INFO:journalctl@ceph.mon.a.smithi083.stdout: s = self.context.wrap_socket( 2024-09-21T01:32:12.425 INFO:journalctl@ceph.mon.a.smithi083.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T01:32:12.425 INFO:journalctl@ceph.mon.a.smithi083.stdout: return self.sslsocket_class._create( 2024-09-21T01:32:12.425 INFO:journalctl@ceph.mon.a.smithi083.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T01:32:12.425 INFO:journalctl@ceph.mon.a.smithi083.stdout: self.do_handshake() 2024-09-21T01:32:12.425 INFO:journalctl@ceph.mon.a.smithi083.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T01:32:12.426 INFO:journalctl@ceph.mon.a.smithi083.stdout: self._sslobj.do_handshake() 2024-09-21T01:32:12.426 INFO:journalctl@ceph.mon.a.smithi083.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T01:32:12.426 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:12 smithi083 ceph-mon[31370]: [21/Sep/2024:01:32:11] ENGINE Serving on http://172.21.15.83:8765 2024-09-21T01:32:12.426 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:12 smithi083 ceph-mon[31370]: [21/Sep/2024:01:32:11] ENGINE Bus STARTED 2024-09-21T01:32:12.426 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:12 smithi083 ceph-mon[31370]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' 2024-09-21T01:32:13.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:13 smithi083 ceph-mon[31370]: mgrmap e12: x(active, since 2s) 2024-09-21T01:32:13.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:13 smithi083 ceph-mon[31370]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' 2024-09-21T01:32:13.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:13 smithi083 ceph-mon[31370]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "orch certmgr generate-certificates", "module_name": "dashboard", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:32:14.151 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout {"cert": "-----BEGIN CERTIFICATE-----\nMIIFEDCCAvigAwIBAgIUKvrXjZvETKUkmVLfRUu2HpeH9YMwDQYJKoZIhvcNAQEL\nBQAwFzEVMBMGA1UEAwwMY2VwaGFkbS1yb290MB4XDTI0MDkyMTAxMzIxM1oXDTM0\nMDkyMjAxMzIxM1owFzEVMBMGA1UEAwwMMTcyLjIxLjE1LjgzMIICIjANBgkqhkiG\n9w0BAQEFAAOCAg8AMIICCgKCAgEAs8ms+y0ps+uu1QU9zKlOG9DywRvb8Zp/Ds5D\n+LuNDvRlCHr5WXQBuvxlZG2u5tQMWdlumZ1jZUnUIcilR5tpWZntWxxtiXJ+FpbE\nnEnLgYDjR31LdW9yi+M2HynMo9HegH/yAIHA1i4vMA4GMoD59BkY5UTbTFPNFL09\n87NBKrZ8806p0fD0kjsmb5A1mn63q6vVBDMkLgQRWQRiwbocHXxZbfwfIrFrX1yf\npt+HC5Xm3nWEDsRIB7sYiMufiA43qf14vcURqRcxiWDw4N3PIf3wukaaUgE972b+\nqJht1inhGSROhdvSO9koqb877S4WDXmSQVIdsi1SusE/6TIM33Zy8hqxbT9cwU6X\nbYuMAgoq08mY103cE1tF5X6tmoE4xVTDzMeBjKJ+oYT8+nIiLpwMg8bMHudNIkga\nCL9/PcqBYsBVjV96Gp8PtSAU8ZzxDNSlhzgq53JVpOlUAa8Twre94Hi35IOsYH6O\nFP1nKGKgn2HBpz4cqCdVIdfg2PC5LTWraUZ4oEreP68b6KPDPcgo4WpNZk1Pg/cq\nJ1+uYV6l6Box6q7pJklbEwnWhm/hYPBnyHc0CkWpY6CcmyWJxY7wfTnV/wBiRnAN\n5iERBmnMGnqmoJa9Fz07M4EtN3Pn0+TLoXKviF5BvhVT9qndRzlX0RaqFBXTn7hY\nNMPxwq0CAwEAAaNUMFIwQgYDVR0RBDswOYIec21pdGhpMDgzLmZyb250LnNlcGlh\nLmNlcGguY29tghFkYXNoYm9hcmRfc2VydmVyc4cErBUPUzAMBgNVHRMBAf8EAjAA\nMA0GCSqGSIb3DQEBCwUAA4ICAQAccUIn+vMB+qoYfFqsgfsi8JzixrQ5WIEL2jA/\noUlb5tcqRUeBPf31r/SKd2vVZdNpVHS+IebV/WPWpMum1eIVP3VdmBtTyYFTAr4q\nUKDTsQ7PfePU4UJyZp0cChjhIuYl2lNtjCOkymIM0x3VQIupNadEteHUbyOnoQT9\n6MyNN1yF1eUxxEuGJr1uvf9l37dXVrcJyyzjyv3Biu06T52G29GcRt9naD25UsFI\n21YsV0goWb+IbS/B4eOy9kLJgD9tPMpNBmouf4xLpJz4a3+2aTjaXZIM3xQqaAqo\nPxKfm2RJhQ1mTwhd8Wq1MyxDvERSS6Q/F5fRjhwAgko0UNkiZc8VVT66+Pl5EcBZ\nqi2Lda7IdbKzsvfh0lLm21APyC1EITUleKx6s/7Q+PgR70mGAfuWk7tFb9614C5F\nYo4FeY8TsIZlY9v7+5P5wY+jbW7ndXlvUa0rSjXImy4RBDECvcNx0pJoZYuYqhVu\nYGCvD0MS6cJGa7cQwaTkxWNgg0HmMhJ1W96M1h2vSSZ+XY6eALLmcKY9OCcgz2q2\ndHkJX8sxADsg2DyuiTc//9QvSMtACIWKi/itl16CHaAgUir1wfKD+HjE3U7lLN3L\nHIvLepVfr5xofWnzBQYkpzSSWonZs2KN+anQKBAJT6/JOcB6GRPu/yY3n84FLoLe\nkIIdnQ==\n-----END CERTIFICATE-----\n", "key": "-----BEGIN RSA PRIVATE KEY-----\nMIIJKAIBAAKCAgEAs8ms+y0ps+uu1QU9zKlOG9DywRvb8Zp/Ds5D+LuNDvRlCHr5\nWXQBuvxlZG2u5tQMWdlumZ1jZUnUIcilR5tpWZntWxxtiXJ+FpbEnEnLgYDjR31L\ndW9yi+M2HynMo9HegH/yAIHA1i4vMA4GMoD59BkY5UTbTFPNFL0987NBKrZ8806p\n0fD0kjsmb5A1mn63q6vVBDMkLgQRWQRiwbocHXxZbfwfIrFrX1yfpt+HC5Xm3nWE\nDsRIB7sYiMufiA43qf14vcURqRcxiWDw4N3PIf3wukaaUgE972b+qJht1inhGSRO\nhdvSO9koqb877S4WDXmSQVIdsi1SusE/6TIM33Zy8hqxbT9cwU6XbYuMAgoq08mY\n103cE1tF5X6tmoE4xVTDzMeBjKJ+oYT8+nIiLpwMg8bMHudNIkgaCL9/PcqBYsBV\njV96Gp8PtSAU8ZzxDNSlhzgq53JVpOlUAa8Twre94Hi35IOsYH6OFP1nKGKgn2HB\npz4cqCdVIdfg2PC5LTWraUZ4oEreP68b6KPDPcgo4WpNZk1Pg/cqJ1+uYV6l6Box\n6q7pJklbEwnWhm/hYPBnyHc0CkWpY6CcmyWJxY7wfTnV/wBiRnAN5iERBmnMGnqm\noJa9Fz07M4EtN3Pn0+TLoXKviF5BvhVT9qndRzlX0RaqFBXTn7hYNMPxwq0CAwEA\nAQKCAgAZNw5PNgDUzpe5IaCOvSoKxa3ePpGE25W5Vl17G5bHg6hN3a1uCdKaTn7L\n7IQstI285j1YRxYjJQ0e5dykY9wNKIT9E8obDlc3xNJzVvg3RAPcSWrVYBmRG/9B\ntKOSUENkA03GG2yXvWd51mWxHJyxyvlOYm9dT52CLJ5tOPVJT8nLd/tiSeiLP8d+\nuxuBfQc2iQV5rtCCsahbMz3EjN0Xl5KVVdhqDbcQ61Uq2su+aLo19gZc6dNuXiOt\nP92yf8f3y+hsuSBmdi3I5jMyXnmH+20ROwi2upzcoDXUIHi7IimDVK+8n11nbmgB\nEqSNebq3DhdgmOs4S5oAPk0/3/ik/EYhtPIfGK0BXqxSlqK4vCWbaZthZAw6kzB8\nDIy/WM0O27WmY9jZFIX4mLRKMlfpoalJ8Lf644yHJKUn0V0XEUyPclF6kDRt34mr\n1uhZtnIwtGpzsp5861BvyiXP45s9+wmDUYzPcScvzZKi2cXxGcG4MYo9GljpuPaw\nuVscfkeB5IY1uGKa/N7rXCgkQ6tifZxNZ46te931Z0dde3ycpkZ+YHbEpsVOEJ05\ncUDx9UtPuWgrZL4p+6LkEfxRBnlalk/MCGUmVHM2xMcC0Irw4qme1D6ic9vt0Kjo\ngrd2BQ7ufR4HsO8oqQSx3q5FlAzF4CV0o9Qd3uEplIOzozxe4wKCAQEA54KvW0lZ\nlNnZ3wAeKcNPmHCm5evKrmsTpnkHJK+RPb3A89Kspbn1vDeOn4CdVDBYkkq8iL67\nLFENLo3PLrVC4/yJBe+JwCiXbxgKifrqskwNWUzISF1Rr1zo4d8AEs3KWu+5xuKE\nNbdFymHW2gcTbmaavy8nYMFD4tVsXAf9pzGGZqpf6E8kPiulVS+SbZCLKDdFjdoI\nrL8jAF1/4LYrP3caSna3A/613pUghv8IIwBkMB8G4CdvlZVsLP8hrdrVspL2FRBI\nq/MiMgCAqT+fwHeXS0UEvTZW2xzHrAVxnhHcfWodX8qp3lavR8hsEiIAA+K37gra\nAb+2EiQAdTTvRwKCAQEAxs5WdvDerwGvK5Xh4jpZmcE0zqdTaQP/UZAFBdf+VJWO\nMiofGf0KA8HiETrxTIKG6LaF+LCHUwCTPGHOvUjqqnsU44YWvMy9m4QZQNsbPXqB\nfbzQdBujf4Etey20YS6ZneUpKGUlwtHxTwtoVhJIA8lxQ4syxLi8L25vgToiHhEt\n2OcLReTgCc289HygFHqwtAC7YR7ZJhZTFlWJ6FSUA3A80OkyJgzFZS5OdukP3HYe\njqCbPZLbj2zdJiYA+PJvI5XuoroiLucQvxFuq+vuj7+BZHQ1U8yVyAzerRdgGyHq\nwft8cYLFvAbGBAFgDdPRVAeMkZadd76eHDRInQBAawKCAQA6R4nBXzuv3w+btbni\nJYq6A1Hge3UwZ0AxHjKQJ6pWcphKSPSxW5ji4tGCkawJb4o8eZfwjKMtytGYsJZB\nWdwW7JHJ7r0spItKqjCs/39plv+dRVj97pALp0Xw5mRsV2Xjcom/6XIC27oz8mFV\nzYY0upumGUa+cqiWR8fZeyF9n1gILEesgY/MHsymHy2ra0G8w/08cnDQm+VByEfS\n18kXVvJFYJE97jb2a3Aey8DOnuCZxJXEg+jxLQZoZWmjDH3TUG+mac0BjFlFYR8C\nfEPI/dIWXq+MuksvKZWSVmR9uF1bLQVsAea1U/kYBvo9rlV2pPJMeGrdGdfJxUpg\nNw0tAoIBAQC4lDSFA8fMdmTbs7HgJ8quzUopIAN6OgLgCDYRoeN5Rs2Z16++oked\nC3LICpCkN3/oKiaiqctKjfslka2v4jY2CEZxpDoSGolkDTahF4zn/IijZB2p30ti\ng13lwp55qBlqFqyq25Y+lktT10SMvTZthacKTf/Z06as5vzR31Zz0gFeI808nG5B\ny+nGmLrLqMnMpe1TE6ALE6ka0FpVAcnWk2tzjz9HQo43DdI95s8aIfTm+UiI14PQ\nWwPMenZmrDfxsy+3l9dK8q+Cpj25kziP7/7DdH1ai1T5QrGvxUcuicP7THHStda+\nZw+MAnba/7GXMdcaCNu0pJ8JkqVkVyp3AoIBAGCZ0TjboI5kpn7sh7d8FNkzAEDT\nY6/K8Orpt9aq95fVV0dXxOC4VVAe5IbAkiSl+tYWRwRBkBhvnCI7KhJcBzWqdTMw\na89/gRTzFbtTj9rohP3jggvyg9iz9BdHq80a2EookEe3VIoeUq8AJDEqw2WZc70c\nQMIUNo8ZmmxrQcdIpiBIdiA1Kmzf3G3Avs6oYyDD+SYRkrmIjDkaGisQKdGYxes0\nyo2t6RpXKwDLkEwYlePmbi5U+apiphsHvT5p2WfYjEQcIUHbenM6Oc+EIZ1pLGjs\nuDjiK9+BrVoafmllrOC8z7f/U+7QM+4aNJU6hDNqJ0rMhIxC4BdcX5T1Dmg=\n-----END RSA PRIVATE KEY-----\n"} 2024-09-21T01:32:15.453 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout SSL certificate updated 2024-09-21T01:32:15.852 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:15 smithi083 ceph-mon[31370]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "dashboard set-ssl-certificate", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:32:15.853 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:15 smithi083 ceph-mon[31370]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' 2024-09-21T01:32:16.634 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout SSL certificate key updated 2024-09-21T01:32:16.634 INFO:teuthology.orchestra.run.smithi083.stdout:Creating initial admin user... 2024-09-21T01:32:17.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:17 smithi083 ceph-mon[31370]: from='client.14168 -' entity='client.admin' cmd=[{"prefix": "dashboard set-ssl-certificate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:32:17.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:17 smithi083 ceph-mon[31370]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' 2024-09-21T01:32:18.007 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$lAqxvEZou.VZ8gxT2CQXauhWBgQtgJEAca8IDqfhzR6yp48IeB1XW", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1726882337, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-09-21T01:32:18.007 INFO:teuthology.orchestra.run.smithi083.stdout:Fetching dashboard port number... 2024-09-21T01:32:18.585 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:18 smithi083 ceph-mon[31370]: from='client.14170 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:32:18.585 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:18 smithi083 ceph-mon[31370]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' 2024-09-21T01:32:19.190 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stdout 8443 2024-09-21T01:32:19.199 INFO:teuthology.orchestra.run.smithi083.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-21T01:32:19.200 INFO:teuthology.orchestra.run.smithi083.stdout:systemctl: stdout disabled 2024-09-21T01:32:19.206 INFO:teuthology.orchestra.run.smithi083.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-21T01:32:19.207 INFO:teuthology.orchestra.run.smithi083.stdout:systemctl: stdout inactive 2024-09-21T01:32:19.207 INFO:teuthology.orchestra.run.smithi083.stdout:firewalld.service is not enabled 2024-09-21T01:32:19.207 INFO:teuthology.orchestra.run.smithi083.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-09-21T01:32:19.208 INFO:teuthology.orchestra.run.smithi083.stdout:Ceph Dashboard is now available at: 2024-09-21T01:32:19.208 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T01:32:19.209 INFO:teuthology.orchestra.run.smithi083.stdout: URL: https://smithi083.front.sepia.ceph.com:8443/ 2024-09-21T01:32:19.209 INFO:teuthology.orchestra.run.smithi083.stdout: User: admin 2024-09-21T01:32:19.209 INFO:teuthology.orchestra.run.smithi083.stdout: Password: rsix6cpxpq 2024-09-21T01:32:19.209 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T01:32:19.209 INFO:teuthology.orchestra.run.smithi083.stdout:Saving cluster configuration to /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/config directory 2024-09-21T01:32:19.803 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:19 smithi083 ceph-mon[31370]: from='client.? 172.21.15.83:0/1946140455' entity='client.admin' cmd={"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} : dispatch 2024-09-21T01:32:20.479 INFO:teuthology.orchestra.run.smithi083.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-09-21T01:32:20.479 INFO:teuthology.orchestra.run.smithi083.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-09-21T01:32:20.479 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T01:32:20.479 INFO:teuthology.orchestra.run.smithi083.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-09-21T01:32:20.479 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T01:32:20.479 INFO:teuthology.orchestra.run.smithi083.stdout:Or, if you are only running a single cluster on this host: 2024-09-21T01:32:20.480 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T01:32:20.480 INFO:teuthology.orchestra.run.smithi083.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-09-21T01:32:20.480 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T01:32:20.480 INFO:teuthology.orchestra.run.smithi083.stdout:Please consider enabling telemetry to help improve Ceph: 2024-09-21T01:32:20.480 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T01:32:20.480 INFO:teuthology.orchestra.run.smithi083.stdout: ceph telemetry on 2024-09-21T01:32:20.480 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T01:32:20.480 INFO:teuthology.orchestra.run.smithi083.stdout:For more information see: 2024-09-21T01:32:20.480 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T01:32:20.480 INFO:teuthology.orchestra.run.smithi083.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-09-21T01:32:20.480 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T01:32:20.480 INFO:teuthology.orchestra.run.smithi083.stdout:Bootstrap complete. 2024-09-21T01:32:20.517 INFO:tasks.cephadm:Fetching config... 2024-09-21T01:32:20.517 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-09-21T01:32:20.518 DEBUG:teuthology.orchestra.run.smithi083:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-09-21T01:32:20.533 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-09-21T01:32:20.533 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-09-21T01:32:20.533 DEBUG:teuthology.orchestra.run.smithi083:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-09-21T01:32:20.588 INFO:tasks.cephadm:Fetching mon keyring... 2024-09-21T01:32:20.588 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-09-21T01:32:20.589 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd if=/var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/keyring of=/dev/stdout 2024-09-21T01:32:20.653 INFO:tasks.cephadm:Fetching pub ssh key... 2024-09-21T01:32:20.654 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-09-21T01:32:20.654 DEBUG:teuthology.orchestra.run.smithi083:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-09-21T01:32:20.709 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-09-21T01:32:20.710 DEBUG:teuthology.orchestra.run.smithi083:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDmcVojWFQRL3aIMbWRtF3KimCpnEeQGbEsvk4VDn73zSYZzHTmCz8YMQZuqc1NqEjXizIB9a0AW2NmW9I9WdhPtWJ8+cD0DsKZo1mImWlGEmW9MQxyEUDx6jZKz+sYMJVciOei46xVyQ3D6rflPe6m5o9i4EgKWt3cbCrWkPxsQG1Hx4VPkrJuJ82kCWrnRHy5FnpKpKIPJPXJ3FqZmkDbBVP6tdo7evNgxnmrY+ZNzBGjOpcIIqSGjYET9Qxe2czqcpZ15D+gG0Ngiyhr3oWKOyv9oWw6C8OA0o4MX5FKHKiLjB1PIHJkPvn/AqwmAE2seVOtMuq32yotFNhxQsWAx1tVk5J0BfCiqap89FYLF2GDVyjDxbM+T/PqOgHuGb3MyrbYzwNyBwQ0rx5BQoWFFTUIkfXhGD30JOo/PqD51HZVzhWfS14Sbk/f/SUMqlOmuUieVqAdgW76XlWKaJQq06VMo+T1i5lRa04zByJOCDr9DQqOmdNsduhiKGPGNu0= ceph-f7697ecc-77b8-11ef-baf5-efdc52797490' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-21T01:32:20.783 INFO:teuthology.orchestra.run.smithi083.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDmcVojWFQRL3aIMbWRtF3KimCpnEeQGbEsvk4VDn73zSYZzHTmCz8YMQZuqc1NqEjXizIB9a0AW2NmW9I9WdhPtWJ8+cD0DsKZo1mImWlGEmW9MQxyEUDx6jZKz+sYMJVciOei46xVyQ3D6rflPe6m5o9i4EgKWt3cbCrWkPxsQG1Hx4VPkrJuJ82kCWrnRHy5FnpKpKIPJPXJ3FqZmkDbBVP6tdo7evNgxnmrY+ZNzBGjOpcIIqSGjYET9Qxe2czqcpZ15D+gG0Ngiyhr3oWKOyv9oWw6C8OA0o4MX5FKHKiLjB1PIHJkPvn/AqwmAE2seVOtMuq32yotFNhxQsWAx1tVk5J0BfCiqap89FYLF2GDVyjDxbM+T/PqOgHuGb3MyrbYzwNyBwQ0rx5BQoWFFTUIkfXhGD30JOo/PqD51HZVzhWfS14Sbk/f/SUMqlOmuUieVqAdgW76XlWKaJQq06VMo+T1i5lRa04zByJOCDr9DQqOmdNsduhiKGPGNu0= ceph-f7697ecc-77b8-11ef-baf5-efdc52797490 2024-09-21T01:32:20.794 DEBUG:teuthology.orchestra.run.smithi119:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDmcVojWFQRL3aIMbWRtF3KimCpnEeQGbEsvk4VDn73zSYZzHTmCz8YMQZuqc1NqEjXizIB9a0AW2NmW9I9WdhPtWJ8+cD0DsKZo1mImWlGEmW9MQxyEUDx6jZKz+sYMJVciOei46xVyQ3D6rflPe6m5o9i4EgKWt3cbCrWkPxsQG1Hx4VPkrJuJ82kCWrnRHy5FnpKpKIPJPXJ3FqZmkDbBVP6tdo7evNgxnmrY+ZNzBGjOpcIIqSGjYET9Qxe2czqcpZ15D+gG0Ngiyhr3oWKOyv9oWw6C8OA0o4MX5FKHKiLjB1PIHJkPvn/AqwmAE2seVOtMuq32yotFNhxQsWAx1tVk5J0BfCiqap89FYLF2GDVyjDxbM+T/PqOgHuGb3MyrbYzwNyBwQ0rx5BQoWFFTUIkfXhGD30JOo/PqD51HZVzhWfS14Sbk/f/SUMqlOmuUieVqAdgW76XlWKaJQq06VMo+T1i5lRa04zByJOCDr9DQqOmdNsduhiKGPGNu0= ceph-f7697ecc-77b8-11ef-baf5-efdc52797490' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-21T01:32:20.845 INFO:teuthology.orchestra.run.smithi119.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDmcVojWFQRL3aIMbWRtF3KimCpnEeQGbEsvk4VDn73zSYZzHTmCz8YMQZuqc1NqEjXizIB9a0AW2NmW9I9WdhPtWJ8+cD0DsKZo1mImWlGEmW9MQxyEUDx6jZKz+sYMJVciOei46xVyQ3D6rflPe6m5o9i4EgKWt3cbCrWkPxsQG1Hx4VPkrJuJ82kCWrnRHy5FnpKpKIPJPXJ3FqZmkDbBVP6tdo7evNgxnmrY+ZNzBGjOpcIIqSGjYET9Qxe2czqcpZ15D+gG0Ngiyhr3oWKOyv9oWw6C8OA0o4MX5FKHKiLjB1PIHJkPvn/AqwmAE2seVOtMuq32yotFNhxQsWAx1tVk5J0BfCiqap89FYLF2GDVyjDxbM+T/PqOgHuGb3MyrbYzwNyBwQ0rx5BQoWFFTUIkfXhGD30JOo/PqD51HZVzhWfS14Sbk/f/SUMqlOmuUieVqAdgW76XlWKaJQq06VMo+T1i5lRa04zByJOCDr9DQqOmdNsduhiKGPGNu0= ceph-f7697ecc-77b8-11ef-baf5-efdc52797490 2024-09-21T01:32:20.858 DEBUG:teuthology.orchestra.run.smithi142:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDmcVojWFQRL3aIMbWRtF3KimCpnEeQGbEsvk4VDn73zSYZzHTmCz8YMQZuqc1NqEjXizIB9a0AW2NmW9I9WdhPtWJ8+cD0DsKZo1mImWlGEmW9MQxyEUDx6jZKz+sYMJVciOei46xVyQ3D6rflPe6m5o9i4EgKWt3cbCrWkPxsQG1Hx4VPkrJuJ82kCWrnRHy5FnpKpKIPJPXJ3FqZmkDbBVP6tdo7evNgxnmrY+ZNzBGjOpcIIqSGjYET9Qxe2czqcpZ15D+gG0Ngiyhr3oWKOyv9oWw6C8OA0o4MX5FKHKiLjB1PIHJkPvn/AqwmAE2seVOtMuq32yotFNhxQsWAx1tVk5J0BfCiqap89FYLF2GDVyjDxbM+T/PqOgHuGb3MyrbYzwNyBwQ0rx5BQoWFFTUIkfXhGD30JOo/PqD51HZVzhWfS14Sbk/f/SUMqlOmuUieVqAdgW76XlWKaJQq06VMo+T1i5lRa04zByJOCDr9DQqOmdNsduhiKGPGNu0= ceph-f7697ecc-77b8-11ef-baf5-efdc52797490' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-21T01:32:20.903 INFO:teuthology.orchestra.run.smithi142.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDmcVojWFQRL3aIMbWRtF3KimCpnEeQGbEsvk4VDn73zSYZzHTmCz8YMQZuqc1NqEjXizIB9a0AW2NmW9I9WdhPtWJ8+cD0DsKZo1mImWlGEmW9MQxyEUDx6jZKz+sYMJVciOei46xVyQ3D6rflPe6m5o9i4EgKWt3cbCrWkPxsQG1Hx4VPkrJuJ82kCWrnRHy5FnpKpKIPJPXJ3FqZmkDbBVP6tdo7evNgxnmrY+ZNzBGjOpcIIqSGjYET9Qxe2czqcpZ15D+gG0Ngiyhr3oWKOyv9oWw6C8OA0o4MX5FKHKiLjB1PIHJkPvn/AqwmAE2seVOtMuq32yotFNhxQsWAx1tVk5J0BfCiqap89FYLF2GDVyjDxbM+T/PqOgHuGb3MyrbYzwNyBwQ0rx5BQoWFFTUIkfXhGD30JOo/PqD51HZVzhWfS14Sbk/f/SUMqlOmuUieVqAdgW76XlWKaJQq06VMo+T1i5lRa04zByJOCDr9DQqOmdNsduhiKGPGNu0= ceph-f7697ecc-77b8-11ef-baf5-efdc52797490 2024-09-21T01:32:20.915 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-09-21T01:32:21.165 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:32:21.227 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:20 smithi083 ceph-mon[31370]: from='client.? 172.21.15.83:0/3305441507' entity='client.admin' 2024-09-21T01:32:22.452 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-09-21T01:32:22.452 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-09-21T01:32:22.891 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:32:22.991 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:22 smithi083 ceph-mon[31370]: from='client.? 172.21.15.83:0/3487987470' entity='client.admin' 2024-09-21T01:32:22.991 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:22 smithi083 ceph-mon[31370]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' 2024-09-21T01:32:22.991 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:22 smithi083 ceph-mon[31370]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' 2024-09-21T01:32:22.991 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:22 smithi083 ceph-mon[31370]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi083", "name": "osd_memory_target"} : dispatch 2024-09-21T01:32:24.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:23 smithi083 ceph-mon[31370]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' 2024-09-21T01:32:24.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:23 smithi083 ceph-mon[31370]: mgrmap e13: x(active, since 12s) 2024-09-21T01:32:24.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:23 smithi083 ceph-mon[31370]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:32:24.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:23 smithi083 ceph-mon[31370]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' 2024-09-21T01:32:24.800 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi119 2024-09-21T01:32:24.800 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-21T01:32:24.800 DEBUG:teuthology.orchestra.run.smithi119:> dd of=/etc/ceph/ceph.conf 2024-09-21T01:32:24.818 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-21T01:32:24.819 DEBUG:teuthology.orchestra.run.smithi119:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-21T01:32:24.876 INFO:tasks.cephadm:Adding host smithi119 to orchestrator... 2024-09-21T01:32:24.877 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph orch host add smithi119 2024-09-21T01:32:25.229 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:32:25.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:25 smithi083 ceph-mon[31370]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:32:25.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:25 smithi083 ceph-mon[31370]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' 2024-09-21T01:32:25.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:25 smithi083 ceph-mon[31370]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:32:25.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:25 smithi083 ceph-mon[31370]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:32:25.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:25 smithi083 ceph-mon[31370]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:32:25.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:25 smithi083 ceph-mon[31370]: Updating smithi083:/etc/ceph/ceph.conf 2024-09-21T01:32:25.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:25 smithi083 ceph-mon[31370]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' 2024-09-21T01:32:25.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:25 smithi083 ceph-mon[31370]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' 2024-09-21T01:32:25.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:25 smithi083 ceph-mon[31370]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' 2024-09-21T01:32:26.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:26 smithi083 ceph-mon[31370]: Updating smithi083:/var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T01:32:26.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:26 smithi083 ceph-mon[31370]: Updating smithi083:/etc/ceph/ceph.client.admin.keyring 2024-09-21T01:32:26.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:26 smithi083 ceph-mon[31370]: Updating smithi083:/var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T01:32:27.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:27 smithi083 ceph-mon[31370]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi119", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:32:28.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:28 smithi083 ceph-mon[31370]: Deploying cephadm binary to smithi119 2024-09-21T01:32:28.879 INFO:teuthology.orchestra.run.smithi083.stdout:Added host 'smithi119' with addr '172.21.15.119' 2024-09-21T01:32:29.469 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph orch host ls --format=json 2024-09-21T01:32:29.708 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:32:30.119 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:29 smithi083 ceph-mon[31370]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' 2024-09-21T01:32:30.119 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:29 smithi083 ceph-mon[31370]: Added host smithi119 2024-09-21T01:32:30.120 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:29 smithi083 ceph-mon[31370]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:32:30.120 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:29 smithi083 ceph-mon[31370]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' 2024-09-21T01:32:30.120 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:29 smithi083 ceph-mon[31370]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' 2024-09-21T01:32:30.319 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T01:32:30.319 INFO:teuthology.orchestra.run.smithi083.stdout:[{"addr": "172.21.15.83", "hostname": "smithi083", "labels": [], "status": ""}, {"addr": "172.21.15.119", "hostname": "smithi119", "labels": [], "status": ""}] 2024-09-21T01:32:31.116 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi142 2024-09-21T01:32:31.117 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-09-21T01:32:31.117 DEBUG:teuthology.orchestra.run.smithi142:> dd of=/etc/ceph/ceph.conf 2024-09-21T01:32:31.136 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-09-21T01:32:31.136 DEBUG:teuthology.orchestra.run.smithi142:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-21T01:32:31.195 INFO:tasks.cephadm:Adding host smithi142 to orchestrator... 2024-09-21T01:32:31.195 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph orch host add smithi142 2024-09-21T01:32:31.434 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:32:31.554 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:31 smithi083 ceph-mon[31370]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:32:31.554 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:31 smithi083 ceph-mon[31370]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' 2024-09-21T01:32:31.554 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:31 smithi083 ceph-mon[31370]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T01:32:32.554 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:32 smithi083 ceph-mon[31370]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi142", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:32:33.554 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:33 smithi083 ceph-mon[31370]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:32:33.554 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:33 smithi083 ceph-mon[31370]: Deploying cephadm binary to smithi142 2024-09-21T01:32:33.554 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:33 smithi083 ceph-mon[31370]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' 2024-09-21T01:32:33.554 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:33 smithi083 ceph-mon[31370]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' 2024-09-21T01:32:33.554 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:33 smithi083 ceph-mon[31370]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' 2024-09-21T01:32:33.554 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:33 smithi083 ceph-mon[31370]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' 2024-09-21T01:32:33.554 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:33 smithi083 ceph-mon[31370]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi119", "name": "osd_memory_target"} : dispatch 2024-09-21T01:32:33.554 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:33 smithi083 ceph-mon[31370]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:32:33.555 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:33 smithi083 ceph-mon[31370]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:32:35.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:34 smithi083 ceph-mon[31370]: Updating smithi119:/etc/ceph/ceph.conf 2024-09-21T01:32:35.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:34 smithi083 ceph-mon[31370]: Updating smithi119:/var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T01:32:35.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:34 smithi083 ceph-mon[31370]: Updating smithi119:/etc/ceph/ceph.client.admin.keyring 2024-09-21T01:32:35.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:34 smithi083 ceph-mon[31370]: Updating smithi119:/var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T01:32:35.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:34 smithi083 ceph-mon[31370]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' 2024-09-21T01:32:35.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:34 smithi083 ceph-mon[31370]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' 2024-09-21T01:32:35.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:34 smithi083 ceph-mon[31370]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' 2024-09-21T01:32:35.070 INFO:teuthology.orchestra.run.smithi083.stdout:Added host 'smithi142' with addr '172.21.15.142' 2024-09-21T01:32:35.657 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph orch host ls --format=json 2024-09-21T01:32:35.894 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:32:36.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:36 smithi083 ceph-mon[31370]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:32:36.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:36 smithi083 ceph-mon[31370]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' 2024-09-21T01:32:36.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:36 smithi083 ceph-mon[31370]: Added host smithi142 2024-09-21T01:32:36.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:36 smithi083 ceph-mon[31370]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:32:36.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:36 smithi083 ceph-mon[31370]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' 2024-09-21T01:32:36.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:36 smithi083 ceph-mon[31370]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' 2024-09-21T01:32:36.524 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T01:32:36.524 INFO:teuthology.orchestra.run.smithi083.stdout:[{"addr": "172.21.15.83", "hostname": "smithi083", "labels": [], "status": ""}, {"addr": "172.21.15.119", "hostname": "smithi119", "labels": [], "status": ""}, {"addr": "172.21.15.142", "hostname": "smithi142", "labels": [], "status": ""}] 2024-09-21T01:32:37.115 INFO:tasks.cephadm:Setting crush tunables to default 2024-09-21T01:32:37.115 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph osd crush tunables default 2024-09-21T01:32:37.355 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:32:37.773 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:37 smithi083 ceph-mon[31370]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:32:37.773 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:37 smithi083 ceph-mon[31370]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' 2024-09-21T01:32:37.773 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:37 smithi083 ceph-mon[31370]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T01:32:38.460 INFO:teuthology.orchestra.run.smithi083.stderr:adjusted tunables profile to default 2024-09-21T01:32:38.804 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:38 smithi083 ceph-mon[31370]: from='client.? 172.21.15.83:0/64277162' entity='client.admin' cmd={"prefix": "osd crush tunables", "profile": "default"} : dispatch 2024-09-21T01:32:39.150 INFO:tasks.cephadm:Adding mon.a on smithi083 2024-09-21T01:32:39.150 INFO:tasks.cephadm:Adding mon.b on smithi119 2024-09-21T01:32:39.150 INFO:tasks.cephadm:Adding mon.c on smithi142 2024-09-21T01:32:39.150 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph orch apply mon '3;smithi083:172.21.15.83=a;smithi119:172.21.15.119=b;smithi142:172.21.15.142=c' 2024-09-21T01:32:39.402 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T01:32:39.804 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:39 smithi083 ceph-mon[31370]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:32:39.804 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:39 smithi083 ceph-mon[31370]: from='client.? 172.21.15.83:0/64277162' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-21T01:32:39.804 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:39 smithi083 ceph-mon[31370]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T01:32:39.804 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:39 smithi083 ceph-mon[31370]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' 2024-09-21T01:32:39.804 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:39 smithi083 ceph-mon[31370]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' 2024-09-21T01:32:39.804 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:39 smithi083 ceph-mon[31370]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' 2024-09-21T01:32:39.804 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:39 smithi083 ceph-mon[31370]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' 2024-09-21T01:32:39.804 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:39 smithi083 ceph-mon[31370]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi142", "name": "osd_memory_target"} : dispatch 2024-09-21T01:32:39.804 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:39 smithi083 ceph-mon[31370]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:32:39.804 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:39 smithi083 ceph-mon[31370]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:32:39.804 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:39 smithi083 ceph-mon[31370]: Updating smithi142:/etc/ceph/ceph.conf 2024-09-21T01:32:40.074 INFO:teuthology.orchestra.run.smithi142.stdout:Scheduled mon update... 2024-09-21T01:32:40.744 DEBUG:teuthology.orchestra.run.smithi119:mon.b> sudo journalctl -f -n 0 -u ceph-f7697ecc-77b8-11ef-baf5-efdc52797490@mon.b.service 2024-09-21T01:32:40.747 DEBUG:teuthology.orchestra.run.smithi142:mon.c> sudo journalctl -f -n 0 -u ceph-f7697ecc-77b8-11ef-baf5-efdc52797490@mon.c.service 2024-09-21T01:32:40.749 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-21T01:32:40.749 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-21T01:32:41.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:40 smithi083 ceph-mon[31370]: Updating smithi142:/var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T01:32:41.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:40 smithi083 ceph-mon[31370]: Updating smithi142:/etc/ceph/ceph.client.admin.keyring 2024-09-21T01:32:41.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:40 smithi083 ceph-mon[31370]: Updating smithi142:/var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T01:32:41.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:40 smithi083 ceph-mon[31370]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' 2024-09-21T01:32:41.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:40 smithi083 ceph-mon[31370]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' 2024-09-21T01:32:41.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:40 smithi083 ceph-mon[31370]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' 2024-09-21T01:32:41.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:40 smithi083 ceph-mon[31370]: from='client.14190 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi083:172.21.15.83=a;smithi119:172.21.15.119=b;smithi142:172.21.15.142=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:32:41.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:40 smithi083 ceph-mon[31370]: Saving service mon spec with placement smithi083:172.21.15.83=a;smithi119:172.21.15.119=b;smithi142:172.21.15.142=c;count:3 2024-09-21T01:32:41.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:40 smithi083 ceph-mon[31370]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' 2024-09-21T01:32:41.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:40 smithi083 ceph-mon[31370]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:32:41.055 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:40 smithi083 ceph-mon[31370]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:32:41.055 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:40 smithi083 ceph-mon[31370]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:32:41.055 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:40 smithi083 ceph-mon[31370]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' 2024-09-21T01:32:41.055 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:40 smithi083 ceph-mon[31370]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T01:32:41.055 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:40 smithi083 ceph-mon[31370]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:32:42.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:41 smithi083 ceph-mon[31370]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:32:42.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:41 smithi083 ceph-mon[31370]: Deploying daemon mon.c on smithi142 2024-09-21T01:32:42.679 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T01:32:43.471 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-21T01:32:43.471 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":1,"fsid":"f7697ecc-77b8-11ef-baf5-efdc52797490","modified":"2024-09-21T01:31:12.791840Z","created":"2024-09-21T01:31:12.791840Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:3300","nonce":0},{"type":"v1","addr":"172.21.15.83:6789","nonce":0}]},"addr":"172.21.15.83:6789/0","public_addr":"172.21.15.83:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-21T01:32:43.471 INFO:teuthology.orchestra.run.smithi142.stderr:dumped monmap epoch 1 2024-09-21T01:32:44.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:43 smithi083 ceph-mon[31370]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:32:44.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:43 smithi083 ceph-mon[31370]: from='client.? 172.21.15.142:0/3128725032' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T01:32:44.374 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 podman[34030]: 2024-09-21 01:32:44.351770282 +0000 UTC m=+0.090717445 container create 80dee8574d61767c43a98cb3316d47b1e8f1e877b586a53794f6b68e601e8c5d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mon-c, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD) 2024-09-21T01:32:44.374 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 podman[34030]: 2024-09-21 01:32:44.276886888 +0000 UTC m=+0.015834058 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T01:32:44.715 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 podman[34030]: 2024-09-21 01:32:44.537428924 +0000 UTC m=+0.276376088 container init 80dee8574d61767c43a98cb3316d47b1e8f1e877b586a53794f6b68e601e8c5d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mon-c, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, ceph=True) 2024-09-21T01:32:44.715 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 podman[34030]: 2024-09-21 01:32:44.540700055 +0000 UTC m=+0.279647220 container start 80dee8574d61767c43a98cb3316d47b1e8f1e877b586a53794f6b68e601e8c5d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mon-c, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True) 2024-09-21T01:32:44.715 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: set uid:gid to 167:167 (ceph:ceph) 2024-09-21T01:32:44.715 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev), process ceph-mon, pid 2 2024-09-21T01:32:44.716 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: pidfile_write: ignore empty --pid-file 2024-09-21T01:32:44.716 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: load: jerasure load: lrc 2024-09-21T01:32:44.716 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: RocksDB version: 7.9.2 2024-09-21T01:32:44.716 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Git sha 0 2024-09-21T01:32:44.716 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Compile date 2024-09-20 22:29:49 2024-09-21T01:32:44.716 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: DB SUMMARY 2024-09-21T01:32:44.716 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: DB Session ID: JEXBURAG77KNUT4CLFXL 2024-09-21T01:32:44.716 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: CURRENT file: CURRENT 2024-09-21T01:32:44.717 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: IDENTITY file: IDENTITY 2024-09-21T01:32:44.717 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-09-21T01:32:44.717 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2024-09-21T01:32:44.717 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000004.log size: 511 ; 2024-09-21T01:32:44.717 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.error_if_exists: 0 2024-09-21T01:32:44.717 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.create_if_missing: 0 2024-09-21T01:32:44.717 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.paranoid_checks: 1 2024-09-21T01:32:44.717 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-21T01:32:44.717 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-21T01:32:44.717 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-21T01:32:44.717 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.env: 0x55720fd9ed60 2024-09-21T01:32:44.718 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.fs: PosixFileSystem 2024-09-21T01:32:44.718 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.info_log: 0x557216241360 2024-09-21T01:32:44.718 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.max_file_opening_threads: 16 2024-09-21T01:32:44.718 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.statistics: (nil) 2024-09-21T01:32:44.718 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.use_fsync: 0 2024-09-21T01:32:44.718 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.max_log_file_size: 0 2024-09-21T01:32:44.718 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-21T01:32:44.718 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-21T01:32:44.719 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.keep_log_file_num: 1000 2024-09-21T01:32:44.719 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.recycle_log_file_num: 0 2024-09-21T01:32:44.719 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.allow_fallocate: 1 2024-09-21T01:32:44.719 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.allow_mmap_reads: 0 2024-09-21T01:32:44.719 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.allow_mmap_writes: 0 2024-09-21T01:32:44.719 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.use_direct_reads: 0 2024-09-21T01:32:44.719 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-21T01:32:44.719 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.create_missing_column_families: 0 2024-09-21T01:32:44.719 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.db_log_dir: 2024-09-21T01:32:44.719 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.wal_dir: 2024-09-21T01:32:44.719 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-21T01:32:44.719 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-21T01:32:44.720 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-21T01:32:44.720 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-21T01:32:44.720 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-21T01:32:44.720 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-21T01:32:44.720 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.advise_random_on_open: 1 2024-09-21T01:32:44.720 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.db_write_buffer_size: 0 2024-09-21T01:32:44.720 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.write_buffer_manager: 0x557216245d60 2024-09-21T01:32:44.720 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-21T01:32:44.720 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-21T01:32:44.720 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-21T01:32:44.721 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.rate_limiter: (nil) 2024-09-21T01:32:44.721 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-21T01:32:44.721 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.wal_recovery_mode: 2 2024-09-21T01:32:44.721 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.enable_thread_tracking: 0 2024-09-21T01:32:44.721 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.enable_pipelined_write: 0 2024-09-21T01:32:44.721 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.unordered_write: 0 2024-09-21T01:32:44.721 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-21T01:32:44.721 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-21T01:32:44.721 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-21T01:32:44.721 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-21T01:32:44.721 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.row_cache: None 2024-09-21T01:32:44.721 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.wal_filter: None 2024-09-21T01:32:44.723 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-21T01:32:44.723 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.allow_ingest_behind: 0 2024-09-21T01:32:44.724 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.two_write_queues: 0 2024-09-21T01:32:44.724 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.manual_wal_flush: 0 2024-09-21T01:32:44.724 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.wal_compression: 0 2024-09-21T01:32:44.724 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.atomic_flush: 0 2024-09-21T01:32:44.724 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-21T01:32:44.724 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-21T01:32:44.725 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-21T01:32:44.725 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.log_readahead_size: 0 2024-09-21T01:32:44.725 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-21T01:32:44.725 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.best_efforts_recovery: 0 2024-09-21T01:32:44.725 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-21T01:32:44.725 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-21T01:32:44.725 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.allow_data_in_errors: 0 2024-09-21T01:32:44.725 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.db_host_id: __hostname__ 2024-09-21T01:32:44.725 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-21T01:32:44.725 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.max_background_jobs: 2 2024-09-21T01:32:44.726 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.max_background_compactions: -1 2024-09-21T01:32:44.726 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.max_subcompactions: 1 2024-09-21T01:32:44.726 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-21T01:32:44.726 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-21T01:32:44.726 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-21T01:32:44.726 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.max_total_wal_size: 0 2024-09-21T01:32:44.726 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-21T01:32:44.726 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-21T01:32:44.726 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-21T01:32:44.727 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-21T01:32:44.727 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.max_open_files: -1 2024-09-21T01:32:44.727 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.bytes_per_sync: 0 2024-09-21T01:32:44.727 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-21T01:32:44.727 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-21T01:32:44.727 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.compaction_readahead_size: 0 2024-09-21T01:32:44.727 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.max_background_flushes: -1 2024-09-21T01:32:44.727 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Compression algorithms supported: 2024-09-21T01:32:44.727 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: kZSTD supported: 0 2024-09-21T01:32:44.728 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: kXpressCompression supported: 0 2024-09-21T01:32:44.728 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: kBZip2Compression supported: 0 2024-09-21T01:32:44.728 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-21T01:32:44.728 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: kLZ4Compression supported: 1 2024-09-21T01:32:44.728 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: kZlibCompression supported: 1 2024-09-21T01:32:44.728 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: kLZ4HCCompression supported: 1 2024-09-21T01:32:44.728 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: kSnappyCompression supported: 1 2024-09-21T01:32:44.728 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-21T01:32:44.729 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-21T01:32:44.729 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 2024-09-21T01:32:44.729 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-21T01:32:44.729 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-21T01:32:44.729 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.merge_operator: 2024-09-21T01:32:44.729 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.compaction_filter: None 2024-09-21T01:32:44.729 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.compaction_filter_factory: None 2024-09-21T01:32:44.729 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.sst_partitioner_factory: None 2024-09-21T01:32:44.729 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-21T01:32:44.729 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-21T01:32:44.729 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x557216240fa0) 2024-09-21T01:32:44.729 INFO:journalctl@ceph.mon.c.smithi142.stdout: cache_index_and_filter_blocks: 1 2024-09-21T01:32:44.730 INFO:journalctl@ceph.mon.c.smithi142.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-21T01:32:44.730 INFO:journalctl@ceph.mon.c.smithi142.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-21T01:32:44.730 INFO:journalctl@ceph.mon.c.smithi142.stdout: pin_top_level_index_and_filter: 1 2024-09-21T01:32:44.730 INFO:journalctl@ceph.mon.c.smithi142.stdout: index_type: 0 2024-09-21T01:32:44.730 INFO:journalctl@ceph.mon.c.smithi142.stdout: data_block_index_type: 0 2024-09-21T01:32:44.730 INFO:journalctl@ceph.mon.c.smithi142.stdout: index_shortening: 1 2024-09-21T01:32:44.730 INFO:journalctl@ceph.mon.c.smithi142.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-21T01:32:44.730 INFO:journalctl@ceph.mon.c.smithi142.stdout: checksum: 4 2024-09-21T01:32:44.731 INFO:journalctl@ceph.mon.c.smithi142.stdout: no_block_cache: 0 2024-09-21T01:32:44.731 INFO:journalctl@ceph.mon.c.smithi142.stdout: block_cache: 0x557212205610 2024-09-21T01:32:44.731 INFO:journalctl@ceph.mon.c.smithi142.stdout: block_cache_name: BinnedLRUCache 2024-09-21T01:32:44.731 INFO:journalctl@ceph.mon.c.smithi142.stdout: block_cache_options: 2024-09-21T01:32:44.731 INFO:journalctl@ceph.mon.c.smithi142.stdout: capacity : 536870912 2024-09-21T01:32:44.731 INFO:journalctl@ceph.mon.c.smithi142.stdout: num_shard_bits : 4 2024-09-21T01:32:44.731 INFO:journalctl@ceph.mon.c.smithi142.stdout: strict_capacity_limit : 0 2024-09-21T01:32:44.731 INFO:journalctl@ceph.mon.c.smithi142.stdout: high_pri_pool_ratio: 0.000 2024-09-21T01:32:44.731 INFO:journalctl@ceph.mon.c.smithi142.stdout: block_cache_compressed: (nil) 2024-09-21T01:32:44.731 INFO:journalctl@ceph.mon.c.smithi142.stdout: persistent_cache: (nil) 2024-09-21T01:32:44.731 INFO:journalctl@ceph.mon.c.smithi142.stdout: block_size: 4096 2024-09-21T01:32:44.732 INFO:journalctl@ceph.mon.c.smithi142.stdout: block_size_deviation: 10 2024-09-21T01:32:44.732 INFO:journalctl@ceph.mon.c.smithi142.stdout: block_restart_interval: 16 2024-09-21T01:32:44.732 INFO:journalctl@ceph.mon.c.smithi142.stdout: index_block_restart_interval: 1 2024-09-21T01:32:44.732 INFO:journalctl@ceph.mon.c.smithi142.stdout: metadata_block_size: 4096 2024-09-21T01:32:44.732 INFO:journalctl@ceph.mon.c.smithi142.stdout: partition_filters: 0 2024-09-21T01:32:44.732 INFO:journalctl@ceph.mon.c.smithi142.stdout: use_delta_encoding: 1 2024-09-21T01:32:44.732 INFO:journalctl@ceph.mon.c.smithi142.stdout: filter_policy: bloomfilter 2024-09-21T01:32:44.732 INFO:journalctl@ceph.mon.c.smithi142.stdout: whole_key_filtering: 1 2024-09-21T01:32:44.732 INFO:journalctl@ceph.mon.c.smithi142.stdout: verify_compression: 0 2024-09-21T01:32:44.733 INFO:journalctl@ceph.mon.c.smithi142.stdout: read_amp_bytes_per_bit: 0 2024-09-21T01:32:44.733 INFO:journalctl@ceph.mon.c.smithi142.stdout: format_version: 5 2024-09-21T01:32:44.733 INFO:journalctl@ceph.mon.c.smithi142.stdout: enable_index_compression: 1 2024-09-21T01:32:44.733 INFO:journalctl@ceph.mon.c.smithi142.stdout: block_align: 0 2024-09-21T01:32:44.733 INFO:journalctl@ceph.mon.c.smithi142.stdout: max_auto_readahead_size: 262144 2024-09-21T01:32:44.733 INFO:journalctl@ceph.mon.c.smithi142.stdout: prepopulate_block_cache: 0 2024-09-21T01:32:44.733 INFO:journalctl@ceph.mon.c.smithi142.stdout: initial_auto_readahead_size: 8192 2024-09-21T01:32:44.733 INFO:journalctl@ceph.mon.c.smithi142.stdout: num_file_reads_for_auto_readahead: 2 2024-09-21T01:32:44.733 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.write_buffer_size: 33554432 2024-09-21T01:32:44.733 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.max_write_buffer_number: 2 2024-09-21T01:32:44.733 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.compression: NoCompression 2024-09-21T01:32:44.733 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.bottommost_compression: Disabled 2024-09-21T01:32:44.734 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.prefix_extractor: nullptr 2024-09-21T01:32:44.734 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-21T01:32:44.734 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.num_levels: 7 2024-09-21T01:32:44.734 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-21T01:32:44.734 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-21T01:32:44.734 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-21T01:32:44.734 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-21T01:32:44.734 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-21T01:32:44.734 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-21T01:32:44.734 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-21T01:32:44.735 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-21T01:32:44.735 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-21T01:32:44.735 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-21T01:32:44.735 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-21T01:32:44.735 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-21T01:32:44.735 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-21T01:32:44.735 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.compression_opts.level: 32767 2024-09-21T01:32:44.735 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.compression_opts.strategy: 0 2024-09-21T01:32:44.735 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-21T01:32:44.735 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-21T01:32:44.736 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-21T01:32:44.736 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-21T01:32:44.736 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.compression_opts.enabled: false 2024-09-21T01:32:44.736 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-21T01:32:44.736 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-21T01:32:44.736 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-21T01:32:44.736 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-21T01:32:44.736 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.target_file_size_base: 67108864 2024-09-21T01:32:44.736 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-21T01:32:44.736 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-21T01:32:44.737 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-21T01:32:44.737 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-21T01:32:44.737 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-21T01:32:44.737 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-21T01:32:44.737 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-21T01:32:44.737 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-21T01:32:44.737 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-21T01:32:44.737 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-21T01:32:44.737 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-21T01:32:44.737 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-21T01:32:44.738 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-21T01:32:44.738 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-21T01:32:44.738 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.arena_block_size: 1048576 2024-09-21T01:32:44.738 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-21T01:32:44.738 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-21T01:32:44.738 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.disable_auto_compactions: 0 2024-09-21T01:32:44.738 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-21T01:32:44.738 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-21T01:32:44.739 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-21T01:32:44.739 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-21T01:32:44.739 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-21T01:32:44.739 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-21T01:32:44.739 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-21T01:32:44.739 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-21T01:32:44.739 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-21T01:32:44.739 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-21T01:32:44.739 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-21T01:32:44.739 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.inplace_update_support: 0 2024-09-21T01:32:44.739 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-21T01:32:44.739 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-21T01:32:44.740 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-21T01:32:44.740 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-21T01:32:44.740 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.bloom_locality: 0 2024-09-21T01:32:44.740 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.max_successive_merges: 0 2024-09-21T01:32:44.740 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-21T01:32:44.740 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.paranoid_file_checks: 0 2024-09-21T01:32:44.740 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.force_consistency_checks: 1 2024-09-21T01:32:44.740 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.report_bg_io_stats: 0 2024-09-21T01:32:44.740 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.ttl: 2592000 2024-09-21T01:32:44.740 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-21T01:32:44.740 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-21T01:32:44.740 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-21T01:32:44.740 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.enable_blob_files: false 2024-09-21T01:32:44.741 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.min_blob_size: 0 2024-09-21T01:32:44.741 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.blob_file_size: 268435456 2024-09-21T01:32:44.741 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-21T01:32:44.741 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-21T01:32:44.741 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-21T01:32:44.741 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-21T01:32:44.741 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-21T01:32:44.741 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.blob_file_starting_level: 0 2024-09-21T01:32:44.741 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-21T01:32:44.741 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-21T01:32:44.741 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-09-21T01:32:44.741 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 94816a44-944c-4b0f-bb19-b3239c53239d 2024-09-21T01:32:44.741 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726882364578365, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-09-21T01:32:44.741 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-09-21T01:32:44.742 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726882364578794, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1648, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726882364, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "94816a44-944c-4b0f-bb19-b3239c53239d", "db_session_id": "JEXBURAG77KNUT4CLFXL", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-09-21T01:32:44.742 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726882364578890, "job": 1, "event": "recovery_finished"} 2024-09-21T01:32:44.742 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-09-21T01:32:44.742 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-21T01:32:44.742 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x557216264a80 2024-09-21T01:32:44.742 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: DB pointer 0x55721700a000 2024-09-21T01:32:44.742 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-21T01:32:44.742 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-21T01:32:44.742 INFO:journalctl@ceph.mon.c.smithi142.stdout: ** DB Stats ** 2024-09-21T01:32:44.742 INFO:journalctl@ceph.mon.c.smithi142.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T01:32:44.742 INFO:journalctl@ceph.mon.c.smithi142.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-21T01:32:44.743 INFO:journalctl@ceph.mon.c.smithi142.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-21T01:32:44.743 INFO:journalctl@ceph.mon.c.smithi142.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T01:32:44.743 INFO:journalctl@ceph.mon.c.smithi142.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-21T01:32:44.743 INFO:journalctl@ceph.mon.c.smithi142.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-21T01:32:44.743 INFO:journalctl@ceph.mon.c.smithi142.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T01:32:44.743 INFO:journalctl@ceph.mon.c.smithi142.stdout: 2024-09-21T01:32:44.743 INFO:journalctl@ceph.mon.c.smithi142.stdout: ** Compaction Stats [default] ** 2024-09-21T01:32:44.743 INFO:journalctl@ceph.mon.c.smithi142.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-21T01:32:44.743 INFO:journalctl@ceph.mon.c.smithi142.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-21T01:32:44.743 INFO:journalctl@ceph.mon.c.smithi142.stdout: L0 1/0 1.61 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.8 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-21T01:32:44.743 INFO:journalctl@ceph.mon.c.smithi142.stdout: Sum 1/0 1.61 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.8 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-21T01:32:44.743 INFO:journalctl@ceph.mon.c.smithi142.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.8 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-21T01:32:44.743 INFO:journalctl@ceph.mon.c.smithi142.stdout: 2024-09-21T01:32:44.744 INFO:journalctl@ceph.mon.c.smithi142.stdout: ** Compaction Stats [default] ** 2024-09-21T01:32:44.744 INFO:journalctl@ceph.mon.c.smithi142.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-21T01:32:44.744 INFO:journalctl@ceph.mon.c.smithi142.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-21T01:32:44.744 INFO:journalctl@ceph.mon.c.smithi142.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 3.8 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-21T01:32:44.744 INFO:journalctl@ceph.mon.c.smithi142.stdout: 2024-09-21T01:32:44.744 INFO:journalctl@ceph.mon.c.smithi142.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-21T01:32:44.744 INFO:journalctl@ceph.mon.c.smithi142.stdout: 2024-09-21T01:32:44.745 INFO:journalctl@ceph.mon.c.smithi142.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T01:32:44.745 INFO:journalctl@ceph.mon.c.smithi142.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-21T01:32:44.745 INFO:journalctl@ceph.mon.c.smithi142.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-21T01:32:44.745 INFO:journalctl@ceph.mon.c.smithi142.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-21T01:32:44.745 INFO:journalctl@ceph.mon.c.smithi142.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-21T01:32:44.745 INFO:journalctl@ceph.mon.c.smithi142.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-21T01:32:44.745 INFO:journalctl@ceph.mon.c.smithi142.stdout: Cumulative compaction: 0.00 GB write, 0.61 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T01:32:44.745 INFO:journalctl@ceph.mon.c.smithi142.stdout: Interval compaction: 0.00 GB write, 0.61 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T01:32:44.745 INFO:journalctl@ceph.mon.c.smithi142.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-21T01:32:44.745 INFO:journalctl@ceph.mon.c.smithi142.stdout: Block cache BinnedLRUCache@0x557212205610#2 capacity: 512.00 MB usage: 0.23 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-09-21T01:32:44.745 INFO:journalctl@ceph.mon.c.smithi142.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.12 KB,2.23517e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-09-21T01:32:44.745 INFO:journalctl@ceph.mon.c.smithi142.stdout: 2024-09-21T01:32:44.746 INFO:journalctl@ceph.mon.c.smithi142.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-21T01:32:44.746 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: mon.c does not exist in monmap, will attempt to join an existing cluster 2024-09-21T01:32:44.746 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: using public_addr v2:172.21.15.142:0/0 -> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] 2024-09-21T01:32:44.746 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: starting mon.c rank -1 at public addrs [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] at bind addrs [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] mon_data /var/lib/ceph/mon/ceph-c fsid f7697ecc-77b8-11ef-baf5-efdc52797490 2024-09-21T01:32:44.746 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: mon.c@-1(???) e0 preinit fsid f7697ecc-77b8-11ef-baf5-efdc52797490 2024-09-21T01:32:44.746 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: mon.c@-1(synchronizing).mds e1 new map 2024-09-21T01:32:44.746 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: mon.c@-1(synchronizing).mds e1 print_map 2024-09-21T01:32:44.746 INFO:journalctl@ceph.mon.c.smithi142.stdout: e1 2024-09-21T01:32:44.746 INFO:journalctl@ceph.mon.c.smithi142.stdout: btime 2024-09-21T01:31:22:250084+0000 2024-09-21T01:32:44.746 INFO:journalctl@ceph.mon.c.smithi142.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T01:32:44.746 INFO:journalctl@ceph.mon.c.smithi142.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T01:32:44.746 INFO:journalctl@ceph.mon.c.smithi142.stdout: legacy client fscid: -1 2024-09-21T01:32:44.747 INFO:journalctl@ceph.mon.c.smithi142.stdout: 2024-09-21T01:32:44.747 INFO:journalctl@ceph.mon.c.smithi142.stdout: No filesystems configured 2024-09-21T01:32:44.747 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-09-21T01:32:44.747 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-09-21T01:32:44.747 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-09-21T01:32:44.747 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-09-21T01:32:44.747 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-09-21T01:32:44.747 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-09-21T01:32:44.747 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-21T01:32:44.747 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T01:32:44.748 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T01:32:44.748 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T01:32:44.748 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi142", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:32:44.748 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:32:44.748 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: Deploying cephadm binary to smithi142 2024-09-21T01:32:44.748 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' 2024-09-21T01:32:44.748 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' 2024-09-21T01:32:44.748 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' 2024-09-21T01:32:44.748 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' 2024-09-21T01:32:44.749 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi119", "name": "osd_memory_target"} : dispatch 2024-09-21T01:32:44.749 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:32:44.749 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:32:44.749 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: Updating smithi119:/etc/ceph/ceph.conf 2024-09-21T01:32:44.749 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: Updating smithi119:/var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T01:32:44.749 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: Updating smithi119:/etc/ceph/ceph.client.admin.keyring 2024-09-21T01:32:44.749 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: Updating smithi119:/var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T01:32:44.749 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' 2024-09-21T01:32:44.749 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' 2024-09-21T01:32:44.749 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' 2024-09-21T01:32:44.749 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:32:44.749 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' 2024-09-21T01:32:44.749 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: Added host smithi142 2024-09-21T01:32:44.750 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:32:44.750 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' 2024-09-21T01:32:44.750 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' 2024-09-21T01:32:44.750 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:32:44.750 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' 2024-09-21T01:32:44.750 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T01:32:44.750 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: from='client.? 172.21.15.83:0/64277162' entity='client.admin' cmd={"prefix": "osd crush tunables", "profile": "default"} : dispatch 2024-09-21T01:32:44.750 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:32:44.750 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: from='client.? 172.21.15.83:0/64277162' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-21T01:32:44.750 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T01:32:44.750 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' 2024-09-21T01:32:44.750 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' 2024-09-21T01:32:44.750 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' 2024-09-21T01:32:44.750 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' 2024-09-21T01:32:44.751 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi142", "name": "osd_memory_target"} : dispatch 2024-09-21T01:32:44.751 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:32:44.751 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:32:44.751 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: Updating smithi142:/etc/ceph/ceph.conf 2024-09-21T01:32:44.751 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: Updating smithi142:/var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T01:32:44.751 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: Updating smithi142:/etc/ceph/ceph.client.admin.keyring 2024-09-21T01:32:44.751 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: Updating smithi142:/var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T01:32:44.751 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' 2024-09-21T01:32:44.751 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' 2024-09-21T01:32:44.751 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' 2024-09-21T01:32:44.751 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: from='client.14190 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi083:172.21.15.83=a;smithi119:172.21.15.119=b;smithi142:172.21.15.142=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:32:44.751 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: Saving service mon spec with placement smithi083:172.21.15.83=a;smithi119:172.21.15.119=b;smithi142:172.21.15.142=c;count:3 2024-09-21T01:32:44.751 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' 2024-09-21T01:32:44.752 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:32:44.752 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:32:44.752 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:32:44.752 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' 2024-09-21T01:32:44.752 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T01:32:44.752 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:32:44.752 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:32:44.752 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: Deploying daemon mon.c on smithi142 2024-09-21T01:32:44.752 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:32:44.752 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: from='client.? 172.21.15.142:0/3128725032' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T01:32:44.752 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 ceph-mon[34050]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-09-21T01:32:44.752 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 bash[34030]: 80dee8574d61767c43a98cb3316d47b1e8f1e877b586a53794f6b68e601e8c5d 2024-09-21T01:32:44.752 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:44 smithi142 systemd[1]: Started Ceph mon.c for f7697ecc-77b8-11ef-baf5-efdc52797490. 2024-09-21T01:32:45.147 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-21T01:32:45.147 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-21T01:32:45.391 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T01:32:49.965 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:49 smithi142 ceph-mon[34050]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:32:49.965 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:49 smithi142 ceph-mon[34050]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T01:32:49.965 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:49 smithi142 ceph-mon[34050]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T01:32:49.965 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:49 smithi142 ceph-mon[34050]: mon.a calling monitor election 2024-09-21T01:32:49.966 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:49 smithi142 ceph-mon[34050]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T01:32:49.966 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:49 smithi142 ceph-mon[34050]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:32:49.966 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:49 smithi142 ceph-mon[34050]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T01:32:49.966 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:49 smithi142 ceph-mon[34050]: mon.c calling monitor election 2024-09-21T01:32:49.966 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:49 smithi142 ceph-mon[34050]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T01:32:49.966 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:49 smithi142 ceph-mon[34050]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:32:49.966 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:49 smithi142 ceph-mon[34050]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T01:32:49.966 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:49 smithi142 ceph-mon[34050]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T01:32:49.966 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:49 smithi142 ceph-mon[34050]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-21T01:32:49.966 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:49 smithi142 ceph-mon[34050]: monmap epoch 2 2024-09-21T01:32:49.966 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:49 smithi142 ceph-mon[34050]: fsid f7697ecc-77b8-11ef-baf5-efdc52797490 2024-09-21T01:32:49.966 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:49 smithi142 ceph-mon[34050]: last_changed 2024-09-21T01:32:44.606297+0000 2024-09-21T01:32:49.966 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:49 smithi142 ceph-mon[34050]: created 2024-09-21T01:31:12.791840+0000 2024-09-21T01:32:49.966 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:49 smithi142 ceph-mon[34050]: min_mon_release 19 (squid) 2024-09-21T01:32:49.967 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:49 smithi142 ceph-mon[34050]: election_strategy: 1 2024-09-21T01:32:49.967 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:49 smithi142 ceph-mon[34050]: 0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-21T01:32:49.967 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:49 smithi142 ceph-mon[34050]: 1: [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] mon.c 2024-09-21T01:32:49.967 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:49 smithi142 ceph-mon[34050]: fsmap 2024-09-21T01:32:49.967 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:49 smithi142 ceph-mon[34050]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T01:32:49.967 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:49 smithi142 ceph-mon[34050]: mgrmap e13: x(active, since 39s) 2024-09-21T01:32:49.967 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:49 smithi142 ceph-mon[34050]: overall HEALTH_OK 2024-09-21T01:32:49.967 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:49 smithi142 ceph-mon[34050]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' 2024-09-21T01:32:49.967 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:49 smithi142 ceph-mon[34050]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' 2024-09-21T01:32:49.967 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:49 smithi142 ceph-mon[34050]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' 2024-09-21T01:32:49.967 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:49 smithi142 ceph-mon[34050]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T01:32:49.967 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:49 smithi142 ceph-mon[34050]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:32:50.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:49 smithi083 ceph-mon[31370]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:32:50.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:49 smithi083 ceph-mon[31370]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T01:32:50.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:49 smithi083 ceph-mon[31370]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T01:32:50.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:49 smithi083 ceph-mon[31370]: mon.a calling monitor election 2024-09-21T01:32:50.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:49 smithi083 ceph-mon[31370]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T01:32:50.055 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:49 smithi083 ceph-mon[31370]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:32:50.055 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:49 smithi083 ceph-mon[31370]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T01:32:50.055 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:49 smithi083 ceph-mon[31370]: mon.c calling monitor election 2024-09-21T01:32:50.055 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:49 smithi083 ceph-mon[31370]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T01:32:50.055 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:49 smithi083 ceph-mon[31370]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:32:50.055 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:49 smithi083 ceph-mon[31370]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T01:32:50.055 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:49 smithi083 ceph-mon[31370]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T01:32:50.055 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:49 smithi083 ceph-mon[31370]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-21T01:32:50.055 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:49 smithi083 ceph-mon[31370]: monmap epoch 2 2024-09-21T01:32:50.055 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:49 smithi083 ceph-mon[31370]: fsid f7697ecc-77b8-11ef-baf5-efdc52797490 2024-09-21T01:32:50.055 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:49 smithi083 ceph-mon[31370]: last_changed 2024-09-21T01:32:44.606297+0000 2024-09-21T01:32:50.055 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:49 smithi083 ceph-mon[31370]: created 2024-09-21T01:31:12.791840+0000 2024-09-21T01:32:50.055 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:49 smithi083 ceph-mon[31370]: min_mon_release 19 (squid) 2024-09-21T01:32:50.055 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:49 smithi083 ceph-mon[31370]: election_strategy: 1 2024-09-21T01:32:50.056 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:49 smithi083 ceph-mon[31370]: 0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-21T01:32:50.056 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:49 smithi083 ceph-mon[31370]: 1: [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] mon.c 2024-09-21T01:32:50.056 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:49 smithi083 ceph-mon[31370]: fsmap 2024-09-21T01:32:50.056 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:49 smithi083 ceph-mon[31370]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T01:32:50.056 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:49 smithi083 ceph-mon[31370]: mgrmap e13: x(active, since 39s) 2024-09-21T01:32:50.056 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:49 smithi083 ceph-mon[31370]: overall HEALTH_OK 2024-09-21T01:32:50.056 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:49 smithi083 ceph-mon[31370]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' 2024-09-21T01:32:50.056 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:49 smithi083 ceph-mon[31370]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' 2024-09-21T01:32:50.056 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:49 smithi083 ceph-mon[31370]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' 2024-09-21T01:32:50.056 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:49 smithi083 ceph-mon[31370]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T01:32:50.056 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:49 smithi083 ceph-mon[31370]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:32:50.487 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-21T01:32:50.487 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":2,"fsid":"f7697ecc-77b8-11ef-baf5-efdc52797490","modified":"2024-09-21T01:32:44.606297Z","created":"2024-09-21T01:31:12.791840Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:3300","nonce":0},{"type":"v1","addr":"172.21.15.83:6789","nonce":0}]},"addr":"172.21.15.83:6789/0","public_addr":"172.21.15.83:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:3300","nonce":0},{"type":"v1","addr":"172.21.15.142:6789","nonce":0}]},"addr":"172.21.15.142:6789/0","public_addr":"172.21.15.142:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-21T01:32:50.487 INFO:teuthology.orchestra.run.smithi142.stderr:dumped monmap epoch 2 2024-09-21T01:32:50.832 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:50 smithi142 ceph-mon[34050]: Deploying daemon mon.b on smithi119 2024-09-21T01:32:50.832 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:50 smithi142 ceph-mon[34050]: from='client.? 172.21.15.142:0/390543352' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T01:32:50.832 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:50 smithi142 ceph-mon[34050]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T01:32:51.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:50 smithi083 ceph-mon[31370]: Deploying daemon mon.b on smithi119 2024-09-21T01:32:51.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:50 smithi083 ceph-mon[31370]: from='client.? 172.21.15.142:0/390543352' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T01:32:51.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:50 smithi083 ceph-mon[31370]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T01:32:51.964 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:51 smithi142 ceph-mon[34050]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:32:52.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:51 smithi083 ceph-mon[31370]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:32:52.128 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-21T01:32:52.129 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-21T01:32:52.376 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T01:32:53.021 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-21T01:32:53.021 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":2,"fsid":"f7697ecc-77b8-11ef-baf5-efdc52797490","modified":"2024-09-21T01:32:44.606297Z","created":"2024-09-21T01:31:12.791840Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:3300","nonce":0},{"type":"v1","addr":"172.21.15.83:6789","nonce":0}]},"addr":"172.21.15.83:6789/0","public_addr":"172.21.15.83:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:3300","nonce":0},{"type":"v1","addr":"172.21.15.142:6789","nonce":0}]},"addr":"172.21.15.142:6789/0","public_addr":"172.21.15.142:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-21T01:32:53.021 INFO:teuthology.orchestra.run.smithi142.stderr:dumped monmap epoch 2 2024-09-21T01:32:53.174 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 systemd[1]: Starting Ceph mon.b for f7697ecc-77b8-11ef-baf5-efdc52797490... 2024-09-21T01:32:53.468 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 podman[33675]: 2024-09-21 01:32:53.369527693 +0000 UTC m=+0.117914348 container create 22c3ca81beccc184365e2f8d1f2502b3a562573e6c84d222fe0fdd1637ea0c1a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mon-b, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-09-21T01:32:53.468 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 podman[33675]: 2024-09-21 01:32:53.273460466 +0000 UTC m=+0.021847120 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T01:32:53.732 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 podman[33675]: 2024-09-21 01:32:53.574458558 +0000 UTC m=+0.322845214 container init 22c3ca81beccc184365e2f8d1f2502b3a562573e6c84d222fe0fdd1637ea0c1a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mon-b, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True) 2024-09-21T01:32:53.732 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 podman[33675]: 2024-09-21 01:32:53.577773087 +0000 UTC m=+0.326159746 container start 22c3ca81beccc184365e2f8d1f2502b3a562573e6c84d222fe0fdd1637ea0c1a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mon-b, org.label-schema.build-date=20240731, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-09-21T01:32:53.732 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: set uid:gid to 167:167 (ceph:ceph) 2024-09-21T01:32:53.732 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev), process ceph-mon, pid 2 2024-09-21T01:32:53.733 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: pidfile_write: ignore empty --pid-file 2024-09-21T01:32:53.733 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: load: jerasure load: lrc 2024-09-21T01:32:53.733 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: RocksDB version: 7.9.2 2024-09-21T01:32:53.733 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Git sha 0 2024-09-21T01:32:53.733 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Compile date 2024-09-20 22:29:49 2024-09-21T01:32:53.733 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: DB SUMMARY 2024-09-21T01:32:53.733 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: DB Session ID: X5Z7AYY5KYPBYJQCL7MC 2024-09-21T01:32:53.733 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: CURRENT file: CURRENT 2024-09-21T01:32:53.733 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: IDENTITY file: IDENTITY 2024-09-21T01:32:53.733 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-09-21T01:32:53.733 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: SST files in /var/lib/ceph/mon/ceph-b/store.db dir, Total Num: 0, files: 2024-09-21T01:32:53.733 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-b/store.db: 000004.log size: 636 ; 2024-09-21T01:32:53.733 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.error_if_exists: 0 2024-09-21T01:32:53.733 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.create_if_missing: 0 2024-09-21T01:32:53.734 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.paranoid_checks: 1 2024-09-21T01:32:53.734 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-21T01:32:53.734 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-21T01:32:53.734 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-21T01:32:53.734 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.env: 0x563ae6c91d60 2024-09-21T01:32:53.734 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.fs: PosixFileSystem 2024-09-21T01:32:53.734 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.info_log: 0x563aec1a9360 2024-09-21T01:32:53.734 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.max_file_opening_threads: 16 2024-09-21T01:32:53.734 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.statistics: (nil) 2024-09-21T01:32:53.734 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.use_fsync: 0 2024-09-21T01:32:53.734 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.max_log_file_size: 0 2024-09-21T01:32:53.734 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-21T01:32:53.734 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-21T01:32:53.735 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.keep_log_file_num: 1000 2024-09-21T01:32:53.735 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.recycle_log_file_num: 0 2024-09-21T01:32:53.735 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.allow_fallocate: 1 2024-09-21T01:32:53.735 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.allow_mmap_reads: 0 2024-09-21T01:32:53.735 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.allow_mmap_writes: 0 2024-09-21T01:32:53.735 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.use_direct_reads: 0 2024-09-21T01:32:53.735 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-21T01:32:53.735 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.create_missing_column_families: 0 2024-09-21T01:32:53.735 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.db_log_dir: 2024-09-21T01:32:53.735 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.wal_dir: 2024-09-21T01:32:53.735 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-21T01:32:53.735 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-21T01:32:53.735 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-21T01:32:53.735 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-21T01:32:53.735 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-21T01:32:53.736 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-21T01:32:53.736 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.advise_random_on_open: 1 2024-09-21T01:32:53.736 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.db_write_buffer_size: 0 2024-09-21T01:32:53.736 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.write_buffer_manager: 0x563aec1add60 2024-09-21T01:32:53.736 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-21T01:32:53.736 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-21T01:32:53.736 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-21T01:32:53.736 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.rate_limiter: (nil) 2024-09-21T01:32:53.736 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-21T01:32:53.736 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.wal_recovery_mode: 2 2024-09-21T01:32:53.736 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.enable_thread_tracking: 0 2024-09-21T01:32:53.736 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.enable_pipelined_write: 0 2024-09-21T01:32:53.736 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.unordered_write: 0 2024-09-21T01:32:53.736 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-21T01:32:53.736 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-21T01:32:53.737 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-21T01:32:53.737 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-21T01:32:53.737 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.row_cache: None 2024-09-21T01:32:53.737 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.wal_filter: None 2024-09-21T01:32:53.738 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-21T01:32:53.738 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.allow_ingest_behind: 0 2024-09-21T01:32:53.738 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.two_write_queues: 0 2024-09-21T01:32:53.738 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.manual_wal_flush: 0 2024-09-21T01:32:53.738 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.wal_compression: 0 2024-09-21T01:32:53.738 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.atomic_flush: 0 2024-09-21T01:32:53.738 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-21T01:32:53.739 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-21T01:32:53.739 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-21T01:32:53.739 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.log_readahead_size: 0 2024-09-21T01:32:53.739 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-21T01:32:53.739 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.best_efforts_recovery: 0 2024-09-21T01:32:53.739 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-21T01:32:53.739 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-21T01:32:53.739 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.allow_data_in_errors: 0 2024-09-21T01:32:53.739 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.db_host_id: __hostname__ 2024-09-21T01:32:53.739 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-21T01:32:53.739 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.max_background_jobs: 2 2024-09-21T01:32:53.739 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.max_background_compactions: -1 2024-09-21T01:32:53.739 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.max_subcompactions: 1 2024-09-21T01:32:53.739 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-21T01:32:53.739 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-21T01:32:53.740 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-21T01:32:53.740 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.max_total_wal_size: 0 2024-09-21T01:32:53.740 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-21T01:32:53.740 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-21T01:32:53.740 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-21T01:32:53.740 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-21T01:32:53.740 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.max_open_files: -1 2024-09-21T01:32:53.740 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.bytes_per_sync: 0 2024-09-21T01:32:53.740 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-21T01:32:53.740 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-21T01:32:53.740 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.compaction_readahead_size: 0 2024-09-21T01:32:53.740 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.max_background_flushes: -1 2024-09-21T01:32:53.740 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Compression algorithms supported: 2024-09-21T01:32:53.740 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: kZSTD supported: 0 2024-09-21T01:32:53.741 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: kXpressCompression supported: 0 2024-09-21T01:32:53.741 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: kBZip2Compression supported: 0 2024-09-21T01:32:53.741 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-21T01:32:53.741 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: kLZ4Compression supported: 1 2024-09-21T01:32:53.741 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: kZlibCompression supported: 1 2024-09-21T01:32:53.741 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: kLZ4HCCompression supported: 1 2024-09-21T01:32:53.741 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: kSnappyCompression supported: 1 2024-09-21T01:32:53.741 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-21T01:32:53.741 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-21T01:32:53.741 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 2024-09-21T01:32:53.741 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-21T01:32:53.741 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-21T01:32:53.741 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.merge_operator: 2024-09-21T01:32:53.741 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.compaction_filter: None 2024-09-21T01:32:53.742 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.compaction_filter_factory: None 2024-09-21T01:32:53.742 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.sst_partitioner_factory: None 2024-09-21T01:32:53.742 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-21T01:32:53.742 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-21T01:32:53.742 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x563aec1a8fa0) 2024-09-21T01:32:53.742 INFO:journalctl@ceph.mon.b.smithi119.stdout: cache_index_and_filter_blocks: 1 2024-09-21T01:32:53.742 INFO:journalctl@ceph.mon.b.smithi119.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-21T01:32:53.742 INFO:journalctl@ceph.mon.b.smithi119.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-21T01:32:53.742 INFO:journalctl@ceph.mon.b.smithi119.stdout: pin_top_level_index_and_filter: 1 2024-09-21T01:32:53.742 INFO:journalctl@ceph.mon.b.smithi119.stdout: index_type: 0 2024-09-21T01:32:53.742 INFO:journalctl@ceph.mon.b.smithi119.stdout: data_block_index_type: 0 2024-09-21T01:32:53.742 INFO:journalctl@ceph.mon.b.smithi119.stdout: index_shortening: 1 2024-09-21T01:32:53.742 INFO:journalctl@ceph.mon.b.smithi119.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-21T01:32:53.742 INFO:journalctl@ceph.mon.b.smithi119.stdout: checksum: 4 2024-09-21T01:32:53.742 INFO:journalctl@ceph.mon.b.smithi119.stdout: no_block_cache: 0 2024-09-21T01:32:53.743 INFO:journalctl@ceph.mon.b.smithi119.stdout: block_cache: 0x563ae816d610 2024-09-21T01:32:53.743 INFO:journalctl@ceph.mon.b.smithi119.stdout: block_cache_name: BinnedLRUCache 2024-09-21T01:32:53.743 INFO:journalctl@ceph.mon.b.smithi119.stdout: block_cache_options: 2024-09-21T01:32:53.743 INFO:journalctl@ceph.mon.b.smithi119.stdout: capacity : 536870912 2024-09-21T01:32:53.743 INFO:journalctl@ceph.mon.b.smithi119.stdout: num_shard_bits : 4 2024-09-21T01:32:53.743 INFO:journalctl@ceph.mon.b.smithi119.stdout: strict_capacity_limit : 0 2024-09-21T01:32:53.743 INFO:journalctl@ceph.mon.b.smithi119.stdout: high_pri_pool_ratio: 0.000 2024-09-21T01:32:53.743 INFO:journalctl@ceph.mon.b.smithi119.stdout: block_cache_compressed: (nil) 2024-09-21T01:32:53.743 INFO:journalctl@ceph.mon.b.smithi119.stdout: persistent_cache: (nil) 2024-09-21T01:32:53.743 INFO:journalctl@ceph.mon.b.smithi119.stdout: block_size: 4096 2024-09-21T01:32:53.743 INFO:journalctl@ceph.mon.b.smithi119.stdout: block_size_deviation: 10 2024-09-21T01:32:53.743 INFO:journalctl@ceph.mon.b.smithi119.stdout: block_restart_interval: 16 2024-09-21T01:32:53.743 INFO:journalctl@ceph.mon.b.smithi119.stdout: index_block_restart_interval: 1 2024-09-21T01:32:53.743 INFO:journalctl@ceph.mon.b.smithi119.stdout: metadata_block_size: 4096 2024-09-21T01:32:53.744 INFO:journalctl@ceph.mon.b.smithi119.stdout: partition_filters: 0 2024-09-21T01:32:53.744 INFO:journalctl@ceph.mon.b.smithi119.stdout: use_delta_encoding: 1 2024-09-21T01:32:53.744 INFO:journalctl@ceph.mon.b.smithi119.stdout: filter_policy: bloomfilter 2024-09-21T01:32:53.744 INFO:journalctl@ceph.mon.b.smithi119.stdout: whole_key_filtering: 1 2024-09-21T01:32:53.744 INFO:journalctl@ceph.mon.b.smithi119.stdout: verify_compression: 0 2024-09-21T01:32:53.744 INFO:journalctl@ceph.mon.b.smithi119.stdout: read_amp_bytes_per_bit: 0 2024-09-21T01:32:53.744 INFO:journalctl@ceph.mon.b.smithi119.stdout: format_version: 5 2024-09-21T01:32:53.744 INFO:journalctl@ceph.mon.b.smithi119.stdout: enable_index_compression: 1 2024-09-21T01:32:53.744 INFO:journalctl@ceph.mon.b.smithi119.stdout: block_align: 0 2024-09-21T01:32:53.744 INFO:journalctl@ceph.mon.b.smithi119.stdout: max_auto_readahead_size: 262144 2024-09-21T01:32:53.744 INFO:journalctl@ceph.mon.b.smithi119.stdout: prepopulate_block_cache: 0 2024-09-21T01:32:53.744 INFO:journalctl@ceph.mon.b.smithi119.stdout: initial_auto_readahead_size: 8192 2024-09-21T01:32:53.744 INFO:journalctl@ceph.mon.b.smithi119.stdout: num_file_reads_for_auto_readahead: 2 2024-09-21T01:32:53.744 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.write_buffer_size: 33554432 2024-09-21T01:32:53.745 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.max_write_buffer_number: 2 2024-09-21T01:32:53.745 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.compression: NoCompression 2024-09-21T01:32:53.745 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.bottommost_compression: Disabled 2024-09-21T01:32:53.745 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.prefix_extractor: nullptr 2024-09-21T01:32:53.745 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-21T01:32:53.745 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.num_levels: 7 2024-09-21T01:32:53.745 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-21T01:32:53.745 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-21T01:32:53.745 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-21T01:32:53.745 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-21T01:32:53.745 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-21T01:32:53.745 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-21T01:32:53.745 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-21T01:32:53.745 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-21T01:32:53.746 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-21T01:32:53.746 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-21T01:32:53.746 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-21T01:32:53.746 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-21T01:32:53.746 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-21T01:32:53.746 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.compression_opts.level: 32767 2024-09-21T01:32:53.746 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.compression_opts.strategy: 0 2024-09-21T01:32:53.746 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-21T01:32:53.746 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-21T01:32:53.746 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-21T01:32:53.746 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-21T01:32:53.746 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.compression_opts.enabled: false 2024-09-21T01:32:53.746 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-21T01:32:53.746 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-21T01:32:53.746 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-21T01:32:53.747 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-21T01:32:53.747 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.target_file_size_base: 67108864 2024-09-21T01:32:53.747 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-21T01:32:53.747 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-21T01:32:53.747 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-21T01:32:53.747 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-21T01:32:53.747 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-21T01:32:53.747 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-21T01:32:53.747 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-21T01:32:53.747 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-21T01:32:53.747 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-21T01:32:53.747 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-21T01:32:53.747 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-21T01:32:53.747 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-21T01:32:53.747 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-21T01:32:53.748 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-21T01:32:53.748 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.arena_block_size: 1048576 2024-09-21T01:32:53.748 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-21T01:32:53.748 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-21T01:32:53.748 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.disable_auto_compactions: 0 2024-09-21T01:32:53.748 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-21T01:32:53.748 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-21T01:32:53.748 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-21T01:32:53.748 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-21T01:32:53.748 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-21T01:32:53.748 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-21T01:32:53.748 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-21T01:32:53.748 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-21T01:32:53.748 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-21T01:32:53.748 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-21T01:32:53.749 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-21T01:32:53.749 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.inplace_update_support: 0 2024-09-21T01:32:53.749 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-21T01:32:53.749 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-21T01:32:53.749 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-21T01:32:53.749 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-21T01:32:53.749 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.bloom_locality: 0 2024-09-21T01:32:53.749 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.max_successive_merges: 0 2024-09-21T01:32:53.749 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-21T01:32:53.749 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.paranoid_file_checks: 0 2024-09-21T01:32:53.749 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.force_consistency_checks: 1 2024-09-21T01:32:53.749 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.report_bg_io_stats: 0 2024-09-21T01:32:53.749 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.ttl: 2592000 2024-09-21T01:32:53.749 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-21T01:32:53.750 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-21T01:32:53.750 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-21T01:32:53.750 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.enable_blob_files: false 2024-09-21T01:32:53.750 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.min_blob_size: 0 2024-09-21T01:32:53.750 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.blob_file_size: 268435456 2024-09-21T01:32:53.750 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-21T01:32:53.750 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-21T01:32:53.750 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-21T01:32:53.750 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-21T01:32:53.750 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-21T01:32:53.750 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.blob_file_starting_level: 0 2024-09-21T01:32:53.750 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-21T01:32:53.750 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-21T01:32:53.750 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-09-21T01:32:53.751 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 870bd10a-2eac-44f6-bea6-4602aae51d3e 2024-09-21T01:32:53.751 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726882373614165, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-09-21T01:32:53.751 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-09-21T01:32:53.751 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726882373614597, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1773, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 648, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 526, "raw_average_value_size": 105, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726882373, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "870bd10a-2eac-44f6-bea6-4602aae51d3e", "db_session_id": "X5Z7AYY5KYPBYJQCL7MC", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-09-21T01:32:53.751 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726882373614694, "job": 1, "event": "recovery_finished"} 2024-09-21T01:32:53.751 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-09-21T01:32:53.751 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-b/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-21T01:32:53.751 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x563aec1cca80 2024-09-21T01:32:53.751 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: DB pointer 0x563aecf72000 2024-09-21T01:32:53.751 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-21T01:32:53.751 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-21T01:32:53.751 INFO:journalctl@ceph.mon.b.smithi119.stdout: ** DB Stats ** 2024-09-21T01:32:53.751 INFO:journalctl@ceph.mon.b.smithi119.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T01:32:53.751 INFO:journalctl@ceph.mon.b.smithi119.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-21T01:32:53.751 INFO:journalctl@ceph.mon.b.smithi119.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-21T01:32:53.752 INFO:journalctl@ceph.mon.b.smithi119.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T01:32:53.752 INFO:journalctl@ceph.mon.b.smithi119.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-21T01:32:53.752 INFO:journalctl@ceph.mon.b.smithi119.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-21T01:32:53.752 INFO:journalctl@ceph.mon.b.smithi119.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T01:32:53.752 INFO:journalctl@ceph.mon.b.smithi119.stdout: 2024-09-21T01:32:53.752 INFO:journalctl@ceph.mon.b.smithi119.stdout: ** Compaction Stats [default] ** 2024-09-21T01:32:53.752 INFO:journalctl@ceph.mon.b.smithi119.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-21T01:32:53.752 INFO:journalctl@ceph.mon.b.smithi119.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-21T01:32:53.752 INFO:journalctl@ceph.mon.b.smithi119.stdout: L0 1/0 1.73 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.0 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-21T01:32:53.752 INFO:journalctl@ceph.mon.b.smithi119.stdout: Sum 1/0 1.73 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.0 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-21T01:32:53.752 INFO:journalctl@ceph.mon.b.smithi119.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.0 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-21T01:32:53.752 INFO:journalctl@ceph.mon.b.smithi119.stdout: 2024-09-21T01:32:53.752 INFO:journalctl@ceph.mon.b.smithi119.stdout: ** Compaction Stats [default] ** 2024-09-21T01:32:53.752 INFO:journalctl@ceph.mon.b.smithi119.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-21T01:32:53.752 INFO:journalctl@ceph.mon.b.smithi119.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-21T01:32:53.753 INFO:journalctl@ceph.mon.b.smithi119.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 4.0 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-21T01:32:53.753 INFO:journalctl@ceph.mon.b.smithi119.stdout: 2024-09-21T01:32:53.753 INFO:journalctl@ceph.mon.b.smithi119.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-21T01:32:53.753 INFO:journalctl@ceph.mon.b.smithi119.stdout: 2024-09-21T01:32:53.753 INFO:journalctl@ceph.mon.b.smithi119.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T01:32:53.753 INFO:journalctl@ceph.mon.b.smithi119.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-21T01:32:53.753 INFO:journalctl@ceph.mon.b.smithi119.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-21T01:32:53.753 INFO:journalctl@ceph.mon.b.smithi119.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-21T01:32:53.753 INFO:journalctl@ceph.mon.b.smithi119.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-21T01:32:53.753 INFO:journalctl@ceph.mon.b.smithi119.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-21T01:32:53.753 INFO:journalctl@ceph.mon.b.smithi119.stdout: Cumulative compaction: 0.00 GB write, 0.63 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T01:32:53.753 INFO:journalctl@ceph.mon.b.smithi119.stdout: Interval compaction: 0.00 GB write, 0.63 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T01:32:53.753 INFO:journalctl@ceph.mon.b.smithi119.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-21T01:32:53.754 INFO:journalctl@ceph.mon.b.smithi119.stdout: Block cache BinnedLRUCache@0x563ae816d610#2 capacity: 512.00 MB usage: 0.23 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-09-21T01:32:53.754 INFO:journalctl@ceph.mon.b.smithi119.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.12 KB,2.23517e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-09-21T01:32:53.754 INFO:journalctl@ceph.mon.b.smithi119.stdout: 2024-09-21T01:32:53.754 INFO:journalctl@ceph.mon.b.smithi119.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-21T01:32:53.754 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: mon.b does not exist in monmap, will attempt to join an existing cluster 2024-09-21T01:32:53.754 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: using public_addr v2:172.21.15.119:0/0 -> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] 2024-09-21T01:32:53.754 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: starting mon.b rank -1 at public addrs [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] at bind addrs [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon_data /var/lib/ceph/mon/ceph-b fsid f7697ecc-77b8-11ef-baf5-efdc52797490 2024-09-21T01:32:53.754 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: mon.b@-1(???) e0 preinit fsid f7697ecc-77b8-11ef-baf5-efdc52797490 2024-09-21T01:32:53.754 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: mon.b@-1(synchronizing).mds e1 new map 2024-09-21T01:32:53.754 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: mon.b@-1(synchronizing).mds e1 print_map 2024-09-21T01:32:53.754 INFO:journalctl@ceph.mon.b.smithi119.stdout: e1 2024-09-21T01:32:53.754 INFO:journalctl@ceph.mon.b.smithi119.stdout: btime 2024-09-21T01:31:22:250084+0000 2024-09-21T01:32:53.754 INFO:journalctl@ceph.mon.b.smithi119.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T01:32:53.754 INFO:journalctl@ceph.mon.b.smithi119.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T01:32:53.754 INFO:journalctl@ceph.mon.b.smithi119.stdout: legacy client fscid: -1 2024-09-21T01:32:53.755 INFO:journalctl@ceph.mon.b.smithi119.stdout: 2024-09-21T01:32:53.755 INFO:journalctl@ceph.mon.b.smithi119.stdout: No filesystems configured 2024-09-21T01:32:53.755 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: mon.b@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-09-21T01:32:53.755 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: mon.b@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-09-21T01:32:53.755 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: mon.b@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-09-21T01:32:53.755 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: mon.b@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-09-21T01:32:53.755 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: mon.b@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-09-21T01:32:53.755 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: mon.b@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-09-21T01:32:53.755 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: mon.b@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-21T01:32:53.755 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T01:32:53.755 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T01:32:53.755 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T01:32:53.755 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi142", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:32:53.755 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:32:53.755 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: Deploying cephadm binary to smithi142 2024-09-21T01:32:53.755 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' 2024-09-21T01:32:53.756 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' 2024-09-21T01:32:53.756 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' 2024-09-21T01:32:53.756 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' 2024-09-21T01:32:53.756 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi119", "name": "osd_memory_target"} : dispatch 2024-09-21T01:32:53.756 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:32:53.756 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:32:53.756 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: Updating smithi119:/etc/ceph/ceph.conf 2024-09-21T01:32:53.756 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: Updating smithi119:/var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T01:32:53.756 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: Updating smithi119:/etc/ceph/ceph.client.admin.keyring 2024-09-21T01:32:53.756 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: Updating smithi119:/var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T01:32:53.756 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' 2024-09-21T01:32:53.756 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' 2024-09-21T01:32:53.756 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' 2024-09-21T01:32:53.756 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:32:53.756 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' 2024-09-21T01:32:53.756 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: Added host smithi142 2024-09-21T01:32:53.757 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:32:53.757 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' 2024-09-21T01:32:53.757 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' 2024-09-21T01:32:53.757 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:32:53.757 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' 2024-09-21T01:32:53.757 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T01:32:53.757 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: from='client.? 172.21.15.83:0/64277162' entity='client.admin' cmd={"prefix": "osd crush tunables", "profile": "default"} : dispatch 2024-09-21T01:32:53.757 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:32:53.757 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: from='client.? 172.21.15.83:0/64277162' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-21T01:32:53.757 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T01:32:53.757 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' 2024-09-21T01:32:53.757 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' 2024-09-21T01:32:53.757 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' 2024-09-21T01:32:53.757 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' 2024-09-21T01:32:53.757 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi142", "name": "osd_memory_target"} : dispatch 2024-09-21T01:32:53.757 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:32:53.758 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:32:53.758 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: Updating smithi142:/etc/ceph/ceph.conf 2024-09-21T01:32:53.758 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: Updating smithi142:/var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T01:32:53.758 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: Updating smithi142:/etc/ceph/ceph.client.admin.keyring 2024-09-21T01:32:53.758 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: Updating smithi142:/var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T01:32:53.758 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' 2024-09-21T01:32:53.758 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' 2024-09-21T01:32:53.758 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' 2024-09-21T01:32:53.758 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: from='client.14190 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi083:172.21.15.83=a;smithi119:172.21.15.119=b;smithi142:172.21.15.142=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:32:53.758 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: Saving service mon spec with placement smithi083:172.21.15.83=a;smithi119:172.21.15.119=b;smithi142:172.21.15.142=c;count:3 2024-09-21T01:32:53.758 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' 2024-09-21T01:32:53.758 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:32:53.758 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:32:53.758 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:32:53.758 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' 2024-09-21T01:32:53.758 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T01:32:53.759 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:32:53.759 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:32:53.759 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: Deploying daemon mon.c on smithi142 2024-09-21T01:32:53.759 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:32:53.759 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: from='client.? 172.21.15.142:0/3128725032' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T01:32:53.759 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:32:53.759 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T01:32:53.759 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T01:32:53.759 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: mon.a calling monitor election 2024-09-21T01:32:53.759 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T01:32:53.759 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:32:53.759 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T01:32:53.759 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: mon.c calling monitor election 2024-09-21T01:32:53.759 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T01:32:53.759 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:32:53.759 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T01:32:53.760 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T01:32:53.760 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-21T01:32:53.760 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: monmap epoch 2 2024-09-21T01:32:53.760 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: fsid f7697ecc-77b8-11ef-baf5-efdc52797490 2024-09-21T01:32:53.760 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: last_changed 2024-09-21T01:32:44.606297+0000 2024-09-21T01:32:53.760 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: created 2024-09-21T01:31:12.791840+0000 2024-09-21T01:32:53.760 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: min_mon_release 19 (squid) 2024-09-21T01:32:53.760 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: election_strategy: 1 2024-09-21T01:32:53.760 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: 0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-21T01:32:53.760 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: 1: [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] mon.c 2024-09-21T01:32:53.760 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: fsmap 2024-09-21T01:32:53.760 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T01:32:53.760 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: mgrmap e13: x(active, since 39s) 2024-09-21T01:32:53.760 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: overall HEALTH_OK 2024-09-21T01:32:53.760 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' 2024-09-21T01:32:53.760 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' 2024-09-21T01:32:53.760 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' 2024-09-21T01:32:53.761 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T01:32:53.761 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:32:53.761 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: Deploying daemon mon.b on smithi119 2024-09-21T01:32:53.761 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: from='client.? 172.21.15.142:0/390543352' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T01:32:53.761 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T01:32:53.761 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:32:53.761 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 ceph-mon[33693]: mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-09-21T01:32:53.761 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 bash[33675]: 22c3ca81beccc184365e2f8d1f2502b3a562573e6c84d222fe0fdd1637ea0c1a 2024-09-21T01:32:53.761 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:53 smithi119 systemd[1]: Started Ceph mon.b for f7697ecc-77b8-11ef-baf5-efdc52797490. 2024-09-21T01:32:54.609 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-21T01:32:54.609 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-21T01:32:54.858 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T01:32:58.965 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:58 smithi142 ceph-mon[34050]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T01:32:58.965 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:58 smithi142 ceph-mon[34050]: mon.a calling monitor election 2024-09-21T01:32:58.965 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:58 smithi142 ceph-mon[34050]: mon.c calling monitor election 2024-09-21T01:32:58.965 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:58 smithi142 ceph-mon[34050]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T01:32:58.965 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:58 smithi142 ceph-mon[34050]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T01:32:58.965 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:58 smithi142 ceph-mon[34050]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:32:58.965 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:58 smithi142 ceph-mon[34050]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T01:32:58.965 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:58 smithi142 ceph-mon[34050]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T01:32:58.965 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:58 smithi142 ceph-mon[34050]: mon.b calling monitor election 2024-09-21T01:32:58.965 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:58 smithi142 ceph-mon[34050]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:32:58.965 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:58 smithi142 ceph-mon[34050]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T01:32:58.965 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:58 smithi142 ceph-mon[34050]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T01:32:58.966 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:58 smithi142 ceph-mon[34050]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T01:32:58.966 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:58 smithi142 ceph-mon[34050]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-21T01:32:58.966 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:58 smithi142 ceph-mon[34050]: monmap epoch 3 2024-09-21T01:32:58.966 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:58 smithi142 ceph-mon[34050]: fsid f7697ecc-77b8-11ef-baf5-efdc52797490 2024-09-21T01:32:58.966 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:58 smithi142 ceph-mon[34050]: last_changed 2024-09-21T01:32:53.641071+0000 2024-09-21T01:32:58.966 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:58 smithi142 ceph-mon[34050]: created 2024-09-21T01:31:12.791840+0000 2024-09-21T01:32:58.966 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:58 smithi142 ceph-mon[34050]: min_mon_release 19 (squid) 2024-09-21T01:32:58.966 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:58 smithi142 ceph-mon[34050]: election_strategy: 1 2024-09-21T01:32:58.966 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:58 smithi142 ceph-mon[34050]: 0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-21T01:32:58.966 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:58 smithi142 ceph-mon[34050]: 1: [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] mon.c 2024-09-21T01:32:58.966 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:58 smithi142 ceph-mon[34050]: 2: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.b 2024-09-21T01:32:58.966 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:58 smithi142 ceph-mon[34050]: fsmap 2024-09-21T01:32:58.966 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:58 smithi142 ceph-mon[34050]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T01:32:58.966 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:58 smithi142 ceph-mon[34050]: mgrmap e13: x(active, since 48s) 2024-09-21T01:32:58.966 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:58 smithi142 ceph-mon[34050]: overall HEALTH_OK 2024-09-21T01:32:58.967 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:58 smithi142 ceph-mon[34050]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' 2024-09-21T01:32:58.967 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:58 smithi142 ceph-mon[34050]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' 2024-09-21T01:32:58.967 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:58 smithi142 ceph-mon[34050]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' 2024-09-21T01:32:58.967 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:58 smithi142 ceph-mon[34050]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' 2024-09-21T01:32:58.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:58 smithi119 ceph-mon[33693]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T01:32:58.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:58 smithi119 ceph-mon[33693]: mon.a calling monitor election 2024-09-21T01:32:58.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:58 smithi119 ceph-mon[33693]: mon.c calling monitor election 2024-09-21T01:32:58.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:58 smithi119 ceph-mon[33693]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T01:32:58.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:58 smithi119 ceph-mon[33693]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T01:32:58.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:58 smithi119 ceph-mon[33693]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:32:58.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:58 smithi119 ceph-mon[33693]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T01:32:58.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:58 smithi119 ceph-mon[33693]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T01:32:58.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:58 smithi119 ceph-mon[33693]: mon.b calling monitor election 2024-09-21T01:32:58.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:58 smithi119 ceph-mon[33693]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:32:58.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:58 smithi119 ceph-mon[33693]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T01:32:58.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:58 smithi119 ceph-mon[33693]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T01:32:58.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:58 smithi119 ceph-mon[33693]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T01:32:58.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:58 smithi119 ceph-mon[33693]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-21T01:32:58.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:58 smithi119 ceph-mon[33693]: monmap epoch 3 2024-09-21T01:32:58.969 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:58 smithi119 ceph-mon[33693]: fsid f7697ecc-77b8-11ef-baf5-efdc52797490 2024-09-21T01:32:58.969 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:58 smithi119 ceph-mon[33693]: last_changed 2024-09-21T01:32:53.641071+0000 2024-09-21T01:32:58.969 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:58 smithi119 ceph-mon[33693]: created 2024-09-21T01:31:12.791840+0000 2024-09-21T01:32:58.969 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:58 smithi119 ceph-mon[33693]: min_mon_release 19 (squid) 2024-09-21T01:32:58.969 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:58 smithi119 ceph-mon[33693]: election_strategy: 1 2024-09-21T01:32:58.969 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:58 smithi119 ceph-mon[33693]: 0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-21T01:32:58.969 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:58 smithi119 ceph-mon[33693]: 1: [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] mon.c 2024-09-21T01:32:58.969 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:58 smithi119 ceph-mon[33693]: 2: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.b 2024-09-21T01:32:58.969 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:58 smithi119 ceph-mon[33693]: fsmap 2024-09-21T01:32:58.969 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:58 smithi119 ceph-mon[33693]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T01:32:58.969 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:58 smithi119 ceph-mon[33693]: mgrmap e13: x(active, since 48s) 2024-09-21T01:32:58.969 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:58 smithi119 ceph-mon[33693]: overall HEALTH_OK 2024-09-21T01:32:58.969 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:58 smithi119 ceph-mon[33693]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' 2024-09-21T01:32:58.969 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:58 smithi119 ceph-mon[33693]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' 2024-09-21T01:32:58.969 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:58 smithi119 ceph-mon[33693]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' 2024-09-21T01:32:58.969 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:58 smithi119 ceph-mon[33693]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' 2024-09-21T01:32:59.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:58 smithi083 ceph-mon[31370]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T01:32:59.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:58 smithi083 ceph-mon[31370]: mon.a calling monitor election 2024-09-21T01:32:59.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:58 smithi083 ceph-mon[31370]: mon.c calling monitor election 2024-09-21T01:32:59.055 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:58 smithi083 ceph-mon[31370]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T01:32:59.055 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:58 smithi083 ceph-mon[31370]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T01:32:59.055 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:58 smithi083 ceph-mon[31370]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:32:59.055 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:58 smithi083 ceph-mon[31370]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T01:32:59.055 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:58 smithi083 ceph-mon[31370]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T01:32:59.055 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:58 smithi083 ceph-mon[31370]: mon.b calling monitor election 2024-09-21T01:32:59.055 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:58 smithi083 ceph-mon[31370]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:32:59.055 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:58 smithi083 ceph-mon[31370]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T01:32:59.055 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:58 smithi083 ceph-mon[31370]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T01:32:59.055 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:58 smithi083 ceph-mon[31370]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T01:32:59.055 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:58 smithi083 ceph-mon[31370]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-21T01:32:59.055 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:58 smithi083 ceph-mon[31370]: monmap epoch 3 2024-09-21T01:32:59.055 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:58 smithi083 ceph-mon[31370]: fsid f7697ecc-77b8-11ef-baf5-efdc52797490 2024-09-21T01:32:59.055 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:58 smithi083 ceph-mon[31370]: last_changed 2024-09-21T01:32:53.641071+0000 2024-09-21T01:32:59.056 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:58 smithi083 ceph-mon[31370]: created 2024-09-21T01:31:12.791840+0000 2024-09-21T01:32:59.056 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:58 smithi083 ceph-mon[31370]: min_mon_release 19 (squid) 2024-09-21T01:32:59.056 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:58 smithi083 ceph-mon[31370]: election_strategy: 1 2024-09-21T01:32:59.056 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:58 smithi083 ceph-mon[31370]: 0: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.a 2024-09-21T01:32:59.057 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:58 smithi083 ceph-mon[31370]: 1: [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] mon.c 2024-09-21T01:32:59.057 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:58 smithi083 ceph-mon[31370]: 2: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.b 2024-09-21T01:32:59.057 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:58 smithi083 ceph-mon[31370]: fsmap 2024-09-21T01:32:59.057 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:58 smithi083 ceph-mon[31370]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T01:32:59.057 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:58 smithi083 ceph-mon[31370]: mgrmap e13: x(active, since 48s) 2024-09-21T01:32:59.057 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:58 smithi083 ceph-mon[31370]: overall HEALTH_OK 2024-09-21T01:32:59.058 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:58 smithi083 ceph-mon[31370]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' 2024-09-21T01:32:59.058 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:58 smithi083 ceph-mon[31370]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' 2024-09-21T01:32:59.058 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:58 smithi083 ceph-mon[31370]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' 2024-09-21T01:32:59.058 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:58 smithi083 ceph-mon[31370]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' 2024-09-21T01:32:59.158 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-21T01:32:59.158 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":3,"fsid":"f7697ecc-77b8-11ef-baf5-efdc52797490","modified":"2024-09-21T01:32:53.641071Z","created":"2024-09-21T01:31:12.791840Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:3300","nonce":0},{"type":"v1","addr":"172.21.15.83:6789","nonce":0}]},"addr":"172.21.15.83:6789/0","public_addr":"172.21.15.83:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:3300","nonce":0},{"type":"v1","addr":"172.21.15.142:6789","nonce":0}]},"addr":"172.21.15.142:6789/0","public_addr":"172.21.15.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:3300","nonce":0},{"type":"v1","addr":"172.21.15.119:6789","nonce":0}]},"addr":"172.21.15.119:6789/0","public_addr":"172.21.15.119:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2024-09-21T01:32:59.159 INFO:teuthology.orchestra.run.smithi142.stderr:dumped monmap epoch 3 2024-09-21T01:32:59.890 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:59 smithi142 ceph-mon[34050]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:32:59.890 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:59 smithi142 ceph-mon[34050]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:32:59.890 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:59 smithi142 ceph-mon[34050]: from='client.? 172.21.15.142:0/876290847' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T01:32:59.890 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:59 smithi142 ceph-mon[34050]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T01:32:59.890 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:59 smithi142 ceph-mon[34050]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' 2024-09-21T01:32:59.890 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:32:59 smithi142 ceph-mon[34050]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' 2024-09-21T01:32:59.918 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-09-21T01:32:59.919 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph config generate-minimal-conf 2024-09-21T01:33:00.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:59 smithi083 ceph-mon[31370]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:33:00.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:59 smithi083 ceph-mon[31370]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:33:00.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:59 smithi083 ceph-mon[31370]: from='client.? 172.21.15.142:0/876290847' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T01:33:00.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:59 smithi083 ceph-mon[31370]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T01:33:00.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:59 smithi083 ceph-mon[31370]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' 2024-09-21T01:33:00.055 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:32:59 smithi083 ceph-mon[31370]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' 2024-09-21T01:33:00.179 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:33:00.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:59 smithi119 ceph-mon[33693]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:33:00.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:59 smithi119 ceph-mon[33693]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:33:00.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:59 smithi119 ceph-mon[33693]: from='client.? 172.21.15.142:0/876290847' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T01:33:00.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:59 smithi119 ceph-mon[33693]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T01:33:00.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:59 smithi119 ceph-mon[33693]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' 2024-09-21T01:33:00.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:32:59 smithi119 ceph-mon[33693]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' 2024-09-21T01:33:01.004 INFO:teuthology.orchestra.run.smithi083.stdout:# minimal ceph.conf for f7697ecc-77b8-11ef-baf5-efdc52797490 2024-09-21T01:33:01.004 INFO:teuthology.orchestra.run.smithi083.stdout:[global] 2024-09-21T01:33:01.004 INFO:teuthology.orchestra.run.smithi083.stdout: fsid = f7697ecc-77b8-11ef-baf5-efdc52797490 2024-09-21T01:33:01.004 INFO:teuthology.orchestra.run.smithi083.stdout: mon_host = [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] 2024-09-21T01:33:01.519 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:01 smithi083 ceph-mon[31370]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:33:01.519 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:01 smithi083 ceph-mon[31370]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' 2024-09-21T01:33:01.519 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:01 smithi083 ceph-mon[31370]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' 2024-09-21T01:33:01.519 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:01 smithi083 ceph-mon[31370]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:33:01.520 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:01 smithi083 ceph-mon[31370]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:33:01.520 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:01 smithi083 ceph-mon[31370]: Updating smithi083:/etc/ceph/ceph.conf 2024-09-21T01:33:01.520 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:01 smithi083 ceph-mon[31370]: Updating smithi119:/etc/ceph/ceph.conf 2024-09-21T01:33:01.520 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:01 smithi083 ceph-mon[31370]: Updating smithi142:/etc/ceph/ceph.conf 2024-09-21T01:33:01.520 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:01 smithi083 ceph-mon[31370]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' 2024-09-21T01:33:01.520 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:01 smithi083 ceph-mon[31370]: Updating smithi083:/var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T01:33:01.520 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:01 smithi083 ceph-mon[31370]: Updating smithi142:/var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T01:33:01.520 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:01 smithi083 ceph-mon[31370]: Updating smithi119:/var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T01:33:01.520 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:01 smithi083 ceph-mon[31370]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' 2024-09-21T01:33:01.520 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:01 smithi083 ceph-mon[31370]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' 2024-09-21T01:33:01.520 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:01 smithi083 ceph-mon[31370]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' 2024-09-21T01:33:01.520 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:01 smithi083 ceph-mon[31370]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' 2024-09-21T01:33:01.520 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:01 smithi083 ceph-mon[31370]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' 2024-09-21T01:33:01.520 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:01 smithi083 ceph-mon[31370]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' 2024-09-21T01:33:01.521 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:01 smithi083 ceph-mon[31370]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' 2024-09-21T01:33:01.521 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:01 smithi083 ceph-mon[31370]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' 2024-09-21T01:33:01.521 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:01 smithi083 ceph-mon[31370]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' 2024-09-21T01:33:01.521 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:01 smithi083 ceph-mon[31370]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' 2024-09-21T01:33:01.521 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:01 smithi083 ceph-mon[31370]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' 2024-09-21T01:33:01.521 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:01 smithi083 ceph-mon[31370]: Reconfiguring mon.a (unknown last config time)... 2024-09-21T01:33:01.521 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:01 smithi083 ceph-mon[31370]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T01:33:01.521 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:01 smithi083 ceph-mon[31370]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T01:33:01.521 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:01 smithi083 ceph-mon[31370]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:33:01.521 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:01 smithi083 ceph-mon[31370]: Reconfiguring daemon mon.a on smithi083 2024-09-21T01:33:01.521 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:01 smithi083 ceph-mon[31370]: from='client.? 172.21.15.83:0/2147739420' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:33:01.718 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:01 smithi119 ceph-mon[33693]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:33:01.718 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:01 smithi119 ceph-mon[33693]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' 2024-09-21T01:33:01.718 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:01 smithi119 ceph-mon[33693]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' 2024-09-21T01:33:01.718 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:01 smithi119 ceph-mon[33693]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:33:01.718 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:01 smithi119 ceph-mon[33693]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:33:01.719 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:01 smithi119 ceph-mon[33693]: Updating smithi083:/etc/ceph/ceph.conf 2024-09-21T01:33:01.719 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:01 smithi119 ceph-mon[33693]: Updating smithi119:/etc/ceph/ceph.conf 2024-09-21T01:33:01.719 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:01 smithi119 ceph-mon[33693]: Updating smithi142:/etc/ceph/ceph.conf 2024-09-21T01:33:01.719 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:01 smithi119 ceph-mon[33693]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' 2024-09-21T01:33:01.719 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:01 smithi119 ceph-mon[33693]: Updating smithi083:/var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T01:33:01.719 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:01 smithi119 ceph-mon[33693]: Updating smithi142:/var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T01:33:01.719 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:01 smithi119 ceph-mon[33693]: Updating smithi119:/var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T01:33:01.719 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:01 smithi119 ceph-mon[33693]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' 2024-09-21T01:33:01.719 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:01 smithi119 ceph-mon[33693]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' 2024-09-21T01:33:01.719 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:01 smithi119 ceph-mon[33693]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' 2024-09-21T01:33:01.719 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:01 smithi119 ceph-mon[33693]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' 2024-09-21T01:33:01.719 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:01 smithi119 ceph-mon[33693]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' 2024-09-21T01:33:01.719 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:01 smithi119 ceph-mon[33693]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' 2024-09-21T01:33:01.719 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:01 smithi119 ceph-mon[33693]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' 2024-09-21T01:33:01.719 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:01 smithi119 ceph-mon[33693]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' 2024-09-21T01:33:01.720 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:01 smithi119 ceph-mon[33693]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' 2024-09-21T01:33:01.720 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:01 smithi119 ceph-mon[33693]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' 2024-09-21T01:33:01.720 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:01 smithi119 ceph-mon[33693]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' 2024-09-21T01:33:01.720 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:01 smithi119 ceph-mon[33693]: Reconfiguring mon.a (unknown last config time)... 2024-09-21T01:33:01.720 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:01 smithi119 ceph-mon[33693]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T01:33:01.720 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:01 smithi119 ceph-mon[33693]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T01:33:01.720 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:01 smithi119 ceph-mon[33693]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:33:01.720 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:01 smithi119 ceph-mon[33693]: Reconfiguring daemon mon.a on smithi083 2024-09-21T01:33:01.720 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:01 smithi119 ceph-mon[33693]: from='client.? 172.21.15.83:0/2147739420' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:33:01.720 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:01 smithi142 ceph-mon[34050]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:33:01.720 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:01 smithi142 ceph-mon[34050]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' 2024-09-21T01:33:01.720 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:01 smithi142 ceph-mon[34050]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' 2024-09-21T01:33:01.720 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:01 smithi142 ceph-mon[34050]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:33:01.721 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:01 smithi142 ceph-mon[34050]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:33:01.721 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:01 smithi142 ceph-mon[34050]: Updating smithi083:/etc/ceph/ceph.conf 2024-09-21T01:33:01.721 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:01 smithi142 ceph-mon[34050]: Updating smithi119:/etc/ceph/ceph.conf 2024-09-21T01:33:01.721 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:01 smithi142 ceph-mon[34050]: Updating smithi142:/etc/ceph/ceph.conf 2024-09-21T01:33:01.721 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:01 smithi142 ceph-mon[34050]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' 2024-09-21T01:33:01.721 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:01 smithi142 ceph-mon[34050]: Updating smithi083:/var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T01:33:01.721 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:01 smithi142 ceph-mon[34050]: Updating smithi142:/var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T01:33:01.721 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:01 smithi142 ceph-mon[34050]: Updating smithi119:/var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T01:33:01.721 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:01 smithi142 ceph-mon[34050]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' 2024-09-21T01:33:01.721 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:01 smithi142 ceph-mon[34050]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' 2024-09-21T01:33:01.721 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:01 smithi142 ceph-mon[34050]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' 2024-09-21T01:33:01.721 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:01 smithi142 ceph-mon[34050]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' 2024-09-21T01:33:01.721 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:01 smithi142 ceph-mon[34050]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' 2024-09-21T01:33:01.721 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:01 smithi142 ceph-mon[34050]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' 2024-09-21T01:33:01.721 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:01 smithi142 ceph-mon[34050]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' 2024-09-21T01:33:01.722 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:01 smithi142 ceph-mon[34050]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' 2024-09-21T01:33:01.722 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:01 smithi142 ceph-mon[34050]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' 2024-09-21T01:33:01.722 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:01 smithi142 ceph-mon[34050]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' 2024-09-21T01:33:01.722 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:01 smithi142 ceph-mon[34050]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' 2024-09-21T01:33:01.722 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:01 smithi142 ceph-mon[34050]: Reconfiguring mon.a (unknown last config time)... 2024-09-21T01:33:01.722 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:01 smithi142 ceph-mon[34050]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T01:33:01.722 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:01 smithi142 ceph-mon[34050]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T01:33:01.722 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:01 smithi142 ceph-mon[34050]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:33:01.722 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:01 smithi142 ceph-mon[34050]: Reconfiguring daemon mon.a on smithi083 2024-09-21T01:33:01.722 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:01 smithi142 ceph-mon[34050]: from='client.? 172.21.15.83:0/2147739420' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:33:02.228 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-09-21T01:33:02.228 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-09-21T01:33:02.228 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd of=/etc/ceph/ceph.conf 2024-09-21T01:33:02.257 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-09-21T01:33:02.257 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-21T01:33:02.324 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-21T01:33:02.324 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/etc/ceph/ceph.conf 2024-09-21T01:33:02.356 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-21T01:33:02.357 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-21T01:33:02.426 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-09-21T01:33:02.426 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/etc/ceph/ceph.conf 2024-09-21T01:33:02.458 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-09-21T01:33:02.458 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-21T01:33:02.527 INFO:tasks.cephadm:enabling module snap_schedule 2024-09-21T01:33:02.527 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- sudo ceph --cluster ceph mgr module enable snap_schedule 2024-09-21T01:33:02.774 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:33:03.752 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:03 smithi142 ceph-mon[34050]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:33:03.753 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:03 smithi142 ceph-mon[34050]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' 2024-09-21T01:33:03.753 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:03 smithi142 ceph-mon[34050]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' 2024-09-21T01:33:03.753 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:03 smithi142 ceph-mon[34050]: Reconfiguring mon.b (monmap changed)... 2024-09-21T01:33:03.753 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:03 smithi142 ceph-mon[34050]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T01:33:03.753 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:03 smithi142 ceph-mon[34050]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T01:33:03.753 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:03 smithi142 ceph-mon[34050]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:33:03.753 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:03 smithi142 ceph-mon[34050]: Reconfiguring daemon mon.b on smithi119 2024-09-21T01:33:03.753 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:03 smithi142 ceph-mon[34050]: from='client.? 172.21.15.83:0/2427326631' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "snap_schedule"} : dispatch 2024-09-21T01:33:03.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:03 smithi119 ceph-mon[33693]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:33:03.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:03 smithi119 ceph-mon[33693]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' 2024-09-21T01:33:03.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:03 smithi119 ceph-mon[33693]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' 2024-09-21T01:33:03.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:03 smithi119 ceph-mon[33693]: Reconfiguring mon.b (monmap changed)... 2024-09-21T01:33:03.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:03 smithi119 ceph-mon[33693]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T01:33:03.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:03 smithi119 ceph-mon[33693]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T01:33:03.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:03 smithi119 ceph-mon[33693]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:33:03.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:03 smithi119 ceph-mon[33693]: Reconfiguring daemon mon.b on smithi119 2024-09-21T01:33:03.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:03 smithi119 ceph-mon[33693]: from='client.? 172.21.15.83:0/2427326631' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "snap_schedule"} : dispatch 2024-09-21T01:33:04.054 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 21 01:33:03 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mgr-x[31598]: ignoring --setuser ceph since I am not root 2024-09-21T01:33:04.054 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 21 01:33:03 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mgr-x[31598]: ignoring --setgroup ceph since I am not root 2024-09-21T01:33:04.055 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:03 smithi083 ceph-mon[31370]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:33:04.055 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:03 smithi083 ceph-mon[31370]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' 2024-09-21T01:33:04.055 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:03 smithi083 ceph-mon[31370]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' 2024-09-21T01:33:04.055 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:03 smithi083 ceph-mon[31370]: Reconfiguring mon.b (monmap changed)... 2024-09-21T01:33:04.055 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:03 smithi083 ceph-mon[31370]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T01:33:04.055 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:03 smithi083 ceph-mon[31370]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T01:33:04.055 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:03 smithi083 ceph-mon[31370]: from='mgr.14152 172.21.15.83:0/3412296215' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:33:04.055 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:03 smithi083 ceph-mon[31370]: Reconfiguring daemon mon.b on smithi119 2024-09-21T01:33:04.056 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:03 smithi083 ceph-mon[31370]: from='client.? 172.21.15.83:0/2427326631' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "snap_schedule"} : dispatch 2024-09-21T01:33:04.422 INFO:tasks.cephadm:Adding mgr.x on smithi083 2024-09-21T01:33:04.423 INFO:tasks.cephadm:Adding mgr.y on smithi119 2024-09-21T01:33:04.423 INFO:tasks.cephadm:Adding mgr.z on smithi142 2024-09-21T01:33:04.423 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph orch apply mgr '3;smithi083=x;smithi119=y;smithi142=z' 2024-09-21T01:33:04.673 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T01:33:05.027 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:04 smithi142 ceph-mon[34050]: from='client.? 172.21.15.83:0/2427326631' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-09-21T01:33:05.027 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:04 smithi142 ceph-mon[34050]: mgrmap e14: x(active, since 53s) 2024-09-21T01:33:05.053 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:04 smithi083 ceph-mon[31370]: from='client.? 172.21.15.83:0/2427326631' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-09-21T01:33:05.053 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:04 smithi083 ceph-mon[31370]: mgrmap e14: x(active, since 53s) 2024-09-21T01:33:05.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:04 smithi119 ceph-mon[33693]: from='client.? 172.21.15.83:0/2427326631' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-09-21T01:33:05.267 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:04 smithi119 ceph-mon[33693]: mgrmap e14: x(active, since 53s) 2024-09-21T01:33:09.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:08 smithi083 ceph-mon[31370]: Active manager daemon x restarted 2024-09-21T01:33:09.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:08 smithi083 ceph-mon[31370]: Activating manager daemon x 2024-09-21T01:33:09.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:08 smithi083 ceph-mon[31370]: osdmap e5: 0 total, 0 up, 0 in 2024-09-21T01:33:09.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:08 smithi083 ceph-mon[31370]: mgrmap e15: x(active, starting, since 0.00731665s) 2024-09-21T01:33:09.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:08 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T01:33:09.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:08 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T01:33:09.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:08 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T01:33:09.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:08 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-21T01:33:09.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:08 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-09-21T01:33:09.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:08 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-09-21T01:33:09.055 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:08 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-09-21T01:33:09.055 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:08 smithi083 ceph-mon[31370]: Manager daemon x is now available 2024-09-21T01:33:09.065 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:08 smithi119 ceph-mon[33693]: Active manager daemon x restarted 2024-09-21T01:33:09.065 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:08 smithi119 ceph-mon[33693]: Activating manager daemon x 2024-09-21T01:33:09.065 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:08 smithi119 ceph-mon[33693]: osdmap e5: 0 total, 0 up, 0 in 2024-09-21T01:33:09.065 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:08 smithi119 ceph-mon[33693]: mgrmap e15: x(active, starting, since 0.00731665s) 2024-09-21T01:33:09.065 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:08 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T01:33:09.066 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:08 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T01:33:09.066 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:08 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T01:33:09.066 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:08 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-21T01:33:09.066 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:08 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-09-21T01:33:09.066 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:08 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-09-21T01:33:09.066 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:08 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-09-21T01:33:09.066 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:08 smithi119 ceph-mon[33693]: Manager daemon x is now available 2024-09-21T01:33:09.155 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:08 smithi142 ceph-mon[34050]: Active manager daemon x restarted 2024-09-21T01:33:09.155 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:08 smithi142 ceph-mon[34050]: Activating manager daemon x 2024-09-21T01:33:09.155 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:08 smithi142 ceph-mon[34050]: osdmap e5: 0 total, 0 up, 0 in 2024-09-21T01:33:09.155 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:08 smithi142 ceph-mon[34050]: mgrmap e15: x(active, starting, since 0.00731665s) 2024-09-21T01:33:09.155 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:08 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T01:33:09.155 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:08 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T01:33:09.155 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:08 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T01:33:09.155 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:08 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-21T01:33:09.155 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:08 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-09-21T01:33:09.156 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:08 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-09-21T01:33:09.156 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:08 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-09-21T01:33:09.156 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:08 smithi142 ceph-mon[34050]: Manager daemon x is now available 2024-09-21T01:33:09.682 INFO:teuthology.orchestra.run.smithi142.stdout:Scheduled mgr update... 2024-09-21T01:33:09.964 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:09 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:33:09.964 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:09 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-21T01:33:09.965 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:09 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-21T01:33:09.965 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:09 smithi142 ceph-mon[34050]: mgrmap e16: x(active, since 1.0092s) 2024-09-21T01:33:09.965 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:09 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:33:09.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:09 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:33:09.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:09 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-21T01:33:09.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:09 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-21T01:33:09.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:09 smithi119 ceph-mon[33693]: mgrmap e16: x(active, since 1.0092s) 2024-09-21T01:33:09.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:09 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:33:10.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:09 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:33:10.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:09 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-21T01:33:10.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:09 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-21T01:33:10.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:09 smithi083 ceph-mon[31370]: mgrmap e16: x(active, since 1.0092s) 2024-09-21T01:33:10.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:09 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:33:10.285 DEBUG:teuthology.orchestra.run.smithi119:mgr.y> sudo journalctl -f -n 0 -u ceph-f7697ecc-77b8-11ef-baf5-efdc52797490@mgr.y.service 2024-09-21T01:33:10.288 DEBUG:teuthology.orchestra.run.smithi142:mgr.z> sudo journalctl -f -n 0 -u ceph-f7697ecc-77b8-11ef-baf5-efdc52797490@mgr.z.service 2024-09-21T01:33:10.290 INFO:tasks.cephadm:setting config [client] client_mount_timeout = 600 2024-09-21T01:33:10.290 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph config set client client_mount_timeout 600 2024-09-21T01:33:10.292 INFO:tasks.cephadm:setting config [client] debug_client = 20 2024-09-21T01:33:10.292 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph config set client debug_client 20 2024-09-21T01:33:10.335 INFO:tasks.cephadm:setting config [client] debug_ms = 1 2024-09-21T01:33:10.335 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph config set client debug_ms 1 2024-09-21T01:33:10.378 INFO:tasks.cephadm:setting config [client] rados_mon_op_timeout = 900 2024-09-21T01:33:10.378 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph config set client rados_mon_op_timeout 900 2024-09-21T01:33:10.421 INFO:tasks.cephadm:setting config [client] rados_osd_op_timeout = 900 2024-09-21T01:33:10.421 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph config set client rados_osd_op_timeout 900 2024-09-21T01:33:10.464 INFO:tasks.cephadm:setting config [mds] debug_mds = 20 2024-09-21T01:33:10.464 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph config set mds debug_mds 20 2024-09-21T01:33:10.508 INFO:tasks.cephadm:setting config [mds] debug_mds_balancer = 20 2024-09-21T01:33:10.508 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph config set mds debug_mds_balancer 20 2024-09-21T01:33:10.551 INFO:tasks.cephadm:setting config [mds] debug_ms = 2 2024-09-21T01:33:10.552 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph config set mds debug_ms 2 2024-09-21T01:33:10.596 INFO:tasks.cephadm:setting config [mds] mds_bal_fragment_size_max = 10000 2024-09-21T01:33:10.596 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph config set mds mds_bal_fragment_size_max 10000 2024-09-21T01:33:10.635 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:33:10.643 INFO:tasks.cephadm:setting config [mds] mds_bal_merge_size = 5 2024-09-21T01:33:10.643 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph config set mds mds_bal_merge_size 5 2024-09-21T01:33:10.697 INFO:tasks.cephadm:setting config [mds] mds_bal_split_bits = 3 2024-09-21T01:33:10.698 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph config set mds mds_bal_split_bits 3 2024-09-21T01:33:10.740 INFO:tasks.cephadm:setting config [mds] mds_bal_split_size = 100 2024-09-21T01:33:10.741 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph config set mds mds_bal_split_size 100 2024-09-21T01:33:10.785 INFO:tasks.cephadm:setting config [mds] mds_debug_frag = True 2024-09-21T01:33:10.785 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph config set mds mds_debug_frag True 2024-09-21T01:33:10.829 INFO:tasks.cephadm:setting config [mds] mds_debug_scatterstat = True 2024-09-21T01:33:10.830 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph config set mds mds_debug_scatterstat True 2024-09-21T01:33:10.859 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:10 smithi083 ceph-mon[31370]: Saving service mgr spec with placement smithi083=x;smithi119=y;smithi142=z;count:3 2024-09-21T01:33:10.859 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:10 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:33:10.859 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:10 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:33:10.860 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:10 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:33:10.860 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:10 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:33:10.860 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:10 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:33:10.860 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:10 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:33:10.860 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:10 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi119", "name": "osd_memory_target"} : dispatch 2024-09-21T01:33:10.861 INFO:tasks.cephadm:setting config [mds] mds_op_complaint_time = 180 2024-09-21T01:33:10.861 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph config set mds mds_op_complaint_time 180 2024-09-21T01:33:10.861 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 21 01:33:10 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mgr-x[31598]: 2024-09-21T01:33:10.588+0000 7f43190d1640 -1 log_channel(cephadm) log [ERR] : [21/Sep/2024:01:33:10] ENGINE Error in HTTPServer.serve 2024-09-21T01:33:10.861 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 21 01:33:10 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mgr-x[31598]: Traceback (most recent call last): 2024-09-21T01:33:10.862 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 21 01:33:10 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mgr-x[31598]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T01:33:10.862 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 21 01:33:10 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mgr-x[31598]: self._connections.run(self.expiration_interval) 2024-09-21T01:33:10.862 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 21 01:33:10 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mgr-x[31598]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T01:33:10.862 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 21 01:33:10 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mgr-x[31598]: self._run(expiration_interval) 2024-09-21T01:33:10.862 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 21 01:33:10 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mgr-x[31598]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T01:33:10.862 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 21 01:33:10 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mgr-x[31598]: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T01:33:10.862 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 21 01:33:10 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mgr-x[31598]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T01:33:10.862 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 21 01:33:10 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mgr-x[31598]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T01:33:10.862 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 21 01:33:10 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mgr-x[31598]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T01:33:10.862 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 21 01:33:10 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mgr-x[31598]: s = self.context.wrap_socket( 2024-09-21T01:33:10.862 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 21 01:33:10 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mgr-x[31598]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T01:33:10.862 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 21 01:33:10 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mgr-x[31598]: return self.sslsocket_class._create( 2024-09-21T01:33:10.862 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 21 01:33:10 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mgr-x[31598]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T01:33:10.862 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 21 01:33:10 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mgr-x[31598]: self.do_handshake() 2024-09-21T01:33:10.863 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 21 01:33:10 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mgr-x[31598]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T01:33:10.863 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 21 01:33:10 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mgr-x[31598]: self._sslobj.do_handshake() 2024-09-21T01:33:10.863 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 21 01:33:10 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mgr-x[31598]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T01:33:10.863 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 21 01:33:10 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mgr-x[31598]: 2024-09-21T01:33:10.906 INFO:tasks.cephadm:setting config [mds] mds_verify_scatter = True 2024-09-21T01:33:10.906 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph config set mds mds_verify_scatter True 2024-09-21T01:33:10.957 INFO:tasks.cephadm:setting config [mds] osd_op_complaint_time = 180 2024-09-21T01:33:10.957 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph config set mds osd_op_complaint_time 180 2024-09-21T01:33:11.016 INFO:tasks.cephadm:setting config [mds] rados_mon_op_timeout = 900 2024-09-21T01:33:11.016 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph config set mds rados_mon_op_timeout 900 2024-09-21T01:33:11.088 INFO:tasks.cephadm:setting config [mds] rados_osd_op_timeout = 900 2024-09-21T01:33:11.089 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph config set mds rados_osd_op_timeout 900 2024-09-21T01:33:11.137 INFO:tasks.cephadm:setting config [mgr] client_mount_timeout = 30 2024-09-21T01:33:11.137 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph config set mgr client_mount_timeout 30 2024-09-21T01:33:11.193 INFO:tasks.cephadm:setting config [mgr] debug_cephsqlite = 20 2024-09-21T01:33:11.193 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph config set mgr debug_cephsqlite 20 2024-09-21T01:33:11.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:10 smithi142 ceph-mon[34050]: Saving service mgr spec with placement smithi083=x;smithi119=y;smithi142=z;count:3 2024-09-21T01:33:11.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:10 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:33:11.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:10 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:33:11.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:10 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:33:11.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:10 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:33:11.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:10 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:33:11.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:10 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:33:11.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:10 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi119", "name": "osd_memory_target"} : dispatch 2024-09-21T01:33:11.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:10 smithi119 ceph-mon[33693]: Saving service mgr spec with placement smithi083=x;smithi119=y;smithi142=z;count:3 2024-09-21T01:33:11.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:10 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:33:11.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:10 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:33:11.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:10 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:33:11.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:10 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:33:11.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:10 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:33:11.219 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:10 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:33:11.219 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:10 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi119", "name": "osd_memory_target"} : dispatch 2024-09-21T01:33:11.237 INFO:tasks.cephadm:setting config [mgr] debug_client = 20 2024-09-21T01:33:11.238 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph config set mgr debug_client 20 2024-09-21T01:33:11.290 INFO:tasks.cephadm:setting config [mgr] debug_mgr = 20 2024-09-21T01:33:11.291 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph config set mgr debug_mgr 20 2024-09-21T01:33:11.349 INFO:tasks.cephadm:setting config [mgr] debug_ms = 1 2024-09-21T01:33:11.350 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph config set mgr debug_ms 1 2024-09-21T01:33:11.451 INFO:tasks.cephadm:setting config [mgr] mgr/snap_schedule/allow_m_granularity = True 2024-09-21T01:33:11.451 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2024-09-21T01:33:11.452 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:33:11.464 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:33:11.466 INFO:tasks.cephadm:setting config [mgr] mgr/snap_schedule/dump_on_update = True 2024-09-21T01:33:11.466 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph config set mgr mgr/snap_schedule/dump_on_update True 2024-09-21T01:33:11.516 INFO:tasks.cephadm:setting config [mgr] mgr/snap_schedule/log_level = debug 2024-09-21T01:33:11.516 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph config set mgr mgr/snap_schedule/log_level debug 2024-09-21T01:33:11.544 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:33:11.560 INFO:tasks.cephadm:setting config [mgr] mon_warn_on_pool_no_app = False 2024-09-21T01:33:11.560 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph config set mgr mon_warn_on_pool_no_app False 2024-09-21T01:33:11.610 INFO:tasks.cephadm:setting config [mon] mon_op_complaint_time = 120 2024-09-21T01:33:11.610 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph config set mon mon_op_complaint_time 120 2024-09-21T01:33:11.659 INFO:tasks.cephadm:setting config [osd] osd_op_complaint_time = 180 2024-09-21T01:33:11.659 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph config set osd osd_op_complaint_time 180 2024-09-21T01:33:11.714 DEBUG:tasks.cephadm:set 30 configs 2024-09-21T01:33:11.714 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'f7697ecc-77b8-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'client', 'client_mount_timeout', '600'], check_status=True, hostname='smithi083') 2024-09-21T01:33:11.904 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:11 smithi083 ceph-mon[31370]: [21/Sep/2024:01:33:10] ENGINE Bus STARTING 2024-09-21T01:33:11.905 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:11 smithi083 ceph-mon[31370]: [21/Sep/2024:01:33:10] ENGINE Error in HTTPServer.serve 2024-09-21T01:33:11.905 INFO:journalctl@ceph.mon.a.smithi083.stdout: Traceback (most recent call last): 2024-09-21T01:33:11.905 INFO:journalctl@ceph.mon.a.smithi083.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T01:33:11.905 INFO:journalctl@ceph.mon.a.smithi083.stdout: self._connections.run(self.expiration_interval) 2024-09-21T01:33:11.905 INFO:journalctl@ceph.mon.a.smithi083.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T01:33:11.905 INFO:journalctl@ceph.mon.a.smithi083.stdout: self._run(expiration_interval) 2024-09-21T01:33:11.905 INFO:journalctl@ceph.mon.a.smithi083.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T01:33:11.905 INFO:journalctl@ceph.mon.a.smithi083.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T01:33:11.905 INFO:journalctl@ceph.mon.a.smithi083.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T01:33:11.905 INFO:journalctl@ceph.mon.a.smithi083.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T01:33:11.905 INFO:journalctl@ceph.mon.a.smithi083.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T01:33:11.905 INFO:journalctl@ceph.mon.a.smithi083.stdout: s = self.context.wrap_socket( 2024-09-21T01:33:11.905 INFO:journalctl@ceph.mon.a.smithi083.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T01:33:11.906 INFO:journalctl@ceph.mon.a.smithi083.stdout: return self.sslsocket_class._create( 2024-09-21T01:33:11.906 INFO:journalctl@ceph.mon.a.smithi083.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T01:33:11.906 INFO:journalctl@ceph.mon.a.smithi083.stdout: self.do_handshake() 2024-09-21T01:33:11.906 INFO:journalctl@ceph.mon.a.smithi083.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T01:33:11.906 INFO:journalctl@ceph.mon.a.smithi083.stdout: self._sslobj.do_handshake() 2024-09-21T01:33:11.906 INFO:journalctl@ceph.mon.a.smithi083.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T01:33:11.906 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:11 smithi083 ceph-mon[31370]: [21/Sep/2024:01:33:10] ENGINE Serving on https://172.21.15.83:7150 2024-09-21T01:33:11.906 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:11 smithi083 ceph-mon[31370]: [21/Sep/2024:01:33:10] ENGINE Serving on http://172.21.15.83:8765 2024-09-21T01:33:11.906 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:11 smithi083 ceph-mon[31370]: [21/Sep/2024:01:33:10] ENGINE Bus STARTED 2024-09-21T01:33:11.906 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:11 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:33:11.906 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:11 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:33:11.906 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:11 smithi083 ceph-mon[31370]: mgrmap e17: x(active, since 2s) 2024-09-21T01:33:11.906 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:11 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:33:11.906 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:11 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:33:11.906 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:11 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi142", "name": "osd_memory_target"} : dispatch 2024-09-21T01:33:11.907 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:11 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:33:11.907 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:11 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:33:11.907 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:11 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi083", "name": "osd_memory_target"} : dispatch 2024-09-21T01:33:11.907 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:11 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:33:11.907 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:11 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:33:12.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:11 smithi142 ceph-mon[34050]: [21/Sep/2024:01:33:10] ENGINE Bus STARTING 2024-09-21T01:33:12.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:11 smithi142 ceph-mon[34050]: [21/Sep/2024:01:33:10] ENGINE Error in HTTPServer.serve 2024-09-21T01:33:12.215 INFO:journalctl@ceph.mon.c.smithi142.stdout: Traceback (most recent call last): 2024-09-21T01:33:12.215 INFO:journalctl@ceph.mon.c.smithi142.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T01:33:12.215 INFO:journalctl@ceph.mon.c.smithi142.stdout: self._connections.run(self.expiration_interval) 2024-09-21T01:33:12.215 INFO:journalctl@ceph.mon.c.smithi142.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T01:33:12.215 INFO:journalctl@ceph.mon.c.smithi142.stdout: self._run(expiration_interval) 2024-09-21T01:33:12.215 INFO:journalctl@ceph.mon.c.smithi142.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T01:33:12.215 INFO:journalctl@ceph.mon.c.smithi142.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T01:33:12.215 INFO:journalctl@ceph.mon.c.smithi142.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T01:33:12.215 INFO:journalctl@ceph.mon.c.smithi142.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T01:33:12.216 INFO:journalctl@ceph.mon.c.smithi142.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T01:33:12.216 INFO:journalctl@ceph.mon.c.smithi142.stdout: s = self.context.wrap_socket( 2024-09-21T01:33:12.216 INFO:journalctl@ceph.mon.c.smithi142.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T01:33:12.216 INFO:journalctl@ceph.mon.c.smithi142.stdout: return self.sslsocket_class._create( 2024-09-21T01:33:12.216 INFO:journalctl@ceph.mon.c.smithi142.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T01:33:12.216 INFO:journalctl@ceph.mon.c.smithi142.stdout: self.do_handshake() 2024-09-21T01:33:12.216 INFO:journalctl@ceph.mon.c.smithi142.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T01:33:12.216 INFO:journalctl@ceph.mon.c.smithi142.stdout: self._sslobj.do_handshake() 2024-09-21T01:33:12.216 INFO:journalctl@ceph.mon.c.smithi142.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T01:33:12.216 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:11 smithi142 ceph-mon[34050]: [21/Sep/2024:01:33:10] ENGINE Serving on https://172.21.15.83:7150 2024-09-21T01:33:12.216 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:11 smithi142 ceph-mon[34050]: [21/Sep/2024:01:33:10] ENGINE Serving on http://172.21.15.83:8765 2024-09-21T01:33:12.216 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:11 smithi142 ceph-mon[34050]: [21/Sep/2024:01:33:10] ENGINE Bus STARTED 2024-09-21T01:33:12.216 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:11 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:33:12.216 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:11 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:33:12.216 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:11 smithi142 ceph-mon[34050]: mgrmap e17: x(active, since 2s) 2024-09-21T01:33:12.217 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:11 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:33:12.217 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:11 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:33:12.217 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:11 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi142", "name": "osd_memory_target"} : dispatch 2024-09-21T01:33:12.217 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:11 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:33:12.217 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:11 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:33:12.217 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:11 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi083", "name": "osd_memory_target"} : dispatch 2024-09-21T01:33:12.217 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:11 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:33:12.217 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:11 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:33:12.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:11 smithi119 ceph-mon[33693]: [21/Sep/2024:01:33:10] ENGINE Bus STARTING 2024-09-21T01:33:12.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:11 smithi119 ceph-mon[33693]: [21/Sep/2024:01:33:10] ENGINE Error in HTTPServer.serve 2024-09-21T01:33:12.218 INFO:journalctl@ceph.mon.b.smithi119.stdout: Traceback (most recent call last): 2024-09-21T01:33:12.218 INFO:journalctl@ceph.mon.b.smithi119.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T01:33:12.218 INFO:journalctl@ceph.mon.b.smithi119.stdout: self._connections.run(self.expiration_interval) 2024-09-21T01:33:12.218 INFO:journalctl@ceph.mon.b.smithi119.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T01:33:12.218 INFO:journalctl@ceph.mon.b.smithi119.stdout: self._run(expiration_interval) 2024-09-21T01:33:12.218 INFO:journalctl@ceph.mon.b.smithi119.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T01:33:12.218 INFO:journalctl@ceph.mon.b.smithi119.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T01:33:12.218 INFO:journalctl@ceph.mon.b.smithi119.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T01:33:12.218 INFO:journalctl@ceph.mon.b.smithi119.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T01:33:12.218 INFO:journalctl@ceph.mon.b.smithi119.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T01:33:12.218 INFO:journalctl@ceph.mon.b.smithi119.stdout: s = self.context.wrap_socket( 2024-09-21T01:33:12.218 INFO:journalctl@ceph.mon.b.smithi119.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T01:33:12.219 INFO:journalctl@ceph.mon.b.smithi119.stdout: return self.sslsocket_class._create( 2024-09-21T01:33:12.219 INFO:journalctl@ceph.mon.b.smithi119.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T01:33:12.219 INFO:journalctl@ceph.mon.b.smithi119.stdout: self.do_handshake() 2024-09-21T01:33:12.219 INFO:journalctl@ceph.mon.b.smithi119.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T01:33:12.219 INFO:journalctl@ceph.mon.b.smithi119.stdout: self._sslobj.do_handshake() 2024-09-21T01:33:12.219 INFO:journalctl@ceph.mon.b.smithi119.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T01:33:12.219 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:11 smithi119 ceph-mon[33693]: [21/Sep/2024:01:33:10] ENGINE Serving on https://172.21.15.83:7150 2024-09-21T01:33:12.219 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:11 smithi119 ceph-mon[33693]: [21/Sep/2024:01:33:10] ENGINE Serving on http://172.21.15.83:8765 2024-09-21T01:33:12.219 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:11 smithi119 ceph-mon[33693]: [21/Sep/2024:01:33:10] ENGINE Bus STARTED 2024-09-21T01:33:12.219 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:11 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:33:12.219 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:11 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:33:12.219 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:11 smithi119 ceph-mon[33693]: mgrmap e17: x(active, since 2s) 2024-09-21T01:33:12.219 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:11 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:33:12.219 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:11 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:33:12.219 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:11 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi142", "name": "osd_memory_target"} : dispatch 2024-09-21T01:33:12.220 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:11 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:33:12.220 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:11 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:33:12.220 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:11 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi083", "name": "osd_memory_target"} : dispatch 2024-09-21T01:33:12.220 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:11 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:33:12.220 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:11 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:33:12.947 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:12 smithi083 ceph-mon[31370]: Updating smithi083:/etc/ceph/ceph.conf 2024-09-21T01:33:12.947 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:12 smithi083 ceph-mon[31370]: Updating smithi119:/etc/ceph/ceph.conf 2024-09-21T01:33:12.947 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:12 smithi083 ceph-mon[31370]: Updating smithi142:/etc/ceph/ceph.conf 2024-09-21T01:33:12.947 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:12 smithi083 ceph-mon[31370]: Updating smithi119:/var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T01:33:12.947 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:12 smithi083 ceph-mon[31370]: Updating smithi142:/var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T01:33:12.947 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:12 smithi083 ceph-mon[31370]: from='client.? ' entity='client.admin' 2024-09-21T01:33:12.948 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:12 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:33:12.948 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:12 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:33:12.948 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:12 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:33:12.948 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:12 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:33:12.948 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:12 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:33:12.948 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:12 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:33:12.948 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:12 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:33:12.948 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:12 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T01:33:12.948 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:12 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T01:33:12.948 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:12 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T01:33:12.948 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:12 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:33:13.137 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:12 smithi142 ceph-mon[34050]: Updating smithi083:/etc/ceph/ceph.conf 2024-09-21T01:33:13.138 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:12 smithi142 ceph-mon[34050]: Updating smithi119:/etc/ceph/ceph.conf 2024-09-21T01:33:13.138 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:12 smithi142 ceph-mon[34050]: Updating smithi142:/etc/ceph/ceph.conf 2024-09-21T01:33:13.138 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:12 smithi142 ceph-mon[34050]: Updating smithi119:/var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T01:33:13.138 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:12 smithi142 ceph-mon[34050]: Updating smithi142:/var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T01:33:13.138 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:12 smithi142 ceph-mon[34050]: from='client.? ' entity='client.admin' 2024-09-21T01:33:13.138 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:12 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:33:13.138 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:12 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:33:13.138 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:12 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:33:13.138 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:12 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:33:13.138 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:12 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:33:13.138 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:12 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:33:13.139 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:12 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:33:13.139 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:12 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T01:33:13.139 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:12 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T01:33:13.139 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:12 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T01:33:13.139 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:12 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:33:13.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:12 smithi119 ceph-mon[33693]: Updating smithi083:/etc/ceph/ceph.conf 2024-09-21T01:33:13.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:12 smithi119 ceph-mon[33693]: Updating smithi119:/etc/ceph/ceph.conf 2024-09-21T01:33:13.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:12 smithi119 ceph-mon[33693]: Updating smithi142:/etc/ceph/ceph.conf 2024-09-21T01:33:13.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:12 smithi119 ceph-mon[33693]: Updating smithi119:/var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T01:33:13.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:12 smithi119 ceph-mon[33693]: Updating smithi142:/var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T01:33:13.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:12 smithi119 ceph-mon[33693]: from='client.? ' entity='client.admin' 2024-09-21T01:33:13.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:12 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:33:13.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:12 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:33:13.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:12 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:33:13.219 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:12 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:33:13.219 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:12 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:33:13.219 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:12 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:33:13.219 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:12 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:33:13.219 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:12 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T01:33:13.219 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:12 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T01:33:13.219 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:12 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T01:33:13.219 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:12 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:33:14.053 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:13 smithi083 ceph-mon[31370]: Updating smithi119:/etc/ceph/ceph.client.admin.keyring 2024-09-21T01:33:14.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:13 smithi083 ceph-mon[31370]: Updating smithi142:/etc/ceph/ceph.client.admin.keyring 2024-09-21T01:33:14.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:13 smithi083 ceph-mon[31370]: Updating smithi119:/var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T01:33:14.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:13 smithi083 ceph-mon[31370]: Updating smithi142:/var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T01:33:14.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:13 smithi083 ceph-mon[31370]: Updating smithi083:/var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T01:33:14.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:13 smithi083 ceph-mon[31370]: Updating smithi083:/etc/ceph/ceph.client.admin.keyring 2024-09-21T01:33:14.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:13 smithi083 ceph-mon[31370]: Updating smithi083:/var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T01:33:14.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:13 smithi083 ceph-mon[31370]: Deploying daemon mgr.z on smithi142 2024-09-21T01:33:14.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:13 smithi083 ceph-mon[31370]: from='client.? 172.21.15.83:0/2753831838' entity='client.admin' 2024-09-21T01:33:14.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:13 smithi083 ceph-mon[31370]: from='client.? 172.21.15.83:0/3482477038' entity='client.admin' 2024-09-21T01:33:14.077 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:13 smithi142 ceph-mon[34050]: Updating smithi119:/etc/ceph/ceph.client.admin.keyring 2024-09-21T01:33:14.077 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:13 smithi142 ceph-mon[34050]: Updating smithi142:/etc/ceph/ceph.client.admin.keyring 2024-09-21T01:33:14.077 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:13 smithi142 ceph-mon[34050]: Updating smithi119:/var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T01:33:14.077 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:13 smithi142 ceph-mon[34050]: Updating smithi142:/var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T01:33:14.077 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:13 smithi142 ceph-mon[34050]: Updating smithi083:/var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T01:33:14.077 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:13 smithi142 ceph-mon[34050]: Updating smithi083:/etc/ceph/ceph.client.admin.keyring 2024-09-21T01:33:14.077 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:13 smithi142 ceph-mon[34050]: Updating smithi083:/var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T01:33:14.077 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:13 smithi142 ceph-mon[34050]: Deploying daemon mgr.z on smithi142 2024-09-21T01:33:14.077 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:13 smithi142 ceph-mon[34050]: from='client.? 172.21.15.83:0/2753831838' entity='client.admin' 2024-09-21T01:33:14.077 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:13 smithi142 ceph-mon[34050]: from='client.? 172.21.15.83:0/3482477038' entity='client.admin' 2024-09-21T01:33:14.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:13 smithi119 ceph-mon[33693]: Updating smithi119:/etc/ceph/ceph.client.admin.keyring 2024-09-21T01:33:14.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:13 smithi119 ceph-mon[33693]: Updating smithi142:/etc/ceph/ceph.client.admin.keyring 2024-09-21T01:33:14.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:13 smithi119 ceph-mon[33693]: Updating smithi119:/var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T01:33:14.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:13 smithi119 ceph-mon[33693]: Updating smithi142:/var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T01:33:14.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:13 smithi119 ceph-mon[33693]: Updating smithi083:/var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T01:33:14.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:13 smithi119 ceph-mon[33693]: Updating smithi083:/etc/ceph/ceph.client.admin.keyring 2024-09-21T01:33:14.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:13 smithi119 ceph-mon[33693]: Updating smithi083:/var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T01:33:14.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:13 smithi119 ceph-mon[33693]: Deploying daemon mgr.z on smithi142 2024-09-21T01:33:14.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:13 smithi119 ceph-mon[33693]: from='client.? 172.21.15.83:0/2753831838' entity='client.admin' 2024-09-21T01:33:14.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:13 smithi119 ceph-mon[33693]: from='client.? 172.21.15.83:0/3482477038' entity='client.admin' 2024-09-21T01:33:14.464 INFO:journalctl@ceph.mgr.z.smithi142.stdout:Sep 21 01:33:14 smithi142 systemd[1]: Starting Ceph mgr.z for f7697ecc-77b8-11ef-baf5-efdc52797490... 2024-09-21T01:33:14.707 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:14.706+0000 7f6827c77640 1 -- 172.21.15.83:0/850566017 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f680c03fb70 msgr2=0x7f680c042080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:33:14.707 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:14.706+0000 7f6827c77640 1 --2- 172.21.15.83:0/850566017 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f680c03fb70 0x7f680c042080 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f682007a1c0 tx=0x7f6810005f90 comp rx=0 tx=0).stop 2024-09-21T01:33:14.707 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:14.706+0000 7f6827c77640 1 -- 172.21.15.83:0/850566017 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f68201049b0 msgr2=0x7f682019a1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:33:14.707 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:14.706+0000 7f6827c77640 1 --2- 172.21.15.83:0/850566017 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f68201049b0 0x7f682019a1a0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f681c005ec0 tx=0x7f681c032b10 comp rx=0 tx=0).stop 2024-09-21T01:33:14.707 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:14.706+0000 7f6827c77640 1 -- 172.21.15.83:0/850566017 shutdown_connections 2024-09-21T01:33:14.707 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:14.706+0000 7f6827c77640 1 --2- 172.21.15.83:0/850566017 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f680c03fb70 0x7f680c042080 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:14.707 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:14.706+0000 7f6827c77640 1 --2- 172.21.15.83:0/850566017 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f682010de10 0x7f682019f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:14.707 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:14.706+0000 7f6827c77640 1 --2- 172.21.15.83:0/850566017 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6820105300 0x7f682019a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:14.707 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:14.706+0000 7f6827c77640 1 --2- 172.21.15.83:0/850566017 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f68201049b0 0x7f682019a1a0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:14.707 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:14.706+0000 7f6827c77640 1 -- 172.21.15.83:0/850566017 >> 172.21.15.83:0/850566017 conn(0x7f6820079730 msgr2=0x7f68200ff890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:33:14.707 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:14.706+0000 7f6827c77640 1 -- 172.21.15.83:0/850566017 shutdown_connections 2024-09-21T01:33:14.708 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:14.706+0000 7f6827c77640 1 -- 172.21.15.83:0/850566017 wait complete. 2024-09-21T01:33:14.787 INFO:journalctl@ceph.mgr.z.smithi142.stdout:Sep 21 01:33:14 smithi142 podman[35919]: 2024-09-21 01:33:14.386201968 +0000 UTC m=+0.016007597 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T01:33:14.787 INFO:journalctl@ceph.mgr.z.smithi142.stdout:Sep 21 01:33:14 smithi142 podman[35919]: 2024-09-21 01:33:14.484201605 +0000 UTC m=+0.114007224 container create 430c2f99376b4c8ea3d23ae3c0679c79c907044494b5b07b8db4d19aabf3dfff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mgr-z, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-09-21T01:33:14.787 INFO:journalctl@ceph.mgr.z.smithi142.stdout:Sep 21 01:33:14 smithi142 podman[35919]: 2024-09-21 01:33:14.686841755 +0000 UTC m=+0.316647378 container init 430c2f99376b4c8ea3d23ae3c0679c79c907044494b5b07b8db4d19aabf3dfff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mgr-z, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-21T01:33:14.787 INFO:journalctl@ceph.mgr.z.smithi142.stdout:Sep 21 01:33:14 smithi142 podman[35919]: 2024-09-21 01:33:14.689581849 +0000 UTC m=+0.319387468 container start 430c2f99376b4c8ea3d23ae3c0679c79c907044494b5b07b8db4d19aabf3dfff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mgr-z, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T01:33:14.787 INFO:journalctl@ceph.mgr.z.smithi142.stdout:Sep 21 01:33:14 smithi142 ceph-mgr[35938]: -- 172.21.15.142:0/630268849 <== mon.1 v2:172.21.15.142:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5588741330e0 con 0x558874151a80 2024-09-21T01:33:14.787 INFO:journalctl@ceph.mgr.z.smithi142.stdout:Sep 21 01:33:14 smithi142 bash[35919]: 430c2f99376b4c8ea3d23ae3c0679c79c907044494b5b07b8db4d19aabf3dfff 2024-09-21T01:33:15.214 INFO:journalctl@ceph.mgr.z.smithi142.stdout:Sep 21 01:33:14 smithi142 systemd[1]: Started Ceph mgr.z for f7697ecc-77b8-11ef-baf5-efdc52797490. 2024-09-21T01:33:15.513 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'f7697ecc-77b8-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'client', 'debug_client', '20'], check_status=True, hostname='smithi083') 2024-09-21T01:33:15.514 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'f7697ecc-77b8-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'client', 'debug_ms', '1'], check_status=True, hostname='smithi083') 2024-09-21T01:33:15.804 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:15 smithi083 ceph-mon[31370]: from='client.? 172.21.15.83:0/850566017' entity='client.admin' 2024-09-21T01:33:15.804 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:15 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:33:15.804 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:15 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:33:15.804 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:15 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:33:15.804 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:15 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T01:33:15.804 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:15 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T01:33:15.804 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:15 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T01:33:15.804 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:15 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:33:15.958 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'f7697ecc-77b8-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'client', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi083') 2024-09-21T01:33:15.964 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:15 smithi142 ceph-mon[34050]: from='client.? 172.21.15.83:0/850566017' entity='client.admin' 2024-09-21T01:33:15.964 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:15 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:33:15.965 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:15 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:33:15.965 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:15 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:33:15.965 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:15 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T01:33:15.965 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:15 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T01:33:15.965 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:15 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T01:33:15.965 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:15 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:33:15.967 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:15 smithi119 ceph-mon[33693]: from='client.? 172.21.15.83:0/850566017' entity='client.admin' 2024-09-21T01:33:15.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:15 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:33:15.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:15 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:33:15.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:15 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:33:15.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:15 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T01:33:15.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:15 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T01:33:15.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:15 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T01:33:15.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:15 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:33:16.008 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:33:16.011 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:33:16.020 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:33:16.032 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:33:16.038 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:33:16.043 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:33:16.087 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:33:16.107 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:33:16.564 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:16.562+0000 7f902abbd640 1 -- 172.21.15.83:0/2789324236 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9024108d10 msgr2=0x7f902410f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:33:16.564 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:16.562+0000 7f902abbd640 1 --2- 172.21.15.83:0/2789324236 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9024108d10 0x7f902410f540 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f901c009ca0 tx=0x7f901c02a8c0 comp rx=0 tx=0).stop 2024-09-21T01:33:16.564 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:16.562+0000 7f902abbd640 1 -- 172.21.15.83:0/2789324236 shutdown_connections 2024-09-21T01:33:16.564 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:16.562+0000 7f902abbd640 1 --2- 172.21.15.83:0/2789324236 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9024108d10 0x7f902410f540 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:16.565 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:16.562+0000 7f902abbd640 1 --2- 172.21.15.83:0/2789324236 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f90241083c0 0x7f90241087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:16.565 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:16.562+0000 7f902abbd640 1 --2- 172.21.15.83:0/2789324236 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9024102a80 0x7f9024102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:16.565 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:16.562+0000 7f902abbd640 1 -- 172.21.15.83:0/2789324236 >> 172.21.15.83:0/2789324236 conn(0x7f9024079740 msgr2=0x7f9024079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:33:16.565 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:16.562+0000 7f902abbd640 1 -- 172.21.15.83:0/2789324236 shutdown_connections 2024-09-21T01:33:16.565 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:16.562+0000 7f902abbd640 1 -- 172.21.15.83:0/2789324236 wait complete. 2024-09-21T01:33:16.565 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:16.563+0000 7f902abbd640 1 Processor -- start 2024-09-21T01:33:16.565 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:16.563+0000 7f902abbd640 1 -- start start 2024-09-21T01:33:16.565 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:16.563+0000 7f902abbd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9024102a80 0x7f902419b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:33:16.565 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:16.563+0000 7f902abbd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f90241083c0 0x7f902419b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:33:16.565 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:16.563+0000 7f902abbd640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9024108d10 0x7f902419bb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:33:16.565 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:16.563+0000 7f902abbd640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f90241125f0 con 0x7f9024102a80 2024-09-21T01:33:16.566 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:16.563+0000 7f902abbd640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f9024112470 con 0x7f90241083c0 2024-09-21T01:33:16.566 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:16.563+0000 7f902abbd640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f9024112770 con 0x7f9024108d10 2024-09-21T01:33:16.566 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:16.563+0000 7f9028959640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9024102a80 0x7f902419b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:33:16.566 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:16.563+0000 7f9028959640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9024102a80 0x7f902419b080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:53768/0 (socket says 172.21.15.83:53768) 2024-09-21T01:33:16.566 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:16.563+0000 7f9028959640 1 -- 172.21.15.83:0/3254646689 learned_addr learned my addr 172.21.15.83:0/3254646689 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:33:16.566 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:16.564+0000 7f902915a640 1 --2- 172.21.15.83:0/3254646689 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9024108d10 0x7f902419bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:33:16.566 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:16.564+0000 7f9023fff640 1 --2- 172.21.15.83:0/3254646689 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f90241083c0 0x7f902419b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:33:16.566 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:16.564+0000 7f9028959640 1 -- 172.21.15.83:0/3254646689 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9024108d10 msgr2=0x7f902419bb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:33:16.566 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:16.564+0000 7f9028959640 1 --2- 172.21.15.83:0/3254646689 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9024108d10 0x7f902419bb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:16.566 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:16.564+0000 7f9028959640 1 -- 172.21.15.83:0/3254646689 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f90241083c0 msgr2=0x7f902419b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:33:16.567 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:16.564+0000 7f9028959640 1 --2- 172.21.15.83:0/3254646689 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f90241083c0 0x7f902419b5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:16.567 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:16.564+0000 7f9028959640 1 -- 172.21.15.83:0/3254646689 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90241a6280 con 0x7f9024102a80 2024-09-21T01:33:16.567 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:16.564+0000 7f9028959640 1 --2- 172.21.15.83:0/3254646689 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9024102a80 0x7f902419b080 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f901800d770 tx=0x7f901800db70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:33:16.568 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:16.564+0000 7f9021ffb640 1 -- 172.21.15.83:0/3254646689 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9018017070 con 0x7f9024102a80 2024-09-21T01:33:16.568 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:16.564+0000 7f9021ffb640 1 -- 172.21.15.83:0/3254646689 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(23 keys) ==== 1001+0+0 (secure 0 0 0) 0x7f9018009820 con 0x7f9024102a80 2024-09-21T01:33:16.568 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:16.564+0000 7f902abbd640 1 -- 172.21.15.83:0/3254646689 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90241a6570 con 0x7f9024102a80 2024-09-21T01:33:16.568 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:16.564+0000 7f9021ffb640 1 -- 172.21.15.83:0/3254646689 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9018004a00 con 0x7f9024102a80 2024-09-21T01:33:16.568 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:16.564+0000 7f902abbd640 1 -- 172.21.15.83:0/3254646689 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90241a6a60 con 0x7f9024102a80 2024-09-21T01:33:16.568 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:16.565+0000 7f9021ffb640 1 -- 172.21.15.83:0/3254646689 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 17) ==== 51915+0+0 (secure 0 0 0) 0x7f9018004ba0 con 0x7f9024102a80 2024-09-21T01:33:16.568 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:16.565+0000 7f902abbd640 1 -- 172.21.15.83:0/3254646689 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9024102e90 con 0x7f9024102a80 2024-09-21T01:33:16.568 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:16.565+0000 7f9021ffb640 1 --2- 172.21.15.83:0/3254646689 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f901403fba0 0x7f90140420b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:33:16.568 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:16.566+0000 7f9021ffb640 1 -- 172.21.15.83:0/3254646689 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f9018053f60 con 0x7f9024102a80 2024-09-21T01:33:16.568 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:16.566+0000 7f9023fff640 1 --2- 172.21.15.83:0/3254646689 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f901403fba0 0x7f90140420b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:33:16.569 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:16.566+0000 7f9023fff640 1 --2- 172.21.15.83:0/3254646689 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f901403fba0 0x7f90140420b0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f9024079db0 tx=0x7f901000a2d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:33:16.571 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:16.571+0000 7f9021ffb640 1 -- 172.21.15.83:0/3254646689 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f90180099d0 con 0x7f9024102a80 2024-09-21T01:33:16.705 INFO:journalctl@ceph.mgr.y.smithi119.stdout:Sep 21 01:33:16 smithi119 systemd[1]: Starting Ceph mgr.y for f7697ecc-77b8-11ef-baf5-efdc52797490... 2024-09-21T01:33:16.756 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:16.755+0000 7f902abbd640 1 -- 172.21.15.83:0/3254646689 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command([{prefix=config set, name=mds_bal_merge_size}] v 0) -- 0x7f902410ab00 con 0x7f9024102a80 2024-09-21T01:33:16.756 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:16 smithi083 ceph-mon[31370]: Deploying daemon mgr.y on smithi119 2024-09-21T01:33:16.761 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:16.761+0000 7f9021ffb640 1 -- 172.21.15.83:0/3254646689 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_merge_size}]=0 v14)=0 v14) ==== 116+0+0 (secure 0 0 0) 0x7f9018009cf0 con 0x7f9024102a80 2024-09-21T01:33:16.764 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:16.763+0000 7f902abbd640 1 -- 172.21.15.83:0/3254646689 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f901403fba0 msgr2=0x7f90140420b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:33:16.764 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:16.763+0000 7f902abbd640 1 --2- 172.21.15.83:0/3254646689 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f901403fba0 0x7f90140420b0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f9024079db0 tx=0x7f901000a2d0 comp rx=0 tx=0).stop 2024-09-21T01:33:16.764 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:16.763+0000 7f902abbd640 1 -- 172.21.15.83:0/3254646689 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9024102a80 msgr2=0x7f902419b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:33:16.764 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:16.763+0000 7f902abbd640 1 --2- 172.21.15.83:0/3254646689 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9024102a80 0x7f902419b080 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f901800d770 tx=0x7f901800db70 comp rx=0 tx=0).stop 2024-09-21T01:33:16.764 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:16.763+0000 7f902abbd640 1 -- 172.21.15.83:0/3254646689 shutdown_connections 2024-09-21T01:33:16.764 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:16.763+0000 7f902abbd640 1 --2- 172.21.15.83:0/3254646689 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f901403fba0 0x7f90140420b0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:16.764 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:16.763+0000 7f902abbd640 1 --2- 172.21.15.83:0/3254646689 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9024108d10 0x7f902419bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:16.764 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:16.763+0000 7f902abbd640 1 --2- 172.21.15.83:0/3254646689 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f90241083c0 0x7f902419b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:16.764 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:16.763+0000 7f902abbd640 1 --2- 172.21.15.83:0/3254646689 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9024102a80 0x7f902419b080 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:16.764 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:16.763+0000 7f902abbd640 1 -- 172.21.15.83:0/3254646689 >> 172.21.15.83:0/3254646689 conn(0x7f9024079740 msgr2=0x7f90241045d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:33:16.765 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:16.763+0000 7f902abbd640 1 -- 172.21.15.83:0/3254646689 shutdown_connections 2024-09-21T01:33:16.765 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:16.763+0000 7f902abbd640 1 -- 172.21.15.83:0/3254646689 wait complete. 2024-09-21T01:33:16.964 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:16 smithi142 ceph-mon[34050]: Deploying daemon mgr.y on smithi119 2024-09-21T01:33:16.967 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:16 smithi119 ceph-mon[33693]: Deploying daemon mgr.y on smithi119 2024-09-21T01:33:16.967 INFO:journalctl@ceph.mgr.y.smithi119.stdout:Sep 21 01:33:16 smithi119 podman[35202]: 2024-09-21 01:33:16.69992959 +0000 UTC m=+0.015509356 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T01:33:16.967 INFO:journalctl@ceph.mgr.y.smithi119.stdout:Sep 21 01:33:16 smithi119 podman[35202]: 2024-09-21 01:33:16.810387925 +0000 UTC m=+0.125967741 container create ecc355a207af0a8bd5212e227a513be9ed498579e44e7f7c453f19b32d05f3ec (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mgr-y, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T01:33:17.341 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:17.331+0000 7f51134d0640 1 -- 172.21.15.83:0/3260624218 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f510c105300 msgr2=0x7f510c10d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:33:17.341 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:17.331+0000 7f51134d0640 1 --2- 172.21.15.83:0/3260624218 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f510c105300 0x7f510c10d850 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f5100009900 tx=0x7f510002a410 comp rx=0 tx=0).stop 2024-09-21T01:33:17.341 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:17.331+0000 7f51134d0640 1 -- 172.21.15.83:0/3260624218 shutdown_connections 2024-09-21T01:33:17.341 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:17.331+0000 7f51134d0640 1 --2- 172.21.15.83:0/3260624218 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f510c10de10 0x7f510c110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:17.341 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:17.331+0000 7f51134d0640 1 --2- 172.21.15.83:0/3260624218 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f510c105300 0x7f510c10d850 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:17.341 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:17.331+0000 7f51134d0640 1 --2- 172.21.15.83:0/3260624218 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f510c1049b0 0x7f510c104dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:17.341 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:17.331+0000 7f51134d0640 1 -- 172.21.15.83:0/3260624218 >> 172.21.15.83:0/3260624218 conn(0x7f510c079730 msgr2=0x7f510c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:33:17.341 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:17.331+0000 7f51134d0640 1 -- 172.21.15.83:0/3260624218 shutdown_connections 2024-09-21T01:33:17.341 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:17.331+0000 7f51134d0640 1 -- 172.21.15.83:0/3260624218 wait complete. 2024-09-21T01:33:17.341 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:17.332+0000 7f51134d0640 1 Processor -- start 2024-09-21T01:33:17.341 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:17.332+0000 7f51134d0640 1 -- start start 2024-09-21T01:33:17.342 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:17.332+0000 7f51134d0640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f510c1049b0 0x7f510c1026f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:33:17.342 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:17.332+0000 7f51134d0640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f510c105300 0x7f510c102c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:33:17.342 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:17.332+0000 7f51134d0640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f510c10de10 0x7f510c103170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:33:17.342 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:17.332+0000 7f51134d0640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f510c1136e0 con 0x7f510c10de10 2024-09-21T01:33:17.342 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:17.332+0000 7f51134d0640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f510c113560 con 0x7f510c1049b0 2024-09-21T01:33:17.342 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:17.332+0000 7f51134d0640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f510c113860 con 0x7f510c105300 2024-09-21T01:33:17.342 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:17.332+0000 7f5111a6d640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f510c10de10 0x7f510c103170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:33:17.342 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:17.332+0000 7f5111a6d640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f510c10de10 0x7f510c103170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:53798/0 (socket says 172.21.15.83:53798) 2024-09-21T01:33:17.342 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:17.332+0000 7f5111a6d640 1 -- 172.21.15.83:0/2620668251 learned_addr learned my addr 172.21.15.83:0/2620668251 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:33:17.342 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:17.332+0000 7f511126c640 1 --2- 172.21.15.83:0/2620668251 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f510c1049b0 0x7f510c1026f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:33:17.342 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:17.332+0000 7f5110a6b640 1 --2- 172.21.15.83:0/2620668251 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f510c105300 0x7f510c102c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:33:17.342 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:17.332+0000 7f5111a6d640 1 -- 172.21.15.83:0/2620668251 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f510c105300 msgr2=0x7f510c102c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:33:17.343 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:17.332+0000 7f5111a6d640 1 --2- 172.21.15.83:0/2620668251 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f510c105300 0x7f510c102c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:17.343 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:17.332+0000 7f5111a6d640 1 -- 172.21.15.83:0/2620668251 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f510c1049b0 msgr2=0x7f510c1026f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:33:17.343 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:17.332+0000 7f5111a6d640 1 --2- 172.21.15.83:0/2620668251 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f510c1049b0 0x7f510c1026f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:17.343 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:17.332+0000 7f5111a6d640 1 -- 172.21.15.83:0/2620668251 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f510c1a8550 con 0x7f510c10de10 2024-09-21T01:33:17.343 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:17.333+0000 7f5111a6d640 1 --2- 172.21.15.83:0/2620668251 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f510c10de10 0x7f510c103170 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f510400d950 tx=0x7f510400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:33:17.343 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:17.333+0000 7f510a7fc640 1 -- 172.21.15.83:0/2620668251 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5104017030 con 0x7f510c10de10 2024-09-21T01:33:17.343 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:17.333+0000 7f510a7fc640 1 -- 172.21.15.83:0/2620668251 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(23 keys) ==== 1001+0+0 (secure 0 0 0) 0x7f5104004020 con 0x7f510c10de10 2024-09-21T01:33:17.343 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:17.333+0000 7f51134d0640 1 -- 172.21.15.83:0/2620668251 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f510c1a8840 con 0x7f510c10de10 2024-09-21T01:33:17.343 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:17.333+0000 7f510a7fc640 1 -- 172.21.15.83:0/2620668251 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51040038f0 con 0x7f510c10de10 2024-09-21T01:33:17.343 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:17.333+0000 7f51134d0640 1 -- 172.21.15.83:0/2620668251 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f510c1a8d00 con 0x7f510c10de10 2024-09-21T01:33:17.343 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:17.334+0000 7f510a7fc640 1 -- 172.21.15.83:0/2620668251 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 17) ==== 51915+0+0 (secure 0 0 0) 0x7f510401a070 con 0x7f510c10de10 2024-09-21T01:33:17.343 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:17.334+0000 7f51134d0640 1 -- 172.21.15.83:0/2620668251 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f510c104dc0 con 0x7f510c10de10 2024-09-21T01:33:17.343 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:17.334+0000 7f510a7fc640 1 --2- 172.21.15.83:0/2620668251 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f50f403fb70 0x7f50f4042080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:33:17.344 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:17.334+0000 7f510a7fc640 1 -- 172.21.15.83:0/2620668251 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f5104053d60 con 0x7f510c10de10 2024-09-21T01:33:17.344 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:17.334+0000 7f511126c640 1 --2- 172.21.15.83:0/2620668251 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f50f403fb70 0x7f50f4042080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:33:17.344 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:17.335+0000 7f511126c640 1 --2- 172.21.15.83:0/2620668251 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f50f403fb70 0x7f50f4042080 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f510c104140 tx=0x7f50fc009500 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:33:17.344 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:17.339+0000 7f510a7fc640 1 -- 172.21.15.83:0/2620668251 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f5104021070 con 0x7f510c10de10 2024-09-21T01:33:17.468 INFO:journalctl@ceph.mgr.y.smithi119.stdout:Sep 21 01:33:17 smithi119 podman[35202]: 2024-09-21 01:33:17.021227156 +0000 UTC m=+0.336806911 container init ecc355a207af0a8bd5212e227a513be9ed498579e44e7f7c453f19b32d05f3ec (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mgr-y, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True) 2024-09-21T01:33:17.468 INFO:journalctl@ceph.mgr.y.smithi119.stdout:Sep 21 01:33:17 smithi119 podman[35202]: 2024-09-21 01:33:17.024476837 +0000 UTC m=+0.340056579 container start ecc355a207af0a8bd5212e227a513be9ed498579e44e7f7c453f19b32d05f3ec (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mgr-y, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-21T01:33:17.468 INFO:journalctl@ceph.mgr.y.smithi119.stdout:Sep 21 01:33:17 smithi119 ceph-mgr[35221]: -- 172.21.15.119:0/3089553296 <== mon.2 v2:172.21.15.119:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x561e686410e0 con 0x561e6d3e4000 2024-09-21T01:33:17.468 INFO:journalctl@ceph.mgr.y.smithi119.stdout:Sep 21 01:33:17 smithi119 bash[35202]: ecc355a207af0a8bd5212e227a513be9ed498579e44e7f7c453f19b32d05f3ec 2024-09-21T01:33:17.468 INFO:journalctl@ceph.mgr.y.smithi119.stdout:Sep 21 01:33:17 smithi119 systemd[1]: Started Ceph mgr.y for f7697ecc-77b8-11ef-baf5-efdc52797490. 2024-09-21T01:33:17.519 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:17.519+0000 7f51134d0640 1 -- 172.21.15.83:0/2620668251 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) -- 0x7f510c108f10 con 0x7f510c10de10 2024-09-21T01:33:17.525 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:17.524+0000 7f510a7fc640 1 -- 172.21.15.83:0/2620668251 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v15)=0 v15) ==== 106+0+0 (secure 0 0 0) 0x7f510401b3b0 con 0x7f510c10de10 2024-09-21T01:33:17.527 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:17.527+0000 7f51134d0640 1 -- 172.21.15.83:0/2620668251 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f50f403fb70 msgr2=0x7f50f4042080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:33:17.527 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:17.527+0000 7f51134d0640 1 --2- 172.21.15.83:0/2620668251 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f50f403fb70 0x7f50f4042080 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f510c104140 tx=0x7f50fc009500 comp rx=0 tx=0).stop 2024-09-21T01:33:17.528 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:17.527+0000 7f51134d0640 1 -- 172.21.15.83:0/2620668251 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f510c10de10 msgr2=0x7f510c103170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:33:17.528 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:17.527+0000 7f51134d0640 1 --2- 172.21.15.83:0/2620668251 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f510c10de10 0x7f510c103170 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f510400d950 tx=0x7f510400de10 comp rx=0 tx=0).stop 2024-09-21T01:33:17.528 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:17.527+0000 7f51134d0640 1 -- 172.21.15.83:0/2620668251 shutdown_connections 2024-09-21T01:33:17.528 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:17.527+0000 7f51134d0640 1 --2- 172.21.15.83:0/2620668251 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f50f403fb70 0x7f50f4042080 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:17.528 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:17.527+0000 7f51134d0640 1 --2- 172.21.15.83:0/2620668251 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f510c10de10 0x7f510c103170 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:17.528 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:17.527+0000 7f51134d0640 1 --2- 172.21.15.83:0/2620668251 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f510c105300 0x7f510c102c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:17.528 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:17.527+0000 7f51134d0640 1 --2- 172.21.15.83:0/2620668251 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f510c1049b0 0x7f510c1026f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:17.528 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:17.527+0000 7f51134d0640 1 -- 172.21.15.83:0/2620668251 >> 172.21.15.83:0/2620668251 conn(0x7f510c079730 msgr2=0x7f510c0ff940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:33:17.528 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:17.527+0000 7f51134d0640 1 -- 172.21.15.83:0/2620668251 shutdown_connections 2024-09-21T01:33:17.528 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:17.527+0000 7f51134d0640 1 -- 172.21.15.83:0/2620668251 wait complete. 2024-09-21T01:33:18.032 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:17 smithi119 ceph-mon[33693]: from='client.? 172.21.15.83:0/3254646689' entity='client.admin' 2024-09-21T01:33:18.032 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:17 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:33:18.032 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:17 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:33:18.032 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:17 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:33:18.032 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:17 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:33:18.032 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:17 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:33:18.032 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:17 smithi119 ceph-mon[33693]: from='client.? 172.21.15.83:0/2620668251' entity='client.admin' 2024-09-21T01:33:18.053 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:17 smithi083 ceph-mon[31370]: from='client.? 172.21.15.83:0/3254646689' entity='client.admin' 2024-09-21T01:33:18.053 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:17 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:33:18.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:17 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:33:18.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:17 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:33:18.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:17 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:33:18.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:17 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:33:18.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:17 smithi083 ceph-mon[31370]: from='client.? 172.21.15.83:0/2620668251' entity='client.admin' 2024-09-21T01:33:18.142 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:17 smithi142 ceph-mon[34050]: from='client.? 172.21.15.83:0/3254646689' entity='client.admin' 2024-09-21T01:33:18.142 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:17 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:33:18.142 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:17 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:33:18.142 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:17 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:33:18.142 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:17 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:33:18.142 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:17 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:33:18.142 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:17 smithi142 ceph-mon[34050]: from='client.? 172.21.15.83:0/2620668251' entity='client.admin' 2024-09-21T01:33:18.409 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:33:18.409 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:33:18.410 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:33:18.911 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:18.910+0000 7f934b59e640 1 -- 172.21.15.83:0/2184101582 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9344105110 msgr2=0x7f934410d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:33:18.911 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:18.910+0000 7f934b59e640 1 --2- 172.21.15.83:0/2184101582 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9344105110 0x7f934410d660 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f933c009900 tx=0x7f933c02a410 comp rx=0 tx=0).stop 2024-09-21T01:33:18.911 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:18.910+0000 7f934b59e640 1 -- 172.21.15.83:0/2184101582 shutdown_connections 2024-09-21T01:33:18.911 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:18.910+0000 7f934b59e640 1 --2- 172.21.15.83:0/2184101582 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f934410dc20 0x7f9344110110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:18.911 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:18.910+0000 7f934b59e640 1 --2- 172.21.15.83:0/2184101582 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9344105110 0x7f934410d660 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:18.911 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:18.910+0000 7f934b59e640 1 --2- 172.21.15.83:0/2184101582 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f93441047c0 0x7f9344104bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:18.911 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:18.910+0000 7f934b59e640 1 -- 172.21.15.83:0/2184101582 >> 172.21.15.83:0/2184101582 conn(0x7f93440fe2c0 msgr2=0x7f9344100710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:33:18.911 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:18.910+0000 7f934b59e640 1 -- 172.21.15.83:0/2184101582 shutdown_connections 2024-09-21T01:33:18.911 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:18.910+0000 7f934b59e640 1 -- 172.21.15.83:0/2184101582 wait complete. 2024-09-21T01:33:18.915 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:18.911+0000 7f934b59e640 1 Processor -- start 2024-09-21T01:33:18.915 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:18.911+0000 7f934b59e640 1 -- start start 2024-09-21T01:33:18.915 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:18.911+0000 7f934b59e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f93441047c0 0x7f9344102500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:33:18.915 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:18.911+0000 7f934b59e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9344105110 0x7f9344102a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:33:18.915 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:18.911+0000 7f934b59e640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f934410dc20 0x7f9344102f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:33:18.915 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:18.911+0000 7f934b59e640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f93441134f0 con 0x7f934410dc20 2024-09-21T01:33:18.915 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:18.911+0000 7f934b59e640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f9344113370 con 0x7f9344105110 2024-09-21T01:33:18.915 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:18.911+0000 7f934b59e640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f9344113670 con 0x7f93441047c0 2024-09-21T01:33:18.915 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:18.911+0000 7f934ad9d640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f934410dc20 0x7f9344102f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:33:18.915 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:18.911+0000 7f934ad9d640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f934410dc20 0x7f9344102f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:53826/0 (socket says 172.21.15.83:53826) 2024-09-21T01:33:18.915 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:18.911+0000 7f934ad9d640 1 -- 172.21.15.83:0/3159778815 learned_addr learned my addr 172.21.15.83:0/3159778815 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:33:18.915 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:18.911+0000 7f9349d9b640 1 --2- 172.21.15.83:0/3159778815 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9344105110 0x7f9344102a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:33:18.915 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:18.911+0000 7f934a59c640 1 --2- 172.21.15.83:0/3159778815 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f93441047c0 0x7f9344102500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:33:18.916 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:18.911+0000 7f934ad9d640 1 -- 172.21.15.83:0/3159778815 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f93441047c0 msgr2=0x7f9344102500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:33:18.916 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:18.911+0000 7f934ad9d640 1 --2- 172.21.15.83:0/3159778815 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f93441047c0 0x7f9344102500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:18.916 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:18.911+0000 7f934ad9d640 1 -- 172.21.15.83:0/3159778815 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9344105110 msgr2=0x7f9344102a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:33:18.916 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:18.911+0000 7f934ad9d640 1 --2- 172.21.15.83:0/3159778815 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9344105110 0x7f9344102a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:18.916 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:18.911+0000 7f934ad9d640 1 -- 172.21.15.83:0/3159778815 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93441a8320 con 0x7f934410dc20 2024-09-21T01:33:18.916 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:18.912+0000 7f934ad9d640 1 --2- 172.21.15.83:0/3159778815 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f934410dc20 0x7f9344102f80 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f934000eaa0 tx=0x7f934000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:33:18.916 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:18.912+0000 7f93377fe640 1 -- 172.21.15.83:0/3159778815 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f934000cdb0 con 0x7f934410dc20 2024-09-21T01:33:18.916 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:18.912+0000 7f93377fe640 1 -- 172.21.15.83:0/3159778815 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(23 keys) ==== 1001+0+0 (secure 0 0 0) 0x7f9340005020 con 0x7f934410dc20 2024-09-21T01:33:18.916 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:18.912+0000 7f934b59e640 1 -- 172.21.15.83:0/3159778815 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93441a8610 con 0x7f934410dc20 2024-09-21T01:33:18.916 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:18.912+0000 7f93377fe640 1 -- 172.21.15.83:0/3159778815 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93400116d0 con 0x7f934410dc20 2024-09-21T01:33:18.916 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:18.912+0000 7f934b59e640 1 -- 172.21.15.83:0/3159778815 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93441a8ad0 con 0x7f934410dc20 2024-09-21T01:33:18.916 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:18.913+0000 7f93377fe640 1 -- 172.21.15.83:0/3159778815 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 17) ==== 51915+0+0 (secure 0 0 0) 0x7f9340011870 con 0x7f934410dc20 2024-09-21T01:33:18.916 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:18.913+0000 7f934b59e640 1 -- 172.21.15.83:0/3159778815 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9344104bd0 con 0x7f934410dc20 2024-09-21T01:33:18.916 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:18.913+0000 7f93377fe640 1 --2- 172.21.15.83:0/3159778815 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f933003fb70 0x7f9330042080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:33:18.917 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:18.913+0000 7f93377fe640 1 -- 172.21.15.83:0/3159778815 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f93400548a0 con 0x7f934410dc20 2024-09-21T01:33:18.917 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:18.913+0000 7f934a59c640 1 --2- 172.21.15.83:0/3159778815 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f933003fb70 0x7f9330042080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:33:18.917 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:18.914+0000 7f934a59c640 1 --2- 172.21.15.83:0/3159778815 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f933003fb70 0x7f9330042080 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f9344103f50 tx=0x7f9338005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:33:18.918 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:18.918+0000 7f93377fe640 1 -- 172.21.15.83:0/3159778815 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f9340016030 con 0x7f934410dc20 2024-09-21T01:33:19.080 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:19.080+0000 7f81968aa640 1 -- 172.21.15.83:0/3577448466 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f81901094b0 msgr2=0x7f81901098c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:33:19.081 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:19.080+0000 7f81968aa640 1 --2- 172.21.15.83:0/3577448466 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f81901094b0 0x7f81901098c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f8184009900 tx=0x7f818402a410 comp rx=0 tx=0).stop 2024-09-21T01:33:19.081 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:19.080+0000 7f81968aa640 1 -- 172.21.15.83:0/3577448466 shutdown_connections 2024-09-21T01:33:19.081 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:19.080+0000 7f81968aa640 1 --2- 172.21.15.83:0/3577448466 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8190109e00 0x7f8190110630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:19.081 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:19.080+0000 7f81968aa640 1 --2- 172.21.15.83:0/3577448466 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f81901094b0 0x7f81901098c0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:19.081 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:19.080+0000 7f81968aa640 1 --2- 172.21.15.83:0/3577448466 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8190101f70 0x7f8190102380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:19.081 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:19.080+0000 7f81968aa640 1 -- 172.21.15.83:0/3577448466 >> 172.21.15.83:0/3577448466 conn(0x7f8190077c60 msgr2=0x7f81900780a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:33:19.081 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:19.080+0000 7f81968aa640 1 -- 172.21.15.83:0/3577448466 shutdown_connections 2024-09-21T01:33:19.081 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:19.080+0000 7f81968aa640 1 -- 172.21.15.83:0/3577448466 wait complete. 2024-09-21T01:33:19.083 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:19.081+0000 7f81968aa640 1 Processor -- start 2024-09-21T01:33:19.083 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:19.081+0000 7f81968aa640 1 -- start start 2024-09-21T01:33:19.083 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:19.081+0000 7f81968aa640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8190101f70 0x7f819019a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:33:19.083 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:19.081+0000 7f81968aa640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f81901094b0 0x7f819019a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:33:19.083 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:19.081+0000 7f81968aa640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8190109e00 0x7f819019fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:33:19.083 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:19.081+0000 7f81968aa640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f8190113780 con 0x7f81901094b0 2024-09-21T01:33:19.083 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:19.082+0000 7f81968aa640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f8190113600 con 0x7f8190101f70 2024-09-21T01:33:19.083 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:19.082+0000 7f81968aa640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f8190113900 con 0x7f8190109e00 2024-09-21T01:33:19.084 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:19.082+0000 7f818f7fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f81901094b0 0x7f819019a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:33:19.084 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:19.082+0000 7f818ffff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8190101f70 0x7f819019a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:33:19.084 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:19.082+0000 7f818f7fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f81901094b0 0x7f819019a770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:53844/0 (socket says 172.21.15.83:53844) 2024-09-21T01:33:19.084 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:19.082+0000 7f818f7fe640 1 -- 172.21.15.83:0/3266841043 learned_addr learned my addr 172.21.15.83:0/3266841043 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:33:19.084 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:19.082+0000 7f818ffff640 1 --2- 172.21.15.83:0/3266841043 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8190101f70 0x7f819019a1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.83:47810/0 (socket says 172.21.15.83:47810) 2024-09-21T01:33:19.084 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:19.082+0000 7f8194e47640 1 --2- 172.21.15.83:0/3266841043 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8190109e00 0x7f819019fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:33:19.084 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:19.082+0000 7f818ffff640 1 -- 172.21.15.83:0/3266841043 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8190109e00 msgr2=0x7f819019fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:33:19.084 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:19.082+0000 7f818ffff640 1 --2- 172.21.15.83:0/3266841043 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8190109e00 0x7f819019fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:19.084 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:19.082+0000 7f818ffff640 1 -- 172.21.15.83:0/3266841043 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f81901094b0 msgr2=0x7f819019a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:33:19.084 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:19.082+0000 7f818ffff640 1 --2- 172.21.15.83:0/3266841043 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f81901094b0 0x7f819019a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:19.084 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:19.082+0000 7f818ffff640 1 -- 172.21.15.83:0/3266841043 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81901a0140 con 0x7f8190101f70 2024-09-21T01:33:19.084 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:19.082+0000 7f818f7fe640 1 --2- 172.21.15.83:0/3266841043 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f81901094b0 0x7f819019a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:33:19.084 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:19.082+0000 7f8194e47640 1 --2- 172.21.15.83:0/3266841043 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8190109e00 0x7f819019fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:33:19.084 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:19.082+0000 7f818ffff640 1 --2- 172.21.15.83:0/3266841043 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8190101f70 0x7f819019a1d0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f818000e9f0 tx=0x7f818000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:33:19.085 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:19.082+0000 7f818d7fa640 1 -- 172.21.15.83:0/3266841043 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f818000ccc0 con 0x7f8190101f70 2024-09-21T01:33:19.085 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:19.082+0000 7f818d7fa640 1 -- 172.21.15.83:0/3266841043 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(23 keys) ==== 1001+0+0 (secure 0 0 0) 0x7f8180010880 con 0x7f8190101f70 2024-09-21T01:33:19.085 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:19.082+0000 7f818d7fa640 1 -- 172.21.15.83:0/3266841043 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8180018660 con 0x7f8190101f70 2024-09-21T01:33:19.085 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:19.082+0000 7f81968aa640 1 -- 172.21.15.83:0/3266841043 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81901a0430 con 0x7f8190101f70 2024-09-21T01:33:19.085 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:19.083+0000 7f81968aa640 1 -- 172.21.15.83:0/3266841043 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81901a6b90 con 0x7f8190101f70 2024-09-21T01:33:19.085 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:19.083+0000 7f818d7fa640 1 -- 172.21.15.83:0/3266841043 <== mon.2 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 17) ==== 51915+0+0 (secure 0 0 0) 0x7f8180018800 con 0x7f8190101f70 2024-09-21T01:33:19.086 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:19.084+0000 7f818d7fa640 1 --2- 172.21.15.83:0/3266841043 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f817803fb70 0x7f8178042080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:33:19.086 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:19.084+0000 7f818d7fa640 1 -- 172.21.15.83:0/3266841043 <== mon.2 v2:172.21.15.119:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f81800556f0 con 0x7f8190101f70 2024-09-21T01:33:19.086 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:19.084+0000 7f81968aa640 1 -- 172.21.15.83:0/3266841043 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8190102380 con 0x7f8190101f70 2024-09-21T01:33:19.086 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:19.084+0000 7f818f7fe640 1 --2- 172.21.15.83:0/3266841043 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f817803fb70 0x7f8178042080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:33:19.086 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:19.084+0000 7f818f7fe640 1 --2- 172.21.15.83:0/3266841043 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f817803fb70 0x7f8178042080 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f8184006010 tx=0x7f8184005a20 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:33:19.089 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:19.089+0000 7f818d7fa640 1 -- 172.21.15.83:0/3266841043 <== mon.2 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8180020e10 con 0x7f8190101f70 2024-09-21T01:33:19.109 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:19.109+0000 7f934b59e640 1 -- 172.21.15.83:0/3159778815 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_bits}] v 0) -- 0x7f9344108d20 con 0x7f934410dc20 2024-09-21T01:33:19.113 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:19.112+0000 7f93377fe640 1 -- 172.21.15.83:0/3159778815 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_bits}]=0 v16)=0 v16) ==== 116+0+0 (secure 0 0 0) 0x7f93400051d0 con 0x7f934410dc20 2024-09-21T01:33:19.118 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:19.115+0000 7f934b59e640 1 -- 172.21.15.83:0/3159778815 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f933003fb70 msgr2=0x7f9330042080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:33:19.118 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:19.115+0000 7f934b59e640 1 --2- 172.21.15.83:0/3159778815 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f933003fb70 0x7f9330042080 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f9344103f50 tx=0x7f9338005f90 comp rx=0 tx=0).stop 2024-09-21T01:33:19.118 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:19.115+0000 7f934b59e640 1 -- 172.21.15.83:0/3159778815 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f934410dc20 msgr2=0x7f9344102f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:33:19.118 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:19.115+0000 7f934b59e640 1 --2- 172.21.15.83:0/3159778815 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f934410dc20 0x7f9344102f80 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f934000eaa0 tx=0x7f934000ef60 comp rx=0 tx=0).stop 2024-09-21T01:33:19.118 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:19.115+0000 7f934b59e640 1 -- 172.21.15.83:0/3159778815 shutdown_connections 2024-09-21T01:33:19.118 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:19.115+0000 7f934b59e640 1 --2- 172.21.15.83:0/3159778815 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f933003fb70 0x7f9330042080 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:19.118 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:19.115+0000 7f934b59e640 1 --2- 172.21.15.83:0/3159778815 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f934410dc20 0x7f9344102f80 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:19.118 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:19.115+0000 7f934b59e640 1 --2- 172.21.15.83:0/3159778815 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9344105110 0x7f9344102a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:19.118 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:19.115+0000 7f934b59e640 1 --2- 172.21.15.83:0/3159778815 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f93441047c0 0x7f9344102500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:19.118 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:19.115+0000 7f934b59e640 1 -- 172.21.15.83:0/3159778815 >> 172.21.15.83:0/3159778815 conn(0x7f93440fe2c0 msgr2=0x7f93440fecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:33:19.118 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:19.115+0000 7f934b59e640 1 -- 172.21.15.83:0/3159778815 shutdown_connections 2024-09-21T01:33:19.118 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:19.115+0000 7f934b59e640 1 -- 172.21.15.83:0/3159778815 wait complete. 2024-09-21T01:33:19.278 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:19.277+0000 7f81968aa640 1 -- 172.21.15.83:0/3266841043 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command([{prefix=config set, name=debug_mds}] v 0) -- 0x7f819010bb80 con 0x7f8190101f70 2024-09-21T01:33:19.283 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:19.282+0000 7f818d7fa640 1 -- 172.21.15.83:0/3266841043 <== mon.2 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mds}]=0 v17)=0 v17) ==== 108+0+0 (secure 0 0 0) 0x7f818001fe00 con 0x7f8190101f70 2024-09-21T01:33:19.285 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:19.285+0000 7f81968aa640 1 -- 172.21.15.83:0/3266841043 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f817803fb70 msgr2=0x7f8178042080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:33:19.286 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:19.285+0000 7f81968aa640 1 --2- 172.21.15.83:0/3266841043 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f817803fb70 0x7f8178042080 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f8184006010 tx=0x7f8184005a20 comp rx=0 tx=0).stop 2024-09-21T01:33:19.286 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:19.285+0000 7f81968aa640 1 -- 172.21.15.83:0/3266841043 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8190101f70 msgr2=0x7f819019a1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:33:19.286 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:19.285+0000 7f81968aa640 1 --2- 172.21.15.83:0/3266841043 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8190101f70 0x7f819019a1d0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f818000e9f0 tx=0x7f818000eeb0 comp rx=0 tx=0).stop 2024-09-21T01:33:19.286 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:19.285+0000 7f81968aa640 1 -- 172.21.15.83:0/3266841043 shutdown_connections 2024-09-21T01:33:19.286 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:19.285+0000 7f81968aa640 1 --2- 172.21.15.83:0/3266841043 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f817803fb70 0x7f8178042080 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:19.286 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:19.285+0000 7f81968aa640 1 --2- 172.21.15.83:0/3266841043 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8190109e00 0x7f819019fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:19.286 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:19.285+0000 7f81968aa640 1 --2- 172.21.15.83:0/3266841043 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f81901094b0 0x7f819019a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:19.286 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:19.285+0000 7f81968aa640 1 --2- 172.21.15.83:0/3266841043 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8190101f70 0x7f819019a1d0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:19.286 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:19.285+0000 7f81968aa640 1 -- 172.21.15.83:0/3266841043 >> 172.21.15.83:0/3266841043 conn(0x7f8190077c60 msgr2=0x7f8190107660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:33:19.286 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:19.285+0000 7f81968aa640 1 -- 172.21.15.83:0/3266841043 shutdown_connections 2024-09-21T01:33:19.286 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:19.285+0000 7f81968aa640 1 -- 172.21.15.83:0/3266841043 wait complete. 2024-09-21T01:33:19.380 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:19 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:33:19.380 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:19 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:33:19.380 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:19 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:33:19.380 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:19 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:33:19.380 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:19 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:33:19.380 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:19 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:33:19.380 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:19 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:33:19.381 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:19 smithi083 ceph-mon[31370]: Reconfiguring mgr.x (unknown last config time)... 2024-09-21T01:33:19.381 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:19 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T01:33:19.381 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:19 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T01:33:19.381 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:19 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:33:19.381 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:19 smithi083 ceph-mon[31370]: Reconfiguring daemon mgr.x on smithi083 2024-09-21T01:33:19.381 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:19 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:33:19.381 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:19 smithi083 ceph-mon[31370]: from='client.? 172.21.15.83:0/3159778815' entity='client.admin' 2024-09-21T01:33:19.381 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:19 smithi083 ceph-mon[31370]: from='client.? ' entity='client.admin' 2024-09-21T01:33:19.715 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:19 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:33:19.715 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:19 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:33:19.715 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:19 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:33:19.715 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:19 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:33:19.715 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:19 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:33:19.715 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:19 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:33:19.715 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:19 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:33:19.715 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:19 smithi142 ceph-mon[34050]: Reconfiguring mgr.x (unknown last config time)... 2024-09-21T01:33:19.715 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:19 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T01:33:19.715 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:19 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T01:33:19.715 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:19 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:33:19.716 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:19 smithi142 ceph-mon[34050]: Reconfiguring daemon mgr.x on smithi083 2024-09-21T01:33:19.716 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:19 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:33:19.716 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:19 smithi142 ceph-mon[34050]: from='client.? 172.21.15.83:0/3159778815' entity='client.admin' 2024-09-21T01:33:19.716 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:19 smithi142 ceph-mon[34050]: from='client.? ' entity='client.admin' 2024-09-21T01:33:19.718 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:19 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:33:19.718 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:19 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:33:19.718 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:19 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:33:19.718 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:19 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:33:19.718 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:19 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:33:19.718 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:19 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:33:19.718 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:19 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:33:19.718 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:19 smithi119 ceph-mon[33693]: Reconfiguring mgr.x (unknown last config time)... 2024-09-21T01:33:19.718 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:19 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T01:33:19.718 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:19 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T01:33:19.719 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:19 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:33:19.719 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:19 smithi119 ceph-mon[33693]: Reconfiguring daemon mgr.x on smithi083 2024-09-21T01:33:19.719 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:19 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:33:19.719 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:19 smithi119 ceph-mon[33693]: from='client.? 172.21.15.83:0/3159778815' entity='client.admin' 2024-09-21T01:33:19.719 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:19 smithi119 ceph-mon[33693]: from='client.? ' entity='client.admin' 2024-09-21T01:33:19.857 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:19.857+0000 7f3539018640 1 -- 172.21.15.83:0/1739493628 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f35341083a0 msgr2=0x7f35341087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:33:19.857 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:19.857+0000 7f3539018640 1 --2- 172.21.15.83:0/1739493628 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f35341083a0 0x7f35341087b0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f3528009900 tx=0x7f352802a3f0 comp rx=0 tx=0).stop 2024-09-21T01:33:19.857 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:19.857+0000 7f3539018640 1 -- 172.21.15.83:0/1739493628 shutdown_connections 2024-09-21T01:33:19.857 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:19.857+0000 7f3539018640 1 --2- 172.21.15.83:0/1739493628 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3534108cf0 0x7f353410f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:19.858 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:19.857+0000 7f3539018640 1 --2- 172.21.15.83:0/1739493628 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f35341083a0 0x7f35341087b0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:19.858 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:19.857+0000 7f3539018640 1 --2- 172.21.15.83:0/1739493628 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3534102a60 0x7f3534102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:19.858 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:19.857+0000 7f3539018640 1 -- 172.21.15.83:0/1739493628 >> 172.21.15.83:0/1739493628 conn(0x7f3534079730 msgr2=0x7f3534079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:33:19.858 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:19.857+0000 7f3539018640 1 -- 172.21.15.83:0/1739493628 shutdown_connections 2024-09-21T01:33:19.858 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:19.857+0000 7f3539018640 1 -- 172.21.15.83:0/1739493628 wait complete. 2024-09-21T01:33:19.860 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:19.857+0000 7f3539018640 1 Processor -- start 2024-09-21T01:33:19.860 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:19.858+0000 7f3539018640 1 -- start start 2024-09-21T01:33:19.860 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:19.858+0000 7f3539018640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3534102a60 0x7f353419a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:33:19.860 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:19.858+0000 7f3539018640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f35341083a0 0x7f353419a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:33:19.860 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:19.858+0000 7f3539018640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3534108cf0 0x7f353419fa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:33:19.860 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:19.858+0000 7f3539018640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f3534113720 con 0x7f35341083a0 2024-09-21T01:33:19.860 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:19.858+0000 7f3539018640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f35341135a0 con 0x7f3534108cf0 2024-09-21T01:33:19.860 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:19.858+0000 7f3539018640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f35341138a0 con 0x7f3534102a60 2024-09-21T01:33:19.860 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:19.858+0000 7f353259c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f35341083a0 0x7f353419a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:33:19.861 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:19.858+0000 7f353259c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f35341083a0 0x7f353419a7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:53864/0 (socket says 172.21.15.83:53864) 2024-09-21T01:33:19.861 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:19.858+0000 7f353259c640 1 -- 172.21.15.83:0/3479132026 learned_addr learned my addr 172.21.15.83:0/3479132026 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:33:19.861 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:19.858+0000 7f3532d9d640 1 --2- 172.21.15.83:0/3479132026 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3534102a60 0x7f353419a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:33:19.861 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:19.858+0000 7f353359e640 1 --2- 172.21.15.83:0/3479132026 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3534108cf0 0x7f353419fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:33:19.861 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:19.859+0000 7f3532d9d640 1 -- 172.21.15.83:0/3479132026 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3534108cf0 msgr2=0x7f353419fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:33:19.861 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:19.859+0000 7f3532d9d640 1 --2- 172.21.15.83:0/3479132026 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3534108cf0 0x7f353419fa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:19.861 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:19.859+0000 7f3532d9d640 1 -- 172.21.15.83:0/3479132026 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f35341083a0 msgr2=0x7f353419a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:33:19.861 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:19.859+0000 7f3532d9d640 1 --2- 172.21.15.83:0/3479132026 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f35341083a0 0x7f353419a7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:19.861 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:19.859+0000 7f3532d9d640 1 -- 172.21.15.83:0/3479132026 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35341a0100 con 0x7f3534102a60 2024-09-21T01:33:19.861 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:19.859+0000 7f353259c640 1 --2- 172.21.15.83:0/3479132026 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f35341083a0 0x7f353419a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:33:19.862 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:19.859+0000 7f3532d9d640 1 --2- 172.21.15.83:0/3479132026 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3534102a60 0x7f353419a250 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f352400c970 tx=0x7f352400ce30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:33:19.862 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:19.859+0000 7f351bfff640 1 -- 172.21.15.83:0/3479132026 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3524007bb0 con 0x7f3534102a60 2024-09-21T01:33:19.862 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:19.859+0000 7f351bfff640 1 -- 172.21.15.83:0/3479132026 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(23 keys) ==== 1001+0+0 (secure 0 0 0) 0x7f3524007d50 con 0x7f3534102a60 2024-09-21T01:33:19.862 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:19.859+0000 7f3539018640 1 -- 172.21.15.83:0/3479132026 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35341a03f0 con 0x7f3534102a60 2024-09-21T01:33:19.862 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:19.859+0000 7f351bfff640 1 -- 172.21.15.83:0/3479132026 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3524018660 con 0x7f3534102a60 2024-09-21T01:33:19.862 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:19.859+0000 7f3539018640 1 -- 172.21.15.83:0/3479132026 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35341a6c10 con 0x7f3534102a60 2024-09-21T01:33:19.863 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:19.860+0000 7f3539018640 1 -- 172.21.15.83:0/3479132026 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3534102e70 con 0x7f3534102a60 2024-09-21T01:33:19.863 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:19.860+0000 7f351bfff640 1 -- 172.21.15.83:0/3479132026 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 17) ==== 51915+0+0 (secure 0 0 0) 0x7f3524005020 con 0x7f3534102a60 2024-09-21T01:33:19.863 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:19.860+0000 7f351bfff640 1 --2- 172.21.15.83:0/3479132026 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f351c03fba0 0x7f351c0420b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:33:19.863 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:19.860+0000 7f351bfff640 1 -- 172.21.15.83:0/3479132026 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f3524054570 con 0x7f3534102a60 2024-09-21T01:33:19.863 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:19.860+0000 7f353259c640 1 --2- 172.21.15.83:0/3479132026 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f351c03fba0 0x7f351c0420b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:33:19.863 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:19.861+0000 7f353259c640 1 --2- 172.21.15.83:0/3479132026 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f351c03fba0 0x7f351c0420b0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f35280057c0 tx=0x7f3528005a20 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:33:19.866 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:19.866+0000 7f351bfff640 1 -- 172.21.15.83:0/3479132026 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3524014030 con 0x7f3534102a60 2024-09-21T01:33:20.051 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:20.050+0000 7f3539018640 1 -- 172.21.15.83:0/3479132026 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command([{prefix=config set, name=debug_mgr}] v 0) -- 0x7f353410aae0 con 0x7f3534102a60 2024-09-21T01:33:20.052 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:20.051+0000 7f351bfff640 1 -- 172.21.15.83:0/3479132026 <== mon.1 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mgr}]=0 v17)=0 v17) ==== 108+0+0 (secure 0 0 0) 0x7f35240203a0 con 0x7f3534102a60 2024-09-21T01:33:20.054 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:20.054+0000 7f3539018640 1 -- 172.21.15.83:0/3479132026 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f351c03fba0 msgr2=0x7f351c0420b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:33:20.055 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:20.054+0000 7f3539018640 1 --2- 172.21.15.83:0/3479132026 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f351c03fba0 0x7f351c0420b0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f35280057c0 tx=0x7f3528005a20 comp rx=0 tx=0).stop 2024-09-21T01:33:20.055 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:20.054+0000 7f3539018640 1 -- 172.21.15.83:0/3479132026 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3534102a60 msgr2=0x7f353419a250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:33:20.055 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:20.054+0000 7f3539018640 1 --2- 172.21.15.83:0/3479132026 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3534102a60 0x7f353419a250 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f352400c970 tx=0x7f352400ce30 comp rx=0 tx=0).stop 2024-09-21T01:33:20.055 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:20.054+0000 7f3539018640 1 -- 172.21.15.83:0/3479132026 shutdown_connections 2024-09-21T01:33:20.055 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:20.054+0000 7f3539018640 1 --2- 172.21.15.83:0/3479132026 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f351c03fba0 0x7f351c0420b0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:20.055 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:20.054+0000 7f3539018640 1 --2- 172.21.15.83:0/3479132026 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3534108cf0 0x7f353419fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:20.055 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:20.054+0000 7f3539018640 1 --2- 172.21.15.83:0/3479132026 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f35341083a0 0x7f353419a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:20.055 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:20.054+0000 7f3539018640 1 --2- 172.21.15.83:0/3479132026 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3534102a60 0x7f353419a250 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:20.055 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:20.054+0000 7f3539018640 1 -- 172.21.15.83:0/3479132026 >> 172.21.15.83:0/3479132026 conn(0x7f3534079730 msgr2=0x7f3534104520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:33:20.055 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:20.054+0000 7f3539018640 1 -- 172.21.15.83:0/3479132026 shutdown_connections 2024-09-21T01:33:20.055 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:20.054+0000 7f3539018640 1 -- 172.21.15.83:0/3479132026 wait complete. 2024-09-21T01:33:20.076 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:20.027+0000 7f4b1c824640 1 -- 172.21.15.83:0/2623876105 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4b181094d0 msgr2=0x7f4b181098e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:33:20.076 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:20.027+0000 7f4b1c824640 1 --2- 172.21.15.83:0/2623876105 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4b181094d0 0x7f4b181098e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f4b0c009900 tx=0x7f4b0c02a410 comp rx=0 tx=0).stop 2024-09-21T01:33:20.076 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:20.027+0000 7f4b1c824640 1 -- 172.21.15.83:0/2623876105 shutdown_connections 2024-09-21T01:33:20.077 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:20.027+0000 7f4b1c824640 1 --2- 172.21.15.83:0/2623876105 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4b18109e20 0x7f4b18110650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:20.077 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:20.027+0000 7f4b1c824640 1 --2- 172.21.15.83:0/2623876105 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4b181094d0 0x7f4b181098e0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:20.077 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:20.027+0000 7f4b1c824640 1 --2- 172.21.15.83:0/2623876105 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4b18103b90 0x7f4b18103fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:20.077 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:20.027+0000 7f4b1c824640 1 -- 172.21.15.83:0/2623876105 >> 172.21.15.83:0/2623876105 conn(0x7f4b180ff600 msgr2=0x7f4b18101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:33:20.077 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:20.027+0000 7f4b1c824640 1 -- 172.21.15.83:0/2623876105 shutdown_connections 2024-09-21T01:33:20.077 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:20.027+0000 7f4b1c824640 1 -- 172.21.15.83:0/2623876105 wait complete. 2024-09-21T01:33:20.077 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:20.028+0000 7f4b1c824640 1 Processor -- start 2024-09-21T01:33:20.077 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:20.028+0000 7f4b1c824640 1 -- start start 2024-09-21T01:33:20.077 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:20.028+0000 7f4b1c824640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4b18103b90 0x7f4b18075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:33:20.077 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:20.028+0000 7f4b1c824640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4b181094d0 0x7f4b18075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:33:20.077 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:20.028+0000 7f4b1c824640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4b18109e20 0x7f4b18076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:33:20.077 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:20.028+0000 7f4b1c824640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f4b18113750 con 0x7f4b181094d0 2024-09-21T01:33:20.077 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:20.028+0000 7f4b1c824640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f4b181135d0 con 0x7f4b18103b90 2024-09-21T01:33:20.077 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:20.028+0000 7f4b1c824640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f4b181138d0 con 0x7f4b18109e20 2024-09-21T01:33:20.077 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:20.028+0000 7f4b15d9b640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4b181094d0 0x7f4b18075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:33:20.078 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:20.028+0000 7f4b1659c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4b18103b90 0x7f4b18075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:33:20.078 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:20.028+0000 7f4b15d9b640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4b181094d0 0x7f4b18075c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:53878/0 (socket says 172.21.15.83:53878) 2024-09-21T01:33:20.078 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:20.028+0000 7f4b15d9b640 1 -- 172.21.15.83:0/2972748734 learned_addr learned my addr 172.21.15.83:0/2972748734 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:33:20.078 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:20.028+0000 7f4b1659c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4b18103b90 0x7f4b18075710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.83:47836/0 (socket says 172.21.15.83:47836) 2024-09-21T01:33:20.078 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:20.028+0000 7f4b16d9d640 1 --2- 172.21.15.83:0/2972748734 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4b18109e20 0x7f4b18076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:33:20.078 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:20.029+0000 7f4b1659c640 1 -- 172.21.15.83:0/2972748734 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4b18109e20 msgr2=0x7f4b18076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:33:20.078 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:20.029+0000 7f4b1659c640 1 --2- 172.21.15.83:0/2972748734 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4b18109e20 0x7f4b18076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:20.078 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:20.029+0000 7f4b1659c640 1 -- 172.21.15.83:0/2972748734 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4b181094d0 msgr2=0x7f4b18075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:33:20.078 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:20.029+0000 7f4b1659c640 1 --2- 172.21.15.83:0/2972748734 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4b181094d0 0x7f4b18075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:20.078 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:20.029+0000 7f4b1659c640 1 -- 172.21.15.83:0/2972748734 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b181a84c0 con 0x7f4b18103b90 2024-09-21T01:33:20.078 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:20.029+0000 7f4b15d9b640 1 --2- 172.21.15.83:0/2972748734 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4b181094d0 0x7f4b18075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:33:20.078 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:20.029+0000 7f4b1659c640 1 --2- 172.21.15.83:0/2972748734 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4b18103b90 0x7f4b18075710 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f4b08005fd0 tx=0x7f4b0800dde0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:33:20.078 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:20.029+0000 7f4b077fe640 1 -- 172.21.15.83:0/2972748734 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b08009c30 con 0x7f4b18103b90 2024-09-21T01:33:20.079 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:20.029+0000 7f4b077fe640 1 -- 172.21.15.83:0/2972748734 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(23 keys) ==== 1001+0+0 (secure 0 0 0) 0x7f4b08004480 con 0x7f4b18103b90 2024-09-21T01:33:20.079 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:20.029+0000 7f4b1c824640 1 -- 172.21.15.83:0/2972748734 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b181a87b0 con 0x7f4b18103b90 2024-09-21T01:33:20.079 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:20.029+0000 7f4b077fe640 1 -- 172.21.15.83:0/2972748734 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b08003c90 con 0x7f4b18103b90 2024-09-21T01:33:20.079 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:20.029+0000 7f4b1c824640 1 -- 172.21.15.83:0/2972748734 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b181a8cf0 con 0x7f4b18103b90 2024-09-21T01:33:20.079 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:20.030+0000 7f4b077fe640 1 -- 172.21.15.83:0/2972748734 <== mon.2 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 17) ==== 51915+0+0 (secure 0 0 0) 0x7f4b08010460 con 0x7f4b18103b90 2024-09-21T01:33:20.079 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:20.030+0000 7f4b1c824640 1 -- 172.21.15.83:0/2972748734 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b18103fa0 con 0x7f4b18103b90 2024-09-21T01:33:20.079 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:20.030+0000 7f4b077fe640 1 --2- 172.21.15.83:0/2972748734 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f4b0003fb70 0x7f4b00042080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:33:20.079 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:20.030+0000 7f4b077fe640 1 -- 172.21.15.83:0/2972748734 <== mon.2 v2:172.21.15.119:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f4b080544d0 con 0x7f4b18103b90 2024-09-21T01:33:20.079 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:20.030+0000 7f4b15d9b640 1 --2- 172.21.15.83:0/2972748734 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f4b0003fb70 0x7f4b00042080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:33:20.079 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:20.031+0000 7f4b15d9b640 1 --2- 172.21.15.83:0/2972748734 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f4b0003fb70 0x7f4b00042080 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f4b18109080 tx=0x7f4b0c0317b0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:33:20.079 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:20.035+0000 7f4b077fe640 1 -- 172.21.15.83:0/2972748734 <== mon.2 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4b08017020 con 0x7f4b18103b90 2024-09-21T01:33:20.221 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:20.221+0000 7f4b1c824640 1 -- 172.21.15.83:0/2972748734 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7f4b1810bba0 con 0x7f4b18103b90 2024-09-21T01:33:20.226 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:20.226+0000 7f4b077fe640 1 -- 172.21.15.83:0/2972748734 <== mon.2 v2:172.21.15.119:3300/0 7 ==== config(24 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f4b080035f0 con 0x7f4b18103b90 2024-09-21T01:33:20.226 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:20.226+0000 7f4b077fe640 1 -- 172.21.15.83:0/2972748734 <== mon.2 v2:172.21.15.119:3300/0 8 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v18)=0 v18) ==== 123+0+0 (secure 0 0 0) 0x7f4b08020cf0 con 0x7f4b18103b90 2024-09-21T01:33:20.229 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:20.228+0000 7f4b1c824640 1 -- 172.21.15.83:0/2972748734 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f4b0003fb70 msgr2=0x7f4b00042080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:33:20.229 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:20.228+0000 7f4b1c824640 1 --2- 172.21.15.83:0/2972748734 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f4b0003fb70 0x7f4b00042080 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f4b18109080 tx=0x7f4b0c0317b0 comp rx=0 tx=0).stop 2024-09-21T01:33:20.229 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:20.228+0000 7f4b1c824640 1 -- 172.21.15.83:0/2972748734 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4b18103b90 msgr2=0x7f4b18075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:33:20.229 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:20.228+0000 7f4b1c824640 1 --2- 172.21.15.83:0/2972748734 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4b18103b90 0x7f4b18075710 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f4b08005fd0 tx=0x7f4b0800dde0 comp rx=0 tx=0).stop 2024-09-21T01:33:20.229 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:20.228+0000 7f4b1c824640 1 -- 172.21.15.83:0/2972748734 shutdown_connections 2024-09-21T01:33:20.229 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:20.228+0000 7f4b1c824640 1 --2- 172.21.15.83:0/2972748734 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f4b0003fb70 0x7f4b00042080 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:20.229 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:20.228+0000 7f4b1c824640 1 --2- 172.21.15.83:0/2972748734 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4b18109e20 0x7f4b18076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:20.229 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:20.228+0000 7f4b1c824640 1 --2- 172.21.15.83:0/2972748734 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4b181094d0 0x7f4b18075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:20.229 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:20.228+0000 7f4b1c824640 1 --2- 172.21.15.83:0/2972748734 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4b18103b90 0x7f4b18075710 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:20.230 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:20.228+0000 7f4b1c824640 1 -- 172.21.15.83:0/2972748734 >> 172.21.15.83:0/2972748734 conn(0x7f4b180ff600 msgr2=0x7f4b18101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:33:20.230 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:20.228+0000 7f4b1c824640 1 -- 172.21.15.83:0/2972748734 shutdown_connections 2024-09-21T01:33:20.230 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:20.228+0000 7f4b1c824640 1 -- 172.21.15.83:0/2972748734 wait complete. 2024-09-21T01:33:20.714 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:20 smithi142 ceph-mon[34050]: Standby manager daemon z started 2024-09-21T01:33:20.715 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:20 smithi142 ceph-mon[34050]: from='mgr.? 172.21.15.142:0/4166356947' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/crt"} : dispatch 2024-09-21T01:33:20.715 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:20 smithi142 ceph-mon[34050]: from='mgr.? 172.21.15.142:0/4166356947' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-21T01:33:20.715 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:20 smithi142 ceph-mon[34050]: from='mgr.? 172.21.15.142:0/4166356947' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/key"} : dispatch 2024-09-21T01:33:20.715 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:20 smithi142 ceph-mon[34050]: from='mgr.? 172.21.15.142:0/4166356947' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-21T01:33:20.715 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:20 smithi142 ceph-mon[34050]: from='client.? ' entity='client.admin' 2024-09-21T01:33:20.717 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:20 smithi119 ceph-mon[33693]: Standby manager daemon z started 2024-09-21T01:33:20.717 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:20 smithi119 ceph-mon[33693]: from='mgr.? 172.21.15.142:0/4166356947' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/crt"} : dispatch 2024-09-21T01:33:20.718 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:20 smithi119 ceph-mon[33693]: from='mgr.? 172.21.15.142:0/4166356947' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-21T01:33:20.718 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:20 smithi119 ceph-mon[33693]: from='mgr.? 172.21.15.142:0/4166356947' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/key"} : dispatch 2024-09-21T01:33:20.718 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:20 smithi119 ceph-mon[33693]: from='mgr.? 172.21.15.142:0/4166356947' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-21T01:33:20.718 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:20 smithi119 ceph-mon[33693]: from='client.? ' entity='client.admin' 2024-09-21T01:33:20.775 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:20 smithi083 ceph-mon[31370]: Standby manager daemon z started 2024-09-21T01:33:20.777 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:20 smithi083 ceph-mon[31370]: from='mgr.? 172.21.15.142:0/4166356947' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/crt"} : dispatch 2024-09-21T01:33:20.778 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:20 smithi083 ceph-mon[31370]: from='mgr.? 172.21.15.142:0/4166356947' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-21T01:33:20.778 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:20 smithi083 ceph-mon[31370]: from='mgr.? 172.21.15.142:0/4166356947' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/key"} : dispatch 2024-09-21T01:33:20.778 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:20 smithi083 ceph-mon[31370]: from='mgr.? 172.21.15.142:0/4166356947' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-21T01:33:20.778 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:20 smithi083 ceph-mon[31370]: from='client.? ' entity='client.admin' 2024-09-21T01:33:21.211 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:21.210+0000 7f676ffa8640 1 -- 172.21.15.83:0/497401678 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6768102100 msgr2=0x7f6768102510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:33:21.211 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:21.210+0000 7f676ffa8640 1 --2- 172.21.15.83:0/497401678 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6768102100 0x7f6768102510 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f6764009900 tx=0x7f676402a410 comp rx=0 tx=0).stop 2024-09-21T01:33:21.211 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:21.210+0000 7f676ffa8640 1 -- 172.21.15.83:0/497401678 shutdown_connections 2024-09-21T01:33:21.211 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:21.210+0000 7f676ffa8640 1 --2- 172.21.15.83:0/497401678 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6768106ca0 0x7f6768110710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:21.211 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:21.210+0000 7f676ffa8640 1 --2- 172.21.15.83:0/497401678 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6768106350 0x7f6768106760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:21.211 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:21.210+0000 7f676ffa8640 1 --2- 172.21.15.83:0/497401678 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6768102100 0x7f6768102510 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:21.211 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:21.210+0000 7f676ffa8640 1 -- 172.21.15.83:0/497401678 >> 172.21.15.83:0/497401678 conn(0x7f6768079ec0 msgr2=0x7f676807a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:33:21.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:21.210+0000 7f676ffa8640 1 -- 172.21.15.83:0/497401678 shutdown_connections 2024-09-21T01:33:21.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:21.210+0000 7f676ffa8640 1 -- 172.21.15.83:0/497401678 wait complete. 2024-09-21T01:33:21.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:21.211+0000 7f676ffa8640 1 Processor -- start 2024-09-21T01:33:21.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:21.211+0000 7f676ffa8640 1 -- start start 2024-09-21T01:33:21.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:21.211+0000 7f676ffa8640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6768102100 0x7f67681030a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:33:21.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:21.211+0000 7f676ffa8640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6768106350 0x7f67681035e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:33:21.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:21.211+0000 7f676ffa8640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6768106ca0 0x7f6768103b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:33:21.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:21.211+0000 7f676ffa8640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f6768113930 con 0x7f6768102100 2024-09-21T01:33:21.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:21.211+0000 7f676ffa8640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f67681137b0 con 0x7f6768106350 2024-09-21T01:33:21.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:21.211+0000 7f676ffa8640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f6768113ab0 con 0x7f6768106ca0 2024-09-21T01:33:21.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:21.211+0000 7f676dd44640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6768102100 0x7f67681030a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:33:21.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:21.211+0000 7f676dd44640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6768102100 0x7f67681030a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:53892/0 (socket says 172.21.15.83:53892) 2024-09-21T01:33:21.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:21.211+0000 7f676dd44640 1 -- 172.21.15.83:0/784029686 learned_addr learned my addr 172.21.15.83:0/784029686 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:33:21.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:21.211+0000 7f676d543640 1 --2- 172.21.15.83:0/784029686 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6768106350 0x7f67681035e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:33:21.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:21.211+0000 7f676e545640 1 --2- 172.21.15.83:0/784029686 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6768106ca0 0x7f6768103b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:33:21.215 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:21.212+0000 7f676dd44640 1 -- 172.21.15.83:0/784029686 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6768106ca0 msgr2=0x7f6768103b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:33:21.215 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:21.212+0000 7f676dd44640 1 --2- 172.21.15.83:0/784029686 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6768106ca0 0x7f6768103b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:21.215 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:21.212+0000 7f676dd44640 1 -- 172.21.15.83:0/784029686 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6768106350 msgr2=0x7f67681035e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:33:21.215 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:21.212+0000 7f676dd44640 1 --2- 172.21.15.83:0/784029686 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6768106350 0x7f67681035e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:21.215 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:21.212+0000 7f676dd44640 1 -- 172.21.15.83:0/784029686 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67681a8720 con 0x7f6768102100 2024-09-21T01:33:21.215 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:21.212+0000 7f676e545640 1 --2- 172.21.15.83:0/784029686 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6768106ca0 0x7f6768103b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:33:21.215 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:21.212+0000 7f676dd44640 1 --2- 172.21.15.83:0/784029686 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6768102100 0x7f67681030a0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f6764004770 tx=0x7f6764003b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:33:21.215 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:21.212+0000 7f675effd640 1 -- 172.21.15.83:0/784029686 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f676403f070 con 0x7f6768102100 2024-09-21T01:33:21.215 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:21.212+0000 7f675effd640 1 -- 172.21.15.83:0/784029686 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(24 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f676403bad0 con 0x7f6768102100 2024-09-21T01:33:21.215 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:21.212+0000 7f676ffa8640 1 -- 172.21.15.83:0/784029686 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67681a89b0 con 0x7f6768102100 2024-09-21T01:33:21.215 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:21.212+0000 7f675effd640 1 -- 172.21.15.83:0/784029686 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6764035030 con 0x7f6768102100 2024-09-21T01:33:21.215 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:21.212+0000 7f676ffa8640 1 -- 172.21.15.83:0/784029686 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67681a8ee0 con 0x7f6768102100 2024-09-21T01:33:21.215 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:21.213+0000 7f676ffa8640 1 -- 172.21.15.83:0/784029686 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6768102510 con 0x7f6768102100 2024-09-21T01:33:21.216 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:21.214+0000 7f675effd640 1 -- 172.21.15.83:0/784029686 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 18) ==== 103194+0+0 (secure 0 0 0) 0x7f6764042070 con 0x7f6768102100 2024-09-21T01:33:21.216 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:21.214+0000 7f675effd640 1 --2- 172.21.15.83:0/784029686 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f675407b020 0x7f675407d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:33:21.216 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:21.215+0000 7f676d543640 1 --2- 172.21.15.83:0/784029686 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f675407b020 0x7f675407d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:33:21.216 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:21.215+0000 7f675effd640 1 -- 172.21.15.83:0/784029686 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f67640bd5c0 con 0x7f6768102100 2024-09-21T01:33:21.216 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:21.215+0000 7f676d543640 1 --2- 172.21.15.83:0/784029686 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f675407b020 0x7f675407d530 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f67681083d0 tx=0x7f675800b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:33:21.219 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:21.219+0000 7f675effd640 1 -- 172.21.15.83:0/784029686 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6764089fd0 con 0x7f6768102100 2024-09-21T01:33:21.409 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:21.408+0000 7f676ffa8640 1 -- 172.21.15.83:0/784029686 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command([{prefix=config set, name=mds_debug_frag}] v 0) -- 0x7f676810bd30 con 0x7f6768102100 2024-09-21T01:33:21.412 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:21.412+0000 7f675effd640 1 -- 172.21.15.83:0/784029686 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_frag}]=0 v19)=0 v19) ==== 115+0+0 (secure 0 0 0) 0x7f676408ee80 con 0x7f6768102100 2024-09-21T01:33:21.415 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:21.414+0000 7f676ffa8640 1 -- 172.21.15.83:0/784029686 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f675407b020 msgr2=0x7f675407d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:33:21.415 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:21.414+0000 7f676ffa8640 1 --2- 172.21.15.83:0/784029686 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f675407b020 0x7f675407d530 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f67681083d0 tx=0x7f675800b390 comp rx=0 tx=0).stop 2024-09-21T01:33:21.415 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:21.414+0000 7f676ffa8640 1 -- 172.21.15.83:0/784029686 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6768102100 msgr2=0x7f67681030a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:33:21.415 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:21.414+0000 7f676ffa8640 1 --2- 172.21.15.83:0/784029686 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6768102100 0x7f67681030a0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f6764004770 tx=0x7f6764003b00 comp rx=0 tx=0).stop 2024-09-21T01:33:21.415 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:21.414+0000 7f676ffa8640 1 -- 172.21.15.83:0/784029686 shutdown_connections 2024-09-21T01:33:21.415 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:21.414+0000 7f676ffa8640 1 --2- 172.21.15.83:0/784029686 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f675407b020 0x7f675407d530 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:21.415 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:21.414+0000 7f676ffa8640 1 --2- 172.21.15.83:0/784029686 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6768106ca0 0x7f6768103b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:21.415 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:21.414+0000 7f676ffa8640 1 --2- 172.21.15.83:0/784029686 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6768106350 0x7f67681035e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:21.415 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:21.414+0000 7f676ffa8640 1 --2- 172.21.15.83:0/784029686 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6768102100 0x7f67681030a0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:21.415 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:21.414+0000 7f676ffa8640 1 -- 172.21.15.83:0/784029686 >> 172.21.15.83:0/784029686 conn(0x7f6768079ec0 msgr2=0x7f6768107660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:33:21.415 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:21.414+0000 7f676ffa8640 1 -- 172.21.15.83:0/784029686 shutdown_connections 2024-09-21T01:33:21.415 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:21.414+0000 7f676ffa8640 1 -- 172.21.15.83:0/784029686 wait complete. 2024-09-21T01:33:21.525 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:33:21.525 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:33:21.529 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:33:21.529 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:33:21.530 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:33:21.530 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:33:21.538 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:33:21.538 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:33:21.538 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:33:21.539 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:33:21.539 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:33:21.541 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:33:21.541 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:33:21.543 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:33:21.543 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:33:21.616 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:21 smithi142 ceph-mon[34050]: mgrmap e18: x(active, since 11s), standbys: z 2024-09-21T01:33:21.616 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:21 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2024-09-21T01:33:21.619 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:21 smithi119 ceph-mon[33693]: mgrmap e18: x(active, since 11s), standbys: z 2024-09-21T01:33:21.619 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:21 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2024-09-21T01:33:21.654 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:21 smithi083 ceph-mon[31370]: mgrmap e18: x(active, since 11s), standbys: z 2024-09-21T01:33:21.654 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:21 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2024-09-21T01:33:22.715 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:22 smithi142 ceph-mon[34050]: from='client.? 172.21.15.83:0/784029686' entity='client.admin' 2024-09-21T01:33:22.715 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:22 smithi142 ceph-mon[34050]: Standby manager daemon y started 2024-09-21T01:33:22.715 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:22 smithi142 ceph-mon[34050]: from='mgr.? 172.21.15.119:0/3756550659' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/crt"} : dispatch 2024-09-21T01:33:22.715 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:22 smithi142 ceph-mon[34050]: from='mgr.? 172.21.15.119:0/3756550659' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-21T01:33:22.715 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:22 smithi142 ceph-mon[34050]: from='mgr.? 172.21.15.119:0/3756550659' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/key"} : dispatch 2024-09-21T01:33:22.715 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:22 smithi142 ceph-mon[34050]: from='mgr.? 172.21.15.119:0/3756550659' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-21T01:33:22.717 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:22 smithi119 ceph-mon[33693]: from='client.? 172.21.15.83:0/784029686' entity='client.admin' 2024-09-21T01:33:22.717 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:22 smithi119 ceph-mon[33693]: Standby manager daemon y started 2024-09-21T01:33:22.717 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:22 smithi119 ceph-mon[33693]: from='mgr.? 172.21.15.119:0/3756550659' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/crt"} : dispatch 2024-09-21T01:33:22.718 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:22 smithi119 ceph-mon[33693]: from='mgr.? 172.21.15.119:0/3756550659' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-21T01:33:22.718 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:22 smithi119 ceph-mon[33693]: from='mgr.? 172.21.15.119:0/3756550659' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/key"} : dispatch 2024-09-21T01:33:22.718 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:22 smithi119 ceph-mon[33693]: from='mgr.? 172.21.15.119:0/3756550659' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-21T01:33:22.722 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:22 smithi083 ceph-mon[31370]: from='client.? 172.21.15.83:0/784029686' entity='client.admin' 2024-09-21T01:33:22.722 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:22 smithi083 ceph-mon[31370]: Standby manager daemon y started 2024-09-21T01:33:22.722 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:22 smithi083 ceph-mon[31370]: from='mgr.? 172.21.15.119:0/3756550659' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/crt"} : dispatch 2024-09-21T01:33:22.722 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:22 smithi083 ceph-mon[31370]: from='mgr.? 172.21.15.119:0/3756550659' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-21T01:33:22.722 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:22 smithi083 ceph-mon[31370]: from='mgr.? 172.21.15.119:0/3756550659' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/key"} : dispatch 2024-09-21T01:33:22.722 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:22 smithi083 ceph-mon[31370]: from='mgr.? 172.21.15.119:0/3756550659' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-21T01:33:22.941 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:22.940+0000 7fca27677640 1 -- 172.21.15.83:0/2903302510 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fca20108cf0 msgr2=0x7fca2010f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:33:22.941 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:22.940+0000 7fca27677640 1 --2- 172.21.15.83:0/2903302510 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fca20108cf0 0x7fca2010f520 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fca18009ca0 tx=0x7fca1802a8c0 comp rx=0 tx=0).stop 2024-09-21T01:33:22.941 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:22.940+0000 7fca27677640 1 -- 172.21.15.83:0/2903302510 shutdown_connections 2024-09-21T01:33:22.941 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:22.940+0000 7fca27677640 1 --2- 172.21.15.83:0/2903302510 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fca20108cf0 0x7fca2010f520 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:22.941 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:22.940+0000 7fca27677640 1 --2- 172.21.15.83:0/2903302510 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fca201083a0 0x7fca201087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:22.941 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:22.940+0000 7fca27677640 1 --2- 172.21.15.83:0/2903302510 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fca20102a60 0x7fca20102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:22.941 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:22.940+0000 7fca27677640 1 -- 172.21.15.83:0/2903302510 >> 172.21.15.83:0/2903302510 conn(0x7fca20079730 msgr2=0x7fca20079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:33:22.942 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:22.941+0000 7fca27677640 1 -- 172.21.15.83:0/2903302510 shutdown_connections 2024-09-21T01:33:22.942 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:22.941+0000 7fca27677640 1 -- 172.21.15.83:0/2903302510 wait complete. 2024-09-21T01:33:22.943 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:22.941+0000 7fca27677640 1 Processor -- start 2024-09-21T01:33:22.943 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:22.941+0000 7fca27677640 1 -- start start 2024-09-21T01:33:22.943 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:22.941+0000 7fca27677640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fca20102a60 0x7fca2019b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:33:22.943 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:22.942+0000 7fca27677640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fca201083a0 0x7fca2019b590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:33:22.943 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:22.942+0000 7fca27677640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fca20108cf0 0x7fca2019bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:33:22.943 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:22.942+0000 7fca27677640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fca20112740 con 0x7fca201083a0 2024-09-21T01:33:22.943 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:22.942+0000 7fca27677640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fca201125c0 con 0x7fca20102a60 2024-09-21T01:33:22.944 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:22.942+0000 7fca27677640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fca201128c0 con 0x7fca20108cf0 2024-09-21T01:33:22.944 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:22.942+0000 7fca24c12640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fca201083a0 0x7fca2019b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:33:22.944 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:22.942+0000 7fca24c12640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fca201083a0 0x7fca2019b590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:53906/0 (socket says 172.21.15.83:53906) 2024-09-21T01:33:22.944 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:22.942+0000 7fca24c12640 1 -- 172.21.15.83:0/2499926193 learned_addr learned my addr 172.21.15.83:0/2499926193 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:33:22.944 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:22.942+0000 7fca25413640 1 --2- 172.21.15.83:0/2499926193 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fca20102a60 0x7fca2019b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:33:22.944 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:22.942+0000 7fca25c14640 1 --2- 172.21.15.83:0/2499926193 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fca20108cf0 0x7fca2019bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:33:22.944 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:22.942+0000 7fca24c12640 1 -- 172.21.15.83:0/2499926193 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fca20108cf0 msgr2=0x7fca2019bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:33:22.944 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:22.942+0000 7fca24c12640 1 --2- 172.21.15.83:0/2499926193 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fca20108cf0 0x7fca2019bad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:22.944 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:22.942+0000 7fca24c12640 1 -- 172.21.15.83:0/2499926193 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fca20102a60 msgr2=0x7fca2019b050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:33:22.944 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:22.942+0000 7fca24c12640 1 --2- 172.21.15.83:0/2499926193 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fca20102a60 0x7fca2019b050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:22.944 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:22.942+0000 7fca24c12640 1 -- 172.21.15.83:0/2499926193 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca201a62e0 con 0x7fca201083a0 2024-09-21T01:33:22.944 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:22.942+0000 7fca24c12640 1 --2- 172.21.15.83:0/2499926193 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fca201083a0 0x7fca2019b590 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fca1000e9c0 tx=0x7fca1000ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:33:22.944 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:22.942+0000 7fca167fc640 1 -- 172.21.15.83:0/2499926193 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca1000cd80 con 0x7fca201083a0 2024-09-21T01:33:22.944 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:22.942+0000 7fca27677640 1 -- 172.21.15.83:0/2499926193 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca201a65d0 con 0x7fca201083a0 2024-09-21T01:33:22.945 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:22.942+0000 7fca167fc640 1 -- 172.21.15.83:0/2499926193 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(24 keys) ==== 1032+0+0 (secure 0 0 0) 0x7fca10005490 con 0x7fca201083a0 2024-09-21T01:33:22.945 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:22.942+0000 7fca167fc640 1 -- 172.21.15.83:0/2499926193 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca10004e20 con 0x7fca201083a0 2024-09-21T01:33:22.945 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:22.943+0000 7fca27677640 1 -- 172.21.15.83:0/2499926193 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca201a6b60 con 0x7fca201083a0 2024-09-21T01:33:22.945 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:22.944+0000 7fca27677640 1 -- 172.21.15.83:0/2499926193 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca20102e70 con 0x7fca201083a0 2024-09-21T01:33:22.946 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:22.946+0000 7fca167fc640 1 -- 172.21.15.83:0/2499926193 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 19) ==== 154473+0+0 (secure 0 0 0) 0x7fca10004fc0 con 0x7fca201083a0 2024-09-21T01:33:22.947 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:22.947+0000 7fca167fc640 1 --2- 172.21.15.83:0/2499926193 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fca0c0b6580 0x7fca0c0b8a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:33:22.948 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:22.947+0000 7fca167fc640 1 -- 172.21.15.83:0/2499926193 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fca100e5aa0 con 0x7fca201083a0 2024-09-21T01:33:22.948 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:22.947+0000 7fca25413640 1 --2- 172.21.15.83:0/2499926193 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fca0c0b6580 0x7fca0c0b8a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:33:22.948 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:22.948+0000 7fca25413640 1 --2- 172.21.15.83:0/2499926193 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fca0c0b6580 0x7fca0c0b8a90 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fca1c0058c0 tx=0x7fca1c00a250 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:33:22.952 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:22.952+0000 7fca167fc640 1 -- 172.21.15.83:0/2499926193 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fca100052b0 con 0x7fca201083a0 2024-09-21T01:33:23.140 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:23.140+0000 7fca27677640 1 -- 172.21.15.83:0/2499926193 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command([{prefix=config set, name=mds_debug_scatterstat}] v 0) -- 0x7fca2010aae0 con 0x7fca201083a0 2024-09-21T01:33:23.144 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:23.144+0000 7fca167fc640 1 -- 172.21.15.83:0/2499926193 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_scatterstat}]=0 v20)=0 v20) ==== 122+0+0 (secure 0 0 0) 0x7fca100adf30 con 0x7fca201083a0 2024-09-21T01:33:23.147 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:23.146+0000 7fca27677640 1 -- 172.21.15.83:0/2499926193 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fca0c0b6580 msgr2=0x7fca0c0b8a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:33:23.147 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:23.146+0000 7fca27677640 1 --2- 172.21.15.83:0/2499926193 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fca0c0b6580 0x7fca0c0b8a90 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fca1c0058c0 tx=0x7fca1c00a250 comp rx=0 tx=0).stop 2024-09-21T01:33:23.147 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:23.146+0000 7fca27677640 1 -- 172.21.15.83:0/2499926193 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fca201083a0 msgr2=0x7fca2019b590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:33:23.147 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:23.146+0000 7fca27677640 1 --2- 172.21.15.83:0/2499926193 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fca201083a0 0x7fca2019b590 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fca1000e9c0 tx=0x7fca1000ee80 comp rx=0 tx=0).stop 2024-09-21T01:33:23.147 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:23.146+0000 7fca27677640 1 -- 172.21.15.83:0/2499926193 shutdown_connections 2024-09-21T01:33:23.147 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:23.146+0000 7fca27677640 1 --2- 172.21.15.83:0/2499926193 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fca0c0b6580 0x7fca0c0b8a90 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:23.147 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:23.146+0000 7fca27677640 1 --2- 172.21.15.83:0/2499926193 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fca20108cf0 0x7fca2019bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:23.147 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:23.146+0000 7fca27677640 1 --2- 172.21.15.83:0/2499926193 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fca201083a0 0x7fca2019b590 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:23.147 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:23.146+0000 7fca27677640 1 --2- 172.21.15.83:0/2499926193 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fca20102a60 0x7fca2019b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:23.147 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:23.146+0000 7fca27677640 1 -- 172.21.15.83:0/2499926193 >> 172.21.15.83:0/2499926193 conn(0x7fca20079730 msgr2=0x7fca201052a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:33:23.148 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:23.146+0000 7fca27677640 1 -- 172.21.15.83:0/2499926193 shutdown_connections 2024-09-21T01:33:23.148 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:23.146+0000 7fca27677640 1 -- 172.21.15.83:0/2499926193 wait complete. 2024-09-21T01:33:23.714 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:23 smithi142 ceph-mon[34050]: mgrmap e19: x(active, since 13s), standbys: z, y 2024-09-21T01:33:23.715 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:23 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-09-21T01:33:23.715 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:23 smithi142 ceph-mon[34050]: from='client.? 172.21.15.83:0/2499926193' entity='client.admin' 2024-09-21T01:33:23.717 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:23 smithi119 ceph-mon[33693]: mgrmap e19: x(active, since 13s), standbys: z, y 2024-09-21T01:33:23.717 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:23 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-09-21T01:33:23.717 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:23 smithi119 ceph-mon[33693]: from='client.? 172.21.15.83:0/2499926193' entity='client.admin' 2024-09-21T01:33:23.790 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:23 smithi083 ceph-mon[31370]: mgrmap e19: x(active, since 13s), standbys: z, y 2024-09-21T01:33:23.790 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:23 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-09-21T01:33:23.790 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:23 smithi083 ceph-mon[31370]: from='client.? 172.21.15.83:0/2499926193' entity='client.admin' 2024-09-21T01:33:23.982 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:23.981+0000 7fd391361640 1 -- 172.21.15.83:0/2229760638 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd38c1094a0 msgr2=0x7fd38c1098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:33:23.982 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:23.981+0000 7fd391361640 1 --2- 172.21.15.83:0/2229760638 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd38c1094a0 0x7fd38c1098b0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fd380009900 tx=0x7fd38002a410 comp rx=0 tx=0).stop 2024-09-21T01:33:23.982 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:23.981+0000 7fd391361640 1 -- 172.21.15.83:0/2229760638 shutdown_connections 2024-09-21T01:33:23.982 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:23.981+0000 7fd391361640 1 --2- 172.21.15.83:0/2229760638 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd38c109df0 0x7fd38c110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:23.982 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:23.981+0000 7fd391361640 1 --2- 172.21.15.83:0/2229760638 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd38c1094a0 0x7fd38c1098b0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:23.982 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:23.981+0000 7fd391361640 1 --2- 172.21.15.83:0/2229760638 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd38c103b60 0x7fd38c103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:23.983 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:23.981+0000 7fd391361640 1 -- 172.21.15.83:0/2229760638 >> 172.21.15.83:0/2229760638 conn(0x7fd38c07b850 msgr2=0x7fd38c07bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:33:23.983 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:23.981+0000 7fd391361640 1 -- 172.21.15.83:0/2229760638 shutdown_connections 2024-09-21T01:33:23.983 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:23.981+0000 7fd391361640 1 -- 172.21.15.83:0/2229760638 wait complete. 2024-09-21T01:33:23.984 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:23.982+0000 7fd391361640 1 Processor -- start 2024-09-21T01:33:23.984 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:23.982+0000 7fd391361640 1 -- start start 2024-09-21T01:33:23.984 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:23.983+0000 7fd391361640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd38c103b60 0x7fd38c19a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:33:23.984 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:23.983+0000 7fd391361640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd38c1094a0 0x7fd38c19a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:33:23.984 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:23.983+0000 7fd391361640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd38c109df0 0x7fd38c19fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:33:23.984 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:23.983+0000 7fd391361640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fd38c113840 con 0x7fd38c103b60 2024-09-21T01:33:23.984 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:23.983+0000 7fd391361640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fd38c1136c0 con 0x7fd38c109df0 2024-09-21T01:33:23.985 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:23.983+0000 7fd391361640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fd38c1139c0 con 0x7fd38c1094a0 2024-09-21T01:33:23.985 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:23.983+0000 7fd38affd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd38c103b60 0x7fd38c19a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:33:23.985 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:23.983+0000 7fd38affd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd38c103b60 0x7fd38c19a330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:57482/0 (socket says 172.21.15.83:57482) 2024-09-21T01:33:23.985 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:23.983+0000 7fd38affd640 1 -- 172.21.15.83:0/3731767435 learned_addr learned my addr 172.21.15.83:0/3731767435 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:33:23.985 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:23.983+0000 7fd38a7fc640 1 --2- 172.21.15.83:0/3731767435 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd38c1094a0 0x7fd38c19a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:33:23.985 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:23.983+0000 7fd38b7fe640 1 --2- 172.21.15.83:0/3731767435 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd38c109df0 0x7fd38c19fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:33:23.985 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:23.983+0000 7fd38affd640 1 -- 172.21.15.83:0/3731767435 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd38c1094a0 msgr2=0x7fd38c19a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:33:23.985 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:23.983+0000 7fd38affd640 1 --2- 172.21.15.83:0/3731767435 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd38c1094a0 0x7fd38c19a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:23.985 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:23.983+0000 7fd38affd640 1 -- 172.21.15.83:0/3731767435 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd38c109df0 msgr2=0x7fd38c19fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:33:23.985 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:23.983+0000 7fd38affd640 1 --2- 172.21.15.83:0/3731767435 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd38c109df0 0x7fd38c19fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:23.985 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:23.983+0000 7fd38affd640 1 -- 172.21.15.83:0/3731767435 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd38c1a02a0 con 0x7fd38c103b60 2024-09-21T01:33:23.985 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:23.983+0000 7fd38b7fe640 1 --2- 172.21.15.83:0/3731767435 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd38c109df0 0x7fd38c19fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:33:23.985 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:23.983+0000 7fd38affd640 1 --2- 172.21.15.83:0/3731767435 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd38c103b60 0x7fd38c19a330 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fd37c00d950 tx=0x7fd37c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:33:23.986 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:23.983+0000 7fd373fff640 1 -- 172.21.15.83:0/3731767435 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd37c017070 con 0x7fd38c103b60 2024-09-21T01:33:23.986 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:23.983+0000 7fd373fff640 1 -- 172.21.15.83:0/3731767435 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(24 keys) ==== 1032+0+0 (secure 0 0 0) 0x7fd37c009c30 con 0x7fd38c103b60 2024-09-21T01:33:23.986 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:23.983+0000 7fd391361640 1 -- 172.21.15.83:0/3731767435 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd38c1a0590 con 0x7fd38c103b60 2024-09-21T01:33:23.986 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:23.984+0000 7fd373fff640 1 -- 172.21.15.83:0/3731767435 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd37c00f620 con 0x7fd38c103b60 2024-09-21T01:33:23.986 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:23.984+0000 7fd391361640 1 -- 172.21.15.83:0/3731767435 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd38c1a6cf0 con 0x7fd38c103b60 2024-09-21T01:33:23.986 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:23.985+0000 7fd391361640 1 -- 172.21.15.83:0/3731767435 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd38c103f70 con 0x7fd38c103b60 2024-09-21T01:33:23.987 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:23.987+0000 7fd373fff640 1 -- 172.21.15.83:0/3731767435 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 19) ==== 154473+0+0 (secure 0 0 0) 0x7fd37c005030 con 0x7fd38c103b60 2024-09-21T01:33:23.988 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:23.988+0000 7fd373fff640 1 --2- 172.21.15.83:0/3731767435 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fd3740b64d0 0x7fd3740b89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:33:23.988 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:23.988+0000 7fd38a7fc640 1 --2- 172.21.15.83:0/3731767435 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fd3740b64d0 0x7fd3740b89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:33:23.988 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:23.988+0000 7fd373fff640 1 -- 172.21.15.83:0/3731767435 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fd37c0e5370 con 0x7fd38c103b60 2024-09-21T01:33:23.989 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:23.988+0000 7fd38a7fc640 1 --2- 172.21.15.83:0/3731767435 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fd3740b64d0 0x7fd3740b89e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fd380005940 tx=0x7fd3800058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:33:23.991 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:23.991+0000 7fd373fff640 1 -- 172.21.15.83:0/3731767435 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd37c0ad800 con 0x7fd38c103b60 2024-09-21T01:33:24.174 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:24.174+0000 7fd391361640 1 -- 172.21.15.83:0/3731767435 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_size}] v 0) -- 0x7fd38c10bbe0 con 0x7fd38c103b60 2024-09-21T01:33:24.178 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:24.178+0000 7fd373fff640 1 -- 172.21.15.83:0/3731767435 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_size}]=0 v21)=0 v21) ==== 118+0+0 (secure 0 0 0) 0x7fd37c009de0 con 0x7fd38c103b60 2024-09-21T01:33:24.181 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:24.181+0000 7fd391361640 1 -- 172.21.15.83:0/3731767435 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fd3740b64d0 msgr2=0x7fd3740b89e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:33:24.181 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:24.181+0000 7fd391361640 1 --2- 172.21.15.83:0/3731767435 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fd3740b64d0 0x7fd3740b89e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fd380005940 tx=0x7fd3800058d0 comp rx=0 tx=0).stop 2024-09-21T01:33:24.181 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:24.181+0000 7fd391361640 1 -- 172.21.15.83:0/3731767435 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd38c103b60 msgr2=0x7fd38c19a330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:33:24.182 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:24.181+0000 7fd391361640 1 --2- 172.21.15.83:0/3731767435 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd38c103b60 0x7fd38c19a330 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fd37c00d950 tx=0x7fd37c00de10 comp rx=0 tx=0).stop 2024-09-21T01:33:24.182 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:24.181+0000 7fd391361640 1 -- 172.21.15.83:0/3731767435 shutdown_connections 2024-09-21T01:33:24.182 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:24.181+0000 7fd391361640 1 --2- 172.21.15.83:0/3731767435 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fd3740b64d0 0x7fd3740b89e0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:24.182 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:24.181+0000 7fd391361640 1 --2- 172.21.15.83:0/3731767435 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd38c109df0 0x7fd38c19fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:24.182 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:24.181+0000 7fd391361640 1 --2- 172.21.15.83:0/3731767435 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd38c1094a0 0x7fd38c19a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:24.182 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:24.181+0000 7fd391361640 1 --2- 172.21.15.83:0/3731767435 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd38c103b60 0x7fd38c19a330 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:24.182 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:24.181+0000 7fd391361640 1 -- 172.21.15.83:0/3731767435 >> 172.21.15.83:0/3731767435 conn(0x7fd38c07b850 msgr2=0x7fd38c105610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:33:24.182 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:24.181+0000 7fd391361640 1 -- 172.21.15.83:0/3731767435 shutdown_connections 2024-09-21T01:33:24.182 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:24.181+0000 7fd391361640 1 -- 172.21.15.83:0/3731767435 wait complete. 2024-09-21T01:33:25.424 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:25 smithi083 ceph-mon[31370]: from='client.? 172.21.15.83:0/3731767435' entity='client.admin' 2024-09-21T01:33:25.429 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.424+0000 7f3479425640 1 -- 172.21.15.83:0/2969521119 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f34741049b0 msgr2=0x7f3474104dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:33:25.430 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.424+0000 7f3479425640 1 --2- 172.21.15.83:0/2969521119 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f34741049b0 0x7f3474104dc0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f345c009900 tx=0x7f345c02a410 comp rx=0 tx=0).stop 2024-09-21T01:33:25.430 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.424+0000 7f3479425640 1 -- 172.21.15.83:0/2969521119 shutdown_connections 2024-09-21T01:33:25.430 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.424+0000 7f3479425640 1 --2- 172.21.15.83:0/2969521119 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f347410de10 0x7f3474110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:25.430 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.424+0000 7f3479425640 1 --2- 172.21.15.83:0/2969521119 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3474105300 0x7f347410d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:25.430 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.424+0000 7f3479425640 1 --2- 172.21.15.83:0/2969521119 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f34741049b0 0x7f3474104dc0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:25.430 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.424+0000 7f3479425640 1 -- 172.21.15.83:0/2969521119 >> 172.21.15.83:0/2969521119 conn(0x7f3474079730 msgr2=0x7f3474079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:33:25.430 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.424+0000 7f3479425640 1 -- 172.21.15.83:0/2969521119 shutdown_connections 2024-09-21T01:33:25.430 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.424+0000 7f3479425640 1 -- 172.21.15.83:0/2969521119 wait complete. 2024-09-21T01:33:25.430 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.425+0000 7f3479425640 1 Processor -- start 2024-09-21T01:33:25.430 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.425+0000 7f3479425640 1 -- start start 2024-09-21T01:33:25.430 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.425+0000 7f3479425640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f34741049b0 0x7f347419a310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:33:25.431 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.425+0000 7f3479425640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3474105300 0x7f347419a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:33:25.431 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.425+0000 7f3479425640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f347410de10 0x7f347419fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:33:25.431 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.425+0000 7f3479425640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f3474113800 con 0x7f3474105300 2024-09-21T01:33:25.431 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.425+0000 7f3479425640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f3474113680 con 0x7f34741049b0 2024-09-21T01:33:25.431 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.425+0000 7f3479425640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f3474113980 con 0x7f347410de10 2024-09-21T01:33:25.431 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.425+0000 7f34727fc640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3474105300 0x7f347419a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:33:25.431 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.425+0000 7f34727fc640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3474105300 0x7f347419a8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:57540/0 (socket says 172.21.15.83:57540) 2024-09-21T01:33:25.431 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.425+0000 7f34727fc640 1 -- 172.21.15.83:0/1283579655 learned_addr learned my addr 172.21.15.83:0/1283579655 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:33:25.431 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.426+0000 7f34737fe640 1 --2- 172.21.15.83:0/1283579655 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f347410de10 0x7f347419fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:33:25.431 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.426+0000 7f3472ffd640 1 --2- 172.21.15.83:0/1283579655 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f34741049b0 0x7f347419a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:33:25.431 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.426+0000 7f34727fc640 1 -- 172.21.15.83:0/1283579655 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f347410de10 msgr2=0x7f347419fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:33:25.431 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.426+0000 7f34727fc640 1 --2- 172.21.15.83:0/1283579655 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f347410de10 0x7f347419fb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:25.431 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.426+0000 7f34727fc640 1 -- 172.21.15.83:0/1283579655 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f34741049b0 msgr2=0x7f347419a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:33:25.432 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.426+0000 7f34727fc640 1 --2- 172.21.15.83:0/1283579655 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f34741049b0 0x7f347419a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:25.432 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.426+0000 7f34727fc640 1 -- 172.21.15.83:0/1283579655 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34741a01c0 con 0x7f3474105300 2024-09-21T01:33:25.432 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.426+0000 7f34727fc640 1 --2- 172.21.15.83:0/1283579655 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3474105300 0x7f347419a8b0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f346400c8c0 tx=0x7f346400cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:33:25.432 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.426+0000 7f346bfff640 1 -- 172.21.15.83:0/1283579655 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3464007bb0 con 0x7f3474105300 2024-09-21T01:33:25.432 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.426+0000 7f346bfff640 1 -- 172.21.15.83:0/1283579655 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(24 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f3464007d50 con 0x7f3474105300 2024-09-21T01:33:25.432 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.426+0000 7f3479425640 1 -- 172.21.15.83:0/1283579655 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34741a04b0 con 0x7f3474105300 2024-09-21T01:33:25.432 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.426+0000 7f346bfff640 1 -- 172.21.15.83:0/1283579655 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3464018660 con 0x7f3474105300 2024-09-21T01:33:25.432 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.426+0000 7f3479425640 1 -- 172.21.15.83:0/1283579655 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34741a6cd0 con 0x7f3474105300 2024-09-21T01:33:25.432 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.427+0000 7f3479425640 1 -- 172.21.15.83:0/1283579655 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3474104dc0 con 0x7f3474105300 2024-09-21T01:33:25.432 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.429+0000 7f346bfff640 1 -- 172.21.15.83:0/1283579655 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 19) ==== 154473+0+0 (secure 0 0 0) 0x7f346400f9e0 con 0x7f3474105300 2024-09-21T01:33:25.433 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.430+0000 7f346bfff640 1 --2- 172.21.15.83:0/1283579655 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f34600b6500 0x7f34600b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:33:25.433 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.430+0000 7f3472ffd640 1 --2- 172.21.15.83:0/1283579655 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f34600b6500 0x7f34600b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:33:25.433 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.430+0000 7f346bfff640 1 -- 172.21.15.83:0/1283579655 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f34640e5a10 con 0x7f3474105300 2024-09-21T01:33:25.433 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.430+0000 7f3472ffd640 1 --2- 172.21.15.83:0/1283579655 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f34600b6500 0x7f34600b8a10 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f345c000c00 tx=0x7f345c009680 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:33:25.436 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.436+0000 7f346bfff640 1 -- 172.21.15.83:0/1283579655 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3464014030 con 0x7f3474105300 2024-09-21T01:33:25.464 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:25 smithi142 ceph-mon[34050]: from='client.? 172.21.15.83:0/3731767435' entity='client.admin' 2024-09-21T01:33:25.468 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:25 smithi119 ceph-mon[33693]: from='client.? 172.21.15.83:0/3731767435' entity='client.admin' 2024-09-21T01:33:25.627 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.626+0000 7f81bed45640 1 -- 172.21.15.83:0/1086665978 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f81b8103b80 msgr2=0x7f81b8103f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:33:25.627 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.626+0000 7f81bed45640 1 --2- 172.21.15.83:0/1086665978 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f81b8103b80 0x7f81b8103f90 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f81b4009ca0 tx=0x7f81b402a8c0 comp rx=0 tx=0).stop 2024-09-21T01:33:25.627 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.626+0000 7f81bed45640 1 -- 172.21.15.83:0/1086665978 shutdown_connections 2024-09-21T01:33:25.627 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.626+0000 7f81bed45640 1 --2- 172.21.15.83:0/1086665978 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f81b8109e10 0x7f81b8110640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:25.627 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.626+0000 7f81bed45640 1 --2- 172.21.15.83:0/1086665978 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f81b81094c0 0x7f81b81098d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:25.627 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.626+0000 7f81bed45640 1 --2- 172.21.15.83:0/1086665978 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f81b8103b80 0x7f81b8103f90 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:25.627 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.626+0000 7f81bed45640 1 -- 172.21.15.83:0/1086665978 >> 172.21.15.83:0/1086665978 conn(0x7f81b80ff610 msgr2=0x7f81b8101a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:33:25.627 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.626+0000 7f81bed45640 1 -- 172.21.15.83:0/1086665978 shutdown_connections 2024-09-21T01:33:25.627 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.626+0000 7f81bed45640 1 -- 172.21.15.83:0/1086665978 wait complete. 2024-09-21T01:33:25.629 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.627+0000 7f81bed45640 1 Processor -- start 2024-09-21T01:33:25.629 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.627+0000 7f81bed45640 1 -- start start 2024-09-21T01:33:25.629 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.627+0000 7f81bed45640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f81b8103b80 0x7f81b819a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:33:25.629 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.627+0000 7f81bed45640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f81b81094c0 0x7f81b819a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:33:25.630 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.627+0000 7f81bed45640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f81b8109e10 0x7f81b819fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:33:25.630 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.627+0000 7f81bed45640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f81b8113860 con 0x7f81b8103b80 2024-09-21T01:33:25.630 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.627+0000 7f81bed45640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f81b81136e0 con 0x7f81b8109e10 2024-09-21T01:33:25.630 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.627+0000 7f81bed45640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f81b81139e0 con 0x7f81b81094c0 2024-09-21T01:33:25.630 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.627+0000 7f81bcae1640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f81b8103b80 0x7f81b819a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:33:25.630 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.627+0000 7f81bcae1640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f81b8103b80 0x7f81b819a2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:57568/0 (socket says 172.21.15.83:57568) 2024-09-21T01:33:25.630 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.627+0000 7f81affff640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f81b81094c0 0x7f81b819a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:33:25.630 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.627+0000 7f81bcae1640 1 -- 172.21.15.83:0/1293218305 learned_addr learned my addr 172.21.15.83:0/1293218305 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:33:25.630 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.628+0000 7f81bd2e2640 1 --2- 172.21.15.83:0/1293218305 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f81b8109e10 0x7f81b819fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:33:25.630 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.628+0000 7f81bcae1640 1 -- 172.21.15.83:0/1293218305 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f81b81094c0 msgr2=0x7f81b819a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:33:25.630 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.628+0000 7f81bcae1640 1 --2- 172.21.15.83:0/1293218305 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f81b81094c0 0x7f81b819a870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:25.630 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.628+0000 7f81bcae1640 1 -- 172.21.15.83:0/1293218305 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f81b8109e10 msgr2=0x7f81b819fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:33:25.630 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.628+0000 7f81bcae1640 1 --2- 172.21.15.83:0/1293218305 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f81b8109e10 0x7f81b819fb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:25.631 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.628+0000 7f81bcae1640 1 -- 172.21.15.83:0/1293218305 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81b81a0240 con 0x7f81b8103b80 2024-09-21T01:33:25.631 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.628+0000 7f81affff640 1 --2- 172.21.15.83:0/1293218305 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f81b81094c0 0x7f81b819a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:33:25.631 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.628+0000 7f81bcae1640 1 --2- 172.21.15.83:0/1293218305 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f81b8103b80 0x7f81b819a2d0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f81b4006010 tx=0x7f81b4003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:33:25.631 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.628+0000 7f81adffb640 1 -- 172.21.15.83:0/1293218305 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81b4003e20 con 0x7f81b8103b80 2024-09-21T01:33:25.631 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.628+0000 7f81adffb640 1 -- 172.21.15.83:0/1293218305 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(24 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f81b40044b0 con 0x7f81b8103b80 2024-09-21T01:33:25.631 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.628+0000 7f81bed45640 1 -- 172.21.15.83:0/1293218305 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81b81a04d0 con 0x7f81b8103b80 2024-09-21T01:33:25.631 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.628+0000 7f81adffb640 1 -- 172.21.15.83:0/1293218305 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81b4030c10 con 0x7f81b8103b80 2024-09-21T01:33:25.631 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.629+0000 7f81bed45640 1 -- 172.21.15.83:0/1293218305 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81b81a6c90 con 0x7f81b8103b80 2024-09-21T01:33:25.631 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.629+0000 7f3479425640 1 -- 172.21.15.83:0/1283579655 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command([{prefix=config set, name=debug_client}] v 0) -- 0x7f3474108f10 con 0x7f3474105300 2024-09-21T01:33:25.632 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.630+0000 7f81bed45640 1 -- 172.21.15.83:0/1293218305 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81b8103f90 con 0x7f81b8103b80 2024-09-21T01:33:25.632 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.631+0000 7f81adffb640 1 -- 172.21.15.83:0/1293218305 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 19) ==== 154473+0+0 (secure 0 0 0) 0x7f81b4004040 con 0x7f81b8103b80 2024-09-21T01:33:25.632 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.632+0000 7f81adffb640 1 --2- 172.21.15.83:0/1293218305 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f81a00b64d0 0x7f81a00b89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:33:25.632 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.632+0000 7f81affff640 1 --2- 172.21.15.83:0/1293218305 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f81a00b64d0 0x7f81a00b89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:33:25.632 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.632+0000 7f81adffb640 1 -- 172.21.15.83:0/1293218305 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f81b4106a90 con 0x7f81b8103b80 2024-09-21T01:33:25.633 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.632+0000 7f81affff640 1 --2- 172.21.15.83:0/1293218305 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f81a00b64d0 0x7f81a00b89e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f81b81090c0 tx=0x7f81a800b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:33:25.637 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.636+0000 7f81adffb640 1 -- 172.21.15.83:0/1293218305 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f81b40cef20 con 0x7f81b8103b80 2024-09-21T01:33:25.640 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.640+0000 7f346bfff640 1 -- 172.21.15.83:0/1283579655 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_client}]=0 v23)=0 v23) ==== 111+0+0 (secure 0 0 0) 0x7f34640adf30 con 0x7f3474105300 2024-09-21T01:33:25.643 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.643+0000 7f3479425640 1 -- 172.21.15.83:0/1283579655 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f34600b6500 msgr2=0x7f34600b8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:33:25.643 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.643+0000 7f3479425640 1 --2- 172.21.15.83:0/1283579655 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f34600b6500 0x7f34600b8a10 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f345c000c00 tx=0x7f345c009680 comp rx=0 tx=0).stop 2024-09-21T01:33:25.643 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.643+0000 7f3479425640 1 -- 172.21.15.83:0/1283579655 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3474105300 msgr2=0x7f347419a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:33:25.644 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.643+0000 7f3479425640 1 --2- 172.21.15.83:0/1283579655 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3474105300 0x7f347419a8b0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f346400c8c0 tx=0x7f346400cd80 comp rx=0 tx=0).stop 2024-09-21T01:33:25.644 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.643+0000 7f3479425640 1 -- 172.21.15.83:0/1283579655 shutdown_connections 2024-09-21T01:33:25.644 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.643+0000 7f3479425640 1 --2- 172.21.15.83:0/1283579655 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f34600b6500 0x7f34600b8a10 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:25.644 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.643+0000 7f3479425640 1 --2- 172.21.15.83:0/1283579655 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f347410de10 0x7f347419fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:25.644 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.643+0000 7f3479425640 1 --2- 172.21.15.83:0/1283579655 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3474105300 0x7f347419a8b0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:25.644 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.643+0000 7f3479425640 1 --2- 172.21.15.83:0/1283579655 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f34741049b0 0x7f347419a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:25.644 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.643+0000 7f3479425640 1 -- 172.21.15.83:0/1283579655 >> 172.21.15.83:0/1283579655 conn(0x7f3474079730 msgr2=0x7f3474100990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:33:25.644 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.643+0000 7f3479425640 1 -- 172.21.15.83:0/1283579655 shutdown_connections 2024-09-21T01:33:25.644 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.643+0000 7f3479425640 1 -- 172.21.15.83:0/1283579655 wait complete. 2024-09-21T01:33:25.839 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.839+0000 7f81bed45640 1 -- 172.21.15.83:0/1293218305 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command([{prefix=config set, name=mon_op_complaint_time}] v 0) -- 0x7f81b810bb90 con 0x7f81b8103b80 2024-09-21T01:33:25.844 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.843+0000 7f81adffb640 1 -- 172.21.15.83:0/1293218305 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_op_complaint_time}]=0 v24)=0 v24) ==== 121+0+0 (secure 0 0 0) 0x7f81b40d3300 con 0x7f81b8103b80 2024-09-21T01:33:25.846 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.846+0000 7f81bed45640 1 -- 172.21.15.83:0/1293218305 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f81a00b64d0 msgr2=0x7f81a00b89e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:33:25.847 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.846+0000 7f81bed45640 1 --2- 172.21.15.83:0/1293218305 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f81a00b64d0 0x7f81a00b89e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f81b81090c0 tx=0x7f81a800b390 comp rx=0 tx=0).stop 2024-09-21T01:33:25.847 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.846+0000 7f81bed45640 1 -- 172.21.15.83:0/1293218305 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f81b8103b80 msgr2=0x7f81b819a2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:33:25.847 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.846+0000 7f81bed45640 1 --2- 172.21.15.83:0/1293218305 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f81b8103b80 0x7f81b819a2d0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f81b4006010 tx=0x7f81b4003970 comp rx=0 tx=0).stop 2024-09-21T01:33:25.847 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.846+0000 7f81bed45640 1 -- 172.21.15.83:0/1293218305 shutdown_connections 2024-09-21T01:33:25.847 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.846+0000 7f81bed45640 1 --2- 172.21.15.83:0/1293218305 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f81a00b64d0 0x7f81a00b89e0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:25.847 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.846+0000 7f81bed45640 1 --2- 172.21.15.83:0/1293218305 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f81b8109e10 0x7f81b819fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:25.847 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.846+0000 7f81bed45640 1 --2- 172.21.15.83:0/1293218305 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f81b81094c0 0x7f81b819a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:25.847 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.846+0000 7f81bed45640 1 --2- 172.21.15.83:0/1293218305 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f81b8103b80 0x7f81b819a2d0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:25.847 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.846+0000 7f81bed45640 1 -- 172.21.15.83:0/1293218305 >> 172.21.15.83:0/1293218305 conn(0x7f81b80ff610 msgr2=0x7f81b8101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:33:25.847 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.846+0000 7f81bed45640 1 -- 172.21.15.83:0/1293218305 shutdown_connections 2024-09-21T01:33:25.847 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.846+0000 7f81bed45640 1 -- 172.21.15.83:0/1293218305 wait complete. 2024-09-21T01:33:25.985 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.967+0000 7f8f25908640 1 -- 172.21.15.83:0/1135857951 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8f20102aa0 msgr2=0x7f8f20102eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:33:25.985 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.967+0000 7f8f25908640 1 --2- 172.21.15.83:0/1135857951 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8f20102aa0 0x7f8f20102eb0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f8f10009900 tx=0x7f8f1002a410 comp rx=0 tx=0).stop 2024-09-21T01:33:25.985 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.967+0000 7f8f25908640 1 -- 172.21.15.83:0/1135857951 shutdown_connections 2024-09-21T01:33:25.985 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.967+0000 7f8f25908640 1 --2- 172.21.15.83:0/1135857951 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8f20108d30 0x7f8f2010f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:25.985 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.967+0000 7f8f25908640 1 --2- 172.21.15.83:0/1135857951 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8f201083e0 0x7f8f201087f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:25.986 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.967+0000 7f8f25908640 1 --2- 172.21.15.83:0/1135857951 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8f20102aa0 0x7f8f20102eb0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:25.986 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.967+0000 7f8f25908640 1 -- 172.21.15.83:0/1135857951 >> 172.21.15.83:0/1135857951 conn(0x7f8f20079750 msgr2=0x7f8f20079b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:33:25.986 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.967+0000 7f8f25908640 1 -- 172.21.15.83:0/1135857951 shutdown_connections 2024-09-21T01:33:25.986 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.967+0000 7f8f25908640 1 -- 172.21.15.83:0/1135857951 wait complete. 2024-09-21T01:33:25.986 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.968+0000 7f8f25908640 1 Processor -- start 2024-09-21T01:33:25.986 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.968+0000 7f8f25908640 1 -- start start 2024-09-21T01:33:25.986 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.969+0000 7f8f25908640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8f20102aa0 0x7f8f2019a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:33:25.986 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.969+0000 7f8f25908640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8f201083e0 0x7f8f2019a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:33:25.986 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.969+0000 7f8f25908640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8f20108d30 0x7f8f2019fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:33:25.986 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.969+0000 7f8f25908640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f8f201138a0 con 0x7f8f201083e0 2024-09-21T01:33:25.986 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.969+0000 7f8f25908640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f8f20113720 con 0x7f8f20108d30 2024-09-21T01:33:25.986 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.969+0000 7f8f25908640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f8f20113a20 con 0x7f8f20102aa0 2024-09-21T01:33:25.986 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.969+0000 7f8f1e7fc640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8f201083e0 0x7f8f2019a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:33:25.986 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.969+0000 7f8f1e7fc640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8f201083e0 0x7f8f2019a970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:57588/0 (socket says 172.21.15.83:57588) 2024-09-21T01:33:25.987 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.969+0000 7f8f1e7fc640 1 -- 172.21.15.83:0/976398013 learned_addr learned my addr 172.21.15.83:0/976398013 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:33:25.987 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.969+0000 7f8f1effd640 1 --2- 172.21.15.83:0/976398013 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8f20102aa0 0x7f8f2019a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:33:25.987 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.969+0000 7f8f1f7fe640 1 --2- 172.21.15.83:0/976398013 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8f20108d30 0x7f8f2019fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:33:25.987 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.969+0000 7f8f1e7fc640 1 -- 172.21.15.83:0/976398013 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8f20102aa0 msgr2=0x7f8f2019a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:33:25.987 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.969+0000 7f8f1e7fc640 1 --2- 172.21.15.83:0/976398013 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8f20102aa0 0x7f8f2019a3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:25.987 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.969+0000 7f8f1e7fc640 1 -- 172.21.15.83:0/976398013 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8f20108d30 msgr2=0x7f8f2019fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:33:25.987 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.969+0000 7f8f1e7fc640 1 --2- 172.21.15.83:0/976398013 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8f20108d30 0x7f8f2019fc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:25.987 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.969+0000 7f8f1e7fc640 1 -- 172.21.15.83:0/976398013 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f201a0340 con 0x7f8f201083e0 2024-09-21T01:33:25.987 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.969+0000 7f8f1f7fe640 1 --2- 172.21.15.83:0/976398013 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8f20108d30 0x7f8f2019fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:33:25.987 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.969+0000 7f8f1e7fc640 1 --2- 172.21.15.83:0/976398013 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8f201083e0 0x7f8f2019a970 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f8f1400d740 tx=0x7f8f1400dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:33:25.987 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.970+0000 7f8f24906640 1 -- 172.21.15.83:0/976398013 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f14017070 con 0x7f8f201083e0 2024-09-21T01:33:25.987 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.970+0000 7f8f24906640 1 -- 172.21.15.83:0/976398013 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(24 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f8f1400de50 con 0x7f8f201083e0 2024-09-21T01:33:25.987 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.970+0000 7f8f25908640 1 -- 172.21.15.83:0/976398013 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f201a0630 con 0x7f8f201083e0 2024-09-21T01:33:25.988 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.970+0000 7f8f24906640 1 -- 172.21.15.83:0/976398013 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f1400f3c0 con 0x7f8f201083e0 2024-09-21T01:33:25.988 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.970+0000 7f8f25908640 1 -- 172.21.15.83:0/976398013 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f201a6d90 con 0x7f8f201083e0 2024-09-21T01:33:25.988 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.971+0000 7f8f25908640 1 -- 172.21.15.83:0/976398013 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f20102eb0 con 0x7f8f201083e0 2024-09-21T01:33:25.988 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.972+0000 7f8f24906640 1 -- 172.21.15.83:0/976398013 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 19) ==== 154473+0+0 (secure 0 0 0) 0x7f8f1401a070 con 0x7f8f201083e0 2024-09-21T01:33:25.988 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.973+0000 7f8f24906640 1 --2- 172.21.15.83:0/976398013 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f8f080b64d0 0x7f8f080b89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:33:25.988 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.973+0000 7f8f1effd640 1 --2- 172.21.15.83:0/976398013 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f8f080b64d0 0x7f8f080b89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:33:25.988 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.973+0000 7f8f24906640 1 -- 172.21.15.83:0/976398013 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f8f140e50d0 con 0x7f8f201083e0 2024-09-21T01:33:25.988 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.973+0000 7f8f1effd640 1 --2- 172.21.15.83:0/976398013 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f8f080b64d0 0x7f8f080b89e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f8f10009230 tx=0x7f8f100058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:33:25.988 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.976+0000 7f8f24906640 1 -- 172.21.15.83:0/976398013 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8f140ad560 con 0x7f8f201083e0 2024-09-21T01:33:26.159 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:26.158+0000 7f8f25908640 1 -- 172.21.15.83:0/976398013 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command([{prefix=config set, name=mds_verify_scatter}] v 0) -- 0x7f8f2010aab0 con 0x7f8f201083e0 2024-09-21T01:33:26.164 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:26.164+0000 7f8f24906640 1 -- 172.21.15.83:0/976398013 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_verify_scatter}]=0 v25)=0 v25) ==== 119+0+0 (secure 0 0 0) 0x7f8f140b1940 con 0x7f8f201083e0 2024-09-21T01:33:26.169 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:26.166+0000 7f8f25908640 1 -- 172.21.15.83:0/976398013 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f8f080b64d0 msgr2=0x7f8f080b89e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:33:26.169 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:26.166+0000 7f8f25908640 1 --2- 172.21.15.83:0/976398013 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f8f080b64d0 0x7f8f080b89e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f8f10009230 tx=0x7f8f100058d0 comp rx=0 tx=0).stop 2024-09-21T01:33:26.169 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:26.166+0000 7f8f25908640 1 -- 172.21.15.83:0/976398013 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8f201083e0 msgr2=0x7f8f2019a970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:33:26.169 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:26.166+0000 7f8f25908640 1 --2- 172.21.15.83:0/976398013 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8f201083e0 0x7f8f2019a970 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f8f1400d740 tx=0x7f8f1400dc00 comp rx=0 tx=0).stop 2024-09-21T01:33:26.169 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:26.166+0000 7f8f25908640 1 -- 172.21.15.83:0/976398013 shutdown_connections 2024-09-21T01:33:26.169 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:26.166+0000 7f8f25908640 1 --2- 172.21.15.83:0/976398013 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f8f080b64d0 0x7f8f080b89e0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:26.169 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:26.166+0000 7f8f25908640 1 --2- 172.21.15.83:0/976398013 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8f20108d30 0x7f8f2019fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:26.169 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:26.166+0000 7f8f25908640 1 --2- 172.21.15.83:0/976398013 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8f201083e0 0x7f8f2019a970 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:26.169 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:26.166+0000 7f8f25908640 1 --2- 172.21.15.83:0/976398013 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8f20102aa0 0x7f8f2019a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:26.169 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:26.166+0000 7f8f25908640 1 -- 172.21.15.83:0/976398013 >> 172.21.15.83:0/976398013 conn(0x7f8f20079750 msgr2=0x7f8f20106630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:33:26.170 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:26.167+0000 7f8f25908640 1 -- 172.21.15.83:0/976398013 shutdown_connections 2024-09-21T01:33:26.170 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:26.167+0000 7f8f25908640 1 -- 172.21.15.83:0/976398013 wait complete. 2024-09-21T01:33:26.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:26 smithi083 ceph-mon[31370]: from='client.? 172.21.15.83:0/4165296468' entity='client.admin' 2024-09-21T01:33:26.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:26 smithi083 ceph-mon[31370]: from='client.? 172.21.15.83:0/1283579655' entity='client.admin' 2024-09-21T01:33:26.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:26 smithi083 ceph-mon[31370]: from='client.? 172.21.15.83:0/1293218305' entity='client.admin' 2024-09-21T01:33:26.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:26 smithi083 ceph-mon[31370]: from='client.? 172.21.15.83:0/976398013' entity='client.admin' 2024-09-21T01:33:26.464 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:26 smithi142 ceph-mon[34050]: from='client.? 172.21.15.83:0/4165296468' entity='client.admin' 2024-09-21T01:33:26.465 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:26 smithi142 ceph-mon[34050]: from='client.? 172.21.15.83:0/1283579655' entity='client.admin' 2024-09-21T01:33:26.465 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:26 smithi142 ceph-mon[34050]: from='client.? 172.21.15.83:0/1293218305' entity='client.admin' 2024-09-21T01:33:26.465 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:26 smithi142 ceph-mon[34050]: from='client.? 172.21.15.83:0/976398013' entity='client.admin' 2024-09-21T01:33:26.468 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:26 smithi119 ceph-mon[33693]: from='client.? 172.21.15.83:0/4165296468' entity='client.admin' 2024-09-21T01:33:26.468 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:26 smithi119 ceph-mon[33693]: from='client.? 172.21.15.83:0/1283579655' entity='client.admin' 2024-09-21T01:33:26.468 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:26 smithi119 ceph-mon[33693]: from='client.? 172.21.15.83:0/1293218305' entity='client.admin' 2024-09-21T01:33:26.468 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:26 smithi119 ceph-mon[33693]: from='client.? 172.21.15.83:0/976398013' entity='client.admin' 2024-09-21T01:33:26.860 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.324+0000 7f86a4879640 1 -- 172.21.15.83:0/1584185349 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f86a0108420 msgr2=0x7f86a0108830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:33:26.860 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.324+0000 7f86a4879640 1 --2- 172.21.15.83:0/1584185349 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f86a0108420 0x7f86a0108830 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f8694009900 tx=0x7f869402a410 comp rx=0 tx=0).stop 2024-09-21T01:33:26.861 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.325+0000 7f86a4879640 1 -- 172.21.15.83:0/1584185349 shutdown_connections 2024-09-21T01:33:26.861 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.325+0000 7f86a4879640 1 --2- 172.21.15.83:0/1584185349 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f86a0108d70 0x7f86a010f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:26.861 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.325+0000 7f86a4879640 1 --2- 172.21.15.83:0/1584185349 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f86a0108420 0x7f86a0108830 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:26.861 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.325+0000 7f86a4879640 1 --2- 172.21.15.83:0/1584185349 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f86a0102ae0 0x7f86a0102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:26.861 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.325+0000 7f86a4879640 1 -- 172.21.15.83:0/1584185349 >> 172.21.15.83:0/1584185349 conn(0x7f86a0079770 msgr2=0x7f86a0079b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:33:26.861 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.325+0000 7f86a4879640 1 -- 172.21.15.83:0/1584185349 shutdown_connections 2024-09-21T01:33:26.861 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.325+0000 7f86a4879640 1 -- 172.21.15.83:0/1584185349 wait complete. 2024-09-21T01:33:26.861 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.325+0000 7f86a4879640 1 Processor -- start 2024-09-21T01:33:26.861 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.325+0000 7f86a4879640 1 -- start start 2024-09-21T01:33:26.861 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.326+0000 7f86a4879640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f86a0102ae0 0x7f86a019a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:33:26.861 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.326+0000 7f86a4879640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f86a0108420 0x7f86a019a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:33:26.861 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.326+0000 7f86a4879640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f86a0108d70 0x7f86a019fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:33:26.861 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.326+0000 7f86a4879640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f86a01127c0 con 0x7f86a0102ae0 2024-09-21T01:33:26.861 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.326+0000 7f86a4879640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f86a0112640 con 0x7f86a0108420 2024-09-21T01:33:26.862 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.326+0000 7f86a4879640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f86a0112940 con 0x7f86a0108d70 2024-09-21T01:33:26.862 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.326+0000 7f869e59c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f86a0102ae0 0x7f86a019a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:33:26.862 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.326+0000 7f869e59c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f86a0102ae0 0x7f86a019a3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:57520/0 (socket says 172.21.15.83:57520) 2024-09-21T01:33:26.862 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.326+0000 7f869e59c640 1 -- 172.21.15.83:0/3155344224 learned_addr learned my addr 172.21.15.83:0/3155344224 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:33:26.862 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.326+0000 7f869ed9d640 1 --2- 172.21.15.83:0/3155344224 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f86a0108d70 0x7f86a019fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:33:26.862 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.326+0000 7f869dd9b640 1 --2- 172.21.15.83:0/3155344224 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f86a0108420 0x7f86a019a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:33:26.862 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.326+0000 7f869e59c640 1 -- 172.21.15.83:0/3155344224 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f86a0108d70 msgr2=0x7f86a019fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:33:26.862 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.326+0000 7f869e59c640 1 --2- 172.21.15.83:0/3155344224 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f86a0108d70 0x7f86a019fbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:26.862 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.326+0000 7f869e59c640 1 -- 172.21.15.83:0/3155344224 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f86a0108420 msgr2=0x7f86a019a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:33:26.862 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.326+0000 7f869e59c640 1 --2- 172.21.15.83:0/3155344224 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f86a0108420 0x7f86a019a940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:26.862 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.326+0000 7f869e59c640 1 -- 172.21.15.83:0/3155344224 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86a01a0310 con 0x7f86a0102ae0 2024-09-21T01:33:26.862 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.326+0000 7f869e59c640 1 --2- 172.21.15.83:0/3155344224 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f86a0102ae0 0x7f86a019a3a0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f869000c970 tx=0x7f869000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:33:26.862 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.326+0000 7f868f7fe640 1 -- 172.21.15.83:0/3155344224 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8690007bb0 con 0x7f86a0102ae0 2024-09-21T01:33:26.863 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.326+0000 7f86a4879640 1 -- 172.21.15.83:0/3155344224 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86a01a0600 con 0x7f86a0102ae0 2024-09-21T01:33:26.863 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.326+0000 7f868f7fe640 1 -- 172.21.15.83:0/3155344224 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(24 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f8690007d50 con 0x7f86a0102ae0 2024-09-21T01:33:26.863 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.326+0000 7f868f7fe640 1 -- 172.21.15.83:0/3155344224 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8690004d40 con 0x7f86a0102ae0 2024-09-21T01:33:26.863 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.327+0000 7f86a4879640 1 -- 172.21.15.83:0/3155344224 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86a01a6d60 con 0x7f86a0102ae0 2024-09-21T01:33:26.863 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.328+0000 7f86a4879640 1 -- 172.21.15.83:0/3155344224 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86a0103d60 con 0x7f86a0102ae0 2024-09-21T01:33:26.863 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.329+0000 7f868f7fe640 1 -- 172.21.15.83:0/3155344224 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 19) ==== 154473+0+0 (secure 0 0 0) 0x7f8690005000 con 0x7f86a0102ae0 2024-09-21T01:33:26.863 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.330+0000 7f868f7fe640 1 --2- 172.21.15.83:0/3155344224 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f86880b64d0 0x7f86880b89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:33:26.863 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.330+0000 7f869dd9b640 1 --2- 172.21.15.83:0/3155344224 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f86880b64d0 0x7f86880b89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:33:26.863 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.330+0000 7f868f7fe640 1 -- 172.21.15.83:0/3155344224 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f86900e5950 con 0x7f86a0102ae0 2024-09-21T01:33:26.863 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.331+0000 7f869dd9b640 1 --2- 172.21.15.83:0/3155344224 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f86880b64d0 0x7f86880b89e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f8694009230 tx=0x7f8694004240 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:33:26.863 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.335+0000 7f868f7fe640 1 -- 172.21.15.83:0/3155344224 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8690014030 con 0x7f86a0102ae0 2024-09-21T01:33:26.863 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.529+0000 7f86a4879640 1 -- 172.21.15.83:0/3155344224 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) -- 0x7f86a0102ef0 con 0x7f86a0102ae0 2024-09-21T01:33:26.864 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.530+0000 7f868f7fe640 1 -- 172.21.15.83:0/3155344224 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v22)=0 v22) ==== 106+0+0 (secure 0 0 0) 0x7f86a0102ef0 con 0x7f86a0102ae0 2024-09-21T01:33:26.864 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.532+0000 7f86a4879640 1 -- 172.21.15.83:0/3155344224 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f86880b64d0 msgr2=0x7f86880b89e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:33:26.864 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.532+0000 7f86a4879640 1 --2- 172.21.15.83:0/3155344224 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f86880b64d0 0x7f86880b89e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f8694009230 tx=0x7f8694004240 comp rx=0 tx=0).stop 2024-09-21T01:33:26.864 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.532+0000 7f86a4879640 1 -- 172.21.15.83:0/3155344224 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f86a0102ae0 msgr2=0x7f86a019a3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:33:26.864 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.532+0000 7f86a4879640 1 --2- 172.21.15.83:0/3155344224 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f86a0102ae0 0x7f86a019a3a0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f869000c970 tx=0x7f869000ce30 comp rx=0 tx=0).stop 2024-09-21T01:33:26.864 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.535+0000 7f86a4879640 1 -- 172.21.15.83:0/3155344224 shutdown_connections 2024-09-21T01:33:26.864 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.535+0000 7f86a4879640 1 --2- 172.21.15.83:0/3155344224 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f86880b64d0 0x7f86880b89e0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:26.864 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.535+0000 7f86a4879640 1 --2- 172.21.15.83:0/3155344224 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f86a0108d70 0x7f86a019fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:26.864 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.535+0000 7f86a4879640 1 --2- 172.21.15.83:0/3155344224 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f86a0108420 0x7f86a019a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:26.864 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.535+0000 7f86a4879640 1 --2- 172.21.15.83:0/3155344224 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f86a0102ae0 0x7f86a019a3a0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:26.864 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.535+0000 7f86a4879640 1 -- 172.21.15.83:0/3155344224 >> 172.21.15.83:0/3155344224 conn(0x7f86a0079770 msgr2=0x7f86a0101bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:33:26.864 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.535+0000 7f86a4879640 1 -- 172.21.15.83:0/3155344224 shutdown_connections 2024-09-21T01:33:26.864 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.535+0000 7f86a4879640 1 -- 172.21.15.83:0/3155344224 wait complete. 2024-09-21T01:33:27.591 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:27.590+0000 7f1d8ff7a640 1 -- 172.21.15.83:0/1207222884 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1d8810de10 msgr2=0x7f1d88110300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:33:27.591 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:27.590+0000 7f1d8ff7a640 1 --2- 172.21.15.83:0/1207222884 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1d8810de10 0x7f1d88110300 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f1d80009ca0 tx=0x7f1d8002a8e0 comp rx=0 tx=0).stop 2024-09-21T01:33:27.591 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:27.590+0000 7f1d8ff7a640 1 -- 172.21.15.83:0/1207222884 shutdown_connections 2024-09-21T01:33:27.591 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:27.590+0000 7f1d8ff7a640 1 --2- 172.21.15.83:0/1207222884 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1d8810de10 0x7f1d88110300 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:27.591 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:27.590+0000 7f1d8ff7a640 1 --2- 172.21.15.83:0/1207222884 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1d88105300 0x7f1d8810d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:27.592 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:27.590+0000 7f1d8ff7a640 1 --2- 172.21.15.83:0/1207222884 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1d881049b0 0x7f1d88104dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:27.592 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:27.590+0000 7f1d8ff7a640 1 -- 172.21.15.83:0/1207222884 >> 172.21.15.83:0/1207222884 conn(0x7f1d88079730 msgr2=0x7f1d88079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:33:27.592 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:27.591+0000 7f1d8ff7a640 1 -- 172.21.15.83:0/1207222884 shutdown_connections 2024-09-21T01:33:27.592 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:27.591+0000 7f1d8ff7a640 1 -- 172.21.15.83:0/1207222884 wait complete. 2024-09-21T01:33:27.593 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:27.591+0000 7f1d8ff7a640 1 Processor -- start 2024-09-21T01:33:27.594 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:27.591+0000 7f1d8ff7a640 1 -- start start 2024-09-21T01:33:27.594 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:27.591+0000 7f1d8ff7a640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1d881049b0 0x7f1d8819a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:33:27.594 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:27.592+0000 7f1d8ff7a640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1d88105300 0x7f1d8819a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:33:27.594 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:27.592+0000 7f1d8ff7a640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1d8810de10 0x7f1d8819fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:33:27.594 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:27.592+0000 7f1d8ff7a640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f1d88113890 con 0x7f1d881049b0 2024-09-21T01:33:27.594 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:27.592+0000 7f1d8ff7a640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f1d88113710 con 0x7f1d88105300 2024-09-21T01:33:27.594 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:27.592+0000 7f1d8ff7a640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f1d88113a10 con 0x7f1d8810de10 2024-09-21T01:33:27.594 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:27.592+0000 7f1d8dd16640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1d881049b0 0x7f1d8819a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:33:27.594 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:27.592+0000 7f1d8dd16640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1d881049b0 0x7f1d8819a300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:57602/0 (socket says 172.21.15.83:57602) 2024-09-21T01:33:27.594 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:27.592+0000 7f1d8dd16640 1 -- 172.21.15.83:0/3538113997 learned_addr learned my addr 172.21.15.83:0/3538113997 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:33:27.594 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:27.592+0000 7f1d8e517640 1 --2- 172.21.15.83:0/3538113997 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1d8810de10 0x7f1d8819fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:33:27.595 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:27.592+0000 7f1d8d515640 1 --2- 172.21.15.83:0/3538113997 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1d88105300 0x7f1d8819a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:33:27.595 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:27.592+0000 7f1d8dd16640 1 -- 172.21.15.83:0/3538113997 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1d8810de10 msgr2=0x7f1d8819fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:33:27.595 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:27.592+0000 7f1d8dd16640 1 --2- 172.21.15.83:0/3538113997 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1d8810de10 0x7f1d8819fb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:27.595 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:27.592+0000 7f1d8dd16640 1 -- 172.21.15.83:0/3538113997 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1d88105300 msgr2=0x7f1d8819a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:33:27.595 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:27.592+0000 7f1d8dd16640 1 --2- 172.21.15.83:0/3538113997 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1d88105300 0x7f1d8819a8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:27.595 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:27.592+0000 7f1d8dd16640 1 -- 172.21.15.83:0/3538113997 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d881a0270 con 0x7f1d881049b0 2024-09-21T01:33:27.595 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:27.592+0000 7f1d8e517640 1 --2- 172.21.15.83:0/3538113997 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1d8810de10 0x7f1d8819fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:33:27.595 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:27.592+0000 7f1d8d515640 1 --2- 172.21.15.83:0/3538113997 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1d88105300 0x7f1d8819a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:33:27.595 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:27.592+0000 7f1d8dd16640 1 --2- 172.21.15.83:0/3538113997 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1d881049b0 0x7f1d8819a300 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f1d8400d950 tx=0x7f1d8400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:33:27.595 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:27.592+0000 7f1d7affd640 1 -- 172.21.15.83:0/3538113997 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d84017020 con 0x7f1d881049b0 2024-09-21T01:33:27.595 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:27.592+0000 7f1d7affd640 1 -- 172.21.15.83:0/3538113997 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(24 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f1d84009c30 con 0x7f1d881049b0 2024-09-21T01:33:27.595 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:27.592+0000 7f1d8ff7a640 1 -- 172.21.15.83:0/3538113997 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d881a0560 con 0x7f1d881049b0 2024-09-21T01:33:27.595 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:27.592+0000 7f1d7affd640 1 -- 172.21.15.83:0/3538113997 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d8400f620 con 0x7f1d881049b0 2024-09-21T01:33:27.595 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:27.592+0000 7f1d8ff7a640 1 -- 172.21.15.83:0/3538113997 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d881a6cc0 con 0x7f1d881049b0 2024-09-21T01:33:27.596 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:27.593+0000 7f1d8ff7a640 1 -- 172.21.15.83:0/3538113997 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d88104dc0 con 0x7f1d881049b0 2024-09-21T01:33:27.596 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:27.596+0000 7f1d7affd640 1 -- 172.21.15.83:0/3538113997 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 19) ==== 154473+0+0 (secure 0 0 0) 0x7f1d8401a020 con 0x7f1d881049b0 2024-09-21T01:33:27.597 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:27.596+0000 7f1d7affd640 1 --2- 172.21.15.83:0/3538113997 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f1d740b64d0 0x7f1d740b89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:33:27.597 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:27.597+0000 7f1d8d515640 1 --2- 172.21.15.83:0/3538113997 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f1d740b64d0 0x7f1d740b89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:33:27.597 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:27.597+0000 7f1d7affd640 1 -- 172.21.15.83:0/3538113997 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f1d840e5c00 con 0x7f1d881049b0 2024-09-21T01:33:27.597 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:27.597+0000 7f1d8d515640 1 --2- 172.21.15.83:0/3538113997 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f1d740b64d0 0x7f1d740b89e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f1d7c006fd0 tx=0x7f1d7c008040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:33:27.600 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:27.600+0000 7f1d7affd640 1 -- 172.21.15.83:0/3538113997 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f1d84021020 con 0x7f1d881049b0 2024-09-21T01:33:27.784 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:27.783+0000 7f1d8ff7a640 1 -- 172.21.15.83:0/3538113997 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command([{prefix=config set, name=client_mount_timeout}] v 0) -- 0x7f1d88108f10 con 0x7f1d881049b0 2024-09-21T01:33:27.788 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:27.787+0000 7f1d7affd640 1 -- 172.21.15.83:0/3538113997 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{prefix=config set, name=client_mount_timeout}]=0 v26)=0 v26) ==== 119+0+0 (secure 0 0 0) 0x7f1d840ae090 con 0x7f1d881049b0 2024-09-21T01:33:27.791 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:27.790+0000 7f1d8ff7a640 1 -- 172.21.15.83:0/3538113997 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f1d740b64d0 msgr2=0x7f1d740b89e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:33:27.791 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:27.790+0000 7f1d8ff7a640 1 --2- 172.21.15.83:0/3538113997 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f1d740b64d0 0x7f1d740b89e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f1d7c006fd0 tx=0x7f1d7c008040 comp rx=0 tx=0).stop 2024-09-21T01:33:27.791 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:27.790+0000 7f1d8ff7a640 1 -- 172.21.15.83:0/3538113997 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1d881049b0 msgr2=0x7f1d8819a300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:33:27.791 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:27.790+0000 7f1d8ff7a640 1 --2- 172.21.15.83:0/3538113997 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1d881049b0 0x7f1d8819a300 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f1d8400d950 tx=0x7f1d8400de10 comp rx=0 tx=0).stop 2024-09-21T01:33:27.791 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:27.790+0000 7f1d8ff7a640 1 -- 172.21.15.83:0/3538113997 shutdown_connections 2024-09-21T01:33:27.791 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:27.790+0000 7f1d8ff7a640 1 --2- 172.21.15.83:0/3538113997 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f1d740b64d0 0x7f1d740b89e0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:27.791 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:27.790+0000 7f1d8ff7a640 1 --2- 172.21.15.83:0/3538113997 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1d8810de10 0x7f1d8819fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:27.791 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:27.790+0000 7f1d8ff7a640 1 --2- 172.21.15.83:0/3538113997 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1d88105300 0x7f1d8819a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:27.791 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:27.790+0000 7f1d8ff7a640 1 --2- 172.21.15.83:0/3538113997 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1d881049b0 0x7f1d8819a300 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:27.791 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:27.790+0000 7f1d8ff7a640 1 -- 172.21.15.83:0/3538113997 >> 172.21.15.83:0/3538113997 conn(0x7f1d88079730 msgr2=0x7f1d88100930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:33:27.791 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:27.790+0000 7f1d8ff7a640 1 -- 172.21.15.83:0/3538113997 shutdown_connections 2024-09-21T01:33:27.791 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:27.790+0000 7f1d8ff7a640 1 -- 172.21.15.83:0/3538113997 wait complete. 2024-09-21T01:33:28.938 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:28 smithi083 ceph-mon[31370]: from='client.? 172.21.15.83:0/3538113997' entity='client.admin' 2024-09-21T01:33:29.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:28 smithi142 ceph-mon[34050]: from='client.? 172.21.15.83:0/3538113997' entity='client.admin' 2024-09-21T01:33:29.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:28 smithi119 ceph-mon[33693]: from='client.? 172.21.15.83:0/3538113997' entity='client.admin' 2024-09-21T01:33:30.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:29 smithi083 ceph-mon[31370]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:33:30.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:29 smithi083 ceph-mon[31370]: from='client.? 172.21.15.83:0/3803273600' entity='client.admin' 2024-09-21T01:33:30.175 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:30.174+0000 7feb0e899640 1 -- 172.21.15.83:0/3472548173 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7feb08105340 msgr2=0x7feb0810d890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:33:30.175 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:30.174+0000 7feb0e899640 1 --2- 172.21.15.83:0/3472548173 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7feb08105340 0x7feb0810d890 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7feaf0009900 tx=0x7feaf002a410 comp rx=0 tx=0).stop 2024-09-21T01:33:30.175 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:30.174+0000 7feb0e899640 1 -- 172.21.15.83:0/3472548173 shutdown_connections 2024-09-21T01:33:30.175 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:30.174+0000 7feb0e899640 1 --2- 172.21.15.83:0/3472548173 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feb0810de50 0x7feb08110340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:30.176 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:30.174+0000 7feb0e899640 1 --2- 172.21.15.83:0/3472548173 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7feb08105340 0x7feb0810d890 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:30.176 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:30.174+0000 7feb0e899640 1 --2- 172.21.15.83:0/3472548173 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feb081049f0 0x7feb08104e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:30.176 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:30.174+0000 7feb0e899640 1 -- 172.21.15.83:0/3472548173 >> 172.21.15.83:0/3472548173 conn(0x7feb08079750 msgr2=0x7feb08079b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:33:30.176 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:30.174+0000 7feb0e899640 1 -- 172.21.15.83:0/3472548173 shutdown_connections 2024-09-21T01:33:30.176 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:30.174+0000 7feb0e899640 1 -- 172.21.15.83:0/3472548173 wait complete. 2024-09-21T01:33:30.176 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:30.175+0000 7feb0e899640 1 Processor -- start 2024-09-21T01:33:30.176 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:30.175+0000 7feb0e899640 1 -- start start 2024-09-21T01:33:30.177 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:30.175+0000 7feb0e899640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feb081049f0 0x7feb08102730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:33:30.178 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:30.175+0000 7feb0e899640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7feb08105340 0x7feb08102c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:33:30.178 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:30.175+0000 7feb0e899640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feb0810de50 0x7feb081031b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:33:30.178 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:30.175+0000 7feb0e899640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7feb08113840 con 0x7feb08105340 2024-09-21T01:33:30.178 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:30.175+0000 7feb0e899640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7feb081136c0 con 0x7feb081049f0 2024-09-21T01:33:30.178 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:30.175+0000 7feb0e899640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7feb081139c0 con 0x7feb0810de50 2024-09-21T01:33:30.178 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:30.176+0000 7feb077fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7feb08105340 0x7feb08102c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:33:30.178 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:30.176+0000 7feb077fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7feb08105340 0x7feb08102c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:57636/0 (socket says 172.21.15.83:57636) 2024-09-21T01:33:30.178 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:30.176+0000 7feb077fe640 1 -- 172.21.15.83:0/161099280 learned_addr learned my addr 172.21.15.83:0/161099280 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:33:30.178 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:30.176+0000 7feb0ce36640 1 --2- 172.21.15.83:0/161099280 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feb0810de50 0x7feb081031b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:33:30.178 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:30.176+0000 7feb07fff640 1 --2- 172.21.15.83:0/161099280 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feb081049f0 0x7feb08102730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:33:30.178 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:30.176+0000 7feb077fe640 1 -- 172.21.15.83:0/161099280 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feb0810de50 msgr2=0x7feb081031b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:33:30.178 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:30.176+0000 7feb077fe640 1 --2- 172.21.15.83:0/161099280 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feb0810de50 0x7feb081031b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:30.179 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:30.176+0000 7feb077fe640 1 -- 172.21.15.83:0/161099280 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feb081049f0 msgr2=0x7feb08102730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:33:30.179 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:30.176+0000 7feb077fe640 1 --2- 172.21.15.83:0/161099280 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feb081049f0 0x7feb08102730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:30.179 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:30.176+0000 7feb077fe640 1 -- 172.21.15.83:0/161099280 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb081a8650 con 0x7feb08105340 2024-09-21T01:33:30.179 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:30.176+0000 7feb077fe640 1 --2- 172.21.15.83:0/161099280 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7feb08105340 0x7feb08102c70 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7feaf0005940 tx=0x7feaf0003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:33:30.179 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:30.177+0000 7feb057fa640 1 -- 172.21.15.83:0/161099280 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaf003f070 con 0x7feb08105340 2024-09-21T01:33:30.179 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:30.177+0000 7feb057fa640 1 -- 172.21.15.83:0/161099280 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(24 keys) ==== 1032+0+0 (secure 0 0 0) 0x7feaf003bae0 con 0x7feb08105340 2024-09-21T01:33:30.179 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:30.177+0000 7feb057fa640 1 -- 172.21.15.83:0/161099280 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaf0035030 con 0x7feb08105340 2024-09-21T01:33:30.179 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:30.177+0000 7feb0e899640 1 -- 172.21.15.83:0/161099280 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb081a88e0 con 0x7feb08105340 2024-09-21T01:33:30.179 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:30.177+0000 7feb0e899640 1 -- 172.21.15.83:0/161099280 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb081a8d70 con 0x7feb08105340 2024-09-21T01:33:30.180 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:30.179+0000 7feb0e899640 1 -- 172.21.15.83:0/161099280 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb08104e00 con 0x7feb08105340 2024-09-21T01:33:30.181 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:30.181+0000 7feb057fa640 1 -- 172.21.15.83:0/161099280 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 19) ==== 154473+0+0 (secure 0 0 0) 0x7feaf0042070 con 0x7feb08105340 2024-09-21T01:33:30.182 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:30.182+0000 7feb057fa640 1 --2- 172.21.15.83:0/161099280 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7feaf40b6550 0x7feaf40b8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:33:30.183 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:30.182+0000 7feb07fff640 1 --2- 172.21.15.83:0/161099280 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7feaf40b6550 0x7feaf40b8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:33:30.183 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:30.183+0000 7feb057fa640 1 -- 172.21.15.83:0/161099280 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7feaf0106260 con 0x7feb08105340 2024-09-21T01:33:30.183 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:30.183+0000 7feb07fff640 1 --2- 172.21.15.83:0/161099280 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7feaf40b6550 0x7feaf40b8a60 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7feb08104180 tx=0x7feaf800b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:33:30.185 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:30.185+0000 7feb057fa640 1 -- 172.21.15.83:0/161099280 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7feaf00d2ad0 con 0x7feb08105340 2024-09-21T01:33:30.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:29 smithi142 ceph-mon[34050]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:33:30.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:29 smithi142 ceph-mon[34050]: from='client.? 172.21.15.83:0/3803273600' entity='client.admin' 2024-09-21T01:33:30.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:29 smithi119 ceph-mon[33693]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:33:30.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:29 smithi119 ceph-mon[33693]: from='client.? 172.21.15.83:0/3803273600' entity='client.admin' 2024-09-21T01:33:30.281 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:29.250+0000 7f92ec066640 1 -- 172.21.15.83:0/3355084098 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f92e4109560 msgr2=0x7f92e4109970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:33:30.282 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:29.250+0000 7f92ec066640 1 --2- 172.21.15.83:0/3355084098 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f92e4109560 0x7f92e4109970 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f92d4009900 tx=0x7f92d402a410 comp rx=0 tx=0).stop 2024-09-21T01:33:30.282 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:29.250+0000 7f92ec066640 1 -- 172.21.15.83:0/3355084098 shutdown_connections 2024-09-21T01:33:30.282 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:29.250+0000 7f92ec066640 1 --2- 172.21.15.83:0/3355084098 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f92e4109eb0 0x7f92e41106e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:30.282 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:29.250+0000 7f92ec066640 1 --2- 172.21.15.83:0/3355084098 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f92e4109560 0x7f92e4109970 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:30.282 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:29.250+0000 7f92ec066640 1 --2- 172.21.15.83:0/3355084098 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f92e4102080 0x7f92e4102490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:30.282 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:29.250+0000 7f92ec066640 1 -- 172.21.15.83:0/3355084098 >> 172.21.15.83:0/3355084098 conn(0x7f92e4079ec0 msgr2=0x7f92e407a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:33:30.282 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:29.250+0000 7f92ec066640 1 -- 172.21.15.83:0/3355084098 shutdown_connections 2024-09-21T01:33:30.282 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:29.250+0000 7f92ec066640 1 -- 172.21.15.83:0/3355084098 wait complete. 2024-09-21T01:33:30.282 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:29.251+0000 7f92ec066640 1 Processor -- start 2024-09-21T01:33:30.282 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:29.251+0000 7f92ec066640 1 -- start start 2024-09-21T01:33:30.282 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:29.252+0000 7f92ec066640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f92e4102080 0x7f92e419a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:33:30.282 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:29.252+0000 7f92ec066640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f92e4109560 0x7f92e419a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:33:30.283 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:29.252+0000 7f92ec066640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f92e4109eb0 0x7f92e419fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:33:30.283 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:29.252+0000 7f92ec066640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f92e4113950 con 0x7f92e4102080 2024-09-21T01:33:30.283 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:29.252+0000 7f92ec066640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f92e41137d0 con 0x7f92e4109560 2024-09-21T01:33:30.283 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:29.252+0000 7f92ec066640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f92e4113ad0 con 0x7f92e4109eb0 2024-09-21T01:33:30.283 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:29.252+0000 7f92e9e02640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f92e4102080 0x7f92e419a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:33:30.283 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:29.252+0000 7f92e9e02640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f92e4102080 0x7f92e419a3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:57626/0 (socket says 172.21.15.83:57626) 2024-09-21T01:33:30.283 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:29.252+0000 7f92e9e02640 1 -- 172.21.15.83:0/3803273600 learned_addr learned my addr 172.21.15.83:0/3803273600 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:33:30.283 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:29.252+0000 7f92ea603640 1 --2- 172.21.15.83:0/3803273600 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f92e4109eb0 0x7f92e419fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:33:30.283 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:29.252+0000 7f92e9601640 1 --2- 172.21.15.83:0/3803273600 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f92e4109560 0x7f92e419a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:33:30.283 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:29.252+0000 7f92e9e02640 1 -- 172.21.15.83:0/3803273600 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f92e4109eb0 msgr2=0x7f92e419fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:33:30.283 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:29.252+0000 7f92e9e02640 1 --2- 172.21.15.83:0/3803273600 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f92e4109eb0 0x7f92e419fc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:30.283 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:29.252+0000 7f92e9e02640 1 -- 172.21.15.83:0/3803273600 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f92e4109560 msgr2=0x7f92e419a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:33:30.284 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:29.252+0000 7f92e9e02640 1 --2- 172.21.15.83:0/3803273600 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f92e4109560 0x7f92e419a960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:30.284 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:29.252+0000 7f92e9e02640 1 -- 172.21.15.83:0/3803273600 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92e41a0330 con 0x7f92e4102080 2024-09-21T01:33:30.284 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:29.252+0000 7f92e9601640 1 --2- 172.21.15.83:0/3803273600 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f92e4109560 0x7f92e419a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:33:30.284 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:29.252+0000 7f92e9e02640 1 --2- 172.21.15.83:0/3803273600 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f92e4102080 0x7f92e419a3c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f92dc00d770 tx=0x7f92dc00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:33:30.284 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:29.252+0000 7f92daffd640 1 -- 172.21.15.83:0/3803273600 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92dc017070 con 0x7f92e4102080 2024-09-21T01:33:30.284 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:29.253+0000 7f92daffd640 1 -- 172.21.15.83:0/3803273600 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(24 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f92dc005490 con 0x7f92e4102080 2024-09-21T01:33:30.284 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:29.253+0000 7f92daffd640 1 -- 172.21.15.83:0/3803273600 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92dc004b00 con 0x7f92e4102080 2024-09-21T01:33:30.284 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:29.253+0000 7f92ec066640 1 -- 172.21.15.83:0/3803273600 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92e41a0620 con 0x7f92e4102080 2024-09-21T01:33:30.284 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:29.253+0000 7f92ec066640 1 -- 172.21.15.83:0/3803273600 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92e41a6d80 con 0x7f92e4102080 2024-09-21T01:33:30.284 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:29.253+0000 7f92ec066640 1 -- 172.21.15.83:0/3803273600 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92e4102490 con 0x7f92e4102080 2024-09-21T01:33:30.284 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:29.256+0000 7f92daffd640 1 -- 172.21.15.83:0/3803273600 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 19) ==== 154473+0+0 (secure 0 0 0) 0x7f92dc004ca0 con 0x7f92e4102080 2024-09-21T01:33:30.284 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:29.257+0000 7f92daffd640 1 --2- 172.21.15.83:0/3803273600 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f92d00b6550 0x7f92d00b8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:33:30.284 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:29.257+0000 7f92e9601640 1 --2- 172.21.15.83:0/3803273600 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f92d00b6550 0x7f92d00b8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:33:30.284 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:29.257+0000 7f92daffd640 1 -- 172.21.15.83:0/3803273600 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f92dc0e5680 con 0x7f92e4102080 2024-09-21T01:33:30.285 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:29.257+0000 7f92e9601640 1 --2- 172.21.15.83:0/3803273600 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f92d00b6550 0x7f92d00b8a60 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f92d4005ab0 tx=0x7f92d4005fd0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:33:30.285 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:29.260+0000 7f92daffd640 1 -- 172.21.15.83:0/3803273600 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f92dc0ada70 con 0x7f92e4102080 2024-09-21T01:33:30.285 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:29.445+0000 7f92ec066640 1 -- 172.21.15.83:0/3803273600 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7f92e410bca0 con 0x7f92e4102080 2024-09-21T01:33:30.285 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:29.449+0000 7f92daffd640 1 -- 172.21.15.83:0/3803273600 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v27)=0 v27) ==== 121+0+0 (secure 0 0 0) 0x7f92dc0b1e50 con 0x7f92e4102080 2024-09-21T01:33:30.285 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:29.451+0000 7f92ec066640 1 -- 172.21.15.83:0/3803273600 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f92d00b6550 msgr2=0x7f92d00b8a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:33:30.285 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:29.451+0000 7f92ec066640 1 --2- 172.21.15.83:0/3803273600 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f92d00b6550 0x7f92d00b8a60 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f92d4005ab0 tx=0x7f92d4005fd0 comp rx=0 tx=0).stop 2024-09-21T01:33:30.285 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:29.451+0000 7f92ec066640 1 -- 172.21.15.83:0/3803273600 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f92e4102080 msgr2=0x7f92e419a3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:33:30.285 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:29.451+0000 7f92ec066640 1 --2- 172.21.15.83:0/3803273600 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f92e4102080 0x7f92e419a3c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f92dc00d770 tx=0x7f92dc00dc30 comp rx=0 tx=0).stop 2024-09-21T01:33:30.285 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:29.451+0000 7f92ec066640 1 -- 172.21.15.83:0/3803273600 shutdown_connections 2024-09-21T01:33:30.285 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:29.451+0000 7f92ec066640 1 --2- 172.21.15.83:0/3803273600 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f92d00b6550 0x7f92d00b8a60 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:30.285 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:29.451+0000 7f92ec066640 1 --2- 172.21.15.83:0/3803273600 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f92e4109eb0 0x7f92e419fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:30.285 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:29.451+0000 7f92ec066640 1 --2- 172.21.15.83:0/3803273600 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f92e4109560 0x7f92e419a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:30.285 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:29.451+0000 7f92ec066640 1 --2- 172.21.15.83:0/3803273600 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f92e4102080 0x7f92e419a3c0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:30.285 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:29.451+0000 7f92ec066640 1 -- 172.21.15.83:0/3803273600 >> 172.21.15.83:0/3803273600 conn(0x7f92e4079ec0 msgr2=0x7f92e41076a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:33:30.285 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:29.451+0000 7f92ec066640 1 -- 172.21.15.83:0/3803273600 shutdown_connections 2024-09-21T01:33:30.285 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:29.451+0000 7f92ec066640 1 -- 172.21.15.83:0/3803273600 wait complete. 2024-09-21T01:33:30.376 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:30.375+0000 7feb0e899640 1 -- 172.21.15.83:0/161099280 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command([{prefix=config set, name=mds_bal_fragment_size_max}] v 0) -- 0x7feb08108f50 con 0x7feb08105340 2024-09-21T01:33:30.380 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:30.379+0000 7feb057fa640 1 -- 172.21.15.83:0/161099280 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_fragment_size_max}]=0 v28)=0 v28) ==== 127+0+0 (secure 0 0 0) 0x7feaf00d7a10 con 0x7feb08105340 2024-09-21T01:33:30.383 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:30.382+0000 7feb0e899640 1 -- 172.21.15.83:0/161099280 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7feaf40b6550 msgr2=0x7feaf40b8a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:33:30.383 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:30.382+0000 7feb0e899640 1 --2- 172.21.15.83:0/161099280 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7feaf40b6550 0x7feaf40b8a60 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7feb08104180 tx=0x7feaf800b390 comp rx=0 tx=0).stop 2024-09-21T01:33:30.383 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:30.382+0000 7feb0e899640 1 -- 172.21.15.83:0/161099280 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7feb08105340 msgr2=0x7feb08102c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:33:30.383 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:30.382+0000 7feb0e899640 1 --2- 172.21.15.83:0/161099280 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7feb08105340 0x7feb08102c70 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7feaf0005940 tx=0x7feaf0003c10 comp rx=0 tx=0).stop 2024-09-21T01:33:30.383 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:30.382+0000 7feb0e899640 1 -- 172.21.15.83:0/161099280 shutdown_connections 2024-09-21T01:33:30.383 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:30.382+0000 7feb0e899640 1 --2- 172.21.15.83:0/161099280 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7feaf40b6550 0x7feaf40b8a60 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:30.383 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:30.382+0000 7feb0e899640 1 --2- 172.21.15.83:0/161099280 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feb0810de50 0x7feb081031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:30.383 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:30.382+0000 7feb0e899640 1 --2- 172.21.15.83:0/161099280 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7feb08105340 0x7feb08102c70 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:30.383 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:30.382+0000 7feb0e899640 1 --2- 172.21.15.83:0/161099280 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feb081049f0 0x7feb08102730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:30.383 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:30.382+0000 7feb0e899640 1 -- 172.21.15.83:0/161099280 >> 172.21.15.83:0/161099280 conn(0x7feb08079750 msgr2=0x7feb080ff830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:33:30.383 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:30.382+0000 7feb0e899640 1 -- 172.21.15.83:0/161099280 shutdown_connections 2024-09-21T01:33:30.383 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:30.382+0000 7feb0e899640 1 -- 172.21.15.83:0/161099280 wait complete. 2024-09-21T01:33:30.877 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.010+0000 7fd9d7f49640 1 -- 172.21.15.83:0/4101017784 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd9d0103b60 msgr2=0x7fd9d0103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:33:30.877 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.010+0000 7fd9d7f49640 1 --2- 172.21.15.83:0/4101017784 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd9d0103b60 0x7fd9d0103f70 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fd9c0009900 tx=0x7fd9c002a410 comp rx=0 tx=0).stop 2024-09-21T01:33:30.877 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.010+0000 7fd9d7f49640 1 -- 172.21.15.83:0/4101017784 shutdown_connections 2024-09-21T01:33:30.877 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.010+0000 7fd9d7f49640 1 --2- 172.21.15.83:0/4101017784 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd9d0109df0 0x7fd9d0110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:30.878 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.010+0000 7fd9d7f49640 1 --2- 172.21.15.83:0/4101017784 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd9d01094a0 0x7fd9d01098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:30.878 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.010+0000 7fd9d7f49640 1 --2- 172.21.15.83:0/4101017784 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd9d0103b60 0x7fd9d0103f70 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:30.878 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.010+0000 7fd9d7f49640 1 -- 172.21.15.83:0/4101017784 >> 172.21.15.83:0/4101017784 conn(0x7fd9d007b850 msgr2=0x7fd9d007bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:33:30.878 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.010+0000 7fd9d7f49640 1 -- 172.21.15.83:0/4101017784 shutdown_connections 2024-09-21T01:33:30.878 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.010+0000 7fd9d7f49640 1 -- 172.21.15.83:0/4101017784 wait complete. 2024-09-21T01:33:30.878 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.011+0000 7fd9d7f49640 1 Processor -- start 2024-09-21T01:33:30.878 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.011+0000 7fd9d7f49640 1 -- start start 2024-09-21T01:33:30.878 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.011+0000 7fd9d7f49640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd9d0103b60 0x7fd9d0077120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:33:30.878 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.011+0000 7fd9d7f49640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd9d01094a0 0x7fd9d0075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:33:30.878 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.011+0000 7fd9d7f49640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd9d0109df0 0x7fd9d0075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:33:30.878 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.011+0000 7fd9d7f49640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fd9d0113890 con 0x7fd9d0103b60 2024-09-21T01:33:30.878 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.011+0000 7fd9d7f49640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fd9d0113710 con 0x7fd9d0109df0 2024-09-21T01:33:30.878 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.011+0000 7fd9d7f49640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fd9d0113a10 con 0x7fd9d01094a0 2024-09-21T01:33:30.878 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.011+0000 7fd9d5ce5640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd9d0103b60 0x7fd9d0077120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:33:30.879 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.011+0000 7fd9d5ce5640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd9d0103b60 0x7fd9d0077120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:57500/0 (socket says 172.21.15.83:57500) 2024-09-21T01:33:30.879 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.011+0000 7fd9d5ce5640 1 -- 172.21.15.83:0/4165296468 learned_addr learned my addr 172.21.15.83:0/4165296468 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:33:30.879 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.011+0000 7fd9d64e6640 1 --2- 172.21.15.83:0/4165296468 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd9d0109df0 0x7fd9d0075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:33:30.879 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.011+0000 7fd9d54e4640 1 --2- 172.21.15.83:0/4165296468 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd9d01094a0 0x7fd9d0075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:33:30.879 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.011+0000 7fd9d5ce5640 1 -- 172.21.15.83:0/4165296468 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd9d01094a0 msgr2=0x7fd9d0075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:33:30.879 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.011+0000 7fd9d5ce5640 1 --2- 172.21.15.83:0/4165296468 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd9d01094a0 0x7fd9d0075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:30.879 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.011+0000 7fd9d5ce5640 1 -- 172.21.15.83:0/4165296468 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd9d0109df0 msgr2=0x7fd9d0075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:33:30.879 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.011+0000 7fd9d5ce5640 1 --2- 172.21.15.83:0/4165296468 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd9d0109df0 0x7fd9d0075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:30.879 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.011+0000 7fd9d5ce5640 1 -- 172.21.15.83:0/4165296468 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9d0076470 con 0x7fd9d0103b60 2024-09-21T01:33:30.879 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.011+0000 7fd9d64e6640 1 --2- 172.21.15.83:0/4165296468 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd9d0109df0 0x7fd9d0075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:33:30.879 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.011+0000 7fd9d54e4640 1 --2- 172.21.15.83:0/4165296468 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd9d01094a0 0x7fd9d0075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:33:30.879 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.012+0000 7fd9d5ce5640 1 --2- 172.21.15.83:0/4165296468 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd9d0103b60 0x7fd9d0077120 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fd9c002aa00 tx=0x7fd9c0003cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:33:30.879 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.012+0000 7fd9ceffd640 1 -- 172.21.15.83:0/4165296468 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9c003f070 con 0x7fd9d0103b60 2024-09-21T01:33:30.880 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.012+0000 7fd9ceffd640 1 -- 172.21.15.83:0/4165296468 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(24 keys) ==== 1032+0+0 (secure 0 0 0) 0x7fd9c003bce0 con 0x7fd9d0103b60 2024-09-21T01:33:30.880 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.012+0000 7fd9ceffd640 1 -- 172.21.15.83:0/4165296468 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9c0035030 con 0x7fd9d0103b60 2024-09-21T01:33:30.880 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.012+0000 7fd9d7f49640 1 -- 172.21.15.83:0/4165296468 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9d01acc60 con 0x7fd9d0103b60 2024-09-21T01:33:30.880 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.012+0000 7fd9d7f49640 1 -- 172.21.15.83:0/4165296468 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9d01ad140 con 0x7fd9d0103b60 2024-09-21T01:33:30.880 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.013+0000 7fd9d7f49640 1 -- 172.21.15.83:0/4165296468 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9d0103f70 con 0x7fd9d0103b60 2024-09-21T01:33:30.880 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.014+0000 7fd9ceffd640 1 -- 172.21.15.83:0/4165296468 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 19) ==== 154473+0+0 (secure 0 0 0) 0x7fd9c0042070 con 0x7fd9d0103b60 2024-09-21T01:33:30.880 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.015+0000 7fd9ceffd640 1 --2- 172.21.15.83:0/4165296468 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fd9b80b64d0 0x7fd9b80b89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:33:30.880 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.015+0000 7fd9d54e4640 1 --2- 172.21.15.83:0/4165296468 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fd9b80b64d0 0x7fd9b80b89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:33:30.880 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.015+0000 7fd9ceffd640 1 -- 172.21.15.83:0/4165296468 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fd9c0106090 con 0x7fd9d0103b60 2024-09-21T01:33:30.880 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.015+0000 7fd9d54e4640 1 --2- 172.21.15.83:0/4165296468 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fd9b80b64d0 0x7fd9b80b89e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fd9d0106610 tx=0x7fd9c4005e50 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:33:30.880 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.019+0000 7fd9ceffd640 1 -- 172.21.15.83:0/4165296468 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd9c00ce520 con 0x7fd9d0103b60 2024-09-21T01:33:30.880 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.206+0000 7fd9d7f49640 1 -- 172.21.15.83:0/4165296468 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_pool_no_app}] v 0) -- 0x7fd9d010bb70 con 0x7fd9d0103b60 2024-09-21T01:33:30.880 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.212+0000 7fd9ceffd640 1 -- 172.21.15.83:0/4165296468 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_pool_no_app}]=0 v22)=0 v22) ==== 125+0+0 (secure 0 0 0) 0x7fd9c00d2900 con 0x7fd9d0103b60 2024-09-21T01:33:30.880 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.214+0000 7fd9d7f49640 1 -- 172.21.15.83:0/4165296468 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fd9b80b64d0 msgr2=0x7fd9b80b89e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:33:30.881 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.214+0000 7fd9d7f49640 1 --2- 172.21.15.83:0/4165296468 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fd9b80b64d0 0x7fd9b80b89e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fd9d0106610 tx=0x7fd9c4005e50 comp rx=0 tx=0).stop 2024-09-21T01:33:30.881 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.214+0000 7fd9d7f49640 1 -- 172.21.15.83:0/4165296468 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd9d0103b60 msgr2=0x7fd9d0077120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:33:30.881 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.214+0000 7fd9d7f49640 1 --2- 172.21.15.83:0/4165296468 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd9d0103b60 0x7fd9d0077120 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fd9c002aa00 tx=0x7fd9c0003cd0 comp rx=0 tx=0).stop 2024-09-21T01:33:30.881 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.214+0000 7fd9d7f49640 1 -- 172.21.15.83:0/4165296468 shutdown_connections 2024-09-21T01:33:30.881 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.214+0000 7fd9d7f49640 1 --2- 172.21.15.83:0/4165296468 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fd9b80b64d0 0x7fd9b80b89e0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:30.881 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.214+0000 7fd9d7f49640 1 --2- 172.21.15.83:0/4165296468 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd9d0109df0 0x7fd9d0075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:30.881 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.214+0000 7fd9d7f49640 1 --2- 172.21.15.83:0/4165296468 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd9d01094a0 0x7fd9d0075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:30.881 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.214+0000 7fd9d7f49640 1 --2- 172.21.15.83:0/4165296468 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd9d0103b60 0x7fd9d0077120 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:30.881 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.214+0000 7fd9d7f49640 1 -- 172.21.15.83:0/4165296468 >> 172.21.15.83:0/4165296468 conn(0x7fd9d007b850 msgr2=0x7fd9d0107640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:33:30.881 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.214+0000 7fd9d7f49640 1 -- 172.21.15.83:0/4165296468 shutdown_connections 2024-09-21T01:33:30.881 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:25.214+0000 7fd9d7f49640 1 -- 172.21.15.83:0/4165296468 wait complete. 2024-09-21T01:33:31.241 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:31.240+0000 7f22cb81f640 1 -- 172.21.15.83:0/1334994487 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f22c410de10 msgr2=0x7f22c4110300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:33:31.241 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:31.240+0000 7f22cb81f640 1 --2- 172.21.15.83:0/1334994487 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f22c410de10 0x7f22c4110300 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f22bc009ca0 tx=0x7f22bc02a8c0 comp rx=0 tx=0).stop 2024-09-21T01:33:31.241 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:31.240+0000 7f22cb81f640 1 -- 172.21.15.83:0/1334994487 shutdown_connections 2024-09-21T01:33:31.241 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:31.240+0000 7f22cb81f640 1 --2- 172.21.15.83:0/1334994487 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f22c410de10 0x7f22c4110300 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:31.241 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:31.240+0000 7f22cb81f640 1 --2- 172.21.15.83:0/1334994487 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f22c4105300 0x7f22c410d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:31.241 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:31.240+0000 7f22cb81f640 1 --2- 172.21.15.83:0/1334994487 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f22c41049b0 0x7f22c4104dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:31.241 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:31.240+0000 7f22cb81f640 1 -- 172.21.15.83:0/1334994487 >> 172.21.15.83:0/1334994487 conn(0x7f22c4079730 msgr2=0x7f22c4079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:33:31.241 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:31.240+0000 7f22cb81f640 1 -- 172.21.15.83:0/1334994487 shutdown_connections 2024-09-21T01:33:31.241 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:31.240+0000 7f22cb81f640 1 -- 172.21.15.83:0/1334994487 wait complete. 2024-09-21T01:33:31.243 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:31.241+0000 7f22cb81f640 1 Processor -- start 2024-09-21T01:33:31.243 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:31.241+0000 7f22cb81f640 1 -- start start 2024-09-21T01:33:31.243 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:31.241+0000 7f22cb81f640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f22c41049b0 0x7f22c419a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:33:31.243 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:31.241+0000 7f22cb81f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f22c4105300 0x7f22c419a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:33:31.243 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:31.241+0000 7f22cb81f640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f22c410de10 0x7f22c419fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:33:31.243 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:31.241+0000 7f22cb81f640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f22c4113800 con 0x7f22c41049b0 2024-09-21T01:33:31.243 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:31.241+0000 7f22cb81f640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f22c4113680 con 0x7f22c4105300 2024-09-21T01:33:31.243 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:31.241+0000 7f22cb81f640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f22c4113980 con 0x7f22c410de10 2024-09-21T01:33:31.243 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:31.241+0000 7f22c95bb640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f22c41049b0 0x7f22c419a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:33:31.243 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:31.241+0000 7f22c95bb640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f22c41049b0 0x7f22c419a2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:57650/0 (socket says 172.21.15.83:57650) 2024-09-21T01:33:31.244 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:31.241+0000 7f22c95bb640 1 -- 172.21.15.83:0/150528719 learned_addr learned my addr 172.21.15.83:0/150528719 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:33:31.244 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:31.241+0000 7f22c8dba640 1 --2- 172.21.15.83:0/150528719 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f22c4105300 0x7f22c419a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:33:31.244 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:31.242+0000 7f22c9dbc640 1 --2- 172.21.15.83:0/150528719 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f22c410de10 0x7f22c419fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:33:31.244 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:31.242+0000 7f22c95bb640 1 -- 172.21.15.83:0/150528719 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f22c410de10 msgr2=0x7f22c419fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:33:31.244 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:31.242+0000 7f22c95bb640 1 --2- 172.21.15.83:0/150528719 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f22c410de10 0x7f22c419fb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:31.244 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:31.242+0000 7f22c95bb640 1 -- 172.21.15.83:0/150528719 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f22c4105300 msgr2=0x7f22c419a890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:33:31.244 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:31.242+0000 7f22c95bb640 1 --2- 172.21.15.83:0/150528719 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f22c4105300 0x7f22c419a890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:31.244 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:31.242+0000 7f22c95bb640 1 -- 172.21.15.83:0/150528719 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22c41a01a0 con 0x7f22c41049b0 2024-09-21T01:33:31.244 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:31.242+0000 7f22c8dba640 1 --2- 172.21.15.83:0/150528719 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f22c4105300 0x7f22c419a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:33:31.244 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:31.242+0000 7f22c95bb640 1 --2- 172.21.15.83:0/150528719 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f22c41049b0 0x7f22c419a2f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f22c000c970 tx=0x7f22c000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:33:31.244 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:31.242+0000 7f22ba7fc640 1 -- 172.21.15.83:0/150528719 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22c0007c10 con 0x7f22c41049b0 2024-09-21T01:33:31.244 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:31.242+0000 7f22ba7fc640 1 -- 172.21.15.83:0/150528719 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(24 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f22c0007db0 con 0x7f22c41049b0 2024-09-21T01:33:31.244 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:31.242+0000 7f22cb81f640 1 -- 172.21.15.83:0/150528719 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22c41a0490 con 0x7f22c41049b0 2024-09-21T01:33:31.245 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:31.242+0000 7f22ba7fc640 1 -- 172.21.15.83:0/150528719 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22c000f740 con 0x7f22c41049b0 2024-09-21T01:33:31.245 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:31.242+0000 7f22cb81f640 1 -- 172.21.15.83:0/150528719 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22c41a6cb0 con 0x7f22c41049b0 2024-09-21T01:33:31.245 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:31.243+0000 7f22cb81f640 1 -- 172.21.15.83:0/150528719 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22c4104dc0 con 0x7f22c41049b0 2024-09-21T01:33:31.245 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:31.245+0000 7f22ba7fc640 1 -- 172.21.15.83:0/150528719 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 19) ==== 154473+0+0 (secure 0 0 0) 0x7f22c0018480 con 0x7f22c41049b0 2024-09-21T01:33:31.246 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:31.245+0000 7f22ba7fc640 1 --2- 172.21.15.83:0/150528719 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f22b00b6500 0x7f22b00b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:33:31.246 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:31.246+0000 7f22c8dba640 1 --2- 172.21.15.83:0/150528719 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f22b00b6500 0x7f22b00b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:33:31.246 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:31.246+0000 7f22ba7fc640 1 -- 172.21.15.83:0/150528719 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f22c00e5d70 con 0x7f22c41049b0 2024-09-21T01:33:31.246 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:31.246+0000 7f22c8dba640 1 --2- 172.21.15.83:0/150528719 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f22b00b6500 0x7f22b00b8a10 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f22c407a0d0 tx=0x7f22b4005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:33:31.249 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:31.249+0000 7f22ba7fc640 1 -- 172.21.15.83:0/150528719 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f22c00ae320 con 0x7f22c41049b0 2024-09-21T01:33:31.440 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:31.439+0000 7f22cb81f640 1 -- 172.21.15.83:0/150528719 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command([{prefix=config set, name=mds_op_complaint_time}] v 0) -- 0x7f22c4108f10 con 0x7f22c41049b0 2024-09-21T01:33:31.444 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:31.443+0000 7f22ba7fc640 1 -- 172.21.15.83:0/150528719 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_op_complaint_time}]=0 v29)=0 v29) ==== 121+0+0 (secure 0 0 0) 0x7f22c00b2700 con 0x7f22c41049b0 2024-09-21T01:33:31.447 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:31.446+0000 7f22cb81f640 1 -- 172.21.15.83:0/150528719 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f22b00b6500 msgr2=0x7f22b00b8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:33:31.447 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:31.446+0000 7f22cb81f640 1 --2- 172.21.15.83:0/150528719 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f22b00b6500 0x7f22b00b8a10 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f22c407a0d0 tx=0x7f22b4005f90 comp rx=0 tx=0).stop 2024-09-21T01:33:31.447 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:31.446+0000 7f22cb81f640 1 -- 172.21.15.83:0/150528719 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f22c41049b0 msgr2=0x7f22c419a2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:33:31.447 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:31.446+0000 7f22cb81f640 1 --2- 172.21.15.83:0/150528719 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f22c41049b0 0x7f22c419a2f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f22c000c970 tx=0x7f22c000ce30 comp rx=0 tx=0).stop 2024-09-21T01:33:31.447 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:31.446+0000 7f22cb81f640 1 -- 172.21.15.83:0/150528719 shutdown_connections 2024-09-21T01:33:31.447 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:31.446+0000 7f22cb81f640 1 --2- 172.21.15.83:0/150528719 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f22b00b6500 0x7f22b00b8a10 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:31.447 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:31.446+0000 7f22cb81f640 1 --2- 172.21.15.83:0/150528719 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f22c410de10 0x7f22c419fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:31.447 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:31.446+0000 7f22cb81f640 1 --2- 172.21.15.83:0/150528719 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f22c4105300 0x7f22c419a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:31.447 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:31.446+0000 7f22cb81f640 1 --2- 172.21.15.83:0/150528719 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f22c41049b0 0x7f22c419a2f0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:31.448 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:31.446+0000 7f22cb81f640 1 -- 172.21.15.83:0/150528719 >> 172.21.15.83:0/150528719 conn(0x7f22c4079730 msgr2=0x7f22c4100930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:33:31.448 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:31.446+0000 7f22cb81f640 1 -- 172.21.15.83:0/150528719 shutdown_connections 2024-09-21T01:33:31.448 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:31.446+0000 7f22cb81f640 1 -- 172.21.15.83:0/150528719 wait complete. 2024-09-21T01:33:31.590 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:31 smithi083 ceph-mon[31370]: from='client.? 172.21.15.83:0/161099280' entity='client.admin' 2024-09-21T01:33:31.590 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:31 smithi083 ceph-mon[31370]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:33:31.667 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:31 smithi142 ceph-mon[34050]: from='client.? 172.21.15.83:0/161099280' entity='client.admin' 2024-09-21T01:33:31.667 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:31 smithi142 ceph-mon[34050]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:33:31.717 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:31 smithi119 ceph-mon[33693]: from='client.? 172.21.15.83:0/161099280' entity='client.admin' 2024-09-21T01:33:31.717 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:31 smithi119 ceph-mon[33693]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:33:32.086 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:32.085+0000 7f78b4aa1640 1 -- 172.21.15.83:0/4250617399 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f78b01094a0 msgr2=0x7f78b01098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:33:32.086 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:32.085+0000 7f78b4aa1640 1 --2- 172.21.15.83:0/4250617399 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f78b01094a0 0x7f78b01098b0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f7898009900 tx=0x7f789802a410 comp rx=0 tx=0).stop 2024-09-21T01:33:32.086 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:32.085+0000 7f78b4aa1640 1 -- 172.21.15.83:0/4250617399 shutdown_connections 2024-09-21T01:33:32.087 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:32.085+0000 7f78b4aa1640 1 --2- 172.21.15.83:0/4250617399 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f78b0109df0 0x7f78b0110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:32.087 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:32.085+0000 7f78b4aa1640 1 --2- 172.21.15.83:0/4250617399 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f78b01094a0 0x7f78b01098b0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:32.087 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:32.085+0000 7f78b4aa1640 1 --2- 172.21.15.83:0/4250617399 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f78b0103b60 0x7f78b0103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:32.087 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:32.085+0000 7f78b4aa1640 1 -- 172.21.15.83:0/4250617399 >> 172.21.15.83:0/4250617399 conn(0x7f78b007b850 msgr2=0x7f78b007bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:33:32.087 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:32.086+0000 7f78b4aa1640 1 -- 172.21.15.83:0/4250617399 shutdown_connections 2024-09-21T01:33:32.087 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:32.086+0000 7f78b4aa1640 1 -- 172.21.15.83:0/4250617399 wait complete. 2024-09-21T01:33:32.089 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:32.086+0000 7f78b4aa1640 1 Processor -- start 2024-09-21T01:33:32.089 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:32.086+0000 7f78b4aa1640 1 -- start start 2024-09-21T01:33:32.089 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:32.087+0000 7f78b4aa1640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f78b0103b60 0x7f78b019a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:33:32.089 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:32.087+0000 7f78b4aa1640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f78b01094a0 0x7f78b019a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:33:32.089 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:32.087+0000 7f78b4aa1640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f78b0109df0 0x7f78b019fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:33:32.089 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:32.087+0000 7f78b4aa1640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f78b0113840 con 0x7f78b0109df0 2024-09-21T01:33:32.090 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:32.087+0000 7f78b4aa1640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f78b01136c0 con 0x7f78b01094a0 2024-09-21T01:33:32.090 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:32.087+0000 7f78b4aa1640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f78b01139c0 con 0x7f78b0103b60 2024-09-21T01:33:32.090 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:32.087+0000 7f78aed9d640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f78b0109df0 0x7f78b019fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:33:32.090 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:32.087+0000 7f78aed9d640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f78b0109df0 0x7f78b019fbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:57674/0 (socket says 172.21.15.83:57674) 2024-09-21T01:33:32.090 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:32.087+0000 7f78aed9d640 1 -- 172.21.15.83:0/2120748690 learned_addr learned my addr 172.21.15.83:0/2120748690 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:33:32.090 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:32.087+0000 7f78ae59c640 1 --2- 172.21.15.83:0/2120748690 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f78b0103b60 0x7f78b019a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:33:32.090 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:32.087+0000 7f78add9b640 1 --2- 172.21.15.83:0/2120748690 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f78b01094a0 0x7f78b019a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:33:32.090 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:32.087+0000 7f78aed9d640 1 -- 172.21.15.83:0/2120748690 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f78b0103b60 msgr2=0x7f78b019a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:33:32.090 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:32.087+0000 7f78aed9d640 1 --2- 172.21.15.83:0/2120748690 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f78b0103b60 0x7f78b019a3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:32.090 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:32.087+0000 7f78aed9d640 1 -- 172.21.15.83:0/2120748690 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f78b01094a0 msgr2=0x7f78b019a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:33:32.090 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:32.087+0000 7f78aed9d640 1 --2- 172.21.15.83:0/2120748690 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f78b01094a0 0x7f78b019a950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:32.090 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:32.087+0000 7f78aed9d640 1 -- 172.21.15.83:0/2120748690 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78b01a0320 con 0x7f78b0109df0 2024-09-21T01:33:32.090 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:32.087+0000 7f78ae59c640 1 --2- 172.21.15.83:0/2120748690 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f78b0103b60 0x7f78b019a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:33:32.090 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:32.087+0000 7f78add9b640 1 --2- 172.21.15.83:0/2120748690 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f78b01094a0 0x7f78b019a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:33:32.091 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:32.087+0000 7f78aed9d640 1 --2- 172.21.15.83:0/2120748690 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f78b0109df0 0x7f78b019fbf0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f78a800b970 tx=0x7f78a800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:33:32.091 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:32.088+0000 7f78a77fe640 1 -- 172.21.15.83:0/2120748690 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78a8019070 con 0x7f78b0109df0 2024-09-21T01:33:32.091 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:32.088+0000 7f78b4aa1640 1 -- 172.21.15.83:0/2120748690 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78b01a0610 con 0x7f78b0109df0 2024-09-21T01:33:32.091 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:32.088+0000 7f78a77fe640 1 -- 172.21.15.83:0/2120748690 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(24 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f78a8014440 con 0x7f78b0109df0 2024-09-21T01:33:32.091 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:32.088+0000 7f78a77fe640 1 -- 172.21.15.83:0/2120748690 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78a80075d0 con 0x7f78b0109df0 2024-09-21T01:33:32.091 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:32.088+0000 7f78b4aa1640 1 -- 172.21.15.83:0/2120748690 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78b01a6d70 con 0x7f78b0109df0 2024-09-21T01:33:32.091 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:32.089+0000 7f78b4aa1640 1 -- 172.21.15.83:0/2120748690 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78b0103f70 con 0x7f78b0109df0 2024-09-21T01:33:32.091 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:32.091+0000 7f78a77fe640 1 -- 172.21.15.83:0/2120748690 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 19) ==== 154473+0+0 (secure 0 0 0) 0x7f78a801c070 con 0x7f78b0109df0 2024-09-21T01:33:32.092 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:32.092+0000 7f78a77fe640 1 --2- 172.21.15.83:0/2120748690 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f789c0b64d0 0x7f789c0b89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:33:32.092 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:32.092+0000 7f78ae59c640 1 --2- 172.21.15.83:0/2120748690 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f789c0b64d0 0x7f789c0b89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:33:32.093 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:32.092+0000 7f78a77fe640 1 -- 172.21.15.83:0/2120748690 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f78a80e54f0 con 0x7f78b0109df0 2024-09-21T01:33:32.093 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:32.092+0000 7f78ae59c640 1 --2- 172.21.15.83:0/2120748690 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f789c0b64d0 0x7f789c0b89e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f78a00058c0 tx=0x7f78a0005850 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:33:32.095 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:32.095+0000 7f78a77fe640 1 -- 172.21.15.83:0/2120748690 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f78a8023070 con 0x7f78b0109df0 2024-09-21T01:33:32.279 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:32.279+0000 7f78b4aa1640 1 -- 172.21.15.83:0/2120748690 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/log_level}] v 0) -- 0x7f78b019b4e0 con 0x7f78b0109df0 2024-09-21T01:33:32.283 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:32.283+0000 7f78a77fe640 1 -- 172.21.15.83:0/2120748690 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/log_level}]=0 v31)=0 v31) ==== 129+0+0 (secure 0 0 0) 0x7f78b019b4e0 con 0x7f78b0109df0 2024-09-21T01:33:32.286 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:32.285+0000 7f78b4aa1640 1 -- 172.21.15.83:0/2120748690 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f789c0b64d0 msgr2=0x7f789c0b89e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:33:32.286 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:32.285+0000 7f78b4aa1640 1 --2- 172.21.15.83:0/2120748690 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f789c0b64d0 0x7f789c0b89e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f78a00058c0 tx=0x7f78a0005850 comp rx=0 tx=0).stop 2024-09-21T01:33:32.286 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:32.285+0000 7f78b4aa1640 1 -- 172.21.15.83:0/2120748690 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f78b0109df0 msgr2=0x7f78b019fbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:33:32.286 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:32.285+0000 7f78b4aa1640 1 --2- 172.21.15.83:0/2120748690 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f78b0109df0 0x7f78b019fbf0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f78a800b970 tx=0x7f78a800be30 comp rx=0 tx=0).stop 2024-09-21T01:33:32.286 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:32.285+0000 7f78b4aa1640 1 -- 172.21.15.83:0/2120748690 shutdown_connections 2024-09-21T01:33:32.286 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:32.285+0000 7f78b4aa1640 1 --2- 172.21.15.83:0/2120748690 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f789c0b64d0 0x7f789c0b89e0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:32.286 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:32.285+0000 7f78b4aa1640 1 --2- 172.21.15.83:0/2120748690 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f78b0109df0 0x7f78b019fbf0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:32.286 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:32.285+0000 7f78b4aa1640 1 --2- 172.21.15.83:0/2120748690 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f78b01094a0 0x7f78b019a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:32.286 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:32.285+0000 7f78b4aa1640 1 --2- 172.21.15.83:0/2120748690 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f78b0103b60 0x7f78b019a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:32.286 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:32.285+0000 7f78b4aa1640 1 -- 172.21.15.83:0/2120748690 >> 172.21.15.83:0/2120748690 conn(0x7f78b007b850 msgr2=0x7f78b01076e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:33:32.286 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:32.285+0000 7f78b4aa1640 1 -- 172.21.15.83:0/2120748690 shutdown_connections 2024-09-21T01:33:32.286 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:32.285+0000 7f78b4aa1640 1 -- 172.21.15.83:0/2120748690 wait complete. 2024-09-21T01:33:32.715 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:32 smithi142 ceph-mon[34050]: from='client.? 172.21.15.83:0/150528719' entity='client.admin' 2024-09-21T01:33:32.715 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:32 smithi142 ceph-mon[34050]: from='client.? 172.21.15.83:0/3944698847' entity='client.admin' 2024-09-21T01:33:32.715 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:32 smithi142 ceph-mon[34050]: from='client.? 172.21.15.83:0/2120748690' entity='client.admin' 2024-09-21T01:33:32.717 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:32 smithi119 ceph-mon[33693]: from='client.? 172.21.15.83:0/150528719' entity='client.admin' 2024-09-21T01:33:32.717 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:32 smithi119 ceph-mon[33693]: from='client.? 172.21.15.83:0/3944698847' entity='client.admin' 2024-09-21T01:33:32.718 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:32 smithi119 ceph-mon[33693]: from='client.? 172.21.15.83:0/2120748690' entity='client.admin' 2024-09-21T01:33:32.773 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:32 smithi083 ceph-mon[31370]: from='client.? 172.21.15.83:0/150528719' entity='client.admin' 2024-09-21T01:33:32.773 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:32 smithi083 ceph-mon[31370]: from='client.? 172.21.15.83:0/3944698847' entity='client.admin' 2024-09-21T01:33:32.773 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:32 smithi083 ceph-mon[31370]: from='client.? 172.21.15.83:0/2120748690' entity='client.admin' 2024-09-21T01:33:33.059 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:33.059+0000 7f8898bbf640 1 -- 172.21.15.83:0/1410421377 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8894108420 msgr2=0x7f8894108830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:33:33.060 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:33.059+0000 7f8898bbf640 1 --2- 172.21.15.83:0/1410421377 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8894108420 0x7f8894108830 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f887c009900 tx=0x7f887c02a410 comp rx=0 tx=0).stop 2024-09-21T01:33:33.060 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:33.059+0000 7f8898bbf640 1 -- 172.21.15.83:0/1410421377 shutdown_connections 2024-09-21T01:33:33.060 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:33.059+0000 7f8898bbf640 1 --2- 172.21.15.83:0/1410421377 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8894108d70 0x7f889410f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:33.060 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:33.059+0000 7f8898bbf640 1 --2- 172.21.15.83:0/1410421377 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8894108420 0x7f8894108830 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:33.060 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:33.059+0000 7f8898bbf640 1 --2- 172.21.15.83:0/1410421377 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8894102ae0 0x7f8894102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:33.060 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:33.059+0000 7f8898bbf640 1 -- 172.21.15.83:0/1410421377 >> 172.21.15.83:0/1410421377 conn(0x7f8894079770 msgr2=0x7f8894079b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:33:33.060 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:33.059+0000 7f8898bbf640 1 -- 172.21.15.83:0/1410421377 shutdown_connections 2024-09-21T01:33:33.060 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:33.059+0000 7f8898bbf640 1 -- 172.21.15.83:0/1410421377 wait complete. 2024-09-21T01:33:33.061 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:33.060+0000 7f8898bbf640 1 Processor -- start 2024-09-21T01:33:33.062 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:33.060+0000 7f8898bbf640 1 -- start start 2024-09-21T01:33:33.062 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:33.060+0000 7f8898bbf640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8894102ae0 0x7f889419a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:33:33.062 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:33.060+0000 7f8898bbf640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8894108420 0x7f889419a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:33:33.062 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:33.060+0000 7f8898bbf640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8894108d70 0x7f889419fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:33:33.062 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:33.060+0000 7f8898bbf640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f88941127c0 con 0x7f8894102ae0 2024-09-21T01:33:33.062 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:33.060+0000 7f8898bbf640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f8894112640 con 0x7f8894108420 2024-09-21T01:33:33.062 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:33.060+0000 7f8898bbf640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f8894112940 con 0x7f8894108d70 2024-09-21T01:33:33.062 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:33.060+0000 7f889259c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8894102ae0 0x7f889419a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:33:33.062 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:33.060+0000 7f889259c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8894102ae0 0x7f889419a3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:43410/0 (socket says 172.21.15.83:43410) 2024-09-21T01:33:33.062 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:33.060+0000 7f889259c640 1 -- 172.21.15.83:0/3038161520 learned_addr learned my addr 172.21.15.83:0/3038161520 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:33:33.062 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:33.060+0000 7f8891d9b640 1 --2- 172.21.15.83:0/3038161520 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8894108420 0x7f889419a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:33:33.062 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:33.060+0000 7f8892d9d640 1 --2- 172.21.15.83:0/3038161520 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8894108d70 0x7f889419fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:33:33.063 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:33.060+0000 7f889259c640 1 -- 172.21.15.83:0/3038161520 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8894108d70 msgr2=0x7f889419fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:33:33.063 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:33.060+0000 7f889259c640 1 --2- 172.21.15.83:0/3038161520 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8894108d70 0x7f889419fbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:33.063 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:33.060+0000 7f889259c640 1 -- 172.21.15.83:0/3038161520 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8894108420 msgr2=0x7f889419a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:33:33.063 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:33.060+0000 7f889259c640 1 --2- 172.21.15.83:0/3038161520 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8894108420 0x7f889419a940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:33.063 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:33.060+0000 7f889259c640 1 -- 172.21.15.83:0/3038161520 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88941a0250 con 0x7f8894102ae0 2024-09-21T01:33:33.063 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:33.061+0000 7f889259c640 1 --2- 172.21.15.83:0/3038161520 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8894102ae0 0x7f889419a3a0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f888c00eab0 tx=0x7f888c00ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:33:33.063 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:33.061+0000 7f888b7fe640 1 -- 172.21.15.83:0/3038161520 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f888c00ce40 con 0x7f8894102ae0 2024-09-21T01:33:33.063 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:33.061+0000 7f888b7fe640 1 -- 172.21.15.83:0/3038161520 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(24 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f888c0118e0 con 0x7f8894102ae0 2024-09-21T01:33:33.063 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:33.061+0000 7f8898bbf640 1 -- 172.21.15.83:0/3038161520 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88941a0540 con 0x7f8894102ae0 2024-09-21T01:33:33.063 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:33.061+0000 7f888b7fe640 1 -- 172.21.15.83:0/3038161520 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f888c010830 con 0x7f8894102ae0 2024-09-21T01:33:33.063 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:33.061+0000 7f8898bbf640 1 -- 172.21.15.83:0/3038161520 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88941a6d60 con 0x7f8894102ae0 2024-09-21T01:33:33.064 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:33.062+0000 7f8898bbf640 1 -- 172.21.15.83:0/3038161520 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f889406b390 con 0x7f8894102ae0 2024-09-21T01:33:33.064 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:33.063+0000 7f888b7fe640 1 -- 172.21.15.83:0/3038161520 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 19) ==== 154473+0+0 (secure 0 0 0) 0x7f888c011470 con 0x7f8894102ae0 2024-09-21T01:33:33.064 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:33.064+0000 7f888b7fe640 1 --2- 172.21.15.83:0/3038161520 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f88800b6500 0x7f88800b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:33:33.065 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:33.064+0000 7f8891d9b640 1 --2- 172.21.15.83:0/3038161520 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f88800b6500 0x7f88800b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:33:33.065 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:33.064+0000 7f888b7fe640 1 -- 172.21.15.83:0/3038161520 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f888c0e5e30 con 0x7f8894102ae0 2024-09-21T01:33:33.065 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:33.065+0000 7f8891d9b640 1 --2- 172.21.15.83:0/3038161520 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f88800b6500 0x7f88800b8a10 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f887c009230 tx=0x7f887c004240 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:33:33.067 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:33.067+0000 7f888b7fe640 1 -- 172.21.15.83:0/3038161520 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f888c016030 con 0x7f8894102ae0 2024-09-21T01:33:33.253 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:33.253+0000 7f8898bbf640 1 -- 172.21.15.83:0/3038161520 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7f889410bb70 con 0x7f8894102ae0 2024-09-21T01:33:33.257 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:33.257+0000 7f888b7fe640 1 -- 172.21.15.83:0/3038161520 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v32)=0 v32) ==== 121+0+0 (secure 0 0 0) 0x7f888c0ae2c0 con 0x7f8894102ae0 2024-09-21T01:33:33.260 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:33.260+0000 7f8898bbf640 1 -- 172.21.15.83:0/3038161520 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f88800b6500 msgr2=0x7f88800b8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:33:33.260 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:33.260+0000 7f8898bbf640 1 --2- 172.21.15.83:0/3038161520 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f88800b6500 0x7f88800b8a10 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f887c009230 tx=0x7f887c004240 comp rx=0 tx=0).stop 2024-09-21T01:33:33.261 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:33.260+0000 7f8898bbf640 1 -- 172.21.15.83:0/3038161520 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8894102ae0 msgr2=0x7f889419a3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:33:33.261 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:33.260+0000 7f8898bbf640 1 --2- 172.21.15.83:0/3038161520 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8894102ae0 0x7f889419a3a0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f888c00eab0 tx=0x7f888c00ef70 comp rx=0 tx=0).stop 2024-09-21T01:33:33.261 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:33.260+0000 7f8898bbf640 1 -- 172.21.15.83:0/3038161520 shutdown_connections 2024-09-21T01:33:33.261 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:33.260+0000 7f8898bbf640 1 --2- 172.21.15.83:0/3038161520 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f88800b6500 0x7f88800b8a10 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:33.261 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:33.260+0000 7f8898bbf640 1 --2- 172.21.15.83:0/3038161520 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8894108d70 0x7f889419fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:33.261 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:33.260+0000 7f8898bbf640 1 --2- 172.21.15.83:0/3038161520 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8894108420 0x7f889419a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:33.261 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:33.260+0000 7f8898bbf640 1 --2- 172.21.15.83:0/3038161520 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8894102ae0 0x7f889419a3a0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:33.261 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:33.260+0000 7f8898bbf640 1 -- 172.21.15.83:0/3038161520 >> 172.21.15.83:0/3038161520 conn(0x7f8894079770 msgr2=0x7f8894101bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:33:33.261 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:33.260+0000 7f8898bbf640 1 -- 172.21.15.83:0/3038161520 shutdown_connections 2024-09-21T01:33:33.261 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:33.260+0000 7f8898bbf640 1 -- 172.21.15.83:0/3038161520 wait complete. 2024-09-21T01:33:33.290 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:33.289+0000 7fa61b22b640 1 -- 172.21.15.83:0/470077642 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa614102aa0 msgr2=0x7fa614102eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:33:33.290 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:33.289+0000 7fa61b22b640 1 --2- 172.21.15.83:0/470077642 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa614102aa0 0x7fa614102eb0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fa608009900 tx=0x7fa60802a410 comp rx=0 tx=0).stop 2024-09-21T01:33:33.290 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:33.289+0000 7fa61b22b640 1 -- 172.21.15.83:0/470077642 shutdown_connections 2024-09-21T01:33:33.291 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:33.289+0000 7fa61b22b640 1 --2- 172.21.15.83:0/470077642 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa614108d30 0x7fa61410f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:33.291 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:33.289+0000 7fa61b22b640 1 --2- 172.21.15.83:0/470077642 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa6141083e0 0x7fa6141087f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:33.291 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:33.289+0000 7fa61b22b640 1 --2- 172.21.15.83:0/470077642 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa614102aa0 0x7fa614102eb0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:33.291 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:33.289+0000 7fa61b22b640 1 -- 172.21.15.83:0/470077642 >> 172.21.15.83:0/470077642 conn(0x7fa614079750 msgr2=0x7fa614079b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:33:33.291 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:33.289+0000 7fa61b22b640 1 -- 172.21.15.83:0/470077642 shutdown_connections 2024-09-21T01:33:33.291 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:33.290+0000 7fa61b22b640 1 -- 172.21.15.83:0/470077642 wait complete. 2024-09-21T01:33:33.292 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:33.290+0000 7fa61b22b640 1 Processor -- start 2024-09-21T01:33:33.293 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:33.290+0000 7fa61b22b640 1 -- start start 2024-09-21T01:33:33.293 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:33.291+0000 7fa61b22b640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa614102aa0 0x7fa61419c500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:33:33.293 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:33.291+0000 7fa61b22b640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa6141083e0 0x7fa61419caa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:33:33.293 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:33.291+0000 7fa61b22b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa614108d30 0x7fa6141a1d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:33:33.293 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:33.291+0000 7fa61b22b640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fa6141116c0 con 0x7fa614102aa0 2024-09-21T01:33:33.293 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:33.291+0000 7fa61b22b640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fa614111540 con 0x7fa614108d30 2024-09-21T01:33:33.293 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:33.291+0000 7fa61b22b640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fa614111840 con 0x7fa6141083e0 2024-09-21T01:33:33.293 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:33.291+0000 7fa618fc7640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa614102aa0 0x7fa61419c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:33:33.293 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:33.291+0000 7fa618fc7640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa614102aa0 0x7fa61419c500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:43426/0 (socket says 172.21.15.83:43426) 2024-09-21T01:33:33.293 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:33.291+0000 7fa618fc7640 1 -- 172.21.15.83:0/3497994968 learned_addr learned my addr 172.21.15.83:0/3497994968 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:33:33.293 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:33.291+0000 7fa613fff640 1 --2- 172.21.15.83:0/3497994968 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa6141083e0 0x7fa61419caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:33:33.294 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:33.291+0000 7fa6197c8640 1 --2- 172.21.15.83:0/3497994968 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa614108d30 0x7fa6141a1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:33:33.294 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:33.291+0000 7fa618fc7640 1 -- 172.21.15.83:0/3497994968 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa6141083e0 msgr2=0x7fa61419caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:33:33.294 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:33.291+0000 7fa618fc7640 1 --2- 172.21.15.83:0/3497994968 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa6141083e0 0x7fa61419caa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:33.294 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:33.291+0000 7fa618fc7640 1 -- 172.21.15.83:0/3497994968 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa614108d30 msgr2=0x7fa6141a1d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:33:33.294 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:33.291+0000 7fa618fc7640 1 --2- 172.21.15.83:0/3497994968 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa614108d30 0x7fa6141a1d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:33.294 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:33.291+0000 7fa618fc7640 1 -- 172.21.15.83:0/3497994968 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6141a23b0 con 0x7fa614102aa0 2024-09-21T01:33:33.294 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:33.291+0000 7fa618fc7640 1 --2- 172.21.15.83:0/3497994968 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa614102aa0 0x7fa61419c500 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fa60802a980 tx=0x7fa608003cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:33:33.294 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:33.291+0000 7fa611ffb640 1 -- 172.21.15.83:0/3497994968 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa60803f070 con 0x7fa614102aa0 2024-09-21T01:33:33.294 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:33.292+0000 7fa611ffb640 1 -- 172.21.15.83:0/3497994968 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(24 keys) ==== 1032+0+0 (secure 0 0 0) 0x7fa608003e40 con 0x7fa614102aa0 2024-09-21T01:33:33.294 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:33.292+0000 7fa61b22b640 1 -- 172.21.15.83:0/3497994968 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6141a2640 con 0x7fa614102aa0 2024-09-21T01:33:33.294 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:33.292+0000 7fa611ffb640 1 -- 172.21.15.83:0/3497994968 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa608035030 con 0x7fa614102aa0 2024-09-21T01:33:33.294 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:33.292+0000 7fa61b22b640 1 -- 172.21.15.83:0/3497994968 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6141a2b70 con 0x7fa614102aa0 2024-09-21T01:33:33.295 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:33.293+0000 7fa61b22b640 1 -- 172.21.15.83:0/3497994968 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa614102eb0 con 0x7fa614102aa0 2024-09-21T01:33:33.295 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:33.295+0000 7fa611ffb640 1 -- 172.21.15.83:0/3497994968 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 19) ==== 154473+0+0 (secure 0 0 0) 0x7fa608042070 con 0x7fa614102aa0 2024-09-21T01:33:33.296 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:33.295+0000 7fa611ffb640 1 --2- 172.21.15.83:0/3497994968 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fa6040b6630 0x7fa6040b8b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:33:33.296 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:33.295+0000 7fa613fff640 1 --2- 172.21.15.83:0/3497994968 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fa6040b6630 0x7fa6040b8b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:33:33.296 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:33.296+0000 7fa611ffb640 1 -- 172.21.15.83:0/3497994968 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fa608106370 con 0x7fa614102aa0 2024-09-21T01:33:33.296 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:33.296+0000 7fa613fff640 1 --2- 172.21.15.83:0/3497994968 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fa6040b6630 0x7fa6040b8b40 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fa61407a1b0 tx=0x7fa60000a2d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:33:33.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:33.299+0000 7fa611ffb640 1 -- 172.21.15.83:0/3497994968 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa6141a2b70 con 0x7fa614102aa0 2024-09-21T01:33:33.489 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:33.488+0000 7fa61b22b640 1 -- 172.21.15.83:0/3497994968 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) -- 0x7fa61419d630 con 0x7fa614102aa0 2024-09-21T01:33:33.493 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:33.492+0000 7fa611ffb640 1 -- 172.21.15.83:0/3497994968 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v33)=0 v33) ==== 138+0+0 (secure 0 0 0) 0x7fa61419d630 con 0x7fa614102aa0 2024-09-21T01:33:33.495 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:33.495+0000 7fa61b22b640 1 -- 172.21.15.83:0/3497994968 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fa6040b6630 msgr2=0x7fa6040b8b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:33:33.496 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:33.495+0000 7fa61b22b640 1 --2- 172.21.15.83:0/3497994968 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fa6040b6630 0x7fa6040b8b40 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fa61407a1b0 tx=0x7fa60000a2d0 comp rx=0 tx=0).stop 2024-09-21T01:33:33.496 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:33.495+0000 7fa61b22b640 1 -- 172.21.15.83:0/3497994968 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa614102aa0 msgr2=0x7fa61419c500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:33:33.496 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:33.495+0000 7fa61b22b640 1 --2- 172.21.15.83:0/3497994968 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa614102aa0 0x7fa61419c500 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fa60802a980 tx=0x7fa608003cd0 comp rx=0 tx=0).stop 2024-09-21T01:33:33.496 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:33.495+0000 7fa61b22b640 1 -- 172.21.15.83:0/3497994968 shutdown_connections 2024-09-21T01:33:33.496 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:33.495+0000 7fa61b22b640 1 --2- 172.21.15.83:0/3497994968 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fa6040b6630 0x7fa6040b8b40 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:33.496 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:33.495+0000 7fa61b22b640 1 --2- 172.21.15.83:0/3497994968 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa614108d30 0x7fa6141a1d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:33.496 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:33.495+0000 7fa61b22b640 1 --2- 172.21.15.83:0/3497994968 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa6141083e0 0x7fa61419caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:33.496 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:33.495+0000 7fa61b22b640 1 --2- 172.21.15.83:0/3497994968 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa614102aa0 0x7fa61419c500 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:33.496 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:33.495+0000 7fa61b22b640 1 -- 172.21.15.83:0/3497994968 >> 172.21.15.83:0/3497994968 conn(0x7fa614079750 msgr2=0x7fa614106540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:33:33.496 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:33.495+0000 7fa61b22b640 1 -- 172.21.15.83:0/3497994968 shutdown_connections 2024-09-21T01:33:33.496 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:33.495+0000 7fa61b22b640 1 -- 172.21.15.83:0/3497994968 wait complete. 2024-09-21T01:33:33.553 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:33 smithi083 ceph-mon[31370]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:33:33.554 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:33 smithi083 ceph-mon[31370]: from='client.? 172.21.15.83:0/3038161520' entity='client.admin' 2024-09-21T01:33:33.714 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:33 smithi142 ceph-mon[34050]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:33:33.715 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:33 smithi142 ceph-mon[34050]: from='client.? 172.21.15.83:0/3038161520' entity='client.admin' 2024-09-21T01:33:33.717 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:33 smithi119 ceph-mon[33693]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:33:33.718 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:33 smithi119 ceph-mon[33693]: from='client.? 172.21.15.83:0/3038161520' entity='client.admin' 2024-09-21T01:33:34.763 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:34 smithi083 ceph-mon[31370]: from='client.? 172.21.15.83:0/3497994968' entity='client.admin' 2024-09-21T01:33:34.964 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:34 smithi142 ceph-mon[34050]: from='client.? 172.21.15.83:0/3497994968' entity='client.admin' 2024-09-21T01:33:34.967 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:34 smithi119 ceph-mon[33693]: from='client.? 172.21.15.83:0/3497994968' entity='client.admin' 2024-09-21T01:33:35.031 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:31.682+0000 7fd3950ea640 1 -- 172.21.15.83:0/242376406 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd390105170 msgr2=0x7fd390105580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:33:35.031 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:31.682+0000 7fd3950ea640 1 --2- 172.21.15.83:0/242376406 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd390105170 0x7fd390105580 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fd384009900 tx=0x7fd38402a410 comp rx=0 tx=0).stop 2024-09-21T01:33:35.031 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:31.682+0000 7fd3950ea640 1 -- 172.21.15.83:0/242376406 shutdown_connections 2024-09-21T01:33:35.031 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:31.682+0000 7fd3950ea640 1 --2- 172.21.15.83:0/242376406 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd390105ac0 0x7fd39010f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:35.031 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:31.682+0000 7fd3950ea640 1 --2- 172.21.15.83:0/242376406 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd390105170 0x7fd390105580 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:35.031 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:31.682+0000 7fd3950ea640 1 --2- 172.21.15.83:0/242376406 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd3901031a0 0x7fd3901035b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:35.031 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:31.682+0000 7fd3950ea640 1 -- 172.21.15.83:0/242376406 >> 172.21.15.83:0/242376406 conn(0x7fd390077c60 msgr2=0x7fd3900780a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:33:35.031 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:31.682+0000 7fd3950ea640 1 -- 172.21.15.83:0/242376406 shutdown_connections 2024-09-21T01:33:35.031 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:31.682+0000 7fd3950ea640 1 -- 172.21.15.83:0/242376406 wait complete. 2024-09-21T01:33:35.031 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:31.683+0000 7fd3950ea640 1 Processor -- start 2024-09-21T01:33:35.032 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:31.683+0000 7fd3950ea640 1 -- start start 2024-09-21T01:33:35.032 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:31.683+0000 7fd3950ea640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd3901031a0 0x7fd3901991d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:33:35.032 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:31.683+0000 7fd3950ea640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd390105170 0x7fd390199770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:33:35.032 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:31.683+0000 7fd3950ea640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd390105ac0 0x7fd39019ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:33:35.032 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:31.683+0000 7fd3950ea640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fd3901127a0 con 0x7fd390105ac0 2024-09-21T01:33:35.032 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:31.683+0000 7fd3950ea640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fd390112620 con 0x7fd390105170 2024-09-21T01:33:35.032 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:31.683+0000 7fd3950ea640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fd390112920 con 0x7fd3901031a0 2024-09-21T01:33:35.032 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:31.683+0000 7fd38f59e640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd390105ac0 0x7fd39019ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:33:35.032 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:31.684+0000 7fd38f59e640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd390105ac0 0x7fd39019ea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:57666/0 (socket says 172.21.15.83:57666) 2024-09-21T01:33:35.032 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:31.684+0000 7fd38f59e640 1 -- 172.21.15.83:0/3944698847 learned_addr learned my addr 172.21.15.83:0/3944698847 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:33:35.032 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:31.684+0000 7fd38ed9d640 1 --2- 172.21.15.83:0/3944698847 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd3901031a0 0x7fd3901991d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:33:35.032 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:31.684+0000 7fd38e59c640 1 --2- 172.21.15.83:0/3944698847 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd390105170 0x7fd390199770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:33:35.032 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:31.684+0000 7fd38f59e640 1 -- 172.21.15.83:0/3944698847 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd3901031a0 msgr2=0x7fd3901991d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:33:35.032 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:31.684+0000 7fd38f59e640 1 --2- 172.21.15.83:0/3944698847 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd3901031a0 0x7fd3901991d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:35.033 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:31.684+0000 7fd38f59e640 1 -- 172.21.15.83:0/3944698847 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd390105170 msgr2=0x7fd390199770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:33:35.033 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:31.684+0000 7fd38f59e640 1 --2- 172.21.15.83:0/3944698847 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd390105170 0x7fd390199770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:35.033 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:31.684+0000 7fd38f59e640 1 -- 172.21.15.83:0/3944698847 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd39019f080 con 0x7fd390105ac0 2024-09-21T01:33:35.033 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:31.684+0000 7fd38e59c640 1 --2- 172.21.15.83:0/3944698847 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd390105170 0x7fd390199770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:33:35.033 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:31.684+0000 7fd38f59e640 1 --2- 172.21.15.83:0/3944698847 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd390105ac0 0x7fd39019ea10 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fd388007cb0 tx=0x7fd38800e420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:33:35.033 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:31.684+0000 7fd377fff640 1 -- 172.21.15.83:0/3944698847 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd38800eb30 con 0x7fd390105ac0 2024-09-21T01:33:35.033 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:31.684+0000 7fd3950ea640 1 -- 172.21.15.83:0/3944698847 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd39019f370 con 0x7fd390105ac0 2024-09-21T01:33:35.033 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:31.684+0000 7fd377fff640 1 -- 172.21.15.83:0/3944698847 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(24 keys) ==== 1032+0+0 (secure 0 0 0) 0x7fd38800ecd0 con 0x7fd390105ac0 2024-09-21T01:33:35.033 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:31.684+0000 7fd377fff640 1 -- 172.21.15.83:0/3944698847 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd38800ae20 con 0x7fd390105ac0 2024-09-21T01:33:35.033 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:31.684+0000 7fd3950ea640 1 -- 172.21.15.83:0/3944698847 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd390101e00 con 0x7fd390105ac0 2024-09-21T01:33:35.033 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:31.685+0000 7fd3950ea640 1 -- 172.21.15.83:0/3944698847 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd39006ac30 con 0x7fd390105ac0 2024-09-21T01:33:35.033 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:31.688+0000 7fd377fff640 1 -- 172.21.15.83:0/3944698847 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 19) ==== 154473+0+0 (secure 0 0 0) 0x7fd38800a440 con 0x7fd390105ac0 2024-09-21T01:33:35.033 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:31.688+0000 7fd377fff640 1 --2- 172.21.15.83:0/3944698847 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fd3780b6500 0x7fd3780b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:33:35.033 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:31.689+0000 7fd38ed9d640 1 --2- 172.21.15.83:0/3944698847 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fd3780b6500 0x7fd3780b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:33:35.033 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:31.689+0000 7fd377fff640 1 -- 172.21.15.83:0/3944698847 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fd3880e7630 con 0x7fd390105ac0 2024-09-21T01:33:35.034 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:31.689+0000 7fd38ed9d640 1 --2- 172.21.15.83:0/3944698847 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fd3780b6500 0x7fd3780b8a10 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fd3800058c0 tx=0x7fd38000a2d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:33:35.034 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:31.692+0000 7fd377fff640 1 -- 172.21.15.83:0/3944698847 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd3880afac0 con 0x7fd390105ac0 2024-09-21T01:33:35.034 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:31.873+0000 7fd3950ea640 1 -- 172.21.15.83:0/3944698847 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7fd39019a300 con 0x7fd390105ac0 2024-09-21T01:33:35.034 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:31.878+0000 7fd377fff640 1 -- 172.21.15.83:0/3944698847 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v30)=0 v30) ==== 120+0+0 (secure 0 0 0) 0x7fd3880b3ea0 con 0x7fd390105ac0 2024-09-21T01:33:35.034 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:31.880+0000 7fd3950ea640 1 -- 172.21.15.83:0/3944698847 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fd3780b6500 msgr2=0x7fd3780b8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:33:35.034 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:31.880+0000 7fd3950ea640 1 --2- 172.21.15.83:0/3944698847 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fd3780b6500 0x7fd3780b8a10 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fd3800058c0 tx=0x7fd38000a2d0 comp rx=0 tx=0).stop 2024-09-21T01:33:35.034 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:31.880+0000 7fd3950ea640 1 -- 172.21.15.83:0/3944698847 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd390105ac0 msgr2=0x7fd39019ea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:33:35.034 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:31.880+0000 7fd3950ea640 1 --2- 172.21.15.83:0/3944698847 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd390105ac0 0x7fd39019ea10 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fd388007cb0 tx=0x7fd38800e420 comp rx=0 tx=0).stop 2024-09-21T01:33:35.034 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:31.880+0000 7fd3950ea640 1 -- 172.21.15.83:0/3944698847 shutdown_connections 2024-09-21T01:33:35.034 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:31.880+0000 7fd3950ea640 1 --2- 172.21.15.83:0/3944698847 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fd3780b6500 0x7fd3780b8a10 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:35.034 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:31.880+0000 7fd3950ea640 1 --2- 172.21.15.83:0/3944698847 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd390105ac0 0x7fd39019ea10 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:35.034 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:31.880+0000 7fd3950ea640 1 --2- 172.21.15.83:0/3944698847 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd390105170 0x7fd390199770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:35.034 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:31.880+0000 7fd3950ea640 1 --2- 172.21.15.83:0/3944698847 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd3901031a0 0x7fd3901991d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:35.034 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:31.880+0000 7fd3950ea640 1 -- 172.21.15.83:0/3944698847 >> 172.21.15.83:0/3944698847 conn(0x7fd390077c60 msgr2=0x7fd390106570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:33:35.035 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:31.880+0000 7fd3950ea640 1 -- 172.21.15.83:0/3944698847 shutdown_connections 2024-09-21T01:33:35.035 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:31.880+0000 7fd3950ea640 1 -- 172.21.15.83:0/3944698847 wait complete. 2024-09-21T01:33:35.804 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:35 smithi083 ceph-mon[31370]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:33:35.964 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:35 smithi142 ceph-mon[34050]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:33:35.967 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:35 smithi119 ceph-mon[33693]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:33:37.933 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:37 smithi083 ceph-mon[31370]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:33:38.118 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:38.118+0000 7faa11978640 1 -- 172.21.15.83:0/3094515180 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faa0c102a60 msgr2=0x7faa0c102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:33:38.118 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:38.118+0000 7faa11978640 1 --2- 172.21.15.83:0/3094515180 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faa0c102a60 0x7faa0c102e70 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fa9fc009ca0 tx=0x7fa9fc02a8c0 comp rx=0 tx=0).stop 2024-09-21T01:33:38.118 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:38.118+0000 7faa11978640 1 -- 172.21.15.83:0/3094515180 shutdown_connections 2024-09-21T01:33:38.119 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:38.118+0000 7faa11978640 1 --2- 172.21.15.83:0/3094515180 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faa0c108cf0 0x7faa0c10f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:38.119 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:38.118+0000 7faa11978640 1 --2- 172.21.15.83:0/3094515180 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faa0c1083a0 0x7faa0c1087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:38.119 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:38.118+0000 7faa11978640 1 --2- 172.21.15.83:0/3094515180 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faa0c102a60 0x7faa0c102e70 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:38.119 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:38.118+0000 7faa11978640 1 -- 172.21.15.83:0/3094515180 >> 172.21.15.83:0/3094515180 conn(0x7faa0c079730 msgr2=0x7faa0c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:33:38.119 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:38.118+0000 7faa11978640 1 -- 172.21.15.83:0/3094515180 shutdown_connections 2024-09-21T01:33:38.119 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:38.118+0000 7faa11978640 1 -- 172.21.15.83:0/3094515180 wait complete. 2024-09-21T01:33:38.120 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:38.118+0000 7faa11978640 1 Processor -- start 2024-09-21T01:33:38.121 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:38.119+0000 7faa11978640 1 -- start start 2024-09-21T01:33:38.121 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:38.119+0000 7faa11978640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faa0c102a60 0x7faa0c19a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:33:38.121 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:38.119+0000 7faa11978640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faa0c1083a0 0x7faa0c19aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:33:38.121 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:38.119+0000 7faa11978640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faa0c108cf0 0x7faa0c19fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:33:38.121 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:38.119+0000 7faa11978640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7faa0c1138b0 con 0x7faa0c108cf0 2024-09-21T01:33:38.121 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:38.119+0000 7faa11978640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7faa0c113730 con 0x7faa0c1083a0 2024-09-21T01:33:38.121 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:38.119+0000 7faa11978640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7faa0c113a30 con 0x7faa0c102a60 2024-09-21T01:33:38.121 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:38.119+0000 7faa0b7fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faa0c108cf0 0x7faa0c19fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:33:38.121 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:38.119+0000 7faa0b7fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faa0c108cf0 0x7faa0c19fce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:43442/0 (socket says 172.21.15.83:43442) 2024-09-21T01:33:38.121 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:38.119+0000 7faa0b7fe640 1 -- 172.21.15.83:0/2812479230 learned_addr learned my addr 172.21.15.83:0/2812479230 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:33:38.121 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:38.119+0000 7faa0a7fc640 1 --2- 172.21.15.83:0/2812479230 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faa0c1083a0 0x7faa0c19aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:33:38.121 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:38.119+0000 7faa0affd640 1 --2- 172.21.15.83:0/2812479230 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faa0c102a60 0x7faa0c19a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:33:38.121 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:38.119+0000 7faa0b7fe640 1 -- 172.21.15.83:0/2812479230 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faa0c102a60 msgr2=0x7faa0c19a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:33:38.121 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:38.119+0000 7faa0b7fe640 1 --2- 172.21.15.83:0/2812479230 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faa0c102a60 0x7faa0c19a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:38.122 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:38.119+0000 7faa0b7fe640 1 -- 172.21.15.83:0/2812479230 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faa0c1083a0 msgr2=0x7faa0c19aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:33:38.122 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:38.119+0000 7faa0b7fe640 1 --2- 172.21.15.83:0/2812479230 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faa0c1083a0 0x7faa0c19aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:38.122 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:38.119+0000 7faa0b7fe640 1 -- 172.21.15.83:0/2812479230 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa0c1a0410 con 0x7faa0c108cf0 2024-09-21T01:33:38.122 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:38.120+0000 7faa0b7fe640 1 --2- 172.21.15.83:0/2812479230 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faa0c108cf0 0x7faa0c19fce0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7faa04009fd0 tx=0x7faa0400b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:33:38.122 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:38.120+0000 7faa10976640 1 -- 172.21.15.83:0/2812479230 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa04015020 con 0x7faa0c108cf0 2024-09-21T01:33:38.122 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:38.120+0000 7faa10976640 1 -- 172.21.15.83:0/2812479230 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(24 keys) ==== 1032+0+0 (secure 0 0 0) 0x7faa04011ca0 con 0x7faa0c108cf0 2024-09-21T01:33:38.122 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:38.120+0000 7faa10976640 1 -- 172.21.15.83:0/2812479230 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa04010c50 con 0x7faa0c108cf0 2024-09-21T01:33:38.122 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:38.120+0000 7faa11978640 1 -- 172.21.15.83:0/2812479230 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa0c1a0700 con 0x7faa0c108cf0 2024-09-21T01:33:38.122 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:38.120+0000 7faa11978640 1 -- 172.21.15.83:0/2812479230 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa0c1a6e60 con 0x7faa0c108cf0 2024-09-21T01:33:38.123 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:38.121+0000 7faa11978640 1 -- 172.21.15.83:0/2812479230 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa0c102ef0 con 0x7faa0c108cf0 2024-09-21T01:33:38.123 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:38.122+0000 7faa10976640 1 -- 172.21.15.83:0/2812479230 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 19) ==== 154473+0+0 (secure 0 0 0) 0x7faa04018020 con 0x7faa0c108cf0 2024-09-21T01:33:38.123 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:38.123+0000 7faa10976640 1 --2- 172.21.15.83:0/2812479230 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fa9f40b6550 0x7fa9f40b8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:33:38.123 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:38.123+0000 7faa0affd640 1 --2- 172.21.15.83:0/2812479230 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fa9f40b6550 0x7fa9f40b8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:33:38.123 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:38.123+0000 7faa10976640 1 -- 172.21.15.83:0/2812479230 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7faa040e5400 con 0x7faa0c108cf0 2024-09-21T01:33:38.124 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:38.124+0000 7faa0affd640 1 --2- 172.21.15.83:0/2812479230 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fa9f40b6550 0x7fa9f40b8a60 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fa9fc009a60 tx=0x7fa9fc009890 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:33:38.127 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:38.126+0000 7faa10976640 1 -- 172.21.15.83:0/2812479230 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7faa0401f020 con 0x7faa0c108cf0 2024-09-21T01:33:38.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:37 smithi142 ceph-mon[34050]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:33:38.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:37 smithi119 ceph-mon[33693]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:33:38.314 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:38.313+0000 7faa11978640 1 -- 172.21.15.83:0/2812479230 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7faa0c19b5d0 con 0x7faa0c108cf0 2024-09-21T01:33:38.318 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:38.317+0000 7faa10976640 1 -- 172.21.15.83:0/2812479230 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v34)=0 v34) ==== 123+0+0 (secure 0 0 0) 0x7faa0c19b5d0 con 0x7faa0c108cf0 2024-09-21T01:33:38.319 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:38.319+0000 7faa10976640 1 -- 172.21.15.83:0/2812479230 <== mon.0 v2:172.21.15.83:3300/0 8 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7faa040acca0 con 0x7faa0c108cf0 2024-09-21T01:33:38.321 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:38.320+0000 7faa11978640 1 -- 172.21.15.83:0/2812479230 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fa9f40b6550 msgr2=0x7fa9f40b8a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:33:38.321 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:38.320+0000 7faa11978640 1 --2- 172.21.15.83:0/2812479230 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fa9f40b6550 0x7fa9f40b8a60 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fa9fc009a60 tx=0x7fa9fc009890 comp rx=0 tx=0).stop 2024-09-21T01:33:38.321 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:38.320+0000 7faa11978640 1 -- 172.21.15.83:0/2812479230 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faa0c108cf0 msgr2=0x7faa0c19fce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:33:38.321 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:38.320+0000 7faa11978640 1 --2- 172.21.15.83:0/2812479230 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faa0c108cf0 0x7faa0c19fce0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7faa04009fd0 tx=0x7faa0400b820 comp rx=0 tx=0).stop 2024-09-21T01:33:38.321 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:38.320+0000 7faa11978640 1 -- 172.21.15.83:0/2812479230 shutdown_connections 2024-09-21T01:33:38.321 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:38.320+0000 7faa11978640 1 --2- 172.21.15.83:0/2812479230 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fa9f40b6550 0x7fa9f40b8a60 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:38.321 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:38.320+0000 7faa11978640 1 --2- 172.21.15.83:0/2812479230 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faa0c108cf0 0x7faa0c19fce0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:38.321 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:38.320+0000 7faa11978640 1 --2- 172.21.15.83:0/2812479230 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faa0c1083a0 0x7faa0c19aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:38.321 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:38.320+0000 7faa11978640 1 --2- 172.21.15.83:0/2812479230 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faa0c102a60 0x7faa0c19a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:38.321 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:38.320+0000 7faa11978640 1 -- 172.21.15.83:0/2812479230 >> 172.21.15.83:0/2812479230 conn(0x7faa0c079730 msgr2=0x7faa0c1017b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:33:38.321 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:38.320+0000 7faa11978640 1 -- 172.21.15.83:0/2812479230 shutdown_connections 2024-09-21T01:33:38.321 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:38.320+0000 7faa11978640 1 -- 172.21.15.83:0/2812479230 wait complete. 2024-09-21T01:33:39.334 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'f7697ecc-77b8-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'client', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi083') 2024-09-21T01:33:39.335 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'f7697ecc-77b8-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds', '20'], check_status=True, hostname='smithi083') 2024-09-21T01:33:39.335 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'f7697ecc-77b8-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds_balancer', '20'], check_status=True, hostname='smithi083') 2024-09-21T01:33:39.335 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'f7697ecc-77b8-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'debug_ms', '2'], check_status=True, hostname='smithi083') 2024-09-21T01:33:39.335 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'f7697ecc-77b8-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_fragment_size_max', '10000'], check_status=True, hostname='smithi083') 2024-09-21T01:33:39.335 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'f7697ecc-77b8-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_merge_size', '5'], check_status=True, hostname='smithi083') 2024-09-21T01:33:39.335 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'f7697ecc-77b8-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_split_bits', '3'], check_status=True, hostname='smithi083') 2024-09-21T01:33:39.335 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'f7697ecc-77b8-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_split_size', '100'], check_status=True, hostname='smithi083') 2024-09-21T01:33:39.335 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'f7697ecc-77b8-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_frag', 'True'], check_status=True, hostname='smithi083') 2024-09-21T01:33:39.335 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'f7697ecc-77b8-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_scatterstat', 'True'], check_status=True, hostname='smithi083') 2024-09-21T01:33:39.336 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'f7697ecc-77b8-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_op_complaint_time', '180'], check_status=True, hostname='smithi083') 2024-09-21T01:33:39.498 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:39.497+0000 7f83e1c62640 1 -- 172.21.15.83:0/2979282326 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f83dc113eb0 msgr2=0x7f83dc1142c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:33:39.498 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:39.497+0000 7f83e1c62640 1 --2- 172.21.15.83:0/2979282326 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f83dc113eb0 0x7f83dc1142c0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f83d0009900 tx=0x7f83d002a410 comp rx=0 tx=0).stop 2024-09-21T01:33:39.498 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:39.497+0000 7f83e1c62640 1 -- 172.21.15.83:0/2979282326 shutdown_connections 2024-09-21T01:33:39.498 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:39.497+0000 7f83e1c62640 1 --2- 172.21.15.83:0/2979282326 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f83dc114800 0x7f83dc11b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:39.498 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:39.497+0000 7f83e1c62640 1 --2- 172.21.15.83:0/2979282326 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f83dc113eb0 0x7f83dc1142c0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:39.499 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:39.497+0000 7f83e1c62640 1 --2- 172.21.15.83:0/2979282326 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f83dc10e5c0 0x7f83dc10e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:39.499 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:39.497+0000 7f83e1c62640 1 -- 172.21.15.83:0/2979282326 >> 172.21.15.83:0/2979282326 conn(0x7f83dc10a3c0 msgr2=0x7f83dc10c7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:33:39.499 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:39 smithi083 ceph-mon[31370]: from='client.? 172.21.15.83:0/2812479230' entity='client.admin' 2024-09-21T01:33:39.499 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:39 smithi083 ceph-mon[31370]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:33:39.501 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:39.497+0000 7f83e1c62640 1 -- 172.21.15.83:0/2979282326 shutdown_connections 2024-09-21T01:33:39.502 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:39.497+0000 7f83e1c62640 1 -- 172.21.15.83:0/2979282326 wait complete. 2024-09-21T01:33:39.502 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:39.498+0000 7f83e1c62640 1 Processor -- start 2024-09-21T01:33:39.502 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:39.498+0000 7f83e1c62640 1 -- start start 2024-09-21T01:33:39.502 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:39.499+0000 7f83e1c62640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f83dc10e5c0 0x7f83dc1a4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:33:39.503 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:39.499+0000 7f83e1c62640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f83dc113eb0 0x7f83dc1a5370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:33:39.503 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:39.499+0000 7f83e1c62640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f83dc114800 0x7f83dc1aa610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:33:39.503 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:39.499+0000 7f83e1c62640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f83dc11e320 con 0x7f83dc113eb0 2024-09-21T01:33:39.503 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:39.499+0000 7f83e1c62640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f83dc11e1a0 con 0x7f83dc114800 2024-09-21T01:33:39.503 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:39.499+0000 7f83e1c62640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f83dc11e4a0 con 0x7f83dc10e5c0 2024-09-21T01:33:39.503 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:39.499+0000 7f83db7fe640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f83dc10e5c0 0x7f83dc1a4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:33:39.504 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:39.499+0000 7f83daffd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f83dc113eb0 0x7f83dc1a5370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:33:39.504 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:39.499+0000 7f83db7fe640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f83dc10e5c0 0x7f83dc1a4dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.83:34710/0 (socket says 172.21.15.83:34710) 2024-09-21T01:33:39.504 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:39.499+0000 7f83db7fe640 1 -- 172.21.15.83:0/3393844628 learned_addr learned my addr 172.21.15.83:0/3393844628 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:33:39.504 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:39.499+0000 7f83daffd640 1 -- 172.21.15.83:0/3393844628 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f83dc10e5c0 msgr2=0x7f83dc1a4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:33:39.504 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:39.499+0000 7f83daffd640 1 --2- 172.21.15.83:0/3393844628 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f83dc10e5c0 0x7f83dc1a4dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:39.504 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:39.499+0000 7f83daffd640 1 -- 172.21.15.83:0/3393844628 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f83dc114800 msgr2=0x7f83dc1aa610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:33:39.504 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:39.499+0000 7f83daffd640 1 --2- 172.21.15.83:0/3393844628 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f83dc114800 0x7f83dc1aa610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:39.504 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:39.499+0000 7f83daffd640 1 -- 172.21.15.83:0/3393844628 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83dc1aad40 con 0x7f83dc113eb0 2024-09-21T01:33:39.505 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:39.500+0000 7f83daffd640 1 --2- 172.21.15.83:0/3393844628 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f83dc113eb0 0x7f83dc1a5370 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f83d002a930 tx=0x7f83d00040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:33:39.505 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:39.500+0000 7f83d8ff9640 1 -- 172.21.15.83:0/3393844628 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83d003f070 con 0x7f83dc113eb0 2024-09-21T01:33:39.505 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:39.500+0000 7f83d8ff9640 1 -- 172.21.15.83:0/3393844628 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f83d0003c80 con 0x7f83dc113eb0 2024-09-21T01:33:39.505 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:39.500+0000 7f83e1c62640 1 -- 172.21.15.83:0/3393844628 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83dc1aafd0 con 0x7f83dc113eb0 2024-09-21T01:33:39.505 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:39.500+0000 7f83d8ff9640 1 -- 172.21.15.83:0/3393844628 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83d0035070 con 0x7f83dc113eb0 2024-09-21T01:33:39.505 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:39.500+0000 7f83e1c62640 1 -- 172.21.15.83:0/3393844628 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83dc1b1790 con 0x7f83dc113eb0 2024-09-21T01:33:39.506 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:39.502+0000 7f83e1c62640 1 -- 172.21.15.83:0/3393844628 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83dc10e9d0 con 0x7f83dc113eb0 2024-09-21T01:33:39.506 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:39.502+0000 7f83d8ff9640 1 -- 172.21.15.83:0/3393844628 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 19) ==== 154473+0+0 (secure 0 0 0) 0x7f83d003b460 con 0x7f83dc113eb0 2024-09-21T01:33:39.506 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:39.503+0000 7f83d8ff9640 1 --2- 172.21.15.83:0/3393844628 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f83c40b6550 0x7f83c40b8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:33:39.506 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:39.503+0000 7f83db7fe640 1 --2- 172.21.15.83:0/3393844628 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f83c40b6550 0x7f83c40b8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:33:39.506 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:39.503+0000 7f83d8ff9640 1 -- 172.21.15.83:0/3393844628 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f83d0105db0 con 0x7f83dc113eb0 2024-09-21T01:33:39.506 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:39.504+0000 7f83db7fe640 1 --2- 172.21.15.83:0/3393844628 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f83c40b6550 0x7f83c40b8a60 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f83cc0104e0 tx=0x7f83cc009800 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:33:39.508 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:39.508+0000 7f83d8ff9640 1 -- 172.21.15.83:0/3393844628 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f83d00ce240 con 0x7f83dc113eb0 2024-09-21T01:33:39.698 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:39.697+0000 7f83e1c62640 1 -- 172.21.15.83:0/3393844628 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command([{prefix=config set, name=debug_cephsqlite}] v 0) -- 0x7f83dc1165e0 con 0x7f83dc113eb0 2024-09-21T01:33:39.702 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:39.702+0000 7f83d8ff9640 1 -- 172.21.15.83:0/3393844628 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_cephsqlite}]=0 v35)=0 v35) ==== 115+0+0 (secure 0 0 0) 0x7f83d00d2620 con 0x7f83dc113eb0 2024-09-21T01:33:39.705 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:39.704+0000 7f83e1c62640 1 -- 172.21.15.83:0/3393844628 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f83c40b6550 msgr2=0x7f83c40b8a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:33:39.705 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:39.704+0000 7f83e1c62640 1 --2- 172.21.15.83:0/3393844628 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f83c40b6550 0x7f83c40b8a60 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f83cc0104e0 tx=0x7f83cc009800 comp rx=0 tx=0).stop 2024-09-21T01:33:39.705 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:39.704+0000 7f83e1c62640 1 -- 172.21.15.83:0/3393844628 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f83dc113eb0 msgr2=0x7f83dc1a5370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:33:39.705 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:39.704+0000 7f83e1c62640 1 --2- 172.21.15.83:0/3393844628 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f83dc113eb0 0x7f83dc1a5370 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f83d002a930 tx=0x7f83d00040e0 comp rx=0 tx=0).stop 2024-09-21T01:33:39.705 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:39.704+0000 7f83e1c62640 1 -- 172.21.15.83:0/3393844628 shutdown_connections 2024-09-21T01:33:39.705 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:39.704+0000 7f83e1c62640 1 --2- 172.21.15.83:0/3393844628 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f83c40b6550 0x7f83c40b8a60 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:39.706 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:39.704+0000 7f83e1c62640 1 --2- 172.21.15.83:0/3393844628 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f83dc114800 0x7f83dc1aa610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:39.706 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:39.704+0000 7f83e1c62640 1 --2- 172.21.15.83:0/3393844628 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f83dc113eb0 0x7f83dc1a5370 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:39.706 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:39.704+0000 7f83e1c62640 1 --2- 172.21.15.83:0/3393844628 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f83dc10e5c0 0x7f83dc1a4dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:39.706 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:39.704+0000 7f83e1c62640 1 -- 172.21.15.83:0/3393844628 >> 172.21.15.83:0/3393844628 conn(0x7f83dc10a3c0 msgr2=0x7f83dc113570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:33:39.706 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:39.705+0000 7f83e1c62640 1 -- 172.21.15.83:0/3393844628 shutdown_connections 2024-09-21T01:33:39.706 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:39.705+0000 7f83e1c62640 1 -- 172.21.15.83:0/3393844628 wait complete. 2024-09-21T01:33:39.714 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:39 smithi142 ceph-mon[34050]: from='client.? 172.21.15.83:0/2812479230' entity='client.admin' 2024-09-21T01:33:39.714 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:39 smithi142 ceph-mon[34050]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:33:39.717 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:39 smithi119 ceph-mon[33693]: from='client.? 172.21.15.83:0/2812479230' entity='client.admin' 2024-09-21T01:33:39.717 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:39 smithi119 ceph-mon[33693]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:33:40.964 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:40 smithi142 ceph-mon[34050]: from='client.? 172.21.15.83:0/3393844628' entity='client.admin' 2024-09-21T01:33:40.967 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:40 smithi119 ceph-mon[33693]: from='client.? 172.21.15.83:0/3393844628' entity='client.admin' 2024-09-21T01:33:41.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:40 smithi083 ceph-mon[31370]: from='client.? 172.21.15.83:0/3393844628' entity='client.admin' 2024-09-21T01:33:41.172 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:41.171+0000 7f5c4e19b640 1 -- 172.21.15.83:0/1881177862 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5c48109df0 msgr2=0x7f5c48110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:33:41.172 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:41.171+0000 7f5c4e19b640 1 --2- 172.21.15.83:0/1881177862 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5c48109df0 0x7f5c48110620 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f5c40009900 tx=0x7f5c4002a410 comp rx=0 tx=0).stop 2024-09-21T01:33:41.172 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:41.171+0000 7f5c4e19b640 1 -- 172.21.15.83:0/1881177862 shutdown_connections 2024-09-21T01:33:41.172 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:41.171+0000 7f5c4e19b640 1 --2- 172.21.15.83:0/1881177862 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5c48109df0 0x7f5c48110620 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:41.172 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:41.171+0000 7f5c4e19b640 1 --2- 172.21.15.83:0/1881177862 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5c481094a0 0x7f5c481098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:41.172 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:41.171+0000 7f5c4e19b640 1 --2- 172.21.15.83:0/1881177862 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5c48103b60 0x7f5c48103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:41.172 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:41.171+0000 7f5c4e19b640 1 -- 172.21.15.83:0/1881177862 >> 172.21.15.83:0/1881177862 conn(0x7f5c4807b850 msgr2=0x7f5c4807bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:33:41.172 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:41.171+0000 7f5c4e19b640 1 -- 172.21.15.83:0/1881177862 shutdown_connections 2024-09-21T01:33:41.172 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:41.171+0000 7f5c4e19b640 1 -- 172.21.15.83:0/1881177862 wait complete. 2024-09-21T01:33:41.173 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:41.171+0000 7f5c4e19b640 1 Processor -- start 2024-09-21T01:33:41.174 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:41.172+0000 7f5c4e19b640 1 -- start start 2024-09-21T01:33:41.174 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:41.172+0000 7f5c4e19b640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5c48103b60 0x7f5c4819a370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:33:41.174 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:41.172+0000 7f5c4e19b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5c481094a0 0x7f5c4819a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:33:41.174 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:41.172+0000 7f5c4e19b640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5c48109df0 0x7f5c4819fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:33:41.174 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:41.172+0000 7f5c4e19b640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f5c48113960 con 0x7f5c48103b60 2024-09-21T01:33:41.175 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:41.172+0000 7f5c4e19b640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f5c481137e0 con 0x7f5c481094a0 2024-09-21T01:33:41.175 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:41.172+0000 7f5c4e19b640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f5c48113ae0 con 0x7f5c48109df0 2024-09-21T01:33:41.175 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:41.172+0000 7f5c477fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5c48103b60 0x7f5c4819a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:33:41.175 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:41.172+0000 7f5c477fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5c48103b60 0x7f5c4819a370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:43476/0 (socket says 172.21.15.83:43476) 2024-09-21T01:33:41.175 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:41.172+0000 7f5c477fe640 1 -- 172.21.15.83:0/1912018336 learned_addr learned my addr 172.21.15.83:0/1912018336 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:33:41.175 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:41.172+0000 7f5c46ffd640 1 --2- 172.21.15.83:0/1912018336 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5c481094a0 0x7f5c4819a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:33:41.175 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:41.172+0000 7f5c47fff640 1 --2- 172.21.15.83:0/1912018336 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5c48109df0 0x7f5c4819fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:33:41.175 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:41.173+0000 7f5c477fe640 1 -- 172.21.15.83:0/1912018336 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5c48109df0 msgr2=0x7f5c4819fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:33:41.175 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:41.173+0000 7f5c477fe640 1 --2- 172.21.15.83:0/1912018336 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5c48109df0 0x7f5c4819fbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:41.175 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:41.173+0000 7f5c477fe640 1 -- 172.21.15.83:0/1912018336 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5c481094a0 msgr2=0x7f5c4819a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:33:41.175 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:41.173+0000 7f5c477fe640 1 --2- 172.21.15.83:0/1912018336 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5c481094a0 0x7f5c4819a910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:41.175 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:41.173+0000 7f5c477fe640 1 -- 172.21.15.83:0/1912018336 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c481a0220 con 0x7f5c48103b60 2024-09-21T01:33:41.175 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:41.173+0000 7f5c477fe640 1 --2- 172.21.15.83:0/1912018336 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5c48103b60 0x7f5c4819a370 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f5c3800c920 tx=0x7f5c3800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:33:41.175 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:41.173+0000 7f5c44ff9640 1 -- 172.21.15.83:0/1912018336 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c38007c70 con 0x7f5c48103b60 2024-09-21T01:33:41.176 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:41.173+0000 7f5c44ff9640 1 -- 172.21.15.83:0/1912018336 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5c38007e10 con 0x7f5c48103b60 2024-09-21T01:33:41.176 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:41.173+0000 7f5c4e19b640 1 -- 172.21.15.83:0/1912018336 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c481a0510 con 0x7f5c48103b60 2024-09-21T01:33:41.176 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:41.173+0000 7f5c44ff9640 1 -- 172.21.15.83:0/1912018336 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c38018710 con 0x7f5c48103b60 2024-09-21T01:33:41.176 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:41.173+0000 7f5c4e19b640 1 -- 172.21.15.83:0/1912018336 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c481a6d30 con 0x7f5c48103b60 2024-09-21T01:33:41.176 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:41.174+0000 7f5c4e19b640 1 -- 172.21.15.83:0/1912018336 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c48103f70 con 0x7f5c48103b60 2024-09-21T01:33:41.176 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:41.176+0000 7f5c44ff9640 1 -- 172.21.15.83:0/1912018336 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 19) ==== 154473+0+0 (secure 0 0 0) 0x7f5c3800f450 con 0x7f5c48103b60 2024-09-21T01:33:41.177 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:41.176+0000 7f5c44ff9640 1 --2- 172.21.15.83:0/1912018336 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f5c300b6500 0x7f5c300b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:33:41.177 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:41.176+0000 7f5c46ffd640 1 --2- 172.21.15.83:0/1912018336 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f5c300b6500 0x7f5c300b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:33:41.177 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:41.177+0000 7f5c44ff9640 1 -- 172.21.15.83:0/1912018336 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f5c380e5a70 con 0x7f5c48103b60 2024-09-21T01:33:41.177 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:41.177+0000 7f5c46ffd640 1 --2- 172.21.15.83:0/1912018336 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f5c300b6500 0x7f5c300b8a10 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f5c48106450 tx=0x7f5c3c00a570 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:33:41.180 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:41.179+0000 7f5c44ff9640 1 -- 172.21.15.83:0/1912018336 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f5c38014030 con 0x7f5c48103b60 2024-09-21T01:33:41.360 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:41.359+0000 7f5c4e19b640 1 -- 172.21.15.83:0/1912018336 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7f5c4802e640 con 0x7f5c48103b60 2024-09-21T01:33:41.364 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:41.364+0000 7f5c44ff9640 1 -- 172.21.15.83:0/1912018336 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v36)=0 v36) ==== 120+0+0 (secure 0 0 0) 0x7f5c380adf90 con 0x7f5c48103b60 2024-09-21T01:33:41.366 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:41.366+0000 7f5c4e19b640 1 -- 172.21.15.83:0/1912018336 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f5c300b6500 msgr2=0x7f5c300b8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:33:41.366 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:41.366+0000 7f5c4e19b640 1 --2- 172.21.15.83:0/1912018336 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f5c300b6500 0x7f5c300b8a10 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f5c48106450 tx=0x7f5c3c00a570 comp rx=0 tx=0).stop 2024-09-21T01:33:41.367 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:41.366+0000 7f5c4e19b640 1 -- 172.21.15.83:0/1912018336 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5c48103b60 msgr2=0x7f5c4819a370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:33:41.367 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:41.366+0000 7f5c4e19b640 1 --2- 172.21.15.83:0/1912018336 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5c48103b60 0x7f5c4819a370 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f5c3800c920 tx=0x7f5c3800cde0 comp rx=0 tx=0).stop 2024-09-21T01:33:41.367 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:41.366+0000 7f5c4e19b640 1 -- 172.21.15.83:0/1912018336 shutdown_connections 2024-09-21T01:33:41.367 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:41.366+0000 7f5c4e19b640 1 --2- 172.21.15.83:0/1912018336 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f5c300b6500 0x7f5c300b8a10 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:41.367 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:41.366+0000 7f5c4e19b640 1 --2- 172.21.15.83:0/1912018336 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5c48109df0 0x7f5c4819fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:41.367 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:41.366+0000 7f5c4e19b640 1 --2- 172.21.15.83:0/1912018336 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5c481094a0 0x7f5c4819a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:41.367 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:41.366+0000 7f5c4e19b640 1 --2- 172.21.15.83:0/1912018336 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5c48103b60 0x7f5c4819a370 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:41.367 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:41.366+0000 7f5c4e19b640 1 -- 172.21.15.83:0/1912018336 >> 172.21.15.83:0/1912018336 conn(0x7f5c4807b850 msgr2=0x7f5c48107590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:33:41.367 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:41.366+0000 7f5c4e19b640 1 -- 172.21.15.83:0/1912018336 shutdown_connections 2024-09-21T01:33:41.367 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:41.366+0000 7f5c4e19b640 1 -- 172.21.15.83:0/1912018336 wait complete. 2024-09-21T01:33:41.965 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:41 smithi142 ceph-mon[34050]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:33:41.965 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:41 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:33:41.965 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:41 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:33:41.965 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:41 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T01:33:41.965 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:41 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T01:33:41.965 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:41 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:33:41.965 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:41 smithi142 ceph-mon[34050]: from='client.? 172.21.15.83:0/1912018336' entity='client.admin' 2024-09-21T01:33:41.967 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:41 smithi119 ceph-mon[33693]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:33:41.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:41 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:33:41.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:41 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:33:41.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:41 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T01:33:41.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:41 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T01:33:41.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:41 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:33:41.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:41 smithi119 ceph-mon[33693]: from='client.? 172.21.15.83:0/1912018336' entity='client.admin' 2024-09-21T01:33:41.973 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:41 smithi083 ceph-mon[31370]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:33:41.973 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:41 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:33:41.973 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:41 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:33:41.973 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:41 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T01:33:41.973 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:41 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T01:33:41.973 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:41 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:33:41.974 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:41 smithi083 ceph-mon[31370]: from='client.? 172.21.15.83:0/1912018336' entity='client.admin' 2024-09-21T01:33:42.461 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'f7697ecc-77b8-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_verify_scatter', 'True'], check_status=True, hostname='smithi083') 2024-09-21T01:33:42.715 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:42 smithi142 ceph-mon[34050]: Reconfiguring mon.b (monmap changed)... 2024-09-21T01:33:42.715 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:42 smithi142 ceph-mon[34050]: Reconfiguring daemon mon.b on smithi119 2024-09-21T01:33:42.715 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:42 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:33:42.715 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:42 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:33:42.715 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:42 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T01:33:42.715 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:42 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T01:33:42.715 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:42 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:33:42.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:42 smithi119 ceph-mon[33693]: Reconfiguring mon.b (monmap changed)... 2024-09-21T01:33:42.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:42 smithi119 ceph-mon[33693]: Reconfiguring daemon mon.b on smithi119 2024-09-21T01:33:42.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:42 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:33:42.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:42 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:33:42.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:42 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T01:33:42.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:42 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T01:33:42.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:42 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:33:43.029 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:42 smithi083 ceph-mon[31370]: Reconfiguring mon.b (monmap changed)... 2024-09-21T01:33:43.030 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:42 smithi083 ceph-mon[31370]: Reconfiguring daemon mon.b on smithi119 2024-09-21T01:33:43.030 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:42 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:33:43.030 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:42 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:33:43.030 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:42 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T01:33:43.030 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:42 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T01:33:43.030 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:42 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:33:43.045 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:43.044+0000 7f4949958640 1 -- 172.21.15.83:0/3824039868 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f494410de30 msgr2=0x7f4944110300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:33:43.045 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:43.044+0000 7f4949958640 1 --2- 172.21.15.83:0/3824039868 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f494410de30 0x7f4944110300 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f493c009ca0 tx=0x7f493c02a8c0 comp rx=0 tx=0).stop 2024-09-21T01:33:43.045 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:43.044+0000 7f4949958640 1 -- 172.21.15.83:0/3824039868 shutdown_connections 2024-09-21T01:33:43.045 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:43.044+0000 7f4949958640 1 --2- 172.21.15.83:0/3824039868 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f494410de30 0x7f4944110300 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:43.045 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:43.044+0000 7f4949958640 1 --2- 172.21.15.83:0/3824039868 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f49441052b0 0x7f494410d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:43.045 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:43.044+0000 7f4949958640 1 --2- 172.21.15.83:0/3824039868 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4944104880 0x7f4944104c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:43.045 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:43.044+0000 7f4949958640 1 -- 172.21.15.83:0/3824039868 >> 172.21.15.83:0/3824039868 conn(0x7f4944079730 msgr2=0x7f4944079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:33:43.045 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:43.044+0000 7f4949958640 1 -- 172.21.15.83:0/3824039868 shutdown_connections 2024-09-21T01:33:43.045 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:43.044+0000 7f4949958640 1 -- 172.21.15.83:0/3824039868 wait complete. 2024-09-21T01:33:43.047 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:43.045+0000 7f4949958640 1 Processor -- start 2024-09-21T01:33:43.047 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:43.045+0000 7f4949958640 1 -- start start 2024-09-21T01:33:43.047 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:43.046+0000 7f4949958640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4944104880 0x7f494419a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:33:43.047 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:43.046+0000 7f4949958640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f49441052b0 0x7f494419a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:33:43.048 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:43.046+0000 7f4949958640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f494410de30 0x7f494419fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:33:43.048 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:43.046+0000 7f4949958640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f4944113970 con 0x7f494410de30 2024-09-21T01:33:43.048 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:43.046+0000 7f4949958640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f49441137f0 con 0x7f4944104880 2024-09-21T01:33:43.048 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:43.046+0000 7f4949958640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f4944113af0 con 0x7f49441052b0 2024-09-21T01:33:43.048 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:43.046+0000 7f49437fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f494410de30 0x7f494419fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:33:43.048 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:43.046+0000 7f49437fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f494410de30 0x7f494419fb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:57220/0 (socket says 172.21.15.83:57220) 2024-09-21T01:33:43.048 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:43.046+0000 7f49437fe640 1 -- 172.21.15.83:0/1512001266 learned_addr learned my addr 172.21.15.83:0/1512001266 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:33:43.048 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:43.046+0000 7f49427fc640 1 --2- 172.21.15.83:0/1512001266 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f49441052b0 0x7f494419a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:33:43.048 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:43.046+0000 7f4942ffd640 1 --2- 172.21.15.83:0/1512001266 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4944104880 0x7f494419a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:33:43.048 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:43.046+0000 7f49437fe640 1 -- 172.21.15.83:0/1512001266 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f49441052b0 msgr2=0x7f494419a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:33:43.048 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:43.046+0000 7f49437fe640 1 --2- 172.21.15.83:0/1512001266 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f49441052b0 0x7f494419a8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:43.048 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:43.046+0000 7f49437fe640 1 -- 172.21.15.83:0/1512001266 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4944104880 msgr2=0x7f494419a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:33:43.048 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:43.046+0000 7f49437fe640 1 --2- 172.21.15.83:0/1512001266 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4944104880 0x7f494419a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:43.048 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:43.046+0000 7f49437fe640 1 -- 172.21.15.83:0/1512001266 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49441a0290 con 0x7f494410de30 2024-09-21T01:33:43.048 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:43.046+0000 7f49437fe640 1 --2- 172.21.15.83:0/1512001266 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f494410de30 0x7f494419fb60 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f493c031040 tx=0x7f493c032bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:33:43.049 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:43.046+0000 7f4948956640 1 -- 172.21.15.83:0/1512001266 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f493c004040 con 0x7f494410de30 2024-09-21T01:33:43.049 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:43.046+0000 7f4948956640 1 -- 172.21.15.83:0/1512001266 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f493c004670 con 0x7f494410de30 2024-09-21T01:33:43.049 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:43.046+0000 7f4948956640 1 -- 172.21.15.83:0/1512001266 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f493c030bb0 con 0x7f494410de30 2024-09-21T01:33:43.049 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:43.046+0000 7f4949958640 1 -- 172.21.15.83:0/1512001266 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49441a0520 con 0x7f494410de30 2024-09-21T01:33:43.049 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:43.046+0000 7f4949958640 1 -- 172.21.15.83:0/1512001266 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49441a6ce0 con 0x7f494410de30 2024-09-21T01:33:43.049 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:43.047+0000 7f4949958640 1 -- 172.21.15.83:0/1512001266 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4944104c90 con 0x7f494410de30 2024-09-21T01:33:43.049 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:43.049+0000 7f4948956640 1 -- 172.21.15.83:0/1512001266 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 19) ==== 154473+0+0 (secure 0 0 0) 0x7f493c0041e0 con 0x7f494410de30 2024-09-21T01:33:43.050 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:43.050+0000 7f4948956640 1 --2- 172.21.15.83:0/1512001266 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f492c0b6550 0x7f492c0b8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:33:43.050 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:43.050+0000 7f4942ffd640 1 --2- 172.21.15.83:0/1512001266 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f492c0b6550 0x7f492c0b8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:33:43.050 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:43.050+0000 7f4948956640 1 -- 172.21.15.83:0/1512001266 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f493c106aa0 con 0x7f494410de30 2024-09-21T01:33:43.050 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:43.050+0000 7f4942ffd640 1 --2- 172.21.15.83:0/1512001266 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f492c0b6550 0x7f492c0b8a60 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f4934005fd0 tx=0x7f4934005850 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:33:43.053 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:43.053+0000 7f4948956640 1 -- 172.21.15.83:0/1512001266 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f493c0cefc0 con 0x7f494410de30 2024-09-21T01:33:43.234 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:43.234+0000 7f4949958640 1 -- 172.21.15.83:0/1512001266 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) -- 0x7f494419b450 con 0x7f494410de30 2024-09-21T01:33:43.241 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:43.240+0000 7f4948956640 1 -- 172.21.15.83:0/1512001266 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v37)=0 v37) ==== 133+0+0 (secure 0 0 0) 0x7f494419b450 con 0x7f494410de30 2024-09-21T01:33:43.243 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:43.243+0000 7f4949958640 1 -- 172.21.15.83:0/1512001266 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f492c0b6550 msgr2=0x7f492c0b8a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:33:43.244 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:43.243+0000 7f4949958640 1 --2- 172.21.15.83:0/1512001266 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f492c0b6550 0x7f492c0b8a60 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f4934005fd0 tx=0x7f4934005850 comp rx=0 tx=0).stop 2024-09-21T01:33:43.244 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:43.243+0000 7f4949958640 1 -- 172.21.15.83:0/1512001266 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f494410de30 msgr2=0x7f494419fb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:33:43.244 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:43.243+0000 7f4949958640 1 --2- 172.21.15.83:0/1512001266 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f494410de30 0x7f494419fb60 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f493c031040 tx=0x7f493c032bc0 comp rx=0 tx=0).stop 2024-09-21T01:33:43.244 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:43.243+0000 7f4949958640 1 -- 172.21.15.83:0/1512001266 shutdown_connections 2024-09-21T01:33:43.244 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:43.243+0000 7f4949958640 1 --2- 172.21.15.83:0/1512001266 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f492c0b6550 0x7f492c0b8a60 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:43.244 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:43.243+0000 7f4949958640 1 --2- 172.21.15.83:0/1512001266 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f494410de30 0x7f494419fb60 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:43.244 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:43.243+0000 7f4949958640 1 --2- 172.21.15.83:0/1512001266 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f49441052b0 0x7f494419a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:43.244 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:43.243+0000 7f4949958640 1 --2- 172.21.15.83:0/1512001266 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4944104880 0x7f494419a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:43.244 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:43.243+0000 7f4949958640 1 -- 172.21.15.83:0/1512001266 >> 172.21.15.83:0/1512001266 conn(0x7f4944079730 msgr2=0x7f4944100850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:33:43.244 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:43.243+0000 7f4949958640 1 -- 172.21.15.83:0/1512001266 shutdown_connections 2024-09-21T01:33:43.244 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:43.243+0000 7f4949958640 1 -- 172.21.15.83:0/1512001266 wait complete. 2024-09-21T01:33:43.442 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'f7697ecc-77b8-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi083') 2024-09-21T01:33:43.443 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'f7697ecc-77b8-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi083') 2024-09-21T01:33:43.443 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'f7697ecc-77b8-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi083') 2024-09-21T01:33:43.443 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'f7697ecc-77b8-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'client_mount_timeout', '30'], check_status=True, hostname='smithi083') 2024-09-21T01:33:43.443 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'f7697ecc-77b8-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'debug_cephsqlite', '20'], check_status=True, hostname='smithi083') 2024-09-21T01:33:43.443 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'f7697ecc-77b8-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'debug_client', '20'], check_status=True, hostname='smithi083') 2024-09-21T01:33:43.443 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'f7697ecc-77b8-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'debug_mgr', '20'], check_status=True, hostname='smithi083') 2024-09-21T01:33:43.443 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'f7697ecc-77b8-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'debug_ms', '1'], check_status=True, hostname='smithi083') 2024-09-21T01:33:43.443 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'f7697ecc-77b8-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'mgr/snap_schedule/allow_m_granularity', 'True'], check_status=True, hostname='smithi083') 2024-09-21T01:33:43.443 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'f7697ecc-77b8-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'mgr/snap_schedule/dump_on_update', 'True'], check_status=True, hostname='smithi083') 2024-09-21T01:33:43.964 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:43 smithi142 ceph-mon[34050]: Reconfiguring mon.c (monmap changed)... 2024-09-21T01:33:43.965 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:43 smithi142 ceph-mon[34050]: Reconfiguring daemon mon.c on smithi142 2024-09-21T01:33:43.965 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:43 smithi142 ceph-mon[34050]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:33:43.965 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:43 smithi142 ceph-mon[34050]: from='client.? 172.21.15.83:0/1512001266' entity='client.admin' 2024-09-21T01:33:43.965 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:43 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:33:43.965 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:43 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:33:43.965 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:43 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:33:43.965 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:43 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:33:43.965 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:43 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:33:43.965 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:43 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:33:43.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:43 smithi119 ceph-mon[33693]: Reconfiguring mon.c (monmap changed)... 2024-09-21T01:33:43.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:43 smithi119 ceph-mon[33693]: Reconfiguring daemon mon.c on smithi142 2024-09-21T01:33:43.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:43 smithi119 ceph-mon[33693]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:33:43.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:43 smithi119 ceph-mon[33693]: from='client.? 172.21.15.83:0/1512001266' entity='client.admin' 2024-09-21T01:33:43.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:43 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:33:43.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:43 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:33:43.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:43 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:33:43.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:43 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:33:43.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:43 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:33:43.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:43 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:33:44.053 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:43 smithi083 ceph-mon[31370]: Reconfiguring mon.c (monmap changed)... 2024-09-21T01:33:44.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:43 smithi083 ceph-mon[31370]: Reconfiguring daemon mon.c on smithi142 2024-09-21T01:33:44.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:43 smithi083 ceph-mon[31370]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:33:44.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:43 smithi083 ceph-mon[31370]: from='client.? 172.21.15.83:0/1512001266' entity='client.admin' 2024-09-21T01:33:44.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:43 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:33:44.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:43 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:33:44.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:43 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:33:44.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:43 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:33:44.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:43 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:33:44.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:43 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:33:44.105 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'f7697ecc-77b8-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'mgr/snap_schedule/log_level', 'debug'], check_status=True, hostname='smithi083') 2024-09-21T01:33:44.105 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'f7697ecc-77b8-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'mon_warn_on_pool_no_app', 'False'], check_status=True, hostname='smithi083') 2024-09-21T01:33:44.105 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'f7697ecc-77b8-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mon', 'mon_op_complaint_time', '120'], check_status=True, hostname='smithi083') 2024-09-21T01:33:44.106 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'f7697ecc-77b8-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'osd', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi083') 2024-09-21T01:33:44.106 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph config dump 2024-09-21T01:33:44.346 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:33:44.756 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:44.746+0000 7feeb2b1e640 1 -- 172.21.15.83:0/2117677124 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7feeac1094a0 msgr2=0x7feeac1098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:33:44.756 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:44.746+0000 7feeb2b1e640 1 --2- 172.21.15.83:0/2117677124 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7feeac1094a0 0x7feeac1098b0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fee98009900 tx=0x7fee9802a410 comp rx=0 tx=0).stop 2024-09-21T01:33:44.756 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:44.746+0000 7feeb2b1e640 1 -- 172.21.15.83:0/2117677124 shutdown_connections 2024-09-21T01:33:44.756 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:44.746+0000 7feeb2b1e640 1 --2- 172.21.15.83:0/2117677124 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feeac109df0 0x7feeac110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:44.756 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:44.746+0000 7feeb2b1e640 1 --2- 172.21.15.83:0/2117677124 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7feeac1094a0 0x7feeac1098b0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:44.756 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:44.746+0000 7feeb2b1e640 1 --2- 172.21.15.83:0/2117677124 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feeac103b60 0x7feeac103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:44.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:44.746+0000 7feeb2b1e640 1 -- 172.21.15.83:0/2117677124 >> 172.21.15.83:0/2117677124 conn(0x7feeac07b850 msgr2=0x7feeac07bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:33:44.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:44.746+0000 7feeb2b1e640 1 -- 172.21.15.83:0/2117677124 shutdown_connections 2024-09-21T01:33:44.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:44.746+0000 7feeb2b1e640 1 -- 172.21.15.83:0/2117677124 wait complete. 2024-09-21T01:33:44.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:44.747+0000 7feeb2b1e640 1 Processor -- start 2024-09-21T01:33:44.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:44.748+0000 7feeb2b1e640 1 -- start start 2024-09-21T01:33:44.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:44.748+0000 7feeb2b1e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feeac103b60 0x7feeac077120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:33:44.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:44.748+0000 7feeb2b1e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feeac1094a0 0x7feeac075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:33:44.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:44.748+0000 7feeb2b1e640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7feeac109df0 0x7feeac075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:33:44.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:44.748+0000 7feeb2b1e640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7feeac113960 con 0x7feeac109df0 2024-09-21T01:33:44.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:44.748+0000 7feeb2b1e640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7feeac1137e0 con 0x7feeac1094a0 2024-09-21T01:33:44.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:44.748+0000 7feeb2b1e640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7feeac113ae0 con 0x7feeac103b60 2024-09-21T01:33:44.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:44.748+0000 7feeb10bb640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7feeac109df0 0x7feeac075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:33:44.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:44.748+0000 7feeb10bb640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7feeac109df0 0x7feeac075c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:57236/0 (socket says 172.21.15.83:57236) 2024-09-21T01:33:44.758 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:44.748+0000 7feeb10bb640 1 -- 172.21.15.83:0/202573400 learned_addr learned my addr 172.21.15.83:0/202573400 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:33:44.758 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:44.748+0000 7feeabfff640 1 --2- 172.21.15.83:0/202573400 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feeac1094a0 0x7feeac075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:33:44.758 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:44.748+0000 7feeb08ba640 1 --2- 172.21.15.83:0/202573400 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feeac103b60 0x7feeac077120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:33:44.758 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:44.748+0000 7feeb10bb640 1 -- 172.21.15.83:0/202573400 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feeac103b60 msgr2=0x7feeac077120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:33:44.758 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:44.748+0000 7feeb10bb640 1 --2- 172.21.15.83:0/202573400 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feeac103b60 0x7feeac077120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:44.758 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:44.748+0000 7feeb10bb640 1 -- 172.21.15.83:0/202573400 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feeac1094a0 msgr2=0x7feeac075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:33:44.758 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:44.748+0000 7feeb10bb640 1 --2- 172.21.15.83:0/202573400 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feeac1094a0 0x7feeac075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:44.758 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:44.748+0000 7feeb10bb640 1 -- 172.21.15.83:0/202573400 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feeac076470 con 0x7feeac109df0 2024-09-21T01:33:44.758 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:44.749+0000 7feeb10bb640 1 --2- 172.21.15.83:0/202573400 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7feeac109df0 0x7feeac075c50 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7feea400eb10 tx=0x7feea400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:33:44.758 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:44.749+0000 7feea9ffb640 1 -- 172.21.15.83:0/202573400 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feea4004b20 con 0x7feeac109df0 2024-09-21T01:33:44.758 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:44.749+0000 7feea9ffb640 1 -- 172.21.15.83:0/202573400 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7feea4004cc0 con 0x7feeac109df0 2024-09-21T01:33:44.758 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:44.749+0000 7feea9ffb640 1 -- 172.21.15.83:0/202573400 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feea4010690 con 0x7feeac109df0 2024-09-21T01:33:44.758 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:44.749+0000 7feeb2b1e640 1 -- 172.21.15.83:0/202573400 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feeac1acdb0 con 0x7feeac109df0 2024-09-21T01:33:44.758 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:44.749+0000 7feeb2b1e640 1 -- 172.21.15.83:0/202573400 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feeac1ad210 con 0x7feeac109df0 2024-09-21T01:33:44.759 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:44.750+0000 7feeb2b1e640 1 -- 172.21.15.83:0/202573400 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feeac103f70 con 0x7feeac109df0 2024-09-21T01:33:44.759 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:44.751+0000 7feea9ffb640 1 -- 172.21.15.83:0/202573400 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 19) ==== 154473+0+0 (secure 0 0 0) 0x7feea4005020 con 0x7feeac109df0 2024-09-21T01:33:44.759 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:44.752+0000 7feea9ffb640 1 --2- 172.21.15.83:0/202573400 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fee9c0b64d0 0x7fee9c0b89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:33:44.759 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:44.752+0000 7feeb08ba640 1 --2- 172.21.15.83:0/202573400 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fee9c0b64d0 0x7fee9c0b89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:33:44.759 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:44.752+0000 7feea9ffb640 1 -- 172.21.15.83:0/202573400 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7feea40e5e60 con 0x7feeac109df0 2024-09-21T01:33:44.759 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:44.753+0000 7feeb08ba640 1 --2- 172.21.15.83:0/202573400 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fee9c0b64d0 0x7fee9c0b89e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7feea0005fd0 tx=0x7feea0005850 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:33:44.759 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:44.757+0000 7feea9ffb640 1 -- 172.21.15.83:0/202573400 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7feea40ae2f0 con 0x7feeac109df0 2024-09-21T01:33:44.935 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:44.935+0000 7feeb2b1e640 1 -- 172.21.15.83:0/202573400 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7feeac02e640 con 0x7feeac109df0 2024-09-21T01:33:44.936 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:44.936+0000 7feea9ffb640 1 -- 172.21.15.83:0/202573400 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v37) ==== 59+0+21721 (secure 0 0 0) 0x7feea40b26d0 con 0x7feeac109df0 2024-09-21T01:33:44.936 INFO:teuthology.orchestra.run.smithi083.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-21T01:33:44.937 INFO:teuthology.orchestra.run.smithi083.stdout:global dev auth_debug true 2024-09-21T01:33:44.937 INFO:teuthology.orchestra.run.smithi083.stdout:global basic container_image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 * 2024-09-21T01:33:44.937 INFO:teuthology.orchestra.run.smithi083.stdout:global dev debug_asserts_on_shutdown true 2024-09-21T01:33:44.937 INFO:teuthology.orchestra.run.smithi083.stdout:global basic log_to_file true 2024-09-21T01:33:44.937 INFO:teuthology.orchestra.run.smithi083.stdout:global basic log_to_journald false 2024-09-21T01:33:44.937 INFO:teuthology.orchestra.run.smithi083.stdout:global basic log_to_stderr false 2024-09-21T01:33:44.937 INFO:teuthology.orchestra.run.smithi083.stdout:global advanced mon_allow_pool_delete true 2024-09-21T01:33:44.937 INFO:teuthology.orchestra.run.smithi083.stdout:global advanced mon_clock_drift_allowed 1.000000 2024-09-21T01:33:44.937 INFO:teuthology.orchestra.run.smithi083.stdout:global advanced mon_cluster_log_to_file true 2024-09-21T01:33:44.937 INFO:teuthology.orchestra.run.smithi083.stdout:global advanced mon_max_pg_per_osd 10000 2024-09-21T01:33:44.937 INFO:teuthology.orchestra.run.smithi083.stdout:global advanced mon_pg_warn_max_object_skew 0.000000 2024-09-21T01:33:44.937 INFO:teuthology.orchestra.run.smithi083.stdout:global advanced mon_warn_on_crush_straw_calc_version_zero false 2024-09-21T01:33:44.938 INFO:teuthology.orchestra.run.smithi083.stdout:global advanced mon_warn_on_legacy_crush_tunables false 2024-09-21T01:33:44.938 INFO:teuthology.orchestra.run.smithi083.stdout:global advanced mon_warn_on_osd_down_out_interval_zero false 2024-09-21T01:33:44.938 INFO:teuthology.orchestra.run.smithi083.stdout:global dev mon_warn_on_pool_pg_num_not_power_of_two false 2024-09-21T01:33:44.938 INFO:teuthology.orchestra.run.smithi083.stdout:global advanced mon_warn_on_too_few_osds false 2024-09-21T01:33:44.938 INFO:teuthology.orchestra.run.smithi083.stdout:global dev ms_die_on_bug true 2024-09-21T01:33:44.938 INFO:teuthology.orchestra.run.smithi083.stdout:global dev ms_die_on_old_message true 2024-09-21T01:33:44.938 INFO:teuthology.orchestra.run.smithi083.stdout:global advanced osd_pool_default_erasure_code_profile plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-21T01:33:44.938 INFO:teuthology.orchestra.run.smithi083.stdout:global advanced osd_pool_default_pg_autoscale_mode off 2024-09-21T01:33:44.938 INFO:teuthology.orchestra.run.smithi083.stdout:mon advanced auth_allow_insecure_global_id_reclaim false 2024-09-21T01:33:44.938 INFO:teuthology.orchestra.run.smithi083.stdout:mon advanced auth_mon_ticket_ttl 660.000000 2024-09-21T01:33:44.938 INFO:teuthology.orchestra.run.smithi083.stdout:mon advanced auth_service_ticket_ttl 240.000000 2024-09-21T01:33:44.938 INFO:teuthology.orchestra.run.smithi083.stdout:mon advanced debug_mon 20/20 2024-09-21T01:33:44.938 INFO:teuthology.orchestra.run.smithi083.stdout:mon advanced debug_ms 1/1 2024-09-21T01:33:44.939 INFO:teuthology.orchestra.run.smithi083.stdout:mon advanced debug_paxos 20/20 2024-09-21T01:33:44.939 INFO:teuthology.orchestra.run.smithi083.stdout:mon advanced mon_data_avail_warn 5 2024-09-21T01:33:44.939 INFO:teuthology.orchestra.run.smithi083.stdout:mon advanced mon_down_mkfs_grace 300 2024-09-21T01:33:44.939 INFO:teuthology.orchestra.run.smithi083.stdout:mon advanced mon_mgr_mkfs_grace 240 2024-09-21T01:33:44.939 INFO:teuthology.orchestra.run.smithi083.stdout:mon advanced mon_op_complaint_time 120 2024-09-21T01:33:44.939 INFO:teuthology.orchestra.run.smithi083.stdout:mon dev mon_osd_prime_pg_temp true 2024-09-21T01:33:44.939 INFO:teuthology.orchestra.run.smithi083.stdout:mon advanced mon_osd_reporter_subtree_level osd 2024-09-21T01:33:44.939 INFO:teuthology.orchestra.run.smithi083.stdout:mon advanced mon_reweight_min_bytes_per_osd 10 2024-09-21T01:33:44.939 INFO:teuthology.orchestra.run.smithi083.stdout:mon advanced mon_reweight_min_pgs_per_osd 4 2024-09-21T01:33:44.939 INFO:teuthology.orchestra.run.smithi083.stdout:mon advanced mon_warn_on_insecure_global_id_reclaim false 2024-09-21T01:33:44.939 INFO:teuthology.orchestra.run.smithi083.stdout:mon advanced mon_warn_on_insecure_global_id_reclaim_allowed false 2024-09-21T01:33:44.939 INFO:teuthology.orchestra.run.smithi083.stdout:mon advanced public_network 172.21.0.0/20 * 2024-09-21T01:33:44.939 INFO:teuthology.orchestra.run.smithi083.stdout:mgr advanced cephsqlite_lock_renewal_timeout 900000 2024-09-21T01:33:44.939 INFO:teuthology.orchestra.run.smithi083.stdout:mgr advanced client_mount_timeout 30 2024-09-21T01:33:44.940 INFO:teuthology.orchestra.run.smithi083.stdout:mgr advanced debug_cephsqlite 20/20 2024-09-21T01:33:44.940 INFO:teuthology.orchestra.run.smithi083.stdout:mgr advanced debug_client 20/20 2024-09-21T01:33:44.940 INFO:teuthology.orchestra.run.smithi083.stdout:mgr advanced debug_mgr 20/20 2024-09-21T01:33:44.940 INFO:teuthology.orchestra.run.smithi083.stdout:mgr advanced debug_ms 1/1 2024-09-21T01:33:44.940 INFO:teuthology.orchestra.run.smithi083.stdout:mgr advanced mgr/cephadm/allow_ptrace true * 2024-09-21T01:33:44.940 INFO:teuthology.orchestra.run.smithi083.stdout:mgr advanced mgr/cephadm/container_init True * 2024-09-21T01:33:44.940 INFO:teuthology.orchestra.run.smithi083.stdout:mgr advanced mgr/cephadm/migration_current 7 * 2024-09-21T01:33:44.940 INFO:teuthology.orchestra.run.smithi083.stdout:mgr advanced mgr/dashboard/ssl_server_port 8443 * 2024-09-21T01:33:44.940 INFO:teuthology.orchestra.run.smithi083.stdout:mgr advanced mgr/orchestrator/orchestrator cephadm 2024-09-21T01:33:44.940 INFO:teuthology.orchestra.run.smithi083.stdout:mgr advanced mgr/snap_schedule/allow_m_granularity true 2024-09-21T01:33:44.940 INFO:teuthology.orchestra.run.smithi083.stdout:mgr advanced mgr/snap_schedule/dump_on_update true 2024-09-21T01:33:44.940 INFO:teuthology.orchestra.run.smithi083.stdout:mgr advanced mgr/snap_schedule/log_level debug 2024-09-21T01:33:44.940 INFO:teuthology.orchestra.run.smithi083.stdout:mgr advanced mon_reweight_min_bytes_per_osd 10 2024-09-21T01:33:44.940 INFO:teuthology.orchestra.run.smithi083.stdout:mgr advanced mon_reweight_min_pgs_per_osd 4 2024-09-21T01:33:44.941 INFO:teuthology.orchestra.run.smithi083.stdout:mgr dev mon_warn_on_pool_no_app false 2024-09-21T01:33:44.941 INFO:teuthology.orchestra.run.smithi083.stdout:osd dev bdev_debug_aio true 2024-09-21T01:33:44.941 INFO:teuthology.orchestra.run.smithi083.stdout:osd dev bluestore_block_size 96636764160 * 2024-09-21T01:33:44.941 INFO:teuthology.orchestra.run.smithi083.stdout:osd advanced bluestore_compression_mode aggressive 2024-09-21T01:33:44.941 INFO:teuthology.orchestra.run.smithi083.stdout:osd dev bluestore_fsck_on_mount true 2024-09-21T01:33:44.941 INFO:teuthology.orchestra.run.smithi083.stdout:osd advanced debug_bluefs 20/20 2024-09-21T01:33:44.941 INFO:teuthology.orchestra.run.smithi083.stdout:osd advanced debug_bluestore 20/20 2024-09-21T01:33:44.941 INFO:teuthology.orchestra.run.smithi083.stdout:osd advanced debug_ms 1/1 2024-09-21T01:33:44.941 INFO:teuthology.orchestra.run.smithi083.stdout:osd advanced debug_osd 20/20 2024-09-21T01:33:44.941 INFO:teuthology.orchestra.run.smithi083.stdout:osd advanced debug_rocksdb 10/10 2024-09-21T01:33:44.941 INFO:teuthology.orchestra.run.smithi083.stdout:osd dev osd_debug_misdirected_ops true 2024-09-21T01:33:44.941 INFO:teuthology.orchestra.run.smithi083.stdout:osd dev osd_debug_op_order true 2024-09-21T01:33:44.941 INFO:teuthology.orchestra.run.smithi083.stdout:osd dev osd_debug_pg_log_writeout true 2024-09-21T01:33:44.941 INFO:teuthology.orchestra.run.smithi083.stdout:osd dev osd_debug_shutdown true 2024-09-21T01:33:44.942 INFO:teuthology.orchestra.run.smithi083.stdout:osd dev osd_debug_verify_cached_snaps true 2024-09-21T01:33:44.942 INFO:teuthology.orchestra.run.smithi083.stdout:osd dev osd_debug_verify_missing_on_start true 2024-09-21T01:33:44.942 INFO:teuthology.orchestra.run.smithi083.stdout:osd dev osd_debug_verify_stray_on_activate true 2024-09-21T01:33:44.942 INFO:teuthology.orchestra.run.smithi083.stdout:osd advanced osd_deep_scrub_update_digest_min_age 30 2024-09-21T01:33:44.942 INFO:teuthology.orchestra.run.smithi083.stdout:osd advanced osd_failsafe_full_ratio 0.950000 2024-09-21T01:33:44.943 INFO:teuthology.orchestra.run.smithi083.stdout:osd advanced osd_max_omap_entries_per_request 10000 2024-09-21T01:33:44.943 INFO:teuthology.orchestra.run.smithi083.stdout:osd advanced osd_mclock_profile high_recovery_ops 2024-09-21T01:33:44.943 INFO:teuthology.orchestra.run.smithi083.stdout:osd advanced osd_memory_target_autotune true 2024-09-21T01:33:44.943 INFO:teuthology.orchestra.run.smithi083.stdout:osd advanced osd_objectstore bluestore * 2024-09-21T01:33:44.943 INFO:teuthology.orchestra.run.smithi083.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-21T01:33:44.943 INFO:teuthology.orchestra.run.smithi083.stdout:osd advanced osd_op_queue debug_random * 2024-09-21T01:33:44.944 INFO:teuthology.orchestra.run.smithi083.stdout:osd advanced osd_op_queue_cut_off debug_random * 2024-09-21T01:33:44.944 INFO:teuthology.orchestra.run.smithi083.stdout:osd advanced osd_recover_clone_overlap true 2024-09-21T01:33:44.944 INFO:teuthology.orchestra.run.smithi083.stdout:osd advanced osd_recovery_max_chunk 1048576 2024-09-21T01:33:44.944 INFO:teuthology.orchestra.run.smithi083.stdout:osd advanced osd_scrub_load_threshold 5.000000 2024-09-21T01:33:44.944 INFO:teuthology.orchestra.run.smithi083.stdout:osd advanced osd_scrub_max_interval 600.000000 2024-09-21T01:33:44.944 INFO:teuthology.orchestra.run.smithi083.stdout:osd advanced osd_shutdown_pgref_assert true 2024-09-21T01:33:44.944 INFO:teuthology.orchestra.run.smithi083.stdout:mds advanced debug_mds 20/20 2024-09-21T01:33:44.944 INFO:teuthology.orchestra.run.smithi083.stdout:mds advanced debug_mds_balancer 20/20 2024-09-21T01:33:44.944 INFO:teuthology.orchestra.run.smithi083.stdout:mds advanced debug_ms 2/2 2024-09-21T01:33:44.944 INFO:teuthology.orchestra.run.smithi083.stdout:mds advanced mds_bal_fragment_size_max 10000 2024-09-21T01:33:44.944 INFO:teuthology.orchestra.run.smithi083.stdout:mds advanced mds_bal_merge_size 5 2024-09-21T01:33:44.944 INFO:teuthology.orchestra.run.smithi083.stdout:mds advanced mds_bal_split_bits 3 2024-09-21T01:33:44.944 INFO:teuthology.orchestra.run.smithi083.stdout:mds advanced mds_bal_split_size 100 2024-09-21T01:33:44.944 INFO:teuthology.orchestra.run.smithi083.stdout:mds dev mds_debug_frag true 2024-09-21T01:33:44.945 INFO:teuthology.orchestra.run.smithi083.stdout:mds dev mds_debug_scatterstat true 2024-09-21T01:33:44.945 INFO:teuthology.orchestra.run.smithi083.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-21T01:33:44.945 INFO:teuthology.orchestra.run.smithi083.stdout:mds dev mds_verify_scatter true 2024-09-21T01:33:44.945 INFO:teuthology.orchestra.run.smithi083.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-21T01:33:44.945 INFO:teuthology.orchestra.run.smithi083.stdout:mds advanced rados_mon_op_timeout 900 2024-09-21T01:33:44.945 INFO:teuthology.orchestra.run.smithi083.stdout:mds advanced rados_osd_op_timeout 900 2024-09-21T01:33:44.945 INFO:teuthology.orchestra.run.smithi083.stdout:client advanced client_mount_timeout 600 2024-09-21T01:33:44.945 INFO:teuthology.orchestra.run.smithi083.stdout:client advanced debug_client 20/20 2024-09-21T01:33:44.945 INFO:teuthology.orchestra.run.smithi083.stdout:client advanced debug_ms 1/1 2024-09-21T01:33:44.945 INFO:teuthology.orchestra.run.smithi083.stdout:client advanced rados_mon_op_timeout 900 2024-09-21T01:33:44.945 INFO:teuthology.orchestra.run.smithi083.stdout:client advanced rados_osd_op_timeout 900 2024-09-21T01:33:44.945 INFO:teuthology.orchestra.run.smithi083.stdout:client.rgw advanced rgw_cache_enabled true 2024-09-21T01:33:44.945 INFO:teuthology.orchestra.run.smithi083.stdout:client.rgw advanced rgw_enable_ops_log true 2024-09-21T01:33:44.945 INFO:teuthology.orchestra.run.smithi083.stdout:client.rgw advanced rgw_enable_usage_log true 2024-09-21T01:33:44.946 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:44.938+0000 7feeb2b1e640 1 -- 172.21.15.83:0/202573400 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fee9c0b64d0 msgr2=0x7fee9c0b89e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:33:44.946 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:44.938+0000 7feeb2b1e640 1 --2- 172.21.15.83:0/202573400 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fee9c0b64d0 0x7fee9c0b89e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7feea0005fd0 tx=0x7feea0005850 comp rx=0 tx=0).stop 2024-09-21T01:33:44.946 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:44.938+0000 7feeb2b1e640 1 -- 172.21.15.83:0/202573400 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7feeac109df0 msgr2=0x7feeac075c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:33:44.946 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:44.938+0000 7feeb2b1e640 1 --2- 172.21.15.83:0/202573400 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7feeac109df0 0x7feeac075c50 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7feea400eb10 tx=0x7feea400c2d0 comp rx=0 tx=0).stop 2024-09-21T01:33:44.946 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:44.938+0000 7feeb2b1e640 1 -- 172.21.15.83:0/202573400 shutdown_connections 2024-09-21T01:33:44.947 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:44.938+0000 7feeb2b1e640 1 --2- 172.21.15.83:0/202573400 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fee9c0b64d0 0x7fee9c0b89e0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:44.947 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:44.938+0000 7feeb2b1e640 1 --2- 172.21.15.83:0/202573400 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7feeac109df0 0x7feeac075c50 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:44.947 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:44.938+0000 7feeb2b1e640 1 --2- 172.21.15.83:0/202573400 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feeac1094a0 0x7feeac075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:44.947 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:44.938+0000 7feeb2b1e640 1 --2- 172.21.15.83:0/202573400 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feeac103b60 0x7feeac077120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:44.947 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:44.938+0000 7feeb2b1e640 1 -- 172.21.15.83:0/202573400 >> 172.21.15.83:0/202573400 conn(0x7feeac07b850 msgr2=0x7feeac105560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:33:44.947 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:44.938+0000 7feeb2b1e640 1 -- 172.21.15.83:0/202573400 shutdown_connections 2024-09-21T01:33:44.947 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:44.938+0000 7feeb2b1e640 1 -- 172.21.15.83:0/202573400 wait complete. 2024-09-21T01:33:45.564 INFO:tasks.cephadm:Deploying OSDs... 2024-09-21T01:33:45.565 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-09-21T01:33:45.565 DEBUG:teuthology.orchestra.run.smithi083:> dd if=/scratch_devs of=/dev/stdout 2024-09-21T01:33:45.581 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-21T01:33:45.581 DEBUG:teuthology.orchestra.run.smithi083:> stat /dev/vg_nvme/lv_1 2024-09-21T01:33:45.637 INFO:teuthology.orchestra.run.smithi083.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-21T01:33:45.637 INFO:teuthology.orchestra.run.smithi083.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T01:33:45.637 INFO:teuthology.orchestra.run.smithi083.stdout:Device: 5h/5d Inode: 668 Links: 1 2024-09-21T01:33:45.637 INFO:teuthology.orchestra.run.smithi083.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T01:33:45.637 INFO:teuthology.orchestra.run.smithi083.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T01:33:45.637 INFO:teuthology.orchestra.run.smithi083.stdout:Access: 2024-09-21 01:32:23.670970624 +0000 2024-09-21T01:33:45.637 INFO:teuthology.orchestra.run.smithi083.stdout:Modify: 2024-09-21 01:27:26.541611842 +0000 2024-09-21T01:33:45.637 INFO:teuthology.orchestra.run.smithi083.stdout:Change: 2024-09-21 01:27:26.541611842 +0000 2024-09-21T01:33:45.637 INFO:teuthology.orchestra.run.smithi083.stdout: Birth: 2024-09-21 01:27:26.541611842 +0000 2024-09-21T01:33:45.638 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-21T01:33:45.702 INFO:teuthology.orchestra.run.smithi083.stderr:1+0 records in 2024-09-21T01:33:45.702 INFO:teuthology.orchestra.run.smithi083.stderr:1+0 records out 2024-09-21T01:33:45.702 INFO:teuthology.orchestra.run.smithi083.stderr:512 bytes copied, 0.000226728 s, 2.3 MB/s 2024-09-21T01:33:45.703 DEBUG:teuthology.orchestra.run.smithi083:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-21T01:33:45.759 DEBUG:teuthology.orchestra.run.smithi083:> stat /dev/vg_nvme/lv_2 2024-09-21T01:33:45.814 INFO:teuthology.orchestra.run.smithi083.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-21T01:33:45.815 INFO:teuthology.orchestra.run.smithi083.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T01:33:45.815 INFO:teuthology.orchestra.run.smithi083.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-09-21T01:33:45.815 INFO:teuthology.orchestra.run.smithi083.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T01:33:45.815 INFO:teuthology.orchestra.run.smithi083.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T01:33:45.815 INFO:teuthology.orchestra.run.smithi083.stdout:Access: 2024-09-21 01:32:23.700969902 +0000 2024-09-21T01:33:45.815 INFO:teuthology.orchestra.run.smithi083.stdout:Modify: 2024-09-21 01:27:26.856604170 +0000 2024-09-21T01:33:45.815 INFO:teuthology.orchestra.run.smithi083.stdout:Change: 2024-09-21 01:27:26.856604170 +0000 2024-09-21T01:33:45.815 INFO:teuthology.orchestra.run.smithi083.stdout: Birth: 2024-09-21 01:27:26.856604170 +0000 2024-09-21T01:33:45.815 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-21T01:33:45.877 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:45 smithi083 ceph-mon[31370]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:33:45.877 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:45 smithi083 ceph-mon[31370]: from='client.? 172.21.15.83:0/202573400' entity='client.admin' cmd={"prefix": "config dump"} : dispatch 2024-09-21T01:33:45.879 INFO:teuthology.orchestra.run.smithi083.stderr:1+0 records in 2024-09-21T01:33:45.879 INFO:teuthology.orchestra.run.smithi083.stderr:1+0 records out 2024-09-21T01:33:45.879 INFO:teuthology.orchestra.run.smithi083.stderr:512 bytes copied, 0.000287672 s, 1.8 MB/s 2024-09-21T01:33:45.881 DEBUG:teuthology.orchestra.run.smithi083:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-21T01:33:45.937 DEBUG:teuthology.orchestra.run.smithi083:> stat /dev/vg_nvme/lv_3 2024-09-21T01:33:45.967 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:45 smithi119 ceph-mon[33693]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:33:45.967 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:45 smithi119 ceph-mon[33693]: from='client.? 172.21.15.83:0/202573400' entity='client.admin' cmd={"prefix": "config dump"} : dispatch 2024-09-21T01:33:45.992 INFO:teuthology.orchestra.run.smithi083.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-21T01:33:45.992 INFO:teuthology.orchestra.run.smithi083.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T01:33:45.992 INFO:teuthology.orchestra.run.smithi083.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-09-21T01:33:45.992 INFO:teuthology.orchestra.run.smithi083.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T01:33:45.992 INFO:teuthology.orchestra.run.smithi083.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T01:33:45.992 INFO:teuthology.orchestra.run.smithi083.stdout:Access: 2024-09-21 01:32:23.730969181 +0000 2024-09-21T01:33:45.992 INFO:teuthology.orchestra.run.smithi083.stdout:Modify: 2024-09-21 01:27:27.190596035 +0000 2024-09-21T01:33:45.993 INFO:teuthology.orchestra.run.smithi083.stdout:Change: 2024-09-21 01:27:27.190596035 +0000 2024-09-21T01:33:45.993 INFO:teuthology.orchestra.run.smithi083.stdout: Birth: 2024-09-21 01:27:27.190596035 +0000 2024-09-21T01:33:45.993 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-21T01:33:46.055 INFO:teuthology.orchestra.run.smithi083.stderr:1+0 records in 2024-09-21T01:33:46.056 INFO:teuthology.orchestra.run.smithi083.stderr:1+0 records out 2024-09-21T01:33:46.056 INFO:teuthology.orchestra.run.smithi083.stderr:512 bytes copied, 0.000234856 s, 2.2 MB/s 2024-09-21T01:33:46.057 DEBUG:teuthology.orchestra.run.smithi083:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-21T01:33:46.113 DEBUG:teuthology.orchestra.run.smithi083:> stat /dev/vg_nvme/lv_4 2024-09-21T01:33:46.168 INFO:teuthology.orchestra.run.smithi083.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-21T01:33:46.168 INFO:teuthology.orchestra.run.smithi083.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T01:33:46.168 INFO:teuthology.orchestra.run.smithi083.stdout:Device: 5h/5d Inode: 725 Links: 1 2024-09-21T01:33:46.168 INFO:teuthology.orchestra.run.smithi083.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T01:33:46.169 INFO:teuthology.orchestra.run.smithi083.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T01:33:46.169 INFO:teuthology.orchestra.run.smithi083.stdout:Access: 2024-09-21 01:32:23.761968436 +0000 2024-09-21T01:33:46.169 INFO:teuthology.orchestra.run.smithi083.stdout:Modify: 2024-09-21 01:27:27.526587851 +0000 2024-09-21T01:33:46.169 INFO:teuthology.orchestra.run.smithi083.stdout:Change: 2024-09-21 01:27:27.526587851 +0000 2024-09-21T01:33:46.169 INFO:teuthology.orchestra.run.smithi083.stdout: Birth: 2024-09-21 01:27:27.526587851 +0000 2024-09-21T01:33:46.169 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-21T01:33:46.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:45 smithi142 ceph-mon[34050]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:33:46.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:45 smithi142 ceph-mon[34050]: from='client.? 172.21.15.83:0/202573400' entity='client.admin' cmd={"prefix": "config dump"} : dispatch 2024-09-21T01:33:46.231 INFO:teuthology.orchestra.run.smithi083.stderr:1+0 records in 2024-09-21T01:33:46.231 INFO:teuthology.orchestra.run.smithi083.stderr:1+0 records out 2024-09-21T01:33:46.232 INFO:teuthology.orchestra.run.smithi083.stderr:512 bytes copied, 0.000261443 s, 2.0 MB/s 2024-09-21T01:33:46.233 DEBUG:teuthology.orchestra.run.smithi083:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-21T01:33:46.289 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2024-09-21T01:33:46.290 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/scratch_devs of=/dev/stdout 2024-09-21T01:33:46.309 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-21T01:33:46.309 DEBUG:teuthology.orchestra.run.smithi119:> stat /dev/vg_nvme/lv_1 2024-09-21T01:33:46.368 INFO:teuthology.orchestra.run.smithi119.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-21T01:33:46.368 INFO:teuthology.orchestra.run.smithi119.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T01:33:46.368 INFO:teuthology.orchestra.run.smithi119.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-09-21T01:33:46.368 INFO:teuthology.orchestra.run.smithi119.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T01:33:46.368 INFO:teuthology.orchestra.run.smithi119.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T01:33:46.368 INFO:teuthology.orchestra.run.smithi119.stdout:Access: 2024-09-21 01:33:16.531697901 +0000 2024-09-21T01:33:46.368 INFO:teuthology.orchestra.run.smithi119.stdout:Modify: 2024-09-21 01:27:32.871346897 +0000 2024-09-21T01:33:46.368 INFO:teuthology.orchestra.run.smithi119.stdout:Change: 2024-09-21 01:27:32.871346897 +0000 2024-09-21T01:33:46.368 INFO:teuthology.orchestra.run.smithi119.stdout: Birth: 2024-09-21 01:27:32.871346897 +0000 2024-09-21T01:33:46.369 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-21T01:33:46.439 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records in 2024-09-21T01:33:46.439 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records out 2024-09-21T01:33:46.439 INFO:teuthology.orchestra.run.smithi119.stderr:512 bytes copied, 0.000295763 s, 1.7 MB/s 2024-09-21T01:33:46.441 DEBUG:teuthology.orchestra.run.smithi119:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-21T01:33:46.499 DEBUG:teuthology.orchestra.run.smithi119:> stat /dev/vg_nvme/lv_2 2024-09-21T01:33:46.556 INFO:teuthology.orchestra.run.smithi119.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-21T01:33:46.556 INFO:teuthology.orchestra.run.smithi119.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T01:33:46.556 INFO:teuthology.orchestra.run.smithi119.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-09-21T01:33:46.557 INFO:teuthology.orchestra.run.smithi119.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T01:33:46.557 INFO:teuthology.orchestra.run.smithi119.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T01:33:46.557 INFO:teuthology.orchestra.run.smithi119.stdout:Access: 2024-09-21 01:33:16.531697901 +0000 2024-09-21T01:33:46.557 INFO:teuthology.orchestra.run.smithi119.stdout:Modify: 2024-09-21 01:27:33.196338702 +0000 2024-09-21T01:33:46.557 INFO:teuthology.orchestra.run.smithi119.stdout:Change: 2024-09-21 01:27:33.196338702 +0000 2024-09-21T01:33:46.557 INFO:teuthology.orchestra.run.smithi119.stdout: Birth: 2024-09-21 01:27:33.196338702 +0000 2024-09-21T01:33:46.557 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-21T01:33:46.622 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records in 2024-09-21T01:33:46.622 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records out 2024-09-21T01:33:46.622 INFO:teuthology.orchestra.run.smithi119.stderr:512 bytes copied, 0.00023908 s, 2.1 MB/s 2024-09-21T01:33:46.623 DEBUG:teuthology.orchestra.run.smithi119:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-21T01:33:46.682 DEBUG:teuthology.orchestra.run.smithi119:> stat /dev/vg_nvme/lv_3 2024-09-21T01:33:46.739 INFO:teuthology.orchestra.run.smithi119.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-21T01:33:46.739 INFO:teuthology.orchestra.run.smithi119.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T01:33:46.739 INFO:teuthology.orchestra.run.smithi119.stdout:Device: 5h/5d Inode: 706 Links: 1 2024-09-21T01:33:46.740 INFO:teuthology.orchestra.run.smithi119.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T01:33:46.740 INFO:teuthology.orchestra.run.smithi119.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T01:33:46.740 INFO:teuthology.orchestra.run.smithi119.stdout:Access: 2024-09-21 01:33:16.531697901 +0000 2024-09-21T01:33:46.740 INFO:teuthology.orchestra.run.smithi119.stdout:Modify: 2024-09-21 01:27:33.508330835 +0000 2024-09-21T01:33:46.740 INFO:teuthology.orchestra.run.smithi119.stdout:Change: 2024-09-21 01:27:33.508330835 +0000 2024-09-21T01:33:46.740 INFO:teuthology.orchestra.run.smithi119.stdout: Birth: 2024-09-21 01:27:33.508330835 +0000 2024-09-21T01:33:46.740 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-21T01:33:46.804 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records in 2024-09-21T01:33:46.805 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records out 2024-09-21T01:33:46.805 INFO:teuthology.orchestra.run.smithi119.stderr:512 bytes copied, 0.000206861 s, 2.5 MB/s 2024-09-21T01:33:46.806 DEBUG:teuthology.orchestra.run.smithi119:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-21T01:33:46.863 DEBUG:teuthology.orchestra.run.smithi119:> stat /dev/vg_nvme/lv_4 2024-09-21T01:33:46.919 INFO:teuthology.orchestra.run.smithi119.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-21T01:33:46.919 INFO:teuthology.orchestra.run.smithi119.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T01:33:46.919 INFO:teuthology.orchestra.run.smithi119.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-09-21T01:33:46.919 INFO:teuthology.orchestra.run.smithi119.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T01:33:46.919 INFO:teuthology.orchestra.run.smithi119.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T01:33:46.919 INFO:teuthology.orchestra.run.smithi119.stdout:Access: 2024-09-21 01:33:16.532697876 +0000 2024-09-21T01:33:46.919 INFO:teuthology.orchestra.run.smithi119.stdout:Modify: 2024-09-21 01:27:33.832322667 +0000 2024-09-21T01:33:46.919 INFO:teuthology.orchestra.run.smithi119.stdout:Change: 2024-09-21 01:27:33.832322667 +0000 2024-09-21T01:33:46.919 INFO:teuthology.orchestra.run.smithi119.stdout: Birth: 2024-09-21 01:27:33.832322667 +0000 2024-09-21T01:33:46.920 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-21T01:33:46.983 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records in 2024-09-21T01:33:46.983 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records out 2024-09-21T01:33:46.983 INFO:teuthology.orchestra.run.smithi119.stderr:512 bytes copied, 0.00019564 s, 2.6 MB/s 2024-09-21T01:33:46.984 DEBUG:teuthology.orchestra.run.smithi119:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-21T01:33:47.041 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-09-21T01:33:47.041 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/scratch_devs of=/dev/stdout 2024-09-21T01:33:47.061 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-21T01:33:47.061 DEBUG:teuthology.orchestra.run.smithi142:> stat /dev/vg_nvme/lv_1 2024-09-21T01:33:47.120 INFO:teuthology.orchestra.run.smithi142.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-21T01:33:47.120 INFO:teuthology.orchestra.run.smithi142.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T01:33:47.120 INFO:teuthology.orchestra.run.smithi142.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-09-21T01:33:47.120 INFO:teuthology.orchestra.run.smithi142.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T01:33:47.120 INFO:teuthology.orchestra.run.smithi142.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T01:33:47.120 INFO:teuthology.orchestra.run.smithi142.stdout:Access: 2024-09-21 01:33:14.217700078 +0000 2024-09-21T01:33:47.120 INFO:teuthology.orchestra.run.smithi142.stdout:Modify: 2024-09-21 01:27:24.405137262 +0000 2024-09-21T01:33:47.120 INFO:teuthology.orchestra.run.smithi142.stdout:Change: 2024-09-21 01:27:24.405137262 +0000 2024-09-21T01:33:47.120 INFO:teuthology.orchestra.run.smithi142.stdout: Birth: 2024-09-21 01:27:24.405137262 +0000 2024-09-21T01:33:47.121 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-21T01:33:47.190 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records in 2024-09-21T01:33:47.190 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records out 2024-09-21T01:33:47.190 INFO:teuthology.orchestra.run.smithi142.stderr:512 bytes copied, 0.000260832 s, 2.0 MB/s 2024-09-21T01:33:47.192 DEBUG:teuthology.orchestra.run.smithi142:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-21T01:33:47.250 DEBUG:teuthology.orchestra.run.smithi142:> stat /dev/vg_nvme/lv_2 2024-09-21T01:33:47.307 INFO:teuthology.orchestra.run.smithi142.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-21T01:33:47.307 INFO:teuthology.orchestra.run.smithi142.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T01:33:47.307 INFO:teuthology.orchestra.run.smithi142.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-09-21T01:33:47.307 INFO:teuthology.orchestra.run.smithi142.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T01:33:47.308 INFO:teuthology.orchestra.run.smithi142.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T01:33:47.308 INFO:teuthology.orchestra.run.smithi142.stdout:Access: 2024-09-21 01:33:14.217700078 +0000 2024-09-21T01:33:47.308 INFO:teuthology.orchestra.run.smithi142.stdout:Modify: 2024-09-21 01:27:24.766130570 +0000 2024-09-21T01:33:47.308 INFO:teuthology.orchestra.run.smithi142.stdout:Change: 2024-09-21 01:27:24.766130570 +0000 2024-09-21T01:33:47.308 INFO:teuthology.orchestra.run.smithi142.stdout: Birth: 2024-09-21 01:27:24.766130570 +0000 2024-09-21T01:33:47.308 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-21T01:33:47.372 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records in 2024-09-21T01:33:47.373 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records out 2024-09-21T01:33:47.373 INFO:teuthology.orchestra.run.smithi142.stderr:512 bytes copied, 0.000243135 s, 2.1 MB/s 2024-09-21T01:33:47.374 DEBUG:teuthology.orchestra.run.smithi142:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-21T01:33:47.432 DEBUG:teuthology.orchestra.run.smithi142:> stat /dev/vg_nvme/lv_3 2024-09-21T01:33:47.488 INFO:teuthology.orchestra.run.smithi142.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-21T01:33:47.489 INFO:teuthology.orchestra.run.smithi142.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T01:33:47.489 INFO:teuthology.orchestra.run.smithi142.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-21T01:33:47.489 INFO:teuthology.orchestra.run.smithi142.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T01:33:47.489 INFO:teuthology.orchestra.run.smithi142.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T01:33:47.489 INFO:teuthology.orchestra.run.smithi142.stdout:Access: 2024-09-21 01:33:14.218700059 +0000 2024-09-21T01:33:47.489 INFO:teuthology.orchestra.run.smithi142.stdout:Modify: 2024-09-21 01:27:25.098124416 +0000 2024-09-21T01:33:47.489 INFO:teuthology.orchestra.run.smithi142.stdout:Change: 2024-09-21 01:27:25.098124416 +0000 2024-09-21T01:33:47.489 INFO:teuthology.orchestra.run.smithi142.stdout: Birth: 2024-09-21 01:27:25.098124416 +0000 2024-09-21T01:33:47.489 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-21T01:33:47.553 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records in 2024-09-21T01:33:47.554 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records out 2024-09-21T01:33:47.554 INFO:teuthology.orchestra.run.smithi142.stderr:512 bytes copied, 0.000207577 s, 2.5 MB/s 2024-09-21T01:33:47.555 DEBUG:teuthology.orchestra.run.smithi142:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-21T01:33:47.612 DEBUG:teuthology.orchestra.run.smithi142:> stat /dev/vg_nvme/lv_4 2024-09-21T01:33:47.668 INFO:teuthology.orchestra.run.smithi142.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-21T01:33:47.668 INFO:teuthology.orchestra.run.smithi142.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T01:33:47.668 INFO:teuthology.orchestra.run.smithi142.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-09-21T01:33:47.668 INFO:teuthology.orchestra.run.smithi142.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T01:33:47.668 INFO:teuthology.orchestra.run.smithi142.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T01:33:47.669 INFO:teuthology.orchestra.run.smithi142.stdout:Access: 2024-09-21 01:33:14.218700059 +0000 2024-09-21T01:33:47.669 INFO:teuthology.orchestra.run.smithi142.stdout:Modify: 2024-09-21 01:27:25.421118429 +0000 2024-09-21T01:33:47.669 INFO:teuthology.orchestra.run.smithi142.stdout:Change: 2024-09-21 01:27:25.421118429 +0000 2024-09-21T01:33:47.669 INFO:teuthology.orchestra.run.smithi142.stdout: Birth: 2024-09-21 01:27:25.421118429 +0000 2024-09-21T01:33:47.669 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-21T01:33:47.732 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records in 2024-09-21T01:33:47.732 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records out 2024-09-21T01:33:47.733 INFO:teuthology.orchestra.run.smithi142.stderr:512 bytes copied, 0.000206927 s, 2.5 MB/s 2024-09-21T01:33:47.734 DEBUG:teuthology.orchestra.run.smithi142:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-21T01:33:47.791 INFO:tasks.cephadm:Deploying osd.0 on smithi083 with /dev/vg_nvme/lv_4... 2024-09-21T01:33:47.791 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_4 2024-09-21T01:33:47.965 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:47 smithi142 ceph-mon[34050]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:33:47.967 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:47 smithi119 ceph-mon[33693]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:33:48.042 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:33:48.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:47 smithi083 ceph-mon[31370]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:33:50.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:49 smithi083 ceph-mon[31370]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:33:50.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:49 smithi142 ceph-mon[34050]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:33:50.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:49 smithi119 ceph-mon[33693]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:33:50.318 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T01:33:50.344 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi083:vg_nvme/lv_4 2024-09-21T01:33:50.584 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:33:51.048 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:51.044+0000 7fc2d3a5b640 1 -- 172.21.15.83:0/1489194501 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc2cc1094a0 msgr2=0x7fc2cc1098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:33:51.048 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:51.044+0000 7fc2d3a5b640 1 --2- 172.21.15.83:0/1489194501 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc2cc1094a0 0x7fc2cc1098b0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fc2c0009900 tx=0x7fc2c002a410 comp rx=0 tx=0).stop 2024-09-21T01:33:51.049 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:51.044+0000 7fc2d3a5b640 1 -- 172.21.15.83:0/1489194501 shutdown_connections 2024-09-21T01:33:51.049 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:51.044+0000 7fc2d3a5b640 1 --2- 172.21.15.83:0/1489194501 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc2cc109df0 0x7fc2cc110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:51.049 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:51.044+0000 7fc2d3a5b640 1 --2- 172.21.15.83:0/1489194501 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc2cc1094a0 0x7fc2cc1098b0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:51.049 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:51.044+0000 7fc2d3a5b640 1 --2- 172.21.15.83:0/1489194501 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc2cc103b60 0x7fc2cc103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:51.049 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:51.044+0000 7fc2d3a5b640 1 -- 172.21.15.83:0/1489194501 >> 172.21.15.83:0/1489194501 conn(0x7fc2cc07b850 msgr2=0x7fc2cc07bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:33:51.049 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:51.044+0000 7fc2d3a5b640 1 -- 172.21.15.83:0/1489194501 shutdown_connections 2024-09-21T01:33:51.049 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:51.044+0000 7fc2d3a5b640 1 -- 172.21.15.83:0/1489194501 wait complete. 2024-09-21T01:33:51.049 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:51.045+0000 7fc2d3a5b640 1 Processor -- start 2024-09-21T01:33:51.049 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:51.045+0000 7fc2d3a5b640 1 -- start start 2024-09-21T01:33:51.049 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:51.045+0000 7fc2d3a5b640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc2cc103b60 0x7fc2cc075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:33:51.050 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:51.045+0000 7fc2d3a5b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc2cc1094a0 0x7fc2cc075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:33:51.050 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:51.045+0000 7fc2d3a5b640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc2cc109df0 0x7fc2cc076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:33:51.050 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:51.045+0000 7fc2d3a5b640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fc2cc113980 con 0x7fc2cc109df0 2024-09-21T01:33:51.050 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:51.045+0000 7fc2d3a5b640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fc2cc113800 con 0x7fc2cc1094a0 2024-09-21T01:33:51.050 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:51.045+0000 7fc2d3a5b640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fc2cc113b00 con 0x7fc2cc103b60 2024-09-21T01:33:51.050 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:51.045+0000 7fc2d1ff8640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc2cc109df0 0x7fc2cc076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:33:51.050 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:51.045+0000 7fc2d1ff8640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc2cc109df0 0x7fc2cc076190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:57256/0 (socket says 172.21.15.83:57256) 2024-09-21T01:33:51.050 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:51.045+0000 7fc2d1ff8640 1 -- 172.21.15.83:0/591965286 learned_addr learned my addr 172.21.15.83:0/591965286 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:33:51.050 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:51.045+0000 7fc2d0ff6640 1 --2- 172.21.15.83:0/591965286 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc2cc1094a0 0x7fc2cc075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:33:51.051 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:51.045+0000 7fc2d17f7640 1 --2- 172.21.15.83:0/591965286 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc2cc103b60 0x7fc2cc075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:33:51.051 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:51.045+0000 7fc2d1ff8640 1 -- 172.21.15.83:0/591965286 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc2cc103b60 msgr2=0x7fc2cc075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:33:51.051 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:51.045+0000 7fc2d1ff8640 1 --2- 172.21.15.83:0/591965286 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc2cc103b60 0x7fc2cc075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:51.051 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:51.045+0000 7fc2d1ff8640 1 -- 172.21.15.83:0/591965286 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc2cc1094a0 msgr2=0x7fc2cc075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:33:51.051 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:51.045+0000 7fc2d1ff8640 1 --2- 172.21.15.83:0/591965286 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc2cc1094a0 0x7fc2cc075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:33:51.051 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:51.045+0000 7fc2d1ff8640 1 -- 172.21.15.83:0/591965286 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2cc1a8710 con 0x7fc2cc109df0 2024-09-21T01:33:51.051 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:51.046+0000 7fc2d1ff8640 1 --2- 172.21.15.83:0/591965286 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc2cc109df0 0x7fc2cc076190 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fc2c400d750 tx=0x7fc2c400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:33:51.051 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:51.046+0000 7fc2ca7fc640 1 -- 172.21.15.83:0/591965286 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2c4017070 con 0x7fc2cc109df0 2024-09-21T01:33:51.051 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:51.046+0000 7fc2ca7fc640 1 -- 172.21.15.83:0/591965286 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc2c40054b0 con 0x7fc2cc109df0 2024-09-21T01:33:51.051 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:51.046+0000 7fc2ca7fc640 1 -- 172.21.15.83:0/591965286 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2c4004b90 con 0x7fc2cc109df0 2024-09-21T01:33:51.052 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:51.046+0000 7fc2d3a5b640 1 -- 172.21.15.83:0/591965286 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2cc1a8a00 con 0x7fc2cc109df0 2024-09-21T01:33:51.052 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:51.046+0000 7fc2d3a5b640 1 -- 172.21.15.83:0/591965286 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2cc1a8f40 con 0x7fc2cc109df0 2024-09-21T01:33:51.052 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:51.047+0000 7fc2d3a5b640 1 -- 172.21.15.83:0/591965286 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2cc103f70 con 0x7fc2cc109df0 2024-09-21T01:33:51.053 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:51.048+0000 7fc2ca7fc640 1 -- 172.21.15.83:0/591965286 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 19) ==== 154473+0+0 (secure 0 0 0) 0x7fc2c4004d30 con 0x7fc2cc109df0 2024-09-21T01:33:51.053 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:51.049+0000 7fc2ca7fc640 1 --2- 172.21.15.83:0/591965286 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fc2b40b64d0 0x7fc2b40b89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:33:51.053 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:51.049+0000 7fc2d17f7640 1 --2- 172.21.15.83:0/591965286 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fc2b40b64d0 0x7fc2b40b89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:33:51.053 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:51.049+0000 7fc2ca7fc640 1 -- 172.21.15.83:0/591965286 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fc2c40e5590 con 0x7fc2cc109df0 2024-09-21T01:33:51.053 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:51.050+0000 7fc2d17f7640 1 --2- 172.21.15.83:0/591965286 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fc2b40b64d0 0x7fc2b40b89e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fc2cc077160 tx=0x7fc2bc0094f0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:33:51.054 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:51.052+0000 7fc2ca7fc640 1 -- 172.21.15.83:0/591965286 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc2c40ada20 con 0x7fc2cc109df0 2024-09-21T01:33:51.240 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:33:51.238+0000 7fc2d3a5b640 1 -- 172.21.15.83:0/591965286 --> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi083:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7fc2cc063800 con 0x7fc2b40b64d0 2024-09-21T01:33:51.890 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:51 smithi083 ceph-mon[31370]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:33:51.890 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:51 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T01:33:51.890 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:51 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T01:33:51.890 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:51 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:33:52.017 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:51 smithi142 ceph-mon[34050]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:33:52.017 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:51 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T01:33:52.017 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:51 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T01:33:52.017 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:51 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:33:52.020 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:51 smithi119 ceph-mon[33693]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:33:52.020 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:51 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T01:33:52.020 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:51 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T01:33:52.020 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:51 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:33:53.032 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:52 smithi142 ceph-mon[34050]: from='client.14451 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi083:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:33:53.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:52 smithi083 ceph-mon[31370]: from='client.14451 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi083:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:33:53.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:52 smithi119 ceph-mon[33693]: from='client.14451 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi083:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:33:54.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:53 smithi083 ceph-mon[31370]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:33:54.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:53 smithi083 ceph-mon[31370]: from='client.? 172.21.15.83:0/1769033928' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "66947512-01ee-4bf0-87b0-98a168cf50dc"} : dispatch 2024-09-21T01:33:54.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:53 smithi083 ceph-mon[31370]: from='client.? 172.21.15.83:0/1769033928' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "66947512-01ee-4bf0-87b0-98a168cf50dc"}]': finished 2024-09-21T01:33:54.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:53 smithi083 ceph-mon[31370]: osdmap e6: 1 total, 0 up, 1 in 2024-09-21T01:33:54.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:53 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T01:33:54.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:53 smithi142 ceph-mon[34050]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:33:54.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:53 smithi142 ceph-mon[34050]: from='client.? 172.21.15.83:0/1769033928' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "66947512-01ee-4bf0-87b0-98a168cf50dc"} : dispatch 2024-09-21T01:33:54.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:53 smithi142 ceph-mon[34050]: from='client.? 172.21.15.83:0/1769033928' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "66947512-01ee-4bf0-87b0-98a168cf50dc"}]': finished 2024-09-21T01:33:54.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:53 smithi142 ceph-mon[34050]: osdmap e6: 1 total, 0 up, 1 in 2024-09-21T01:33:54.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:53 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T01:33:54.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:53 smithi119 ceph-mon[33693]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:33:54.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:53 smithi119 ceph-mon[33693]: from='client.? 172.21.15.83:0/1769033928' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "66947512-01ee-4bf0-87b0-98a168cf50dc"} : dispatch 2024-09-21T01:33:54.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:53 smithi119 ceph-mon[33693]: from='client.? 172.21.15.83:0/1769033928' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "66947512-01ee-4bf0-87b0-98a168cf50dc"}]': finished 2024-09-21T01:33:54.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:53 smithi119 ceph-mon[33693]: osdmap e6: 1 total, 0 up, 1 in 2024-09-21T01:33:54.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:53 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T01:33:55.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:54 smithi083 ceph-mon[31370]: from='client.? 172.21.15.83:0/3966667843' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T01:33:55.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:54 smithi142 ceph-mon[34050]: from='client.? 172.21.15.83:0/3966667843' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T01:33:55.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:54 smithi119 ceph-mon[33693]: from='client.? 172.21.15.83:0/3966667843' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T01:33:56.053 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:55 smithi083 ceph-mon[31370]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:33:56.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:55 smithi142 ceph-mon[34050]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:33:56.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:55 smithi119 ceph-mon[33693]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:33:58.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:57 smithi083 ceph-mon[31370]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:33:58.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:57 smithi142 ceph-mon[34050]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:33:58.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:57 smithi119 ceph-mon[33693]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:34:00.040 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:33:59 smithi083 ceph-mon[31370]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:34:00.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:33:59 smithi142 ceph-mon[34050]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:34:00.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:33:59 smithi119 ceph-mon[33693]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:34:02.023 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:34:01 smithi083 ceph-mon[31370]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:34:02.023 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:34:01 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-21T01:34:02.023 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:34:01 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:34:02.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:34:01 smithi142 ceph-mon[34050]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:34:02.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:34:01 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-21T01:34:02.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:34:01 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:34:02.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:34:01 smithi119 ceph-mon[33693]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:34:02.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:34:01 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-21T01:34:02.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:34:01 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:34:03.005 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:34:02 smithi083 ceph-mon[31370]: Deploying daemon osd.0 on smithi083 2024-09-21T01:34:03.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:34:02 smithi142 ceph-mon[34050]: Deploying daemon osd.0 on smithi083 2024-09-21T01:34:03.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:34:02 smithi119 ceph-mon[33693]: Deploying daemon osd.0 on smithi083 2024-09-21T01:34:04.053 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:34:03 smithi083 ceph-mon[31370]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:34:04.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:34:03 smithi142 ceph-mon[34050]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:34:04.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:34:03 smithi119 ceph-mon[33693]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:34:06.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:34:05 smithi083 ceph-mon[31370]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:34:06.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:34:05 smithi142 ceph-mon[34050]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:34:06.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:34:05 smithi119 ceph-mon[33693]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:34:08.053 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:34:07 smithi083 ceph-mon[31370]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:34:08.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:34:07 smithi142 ceph-mon[34050]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:34:08.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:34:07 smithi119 ceph-mon[33693]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:34:09.053 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:34:08 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:34:09.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:34:08 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:34:09.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:34:08 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:34:09.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:34:08 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:34:09.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:34:08 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:34:09.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:34:08 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:34:09.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:34:08 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:34:09.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:34:08 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:34:09.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:34:08 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:34:09.976 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:34:09 smithi083 ceph-mon[31370]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:34:10.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:34:09 smithi142 ceph-mon[34050]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:34:10.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:34:09 smithi119 ceph-mon[33693]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:34:11.411 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:34:11.411+0000 7fc2ca7fc640 1 -- 172.21.15.83:0/591965286 <== mgr.14223 v2:172.21.15.83:6800/1748483157 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fc2cc063800 con 0x7fc2b40b64d0 2024-09-21T01:34:11.412 INFO:teuthology.orchestra.run.smithi083.stdout:Created osd(s) 0 on host 'smithi083' 2024-09-21T01:34:11.415 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:34:11.415+0000 7fc2d3a5b640 1 -- 172.21.15.83:0/591965286 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fc2b40b64d0 msgr2=0x7fc2b40b89e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:34:11.415 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:34:11.415+0000 7fc2d3a5b640 1 --2- 172.21.15.83:0/591965286 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fc2b40b64d0 0x7fc2b40b89e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fc2cc077160 tx=0x7fc2bc0094f0 comp rx=0 tx=0).stop 2024-09-21T01:34:11.415 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:34:11.415+0000 7fc2d3a5b640 1 -- 172.21.15.83:0/591965286 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc2cc109df0 msgr2=0x7fc2cc076190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:34:11.415 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:34:11.415+0000 7fc2d3a5b640 1 --2- 172.21.15.83:0/591965286 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc2cc109df0 0x7fc2cc076190 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fc2c400d750 tx=0x7fc2c400dc10 comp rx=0 tx=0).stop 2024-09-21T01:34:11.416 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:34:11.415+0000 7fc2d3a5b640 1 -- 172.21.15.83:0/591965286 shutdown_connections 2024-09-21T01:34:11.416 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:34:11.415+0000 7fc2d3a5b640 1 --2- 172.21.15.83:0/591965286 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fc2b40b64d0 0x7fc2b40b89e0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:34:11.416 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:34:11.415+0000 7fc2d3a5b640 1 --2- 172.21.15.83:0/591965286 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc2cc109df0 0x7fc2cc076190 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:34:11.416 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:34:11.415+0000 7fc2d3a5b640 1 --2- 172.21.15.83:0/591965286 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc2cc1094a0 0x7fc2cc075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:34:11.416 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:34:11.415+0000 7fc2d3a5b640 1 --2- 172.21.15.83:0/591965286 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc2cc103b60 0x7fc2cc075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:34:11.416 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:34:11.415+0000 7fc2d3a5b640 1 -- 172.21.15.83:0/591965286 >> 172.21.15.83:0/591965286 conn(0x7fc2cc07b850 msgr2=0x7fc2cc1075e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:34:11.416 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:34:11.415+0000 7fc2d3a5b640 1 -- 172.21.15.83:0/591965286 shutdown_connections 2024-09-21T01:34:11.416 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:34:11.415+0000 7fc2d3a5b640 1 -- 172.21.15.83:0/591965286 wait complete. 2024-09-21T01:34:11.742 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:34:11 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:34:11.742 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:34:11 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:34:11.742 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:34:11 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:34:11.742 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:34:11 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:34:11.743 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:34:11 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:34:11.743 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:34:11 smithi083 ceph-mon[31370]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:34:11.743 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:34:11 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:34:11.743 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:34:11 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:34:11.743 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:34:11 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:34:11.965 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:34:11 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:34:11.965 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:34:11 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:34:11.965 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:34:11 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:34:11.965 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:34:11 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:34:11.965 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:34:11 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:34:11.965 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:34:11 smithi142 ceph-mon[34050]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:34:11.965 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:34:11 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:34:11.965 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:34:11 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:34:11.965 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:34:11 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:34:11.967 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:34:11 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:34:11.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:34:11 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:34:11.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:34:11 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:34:11.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:34:11 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:34:11.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:34:11 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:34:11.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:34:11 smithi119 ceph-mon[33693]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:34:11.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:34:11 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:34:11.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:34:11 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:34:11.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:34:11 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:34:12.024 DEBUG:teuthology.orchestra.run.smithi083:osd.0> sudo journalctl -f -n 0 -u ceph-f7697ecc-77b8-11ef-baf5-efdc52797490@osd.0.service 2024-09-21T01:34:12.026 INFO:tasks.cephadm:Deploying osd.1 on smithi119 with /dev/vg_nvme/lv_4... 2024-09-21T01:34:12.027 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_4 2024-09-21T01:34:12.263 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T01:34:13.971 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:34:13 smithi119 ceph-mon[33693]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:34:14.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:34:13 smithi083 ceph-mon[31370]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:34:14.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:34:13 smithi142 ceph-mon[34050]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:34:14.526 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-21T01:34:14.554 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi119:vg_nvme/lv_4 2024-09-21T01:34:14.615 INFO:journalctl@ceph.osd.0.smithi083.stdout:Sep 21 01:34:14 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-0[48573]: 2024-09-21T01:34:14.377+0000 7f01dd506640 -1 osd.0 0 log_to_monitors true 2024-09-21T01:34:14.824 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T01:34:15.040 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:34:14 smithi119 ceph-mon[33693]: from='osd.0 [v2:172.21.15.83:6802/3563457494,v1:172.21.15.83:6803/3563457494]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-21T01:34:15.040 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:34:14 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:34:15.040 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:34:14 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:34:15.040 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:34:14 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T01:34:15.040 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:34:14 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:34:15.040 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:34:14 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:34:15.040 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:34:14 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:34:15.040 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:34:14 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:34:15.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:34:14 smithi083 ceph-mon[31370]: from='osd.0 [v2:172.21.15.83:6802/3563457494,v1:172.21.15.83:6803/3563457494]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-21T01:34:15.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:34:14 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:34:15.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:34:14 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:34:15.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:34:14 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T01:34:15.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:34:14 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:34:15.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:34:14 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:34:15.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:34:14 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:34:15.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:34:14 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:34:15.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:34:14 smithi142 ceph-mon[34050]: from='osd.0 [v2:172.21.15.83:6802/3563457494,v1:172.21.15.83:6803/3563457494]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-21T01:34:15.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:34:14 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:34:15.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:34:14 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:34:15.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:34:14 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T01:34:15.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:34:14 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:34:15.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:34:14 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:34:15.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:34:14 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:34:15.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:34:14 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:34:15.330 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:34:15.330+0000 7f49e60cc640 1 -- 172.21.15.119:0/1313143075 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f49e01049b0 msgr2=0x7f49e0104dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:34:15.330 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:34:15.330+0000 7f49e60cc640 1 --2- 172.21.15.119:0/1313143075 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f49e01049b0 0x7f49e0104dc0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f49d0009900 tx=0x7f49d002a410 comp rx=0 tx=0).stop 2024-09-21T01:34:15.330 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:34:15.330+0000 7f49e60cc640 1 -- 172.21.15.119:0/1313143075 shutdown_connections 2024-09-21T01:34:15.330 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:34:15.330+0000 7f49e60cc640 1 --2- 172.21.15.119:0/1313143075 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f49e010de10 0x7f49e0110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:34:15.331 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:34:15.330+0000 7f49e60cc640 1 --2- 172.21.15.119:0/1313143075 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f49e0105300 0x7f49e010d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:34:15.331 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:34:15.330+0000 7f49e60cc640 1 --2- 172.21.15.119:0/1313143075 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f49e01049b0 0x7f49e0104dc0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:34:15.331 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:34:15.330+0000 7f49e60cc640 1 -- 172.21.15.119:0/1313143075 >> 172.21.15.119:0/1313143075 conn(0x7f49e0079730 msgr2=0x7f49e0079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:34:15.331 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:34:15.330+0000 7f49e60cc640 1 -- 172.21.15.119:0/1313143075 shutdown_connections 2024-09-21T01:34:15.331 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:34:15.330+0000 7f49e60cc640 1 -- 172.21.15.119:0/1313143075 wait complete. 2024-09-21T01:34:15.331 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:34:15.330+0000 7f49e60cc640 1 Processor -- start 2024-09-21T01:34:15.333 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:34:15.331+0000 7f49e60cc640 1 -- start start 2024-09-21T01:34:15.333 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:34:15.331+0000 7f49e60cc640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f49e01049b0 0x7f49e019a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:34:15.333 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:34:15.331+0000 7f49e60cc640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f49e0105300 0x7f49e019a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:34:15.333 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:34:15.331+0000 7f49e60cc640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f49e010de10 0x7f49e019fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:34:15.334 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:34:15.331+0000 7f49e60cc640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f49e0113970 con 0x7f49e0105300 2024-09-21T01:34:15.334 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:34:15.331+0000 7f49e60cc640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f49e01137f0 con 0x7f49e010de10 2024-09-21T01:34:15.334 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:34:15.331+0000 7f49e60cc640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f49e0113af0 con 0x7f49e01049b0 2024-09-21T01:34:15.334 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:34:15.331+0000 7f49dffff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f49e010de10 0x7f49e019fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:34:15.334 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:34:15.331+0000 7f49dffff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f49e010de10 0x7f49e019fc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:41864/0 (socket says 172.21.15.119:41864) 2024-09-21T01:34:15.334 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:34:15.331+0000 7f49dffff640 1 -- 172.21.15.119:0/3640150512 learned_addr learned my addr 172.21.15.119:0/3640150512 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-21T01:34:15.334 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:34:15.331+0000 7f49deffd640 1 --2- 172.21.15.119:0/3640150512 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f49e0105300 0x7f49e019a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:34:15.334 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:34:15.331+0000 7f49df7fe640 1 --2- 172.21.15.119:0/3640150512 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f49e01049b0 0x7f49e019a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:34:15.334 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:34:15.331+0000 7f49dffff640 1 -- 172.21.15.119:0/3640150512 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f49e01049b0 msgr2=0x7f49e019a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:34:15.334 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:34:15.331+0000 7f49dffff640 1 --2- 172.21.15.119:0/3640150512 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f49e01049b0 0x7f49e019a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:34:15.334 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:34:15.331+0000 7f49dffff640 1 -- 172.21.15.119:0/3640150512 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f49e0105300 msgr2=0x7f49e019a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:34:15.334 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:34:15.331+0000 7f49dffff640 1 --2- 172.21.15.119:0/3640150512 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f49e0105300 0x7f49e019a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:34:15.334 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:34:15.331+0000 7f49dffff640 1 -- 172.21.15.119:0/3640150512 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49e01a0290 con 0x7f49e010de10 2024-09-21T01:34:15.335 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:34:15.331+0000 7f49df7fe640 1 --2- 172.21.15.119:0/3640150512 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f49e01049b0 0x7f49e019a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:34:15.335 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:34:15.332+0000 7f49dffff640 1 --2- 172.21.15.119:0/3640150512 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f49e010de10 0x7f49e019fc20 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f49d800eaa0 tx=0x7f49d800eea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:34:15.335 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:34:15.332+0000 7f49dcff9640 1 -- 172.21.15.119:0/3640150512 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49d8004d20 con 0x7f49e010de10 2024-09-21T01:34:15.335 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:34:15.332+0000 7f49dcff9640 1 -- 172.21.15.119:0/3640150512 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f49d8005020 con 0x7f49e010de10 2024-09-21T01:34:15.335 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:34:15.332+0000 7f49e60cc640 1 -- 172.21.15.119:0/3640150512 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49e01a0580 con 0x7f49e010de10 2024-09-21T01:34:15.335 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:34:15.332+0000 7f49dcff9640 1 -- 172.21.15.119:0/3640150512 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49d80116d0 con 0x7f49e010de10 2024-09-21T01:34:15.335 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:34:15.332+0000 7f49e60cc640 1 -- 172.21.15.119:0/3640150512 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49e01a6da0 con 0x7f49e010de10 2024-09-21T01:34:15.335 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:34:15.333+0000 7f49e60cc640 1 -- 172.21.15.119:0/3640150512 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49e0104dc0 con 0x7f49e010de10 2024-09-21T01:34:15.336 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:34:15.335+0000 7f49dcff9640 1 -- 172.21.15.119:0/3640150512 <== mon.2 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 19) ==== 154473+0+0 (secure 0 0 0) 0x7f49d80051d0 con 0x7f49e010de10 2024-09-21T01:34:15.337 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:34:15.335+0000 7f49dcff9640 1 --2- 172.21.15.119:0/3640150512 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f49c80b6580 0x7f49c80b8a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:34:15.337 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:34:15.336+0000 7f49dcff9640 1 -- 172.21.15.119:0/3640150512 <== mon.2 v2:172.21.15.119:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1576+0+0 (secure 0 0 0) 0x7f49d80e5d00 con 0x7f49e010de10 2024-09-21T01:34:15.337 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:34:15.336+0000 7f49df7fe640 1 --2- 172.21.15.119:0/3640150512 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f49c80b6580 0x7f49c80b8a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:34:15.337 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:34:15.336+0000 7f49df7fe640 1 --2- 172.21.15.119:0/3640150512 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f49c80b6580 0x7f49c80b8a90 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f49d00057c0 tx=0x7f49d0000bc0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:34:15.343 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:34:15.343+0000 7f49dcff9640 1 -- 172.21.15.119:0/3640150512 <== mon.2 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f49d8016030 con 0x7f49e010de10 2024-09-21T01:34:15.535 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:34:15.536+0000 7f49e60cc640 1 -- 172.21.15.119:0/3640150512 --> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi119:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f49e0063800 con 0x7f49c80b6580 2024-09-21T01:34:16.022 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:34:15 smithi119 ceph-mon[33693]: Detected new or changed devices on smithi083 2024-09-21T01:34:16.022 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:34:15 smithi119 ceph-mon[33693]: Adjusting osd_memory_target on smithi083 to 17088M 2024-09-21T01:34:16.022 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:34:15 smithi119 ceph-mon[33693]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:34:16.022 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:34:15 smithi119 ceph-mon[33693]: from='osd.0 [v2:172.21.15.83:6802/3563457494,v1:172.21.15.83:6803/3563457494]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-21T01:34:16.022 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:34:15 smithi119 ceph-mon[33693]: osdmap e7: 1 total, 0 up, 1 in 2024-09-21T01:34:16.022 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:34:15 smithi119 ceph-mon[33693]: from='osd.0 [v2:172.21.15.83:6802/3563457494,v1:172.21.15.83:6803/3563457494]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi083", "root=default"]} : dispatch 2024-09-21T01:34:16.022 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:34:15 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T01:34:16.023 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:34:15 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T01:34:16.023 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:34:15 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T01:34:16.023 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:34:15 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:34:16.054 INFO:journalctl@ceph.osd.0.smithi083.stdout:Sep 21 01:34:15 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-0[48573]: 2024-09-21T01:34:15.760+0000 7f01d9488640 -1 osd.0 0 waiting for initial osdmap 2024-09-21T01:34:16.054 INFO:journalctl@ceph.osd.0.smithi083.stdout:Sep 21 01:34:15 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-0[48573]: 2024-09-21T01:34:15.767+0000 7f01d5286640 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T01:34:16.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:34:15 smithi083 ceph-mon[31370]: Detected new or changed devices on smithi083 2024-09-21T01:34:16.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:34:15 smithi083 ceph-mon[31370]: Adjusting osd_memory_target on smithi083 to 17088M 2024-09-21T01:34:16.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:34:15 smithi083 ceph-mon[31370]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:34:16.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:34:15 smithi083 ceph-mon[31370]: from='osd.0 [v2:172.21.15.83:6802/3563457494,v1:172.21.15.83:6803/3563457494]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-21T01:34:16.055 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:34:15 smithi083 ceph-mon[31370]: osdmap e7: 1 total, 0 up, 1 in 2024-09-21T01:34:16.055 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:34:15 smithi083 ceph-mon[31370]: from='osd.0 [v2:172.21.15.83:6802/3563457494,v1:172.21.15.83:6803/3563457494]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi083", "root=default"]} : dispatch 2024-09-21T01:34:16.055 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:34:15 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T01:34:16.055 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:34:15 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T01:34:16.055 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:34:15 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T01:34:16.055 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:34:15 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:34:16.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:34:15 smithi142 ceph-mon[34050]: Detected new or changed devices on smithi083 2024-09-21T01:34:16.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:34:15 smithi142 ceph-mon[34050]: Adjusting osd_memory_target on smithi083 to 17088M 2024-09-21T01:34:16.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:34:15 smithi142 ceph-mon[34050]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:34:16.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:34:15 smithi142 ceph-mon[34050]: from='osd.0 [v2:172.21.15.83:6802/3563457494,v1:172.21.15.83:6803/3563457494]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-21T01:34:16.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:34:15 smithi142 ceph-mon[34050]: osdmap e7: 1 total, 0 up, 1 in 2024-09-21T01:34:16.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:34:15 smithi142 ceph-mon[34050]: from='osd.0 [v2:172.21.15.83:6802/3563457494,v1:172.21.15.83:6803/3563457494]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi083", "root=default"]} : dispatch 2024-09-21T01:34:16.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:34:15 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T01:34:16.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:34:15 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T01:34:16.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:34:15 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T01:34:16.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:34:15 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:34:16.936 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:34:16 smithi119 ceph-mon[33693]: from='client.24281 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi119:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:34:16.936 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:34:16 smithi119 ceph-mon[33693]: from='osd.0 [v2:172.21.15.83:6802/3563457494,v1:172.21.15.83:6803/3563457494]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi083", "root=default"]}]': finished 2024-09-21T01:34:16.936 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:34:16 smithi119 ceph-mon[33693]: osdmap e8: 1 total, 0 up, 1 in 2024-09-21T01:34:16.936 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:34:16 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T01:34:16.936 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:34:16 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T01:34:17.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:34:16 smithi083 ceph-mon[31370]: from='client.24281 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi119:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:34:17.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:34:16 smithi083 ceph-mon[31370]: from='osd.0 [v2:172.21.15.83:6802/3563457494,v1:172.21.15.83:6803/3563457494]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi083", "root=default"]}]': finished 2024-09-21T01:34:17.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:34:16 smithi083 ceph-mon[31370]: osdmap e8: 1 total, 0 up, 1 in 2024-09-21T01:34:17.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:34:16 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T01:34:17.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:34:16 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T01:34:17.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:34:16 smithi142 ceph-mon[34050]: from='client.24281 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi119:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:34:17.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:34:16 smithi142 ceph-mon[34050]: from='osd.0 [v2:172.21.15.83:6802/3563457494,v1:172.21.15.83:6803/3563457494]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi083", "root=default"]}]': finished 2024-09-21T01:34:17.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:34:16 smithi142 ceph-mon[34050]: osdmap e8: 1 total, 0 up, 1 in 2024-09-21T01:34:17.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:34:16 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T01:34:17.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:34:16 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T01:34:18.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:34:17 smithi083 ceph-mon[31370]: purged_snaps scrub starts 2024-09-21T01:34:18.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:34:17 smithi083 ceph-mon[31370]: purged_snaps scrub ok 2024-09-21T01:34:18.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:34:17 smithi083 ceph-mon[31370]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:34:18.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:34:17 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T01:34:18.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:34:17 smithi083 ceph-mon[31370]: osd.0 [v2:172.21.15.83:6802/3563457494,v1:172.21.15.83:6803/3563457494] boot 2024-09-21T01:34:18.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:34:17 smithi083 ceph-mon[31370]: osdmap e9: 1 total, 1 up, 1 in 2024-09-21T01:34:18.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:34:17 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T01:34:18.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:34:17 smithi083 ceph-mon[31370]: from='client.? 172.21.15.119:0/3121787679' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "f7818a08-86a5-412d-a164-cfeb18f8650a"} : dispatch 2024-09-21T01:34:18.055 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:34:17 smithi083 ceph-mon[31370]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "f7818a08-86a5-412d-a164-cfeb18f8650a"} : dispatch 2024-09-21T01:34:18.055 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:34:17 smithi083 ceph-mon[31370]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f7818a08-86a5-412d-a164-cfeb18f8650a"}]': finished 2024-09-21T01:34:18.055 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:34:17 smithi083 ceph-mon[31370]: osdmap e10: 2 total, 1 up, 2 in 2024-09-21T01:34:18.055 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:34:17 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T01:34:18.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:34:17 smithi142 ceph-mon[34050]: purged_snaps scrub starts 2024-09-21T01:34:18.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:34:17 smithi142 ceph-mon[34050]: purged_snaps scrub ok 2024-09-21T01:34:18.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:34:17 smithi142 ceph-mon[34050]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:34:18.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:34:17 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T01:34:18.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:34:17 smithi142 ceph-mon[34050]: osd.0 [v2:172.21.15.83:6802/3563457494,v1:172.21.15.83:6803/3563457494] boot 2024-09-21T01:34:18.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:34:17 smithi142 ceph-mon[34050]: osdmap e9: 1 total, 1 up, 1 in 2024-09-21T01:34:18.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:34:17 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T01:34:18.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:34:17 smithi142 ceph-mon[34050]: from='client.? 172.21.15.119:0/3121787679' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "f7818a08-86a5-412d-a164-cfeb18f8650a"} : dispatch 2024-09-21T01:34:18.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:34:17 smithi142 ceph-mon[34050]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "f7818a08-86a5-412d-a164-cfeb18f8650a"} : dispatch 2024-09-21T01:34:18.216 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:34:17 smithi142 ceph-mon[34050]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f7818a08-86a5-412d-a164-cfeb18f8650a"}]': finished 2024-09-21T01:34:18.216 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:34:17 smithi142 ceph-mon[34050]: osdmap e10: 2 total, 1 up, 2 in 2024-09-21T01:34:18.216 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:34:17 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T01:34:18.216 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:34:17 smithi119 ceph-mon[33693]: purged_snaps scrub starts 2024-09-21T01:34:18.216 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:34:17 smithi119 ceph-mon[33693]: purged_snaps scrub ok 2024-09-21T01:34:18.216 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:34:17 smithi119 ceph-mon[33693]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T01:34:18.216 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:34:17 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T01:34:18.216 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:34:17 smithi119 ceph-mon[33693]: osd.0 [v2:172.21.15.83:6802/3563457494,v1:172.21.15.83:6803/3563457494] boot 2024-09-21T01:34:18.216 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:34:17 smithi119 ceph-mon[33693]: osdmap e9: 1 total, 1 up, 1 in 2024-09-21T01:34:18.216 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:34:17 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T01:34:18.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:34:17 smithi119 ceph-mon[33693]: from='client.? 172.21.15.119:0/3121787679' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "f7818a08-86a5-412d-a164-cfeb18f8650a"} : dispatch 2024-09-21T01:34:18.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:34:17 smithi119 ceph-mon[33693]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "f7818a08-86a5-412d-a164-cfeb18f8650a"} : dispatch 2024-09-21T01:34:18.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:34:17 smithi119 ceph-mon[33693]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f7818a08-86a5-412d-a164-cfeb18f8650a"}]': finished 2024-09-21T01:34:18.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:34:17 smithi119 ceph-mon[33693]: osdmap e10: 2 total, 1 up, 2 in 2024-09-21T01:34:18.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:34:17 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T01:34:19.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:34:18 smithi083 ceph-mon[31370]: from='client.? 172.21.15.119:0/1229607082' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T01:34:19.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:34:18 smithi142 ceph-mon[34050]: from='client.? 172.21.15.119:0/1229607082' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T01:34:19.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:34:18 smithi119 ceph-mon[33693]: from='client.? 172.21.15.119:0/1229607082' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T01:34:20.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:34:19 smithi083 ceph-mon[31370]: pgmap v33: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T01:34:20.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:34:19 smithi142 ceph-mon[34050]: pgmap v33: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T01:34:20.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:34:19 smithi119 ceph-mon[33693]: pgmap v33: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T01:34:22.030 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:34:21 smithi119 ceph-mon[33693]: pgmap v34: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T01:34:22.053 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:34:21 smithi083 ceph-mon[31370]: pgmap v34: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T01:34:22.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:34:21 smithi142 ceph-mon[34050]: pgmap v34: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T01:34:24.053 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:34:23 smithi083 ceph-mon[31370]: pgmap v35: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T01:34:24.076 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:34:23 smithi119 ceph-mon[33693]: pgmap v35: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T01:34:24.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:34:23 smithi142 ceph-mon[34050]: pgmap v35: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T01:34:25.872 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:34:25 smithi119 ceph-mon[33693]: pgmap v36: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T01:34:26.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:34:25 smithi083 ceph-mon[31370]: pgmap v36: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T01:34:26.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:34:25 smithi142 ceph-mon[34050]: pgmap v36: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T01:34:27.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:34:26 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-21T01:34:27.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:34:26 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:34:27.160 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:34:26 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-21T01:34:27.160 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:34:26 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:34:27.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:34:26 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-21T01:34:27.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:34:26 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:34:27.965 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:34:27 smithi142 ceph-mon[34050]: Deploying daemon osd.1 on smithi119 2024-09-21T01:34:27.965 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:34:27 smithi142 ceph-mon[34050]: pgmap v37: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T01:34:28.053 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:34:27 smithi083 ceph-mon[31370]: Deploying daemon osd.1 on smithi119 2024-09-21T01:34:28.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:34:27 smithi083 ceph-mon[31370]: pgmap v37: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T01:34:28.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:34:27 smithi119 ceph-mon[33693]: Deploying daemon osd.1 on smithi119 2024-09-21T01:34:28.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:34:27 smithi119 ceph-mon[33693]: pgmap v37: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T01:34:30.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:34:29 smithi083 ceph-mon[31370]: pgmap v38: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T01:34:30.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:34:29 smithi142 ceph-mon[34050]: pgmap v38: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T01:34:30.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:34:29 smithi119 ceph-mon[33693]: pgmap v38: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T01:34:32.020 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:34:31 smithi119 ceph-mon[33693]: pgmap v39: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T01:34:32.053 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:34:31 smithi083 ceph-mon[31370]: pgmap v39: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T01:34:32.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:34:31 smithi142 ceph-mon[34050]: pgmap v39: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T01:34:33.053 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:34:32 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:34:33.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:34:32 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:34:33.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:34:32 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:34:33.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:34:32 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:34:33.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:34:32 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:34:33.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:34:32 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:34:33.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:34:32 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:34:33.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:34:32 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:34:33.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:34:32 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:34:33.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:34:33 smithi119 ceph-mon[33693]: pgmap v40: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T01:34:34.053 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:34:33 smithi083 ceph-mon[31370]: pgmap v40: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T01:34:34.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:34:33 smithi142 ceph-mon[34050]: pgmap v40: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T01:34:35.665 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:34:35 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:34:35.666 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:34:35 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:34:35.666 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:34:35 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:34:35.666 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:34:35 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:34:35.666 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:34:35 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:34:35.666 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:34:35 smithi119 ceph-mon[33693]: pgmap v41: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T01:34:35.714 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:34:35 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:34:35.714 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:34:35 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:34:35.715 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:34:35 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:34:35.715 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:34:35 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:34:35.715 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:34:35 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:34:35.715 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:34:35 smithi142 ceph-mon[34050]: pgmap v41: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T01:34:35.804 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:34:35 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:34:35.804 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:34:35 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:34:35.804 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:34:35 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:34:35.804 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:34:35 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:34:35.804 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:34:35 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:34:35.804 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:34:35 smithi083 ceph-mon[31370]: pgmap v41: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T01:34:36.344 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:34:36.343+0000 7f49dcff9640 1 -- 172.21.15.119:0/3640150512 <== mgr.14223 v2:172.21.15.83:6800/1748483157 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f49e0063800 con 0x7f49c80b6580 2024-09-21T01:34:36.344 INFO:teuthology.orchestra.run.smithi119.stdout:Created osd(s) 1 on host 'smithi119' 2024-09-21T01:34:36.346 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:34:36.345+0000 7f49e60cc640 1 -- 172.21.15.119:0/3640150512 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f49c80b6580 msgr2=0x7f49c80b8a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:34:36.346 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:34:36.345+0000 7f49e60cc640 1 --2- 172.21.15.119:0/3640150512 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f49c80b6580 0x7f49c80b8a90 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f49d00057c0 tx=0x7f49d0000bc0 comp rx=0 tx=0).stop 2024-09-21T01:34:36.346 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:34:36.345+0000 7f49e60cc640 1 -- 172.21.15.119:0/3640150512 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f49e010de10 msgr2=0x7f49e019fc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:34:36.346 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:34:36.345+0000 7f49e60cc640 1 --2- 172.21.15.119:0/3640150512 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f49e010de10 0x7f49e019fc20 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f49d800eaa0 tx=0x7f49d800eea0 comp rx=0 tx=0).stop 2024-09-21T01:34:36.346 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:34:36.345+0000 7f49e60cc640 1 -- 172.21.15.119:0/3640150512 shutdown_connections 2024-09-21T01:34:36.347 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:34:36.345+0000 7f49e60cc640 1 --2- 172.21.15.119:0/3640150512 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f49c80b6580 0x7f49c80b8a90 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:34:36.347 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:34:36.345+0000 7f49e60cc640 1 --2- 172.21.15.119:0/3640150512 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f49e010de10 0x7f49e019fc20 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:34:36.347 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:34:36.345+0000 7f49e60cc640 1 --2- 172.21.15.119:0/3640150512 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f49e0105300 0x7f49e019a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:34:36.347 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:34:36.345+0000 7f49e60cc640 1 --2- 172.21.15.119:0/3640150512 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f49e01049b0 0x7f49e019a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:34:36.347 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:34:36.345+0000 7f49e60cc640 1 -- 172.21.15.119:0/3640150512 >> 172.21.15.119:0/3640150512 conn(0x7f49e0079730 msgr2=0x7f49e0100880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:34:36.347 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:34:36.345+0000 7f49e60cc640 1 -- 172.21.15.119:0/3640150512 shutdown_connections 2024-09-21T01:34:36.347 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:34:36.345+0000 7f49e60cc640 1 -- 172.21.15.119:0/3640150512 wait complete. 2024-09-21T01:34:36.664 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:34:36 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:34:36.664 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:34:36 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:34:36.664 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:34:36 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:34:36.714 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:34:36 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:34:36.714 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:34:36 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:34:36.714 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:34:36 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:34:36.803 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:34:36 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:34:36.804 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:34:36 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:34:36.804 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:34:36 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:34:36.966 DEBUG:teuthology.orchestra.run.smithi119:osd.1> sudo journalctl -f -n 0 -u ceph-f7697ecc-77b8-11ef-baf5-efdc52797490@osd.1.service 2024-09-21T01:34:36.968 INFO:tasks.cephadm:Deploying osd.2 on smithi142 with /dev/vg_nvme/lv_4... 2024-09-21T01:34:36.968 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_4 2024-09-21T01:34:37.217 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T01:34:37.591 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:34:37 smithi142 ceph-mon[34050]: pgmap v42: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T01:34:37.717 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:34:37 smithi119 ceph-mon[33693]: pgmap v42: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T01:34:37.803 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:34:37 smithi083 ceph-mon[31370]: pgmap v42: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T01:34:38.467 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:34:38 smithi119 ceph-mon[33693]: from='osd.1 [v2:172.21.15.119:6800/2066870220,v1:172.21.15.119:6801/2066870220]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T01:34:38.468 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:34:38 smithi119 ceph-mon[33693]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T01:34:38.468 INFO:journalctl@ceph.osd.1.smithi119.stdout:Sep 21 01:34:38 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-1[38376]: 2024-09-21T01:34:38.210+0000 7f231f265640 -1 osd.1 0 log_to_monitors true 2024-09-21T01:34:38.681 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:34:38 smithi142 ceph-mon[34050]: from='osd.1 [v2:172.21.15.119:6800/2066870220,v1:172.21.15.119:6801/2066870220]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T01:34:38.681 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:34:38 smithi142 ceph-mon[34050]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T01:34:38.803 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:34:38 smithi083 ceph-mon[31370]: from='osd.1 [v2:172.21.15.119:6800/2066870220,v1:172.21.15.119:6801/2066870220]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T01:34:38.804 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:34:38 smithi083 ceph-mon[31370]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T01:34:39.312 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-21T01:34:39.338 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi142:vg_nvme/lv_4 2024-09-21T01:34:39.536 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:34:39 smithi119 ceph-mon[33693]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-21T01:34:39.536 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:34:39 smithi119 ceph-mon[33693]: from='osd.1 [v2:172.21.15.119:6800/2066870220,v1:172.21.15.119:6801/2066870220]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi119", "root=default"]} : dispatch 2024-09-21T01:34:39.537 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:34:39 smithi119 ceph-mon[33693]: osdmap e11: 2 total, 1 up, 2 in 2024-09-21T01:34:39.537 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:34:39 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T01:34:39.537 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:34:39 smithi119 ceph-mon[33693]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi119", "root=default"]} : dispatch 2024-09-21T01:34:39.537 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:34:39 smithi119 ceph-mon[33693]: pgmap v44: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T01:34:39.593 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T01:34:39.623 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:34:39 smithi142 ceph-mon[34050]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-21T01:34:39.623 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:34:39 smithi142 ceph-mon[34050]: from='osd.1 [v2:172.21.15.119:6800/2066870220,v1:172.21.15.119:6801/2066870220]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi119", "root=default"]} : dispatch 2024-09-21T01:34:39.623 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:34:39 smithi142 ceph-mon[34050]: osdmap e11: 2 total, 1 up, 2 in 2024-09-21T01:34:39.623 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:34:39 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T01:34:39.623 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:34:39 smithi142 ceph-mon[34050]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi119", "root=default"]} : dispatch 2024-09-21T01:34:39.624 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:34:39 smithi142 ceph-mon[34050]: pgmap v44: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T01:34:39.803 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:34:39 smithi083 ceph-mon[31370]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-21T01:34:39.804 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:34:39 smithi083 ceph-mon[31370]: from='osd.1 [v2:172.21.15.119:6800/2066870220,v1:172.21.15.119:6801/2066870220]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi119", "root=default"]} : dispatch 2024-09-21T01:34:39.804 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:34:39 smithi083 ceph-mon[31370]: osdmap e11: 2 total, 1 up, 2 in 2024-09-21T01:34:39.804 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:34:39 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T01:34:39.804 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:34:39 smithi083 ceph-mon[31370]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi119", "root=default"]} : dispatch 2024-09-21T01:34:39.804 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:34:39 smithi083 ceph-mon[31370]: pgmap v44: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T01:34:40.034 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:34:40.033+0000 7f957fe66640 1 -- 172.21.15.142:0/1182036408 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9578102a60 msgr2=0x7f9578102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:34:40.034 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:34:40.033+0000 7f957fe66640 1 --2- 172.21.15.142:0/1182036408 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9578102a60 0x7f9578102e70 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f9574009900 tx=0x7f957402a410 comp rx=0 tx=0).stop 2024-09-21T01:34:40.034 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:34:40.033+0000 7f957fe66640 1 -- 172.21.15.142:0/1182036408 shutdown_connections 2024-09-21T01:34:40.035 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:34:40.033+0000 7f957fe66640 1 --2- 172.21.15.142:0/1182036408 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9578108cf0 0x7f957810f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:34:40.035 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:34:40.033+0000 7f957fe66640 1 --2- 172.21.15.142:0/1182036408 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f95781083a0 0x7f95781087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:34:40.035 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:34:40.033+0000 7f957fe66640 1 --2- 172.21.15.142:0/1182036408 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9578102a60 0x7f9578102e70 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:34:40.035 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:34:40.033+0000 7f957fe66640 1 -- 172.21.15.142:0/1182036408 >> 172.21.15.142:0/1182036408 conn(0x7f9578079730 msgr2=0x7f9578079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:34:40.035 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:34:40.033+0000 7f957fe66640 1 -- 172.21.15.142:0/1182036408 shutdown_connections 2024-09-21T01:34:40.035 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:34:40.033+0000 7f957fe66640 1 -- 172.21.15.142:0/1182036408 wait complete. 2024-09-21T01:34:40.035 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:34:40.034+0000 7f957fe66640 1 Processor -- start 2024-09-21T01:34:40.035 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:34:40.034+0000 7f957fe66640 1 -- start start 2024-09-21T01:34:40.037 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:34:40.034+0000 7f957fe66640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9578102a60 0x7f95781992a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:34:40.037 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:34:40.034+0000 7f957fe66640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f95781083a0 0x7f9578199840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:34:40.037 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:34:40.034+0000 7f957fe66640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9578108cf0 0x7f957819eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:34:40.037 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:34:40.034+0000 7f957fe66640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f9578112810 con 0x7f95781083a0 2024-09-21T01:34:40.037 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:34:40.034+0000 7f957fe66640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f9578112690 con 0x7f9578108cf0 2024-09-21T01:34:40.037 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:34:40.034+0000 7f957fe66640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f9578112990 con 0x7f9578102a60 2024-09-21T01:34:40.037 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:34:40.034+0000 7f957dc02640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9578102a60 0x7f95781992a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:34:40.038 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:34:40.034+0000 7f957dc02640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9578102a60 0x7f95781992a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:44666/0 (socket says 172.21.15.142:44666) 2024-09-21T01:34:40.038 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:34:40.034+0000 7f957dc02640 1 -- 172.21.15.142:0/2914235236 learned_addr learned my addr 172.21.15.142:0/2914235236 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-21T01:34:40.038 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:34:40.035+0000 7f957e403640 1 --2- 172.21.15.142:0/2914235236 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9578108cf0 0x7f957819eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:34:40.038 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:34:40.035+0000 7f957d401640 1 --2- 172.21.15.142:0/2914235236 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f95781083a0 0x7f9578199840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:34:40.038 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:34:40.035+0000 7f957dc02640 1 -- 172.21.15.142:0/2914235236 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9578108cf0 msgr2=0x7f957819eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:34:40.038 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:34:40.035+0000 7f957dc02640 1 --2- 172.21.15.142:0/2914235236 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9578108cf0 0x7f957819eae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:34:40.038 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:34:40.035+0000 7f957dc02640 1 -- 172.21.15.142:0/2914235236 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f95781083a0 msgr2=0x7f9578199840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:34:40.038 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:34:40.035+0000 7f957dc02640 1 --2- 172.21.15.142:0/2914235236 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f95781083a0 0x7f9578199840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:34:40.038 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:34:40.035+0000 7f957dc02640 1 -- 172.21.15.142:0/2914235236 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f957819f210 con 0x7f9578102a60 2024-09-21T01:34:40.038 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:34:40.035+0000 7f957d401640 1 --2- 172.21.15.142:0/2914235236 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f95781083a0 0x7f9578199840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:34:40.038 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:34:40.035+0000 7f957dc02640 1 --2- 172.21.15.142:0/2914235236 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9578102a60 0x7f95781992a0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f9574009230 tx=0x7f9574004270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:34:40.039 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:34:40.035+0000 7f956effd640 1 -- 172.21.15.142:0/2914235236 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9574046070 con 0x7f9578102a60 2024-09-21T01:34:40.039 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:34:40.035+0000 7f956effd640 1 -- 172.21.15.142:0/2914235236 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9574003a80 con 0x7f9578102a60 2024-09-21T01:34:40.039 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:34:40.035+0000 7f957fe66640 1 -- 172.21.15.142:0/2914235236 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f957819f4a0 con 0x7f9578102a60 2024-09-21T01:34:40.039 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:34:40.035+0000 7f956effd640 1 -- 172.21.15.142:0/2914235236 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9574035050 con 0x7f9578102a60 2024-09-21T01:34:40.039 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:34:40.035+0000 7f957fe66640 1 -- 172.21.15.142:0/2914235236 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f957806ae60 con 0x7f9578102a60 2024-09-21T01:34:40.039 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:34:40.036+0000 7f957fe66640 1 -- 172.21.15.142:0/2914235236 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9578103ce0 con 0x7f9578102a60 2024-09-21T01:34:40.040 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:34:40.038+0000 7f956effd640 1 -- 172.21.15.142:0/2914235236 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 19) ==== 154473+0+0 (secure 0 0 0) 0x7f9574049070 con 0x7f9578102a60 2024-09-21T01:34:40.040 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:34:40.039+0000 7f956effd640 1 --2- 172.21.15.142:0/2914235236 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f95640b6550 0x7f95640b8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:34:40.040 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:34:40.039+0000 7f956effd640 1 -- 172.21.15.142:0/2914235236 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 2244+0+0 (secure 0 0 0) 0x7f9574107a10 con 0x7f9578102a60 2024-09-21T01:34:40.040 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:34:40.039+0000 7f957d401640 1 --2- 172.21.15.142:0/2914235236 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f95640b6550 0x7f95640b8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:34:40.040 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:34:40.040+0000 7f957d401640 1 --2- 172.21.15.142:0/2914235236 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f95640b6550 0x7f95640b8a60 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f95680058c0 tx=0x7f9568005850 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:34:40.043 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:34:40.042+0000 7f956effd640 1 -- 172.21.15.142:0/2914235236 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f9574050020 con 0x7f9578102a60 2024-09-21T01:34:40.218 INFO:journalctl@ceph.osd.1.smithi119.stdout:Sep 21 01:34:39 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-1[38376]: 2024-09-21T01:34:39.839+0000 7f231b1e7640 -1 osd.1 0 waiting for initial osdmap 2024-09-21T01:34:40.218 INFO:journalctl@ceph.osd.1.smithi119.stdout:Sep 21 01:34:39 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-1[38376]: 2024-09-21T01:34:39.846+0000 7f2312fdd640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T01:34:40.239 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:34:40.238+0000 7f957fe66640 1 -- 172.21.15.142:0/2914235236 --> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi142:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f957806b900 con 0x7f95640b6550 2024-09-21T01:34:40.613 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:34:40 smithi142 ceph-mon[34050]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]': finished 2024-09-21T01:34:40.613 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:34:40 smithi142 ceph-mon[34050]: osdmap e12: 2 total, 1 up, 2 in 2024-09-21T01:34:40.613 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:34:40 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T01:34:40.613 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:34:40 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T01:34:40.613 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:34:40 smithi142 ceph-mon[34050]: Detected new or changed devices on smithi119 2024-09-21T01:34:40.614 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:34:40 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:34:40.614 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:34:40 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:34:40.614 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:34:40 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T01:34:40.614 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:34:40 smithi142 ceph-mon[34050]: Adjusting osd_memory_target on smithi119 to 17088M 2024-09-21T01:34:40.614 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:34:40 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:34:40.614 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:34:40 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:34:40.614 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:34:40 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:34:40.614 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:34:40 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:34:40.614 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:34:40 smithi142 ceph-mon[34050]: from='osd.1 ' entity='osd.1' 2024-09-21T01:34:40.614 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:34:40 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T01:34:40.614 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:34:40 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T01:34:40.614 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:34:40 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:34:40.718 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:34:40 smithi119 ceph-mon[33693]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]': finished 2024-09-21T01:34:40.718 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:34:40 smithi119 ceph-mon[33693]: osdmap e12: 2 total, 1 up, 2 in 2024-09-21T01:34:40.718 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:34:40 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T01:34:40.718 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:34:40 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T01:34:40.718 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:34:40 smithi119 ceph-mon[33693]: Detected new or changed devices on smithi119 2024-09-21T01:34:40.718 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:34:40 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:34:40.718 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:34:40 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:34:40.718 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:34:40 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T01:34:40.719 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:34:40 smithi119 ceph-mon[33693]: Adjusting osd_memory_target on smithi119 to 17088M 2024-09-21T01:34:40.719 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:34:40 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:34:40.719 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:34:40 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:34:40.719 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:34:40 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:34:40.719 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:34:40 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:34:40.719 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:34:40 smithi119 ceph-mon[33693]: from='osd.1 ' entity='osd.1' 2024-09-21T01:34:40.719 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:34:40 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T01:34:40.719 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:34:40 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T01:34:40.719 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:34:40 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:34:40.804 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:34:40 smithi083 ceph-mon[31370]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]': finished 2024-09-21T01:34:40.804 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:34:40 smithi083 ceph-mon[31370]: osdmap e12: 2 total, 1 up, 2 in 2024-09-21T01:34:40.804 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:34:40 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T01:34:40.804 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:34:40 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T01:34:40.804 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:34:40 smithi083 ceph-mon[31370]: Detected new or changed devices on smithi119 2024-09-21T01:34:40.804 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:34:40 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:34:40.804 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:34:40 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:34:40.804 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:34:40 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T01:34:40.804 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:34:40 smithi083 ceph-mon[31370]: Adjusting osd_memory_target on smithi119 to 17088M 2024-09-21T01:34:40.804 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:34:40 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:34:40.804 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:34:40 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:34:40.804 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:34:40 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:34:40.804 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:34:40 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:34:40.805 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:34:40 smithi083 ceph-mon[31370]: from='osd.1 ' entity='osd.1' 2024-09-21T01:34:40.805 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:34:40 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T01:34:40.805 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:34:40 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T01:34:40.805 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:34:40 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:34:41.705 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:34:41 smithi142 ceph-mon[34050]: purged_snaps scrub starts 2024-09-21T01:34:41.705 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:34:41 smithi142 ceph-mon[34050]: purged_snaps scrub ok 2024-09-21T01:34:41.705 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:34:41 smithi142 ceph-mon[34050]: from='client.24319 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi142:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:34:41.705 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:34:41 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T01:34:41.705 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:34:41 smithi142 ceph-mon[34050]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T01:34:41.705 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:34:41 smithi142 ceph-mon[34050]: osd.1 [v2:172.21.15.119:6800/2066870220,v1:172.21.15.119:6801/2066870220] boot 2024-09-21T01:34:41.705 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:34:41 smithi142 ceph-mon[34050]: osdmap e13: 2 total, 2 up, 2 in 2024-09-21T01:34:41.705 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:34:41 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T01:34:41.717 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:34:41 smithi119 ceph-mon[33693]: purged_snaps scrub starts 2024-09-21T01:34:41.717 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:34:41 smithi119 ceph-mon[33693]: purged_snaps scrub ok 2024-09-21T01:34:41.717 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:34:41 smithi119 ceph-mon[33693]: from='client.24319 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi142:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:34:41.717 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:34:41 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T01:34:41.718 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:34:41 smithi119 ceph-mon[33693]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T01:34:41.718 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:34:41 smithi119 ceph-mon[33693]: osd.1 [v2:172.21.15.119:6800/2066870220,v1:172.21.15.119:6801/2066870220] boot 2024-09-21T01:34:41.718 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:34:41 smithi119 ceph-mon[33693]: osdmap e13: 2 total, 2 up, 2 in 2024-09-21T01:34:41.718 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:34:41 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T01:34:41.804 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:34:41 smithi083 ceph-mon[31370]: purged_snaps scrub starts 2024-09-21T01:34:41.804 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:34:41 smithi083 ceph-mon[31370]: purged_snaps scrub ok 2024-09-21T01:34:41.804 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:34:41 smithi083 ceph-mon[31370]: from='client.24319 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi142:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:34:41.804 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:34:41 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T01:34:41.804 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:34:41 smithi083 ceph-mon[31370]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T01:34:41.804 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:34:41 smithi083 ceph-mon[31370]: osd.1 [v2:172.21.15.119:6800/2066870220,v1:172.21.15.119:6801/2066870220] boot 2024-09-21T01:34:41.804 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:34:41 smithi083 ceph-mon[31370]: osdmap e13: 2 total, 2 up, 2 in 2024-09-21T01:34:41.804 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:34:41 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T01:34:43.096 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:34:42 smithi142 ceph-mon[34050]: osdmap e14: 2 total, 2 up, 2 in 2024-09-21T01:34:43.097 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:34:42 smithi142 ceph-mon[34050]: from='client.? 172.21.15.142:0/2652752028' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "0d1a3870-c67a-4783-85f9-be2bb36f7722"} : dispatch 2024-09-21T01:34:43.097 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:34:42 smithi142 ceph-mon[34050]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "0d1a3870-c67a-4783-85f9-be2bb36f7722"} : dispatch 2024-09-21T01:34:43.097 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:34:42 smithi142 ceph-mon[34050]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0d1a3870-c67a-4783-85f9-be2bb36f7722"}]': finished 2024-09-21T01:34:43.097 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:34:42 smithi142 ceph-mon[34050]: osdmap e15: 3 total, 2 up, 3 in 2024-09-21T01:34:43.097 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:34:42 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T01:34:43.097 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:34:42 smithi142 ceph-mon[34050]: pgmap v50: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T01:34:43.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:34:42 smithi119 ceph-mon[33693]: osdmap e14: 2 total, 2 up, 2 in 2024-09-21T01:34:43.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:34:42 smithi119 ceph-mon[33693]: from='client.? 172.21.15.142:0/2652752028' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "0d1a3870-c67a-4783-85f9-be2bb36f7722"} : dispatch 2024-09-21T01:34:43.219 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:34:42 smithi119 ceph-mon[33693]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "0d1a3870-c67a-4783-85f9-be2bb36f7722"} : dispatch 2024-09-21T01:34:43.219 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:34:42 smithi119 ceph-mon[33693]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0d1a3870-c67a-4783-85f9-be2bb36f7722"}]': finished 2024-09-21T01:34:43.219 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:34:42 smithi119 ceph-mon[33693]: osdmap e15: 3 total, 2 up, 3 in 2024-09-21T01:34:43.219 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:34:42 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T01:34:43.219 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:34:42 smithi119 ceph-mon[33693]: pgmap v50: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T01:34:43.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:34:42 smithi083 ceph-mon[31370]: osdmap e14: 2 total, 2 up, 2 in 2024-09-21T01:34:43.305 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:34:42 smithi083 ceph-mon[31370]: from='client.? 172.21.15.142:0/2652752028' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "0d1a3870-c67a-4783-85f9-be2bb36f7722"} : dispatch 2024-09-21T01:34:43.305 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:34:42 smithi083 ceph-mon[31370]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "0d1a3870-c67a-4783-85f9-be2bb36f7722"} : dispatch 2024-09-21T01:34:43.306 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:34:42 smithi083 ceph-mon[31370]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0d1a3870-c67a-4783-85f9-be2bb36f7722"}]': finished 2024-09-21T01:34:43.306 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:34:42 smithi083 ceph-mon[31370]: osdmap e15: 3 total, 2 up, 3 in 2024-09-21T01:34:43.306 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:34:42 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T01:34:43.307 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:34:42 smithi083 ceph-mon[31370]: pgmap v50: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T01:34:44.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:34:43 smithi142 ceph-mon[34050]: from='client.? 172.21.15.142:0/2667351672' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T01:34:44.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:34:43 smithi119 ceph-mon[33693]: from='client.? 172.21.15.142:0/2667351672' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T01:34:44.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:34:43 smithi083 ceph-mon[31370]: from='client.? 172.21.15.142:0/2667351672' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T01:34:45.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:34:44 smithi142 ceph-mon[34050]: pgmap v51: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T01:34:45.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:34:44 smithi119 ceph-mon[33693]: pgmap v51: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T01:34:45.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:34:44 smithi083 ceph-mon[31370]: pgmap v51: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T01:34:48.051 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:34:47 smithi142 ceph-mon[34050]: pgmap v52: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T01:34:48.053 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:34:47 smithi083 ceph-mon[31370]: pgmap v52: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T01:34:48.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:34:47 smithi119 ceph-mon[33693]: pgmap v52: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T01:34:49.964 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:34:49 smithi142 ceph-mon[34050]: pgmap v53: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T01:34:50.053 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:34:49 smithi083 ceph-mon[31370]: pgmap v53: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T01:34:50.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:34:49 smithi119 ceph-mon[33693]: pgmap v53: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T01:34:50.964 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:34:50 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-21T01:34:50.964 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:34:50 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:34:51.053 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:34:50 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-21T01:34:51.053 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:34:50 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:34:51.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:34:50 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-21T01:34:51.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:34:50 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:34:52.053 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:34:51 smithi083 ceph-mon[31370]: Deploying daemon osd.2 on smithi142 2024-09-21T01:34:52.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:34:51 smithi083 ceph-mon[31370]: pgmap v54: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T01:34:52.054 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:34:51 smithi142 ceph-mon[34050]: Deploying daemon osd.2 on smithi142 2024-09-21T01:34:52.054 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:34:51 smithi142 ceph-mon[34050]: pgmap v54: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T01:34:52.118 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:34:51 smithi119 ceph-mon[33693]: Deploying daemon osd.2 on smithi142 2024-09-21T01:34:52.118 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:34:51 smithi119 ceph-mon[33693]: pgmap v54: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T01:34:54.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:34:53 smithi083 ceph-mon[31370]: pgmap v55: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T01:34:54.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:34:53 smithi142 ceph-mon[34050]: pgmap v55: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T01:34:54.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:34:53 smithi119 ceph-mon[33693]: pgmap v55: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T01:34:56.023 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:34:55 smithi142 ceph-mon[34050]: pgmap v56: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T01:34:56.053 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:34:55 smithi083 ceph-mon[31370]: pgmap v56: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T01:34:56.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:34:55 smithi119 ceph-mon[33693]: pgmap v56: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T01:34:57.045 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:34:56 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:34:57.045 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:34:56 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:34:57.045 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:34:56 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:34:57.053 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:34:56 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:34:57.053 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:34:56 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:34:57.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:34:56 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:34:57.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:34:56 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:34:57.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:34:56 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:34:57.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:34:56 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:34:57.964 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:34:57 smithi142 ceph-mon[34050]: pgmap v57: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T01:34:58.053 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:34:57 smithi083 ceph-mon[31370]: pgmap v57: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T01:34:58.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:34:57 smithi119 ceph-mon[33693]: pgmap v57: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T01:35:00.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:34:59 smithi083 ceph-mon[31370]: pgmap v58: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T01:35:00.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:34:59 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:35:00.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:34:59 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:35:00.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:34:59 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:35:00.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:34:59 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:35:00.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:34:59 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:35:00.076 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:34:59 smithi142 ceph-mon[34050]: pgmap v58: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T01:35:00.076 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:34:59 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:35:00.076 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:34:59 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:35:00.076 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:34:59 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:35:00.076 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:34:59 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:35:00.076 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:34:59 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:35:00.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:34:59 smithi119 ceph-mon[33693]: pgmap v58: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T01:35:00.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:34:59 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:35:00.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:34:59 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:35:00.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:34:59 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:35:00.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:34:59 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:35:00.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:34:59 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:35:00.683 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:35:00.682+0000 7f956effd640 1 -- 172.21.15.142:0/2914235236 <== mgr.14223 v2:172.21.15.83:6800/1748483157 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f957806b900 con 0x7f95640b6550 2024-09-21T01:35:00.683 INFO:teuthology.orchestra.run.smithi142.stdout:Created osd(s) 2 on host 'smithi142' 2024-09-21T01:35:00.685 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:35:00.684+0000 7f957fe66640 1 -- 172.21.15.142:0/2914235236 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f95640b6550 msgr2=0x7f95640b8a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:35:00.685 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:35:00.684+0000 7f957fe66640 1 --2- 172.21.15.142:0/2914235236 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f95640b6550 0x7f95640b8a60 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f95680058c0 tx=0x7f9568005850 comp rx=0 tx=0).stop 2024-09-21T01:35:00.685 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:35:00.684+0000 7f957fe66640 1 -- 172.21.15.142:0/2914235236 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9578102a60 msgr2=0x7f95781992a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:35:00.685 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:35:00.684+0000 7f957fe66640 1 --2- 172.21.15.142:0/2914235236 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9578102a60 0x7f95781992a0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f9574009230 tx=0x7f9574004270 comp rx=0 tx=0).stop 2024-09-21T01:35:00.685 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:35:00.684+0000 7f957fe66640 1 -- 172.21.15.142:0/2914235236 shutdown_connections 2024-09-21T01:35:00.685 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:35:00.684+0000 7f957fe66640 1 --2- 172.21.15.142:0/2914235236 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f95640b6550 0x7f95640b8a60 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:35:00.685 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:35:00.684+0000 7f957fe66640 1 --2- 172.21.15.142:0/2914235236 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9578108cf0 0x7f957819eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:35:00.685 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:35:00.684+0000 7f957fe66640 1 --2- 172.21.15.142:0/2914235236 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f95781083a0 0x7f9578199840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:35:00.686 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:35:00.684+0000 7f957fe66640 1 --2- 172.21.15.142:0/2914235236 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9578102a60 0x7f95781992a0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:35:00.686 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:35:00.684+0000 7f957fe66640 1 -- 172.21.15.142:0/2914235236 >> 172.21.15.142:0/2914235236 conn(0x7f9578079730 msgr2=0x7f95781014a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:35:00.686 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:35:00.685+0000 7f957fe66640 1 -- 172.21.15.142:0/2914235236 shutdown_connections 2024-09-21T01:35:00.686 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:35:00.685+0000 7f957fe66640 1 -- 172.21.15.142:0/2914235236 wait complete. 2024-09-21T01:35:00.964 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:00 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:35:00.964 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:00 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:35:00.964 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:00 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:35:01.053 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:00 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:35:01.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:00 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:35:01.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:00 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:35:01.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:00 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:35:01.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:00 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:35:01.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:00 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:35:01.272 DEBUG:teuthology.orchestra.run.smithi142:osd.2> sudo journalctl -f -n 0 -u ceph-f7697ecc-77b8-11ef-baf5-efdc52797490@osd.2.service 2024-09-21T01:35:01.275 INFO:tasks.cephadm:Deploying osd.3 on smithi083 with /dev/vg_nvme/lv_3... 2024-09-21T01:35:01.275 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_3 2024-09-21T01:35:01.530 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:35:01.964 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:01 smithi142 ceph-mon[34050]: pgmap v59: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T01:35:01.982 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:01 smithi083 ceph-mon[31370]: pgmap v59: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T01:35:02.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:01 smithi119 ceph-mon[33693]: pgmap v59: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T01:35:02.512 INFO:journalctl@ceph.osd.2.smithi142.stdout:Sep 21 01:35:02 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-2[39164]: 2024-09-21T01:35:02.352+0000 7fa137a14640 -1 osd.2 0 log_to_monitors true 2024-09-21T01:35:02.926 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:02 smithi083 ceph-mon[31370]: from='osd.2 [v2:172.21.15.142:6800/3955936117,v1:172.21.15.142:6801/3955936117]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T01:35:02.927 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:02 smithi083 ceph-mon[31370]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T01:35:03.213 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:02 smithi142 ceph-mon[34050]: from='osd.2 [v2:172.21.15.142:6800/3955936117,v1:172.21.15.142:6801/3955936117]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T01:35:03.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:02 smithi142 ceph-mon[34050]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T01:35:03.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:02 smithi119 ceph-mon[33693]: from='osd.2 [v2:172.21.15.142:6800/3955936117,v1:172.21.15.142:6801/3955936117]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T01:35:03.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:02 smithi119 ceph-mon[33693]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T01:35:03.884 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:03 smithi142 ceph-mon[34050]: pgmap v60: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T01:35:03.884 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:03 smithi142 ceph-mon[34050]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-21T01:35:03.884 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:03 smithi142 ceph-mon[34050]: osdmap e16: 3 total, 2 up, 3 in 2024-09-21T01:35:03.885 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:03 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T01:35:03.885 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:03 smithi142 ceph-mon[34050]: from='osd.2 [v2:172.21.15.142:6800/3955936117,v1:172.21.15.142:6801/3955936117]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi142", "root=default"]} : dispatch 2024-09-21T01:35:03.885 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:03 smithi142 ceph-mon[34050]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi142", "root=default"]} : dispatch 2024-09-21T01:35:04.053 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:03 smithi083 ceph-mon[31370]: pgmap v60: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T01:35:04.053 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:03 smithi083 ceph-mon[31370]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-21T01:35:04.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:03 smithi083 ceph-mon[31370]: osdmap e16: 3 total, 2 up, 3 in 2024-09-21T01:35:04.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:03 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T01:35:04.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:03 smithi083 ceph-mon[31370]: from='osd.2 [v2:172.21.15.142:6800/3955936117,v1:172.21.15.142:6801/3955936117]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi142", "root=default"]} : dispatch 2024-09-21T01:35:04.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:03 smithi083 ceph-mon[31370]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi142", "root=default"]} : dispatch 2024-09-21T01:35:04.097 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T01:35:04.124 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi083:vg_nvme/lv_3 2024-09-21T01:35:04.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:03 smithi119 ceph-mon[33693]: pgmap v60: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T01:35:04.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:03 smithi119 ceph-mon[33693]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-21T01:35:04.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:03 smithi119 ceph-mon[33693]: osdmap e16: 3 total, 2 up, 3 in 2024-09-21T01:35:04.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:03 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T01:35:04.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:03 smithi119 ceph-mon[33693]: from='osd.2 [v2:172.21.15.142:6800/3955936117,v1:172.21.15.142:6801/3955936117]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi142", "root=default"]} : dispatch 2024-09-21T01:35:04.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:03 smithi119 ceph-mon[33693]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi142", "root=default"]} : dispatch 2024-09-21T01:35:04.374 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:35:04.714 INFO:journalctl@ceph.osd.2.smithi142.stdout:Sep 21 01:35:04 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-2[39164]: 2024-09-21T01:35:04.258+0000 7fa133996640 -1 osd.2 0 waiting for initial osdmap 2024-09-21T01:35:04.715 INFO:journalctl@ceph.osd.2.smithi142.stdout:Sep 21 01:35:04 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-2[39164]: 2024-09-21T01:35:04.264+0000 7fa12b78c640 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T01:35:04.864 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:35:04.859+0000 7fe103877640 1 -- 172.21.15.83:0/3145267118 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe0fc103270 msgr2=0x7fe0fc103680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:35:04.864 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:35:04.859+0000 7fe103877640 1 --2- 172.21.15.83:0/3145267118 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe0fc103270 0x7fe0fc103680 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fe0f8009ca0 tx=0x7fe0f802a8c0 comp rx=0 tx=0).stop 2024-09-21T01:35:04.865 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:35:04.859+0000 7fe103877640 1 -- 172.21.15.83:0/3145267118 shutdown_connections 2024-09-21T01:35:04.865 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:35:04.859+0000 7fe103877640 1 --2- 172.21.15.83:0/3145267118 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe0fc105b90 0x7fe0fc10f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:35:04.865 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:35:04.859+0000 7fe103877640 1 --2- 172.21.15.83:0/3145267118 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe0fc105240 0x7fe0fc105650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:35:04.865 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:35:04.859+0000 7fe103877640 1 --2- 172.21.15.83:0/3145267118 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe0fc103270 0x7fe0fc103680 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:35:04.865 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:35:04.859+0000 7fe103877640 1 -- 172.21.15.83:0/3145267118 >> 172.21.15.83:0/3145267118 conn(0x7fe0fc079ec0 msgr2=0x7fe0fc07a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:35:04.865 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:35:04.860+0000 7fe103877640 1 -- 172.21.15.83:0/3145267118 shutdown_connections 2024-09-21T01:35:04.865 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:35:04.860+0000 7fe103877640 1 -- 172.21.15.83:0/3145267118 wait complete. 2024-09-21T01:35:04.865 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:35:04.860+0000 7fe103877640 1 Processor -- start 2024-09-21T01:35:04.865 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:35:04.860+0000 7fe103877640 1 -- start start 2024-09-21T01:35:04.865 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:35:04.860+0000 7fe103877640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe0fc103270 0x7fe0fc1992e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:35:04.865 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:35:04.860+0000 7fe103877640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe0fc105240 0x7fe0fc199880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:35:04.865 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:35:04.860+0000 7fe103877640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe0fc105b90 0x7fe0fc19eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:35:04.866 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:35:04.861+0000 7fe103877640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fe0fc112930 con 0x7fe0fc105b90 2024-09-21T01:35:04.866 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:35:04.861+0000 7fe103877640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fe0fc1127b0 con 0x7fe0fc105240 2024-09-21T01:35:04.866 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:35:04.861+0000 7fe103877640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fe0fc112ab0 con 0x7fe0fc103270 2024-09-21T01:35:04.866 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:35:04.861+0000 7fe101e14640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe0fc105b90 0x7fe0fc19eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:35:04.866 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:35:04.861+0000 7fe101e14640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe0fc105b90 0x7fe0fc19eb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:47466/0 (socket says 172.21.15.83:47466) 2024-09-21T01:35:04.866 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:35:04.861+0000 7fe101e14640 1 -- 172.21.15.83:0/3810011919 learned_addr learned my addr 172.21.15.83:0/3810011919 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:35:04.866 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:35:04.861+0000 7fe101613640 1 --2- 172.21.15.83:0/3810011919 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe0fc103270 0x7fe0fc1992e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:35:04.866 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:35:04.861+0000 7fe100e12640 1 --2- 172.21.15.83:0/3810011919 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe0fc105240 0x7fe0fc199880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:35:04.866 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:35:04.861+0000 7fe101e14640 1 -- 172.21.15.83:0/3810011919 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe0fc103270 msgr2=0x7fe0fc1992e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:35:04.866 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:35:04.861+0000 7fe101e14640 1 --2- 172.21.15.83:0/3810011919 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe0fc103270 0x7fe0fc1992e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:35:04.866 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:35:04.861+0000 7fe101e14640 1 -- 172.21.15.83:0/3810011919 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe0fc105240 msgr2=0x7fe0fc199880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:35:04.866 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:35:04.861+0000 7fe101e14640 1 --2- 172.21.15.83:0/3810011919 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe0fc105240 0x7fe0fc199880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:35:04.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:35:04.861+0000 7fe101e14640 1 -- 172.21.15.83:0/3810011919 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0fc19f250 con 0x7fe0fc105b90 2024-09-21T01:35:04.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:35:04.861+0000 7fe101e14640 1 --2- 172.21.15.83:0/3810011919 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe0fc105b90 0x7fe0fc19eb20 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fe0f400d750 tx=0x7fe0f400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:35:04.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:35:04.861+0000 7fe0f27fc640 1 -- 172.21.15.83:0/3810011919 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0f4017070 con 0x7fe0fc105b90 2024-09-21T01:35:04.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:35:04.861+0000 7fe103877640 1 -- 172.21.15.83:0/3810011919 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0fc19f540 con 0x7fe0fc105b90 2024-09-21T01:35:04.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:35:04.861+0000 7fe0f27fc640 1 -- 172.21.15.83:0/3810011919 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe0f40054b0 con 0x7fe0fc105b90 2024-09-21T01:35:04.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:35:04.861+0000 7fe0f27fc640 1 -- 172.21.15.83:0/3810011919 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0f4004b90 con 0x7fe0fc105b90 2024-09-21T01:35:04.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:35:04.861+0000 7fe103877640 1 -- 172.21.15.83:0/3810011919 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0fc1a5ca0 con 0x7fe0fc105b90 2024-09-21T01:35:04.867 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:35:04.862+0000 7fe103877640 1 -- 172.21.15.83:0/3810011919 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0fc19a410 con 0x7fe0fc105b90 2024-09-21T01:35:04.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:35:04.865+0000 7fe0f27fc640 1 -- 172.21.15.83:0/3810011919 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 19) ==== 154473+0+0 (secure 0 0 0) 0x7fe0f4004d30 con 0x7fe0fc105b90 2024-09-21T01:35:04.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:35:04.865+0000 7fe0f27fc640 1 --2- 172.21.15.83:0/3810011919 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fe0e80b64d0 0x7fe0e80b89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:35:04.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:35:04.865+0000 7fe101613640 1 --2- 172.21.15.83:0/3810011919 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fe0e80b64d0 0x7fe0e80b89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:35:04.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:35:04.865+0000 7fe0f27fc640 1 -- 172.21.15.83:0/3810011919 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 2786+0+0 (secure 0 0 0) 0x7fe0f40e5ae0 con 0x7fe0fc105b90 2024-09-21T01:35:04.868 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:35:04.866+0000 7fe101613640 1 --2- 172.21.15.83:0/3810011919 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fe0e80b64d0 0x7fe0e80b89e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe0f8000f80 tx=0x7fe0f8031000 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:35:04.869 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:35:04.869+0000 7fe0f27fc640 1 -- 172.21.15.83:0/3810011919 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe0f40ad9e0 con 0x7fe0fc105b90 2024-09-21T01:35:05.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:04 smithi083 ceph-mon[31370]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi142", "root=default"]}]': finished 2024-09-21T01:35:05.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:04 smithi083 ceph-mon[31370]: osdmap e17: 3 total, 2 up, 3 in 2024-09-21T01:35:05.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:04 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T01:35:05.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:04 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T01:35:05.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:04 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:35:05.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:04 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:35:05.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:04 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T01:35:05.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:04 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:35:05.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:04 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:35:05.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:04 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:35:05.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:04 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:35:05.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:04 smithi083 ceph-mon[31370]: from='osd.2 ' entity='osd.2' 2024-09-21T01:35:05.061 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:35:05.061+0000 7fe103877640 1 -- 172.21.15.83:0/3810011919 --> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi083:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7fe0fc06b910 con 0x7fe0e80b64d0 2024-09-21T01:35:05.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:04 smithi142 ceph-mon[34050]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi142", "root=default"]}]': finished 2024-09-21T01:35:05.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:04 smithi142 ceph-mon[34050]: osdmap e17: 3 total, 2 up, 3 in 2024-09-21T01:35:05.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:04 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T01:35:05.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:04 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T01:35:05.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:04 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:35:05.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:04 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:35:05.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:04 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T01:35:05.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:04 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:35:05.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:04 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:35:05.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:04 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:35:05.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:04 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:35:05.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:04 smithi142 ceph-mon[34050]: from='osd.2 ' entity='osd.2' 2024-09-21T01:35:05.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:04 smithi119 ceph-mon[33693]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi142", "root=default"]}]': finished 2024-09-21T01:35:05.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:04 smithi119 ceph-mon[33693]: osdmap e17: 3 total, 2 up, 3 in 2024-09-21T01:35:05.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:04 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T01:35:05.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:04 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T01:35:05.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:04 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:35:05.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:04 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:35:05.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:04 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T01:35:05.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:04 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:35:05.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:04 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:35:05.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:04 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:35:05.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:04 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:35:05.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:04 smithi119 ceph-mon[33693]: from='osd.2 ' entity='osd.2' 2024-09-21T01:35:06.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:05 smithi083 ceph-mon[31370]: purged_snaps scrub starts 2024-09-21T01:35:06.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:05 smithi083 ceph-mon[31370]: purged_snaps scrub ok 2024-09-21T01:35:06.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:05 smithi083 ceph-mon[31370]: Detected new or changed devices on smithi142 2024-09-21T01:35:06.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:05 smithi083 ceph-mon[31370]: Adjusting osd_memory_target on smithi142 to 17088M 2024-09-21T01:35:06.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:05 smithi083 ceph-mon[31370]: pgmap v63: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T01:35:06.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:05 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T01:35:06.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:05 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T01:35:06.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:05 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T01:35:06.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:05 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:35:06.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:05 smithi083 ceph-mon[31370]: osd.2 [v2:172.21.15.142:6800/3955936117,v1:172.21.15.142:6801/3955936117] boot 2024-09-21T01:35:06.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:05 smithi083 ceph-mon[31370]: osdmap e18: 3 total, 3 up, 3 in 2024-09-21T01:35:06.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:05 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T01:35:06.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:05 smithi142 ceph-mon[34050]: purged_snaps scrub starts 2024-09-21T01:35:06.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:05 smithi142 ceph-mon[34050]: purged_snaps scrub ok 2024-09-21T01:35:06.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:05 smithi142 ceph-mon[34050]: Detected new or changed devices on smithi142 2024-09-21T01:35:06.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:05 smithi142 ceph-mon[34050]: Adjusting osd_memory_target on smithi142 to 17088M 2024-09-21T01:35:06.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:05 smithi142 ceph-mon[34050]: pgmap v63: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T01:35:06.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:05 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T01:35:06.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:05 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T01:35:06.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:05 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T01:35:06.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:05 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:35:06.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:05 smithi142 ceph-mon[34050]: osd.2 [v2:172.21.15.142:6800/3955936117,v1:172.21.15.142:6801/3955936117] boot 2024-09-21T01:35:06.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:05 smithi142 ceph-mon[34050]: osdmap e18: 3 total, 3 up, 3 in 2024-09-21T01:35:06.216 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:05 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T01:35:06.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:05 smithi119 ceph-mon[33693]: purged_snaps scrub starts 2024-09-21T01:35:06.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:05 smithi119 ceph-mon[33693]: purged_snaps scrub ok 2024-09-21T01:35:06.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:05 smithi119 ceph-mon[33693]: Detected new or changed devices on smithi142 2024-09-21T01:35:06.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:05 smithi119 ceph-mon[33693]: Adjusting osd_memory_target on smithi142 to 17088M 2024-09-21T01:35:06.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:05 smithi119 ceph-mon[33693]: pgmap v63: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T01:35:06.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:05 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T01:35:06.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:05 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T01:35:06.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:05 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T01:35:06.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:05 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:35:06.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:05 smithi119 ceph-mon[33693]: osd.2 [v2:172.21.15.142:6800/3955936117,v1:172.21.15.142:6801/3955936117] boot 2024-09-21T01:35:06.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:05 smithi119 ceph-mon[33693]: osdmap e18: 3 total, 3 up, 3 in 2024-09-21T01:35:06.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:05 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T01:35:07.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:06 smithi083 ceph-mon[31370]: from='client.14529 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi083:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:35:07.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:06 smithi083 ceph-mon[31370]: osdmap e19: 3 total, 3 up, 3 in 2024-09-21T01:35:07.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:06 smithi142 ceph-mon[34050]: from='client.14529 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi083:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:35:07.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:06 smithi142 ceph-mon[34050]: osdmap e19: 3 total, 3 up, 3 in 2024-09-21T01:35:07.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:06 smithi119 ceph-mon[33693]: from='client.14529 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi083:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:35:07.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:06 smithi119 ceph-mon[33693]: osdmap e19: 3 total, 3 up, 3 in 2024-09-21T01:35:08.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:07 smithi083 ceph-mon[31370]: pgmap v66: 0 pgs: ; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-21T01:35:08.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:07 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2024-09-21T01:35:08.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:07 smithi083 ceph-mon[31370]: from='client.? 172.21.15.83:0/2777867352' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a4cb1a36-3495-4d36-92da-ed3b6e852d14"} : dispatch 2024-09-21T01:35:08.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:07 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-21T01:35:08.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:07 smithi083 ceph-mon[31370]: from='client.? 172.21.15.83:0/2777867352' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a4cb1a36-3495-4d36-92da-ed3b6e852d14"}]': finished 2024-09-21T01:35:08.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:07 smithi083 ceph-mon[31370]: osdmap e20: 4 total, 3 up, 4 in 2024-09-21T01:35:08.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:07 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T01:35:08.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:07 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2024-09-21T01:35:08.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:07 smithi142 ceph-mon[34050]: pgmap v66: 0 pgs: ; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-21T01:35:08.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:07 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2024-09-21T01:35:08.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:07 smithi142 ceph-mon[34050]: from='client.? 172.21.15.83:0/2777867352' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a4cb1a36-3495-4d36-92da-ed3b6e852d14"} : dispatch 2024-09-21T01:35:08.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:07 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-21T01:35:08.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:07 smithi142 ceph-mon[34050]: from='client.? 172.21.15.83:0/2777867352' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a4cb1a36-3495-4d36-92da-ed3b6e852d14"}]': finished 2024-09-21T01:35:08.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:07 smithi142 ceph-mon[34050]: osdmap e20: 4 total, 3 up, 4 in 2024-09-21T01:35:08.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:07 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T01:35:08.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:07 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2024-09-21T01:35:08.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:07 smithi119 ceph-mon[33693]: pgmap v66: 0 pgs: ; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-21T01:35:08.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:07 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2024-09-21T01:35:08.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:07 smithi119 ceph-mon[33693]: from='client.? 172.21.15.83:0/2777867352' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a4cb1a36-3495-4d36-92da-ed3b6e852d14"} : dispatch 2024-09-21T01:35:08.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:07 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-21T01:35:08.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:07 smithi119 ceph-mon[33693]: from='client.? 172.21.15.83:0/2777867352' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a4cb1a36-3495-4d36-92da-ed3b6e852d14"}]': finished 2024-09-21T01:35:08.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:07 smithi119 ceph-mon[33693]: osdmap e20: 4 total, 3 up, 4 in 2024-09-21T01:35:08.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:07 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T01:35:08.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:07 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2024-09-21T01:35:08.968 INFO:journalctl@ceph.osd.1.smithi119.stdout:Sep 21 01:35:08 smithi119 sudo[42198]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T01:35:08.968 INFO:journalctl@ceph.osd.1.smithi119.stdout:Sep 21 01:35:08 smithi119 sudo[42198]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T01:35:08.968 INFO:journalctl@ceph.osd.1.smithi119.stdout:Sep 21 01:35:08 smithi119 sudo[42198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T01:35:08.968 INFO:journalctl@ceph.osd.1.smithi119.stdout:Sep 21 01:35:08 smithi119 sudo[42198]: pam_unix(sudo:session): session closed for user root 2024-09-21T01:35:08.968 INFO:journalctl@ceph.osd.1.smithi119.stdout:Sep 21 01:35:08 smithi119 sudo[42201]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T01:35:08.968 INFO:journalctl@ceph.osd.1.smithi119.stdout:Sep 21 01:35:08 smithi119 sudo[42201]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T01:35:08.968 INFO:journalctl@ceph.osd.1.smithi119.stdout:Sep 21 01:35:08 smithi119 sudo[42201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T01:35:08.968 INFO:journalctl@ceph.osd.1.smithi119.stdout:Sep 21 01:35:08 smithi119 sudo[42201]: pam_unix(sudo:session): session closed for user root 2024-09-21T01:35:08.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:08 smithi119 ceph-mon[33693]: from='client.? 172.21.15.83:0/2219482024' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T01:35:08.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:08 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-21T01:35:08.969 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:08 smithi119 ceph-mon[33693]: osdmap e21: 4 total, 3 up, 4 in 2024-09-21T01:35:08.969 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:08 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T01:35:08.969 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:08 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:35:08.969 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:08 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:35:08.969 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:08 smithi119 sudo[42204]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T01:35:08.969 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:08 smithi119 sudo[42204]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T01:35:08.969 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:08 smithi119 sudo[42204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T01:35:08.969 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:08 smithi119 sudo[42204]: pam_unix(sudo:session): session closed for user root 2024-09-21T01:35:08.969 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:08 smithi119 sudo[42207]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T01:35:08.969 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:08 smithi119 sudo[42207]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T01:35:08.969 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:08 smithi119 sudo[42207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T01:35:08.969 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:08 smithi119 sudo[42207]: pam_unix(sudo:session): session closed for user root 2024-09-21T01:35:09.054 INFO:journalctl@ceph.osd.0.smithi083.stdout:Sep 21 01:35:08 smithi083 sudo[52762]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T01:35:09.054 INFO:journalctl@ceph.osd.0.smithi083.stdout:Sep 21 01:35:08 smithi083 sudo[52762]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T01:35:09.054 INFO:journalctl@ceph.osd.0.smithi083.stdout:Sep 21 01:35:08 smithi083 sudo[52762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T01:35:09.054 INFO:journalctl@ceph.osd.0.smithi083.stdout:Sep 21 01:35:08 smithi083 sudo[52762]: pam_unix(sudo:session): session closed for user root 2024-09-21T01:35:09.054 INFO:journalctl@ceph.osd.0.smithi083.stdout:Sep 21 01:35:08 smithi083 sudo[52765]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T01:35:09.054 INFO:journalctl@ceph.osd.0.smithi083.stdout:Sep 21 01:35:08 smithi083 sudo[52765]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T01:35:09.054 INFO:journalctl@ceph.osd.0.smithi083.stdout:Sep 21 01:35:08 smithi083 sudo[52765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T01:35:09.054 INFO:journalctl@ceph.osd.0.smithi083.stdout:Sep 21 01:35:08 smithi083 sudo[52765]: pam_unix(sudo:session): session closed for user root 2024-09-21T01:35:09.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:08 smithi083 ceph-mon[31370]: from='client.? 172.21.15.83:0/2219482024' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T01:35:09.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:08 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-21T01:35:09.055 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:08 smithi083 ceph-mon[31370]: osdmap e21: 4 total, 3 up, 4 in 2024-09-21T01:35:09.055 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:08 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T01:35:09.055 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:08 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:35:09.055 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:08 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:35:09.055 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:08 smithi083 sudo[52769]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T01:35:09.055 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:08 smithi083 sudo[52769]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T01:35:09.055 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:08 smithi083 sudo[52769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T01:35:09.055 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:08 smithi083 sudo[52769]: pam_unix(sudo:session): session closed for user root 2024-09-21T01:35:09.055 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:08 smithi083 sudo[52772]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T01:35:09.055 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:08 smithi083 sudo[52772]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T01:35:09.055 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:08 smithi083 sudo[52772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T01:35:09.055 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:08 smithi083 sudo[52772]: pam_unix(sudo:session): session closed for user root 2024-09-21T01:35:09.214 INFO:journalctl@ceph.osd.2.smithi142.stdout:Sep 21 01:35:08 smithi142 sudo[42769]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T01:35:09.215 INFO:journalctl@ceph.osd.2.smithi142.stdout:Sep 21 01:35:08 smithi142 sudo[42769]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T01:35:09.215 INFO:journalctl@ceph.osd.2.smithi142.stdout:Sep 21 01:35:08 smithi142 sudo[42769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T01:35:09.215 INFO:journalctl@ceph.osd.2.smithi142.stdout:Sep 21 01:35:08 smithi142 sudo[42769]: pam_unix(sudo:session): session closed for user root 2024-09-21T01:35:09.215 INFO:journalctl@ceph.osd.2.smithi142.stdout:Sep 21 01:35:08 smithi142 sudo[42772]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T01:35:09.215 INFO:journalctl@ceph.osd.2.smithi142.stdout:Sep 21 01:35:08 smithi142 sudo[42772]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T01:35:09.215 INFO:journalctl@ceph.osd.2.smithi142.stdout:Sep 21 01:35:08 smithi142 sudo[42772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T01:35:09.215 INFO:journalctl@ceph.osd.2.smithi142.stdout:Sep 21 01:35:08 smithi142 sudo[42772]: pam_unix(sudo:session): session closed for user root 2024-09-21T01:35:09.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:08 smithi142 ceph-mon[34050]: from='client.? 172.21.15.83:0/2219482024' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T01:35:09.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:08 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-21T01:35:09.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:08 smithi142 ceph-mon[34050]: osdmap e21: 4 total, 3 up, 4 in 2024-09-21T01:35:09.216 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:08 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T01:35:09.216 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:08 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:35:09.216 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:08 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:35:09.216 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:08 smithi142 sudo[42775]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T01:35:09.216 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:08 smithi142 sudo[42775]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T01:35:09.216 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:08 smithi142 sudo[42775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T01:35:09.216 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:08 smithi142 sudo[42775]: pam_unix(sudo:session): session closed for user root 2024-09-21T01:35:09.216 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:08 smithi142 sudo[42778]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T01:35:09.216 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:08 smithi142 sudo[42778]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T01:35:09.216 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:08 smithi142 sudo[42778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T01:35:09.216 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:08 smithi142 sudo[42778]: pam_unix(sudo:session): session closed for user root 2024-09-21T01:35:09.688 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:35:09.686+0000 7fe0f27fc640 1 -- 172.21.15.83:0/3810011919 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mgrmap(e 20) ==== 154529+0+0 (secure 0 0 0) 0x7fe0f40a9550 con 0x7fe0fc105b90 2024-09-21T01:35:10.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:09 smithi083 ceph-mon[31370]: pgmap v69: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-21T01:35:10.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:09 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:35:10.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:09 smithi083 ceph-mon[31370]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T01:35:10.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:09 smithi083 ceph-mon[31370]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T01:35:10.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:09 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T01:35:10.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:09 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T01:35:10.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:09 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T01:35:10.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:09 smithi083 ceph-mon[31370]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T01:35:10.055 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:09 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T01:35:10.055 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:09 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T01:35:10.055 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:09 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T01:35:10.055 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:09 smithi083 ceph-mon[31370]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T01:35:10.055 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:09 smithi083 ceph-mon[31370]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T01:35:10.055 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:09 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T01:35:10.055 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:09 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T01:35:10.055 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:09 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T01:35:10.055 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:09 smithi083 ceph-mon[31370]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T01:35:10.055 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:09 smithi083 ceph-mon[31370]: osdmap e22: 4 total, 3 up, 4 in 2024-09-21T01:35:10.055 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:09 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T01:35:10.055 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:09 smithi083 ceph-mon[31370]: mgrmap e20: x(active, since 2m), standbys: z, y 2024-09-21T01:35:10.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:09 smithi142 ceph-mon[34050]: pgmap v69: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-21T01:35:10.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:09 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:35:10.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:09 smithi142 ceph-mon[34050]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T01:35:10.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:09 smithi142 ceph-mon[34050]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T01:35:10.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:09 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T01:35:10.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:09 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T01:35:10.216 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:09 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T01:35:10.216 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:09 smithi142 ceph-mon[34050]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T01:35:10.216 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:09 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T01:35:10.216 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:09 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T01:35:10.216 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:09 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T01:35:10.216 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:09 smithi142 ceph-mon[34050]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T01:35:10.216 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:09 smithi142 ceph-mon[34050]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T01:35:10.216 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:09 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T01:35:10.216 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:09 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T01:35:10.216 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:09 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T01:35:10.216 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:09 smithi142 ceph-mon[34050]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T01:35:10.216 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:09 smithi142 ceph-mon[34050]: osdmap e22: 4 total, 3 up, 4 in 2024-09-21T01:35:10.217 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:09 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T01:35:10.217 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:09 smithi142 ceph-mon[34050]: mgrmap e20: x(active, since 2m), standbys: z, y 2024-09-21T01:35:10.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:09 smithi119 ceph-mon[33693]: pgmap v69: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-21T01:35:10.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:09 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:35:10.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:09 smithi119 ceph-mon[33693]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T01:35:10.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:09 smithi119 ceph-mon[33693]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T01:35:10.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:09 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T01:35:10.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:09 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T01:35:10.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:09 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T01:35:10.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:09 smithi119 ceph-mon[33693]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T01:35:10.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:09 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T01:35:10.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:09 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T01:35:10.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:09 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T01:35:10.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:09 smithi119 ceph-mon[33693]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T01:35:10.219 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:09 smithi119 ceph-mon[33693]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T01:35:10.219 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:09 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T01:35:10.219 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:09 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T01:35:10.219 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:09 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T01:35:10.219 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:09 smithi119 ceph-mon[33693]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T01:35:10.219 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:09 smithi119 ceph-mon[33693]: osdmap e22: 4 total, 3 up, 4 in 2024-09-21T01:35:10.219 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:09 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T01:35:10.219 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:09 smithi119 ceph-mon[33693]: mgrmap e20: x(active, since 2m), standbys: z, y 2024-09-21T01:35:12.099 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:11 smithi083 ceph-mon[31370]: pgmap v71: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-21T01:35:12.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:11 smithi142 ceph-mon[34050]: pgmap v71: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-21T01:35:12.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:11 smithi119 ceph-mon[33693]: pgmap v71: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-21T01:35:13.115 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:12 smithi083 ceph-mon[31370]: pgmap v72: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-21T01:35:13.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:12 smithi142 ceph-mon[34050]: pgmap v72: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-21T01:35:13.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:12 smithi119 ceph-mon[33693]: pgmap v72: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-21T01:35:16.053 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:15 smithi083 ceph-mon[31370]: pgmap v73: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-21T01:35:16.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:15 smithi142 ceph-mon[34050]: pgmap v73: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-21T01:35:16.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:15 smithi119 ceph-mon[33693]: pgmap v73: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-21T01:35:16.803 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:16 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-21T01:35:16.804 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:16 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:35:17.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:16 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-21T01:35:17.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:16 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:35:17.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:16 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-21T01:35:17.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:16 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:35:17.780 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:17 smithi083 ceph-mon[31370]: Deploying daemon osd.3 on smithi083 2024-09-21T01:35:17.780 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:17 smithi083 ceph-mon[31370]: pgmap v74: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-21T01:35:18.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:17 smithi142 ceph-mon[34050]: Deploying daemon osd.3 on smithi083 2024-09-21T01:35:18.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:17 smithi142 ceph-mon[34050]: pgmap v74: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-21T01:35:18.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:17 smithi119 ceph-mon[33693]: Deploying daemon osd.3 on smithi083 2024-09-21T01:35:18.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:17 smithi119 ceph-mon[33693]: pgmap v74: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-21T01:35:20.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:19 smithi083 ceph-mon[31370]: pgmap v75: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-21T01:35:20.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:19 smithi142 ceph-mon[34050]: pgmap v75: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-21T01:35:20.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:19 smithi119 ceph-mon[33693]: pgmap v75: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-21T01:35:22.017 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:21 smithi142 ceph-mon[34050]: pgmap v76: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-21T01:35:22.020 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:21 smithi119 ceph-mon[33693]: pgmap v76: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-21T01:35:22.038 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:21 smithi083 ceph-mon[31370]: pgmap v76: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-21T01:35:23.053 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:22 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:35:23.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:22 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:35:23.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:22 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:35:23.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:22 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:35:23.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:22 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:35:23.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:22 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:35:23.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:22 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:35:23.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:22 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:35:23.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:22 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:35:24.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:23 smithi083 ceph-mon[31370]: pgmap v77: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-21T01:35:24.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:23 smithi142 ceph-mon[34050]: pgmap v77: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-21T01:35:24.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:23 smithi119 ceph-mon[33693]: pgmap v77: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-21T01:35:25.790 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:25 smithi083 ceph-mon[31370]: pgmap v78: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-21T01:35:25.790 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:25 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:35:25.790 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:25 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:35:25.790 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:25 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:35:25.790 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:25 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:35:25.790 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:25 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:35:25.833 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:35:25.833+0000 7fe0f27fc640 1 -- 172.21.15.83:0/3810011919 <== mgr.14223 v2:172.21.15.83:6800/1748483157 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fe0fc06b910 con 0x7fe0e80b64d0 2024-09-21T01:35:25.834 INFO:teuthology.orchestra.run.smithi083.stdout:Created osd(s) 3 on host 'smithi083' 2024-09-21T01:35:25.836 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:35:25.835+0000 7fe103877640 1 -- 172.21.15.83:0/3810011919 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fe0e80b64d0 msgr2=0x7fe0e80b89e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:35:25.836 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:35:25.835+0000 7fe103877640 1 --2- 172.21.15.83:0/3810011919 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fe0e80b64d0 0x7fe0e80b89e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe0f8000f80 tx=0x7fe0f8031000 comp rx=0 tx=0).stop 2024-09-21T01:35:25.836 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:35:25.835+0000 7fe103877640 1 -- 172.21.15.83:0/3810011919 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe0fc105b90 msgr2=0x7fe0fc19eb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:35:25.836 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:35:25.835+0000 7fe103877640 1 --2- 172.21.15.83:0/3810011919 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe0fc105b90 0x7fe0fc19eb20 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fe0f400d750 tx=0x7fe0f400dc10 comp rx=0 tx=0).stop 2024-09-21T01:35:25.836 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:35:25.835+0000 7fe103877640 1 -- 172.21.15.83:0/3810011919 shutdown_connections 2024-09-21T01:35:25.836 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:35:25.835+0000 7fe103877640 1 --2- 172.21.15.83:0/3810011919 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fe0e80b64d0 0x7fe0e80b89e0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:35:25.836 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:35:25.835+0000 7fe103877640 1 --2- 172.21.15.83:0/3810011919 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe0fc105b90 0x7fe0fc19eb20 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:35:25.836 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:35:25.835+0000 7fe103877640 1 --2- 172.21.15.83:0/3810011919 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe0fc105240 0x7fe0fc199880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:35:25.836 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:35:25.835+0000 7fe103877640 1 --2- 172.21.15.83:0/3810011919 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe0fc103270 0x7fe0fc1992e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:35:25.836 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:35:25.835+0000 7fe103877640 1 -- 172.21.15.83:0/3810011919 >> 172.21.15.83:0/3810011919 conn(0x7fe0fc079ec0 msgr2=0x7fe0fc1073e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:35:25.837 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:35:25.836+0000 7fe103877640 1 -- 172.21.15.83:0/3810011919 shutdown_connections 2024-09-21T01:35:25.837 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:35:25.836+0000 7fe103877640 1 -- 172.21.15.83:0/3810011919 wait complete. 2024-09-21T01:35:25.964 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:25 smithi142 ceph-mon[34050]: pgmap v78: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-21T01:35:25.964 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:25 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:35:25.964 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:25 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:35:25.965 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:25 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:35:25.965 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:25 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:35:25.965 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:25 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:35:25.967 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:25 smithi119 ceph-mon[33693]: pgmap v78: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-21T01:35:25.967 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:25 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:35:25.967 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:25 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:35:25.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:25 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:35:25.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:25 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:35:25.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:25 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:35:26.455 DEBUG:teuthology.orchestra.run.smithi083:osd.3> sudo journalctl -f -n 0 -u ceph-f7697ecc-77b8-11ef-baf5-efdc52797490@osd.3.service 2024-09-21T01:35:26.458 INFO:tasks.cephadm:Deploying osd.4 on smithi119 with /dev/vg_nvme/lv_3... 2024-09-21T01:35:26.458 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_3 2024-09-21T01:35:26.714 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T01:35:26.835 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:26 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:35:26.835 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:26 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:35:26.835 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:26 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:35:26.956 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:26 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:35:26.956 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:26 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:35:26.956 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:26 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:35:26.964 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:26 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:35:26.964 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:26 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:35:26.964 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:26 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:35:27.962 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:27 smithi119 ceph-mon[33693]: pgmap v79: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-21T01:35:27.964 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:27 smithi142 ceph-mon[34050]: pgmap v79: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-21T01:35:28.021 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:27 smithi083 ceph-mon[31370]: pgmap v79: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-21T01:35:28.713 INFO:journalctl@ceph.osd.3.smithi083.stdout:Sep 21 01:35:28 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-3[54664]: 2024-09-21T01:35:28.450+0000 7ff1987a0640 -1 osd.3 0 log_to_monitors true 2024-09-21T01:35:28.911 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:28 smithi119 ceph-mon[33693]: from='osd.3 [v2:172.21.15.83:6810/3746834093,v1:172.21.15.83:6811/3746834093]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-21T01:35:28.964 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:28 smithi142 ceph-mon[34050]: from='osd.3 [v2:172.21.15.83:6810/3746834093,v1:172.21.15.83:6811/3746834093]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-21T01:35:28.983 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:28 smithi083 ceph-mon[31370]: from='osd.3 [v2:172.21.15.83:6810/3746834093,v1:172.21.15.83:6811/3746834093]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-21T01:35:29.200 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-21T01:35:29.226 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi119:vg_nvme/lv_3 2024-09-21T01:35:29.488 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T01:35:29.826 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:29 smithi119 ceph-mon[33693]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-21T01:35:29.826 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:29 smithi119 ceph-mon[33693]: from='osd.3 [v2:172.21.15.83:6810/3746834093,v1:172.21.15.83:6811/3746834093]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-21T01:35:29.826 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:29 smithi119 ceph-mon[33693]: osdmap e23: 4 total, 3 up, 4 in 2024-09-21T01:35:29.826 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:29 smithi119 ceph-mon[33693]: from='osd.3 [v2:172.21.15.83:6810/3746834093,v1:172.21.15.83:6811/3746834093]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi083", "root=default"]} : dispatch 2024-09-21T01:35:29.826 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:29 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T01:35:29.826 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:29 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:35:29.826 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:29 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:35:29.826 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:29 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T01:35:29.827 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:29 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T01:35:29.827 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:29 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:35:29.827 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:29 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:35:29.827 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:29 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:35:29.827 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:29 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:35:29.942 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:35:29.920+0000 7f833d93e640 1 -- 172.21.15.119:0/2550718008 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8338109570 msgr2=0x7f8338109980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:35:29.942 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:35:29.920+0000 7f833d93e640 1 --2- 172.21.15.119:0/2550718008 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8338109570 0x7f8338109980 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f832c009900 tx=0x7f832c02a410 comp rx=0 tx=0).stop 2024-09-21T01:35:29.942 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:35:29.920+0000 7f833d93e640 1 -- 172.21.15.119:0/2550718008 shutdown_connections 2024-09-21T01:35:29.942 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:35:29.920+0000 7f833d93e640 1 --2- 172.21.15.119:0/2550718008 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8338109ec0 0x7f83381106f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:35:29.943 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:35:29.920+0000 7f833d93e640 1 --2- 172.21.15.119:0/2550718008 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8338109570 0x7f8338109980 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:35:29.943 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:35:29.920+0000 7f833d93e640 1 --2- 172.21.15.119:0/2550718008 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8338103c30 0x7f8338104040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:35:29.943 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:35:29.920+0000 7f833d93e640 1 -- 172.21.15.119:0/2550718008 >> 172.21.15.119:0/2550718008 conn(0x7f833807b8d0 msgr2=0x7f833807bce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:35:29.943 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:35:29.920+0000 7f833d93e640 1 -- 172.21.15.119:0/2550718008 shutdown_connections 2024-09-21T01:35:29.943 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:35:29.920+0000 7f833d93e640 1 -- 172.21.15.119:0/2550718008 wait complete. 2024-09-21T01:35:29.943 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:35:29.920+0000 7f833d93e640 1 Processor -- start 2024-09-21T01:35:29.943 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:35:29.921+0000 7f833d93e640 1 -- start start 2024-09-21T01:35:29.943 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:35:29.921+0000 7f833d93e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8338103c30 0x7f8338075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:35:29.943 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:35:29.921+0000 7f833d93e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8338109570 0x7f8338075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:35:29.943 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:35:29.921+0000 7f833d93e640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8338109ec0 0x7f8338076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:35:29.943 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:35:29.921+0000 7f833d93e640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f8338113990 con 0x7f8338109ec0 2024-09-21T01:35:29.943 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:35:29.921+0000 7f833d93e640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f8338113810 con 0x7f8338109570 2024-09-21T01:35:29.943 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:35:29.921+0000 7f833d93e640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f8338113b10 con 0x7f8338103c30 2024-09-21T01:35:29.943 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:35:29.921+0000 7f83367fc640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8338109570 0x7f8338075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:35:29.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:35:29.921+0000 7f83367fc640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8338109570 0x7f8338075c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:41582/0 (socket says 172.21.15.119:41582) 2024-09-21T01:35:29.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:35:29.921+0000 7f83377fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8338109ec0 0x7f8338076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:35:29.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:35:29.921+0000 7f83367fc640 1 -- 172.21.15.119:0/3067521996 learned_addr learned my addr 172.21.15.119:0/3067521996 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-21T01:35:29.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:35:29.921+0000 7f8336ffd640 1 --2- 172.21.15.119:0/3067521996 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8338103c30 0x7f8338075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:35:29.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:35:29.921+0000 7f83377fe640 1 -- 172.21.15.119:0/3067521996 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8338103c30 msgr2=0x7f8338075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:35:29.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:35:29.921+0000 7f83377fe640 1 --2- 172.21.15.119:0/3067521996 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8338103c30 0x7f8338075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:35:29.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:35:29.921+0000 7f83377fe640 1 -- 172.21.15.119:0/3067521996 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8338109570 msgr2=0x7f8338075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:35:29.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:35:29.921+0000 7f83377fe640 1 --2- 172.21.15.119:0/3067521996 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8338109570 0x7f8338075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:35:29.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:35:29.921+0000 7f83377fe640 1 -- 172.21.15.119:0/3067521996 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83381a86d0 con 0x7f8338109ec0 2024-09-21T01:35:29.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:35:29.921+0000 7f83367fc640 1 --2- 172.21.15.119:0/3067521996 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8338109570 0x7f8338075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:35:29.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:35:29.922+0000 7f83377fe640 1 --2- 172.21.15.119:0/3067521996 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8338109ec0 0x7f8338076190 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f833000cab0 tx=0x7f833000cf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:35:29.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:35:29.922+0000 7f833c93c640 1 -- 172.21.15.119:0/3067521996 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f833000ae20 con 0x7f8338109ec0 2024-09-21T01:35:29.944 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:35:29.922+0000 7f833d93e640 1 -- 172.21.15.119:0/3067521996 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83381a89c0 con 0x7f8338109ec0 2024-09-21T01:35:29.945 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:35:29.922+0000 7f833c93c640 1 -- 172.21.15.119:0/3067521996 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f833000f8e0 con 0x7f8338109ec0 2024-09-21T01:35:29.945 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:35:29.922+0000 7f833c93c640 1 -- 172.21.15.119:0/3067521996 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83300189a0 con 0x7f8338109ec0 2024-09-21T01:35:29.945 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:35:29.922+0000 7f833d93e640 1 -- 172.21.15.119:0/3067521996 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83381a8ed0 con 0x7f8338109ec0 2024-09-21T01:35:29.945 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:35:29.923+0000 7f833d93e640 1 -- 172.21.15.119:0/3067521996 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8338104040 con 0x7f8338109ec0 2024-09-21T01:35:29.945 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:35:29.924+0000 7f833c93c640 1 -- 172.21.15.119:0/3067521996 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 20) ==== 154529+0+0 (secure 0 0 0) 0x7f833000f450 con 0x7f8338109ec0 2024-09-21T01:35:29.945 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:35:29.925+0000 7f833c93c640 1 --2- 172.21.15.119:0/3067521996 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f83200b6560 0x7f83200b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:35:29.945 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:35:29.926+0000 7f8336ffd640 1 --2- 172.21.15.119:0/3067521996 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f83200b6560 0x7f83200b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:35:29.945 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:35:29.926+0000 7f833c93c640 1 -- 172.21.15.119:0/3067521996 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 3604+0+0 (secure 0 0 0) 0x7f83300e64d0 con 0x7f8338109ec0 2024-09-21T01:35:29.945 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:35:29.926+0000 7f8336ffd640 1 --2- 172.21.15.119:0/3067521996 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f83200b6560 0x7f83200b8a70 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f8338077160 tx=0x7f8328005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:35:29.945 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:35:29.930+0000 7f833c93c640 1 -- 172.21.15.119:0/3067521996 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8330014030 con 0x7f8338109ec0 2024-09-21T01:35:30.053 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:29 smithi083 ceph-mon[31370]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-21T01:35:30.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:29 smithi083 ceph-mon[31370]: from='osd.3 [v2:172.21.15.83:6810/3746834093,v1:172.21.15.83:6811/3746834093]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-21T01:35:30.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:29 smithi083 ceph-mon[31370]: osdmap e23: 4 total, 3 up, 4 in 2024-09-21T01:35:30.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:29 smithi083 ceph-mon[31370]: from='osd.3 [v2:172.21.15.83:6810/3746834093,v1:172.21.15.83:6811/3746834093]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi083", "root=default"]} : dispatch 2024-09-21T01:35:30.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:29 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T01:35:30.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:29 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:35:30.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:29 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:35:30.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:29 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T01:35:30.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:29 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T01:35:30.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:29 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:35:30.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:29 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:35:30.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:29 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:35:30.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:29 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:35:30.127 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:35:30.126+0000 7f833d93e640 1 -- 172.21.15.119:0/3067521996 --> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi119:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f8338063800 con 0x7f83200b6560 2024-09-21T01:35:30.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:29 smithi142 ceph-mon[34050]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-21T01:35:30.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:29 smithi142 ceph-mon[34050]: from='osd.3 [v2:172.21.15.83:6810/3746834093,v1:172.21.15.83:6811/3746834093]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-21T01:35:30.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:29 smithi142 ceph-mon[34050]: osdmap e23: 4 total, 3 up, 4 in 2024-09-21T01:35:30.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:29 smithi142 ceph-mon[34050]: from='osd.3 [v2:172.21.15.83:6810/3746834093,v1:172.21.15.83:6811/3746834093]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi083", "root=default"]} : dispatch 2024-09-21T01:35:30.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:29 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T01:35:30.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:29 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:35:30.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:29 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:35:30.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:29 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T01:35:30.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:29 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T01:35:30.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:29 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:35:30.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:29 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:35:30.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:29 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:35:30.216 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:29 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:35:30.554 INFO:journalctl@ceph.osd.3.smithi083.stdout:Sep 21 01:35:30 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-3[54664]: 2024-09-21T01:35:30.144+0000 7ff194722640 -1 osd.3 0 waiting for initial osdmap 2024-09-21T01:35:30.554 INFO:journalctl@ceph.osd.3.smithi083.stdout:Sep 21 01:35:30 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-3[54664]: 2024-09-21T01:35:30.149+0000 7ff18c518640 -1 osd.3 24 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T01:35:30.855 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:30 smithi119 ceph-mon[33693]: Detected new or changed devices on smithi083 2024-09-21T01:35:30.855 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:30 smithi119 ceph-mon[33693]: Adjusting osd_memory_target on smithi083 to 8544M 2024-09-21T01:35:30.855 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:30 smithi119 ceph-mon[33693]: from='osd.3 [v2:172.21.15.83:6810/3746834093,v1:172.21.15.83:6811/3746834093]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi083", "root=default"]}]': finished 2024-09-21T01:35:30.855 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:30 smithi119 ceph-mon[33693]: osdmap e24: 4 total, 3 up, 4 in 2024-09-21T01:35:30.855 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:30 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T01:35:30.855 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:30 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T01:35:30.855 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:30 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T01:35:30.855 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:30 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T01:35:30.855 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:30 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:35:30.855 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:30 smithi119 ceph-mon[33693]: from='osd.3 [v2:172.21.15.83:6810/3746834093,v1:172.21.15.83:6811/3746834093]' entity='osd.3' 2024-09-21T01:35:31.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:30 smithi083 ceph-mon[31370]: Detected new or changed devices on smithi083 2024-09-21T01:35:31.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:30 smithi083 ceph-mon[31370]: Adjusting osd_memory_target on smithi083 to 8544M 2024-09-21T01:35:31.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:30 smithi083 ceph-mon[31370]: from='osd.3 [v2:172.21.15.83:6810/3746834093,v1:172.21.15.83:6811/3746834093]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi083", "root=default"]}]': finished 2024-09-21T01:35:31.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:30 smithi083 ceph-mon[31370]: osdmap e24: 4 total, 3 up, 4 in 2024-09-21T01:35:31.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:30 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T01:35:31.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:30 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T01:35:31.055 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:30 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T01:35:31.055 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:30 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T01:35:31.055 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:30 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:35:31.055 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:30 smithi083 ceph-mon[31370]: from='osd.3 [v2:172.21.15.83:6810/3746834093,v1:172.21.15.83:6811/3746834093]' entity='osd.3' 2024-09-21T01:35:31.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:30 smithi142 ceph-mon[34050]: Detected new or changed devices on smithi083 2024-09-21T01:35:31.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:30 smithi142 ceph-mon[34050]: Adjusting osd_memory_target on smithi083 to 8544M 2024-09-21T01:35:31.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:30 smithi142 ceph-mon[34050]: from='osd.3 [v2:172.21.15.83:6810/3746834093,v1:172.21.15.83:6811/3746834093]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi083", "root=default"]}]': finished 2024-09-21T01:35:31.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:30 smithi142 ceph-mon[34050]: osdmap e24: 4 total, 3 up, 4 in 2024-09-21T01:35:31.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:30 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T01:35:31.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:30 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T01:35:31.216 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:30 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T01:35:31.216 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:30 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T01:35:31.216 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:30 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:35:31.216 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:30 smithi142 ceph-mon[34050]: from='osd.3 [v2:172.21.15.83:6810/3746834093,v1:172.21.15.83:6811/3746834093]' entity='osd.3' 2024-09-21T01:35:32.017 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:31 smithi119 ceph-mon[33693]: purged_snaps scrub starts 2024-09-21T01:35:32.017 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:31 smithi119 ceph-mon[33693]: purged_snaps scrub ok 2024-09-21T01:35:32.017 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:31 smithi119 ceph-mon[33693]: from='client.14565 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi119:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:35:32.017 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:31 smithi119 ceph-mon[33693]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-21T01:35:32.017 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:31 smithi119 ceph-mon[33693]: osd.3 [v2:172.21.15.83:6810/3746834093,v1:172.21.15.83:6811/3746834093] boot 2024-09-21T01:35:32.017 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:31 smithi119 ceph-mon[33693]: osdmap e25: 4 total, 4 up, 4 in 2024-09-21T01:35:32.017 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:31 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T01:35:32.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:31 smithi083 ceph-mon[31370]: purged_snaps scrub starts 2024-09-21T01:35:32.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:31 smithi083 ceph-mon[31370]: purged_snaps scrub ok 2024-09-21T01:35:32.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:31 smithi083 ceph-mon[31370]: from='client.14565 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi119:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:35:32.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:31 smithi083 ceph-mon[31370]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-21T01:35:32.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:31 smithi083 ceph-mon[31370]: osd.3 [v2:172.21.15.83:6810/3746834093,v1:172.21.15.83:6811/3746834093] boot 2024-09-21T01:35:32.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:31 smithi083 ceph-mon[31370]: osdmap e25: 4 total, 4 up, 4 in 2024-09-21T01:35:32.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:31 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T01:35:32.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:31 smithi142 ceph-mon[34050]: purged_snaps scrub starts 2024-09-21T01:35:32.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:31 smithi142 ceph-mon[34050]: purged_snaps scrub ok 2024-09-21T01:35:32.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:31 smithi142 ceph-mon[34050]: from='client.14565 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi119:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:35:32.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:31 smithi142 ceph-mon[34050]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 92 MiB used, 268 GiB / 268 GiB avail 2024-09-21T01:35:32.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:31 smithi142 ceph-mon[34050]: osd.3 [v2:172.21.15.83:6810/3746834093,v1:172.21.15.83:6811/3746834093] boot 2024-09-21T01:35:32.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:31 smithi142 ceph-mon[34050]: osdmap e25: 4 total, 4 up, 4 in 2024-09-21T01:35:32.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:31 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T01:35:32.967 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:32 smithi119 ceph-mon[33693]: osdmap e26: 4 total, 4 up, 4 in 2024-09-21T01:35:32.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:32 smithi119 ceph-mon[33693]: from='client.? 172.21.15.119:0/1691419275' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "d6f2ec78-7f08-473b-a96c-e8590f5d2f25"} : dispatch 2024-09-21T01:35:32.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:32 smithi119 ceph-mon[33693]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "d6f2ec78-7f08-473b-a96c-e8590f5d2f25"} : dispatch 2024-09-21T01:35:32.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:32 smithi119 ceph-mon[33693]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d6f2ec78-7f08-473b-a96c-e8590f5d2f25"}]': finished 2024-09-21T01:35:32.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:32 smithi119 ceph-mon[33693]: osdmap e27: 5 total, 4 up, 5 in 2024-09-21T01:35:32.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:32 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T01:35:33.053 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:32 smithi083 ceph-mon[31370]: osdmap e26: 4 total, 4 up, 4 in 2024-09-21T01:35:33.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:32 smithi083 ceph-mon[31370]: from='client.? 172.21.15.119:0/1691419275' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "d6f2ec78-7f08-473b-a96c-e8590f5d2f25"} : dispatch 2024-09-21T01:35:33.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:32 smithi083 ceph-mon[31370]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "d6f2ec78-7f08-473b-a96c-e8590f5d2f25"} : dispatch 2024-09-21T01:35:33.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:32 smithi083 ceph-mon[31370]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d6f2ec78-7f08-473b-a96c-e8590f5d2f25"}]': finished 2024-09-21T01:35:33.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:32 smithi083 ceph-mon[31370]: osdmap e27: 5 total, 4 up, 5 in 2024-09-21T01:35:33.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:32 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T01:35:33.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:32 smithi142 ceph-mon[34050]: osdmap e26: 4 total, 4 up, 4 in 2024-09-21T01:35:33.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:32 smithi142 ceph-mon[34050]: from='client.? 172.21.15.119:0/1691419275' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "d6f2ec78-7f08-473b-a96c-e8590f5d2f25"} : dispatch 2024-09-21T01:35:33.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:32 smithi142 ceph-mon[34050]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "d6f2ec78-7f08-473b-a96c-e8590f5d2f25"} : dispatch 2024-09-21T01:35:33.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:32 smithi142 ceph-mon[34050]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d6f2ec78-7f08-473b-a96c-e8590f5d2f25"}]': finished 2024-09-21T01:35:33.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:32 smithi142 ceph-mon[34050]: osdmap e27: 5 total, 4 up, 5 in 2024-09-21T01:35:33.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:32 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T01:35:34.053 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:33 smithi083 ceph-mon[31370]: pgmap v87: 1 pgs: 1 remapped+peering; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-21T01:35:34.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:33 smithi083 ceph-mon[31370]: from='client.? 172.21.15.119:0/1013753270' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T01:35:34.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:33 smithi142 ceph-mon[34050]: pgmap v87: 1 pgs: 1 remapped+peering; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-21T01:35:34.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:33 smithi142 ceph-mon[34050]: from='client.? 172.21.15.119:0/1013753270' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T01:35:34.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:33 smithi119 ceph-mon[33693]: pgmap v87: 1 pgs: 1 remapped+peering; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-21T01:35:34.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:33 smithi119 ceph-mon[33693]: from='client.? 172.21.15.119:0/1013753270' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T01:35:36.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:35 smithi083 ceph-mon[31370]: pgmap v88: 1 pgs: 1 remapped+peering; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-21T01:35:36.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:35 smithi142 ceph-mon[34050]: pgmap v88: 1 pgs: 1 remapped+peering; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-21T01:35:36.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:35 smithi119 ceph-mon[33693]: pgmap v88: 1 pgs: 1 remapped+peering; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-21T01:35:37.967 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:37 smithi119 ceph-mon[33693]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T01:35:38.053 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:37 smithi083 ceph-mon[31370]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T01:35:38.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:37 smithi142 ceph-mon[34050]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T01:35:39.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:39 smithi119 ceph-mon[33693]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T01:35:40.053 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:39 smithi083 ceph-mon[31370]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T01:35:40.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:39 smithi142 ceph-mon[34050]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T01:35:42.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:41 smithi083 ceph-mon[31370]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 64 KiB/s, 0 objects/s recovering 2024-09-21T01:35:42.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:41 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-21T01:35:42.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:41 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:35:42.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:41 smithi083 ceph-mon[31370]: Deploying daemon osd.4 on smithi119 2024-09-21T01:35:42.061 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:41 smithi119 ceph-mon[33693]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 64 KiB/s, 0 objects/s recovering 2024-09-21T01:35:42.061 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:41 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-21T01:35:42.062 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:41 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:35:42.062 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:41 smithi119 ceph-mon[33693]: Deploying daemon osd.4 on smithi119 2024-09-21T01:35:42.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:41 smithi142 ceph-mon[34050]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 64 KiB/s, 0 objects/s recovering 2024-09-21T01:35:42.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:41 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-21T01:35:42.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:41 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:35:42.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:41 smithi142 ceph-mon[34050]: Deploying daemon osd.4 on smithi119 2024-09-21T01:35:43.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:43 smithi119 ceph-mon[33693]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 56 KiB/s, 0 objects/s recovering 2024-09-21T01:35:44.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:43 smithi083 ceph-mon[31370]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 56 KiB/s, 0 objects/s recovering 2024-09-21T01:35:44.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:43 smithi142 ceph-mon[34050]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 56 KiB/s, 0 objects/s recovering 2024-09-21T01:35:46.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:45 smithi083 ceph-mon[31370]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T01:35:46.092 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:45 smithi119 ceph-mon[33693]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T01:35:46.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:45 smithi142 ceph-mon[34050]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T01:35:48.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:47 smithi083 ceph-mon[31370]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T01:35:48.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:47 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:35:48.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:47 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:35:48.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:47 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:35:48.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:47 smithi142 ceph-mon[34050]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T01:35:48.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:47 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:35:48.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:47 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:35:48.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:47 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:35:48.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:47 smithi119 ceph-mon[33693]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T01:35:48.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:47 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:35:48.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:47 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:35:48.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:47 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:35:50.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:49 smithi083 ceph-mon[31370]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-21T01:35:50.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:49 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:35:50.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:49 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:35:50.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:49 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:35:50.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:49 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:35:50.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:49 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:35:50.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:49 smithi142 ceph-mon[34050]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-21T01:35:50.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:49 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:35:50.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:49 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:35:50.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:49 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:35:50.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:49 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:35:50.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:49 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:35:50.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:49 smithi119 ceph-mon[33693]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-21T01:35:50.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:49 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:35:50.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:49 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:35:50.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:49 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:35:50.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:49 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:35:50.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:49 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:35:51.098 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:35:51.097+0000 7f833c93c640 1 -- 172.21.15.119:0/3067521996 <== mgr.14223 v2:172.21.15.83:6800/1748483157 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f8338063800 con 0x7f83200b6560 2024-09-21T01:35:51.099 INFO:teuthology.orchestra.run.smithi119.stdout:Created osd(s) 4 on host 'smithi119' 2024-09-21T01:35:51.101 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:35:51.100+0000 7f833d93e640 1 -- 172.21.15.119:0/3067521996 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f83200b6560 msgr2=0x7f83200b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:35:51.101 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:35:51.100+0000 7f833d93e640 1 --2- 172.21.15.119:0/3067521996 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f83200b6560 0x7f83200b8a70 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f8338077160 tx=0x7f8328005f90 comp rx=0 tx=0).stop 2024-09-21T01:35:51.102 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:35:51.100+0000 7f833d93e640 1 -- 172.21.15.119:0/3067521996 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8338109ec0 msgr2=0x7f8338076190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:35:51.102 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:35:51.100+0000 7f833d93e640 1 --2- 172.21.15.119:0/3067521996 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8338109ec0 0x7f8338076190 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f833000cab0 tx=0x7f833000cf70 comp rx=0 tx=0).stop 2024-09-21T01:35:51.102 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:35:51.100+0000 7f833d93e640 1 -- 172.21.15.119:0/3067521996 shutdown_connections 2024-09-21T01:35:51.102 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:35:51.100+0000 7f833d93e640 1 --2- 172.21.15.119:0/3067521996 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f83200b6560 0x7f83200b8a70 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:35:51.102 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:35:51.100+0000 7f833d93e640 1 --2- 172.21.15.119:0/3067521996 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8338109ec0 0x7f8338076190 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:35:51.102 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:35:51.100+0000 7f833d93e640 1 --2- 172.21.15.119:0/3067521996 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8338109570 0x7f8338075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:35:51.102 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:35:51.100+0000 7f833d93e640 1 --2- 172.21.15.119:0/3067521996 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8338103c30 0x7f8338075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:35:51.102 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:35:51.100+0000 7f833d93e640 1 -- 172.21.15.119:0/3067521996 >> 172.21.15.119:0/3067521996 conn(0x7f833807b8d0 msgr2=0x7f83381056f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:35:51.102 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:35:51.100+0000 7f833d93e640 1 -- 172.21.15.119:0/3067521996 shutdown_connections 2024-09-21T01:35:51.103 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:35:51.100+0000 7f833d93e640 1 -- 172.21.15.119:0/3067521996 wait complete. 2024-09-21T01:35:51.690 DEBUG:teuthology.orchestra.run.smithi119:osd.4> sudo journalctl -f -n 0 -u ceph-f7697ecc-77b8-11ef-baf5-efdc52797490@osd.4.service 2024-09-21T01:35:51.693 INFO:tasks.cephadm:Deploying osd.5 on smithi142 with /dev/vg_nvme/lv_3... 2024-09-21T01:35:51.693 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_3 2024-09-21T01:35:51.949 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T01:35:51.953 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:51 smithi119 ceph-mon[33693]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-21T01:35:51.953 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:51 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:35:51.953 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:51 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:35:51.953 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:51 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:35:52.016 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:51 smithi142 ceph-mon[34050]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-21T01:35:52.016 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:51 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:35:52.017 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:51 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:35:52.017 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:51 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:35:52.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:51 smithi083 ceph-mon[31370]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-21T01:35:52.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:51 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:35:52.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:51 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:35:52.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:51 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:35:53.051 INFO:journalctl@ceph.osd.4.smithi119.stdout:Sep 21 01:35:52 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-4[44791]: 2024-09-21T01:35:52.789+0000 7f20de52d640 -1 osd.4 0 log_to_monitors true 2024-09-21T01:35:54.053 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:53 smithi083 ceph-mon[31370]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-21T01:35:54.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:53 smithi083 ceph-mon[31370]: from='osd.4 [v2:172.21.15.119:6808/3083907785,v1:172.21.15.119:6809/3083907785]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T01:35:54.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:53 smithi083 ceph-mon[31370]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T01:35:54.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:53 smithi142 ceph-mon[34050]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-21T01:35:54.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:53 smithi142 ceph-mon[34050]: from='osd.4 [v2:172.21.15.119:6808/3083907785,v1:172.21.15.119:6809/3083907785]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T01:35:54.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:53 smithi142 ceph-mon[34050]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T01:35:54.216 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:53 smithi119 ceph-mon[33693]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-21T01:35:54.216 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:53 smithi119 ceph-mon[33693]: from='osd.4 [v2:172.21.15.119:6808/3083907785,v1:172.21.15.119:6809/3083907785]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T01:35:54.216 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:53 smithi119 ceph-mon[33693]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T01:35:54.497 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-21T01:35:54.522 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi142:vg_nvme/lv_3 2024-09-21T01:35:54.773 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T01:35:54.794 INFO:journalctl@ceph.osd.4.smithi119.stdout:Sep 21 01:35:54 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-4[44791]: 2024-09-21T01:35:54.787+0000 7f20da4af640 -1 osd.4 0 waiting for initial osdmap 2024-09-21T01:35:54.794 INFO:journalctl@ceph.osd.4.smithi119.stdout:Sep 21 01:35:54 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-4[44791]: 2024-09-21T01:35:54.793+0000 7f20d62ad640 -1 osd.4 29 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T01:35:54.794 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:54 smithi119 ceph-mon[33693]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-21T01:35:54.794 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:54 smithi119 ceph-mon[33693]: from='osd.4 [v2:172.21.15.119:6808/3083907785,v1:172.21.15.119:6809/3083907785]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi119", "root=default"]} : dispatch 2024-09-21T01:35:54.795 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:54 smithi119 ceph-mon[33693]: osdmap e28: 5 total, 4 up, 5 in 2024-09-21T01:35:54.795 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:54 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T01:35:54.795 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:54 smithi119 ceph-mon[33693]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi119", "root=default"]} : dispatch 2024-09-21T01:35:54.795 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:54 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:35:54.795 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:54 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:35:54.795 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:54 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T01:35:54.795 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:54 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T01:35:54.795 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:54 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:35:54.795 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:54 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:35:54.795 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:54 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:35:54.795 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:54 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:35:55.038 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:54 smithi142 ceph-mon[34050]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-21T01:35:55.038 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:54 smithi142 ceph-mon[34050]: from='osd.4 [v2:172.21.15.119:6808/3083907785,v1:172.21.15.119:6809/3083907785]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi119", "root=default"]} : dispatch 2024-09-21T01:35:55.038 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:54 smithi142 ceph-mon[34050]: osdmap e28: 5 total, 4 up, 5 in 2024-09-21T01:35:55.038 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:54 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T01:35:55.038 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:54 smithi142 ceph-mon[34050]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi119", "root=default"]} : dispatch 2024-09-21T01:35:55.038 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:54 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:35:55.038 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:54 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:35:55.038 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:54 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T01:35:55.038 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:54 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T01:35:55.039 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:54 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:35:55.039 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:54 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:35:55.039 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:54 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:35:55.039 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:54 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:35:55.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:54 smithi083 ceph-mon[31370]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-21T01:35:55.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:54 smithi083 ceph-mon[31370]: from='osd.4 [v2:172.21.15.119:6808/3083907785,v1:172.21.15.119:6809/3083907785]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi119", "root=default"]} : dispatch 2024-09-21T01:35:55.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:54 smithi083 ceph-mon[31370]: osdmap e28: 5 total, 4 up, 5 in 2024-09-21T01:35:55.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:54 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T01:35:55.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:54 smithi083 ceph-mon[31370]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi119", "root=default"]} : dispatch 2024-09-21T01:35:55.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:54 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:35:55.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:54 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:35:55.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:54 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T01:35:55.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:54 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T01:35:55.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:54 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:35:55.055 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:54 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:35:55.055 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:54 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:35:55.055 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:54 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:35:55.256 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:35:55.249+0000 7f46bf6a6640 1 -- 172.21.15.142:0/1035676631 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f46b8106c80 msgr2=0x7f46b8110710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:35:55.256 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:35:55.249+0000 7f46bf6a6640 1 --2- 172.21.15.142:0/1035676631 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f46b8106c80 0x7f46b8110710 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f46b0009930 tx=0x7f46b002a420 comp rx=0 tx=0).stop 2024-09-21T01:35:55.256 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:35:55.249+0000 7f46bf6a6640 1 -- 172.21.15.142:0/1035676631 shutdown_connections 2024-09-21T01:35:55.256 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:35:55.249+0000 7f46bf6a6640 1 --2- 172.21.15.142:0/1035676631 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f46b8106c80 0x7f46b8110710 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:35:55.256 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:35:55.249+0000 7f46bf6a6640 1 --2- 172.21.15.142:0/1035676631 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f46b8106330 0x7f46b8106740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:35:55.256 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:35:55.249+0000 7f46bf6a6640 1 --2- 172.21.15.142:0/1035676631 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f46b81020e0 0x7f46b81024f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:35:55.256 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:35:55.249+0000 7f46bf6a6640 1 -- 172.21.15.142:0/1035676631 >> 172.21.15.142:0/1035676631 conn(0x7f46b8079ec0 msgr2=0x7f46b807a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:35:55.256 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:35:55.249+0000 7f46bf6a6640 1 -- 172.21.15.142:0/1035676631 shutdown_connections 2024-09-21T01:35:55.256 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:35:55.249+0000 7f46bf6a6640 1 -- 172.21.15.142:0/1035676631 wait complete. 2024-09-21T01:35:55.256 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:35:55.250+0000 7f46bf6a6640 1 Processor -- start 2024-09-21T01:35:55.256 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:35:55.250+0000 7f46bf6a6640 1 -- start start 2024-09-21T01:35:55.257 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:35:55.250+0000 7f46bf6a6640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f46b81020e0 0x7f46b819a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:35:55.257 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:35:55.250+0000 7f46bf6a6640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f46b8106330 0x7f46b819aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:35:55.257 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:35:55.250+0000 7f46bf6a6640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f46b8106c80 0x7f46b819fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:35:55.257 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:35:55.250+0000 7f46bf6a6640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f46b8113a20 con 0x7f46b8106c80 2024-09-21T01:35:55.257 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:35:55.250+0000 7f46bf6a6640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f46b81138a0 con 0x7f46b8106330 2024-09-21T01:35:55.257 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:35:55.250+0000 7f46bf6a6640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f46b8113ba0 con 0x7f46b81020e0 2024-09-21T01:35:55.257 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:35:55.250+0000 7f46bd442640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f46b81020e0 0x7f46b819a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:35:55.257 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:35:55.250+0000 7f46bd442640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f46b81020e0 0x7f46b819a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:60026/0 (socket says 172.21.15.142:60026) 2024-09-21T01:35:55.257 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:35:55.250+0000 7f46bd442640 1 -- 172.21.15.142:0/3488025613 learned_addr learned my addr 172.21.15.142:0/3488025613 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-21T01:35:55.257 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:35:55.250+0000 7f46bcc41640 1 --2- 172.21.15.142:0/3488025613 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f46b8106330 0x7f46b819aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:35:55.257 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:35:55.250+0000 7f46bd442640 1 -- 172.21.15.142:0/3488025613 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f46b8106330 msgr2=0x7f46b819aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:35:55.257 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:35:55.250+0000 7f46bdc43640 1 --2- 172.21.15.142:0/3488025613 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f46b8106c80 0x7f46b819fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:35:55.257 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:35:55.250+0000 7f46bd442640 1 --2- 172.21.15.142:0/3488025613 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f46b8106330 0x7f46b819aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:35:55.258 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:35:55.250+0000 7f46bd442640 1 -- 172.21.15.142:0/3488025613 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f46b8106c80 msgr2=0x7f46b819fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:35:55.258 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:35:55.250+0000 7f46bd442640 1 --2- 172.21.15.142:0/3488025613 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f46b8106c80 0x7f46b819fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:35:55.258 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:35:55.250+0000 7f46bd442640 1 -- 172.21.15.142:0/3488025613 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46b81a0400 con 0x7f46b81020e0 2024-09-21T01:35:55.258 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:35:55.250+0000 7f46bdc43640 1 --2- 172.21.15.142:0/3488025613 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f46b8106c80 0x7f46b819fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:35:55.258 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:35:55.251+0000 7f46bd442640 1 --2- 172.21.15.142:0/3488025613 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f46b81020e0 0x7f46b819a490 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f46a800ea80 tx=0x7f46a800ef40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:35:55.258 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:35:55.251+0000 7f46b67fc640 1 -- 172.21.15.142:0/3488025613 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46a800ce40 con 0x7f46b81020e0 2024-09-21T01:35:55.258 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:35:55.251+0000 7f46b67fc640 1 -- 172.21.15.142:0/3488025613 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f46a8011900 con 0x7f46b81020e0 2024-09-21T01:35:55.258 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:35:55.251+0000 7f46bf6a6640 1 -- 172.21.15.142:0/3488025613 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46b81a06f0 con 0x7f46b81020e0 2024-09-21T01:35:55.258 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:35:55.251+0000 7f46b67fc640 1 -- 172.21.15.142:0/3488025613 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46a801a9e0 con 0x7f46b81020e0 2024-09-21T01:35:55.258 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:35:55.251+0000 7f46bf6a6640 1 -- 172.21.15.142:0/3488025613 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46b81a6e50 con 0x7f46b81020e0 2024-09-21T01:35:55.258 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:35:55.252+0000 7f46bf6a6640 1 -- 172.21.15.142:0/3488025613 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46b81024f0 con 0x7f46b81020e0 2024-09-21T01:35:55.259 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:35:55.254+0000 7f46b67fc640 1 -- 172.21.15.142:0/3488025613 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 20) ==== 154529+0+0 (secure 0 0 0) 0x7f46a801ab80 con 0x7f46b81020e0 2024-09-21T01:35:55.259 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:35:55.255+0000 7f46b67fc640 1 --2- 172.21.15.142:0/3488025613 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f46a00b6560 0x7f46a00b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:35:55.259 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:35:55.255+0000 7f46b67fc640 1 -- 172.21.15.142:0/3488025613 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 4036+0+0 (secure 0 0 0) 0x7f46a80e6a10 con 0x7f46b81020e0 2024-09-21T01:35:55.259 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:35:55.255+0000 7f46bcc41640 1 --2- 172.21.15.142:0/3488025613 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f46a00b6560 0x7f46a00b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:35:55.259 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:35:55.256+0000 7f46bcc41640 1 --2- 172.21.15.142:0/3488025613 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f46a00b6560 0x7f46a00b8a70 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f46b806b200 tx=0x7f46ac00b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:35:55.259 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:35:55.259+0000 7f46b67fc640 1 -- 172.21.15.142:0/3488025613 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f46a8058710 con 0x7f46b81020e0 2024-09-21T01:35:55.444 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:35:55.443+0000 7f46bf6a6640 1 -- 172.21.15.142:0/3488025613 --> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi142:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f46b8063800 con 0x7f46a00b6560 2024-09-21T01:35:56.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:55 smithi083 ceph-mon[31370]: Detected new or changed devices on smithi119 2024-09-21T01:35:56.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:55 smithi083 ceph-mon[31370]: Adjusting osd_memory_target on smithi119 to 8544M 2024-09-21T01:35:56.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:55 smithi083 ceph-mon[31370]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-21T01:35:56.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:55 smithi083 ceph-mon[31370]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]': finished 2024-09-21T01:35:56.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:55 smithi083 ceph-mon[31370]: osdmap e29: 5 total, 4 up, 5 in 2024-09-21T01:35:56.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:55 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T01:35:56.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:55 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T01:35:56.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:55 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T01:35:56.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:55 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T01:35:56.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:55 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:35:56.125 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:55 smithi142 ceph-mon[34050]: Detected new or changed devices on smithi119 2024-09-21T01:35:56.125 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:55 smithi142 ceph-mon[34050]: Adjusting osd_memory_target on smithi119 to 8544M 2024-09-21T01:35:56.126 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:55 smithi142 ceph-mon[34050]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-21T01:35:56.126 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:55 smithi142 ceph-mon[34050]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]': finished 2024-09-21T01:35:56.126 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:55 smithi142 ceph-mon[34050]: osdmap e29: 5 total, 4 up, 5 in 2024-09-21T01:35:56.126 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:55 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T01:35:56.126 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:55 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T01:35:56.126 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:55 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T01:35:56.127 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:55 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T01:35:56.127 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:55 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:35:56.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:55 smithi119 ceph-mon[33693]: Detected new or changed devices on smithi119 2024-09-21T01:35:56.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:55 smithi119 ceph-mon[33693]: Adjusting osd_memory_target on smithi119 to 8544M 2024-09-21T01:35:56.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:55 smithi119 ceph-mon[33693]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-21T01:35:56.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:55 smithi119 ceph-mon[33693]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]': finished 2024-09-21T01:35:56.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:55 smithi119 ceph-mon[33693]: osdmap e29: 5 total, 4 up, 5 in 2024-09-21T01:35:56.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:55 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T01:35:56.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:55 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T01:35:56.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:55 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T01:35:56.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:55 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T01:35:56.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:55 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:35:56.964 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:56 smithi142 ceph-mon[34050]: purged_snaps scrub starts 2024-09-21T01:35:56.965 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:56 smithi142 ceph-mon[34050]: purged_snaps scrub ok 2024-09-21T01:35:56.965 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:56 smithi142 ceph-mon[34050]: from='client.24388 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi142:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:35:56.965 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:56 smithi142 ceph-mon[34050]: osd.4 [v2:172.21.15.119:6808/3083907785,v1:172.21.15.119:6809/3083907785] boot 2024-09-21T01:35:56.965 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:56 smithi142 ceph-mon[34050]: osdmap e30: 5 total, 5 up, 5 in 2024-09-21T01:35:56.965 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:56 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T01:35:57.053 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:56 smithi083 ceph-mon[31370]: purged_snaps scrub starts 2024-09-21T01:35:57.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:56 smithi083 ceph-mon[31370]: purged_snaps scrub ok 2024-09-21T01:35:57.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:56 smithi083 ceph-mon[31370]: from='client.24388 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi142:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:35:57.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:56 smithi083 ceph-mon[31370]: osd.4 [v2:172.21.15.119:6808/3083907785,v1:172.21.15.119:6809/3083907785] boot 2024-09-21T01:35:57.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:56 smithi083 ceph-mon[31370]: osdmap e30: 5 total, 5 up, 5 in 2024-09-21T01:35:57.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:56 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T01:35:57.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:56 smithi119 ceph-mon[33693]: purged_snaps scrub starts 2024-09-21T01:35:57.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:56 smithi119 ceph-mon[33693]: purged_snaps scrub ok 2024-09-21T01:35:57.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:56 smithi119 ceph-mon[33693]: from='client.24388 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi142:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:35:57.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:56 smithi119 ceph-mon[33693]: osd.4 [v2:172.21.15.119:6808/3083907785,v1:172.21.15.119:6809/3083907785] boot 2024-09-21T01:35:57.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:56 smithi119 ceph-mon[33693]: osdmap e30: 5 total, 5 up, 5 in 2024-09-21T01:35:57.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:56 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T01:35:58.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:57 smithi083 ceph-mon[31370]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-21T01:35:58.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:57 smithi083 ceph-mon[31370]: osdmap e31: 5 total, 5 up, 5 in 2024-09-21T01:35:58.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:57 smithi083 ceph-mon[31370]: from='client.? 172.21.15.142:0/2284382164' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c571d04d-d3ea-4d74-8867-e4c7816f4e0e"} : dispatch 2024-09-21T01:35:58.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:57 smithi083 ceph-mon[31370]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c571d04d-d3ea-4d74-8867-e4c7816f4e0e"} : dispatch 2024-09-21T01:35:58.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:57 smithi083 ceph-mon[31370]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c571d04d-d3ea-4d74-8867-e4c7816f4e0e"}]': finished 2024-09-21T01:35:58.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:57 smithi083 ceph-mon[31370]: osdmap e32: 6 total, 5 up, 6 in 2024-09-21T01:35:58.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:57 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T01:35:58.082 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:57 smithi142 ceph-mon[34050]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-21T01:35:58.082 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:57 smithi142 ceph-mon[34050]: osdmap e31: 5 total, 5 up, 5 in 2024-09-21T01:35:58.082 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:57 smithi142 ceph-mon[34050]: from='client.? 172.21.15.142:0/2284382164' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c571d04d-d3ea-4d74-8867-e4c7816f4e0e"} : dispatch 2024-09-21T01:35:58.082 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:57 smithi142 ceph-mon[34050]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c571d04d-d3ea-4d74-8867-e4c7816f4e0e"} : dispatch 2024-09-21T01:35:58.082 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:57 smithi142 ceph-mon[34050]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c571d04d-d3ea-4d74-8867-e4c7816f4e0e"}]': finished 2024-09-21T01:35:58.083 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:57 smithi142 ceph-mon[34050]: osdmap e32: 6 total, 5 up, 6 in 2024-09-21T01:35:58.083 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:57 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T01:35:58.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:57 smithi119 ceph-mon[33693]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-21T01:35:58.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:57 smithi119 ceph-mon[33693]: osdmap e31: 5 total, 5 up, 5 in 2024-09-21T01:35:58.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:57 smithi119 ceph-mon[33693]: from='client.? 172.21.15.142:0/2284382164' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c571d04d-d3ea-4d74-8867-e4c7816f4e0e"} : dispatch 2024-09-21T01:35:58.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:57 smithi119 ceph-mon[33693]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c571d04d-d3ea-4d74-8867-e4c7816f4e0e"} : dispatch 2024-09-21T01:35:58.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:57 smithi119 ceph-mon[33693]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c571d04d-d3ea-4d74-8867-e4c7816f4e0e"}]': finished 2024-09-21T01:35:58.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:57 smithi119 ceph-mon[33693]: osdmap e32: 6 total, 5 up, 6 in 2024-09-21T01:35:58.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:57 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T01:35:59.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:58 smithi142 ceph-mon[34050]: from='client.? 172.21.15.142:0/3170793547' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T01:35:59.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:58 smithi119 ceph-mon[33693]: from='client.? 172.21.15.142:0/3170793547' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T01:35:59.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:58 smithi083 ceph-mon[31370]: from='client.? 172.21.15.142:0/3170793547' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T01:36:00.204 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:35:59 smithi083 ceph-mon[31370]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-21T01:36:00.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:35:59 smithi142 ceph-mon[34050]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-21T01:36:00.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:35:59 smithi119 ceph-mon[33693]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-21T01:36:02.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:36:01 smithi142 ceph-mon[34050]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-21T01:36:02.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:36:01 smithi119 ceph-mon[33693]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-21T01:36:02.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:36:01 smithi083 ceph-mon[31370]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-21T01:36:04.106 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:36:03 smithi142 ceph-mon[34050]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-21T01:36:04.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:36:03 smithi119 ceph-mon[33693]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-21T01:36:04.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:36:03 smithi083 ceph-mon[31370]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-21T01:36:06.017 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:36:05 smithi142 ceph-mon[34050]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-21T01:36:06.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:36:05 smithi119 ceph-mon[33693]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-21T01:36:06.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:36:05 smithi083 ceph-mon[31370]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-21T01:36:06.964 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:36:06 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-21T01:36:06.964 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:36:06 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:36:07.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:36:06 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-21T01:36:07.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:36:06 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:36:07.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:36:06 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-21T01:36:07.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:36:06 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:36:07.875 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:36:07 smithi142 ceph-mon[34050]: Deploying daemon osd.5 on smithi142 2024-09-21T01:36:07.875 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:36:07 smithi142 ceph-mon[34050]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-21T01:36:08.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:36:07 smithi119 ceph-mon[33693]: Deploying daemon osd.5 on smithi142 2024-09-21T01:36:08.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:36:07 smithi119 ceph-mon[33693]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-21T01:36:08.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:36:07 smithi083 ceph-mon[31370]: Deploying daemon osd.5 on smithi142 2024-09-21T01:36:08.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:36:07 smithi083 ceph-mon[31370]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-21T01:36:09.201 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:36:08 smithi142 ceph-mon[34050]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-21T01:36:09.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:36:08 smithi119 ceph-mon[33693]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-21T01:36:09.305 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:36:08 smithi083 ceph-mon[31370]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-21T01:36:11.899 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:36:11 smithi142 ceph-mon[34050]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-21T01:36:12.053 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:36:11 smithi083 ceph-mon[31370]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-21T01:36:12.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:36:11 smithi119 ceph-mon[33693]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-21T01:36:12.867 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:36:12 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:36:12.867 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:36:12 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:36:12.868 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:36:12 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:36:13.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:36:12 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:36:13.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:36:12 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:36:13.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:36:12 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:36:13.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:36:12 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:36:13.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:36:12 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:36:13.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:36:12 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:36:14.026 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:36:13 smithi142 ceph-mon[34050]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-21T01:36:14.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:36:13 smithi083 ceph-mon[31370]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-21T01:36:14.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:36:13 smithi119 ceph-mon[33693]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-21T01:36:15.964 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:36:15 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:36:15.964 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:36:15 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:36:15.964 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:36:15 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:36:15.965 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:36:15 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:36:15.965 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:36:15 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:36:15.965 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:36:15 smithi142 ceph-mon[34050]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-21T01:36:15.967 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:36:15 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:36:15.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:36:15 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:36:15.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:36:15 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:36:15.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:36:15 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:36:15.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:36:15 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:36:15.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:36:15 smithi119 ceph-mon[33693]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-21T01:36:16.015 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:36:16.014+0000 7f46b67fc640 1 -- 172.21.15.142:0/3488025613 <== mgr.14223 v2:172.21.15.83:6800/1748483157 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f46b8063800 con 0x7f46a00b6560 2024-09-21T01:36:16.015 INFO:teuthology.orchestra.run.smithi142.stdout:Created osd(s) 5 on host 'smithi142' 2024-09-21T01:36:16.017 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:36:16.017+0000 7f46bf6a6640 1 -- 172.21.15.142:0/3488025613 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f46a00b6560 msgr2=0x7f46a00b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:36:16.017 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:36:16.017+0000 7f46bf6a6640 1 --2- 172.21.15.142:0/3488025613 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f46a00b6560 0x7f46a00b8a70 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f46b806b200 tx=0x7f46ac00b390 comp rx=0 tx=0).stop 2024-09-21T01:36:16.017 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:36:16.017+0000 7f46bf6a6640 1 -- 172.21.15.142:0/3488025613 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f46b81020e0 msgr2=0x7f46b819a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:36:16.017 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:36:16.017+0000 7f46bf6a6640 1 --2- 172.21.15.142:0/3488025613 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f46b81020e0 0x7f46b819a490 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f46a800ea80 tx=0x7f46a800ef40 comp rx=0 tx=0).stop 2024-09-21T01:36:16.017 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:36:16.017+0000 7f46bf6a6640 1 -- 172.21.15.142:0/3488025613 shutdown_connections 2024-09-21T01:36:16.017 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:36:16.017+0000 7f46bf6a6640 1 --2- 172.21.15.142:0/3488025613 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f46a00b6560 0x7f46a00b8a70 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:36:16.018 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:36:16.017+0000 7f46bf6a6640 1 --2- 172.21.15.142:0/3488025613 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f46b8106c80 0x7f46b819fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:36:16.018 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:36:16.017+0000 7f46bf6a6640 1 --2- 172.21.15.142:0/3488025613 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f46b8106330 0x7f46b819aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:36:16.018 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:36:16.017+0000 7f46bf6a6640 1 --2- 172.21.15.142:0/3488025613 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f46b81020e0 0x7f46b819a490 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:36:16.018 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:36:16.017+0000 7f46bf6a6640 1 -- 172.21.15.142:0/3488025613 >> 172.21.15.142:0/3488025613 conn(0x7f46b8079ec0 msgr2=0x7f46b8107600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:36:16.018 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:36:16.017+0000 7f46bf6a6640 1 -- 172.21.15.142:0/3488025613 shutdown_connections 2024-09-21T01:36:16.018 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:36:16.017+0000 7f46bf6a6640 1 -- 172.21.15.142:0/3488025613 wait complete. 2024-09-21T01:36:16.053 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:36:15 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:36:16.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:36:15 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:36:16.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:36:15 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:36:16.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:36:15 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:36:16.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:36:15 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:36:16.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:36:15 smithi083 ceph-mon[31370]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-21T01:36:16.628 DEBUG:teuthology.orchestra.run.smithi142:osd.5> sudo journalctl -f -n 0 -u ceph-f7697ecc-77b8-11ef-baf5-efdc52797490@osd.5.service 2024-09-21T01:36:16.630 INFO:tasks.cephadm:Deploying osd.6 on smithi083 with /dev/vg_nvme/lv_2... 2024-09-21T01:36:16.631 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_2 2024-09-21T01:36:16.851 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:36:16 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:36:16.851 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:36:16 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:36:16.852 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:36:16 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:36:16.891 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:36:16.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:36:16 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:36:16.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:36:16 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:36:16.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:36:16 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:36:17.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:36:16 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:36:17.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:36:16 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:36:17.012 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:36:16 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:36:17.882 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:36:17 smithi142 ceph-mon[34050]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-21T01:36:17.967 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:36:17 smithi119 ceph-mon[33693]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-21T01:36:18.027 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:36:17 smithi083 ceph-mon[31370]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-21T01:36:18.714 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:36:18 smithi142 ceph-mon[34050]: from='osd.5 [v2:172.21.15.142:6808/349001002,v1:172.21.15.142:6809/349001002]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T01:36:18.715 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:36:18 smithi142 ceph-mon[34050]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T01:36:18.715 INFO:journalctl@ceph.osd.5.smithi142.stdout:Sep 21 01:36:18 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-5[45407]: 2024-09-21T01:36:18.452+0000 7f73a8048640 -1 osd.5 0 log_to_monitors true 2024-09-21T01:36:18.856 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:36:18 smithi083 ceph-mon[31370]: from='osd.5 [v2:172.21.15.142:6808/349001002,v1:172.21.15.142:6809/349001002]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T01:36:18.857 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:36:18 smithi083 ceph-mon[31370]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T01:36:18.967 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:36:18 smithi119 ceph-mon[33693]: from='osd.5 [v2:172.21.15.142:6808/349001002,v1:172.21.15.142:6809/349001002]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T01:36:18.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:36:18 smithi119 ceph-mon[33693]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T01:36:19.476 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T01:36:19.506 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi083:vg_nvme/lv_2 2024-09-21T01:36:19.750 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:36:19.804 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:36:19 smithi083 ceph-mon[31370]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-21T01:36:19.804 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:36:19 smithi083 ceph-mon[31370]: osdmap e33: 6 total, 5 up, 6 in 2024-09-21T01:36:19.804 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:36:19 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T01:36:19.804 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:36:19 smithi083 ceph-mon[31370]: from='osd.5 [v2:172.21.15.142:6808/349001002,v1:172.21.15.142:6809/349001002]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi142", "root=default"]} : dispatch 2024-09-21T01:36:19.804 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:36:19 smithi083 ceph-mon[31370]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi142", "root=default"]} : dispatch 2024-09-21T01:36:19.804 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:36:19 smithi083 ceph-mon[31370]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-21T01:36:19.804 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:36:19 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:36:19.804 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:36:19 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:36:19.804 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:36:19 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T01:36:19.804 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:36:19 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T01:36:19.805 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:36:19 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:36:19.805 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:36:19 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:36:19.805 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:36:19 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:36:19.805 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:36:19 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:36:19.964 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:36:19 smithi142 ceph-mon[34050]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-21T01:36:19.965 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:36:19 smithi142 ceph-mon[34050]: osdmap e33: 6 total, 5 up, 6 in 2024-09-21T01:36:19.965 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:36:19 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T01:36:19.965 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:36:19 smithi142 ceph-mon[34050]: from='osd.5 [v2:172.21.15.142:6808/349001002,v1:172.21.15.142:6809/349001002]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi142", "root=default"]} : dispatch 2024-09-21T01:36:19.965 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:36:19 smithi142 ceph-mon[34050]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi142", "root=default"]} : dispatch 2024-09-21T01:36:19.965 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:36:19 smithi142 ceph-mon[34050]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-21T01:36:19.965 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:36:19 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:36:19.965 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:36:19 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:36:19.965 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:36:19 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T01:36:19.965 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:36:19 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T01:36:19.965 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:36:19 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:36:19.965 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:36:19 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:36:19.965 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:36:19 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:36:19.965 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:36:19 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:36:19.967 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:36:19 smithi119 ceph-mon[33693]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-21T01:36:19.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:36:19 smithi119 ceph-mon[33693]: osdmap e33: 6 total, 5 up, 6 in 2024-09-21T01:36:19.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:36:19 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T01:36:19.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:36:19 smithi119 ceph-mon[33693]: from='osd.5 [v2:172.21.15.142:6808/349001002,v1:172.21.15.142:6809/349001002]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi142", "root=default"]} : dispatch 2024-09-21T01:36:19.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:36:19 smithi119 ceph-mon[33693]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi142", "root=default"]} : dispatch 2024-09-21T01:36:19.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:36:19 smithi119 ceph-mon[33693]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-21T01:36:19.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:36:19 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:36:19.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:36:19 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:36:19.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:36:19 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T01:36:19.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:36:19 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T01:36:19.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:36:19 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:36:19.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:36:19 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:36:19.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:36:19 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:36:19.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:36:19 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:36:20.255 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:36:20.245+0000 7fc215c6b640 1 -- 172.21.15.83:0/2488541576 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc210108530 msgr2=0x7fc21010ed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:36:20.256 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:36:20.245+0000 7fc215c6b640 1 --2- 172.21.15.83:0/2488541576 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc210108530 0x7fc21010ed60 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fc208009ca0 tx=0x7fc20802a8c0 comp rx=0 tx=0).stop 2024-09-21T01:36:20.256 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:36:20.245+0000 7fc215c6b640 1 -- 172.21.15.83:0/2488541576 shutdown_connections 2024-09-21T01:36:20.256 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:36:20.245+0000 7fc215c6b640 1 --2- 172.21.15.83:0/2488541576 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc210108530 0x7fc21010ed60 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:36:20.256 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:36:20.245+0000 7fc215c6b640 1 --2- 172.21.15.83:0/2488541576 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc210107be0 0x7fc210107ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:36:20.256 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:36:20.245+0000 7fc215c6b640 1 --2- 172.21.15.83:0/2488541576 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc2101022a0 0x7fc2101026b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:36:20.256 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:36:20.245+0000 7fc215c6b640 1 -- 172.21.15.83:0/2488541576 >> 172.21.15.83:0/2488541576 conn(0x7fc210079ec0 msgr2=0x7fc21007a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:36:20.256 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:36:20.245+0000 7fc215c6b640 1 -- 172.21.15.83:0/2488541576 shutdown_connections 2024-09-21T01:36:20.256 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:36:20.245+0000 7fc215c6b640 1 -- 172.21.15.83:0/2488541576 wait complete. 2024-09-21T01:36:20.256 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:36:20.246+0000 7fc215c6b640 1 Processor -- start 2024-09-21T01:36:20.256 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:36:20.246+0000 7fc215c6b640 1 -- start start 2024-09-21T01:36:20.256 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:36:20.246+0000 7fc215c6b640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc2101022a0 0x7fc210199340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:36:20.257 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:36:20.246+0000 7fc215c6b640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc210107be0 0x7fc2101998e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:36:20.257 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:36:20.246+0000 7fc215c6b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc210108530 0x7fc21019eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:36:20.257 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:36:20.246+0000 7fc215c6b640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fc210112970 con 0x7fc2101022a0 2024-09-21T01:36:20.257 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:36:20.246+0000 7fc215c6b640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fc2101127f0 con 0x7fc210108530 2024-09-21T01:36:20.257 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:36:20.246+0000 7fc215c6b640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fc210112af0 con 0x7fc210107be0 2024-09-21T01:36:20.257 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:36:20.246+0000 7fc20f7fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc2101022a0 0x7fc210199340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:36:20.257 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:36:20.246+0000 7fc20f7fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc2101022a0 0x7fc210199340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:52786/0 (socket says 172.21.15.83:52786) 2024-09-21T01:36:20.257 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:36:20.246+0000 7fc20f7fe640 1 -- 172.21.15.83:0/2233336857 learned_addr learned my addr 172.21.15.83:0/2233336857 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:36:20.257 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:36:20.247+0000 7fc20effd640 1 --2- 172.21.15.83:0/2233336857 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc210107be0 0x7fc2101998e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:36:20.257 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:36:20.247+0000 7fc20f7fe640 1 -- 172.21.15.83:0/2233336857 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc210107be0 msgr2=0x7fc2101998e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:36:20.257 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:36:20.247+0000 7fc20ffff640 1 --2- 172.21.15.83:0/2233336857 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc210108530 0x7fc21019eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:36:20.258 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:36:20.247+0000 7fc20f7fe640 1 --2- 172.21.15.83:0/2233336857 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc210107be0 0x7fc2101998e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:36:20.258 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:36:20.247+0000 7fc20f7fe640 1 -- 172.21.15.83:0/2233336857 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc210108530 msgr2=0x7fc21019eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:36:20.258 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:36:20.247+0000 7fc20f7fe640 1 --2- 172.21.15.83:0/2233336857 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc210108530 0x7fc21019eb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:36:20.258 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:36:20.247+0000 7fc20f7fe640 1 -- 172.21.15.83:0/2233336857 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc21019f2b0 con 0x7fc2101022a0 2024-09-21T01:36:20.258 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:36:20.247+0000 7fc20f7fe640 1 --2- 172.21.15.83:0/2233336857 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc2101022a0 0x7fc210199340 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fc200009970 tx=0x7fc200009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:36:20.258 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:36:20.247+0000 7fc20cff9640 1 -- 172.21.15.83:0/2233336857 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc20000d020 con 0x7fc2101022a0 2024-09-21T01:36:20.258 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:36:20.247+0000 7fc215c6b640 1 -- 172.21.15.83:0/2233336857 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc21019f5a0 con 0x7fc2101022a0 2024-09-21T01:36:20.258 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:36:20.247+0000 7fc20cff9640 1 -- 172.21.15.83:0/2233336857 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc20000d1c0 con 0x7fc2101022a0 2024-09-21T01:36:20.258 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:36:20.247+0000 7fc20cff9640 1 -- 172.21.15.83:0/2233336857 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc20000cb40 con 0x7fc2101022a0 2024-09-21T01:36:20.258 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:36:20.247+0000 7fc215c6b640 1 -- 172.21.15.83:0/2233336857 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc21010f720 con 0x7fc2101022a0 2024-09-21T01:36:20.259 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:36:20.248+0000 7fc215c6b640 1 -- 172.21.15.83:0/2233336857 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2101026b0 con 0x7fc2101022a0 2024-09-21T01:36:20.259 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:36:20.249+0000 7fc20cff9640 1 -- 172.21.15.83:0/2233336857 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 20) ==== 154529+0+0 (secure 0 0 0) 0x7fc20000cce0 con 0x7fc2101022a0 2024-09-21T01:36:20.259 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:36:20.250+0000 7fc20cff9640 1 --2- 172.21.15.83:0/2233336857 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fc1f80b6560 0x7fc1f80b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:36:20.259 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:36:20.251+0000 7fc20effd640 1 --2- 172.21.15.83:0/2233336857 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fc1f80b6560 0x7fc1f80b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:36:20.259 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:36:20.251+0000 7fc20cff9640 1 -- 172.21.15.83:0/2233336857 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 4468+0+0 (secure 0 0 0) 0x7fc2000e79f0 con 0x7fc2101022a0 2024-09-21T01:36:20.259 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:36:20.251+0000 7fc20effd640 1 --2- 172.21.15.83:0/2233336857 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fc1f80b6560 0x7fc1f80b8a70 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc210105740 tx=0x7fc20400a4c0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:36:20.260 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:36:20.256+0000 7fc20cff9640 1 -- 172.21.15.83:0/2233336857 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc2000af180 con 0x7fc2101022a0 2024-09-21T01:36:20.441 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:36:20.441+0000 7fc215c6b640 1 -- 172.21.15.83:0/2233336857 --> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi083:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7fc21010f980 con 0x7fc1f80b6560 2024-09-21T01:36:20.464 INFO:journalctl@ceph.osd.5.smithi142.stdout:Sep 21 01:36:20 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-5[45407]: 2024-09-21T01:36:20.100+0000 7f73a3fca640 -1 osd.5 0 waiting for initial osdmap 2024-09-21T01:36:20.465 INFO:journalctl@ceph.osd.5.smithi142.stdout:Sep 21 01:36:20 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-5[45407]: 2024-09-21T01:36:20.106+0000 7f739bdc0640 -1 osd.5 34 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T01:36:20.949 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:36:20 smithi083 ceph-mon[31370]: Detected new or changed devices on smithi142 2024-09-21T01:36:20.949 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:36:20 smithi083 ceph-mon[31370]: Adjusting osd_memory_target on smithi142 to 8544M 2024-09-21T01:36:20.949 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:36:20 smithi083 ceph-mon[31370]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi142", "root=default"]}]': finished 2024-09-21T01:36:20.949 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:36:20 smithi083 ceph-mon[31370]: osdmap e34: 6 total, 5 up, 6 in 2024-09-21T01:36:20.949 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:36:20 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T01:36:20.949 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:36:20 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T01:36:20.949 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:36:20 smithi083 ceph-mon[31370]: from='osd.5 ' entity='osd.5' 2024-09-21T01:36:20.950 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:36:20 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T01:36:20.950 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:36:20 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T01:36:20.950 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:36:20 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:36:20.966 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:36:20 smithi142 ceph-mon[34050]: Detected new or changed devices on smithi142 2024-09-21T01:36:20.966 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:36:20 smithi142 ceph-mon[34050]: Adjusting osd_memory_target on smithi142 to 8544M 2024-09-21T01:36:20.966 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:36:20 smithi142 ceph-mon[34050]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi142", "root=default"]}]': finished 2024-09-21T01:36:20.966 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:36:20 smithi142 ceph-mon[34050]: osdmap e34: 6 total, 5 up, 6 in 2024-09-21T01:36:20.966 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:36:20 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T01:36:20.966 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:36:20 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T01:36:20.966 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:36:20 smithi142 ceph-mon[34050]: from='osd.5 ' entity='osd.5' 2024-09-21T01:36:20.966 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:36:20 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T01:36:20.966 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:36:20 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T01:36:20.966 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:36:20 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:36:20.967 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:36:20 smithi119 ceph-mon[33693]: Detected new or changed devices on smithi142 2024-09-21T01:36:20.967 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:36:20 smithi119 ceph-mon[33693]: Adjusting osd_memory_target on smithi142 to 8544M 2024-09-21T01:36:20.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:36:20 smithi119 ceph-mon[33693]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi142", "root=default"]}]': finished 2024-09-21T01:36:20.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:36:20 smithi119 ceph-mon[33693]: osdmap e34: 6 total, 5 up, 6 in 2024-09-21T01:36:20.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:36:20 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T01:36:20.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:36:20 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T01:36:20.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:36:20 smithi119 ceph-mon[33693]: from='osd.5 ' entity='osd.5' 2024-09-21T01:36:20.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:36:20 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T01:36:20.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:36:20 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T01:36:20.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:36:20 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:36:21.804 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:36:21 smithi083 ceph-mon[31370]: purged_snaps scrub starts 2024-09-21T01:36:21.804 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:36:21 smithi083 ceph-mon[31370]: purged_snaps scrub ok 2024-09-21T01:36:21.804 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:36:21 smithi083 ceph-mon[31370]: from='client.14601 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi083:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:36:21.804 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:36:21 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T01:36:21.804 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:36:21 smithi083 ceph-mon[31370]: osd.5 [v2:172.21.15.142:6808/349001002,v1:172.21.15.142:6809/349001002] boot 2024-09-21T01:36:21.804 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:36:21 smithi083 ceph-mon[31370]: osdmap e35: 6 total, 6 up, 6 in 2024-09-21T01:36:21.804 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:36:21 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T01:36:21.804 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:36:21 smithi083 ceph-mon[31370]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-21T01:36:21.965 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:36:21 smithi142 ceph-mon[34050]: purged_snaps scrub starts 2024-09-21T01:36:21.965 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:36:21 smithi142 ceph-mon[34050]: purged_snaps scrub ok 2024-09-21T01:36:21.965 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:36:21 smithi142 ceph-mon[34050]: from='client.14601 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi083:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:36:21.965 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:36:21 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T01:36:21.965 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:36:21 smithi142 ceph-mon[34050]: osd.5 [v2:172.21.15.142:6808/349001002,v1:172.21.15.142:6809/349001002] boot 2024-09-21T01:36:21.965 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:36:21 smithi142 ceph-mon[34050]: osdmap e35: 6 total, 6 up, 6 in 2024-09-21T01:36:21.965 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:36:21 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T01:36:21.965 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:36:21 smithi142 ceph-mon[34050]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-21T01:36:21.967 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:36:21 smithi119 ceph-mon[33693]: purged_snaps scrub starts 2024-09-21T01:36:21.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:36:21 smithi119 ceph-mon[33693]: purged_snaps scrub ok 2024-09-21T01:36:21.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:36:21 smithi119 ceph-mon[33693]: from='client.14601 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi083:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:36:21.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:36:21 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T01:36:21.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:36:21 smithi119 ceph-mon[33693]: osd.5 [v2:172.21.15.142:6808/349001002,v1:172.21.15.142:6809/349001002] boot 2024-09-21T01:36:21.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:36:21 smithi119 ceph-mon[33693]: osdmap e35: 6 total, 6 up, 6 in 2024-09-21T01:36:21.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:36:21 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T01:36:21.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:36:21 smithi119 ceph-mon[33693]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-09-21T01:36:22.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:36:22 smithi119 ceph-mon[33693]: osdmap e36: 6 total, 6 up, 6 in 2024-09-21T01:36:23.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:36:22 smithi083 ceph-mon[31370]: osdmap e36: 6 total, 6 up, 6 in 2024-09-21T01:36:23.135 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:36:22 smithi142 ceph-mon[34050]: osdmap e36: 6 total, 6 up, 6 in 2024-09-21T01:36:23.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:36:23 smithi119 ceph-mon[33693]: osdmap e37: 6 total, 6 up, 6 in 2024-09-21T01:36:23.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:36:23 smithi119 ceph-mon[33693]: pgmap v122: 1 pgs: 1 remapped+peering; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-09-21T01:36:23.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:36:23 smithi119 ceph-mon[33693]: from='client.? 172.21.15.83:0/3456423723' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "6e1b6fe9-700a-448a-b382-59b97896ea7b"} : dispatch 2024-09-21T01:36:23.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:36:23 smithi119 ceph-mon[33693]: from='client.? 172.21.15.83:0/3456423723' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6e1b6fe9-700a-448a-b382-59b97896ea7b"}]': finished 2024-09-21T01:36:23.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:36:23 smithi119 ceph-mon[33693]: osdmap e38: 7 total, 6 up, 7 in 2024-09-21T01:36:23.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:36:23 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T01:36:23.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:36:23 smithi119 ceph-mon[33693]: from='client.? 172.21.15.83:0/2000923083' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T01:36:24.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:36:23 smithi083 ceph-mon[31370]: osdmap e37: 6 total, 6 up, 6 in 2024-09-21T01:36:24.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:36:23 smithi083 ceph-mon[31370]: pgmap v122: 1 pgs: 1 remapped+peering; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-09-21T01:36:24.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:36:23 smithi083 ceph-mon[31370]: from='client.? 172.21.15.83:0/3456423723' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "6e1b6fe9-700a-448a-b382-59b97896ea7b"} : dispatch 2024-09-21T01:36:24.055 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:36:23 smithi083 ceph-mon[31370]: from='client.? 172.21.15.83:0/3456423723' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6e1b6fe9-700a-448a-b382-59b97896ea7b"}]': finished 2024-09-21T01:36:24.055 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:36:23 smithi083 ceph-mon[31370]: osdmap e38: 7 total, 6 up, 7 in 2024-09-21T01:36:24.055 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:36:23 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T01:36:24.055 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:36:23 smithi083 ceph-mon[31370]: from='client.? 172.21.15.83:0/2000923083' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T01:36:24.091 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:36:23 smithi142 ceph-mon[34050]: osdmap e37: 6 total, 6 up, 6 in 2024-09-21T01:36:24.092 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:36:23 smithi142 ceph-mon[34050]: pgmap v122: 1 pgs: 1 remapped+peering; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-09-21T01:36:24.092 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:36:23 smithi142 ceph-mon[34050]: from='client.? 172.21.15.83:0/3456423723' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "6e1b6fe9-700a-448a-b382-59b97896ea7b"} : dispatch 2024-09-21T01:36:24.092 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:36:23 smithi142 ceph-mon[34050]: from='client.? 172.21.15.83:0/3456423723' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6e1b6fe9-700a-448a-b382-59b97896ea7b"}]': finished 2024-09-21T01:36:24.092 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:36:23 smithi142 ceph-mon[34050]: osdmap e38: 7 total, 6 up, 7 in 2024-09-21T01:36:24.092 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:36:23 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T01:36:24.092 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:36:23 smithi142 ceph-mon[34050]: from='client.? 172.21.15.83:0/2000923083' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T01:36:26.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:36:25 smithi083 ceph-mon[31370]: pgmap v124: 1 pgs: 1 remapped+peering; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-09-21T01:36:26.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:36:25 smithi142 ceph-mon[34050]: pgmap v124: 1 pgs: 1 remapped+peering; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-09-21T01:36:26.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:36:25 smithi119 ceph-mon[33693]: pgmap v124: 1 pgs: 1 remapped+peering; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-09-21T01:36:28.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:36:27 smithi083 ceph-mon[31370]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T01:36:28.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:36:27 smithi142 ceph-mon[34050]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T01:36:28.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:36:27 smithi119 ceph-mon[33693]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T01:36:29.803 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:36:29 smithi083 ceph-mon[31370]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 82 KiB/s, 0 objects/s recovering 2024-09-21T01:36:30.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:36:29 smithi142 ceph-mon[34050]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 82 KiB/s, 0 objects/s recovering 2024-09-21T01:36:30.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:36:29 smithi119 ceph-mon[33693]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 82 KiB/s, 0 objects/s recovering 2024-09-21T01:36:32.053 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:36:31 smithi083 ceph-mon[31370]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T01:36:32.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:36:31 smithi142 ceph-mon[34050]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T01:36:32.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:36:31 smithi119 ceph-mon[33693]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T01:36:32.988 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:36:32 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-09-21T01:36:32.988 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:36:32 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:36:33.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:36:32 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-09-21T01:36:33.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:36:32 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:36:33.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:36:32 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-09-21T01:36:33.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:36:32 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:36:33.925 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:36:33 smithi083 ceph-mon[31370]: Deploying daemon osd.6 on smithi083 2024-09-21T01:36:33.925 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:36:33 smithi083 ceph-mon[31370]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T01:36:33.964 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:36:33 smithi142 ceph-mon[34050]: Deploying daemon osd.6 on smithi083 2024-09-21T01:36:33.964 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:36:33 smithi142 ceph-mon[34050]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T01:36:33.967 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:36:33 smithi119 ceph-mon[33693]: Deploying daemon osd.6 on smithi083 2024-09-21T01:36:33.967 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:36:33 smithi119 ceph-mon[33693]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T01:36:36.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:36:35 smithi083 ceph-mon[31370]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-09-21T01:36:36.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:36:35 smithi142 ceph-mon[34050]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-09-21T01:36:36.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:36:35 smithi119 ceph-mon[33693]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-09-21T01:36:38.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:36:37 smithi083 ceph-mon[31370]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T01:36:38.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:36:37 smithi142 ceph-mon[34050]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T01:36:38.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:36:37 smithi119 ceph-mon[33693]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T01:36:39.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:36:38 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:36:39.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:36:38 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:36:39.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:36:38 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:36:39.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:36:38 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:36:39.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:36:38 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:36:39.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:36:38 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:36:39.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:36:38 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:36:39.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:36:38 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:36:39.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:36:38 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:36:40.053 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:36:39 smithi083 ceph-mon[31370]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-09-21T01:36:40.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:36:39 smithi142 ceph-mon[34050]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-09-21T01:36:40.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:36:39 smithi119 ceph-mon[33693]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-09-21T01:36:41.972 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:36:41 smithi083 ceph-mon[31370]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-09-21T01:36:41.973 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:36:41 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:36:41.973 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:36:41 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:36:41.973 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:36:41 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:36:41.973 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:36:41 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:36:41.973 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:36:41 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:36:42.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:36:41 smithi142 ceph-mon[34050]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-09-21T01:36:42.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:36:41 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:36:42.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:36:41 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:36:42.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:36:41 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:36:42.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:36:41 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:36:42.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:36:41 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:36:42.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:36:41 smithi119 ceph-mon[33693]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-09-21T01:36:42.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:36:41 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:36:42.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:36:41 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:36:42.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:36:41 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:36:42.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:36:41 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:36:42.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:36:41 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:36:42.433 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:36:42.433+0000 7fc20cff9640 1 -- 172.21.15.83:0/2233336857 <== mgr.14223 v2:172.21.15.83:6800/1748483157 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fc21010f980 con 0x7fc1f80b6560 2024-09-21T01:36:42.433 INFO:teuthology.orchestra.run.smithi083.stdout:Created osd(s) 6 on host 'smithi083' 2024-09-21T01:36:42.435 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:36:42.435+0000 7fc215c6b640 1 -- 172.21.15.83:0/2233336857 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fc1f80b6560 msgr2=0x7fc1f80b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:36:42.435 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:36:42.435+0000 7fc215c6b640 1 --2- 172.21.15.83:0/2233336857 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fc1f80b6560 0x7fc1f80b8a70 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc210105740 tx=0x7fc20400a4c0 comp rx=0 tx=0).stop 2024-09-21T01:36:42.435 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:36:42.435+0000 7fc215c6b640 1 -- 172.21.15.83:0/2233336857 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc2101022a0 msgr2=0x7fc210199340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:36:42.436 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:36:42.435+0000 7fc215c6b640 1 --2- 172.21.15.83:0/2233336857 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc2101022a0 0x7fc210199340 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fc200009970 tx=0x7fc200009e30 comp rx=0 tx=0).stop 2024-09-21T01:36:42.436 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:36:42.435+0000 7fc215c6b640 1 -- 172.21.15.83:0/2233336857 shutdown_connections 2024-09-21T01:36:42.436 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:36:42.435+0000 7fc215c6b640 1 --2- 172.21.15.83:0/2233336857 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fc1f80b6560 0x7fc1f80b8a70 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:36:42.436 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:36:42.435+0000 7fc215c6b640 1 --2- 172.21.15.83:0/2233336857 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc210108530 0x7fc21019eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:36:42.436 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:36:42.435+0000 7fc215c6b640 1 --2- 172.21.15.83:0/2233336857 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc210107be0 0x7fc2101998e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:36:42.436 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:36:42.435+0000 7fc215c6b640 1 --2- 172.21.15.83:0/2233336857 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc2101022a0 0x7fc210199340 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:36:42.436 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:36:42.435+0000 7fc215c6b640 1 -- 172.21.15.83:0/2233336857 >> 172.21.15.83:0/2233336857 conn(0x7fc210079ec0 msgr2=0x7fc210103c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:36:42.436 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:36:42.436+0000 7fc215c6b640 1 -- 172.21.15.83:0/2233336857 shutdown_connections 2024-09-21T01:36:42.436 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:36:42.436+0000 7fc215c6b640 1 -- 172.21.15.83:0/2233336857 wait complete. 2024-09-21T01:36:43.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:36:42 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:36:43.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:36:42 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:36:43.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:36:42 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:36:43.097 DEBUG:teuthology.orchestra.run.smithi083:osd.6> sudo journalctl -f -n 0 -u ceph-f7697ecc-77b8-11ef-baf5-efdc52797490@osd.6.service 2024-09-21T01:36:43.099 INFO:tasks.cephadm:Deploying osd.7 on smithi119 with /dev/vg_nvme/lv_2... 2024-09-21T01:36:43.099 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_2 2024-09-21T01:36:43.127 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:36:42 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:36:43.127 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:36:42 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:36:43.127 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:36:42 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:36:43.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:36:42 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:36:43.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:36:42 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:36:43.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:36:42 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:36:43.353 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T01:36:44.002 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:36:43 smithi083 ceph-mon[31370]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-09-21T01:36:44.187 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:36:43 smithi119 ceph-mon[33693]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-09-21T01:36:44.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:36:43 smithi142 ceph-mon[34050]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-09-21T01:36:44.903 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:36:44 smithi119 ceph-mon[33693]: from='osd.6 [v2:172.21.15.83:6818/771651063,v1:172.21.15.83:6819/771651063]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-21T01:36:45.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:36:44 smithi083 ceph-mon[31370]: from='osd.6 [v2:172.21.15.83:6818/771651063,v1:172.21.15.83:6819/771651063]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-21T01:36:45.055 INFO:journalctl@ceph.osd.6.smithi083.stdout:Sep 21 01:36:44 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-6[60956]: 2024-09-21T01:36:44.693+0000 7fc39c8ba640 -1 osd.6 0 log_to_monitors true 2024-09-21T01:36:45.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:36:44 smithi142 ceph-mon[34050]: from='osd.6 [v2:172.21.15.83:6818/771651063,v1:172.21.15.83:6819/771651063]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-21T01:36:45.792 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:36:45 smithi119 ceph-mon[33693]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-09-21T01:36:45.792 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:36:45 smithi119 ceph-mon[33693]: from='osd.6 [v2:172.21.15.83:6818/771651063,v1:172.21.15.83:6819/771651063]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-21T01:36:45.792 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:36:45 smithi119 ceph-mon[33693]: osdmap e39: 7 total, 6 up, 7 in 2024-09-21T01:36:45.792 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:36:45 smithi119 ceph-mon[33693]: from='osd.6 [v2:172.21.15.83:6818/771651063,v1:172.21.15.83:6819/771651063]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi083", "root=default"]} : dispatch 2024-09-21T01:36:45.792 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:36:45 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T01:36:46.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:36:45 smithi083 ceph-mon[31370]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-09-21T01:36:46.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:36:45 smithi083 ceph-mon[31370]: from='osd.6 [v2:172.21.15.83:6818/771651063,v1:172.21.15.83:6819/771651063]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-21T01:36:46.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:36:45 smithi083 ceph-mon[31370]: osdmap e39: 7 total, 6 up, 7 in 2024-09-21T01:36:46.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:36:45 smithi083 ceph-mon[31370]: from='osd.6 [v2:172.21.15.83:6818/771651063,v1:172.21.15.83:6819/771651063]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi083", "root=default"]} : dispatch 2024-09-21T01:36:46.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:36:45 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T01:36:46.055 INFO:journalctl@ceph.osd.6.smithi083.stdout:Sep 21 01:36:45 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-6[60956]: 2024-09-21T01:36:45.765+0000 7fc39883c640 -1 osd.6 0 waiting for initial osdmap 2024-09-21T01:36:46.055 INFO:journalctl@ceph.osd.6.smithi083.stdout:Sep 21 01:36:45 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-6[60956]: 2024-09-21T01:36:45.777+0000 7fc39463a640 -1 osd.6 40 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T01:36:46.083 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-21T01:36:46.115 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi119:vg_nvme/lv_2 2024-09-21T01:36:46.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:36:45 smithi142 ceph-mon[34050]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-09-21T01:36:46.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:36:45 smithi142 ceph-mon[34050]: from='osd.6 [v2:172.21.15.83:6818/771651063,v1:172.21.15.83:6819/771651063]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-21T01:36:46.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:36:45 smithi142 ceph-mon[34050]: osdmap e39: 7 total, 6 up, 7 in 2024-09-21T01:36:46.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:36:45 smithi142 ceph-mon[34050]: from='osd.6 [v2:172.21.15.83:6818/771651063,v1:172.21.15.83:6819/771651063]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi083", "root=default"]} : dispatch 2024-09-21T01:36:46.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:36:45 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T01:36:46.408 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T01:36:46.927 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:36:46.926+0000 7f3289b29640 1 -- 172.21.15.119:0/2262317605 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3284108cf0 msgr2=0x7f328410f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:36:46.927 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:36:46.926+0000 7f3289b29640 1 --2- 172.21.15.119:0/2262317605 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3284108cf0 0x7f328410f520 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f327c009ca0 tx=0x7f327c02a8c0 comp rx=0 tx=0).stop 2024-09-21T01:36:46.927 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:36:46.926+0000 7f3289b29640 1 -- 172.21.15.119:0/2262317605 shutdown_connections 2024-09-21T01:36:46.927 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:36:46.926+0000 7f3289b29640 1 --2- 172.21.15.119:0/2262317605 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3284108cf0 0x7f328410f520 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:36:46.927 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:36:46.926+0000 7f3289b29640 1 --2- 172.21.15.119:0/2262317605 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f32841083a0 0x7f32841087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:36:46.927 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:36:46.926+0000 7f3289b29640 1 --2- 172.21.15.119:0/2262317605 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3284102a60 0x7f3284102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:36:46.928 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:36:46.926+0000 7f3289b29640 1 -- 172.21.15.119:0/2262317605 >> 172.21.15.119:0/2262317605 conn(0x7f3284079730 msgr2=0x7f3284079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:36:46.928 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:36:46.926+0000 7f3289b29640 1 -- 172.21.15.119:0/2262317605 shutdown_connections 2024-09-21T01:36:46.928 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:36:46.926+0000 7f3289b29640 1 -- 172.21.15.119:0/2262317605 wait complete. 2024-09-21T01:36:46.928 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:36:46.926+0000 7f3289b29640 1 Processor -- start 2024-09-21T01:36:46.928 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:36:46.926+0000 7f3289b29640 1 -- start start 2024-09-21T01:36:46.929 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:36:46.927+0000 7f3289b29640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3284102a60 0x7f328419d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:36:46.929 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:36:46.927+0000 7f3289b29640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f32841083a0 0x7f328419d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:36:46.929 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:36:46.927+0000 7f3289b29640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3284108cf0 0x7f328419dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:36:46.930 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:36:46.927+0000 7f3289b29640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f328406b720 con 0x7f32841083a0 2024-09-21T01:36:46.930 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:36:46.927+0000 7f3289b29640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f328406b5a0 con 0x7f3284108cf0 2024-09-21T01:36:46.930 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:36:46.927+0000 7f3289b29640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f328406b8a0 con 0x7f3284102a60 2024-09-21T01:36:46.930 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:36:46.927+0000 7f3283fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3284108cf0 0x7f328419dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:36:46.930 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:36:46.927+0000 7f3283fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3284108cf0 0x7f328419dd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:41950/0 (socket says 172.21.15.119:41950) 2024-09-21T01:36:46.930 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:36:46.927+0000 7f3283fff640 1 -- 172.21.15.119:0/2695191636 learned_addr learned my addr 172.21.15.119:0/2695191636 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-21T01:36:46.930 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:36:46.927+0000 7f327bfff640 1 --2- 172.21.15.119:0/2695191636 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f32841083a0 0x7f328419d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:36:46.930 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:36:46.927+0000 7f32837fe640 1 --2- 172.21.15.119:0/2695191636 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3284102a60 0x7f328419d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:36:46.930 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:36:46.927+0000 7f3283fff640 1 -- 172.21.15.119:0/2695191636 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3284102a60 msgr2=0x7f328419d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:36:46.930 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:36:46.927+0000 7f3283fff640 1 --2- 172.21.15.119:0/2695191636 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3284102a60 0x7f328419d2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:36:46.930 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:36:46.927+0000 7f3283fff640 1 -- 172.21.15.119:0/2695191636 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f32841083a0 msgr2=0x7f328419d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:36:46.930 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:36:46.927+0000 7f3283fff640 1 --2- 172.21.15.119:0/2695191636 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f32841083a0 0x7f328419d810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:36:46.930 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:36:46.927+0000 7f3283fff640 1 -- 172.21.15.119:0/2695191636 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32841a8550 con 0x7f3284108cf0 2024-09-21T01:36:46.930 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:36:46.927+0000 7f32837fe640 1 --2- 172.21.15.119:0/2695191636 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3284102a60 0x7f328419d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:36:46.931 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:36:46.927+0000 7f3283fff640 1 --2- 172.21.15.119:0/2695191636 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3284108cf0 0x7f328419dd50 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f327c005cc0 tx=0x7f327c032a10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:36:46.931 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:36:46.928+0000 7f32817fa640 1 -- 172.21.15.119:0/2695191636 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f327c032e00 con 0x7f3284108cf0 2024-09-21T01:36:46.931 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:36:46.928+0000 7f3289b29640 1 -- 172.21.15.119:0/2695191636 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32841a87e0 con 0x7f3284108cf0 2024-09-21T01:36:46.931 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:36:46.928+0000 7f32817fa640 1 -- 172.21.15.119:0/2695191636 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f327c0044d0 con 0x7f3284108cf0 2024-09-21T01:36:46.931 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:36:46.928+0000 7f32817fa640 1 -- 172.21.15.119:0/2695191636 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f327c030b70 con 0x7f3284108cf0 2024-09-21T01:36:46.931 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:36:46.928+0000 7f3289b29640 1 -- 172.21.15.119:0/2695191636 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32841a8d20 con 0x7f3284108cf0 2024-09-21T01:36:46.931 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:36:46.929+0000 7f3289b29640 1 -- 172.21.15.119:0/2695191636 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3284102e70 con 0x7f3284108cf0 2024-09-21T01:36:46.931 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:36:46.930+0000 7f32817fa640 1 -- 172.21.15.119:0/2695191636 <== mon.2 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 20) ==== 154529+0+0 (secure 0 0 0) 0x7f327c030d10 con 0x7f3284108cf0 2024-09-21T01:36:46.931 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:36:46.931+0000 7f32817fa640 1 --2- 172.21.15.119:0/2695191636 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f32700b6560 0x7f32700b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:36:46.932 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:36:46.931+0000 7f32817fa640 1 -- 172.21.15.119:0/2695191636 <== mon.2 v2:172.21.15.119:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 5180+0+0 (secure 0 0 0) 0x7f327c107ba0 con 0x7f3284108cf0 2024-09-21T01:36:46.932 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:36:46.931+0000 7f32837fe640 1 --2- 172.21.15.119:0/2695191636 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f32700b6560 0x7f32700b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:36:46.932 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:36:46.932+0000 7f32837fe640 1 --2- 172.21.15.119:0/2695191636 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f32700b6560 0x7f32700b8a70 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f328410f530 tx=0x7f3274005e70 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:36:46.935 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:36:46.934+0000 7f32817fa640 1 -- 172.21.15.119:0/2695191636 <== mon.2 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f327c0cf100 con 0x7f3284108cf0 2024-09-21T01:36:47.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:36:46 smithi083 ceph-mon[31370]: from='osd.6 [v2:172.21.15.83:6818/771651063,v1:172.21.15.83:6819/771651063]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi083", "root=default"]}]': finished 2024-09-21T01:36:47.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:36:46 smithi083 ceph-mon[31370]: osdmap e40: 7 total, 6 up, 7 in 2024-09-21T01:36:47.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:36:46 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T01:36:47.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:36:46 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T01:36:47.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:36:46 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:36:47.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:36:46 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:36:47.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:36:46 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T01:36:47.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:36:46 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T01:36:47.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:36:46 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T01:36:47.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:36:46 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:36:47.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:36:46 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:36:47.055 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:36:46 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:36:47.055 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:36:46 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:36:47.123 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:36:47.122+0000 7f3289b29640 1 -- 172.21.15.119:0/2695191636 --> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi119:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f3284063800 con 0x7f32700b6560 2024-09-21T01:36:47.123 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:36:46 smithi119 ceph-mon[33693]: from='osd.6 [v2:172.21.15.83:6818/771651063,v1:172.21.15.83:6819/771651063]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi083", "root=default"]}]': finished 2024-09-21T01:36:47.123 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:36:46 smithi119 ceph-mon[33693]: osdmap e40: 7 total, 6 up, 7 in 2024-09-21T01:36:47.123 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:36:46 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T01:36:47.123 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:36:46 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T01:36:47.124 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:36:46 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:36:47.124 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:36:46 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:36:47.124 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:36:46 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T01:36:47.124 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:36:46 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T01:36:47.124 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:36:46 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T01:36:47.124 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:36:46 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:36:47.124 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:36:46 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:36:47.124 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:36:46 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:36:47.124 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:36:46 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:36:47.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:36:46 smithi142 ceph-mon[34050]: from='osd.6 [v2:172.21.15.83:6818/771651063,v1:172.21.15.83:6819/771651063]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi083", "root=default"]}]': finished 2024-09-21T01:36:47.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:36:46 smithi142 ceph-mon[34050]: osdmap e40: 7 total, 6 up, 7 in 2024-09-21T01:36:47.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:36:46 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T01:36:47.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:36:46 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T01:36:47.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:36:46 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:36:47.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:36:46 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:36:47.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:36:46 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T01:36:47.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:36:46 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T01:36:47.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:36:46 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T01:36:47.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:36:46 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:36:47.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:36:46 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:36:47.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:36:46 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:36:47.216 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:36:46 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:36:48.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:36:47 smithi083 ceph-mon[31370]: purged_snaps scrub starts 2024-09-21T01:36:48.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:36:47 smithi083 ceph-mon[31370]: purged_snaps scrub ok 2024-09-21T01:36:48.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:36:47 smithi083 ceph-mon[31370]: Detected new or changed devices on smithi083 2024-09-21T01:36:48.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:36:47 smithi083 ceph-mon[31370]: Adjusting osd_memory_target on smithi083 to 5696M 2024-09-21T01:36:48.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:36:47 smithi083 ceph-mon[31370]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-09-21T01:36:48.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:36:47 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T01:36:48.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:36:47 smithi083 ceph-mon[31370]: osd.6 [v2:172.21.15.83:6818/771651063,v1:172.21.15.83:6819/771651063] boot 2024-09-21T01:36:48.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:36:47 smithi083 ceph-mon[31370]: osdmap e41: 7 total, 7 up, 7 in 2024-09-21T01:36:48.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:36:47 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T01:36:48.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:36:47 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T01:36:48.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:36:47 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T01:36:48.055 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:36:47 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:36:48.090 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:36:47 smithi119 ceph-mon[33693]: purged_snaps scrub starts 2024-09-21T01:36:48.090 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:36:47 smithi119 ceph-mon[33693]: purged_snaps scrub ok 2024-09-21T01:36:48.090 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:36:47 smithi119 ceph-mon[33693]: Detected new or changed devices on smithi083 2024-09-21T01:36:48.090 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:36:47 smithi119 ceph-mon[33693]: Adjusting osd_memory_target on smithi083 to 5696M 2024-09-21T01:36:48.090 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:36:47 smithi119 ceph-mon[33693]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-09-21T01:36:48.091 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:36:47 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T01:36:48.091 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:36:47 smithi119 ceph-mon[33693]: osd.6 [v2:172.21.15.83:6818/771651063,v1:172.21.15.83:6819/771651063] boot 2024-09-21T01:36:48.091 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:36:47 smithi119 ceph-mon[33693]: osdmap e41: 7 total, 7 up, 7 in 2024-09-21T01:36:48.091 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:36:47 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T01:36:48.091 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:36:47 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T01:36:48.091 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:36:47 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T01:36:48.091 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:36:47 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:36:48.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:36:47 smithi142 ceph-mon[34050]: purged_snaps scrub starts 2024-09-21T01:36:48.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:36:47 smithi142 ceph-mon[34050]: purged_snaps scrub ok 2024-09-21T01:36:48.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:36:47 smithi142 ceph-mon[34050]: Detected new or changed devices on smithi083 2024-09-21T01:36:48.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:36:47 smithi142 ceph-mon[34050]: Adjusting osd_memory_target on smithi083 to 5696M 2024-09-21T01:36:48.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:36:47 smithi142 ceph-mon[34050]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-09-21T01:36:48.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:36:47 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T01:36:48.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:36:47 smithi142 ceph-mon[34050]: osd.6 [v2:172.21.15.83:6818/771651063,v1:172.21.15.83:6819/771651063] boot 2024-09-21T01:36:48.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:36:47 smithi142 ceph-mon[34050]: osdmap e41: 7 total, 7 up, 7 in 2024-09-21T01:36:48.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:36:47 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T01:36:48.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:36:47 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T01:36:48.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:36:47 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T01:36:48.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:36:47 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:36:48.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:36:48 smithi119 ceph-mon[33693]: from='client.24425 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi119:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:36:48.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:36:48 smithi119 ceph-mon[33693]: osdmap e42: 7 total, 7 up, 7 in 2024-09-21T01:36:49.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:36:48 smithi083 ceph-mon[31370]: from='client.24425 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi119:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:36:49.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:36:48 smithi083 ceph-mon[31370]: osdmap e42: 7 total, 7 up, 7 in 2024-09-21T01:36:49.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:36:48 smithi142 ceph-mon[34050]: from='client.24425 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi119:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:36:49.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:36:48 smithi142 ceph-mon[34050]: osdmap e42: 7 total, 7 up, 7 in 2024-09-21T01:36:49.967 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:36:49 smithi119 ceph-mon[33693]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-21T01:36:49.967 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:36:49 smithi119 ceph-mon[33693]: from='client.? 172.21.15.119:0/2092259052' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "283bfae4-5f50-4f9e-860e-bbfd47e005e0"} : dispatch 2024-09-21T01:36:49.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:36:49 smithi119 ceph-mon[33693]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "283bfae4-5f50-4f9e-860e-bbfd47e005e0"} : dispatch 2024-09-21T01:36:49.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:36:49 smithi119 ceph-mon[33693]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "283bfae4-5f50-4f9e-860e-bbfd47e005e0"}]': finished 2024-09-21T01:36:49.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:36:49 smithi119 ceph-mon[33693]: osdmap e43: 8 total, 7 up, 8 in 2024-09-21T01:36:49.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:36:49 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T01:36:50.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:36:49 smithi083 ceph-mon[31370]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-21T01:36:50.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:36:49 smithi083 ceph-mon[31370]: from='client.? 172.21.15.119:0/2092259052' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "283bfae4-5f50-4f9e-860e-bbfd47e005e0"} : dispatch 2024-09-21T01:36:50.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:36:49 smithi083 ceph-mon[31370]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "283bfae4-5f50-4f9e-860e-bbfd47e005e0"} : dispatch 2024-09-21T01:36:50.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:36:49 smithi083 ceph-mon[31370]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "283bfae4-5f50-4f9e-860e-bbfd47e005e0"}]': finished 2024-09-21T01:36:50.055 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:36:49 smithi083 ceph-mon[31370]: osdmap e43: 8 total, 7 up, 8 in 2024-09-21T01:36:50.055 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:36:49 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T01:36:50.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:36:49 smithi142 ceph-mon[34050]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-21T01:36:50.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:36:49 smithi142 ceph-mon[34050]: from='client.? 172.21.15.119:0/2092259052' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "283bfae4-5f50-4f9e-860e-bbfd47e005e0"} : dispatch 2024-09-21T01:36:50.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:36:49 smithi142 ceph-mon[34050]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "283bfae4-5f50-4f9e-860e-bbfd47e005e0"} : dispatch 2024-09-21T01:36:50.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:36:49 smithi142 ceph-mon[34050]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "283bfae4-5f50-4f9e-860e-bbfd47e005e0"}]': finished 2024-09-21T01:36:50.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:36:49 smithi142 ceph-mon[34050]: osdmap e43: 8 total, 7 up, 8 in 2024-09-21T01:36:50.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:36:49 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T01:36:51.053 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:36:50 smithi083 ceph-mon[31370]: from='client.? 172.21.15.119:0/794829516' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T01:36:51.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:36:50 smithi142 ceph-mon[34050]: from='client.? 172.21.15.119:0/794829516' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T01:36:51.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:36:50 smithi119 ceph-mon[33693]: from='client.? 172.21.15.119:0/794829516' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T01:36:52.053 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:36:51 smithi083 ceph-mon[31370]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-21T01:36:52.116 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:36:51 smithi142 ceph-mon[34050]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-21T01:36:52.119 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:36:51 smithi119 ceph-mon[33693]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-21T01:36:54.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:36:53 smithi083 ceph-mon[31370]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-21T01:36:54.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:36:53 smithi142 ceph-mon[34050]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-21T01:36:54.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:36:53 smithi119 ceph-mon[33693]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-21T01:36:55.920 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:36:55 smithi119 ceph-mon[33693]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-21T01:36:56.053 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:36:55 smithi083 ceph-mon[31370]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-21T01:36:56.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:36:55 smithi142 ceph-mon[34050]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-21T01:36:58.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:36:57 smithi083 ceph-mon[31370]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-21T01:36:58.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:36:57 smithi142 ceph-mon[34050]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-21T01:36:58.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:36:57 smithi119 ceph-mon[33693]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-21T01:36:58.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:36:58 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-09-21T01:36:58.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:36:58 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:36:59.055 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:36:58 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-09-21T01:36:59.055 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:36:58 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:36:59.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:36:58 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-09-21T01:36:59.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:36:58 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:36:59.909 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:36:59 smithi119 ceph-mon[33693]: Deploying daemon osd.7 on smithi119 2024-09-21T01:36:59.909 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:36:59 smithi119 ceph-mon[33693]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-21T01:37:00.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:36:59 smithi083 ceph-mon[31370]: Deploying daemon osd.7 on smithi119 2024-09-21T01:37:00.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:36:59 smithi083 ceph-mon[31370]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-21T01:37:00.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:36:59 smithi142 ceph-mon[34050]: Deploying daemon osd.7 on smithi119 2024-09-21T01:37:00.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:36:59 smithi142 ceph-mon[34050]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-21T01:37:01.967 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:37:01 smithi119 ceph-mon[33693]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-21T01:37:02.053 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:37:01 smithi083 ceph-mon[31370]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-21T01:37:02.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:37:01 smithi142 ceph-mon[34050]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-21T01:37:03.894 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:37:03 smithi119 ceph-mon[33693]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-21T01:37:04.085 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:37:03 smithi083 ceph-mon[31370]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-21T01:37:04.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:37:03 smithi142 ceph-mon[34050]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-21T01:37:04.860 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:37:04 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:37:04.860 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:37:04 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:37:04.860 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:37:04 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:37:05.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:37:04 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:37:05.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:37:04 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:37:05.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:37:04 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:37:05.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:37:04 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:37:05.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:37:04 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:37:05.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:37:04 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:37:05.925 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:37:05 smithi119 ceph-mon[33693]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-21T01:37:06.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:37:05 smithi142 ceph-mon[34050]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-21T01:37:06.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:37:05 smithi083 ceph-mon[31370]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-21T01:37:08.055 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:37:07 smithi119 ceph-mon[33693]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-21T01:37:08.055 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:37:07 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:37:08.056 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:37:07 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:37:08.056 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:37:07 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:37:08.056 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:37:07 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:37:08.056 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:37:07 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:37:08.099 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:37:08.098+0000 7f32817fa640 1 -- 172.21.15.119:0/2695191636 <== mgr.14223 v2:172.21.15.83:6800/1748483157 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f3284063800 con 0x7f32700b6560 2024-09-21T01:37:08.099 INFO:teuthology.orchestra.run.smithi119.stdout:Created osd(s) 7 on host 'smithi119' 2024-09-21T01:37:08.102 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:37:08.100+0000 7f3289b29640 1 -- 172.21.15.119:0/2695191636 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f32700b6560 msgr2=0x7f32700b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:37:08.102 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:37:08.100+0000 7f3289b29640 1 --2- 172.21.15.119:0/2695191636 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f32700b6560 0x7f32700b8a70 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f328410f530 tx=0x7f3274005e70 comp rx=0 tx=0).stop 2024-09-21T01:37:08.102 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:37:08.101+0000 7f3289b29640 1 -- 172.21.15.119:0/2695191636 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3284108cf0 msgr2=0x7f328419dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:37:08.102 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:37:08.101+0000 7f3289b29640 1 --2- 172.21.15.119:0/2695191636 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3284108cf0 0x7f328419dd50 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f327c005cc0 tx=0x7f327c032a10 comp rx=0 tx=0).stop 2024-09-21T01:37:08.102 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:37:08.101+0000 7f3289b29640 1 -- 172.21.15.119:0/2695191636 shutdown_connections 2024-09-21T01:37:08.102 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:37:08.101+0000 7f3289b29640 1 --2- 172.21.15.119:0/2695191636 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f32700b6560 0x7f32700b8a70 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:37:08.102 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:37:08.101+0000 7f3289b29640 1 --2- 172.21.15.119:0/2695191636 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3284108cf0 0x7f328419dd50 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:37:08.102 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:37:08.101+0000 7f3289b29640 1 --2- 172.21.15.119:0/2695191636 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f32841083a0 0x7f328419d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:37:08.102 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:37:08.101+0000 7f3289b29640 1 --2- 172.21.15.119:0/2695191636 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3284102a60 0x7f328419d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:37:08.102 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:37:08.101+0000 7f3289b29640 1 -- 172.21.15.119:0/2695191636 >> 172.21.15.119:0/2695191636 conn(0x7f3284079730 msgr2=0x7f3284104290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:37:08.102 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:37:08.101+0000 7f3289b29640 1 -- 172.21.15.119:0/2695191636 shutdown_connections 2024-09-21T01:37:08.103 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:37:08.101+0000 7f3289b29640 1 -- 172.21.15.119:0/2695191636 wait complete. 2024-09-21T01:37:08.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:37:07 smithi142 ceph-mon[34050]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-21T01:37:08.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:37:07 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:37:08.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:37:07 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:37:08.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:37:07 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:37:08.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:37:07 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:37:08.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:37:07 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:37:08.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:37:07 smithi083 ceph-mon[31370]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-21T01:37:08.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:37:07 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:37:08.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:37:07 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:37:08.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:37:07 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:37:08.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:37:07 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:37:08.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:37:07 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:37:08.804 DEBUG:teuthology.orchestra.run.smithi119:osd.7> sudo journalctl -f -n 0 -u ceph-f7697ecc-77b8-11ef-baf5-efdc52797490@osd.7.service 2024-09-21T01:37:08.806 INFO:tasks.cephadm:Deploying osd.8 on smithi142 with /dev/vg_nvme/lv_2... 2024-09-21T01:37:08.807 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_2 2024-09-21T01:37:09.058 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:37:08 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:37:09.058 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:37:08 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:37:09.058 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:37:08 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:37:09.058 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T01:37:09.178 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:37:08 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:37:09.179 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:37:08 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:37:09.179 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:37:08 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:37:09.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:37:08 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:37:09.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:37:08 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:37:09.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:37:08 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:37:10.177 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:37:09 smithi119 ceph-mon[33693]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-21T01:37:10.184 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:37:09 smithi142 ceph-mon[34050]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-21T01:37:10.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:37:09 smithi083 ceph-mon[31370]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-21T01:37:10.821 INFO:journalctl@ceph.osd.7.smithi119.stdout:Sep 21 01:37:10 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-7[51223]: 2024-09-21T01:37:10.531+0000 7f38ec81d640 -1 osd.7 0 log_to_monitors true 2024-09-21T01:37:11.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:37:10 smithi142 ceph-mon[34050]: from='osd.7 [v2:172.21.15.119:6816/1556984819,v1:172.21.15.119:6817/1556984819]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T01:37:11.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:37:10 smithi142 ceph-mon[34050]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T01:37:11.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:37:10 smithi119 ceph-mon[33693]: from='osd.7 [v2:172.21.15.119:6816/1556984819,v1:172.21.15.119:6817/1556984819]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T01:37:11.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:37:10 smithi119 ceph-mon[33693]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T01:37:11.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:37:10 smithi083 ceph-mon[31370]: from='osd.7 [v2:172.21.15.119:6816/1556984819,v1:172.21.15.119:6817/1556984819]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T01:37:11.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:37:10 smithi083 ceph-mon[31370]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T01:37:11.578 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-21T01:37:11.604 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi142:vg_nvme/lv_2 2024-09-21T01:37:11.858 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T01:37:11.883 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:37:11 smithi142 ceph-mon[34050]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-21T01:37:11.884 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:37:11 smithi142 ceph-mon[34050]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-21T01:37:11.884 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:37:11 smithi142 ceph-mon[34050]: osdmap e44: 8 total, 7 up, 8 in 2024-09-21T01:37:11.884 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:37:11 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T01:37:11.884 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:37:11 smithi142 ceph-mon[34050]: from='osd.7 [v2:172.21.15.119:6816/1556984819,v1:172.21.15.119:6817/1556984819]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi119", "root=default"]} : dispatch 2024-09-21T01:37:11.884 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:37:11 smithi142 ceph-mon[34050]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi119", "root=default"]} : dispatch 2024-09-21T01:37:11.884 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:37:11 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:37:11.884 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:37:11 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:37:11.884 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:37:11 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T01:37:11.884 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:37:11 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T01:37:11.884 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:37:11 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T01:37:11.884 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:37:11 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:37:11.884 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:37:11 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:37:11.884 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:37:11 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:37:11.885 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:37:11 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:37:11.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:37:11 smithi119 ceph-mon[33693]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-21T01:37:11.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:37:11 smithi119 ceph-mon[33693]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-21T01:37:11.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:37:11 smithi119 ceph-mon[33693]: osdmap e44: 8 total, 7 up, 8 in 2024-09-21T01:37:11.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:37:11 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T01:37:11.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:37:11 smithi119 ceph-mon[33693]: from='osd.7 [v2:172.21.15.119:6816/1556984819,v1:172.21.15.119:6817/1556984819]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi119", "root=default"]} : dispatch 2024-09-21T01:37:11.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:37:11 smithi119 ceph-mon[33693]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi119", "root=default"]} : dispatch 2024-09-21T01:37:11.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:37:11 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:37:11.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:37:11 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:37:11.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:37:11 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T01:37:11.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:37:11 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T01:37:11.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:37:11 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T01:37:11.969 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:37:11 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:37:11.969 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:37:11 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:37:11.969 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:37:11 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:37:11.969 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:37:11 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:37:12.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:37:11 smithi083 ceph-mon[31370]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-21T01:37:12.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:37:11 smithi083 ceph-mon[31370]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-21T01:37:12.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:37:11 smithi083 ceph-mon[31370]: osdmap e44: 8 total, 7 up, 8 in 2024-09-21T01:37:12.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:37:11 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T01:37:12.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:37:11 smithi083 ceph-mon[31370]: from='osd.7 [v2:172.21.15.119:6816/1556984819,v1:172.21.15.119:6817/1556984819]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi119", "root=default"]} : dispatch 2024-09-21T01:37:12.305 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:37:11 smithi083 ceph-mon[31370]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi119", "root=default"]} : dispatch 2024-09-21T01:37:12.305 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:37:11 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:37:12.305 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:37:11 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:37:12.305 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:37:11 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T01:37:12.305 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:37:11 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T01:37:12.305 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:37:11 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T01:37:12.305 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:37:11 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:37:12.305 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:37:11 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:37:12.305 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:37:11 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:37:12.305 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:37:11 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:37:12.346 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:37:12.343+0000 7fd340066640 1 -- 172.21.15.142:0/2159931811 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd338102a60 msgr2=0x7fd338102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:37:12.346 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:37:12.343+0000 7fd340066640 1 --2- 172.21.15.142:0/2159931811 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd338102a60 0x7fd338102e70 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fd334009900 tx=0x7fd33402a410 comp rx=0 tx=0).stop 2024-09-21T01:37:12.346 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:37:12.343+0000 7fd340066640 1 -- 172.21.15.142:0/2159931811 shutdown_connections 2024-09-21T01:37:12.346 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:37:12.343+0000 7fd340066640 1 --2- 172.21.15.142:0/2159931811 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd338108cf0 0x7fd33810f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:37:12.346 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:37:12.343+0000 7fd340066640 1 --2- 172.21.15.142:0/2159931811 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd3381083a0 0x7fd3381087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:37:12.347 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:37:12.343+0000 7fd340066640 1 --2- 172.21.15.142:0/2159931811 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd338102a60 0x7fd338102e70 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:37:12.347 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:37:12.343+0000 7fd340066640 1 -- 172.21.15.142:0/2159931811 >> 172.21.15.142:0/2159931811 conn(0x7fd338079730 msgr2=0x7fd338079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:37:12.347 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:37:12.343+0000 7fd340066640 1 -- 172.21.15.142:0/2159931811 shutdown_connections 2024-09-21T01:37:12.347 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:37:12.343+0000 7fd340066640 1 -- 172.21.15.142:0/2159931811 wait complete. 2024-09-21T01:37:12.347 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:37:12.344+0000 7fd340066640 1 Processor -- start 2024-09-21T01:37:12.347 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:37:12.344+0000 7fd340066640 1 -- start start 2024-09-21T01:37:12.347 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:37:12.344+0000 7fd340066640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd338102a60 0x7fd338199300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:37:12.347 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:37:12.344+0000 7fd340066640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd3381083a0 0x7fd3381998a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:37:12.347 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:37:12.344+0000 7fd340066640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd338108cf0 0x7fd33819eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:37:12.347 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:37:12.345+0000 7fd340066640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fd338112810 con 0x7fd338102a60 2024-09-21T01:37:12.347 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:37:12.345+0000 7fd340066640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fd338112690 con 0x7fd3381083a0 2024-09-21T01:37:12.347 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:37:12.345+0000 7fd340066640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fd338112990 con 0x7fd338108cf0 2024-09-21T01:37:12.347 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:37:12.345+0000 7fd33e603640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd338108cf0 0x7fd33819eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:37:12.348 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:37:12.345+0000 7fd33e603640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd338108cf0 0x7fd33819eb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:58638/0 (socket says 172.21.15.142:58638) 2024-09-21T01:37:12.348 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:37:12.345+0000 7fd33e603640 1 -- 172.21.15.142:0/1413684342 learned_addr learned my addr 172.21.15.142:0/1413684342 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-21T01:37:12.348 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:37:12.345+0000 7fd33d601640 1 --2- 172.21.15.142:0/1413684342 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd3381083a0 0x7fd3381998a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:37:12.348 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:37:12.345+0000 7fd33de02640 1 --2- 172.21.15.142:0/1413684342 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd338102a60 0x7fd338199300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:37:12.348 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:37:12.345+0000 7fd33e603640 1 -- 172.21.15.142:0/1413684342 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd3381083a0 msgr2=0x7fd3381998a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:37:12.348 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:37:12.345+0000 7fd33e603640 1 --2- 172.21.15.142:0/1413684342 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd3381083a0 0x7fd3381998a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:37:12.348 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:37:12.345+0000 7fd33e603640 1 -- 172.21.15.142:0/1413684342 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd338102a60 msgr2=0x7fd338199300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:37:12.348 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:37:12.345+0000 7fd33e603640 1 --2- 172.21.15.142:0/1413684342 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd338102a60 0x7fd338199300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:37:12.348 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:37:12.345+0000 7fd33e603640 1 -- 172.21.15.142:0/1413684342 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd33819f1b0 con 0x7fd338108cf0 2024-09-21T01:37:12.348 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:37:12.345+0000 7fd33e603640 1 --2- 172.21.15.142:0/1413684342 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd338108cf0 0x7fd33819eb40 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fd33000cce0 tx=0x7fd33000a620 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:37:12.348 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:37:12.345+0000 7fd32effd640 1 -- 172.21.15.142:0/1413684342 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd33000f450 con 0x7fd338108cf0 2024-09-21T01:37:12.348 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:37:12.345+0000 7fd340066640 1 -- 172.21.15.142:0/1413684342 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd33819f4a0 con 0x7fd338108cf0 2024-09-21T01:37:12.349 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:37:12.345+0000 7fd32effd640 1 -- 172.21.15.142:0/1413684342 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd33000fa80 con 0x7fd338108cf0 2024-09-21T01:37:12.349 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:37:12.345+0000 7fd32effd640 1 -- 172.21.15.142:0/1413684342 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd330018ad0 con 0x7fd338108cf0 2024-09-21T01:37:12.349 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:37:12.346+0000 7fd340066640 1 -- 172.21.15.142:0/1413684342 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3381a5cc0 con 0x7fd338108cf0 2024-09-21T01:37:12.349 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:37:12.347+0000 7fd340066640 1 -- 172.21.15.142:0/1413684342 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd338102e70 con 0x7fd338108cf0 2024-09-21T01:37:12.349 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:37:12.348+0000 7fd32effd640 1 -- 172.21.15.142:0/1413684342 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 20) ==== 154529+0+0 (secure 0 0 0) 0x7fd33000f5f0 con 0x7fd338108cf0 2024-09-21T01:37:12.350 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:37:12.349+0000 7fd32effd640 1 --2- 172.21.15.142:0/1413684342 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fd3240b6590 0x7fd3240b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:37:12.350 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:37:12.349+0000 7fd32effd640 1 -- 172.21.15.142:0/1413684342 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5332+0+0 (secure 0 0 0) 0x7fd3300e6f70 con 0x7fd338108cf0 2024-09-21T01:37:12.350 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:37:12.349+0000 7fd33de02640 1 --2- 172.21.15.142:0/1413684342 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fd3240b6590 0x7fd3240b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:37:12.350 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:37:12.350+0000 7fd33de02640 1 --2- 172.21.15.142:0/1413684342 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fd3240b6590 0x7fd3240b8aa0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd3340057c0 tx=0x7fd3340058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:37:12.356 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:37:12.356+0000 7fd32effd640 1 -- 172.21.15.142:0/1413684342 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd330014030 con 0x7fd338108cf0 2024-09-21T01:37:12.545 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:37:12.544+0000 7fd340066640 1 -- 172.21.15.142:0/1413684342 --> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi142:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7fd338063800 con 0x7fd3240b6590 2024-09-21T01:37:12.718 INFO:journalctl@ceph.osd.7.smithi119.stdout:Sep 21 01:37:12 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-7[51223]: 2024-09-21T01:37:12.276+0000 7f38e879f640 -1 osd.7 0 waiting for initial osdmap 2024-09-21T01:37:12.718 INFO:journalctl@ceph.osd.7.smithi119.stdout:Sep 21 01:37:12 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-7[51223]: 2024-09-21T01:37:12.286+0000 7f38e0595640 -1 osd.7 45 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T01:37:13.181 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:37:12 smithi142 ceph-mon[34050]: Detected new or changed devices on smithi119 2024-09-21T01:37:13.182 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:37:12 smithi142 ceph-mon[34050]: Adjusting osd_memory_target on smithi119 to 5696M 2024-09-21T01:37:13.182 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:37:12 smithi142 ceph-mon[34050]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]': finished 2024-09-21T01:37:13.182 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:37:12 smithi142 ceph-mon[34050]: osdmap e45: 8 total, 7 up, 8 in 2024-09-21T01:37:13.182 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:37:12 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T01:37:13.182 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:37:12 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T01:37:13.182 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:37:12 smithi142 ceph-mon[34050]: from='osd.7 ' entity='osd.7' 2024-09-21T01:37:13.182 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:37:12 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T01:37:13.182 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:37:12 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T01:37:13.182 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:37:12 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:37:13.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:37:12 smithi119 ceph-mon[33693]: Detected new or changed devices on smithi119 2024-09-21T01:37:13.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:37:12 smithi119 ceph-mon[33693]: Adjusting osd_memory_target on smithi119 to 5696M 2024-09-21T01:37:13.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:37:12 smithi119 ceph-mon[33693]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]': finished 2024-09-21T01:37:13.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:37:12 smithi119 ceph-mon[33693]: osdmap e45: 8 total, 7 up, 8 in 2024-09-21T01:37:13.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:37:12 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T01:37:13.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:37:12 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T01:37:13.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:37:12 smithi119 ceph-mon[33693]: from='osd.7 ' entity='osd.7' 2024-09-21T01:37:13.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:37:12 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T01:37:13.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:37:12 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T01:37:13.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:37:12 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:37:13.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:37:12 smithi083 ceph-mon[31370]: Detected new or changed devices on smithi119 2024-09-21T01:37:13.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:37:12 smithi083 ceph-mon[31370]: Adjusting osd_memory_target on smithi119 to 5696M 2024-09-21T01:37:13.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:37:12 smithi083 ceph-mon[31370]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]': finished 2024-09-21T01:37:13.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:37:12 smithi083 ceph-mon[31370]: osdmap e45: 8 total, 7 up, 8 in 2024-09-21T01:37:13.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:37:12 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T01:37:13.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:37:12 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T01:37:13.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:37:12 smithi083 ceph-mon[31370]: from='osd.7 ' entity='osd.7' 2024-09-21T01:37:13.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:37:12 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T01:37:13.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:37:12 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T01:37:13.305 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:37:12 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:37:13.927 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:37:13 smithi142 ceph-mon[34050]: purged_snaps scrub starts 2024-09-21T01:37:13.927 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:37:13 smithi142 ceph-mon[34050]: purged_snaps scrub ok 2024-09-21T01:37:13.927 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:37:13 smithi142 ceph-mon[34050]: from='client.24463 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi142:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:37:13.927 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:37:13 smithi142 ceph-mon[34050]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-21T01:37:13.927 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:37:13 smithi142 ceph-mon[34050]: osd.7 [v2:172.21.15.119:6816/1556984819,v1:172.21.15.119:6817/1556984819] boot 2024-09-21T01:37:13.927 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:37:13 smithi142 ceph-mon[34050]: osdmap e46: 8 total, 8 up, 8 in 2024-09-21T01:37:13.927 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:37:13 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T01:37:13.928 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:37:13 smithi142 ceph-mon[34050]: osdmap e47: 8 total, 8 up, 8 in 2024-09-21T01:37:14.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:37:13 smithi083 ceph-mon[31370]: purged_snaps scrub starts 2024-09-21T01:37:14.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:37:13 smithi083 ceph-mon[31370]: purged_snaps scrub ok 2024-09-21T01:37:14.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:37:13 smithi083 ceph-mon[31370]: from='client.24463 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi142:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:37:14.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:37:13 smithi083 ceph-mon[31370]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-21T01:37:14.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:37:13 smithi083 ceph-mon[31370]: osd.7 [v2:172.21.15.119:6816/1556984819,v1:172.21.15.119:6817/1556984819] boot 2024-09-21T01:37:14.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:37:13 smithi083 ceph-mon[31370]: osdmap e46: 8 total, 8 up, 8 in 2024-09-21T01:37:14.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:37:13 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T01:37:14.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:37:13 smithi083 ceph-mon[31370]: osdmap e47: 8 total, 8 up, 8 in 2024-09-21T01:37:14.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:37:13 smithi119 ceph-mon[33693]: purged_snaps scrub starts 2024-09-21T01:37:14.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:37:13 smithi119 ceph-mon[33693]: purged_snaps scrub ok 2024-09-21T01:37:14.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:37:13 smithi119 ceph-mon[33693]: from='client.24463 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi142:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:37:14.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:37:13 smithi119 ceph-mon[33693]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 208 MiB used, 626 GiB / 626 GiB avail 2024-09-21T01:37:14.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:37:13 smithi119 ceph-mon[33693]: osd.7 [v2:172.21.15.119:6816/1556984819,v1:172.21.15.119:6817/1556984819] boot 2024-09-21T01:37:14.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:37:13 smithi119 ceph-mon[33693]: osdmap e46: 8 total, 8 up, 8 in 2024-09-21T01:37:14.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:37:13 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T01:37:14.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:37:13 smithi119 ceph-mon[33693]: osdmap e47: 8 total, 8 up, 8 in 2024-09-21T01:37:15.965 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:37:15 smithi142 ceph-mon[34050]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-09-21T01:37:15.965 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:37:15 smithi142 ceph-mon[34050]: osdmap e48: 8 total, 8 up, 8 in 2024-09-21T01:37:15.965 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:37:15 smithi142 ceph-mon[34050]: from='client.? 172.21.15.142:0/3124461355' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "d46e56d4-ed4e-42c3-a315-66af014bd93a"} : dispatch 2024-09-21T01:37:15.966 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:37:15 smithi142 ceph-mon[34050]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "d46e56d4-ed4e-42c3-a315-66af014bd93a"} : dispatch 2024-09-21T01:37:15.966 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:37:15 smithi142 ceph-mon[34050]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d46e56d4-ed4e-42c3-a315-66af014bd93a"}]': finished 2024-09-21T01:37:15.966 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:37:15 smithi142 ceph-mon[34050]: osdmap e49: 9 total, 8 up, 9 in 2024-09-21T01:37:15.967 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:37:15 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T01:37:15.967 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:37:15 smithi142 ceph-mon[34050]: from='client.? 172.21.15.142:0/593036425' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T01:37:16.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:37:15 smithi083 ceph-mon[31370]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-09-21T01:37:16.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:37:15 smithi083 ceph-mon[31370]: osdmap e48: 8 total, 8 up, 8 in 2024-09-21T01:37:16.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:37:15 smithi083 ceph-mon[31370]: from='client.? 172.21.15.142:0/3124461355' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "d46e56d4-ed4e-42c3-a315-66af014bd93a"} : dispatch 2024-09-21T01:37:16.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:37:15 smithi083 ceph-mon[31370]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "d46e56d4-ed4e-42c3-a315-66af014bd93a"} : dispatch 2024-09-21T01:37:16.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:37:15 smithi083 ceph-mon[31370]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d46e56d4-ed4e-42c3-a315-66af014bd93a"}]': finished 2024-09-21T01:37:16.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:37:15 smithi083 ceph-mon[31370]: osdmap e49: 9 total, 8 up, 9 in 2024-09-21T01:37:16.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:37:15 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T01:37:16.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:37:15 smithi083 ceph-mon[31370]: from='client.? 172.21.15.142:0/593036425' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T01:37:16.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:37:15 smithi119 ceph-mon[33693]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-09-21T01:37:16.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:37:15 smithi119 ceph-mon[33693]: osdmap e48: 8 total, 8 up, 8 in 2024-09-21T01:37:16.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:37:15 smithi119 ceph-mon[33693]: from='client.? 172.21.15.142:0/3124461355' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "d46e56d4-ed4e-42c3-a315-66af014bd93a"} : dispatch 2024-09-21T01:37:16.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:37:15 smithi119 ceph-mon[33693]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "d46e56d4-ed4e-42c3-a315-66af014bd93a"} : dispatch 2024-09-21T01:37:16.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:37:15 smithi119 ceph-mon[33693]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d46e56d4-ed4e-42c3-a315-66af014bd93a"}]': finished 2024-09-21T01:37:16.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:37:15 smithi119 ceph-mon[33693]: osdmap e49: 9 total, 8 up, 9 in 2024-09-21T01:37:16.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:37:15 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T01:37:16.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:37:15 smithi119 ceph-mon[33693]: from='client.? 172.21.15.142:0/593036425' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T01:37:18.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:37:17 smithi083 ceph-mon[31370]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-09-21T01:37:18.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:37:17 smithi142 ceph-mon[34050]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-09-21T01:37:18.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:37:17 smithi119 ceph-mon[33693]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-09-21T01:37:20.055 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:37:19 smithi083 ceph-mon[31370]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 98 KiB/s, 0 objects/s recovering 2024-09-21T01:37:20.348 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:37:19 smithi119 ceph-mon[33693]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 98 KiB/s, 0 objects/s recovering 2024-09-21T01:37:20.348 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:37:19 smithi142 ceph-mon[34050]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 98 KiB/s, 0 objects/s recovering 2024-09-21T01:37:21.925 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:37:21 smithi142 ceph-mon[34050]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 83 KiB/s, 0 objects/s recovering 2024-09-21T01:37:22.039 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:37:21 smithi119 ceph-mon[33693]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 83 KiB/s, 0 objects/s recovering 2024-09-21T01:37:22.053 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:37:21 smithi083 ceph-mon[31370]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 83 KiB/s, 0 objects/s recovering 2024-09-21T01:37:24.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:37:23 smithi083 ceph-mon[31370]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T01:37:24.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:37:23 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2024-09-21T01:37:24.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:37:23 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:37:24.069 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:37:23 smithi142 ceph-mon[34050]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T01:37:24.069 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:37:23 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2024-09-21T01:37:24.070 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:37:23 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:37:24.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:37:23 smithi119 ceph-mon[33693]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T01:37:24.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:37:23 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2024-09-21T01:37:24.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:37:23 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:37:25.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:37:24 smithi083 ceph-mon[31370]: Deploying daemon osd.8 on smithi142 2024-09-21T01:37:25.141 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:37:24 smithi142 ceph-mon[34050]: Deploying daemon osd.8 on smithi142 2024-09-21T01:37:25.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:37:24 smithi119 ceph-mon[33693]: Deploying daemon osd.8 on smithi142 2024-09-21T01:37:26.053 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:37:25 smithi083 ceph-mon[31370]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T01:37:26.196 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:37:25 smithi142 ceph-mon[34050]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T01:37:26.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:37:25 smithi119 ceph-mon[33693]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T01:37:28.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:37:27 smithi083 ceph-mon[31370]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-09-21T01:37:28.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:37:27 smithi142 ceph-mon[34050]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-09-21T01:37:28.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:37:27 smithi119 ceph-mon[33693]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-09-21T01:37:30.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:37:29 smithi083 ceph-mon[31370]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T01:37:30.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:37:29 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:37:30.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:37:29 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:37:30.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:37:29 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:37:30.137 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:37:29 smithi142 ceph-mon[34050]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T01:37:30.137 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:37:29 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:37:30.137 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:37:29 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:37:30.137 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:37:29 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:37:30.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:37:29 smithi119 ceph-mon[33693]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T01:37:30.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:37:29 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:37:30.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:37:29 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:37:30.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:37:29 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:37:31.964 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:37:31 smithi142 ceph-mon[34050]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-09-21T01:37:32.119 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:37:31 smithi083 ceph-mon[31370]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-09-21T01:37:32.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:37:31 smithi119 ceph-mon[33693]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-09-21T01:37:33.327 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:37:33 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:37:33.327 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:37:33 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:37:33.327 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:37:33 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:37:33.327 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:37:33 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:37:33.327 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:37:33 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:37:33.327 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:37:33 smithi142 ceph-mon[34050]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-09-21T01:37:33.368 INFO:teuthology.orchestra.run.smithi142.stdout:Created osd(s) 8 on host 'smithi142' 2024-09-21T01:37:33.368 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:37:33.367+0000 7fd32effd640 1 -- 172.21.15.142:0/1413684342 <== mgr.14223 v2:172.21.15.83:6800/1748483157 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fd338063800 con 0x7fd3240b6590 2024-09-21T01:37:33.371 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:37:33.370+0000 7fd340066640 1 -- 172.21.15.142:0/1413684342 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fd3240b6590 msgr2=0x7fd3240b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:37:33.371 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:37:33.370+0000 7fd340066640 1 --2- 172.21.15.142:0/1413684342 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fd3240b6590 0x7fd3240b8aa0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd3340057c0 tx=0x7fd3340058d0 comp rx=0 tx=0).stop 2024-09-21T01:37:33.371 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:37:33.370+0000 7fd340066640 1 -- 172.21.15.142:0/1413684342 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd338108cf0 msgr2=0x7fd33819eb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:37:33.371 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:37:33.370+0000 7fd340066640 1 --2- 172.21.15.142:0/1413684342 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd338108cf0 0x7fd33819eb40 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fd33000cce0 tx=0x7fd33000a620 comp rx=0 tx=0).stop 2024-09-21T01:37:33.371 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:37:33.370+0000 7fd340066640 1 -- 172.21.15.142:0/1413684342 shutdown_connections 2024-09-21T01:37:33.371 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:37:33.370+0000 7fd340066640 1 --2- 172.21.15.142:0/1413684342 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fd3240b6590 0x7fd3240b8aa0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:37:33.371 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:37:33.370+0000 7fd340066640 1 --2- 172.21.15.142:0/1413684342 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd338108cf0 0x7fd33819eb40 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:37:33.371 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:37:33.370+0000 7fd340066640 1 --2- 172.21.15.142:0/1413684342 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd3381083a0 0x7fd3381998a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:37:33.371 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:37:33.370+0000 7fd340066640 1 --2- 172.21.15.142:0/1413684342 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd338102a60 0x7fd338199300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:37:33.371 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:37:33.370+0000 7fd340066640 1 -- 172.21.15.142:0/1413684342 >> 172.21.15.142:0/1413684342 conn(0x7fd338079730 msgr2=0x7fd338101560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:37:33.371 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:37:33.370+0000 7fd340066640 1 -- 172.21.15.142:0/1413684342 shutdown_connections 2024-09-21T01:37:33.371 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:37:33.370+0000 7fd340066640 1 -- 172.21.15.142:0/1413684342 wait complete. 2024-09-21T01:37:33.467 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:37:33 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:37:33.468 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:37:33 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:37:33.468 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:37:33 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:37:33.468 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:37:33 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:37:33.468 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:37:33 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:37:33.468 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:37:33 smithi119 ceph-mon[33693]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-09-21T01:37:33.553 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:37:33 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:37:33.553 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:37:33 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:37:33.554 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:37:33 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:37:33.554 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:37:33 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:37:33.554 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:37:33 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:37:33.554 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:37:33 smithi083 ceph-mon[31370]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-09-21T01:37:34.010 DEBUG:teuthology.orchestra.run.smithi142:osd.8> sudo journalctl -f -n 0 -u ceph-f7697ecc-77b8-11ef-baf5-efdc52797490@osd.8.service 2024-09-21T01:37:34.012 INFO:tasks.cephadm:Deploying osd.9 on smithi083 with /dev/vg_nvme/lv_1... 2024-09-21T01:37:34.012 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_1 2024-09-21T01:37:34.242 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:37:34 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:37:34.242 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:37:34 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:37:34.242 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:37:34 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:37:34.259 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:37:34.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:37:34 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:37:34.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:37:34 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:37:34.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:37:34 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:37:34.717 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:37:34 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:37:34.718 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:37:34 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:37:34.718 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:37:34 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:37:35.382 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:37:35 smithi142 ceph-mon[34050]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-09-21T01:37:35.383 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:37:35 smithi142 ceph-mon[34050]: from='osd.8 [v2:172.21.15.142:6816/1860679473,v1:172.21.15.142:6817/1860679473]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-21T01:37:35.383 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:37:35 smithi142 ceph-mon[34050]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-21T01:37:35.383 INFO:journalctl@ceph.osd.8.smithi142.stdout:Sep 21 01:37:35 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-8[51832]: 2024-09-21T01:37:35.067+0000 7f95b7ae6640 -1 osd.8 0 log_to_monitors true 2024-09-21T01:37:35.553 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:37:35 smithi083 ceph-mon[31370]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-09-21T01:37:35.554 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:37:35 smithi083 ceph-mon[31370]: from='osd.8 [v2:172.21.15.142:6816/1860679473,v1:172.21.15.142:6817/1860679473]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-21T01:37:35.554 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:37:35 smithi083 ceph-mon[31370]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-21T01:37:35.717 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:37:35 smithi119 ceph-mon[33693]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-09-21T01:37:35.718 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:37:35 smithi119 ceph-mon[33693]: from='osd.8 [v2:172.21.15.142:6816/1860679473,v1:172.21.15.142:6817/1860679473]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-21T01:37:35.718 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:37:35 smithi119 ceph-mon[33693]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-21T01:37:36.527 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:37:36 smithi083 ceph-mon[31370]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-21T01:37:36.527 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:37:36 smithi083 ceph-mon[31370]: osdmap e50: 9 total, 8 up, 9 in 2024-09-21T01:37:36.527 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:37:36 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T01:37:36.527 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:37:36 smithi083 ceph-mon[31370]: from='osd.8 [v2:172.21.15.142:6816/1860679473,v1:172.21.15.142:6817/1860679473]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi142", "root=default"]} : dispatch 2024-09-21T01:37:36.527 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:37:36 smithi083 ceph-mon[31370]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi142", "root=default"]} : dispatch 2024-09-21T01:37:36.670 INFO:journalctl@ceph.osd.8.smithi142.stdout:Sep 21 01:37:36 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-8[51832]: 2024-09-21T01:37:36.239+0000 7f95b3a68640 -1 osd.8 0 waiting for initial osdmap 2024-09-21T01:37:36.670 INFO:journalctl@ceph.osd.8.smithi142.stdout:Sep 21 01:37:36 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-8[51832]: 2024-09-21T01:37:36.252+0000 7f95af866640 -1 osd.8 51 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T01:37:36.670 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:37:36 smithi142 ceph-mon[34050]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-21T01:37:36.670 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:37:36 smithi142 ceph-mon[34050]: osdmap e50: 9 total, 8 up, 9 in 2024-09-21T01:37:36.671 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:37:36 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T01:37:36.671 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:37:36 smithi142 ceph-mon[34050]: from='osd.8 [v2:172.21.15.142:6816/1860679473,v1:172.21.15.142:6817/1860679473]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi142", "root=default"]} : dispatch 2024-09-21T01:37:36.671 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:37:36 smithi142 ceph-mon[34050]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi142", "root=default"]} : dispatch 2024-09-21T01:37:36.718 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:37:36 smithi119 ceph-mon[33693]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-21T01:37:36.718 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:37:36 smithi119 ceph-mon[33693]: osdmap e50: 9 total, 8 up, 9 in 2024-09-21T01:37:36.718 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:37:36 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T01:37:36.718 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:37:36 smithi119 ceph-mon[33693]: from='osd.8 [v2:172.21.15.142:6816/1860679473,v1:172.21.15.142:6817/1860679473]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi142", "root=default"]} : dispatch 2024-09-21T01:37:36.718 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:37:36 smithi119 ceph-mon[33693]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi142", "root=default"]} : dispatch 2024-09-21T01:37:36.974 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T01:37:37.003 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi083:vg_nvme/lv_1 2024-09-21T01:37:37.256 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:37:37.501 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:37:37 smithi083 ceph-mon[31370]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi142", "root=default"]}]': finished 2024-09-21T01:37:37.502 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:37:37 smithi083 ceph-mon[31370]: osdmap e51: 9 total, 8 up, 9 in 2024-09-21T01:37:37.502 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:37:37 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T01:37:37.502 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:37:37 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T01:37:37.502 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:37:37 smithi083 ceph-mon[31370]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-09-21T01:37:37.502 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:37:37 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:37:37.502 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:37:37 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:37:37.502 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:37:37 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T01:37:37.502 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:37:37 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T01:37:37.502 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:37:37 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T01:37:37.502 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:37:37 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:37:37.502 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:37:37 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:37:37.502 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:37:37 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:37:37.502 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:37:37 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:37:37.714 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:37:37 smithi142 ceph-mon[34050]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi142", "root=default"]}]': finished 2024-09-21T01:37:37.715 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:37:37 smithi142 ceph-mon[34050]: osdmap e51: 9 total, 8 up, 9 in 2024-09-21T01:37:37.715 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:37:37 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T01:37:37.715 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:37:37 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T01:37:37.715 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:37:37 smithi142 ceph-mon[34050]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-09-21T01:37:37.715 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:37:37 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:37:37.715 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:37:37 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:37:37.715 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:37:37 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T01:37:37.715 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:37:37 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T01:37:37.715 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:37:37 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T01:37:37.715 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:37:37 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:37:37.715 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:37:37 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:37:37.716 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:37:37 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:37:37.716 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:37:37 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:37:37.717 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:37:37 smithi119 ceph-mon[33693]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi142", "root=default"]}]': finished 2024-09-21T01:37:37.717 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:37:37 smithi119 ceph-mon[33693]: osdmap e51: 9 total, 8 up, 9 in 2024-09-21T01:37:37.718 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:37:37 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T01:37:37.718 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:37:37 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T01:37:37.718 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:37:37 smithi119 ceph-mon[33693]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 240 MiB used, 715 GiB / 715 GiB avail 2024-09-21T01:37:37.718 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:37:37 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:37:37.718 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:37:37 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:37:37.718 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:37:37 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T01:37:37.718 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:37:37 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T01:37:37.718 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:37:37 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T01:37:37.718 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:37:37 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:37:37.718 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:37:37 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:37:37.718 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:37:37 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:37:37.718 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:37:37 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:37:37.741 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:37:37.726+0000 7fcb38cef640 1 -- 172.21.15.83:0/768423893 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcb34108530 msgr2=0x7fcb3410ed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:37:37.741 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:37:37.726+0000 7fcb38cef640 1 --2- 172.21.15.83:0/768423893 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcb34108530 0x7fcb3410ed60 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fcb2c009900 tx=0x7fcb2c02a410 comp rx=0 tx=0).stop 2024-09-21T01:37:37.741 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:37:37.726+0000 7fcb38cef640 1 -- 172.21.15.83:0/768423893 shutdown_connections 2024-09-21T01:37:37.741 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:37:37.726+0000 7fcb38cef640 1 --2- 172.21.15.83:0/768423893 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcb34108530 0x7fcb3410ed60 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:37:37.742 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:37:37.726+0000 7fcb38cef640 1 --2- 172.21.15.83:0/768423893 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcb34107be0 0x7fcb34107ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:37:37.742 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:37:37.726+0000 7fcb38cef640 1 --2- 172.21.15.83:0/768423893 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcb341022a0 0x7fcb341026b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:37:37.742 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:37:37.726+0000 7fcb38cef640 1 -- 172.21.15.83:0/768423893 >> 172.21.15.83:0/768423893 conn(0x7fcb34079ec0 msgr2=0x7fcb3407a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:37:37.742 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:37:37.726+0000 7fcb38cef640 1 -- 172.21.15.83:0/768423893 shutdown_connections 2024-09-21T01:37:37.742 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:37:37.726+0000 7fcb38cef640 1 -- 172.21.15.83:0/768423893 wait complete. 2024-09-21T01:37:37.742 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:37:37.726+0000 7fcb38cef640 1 Processor -- start 2024-09-21T01:37:37.742 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:37:37.727+0000 7fcb38cef640 1 -- start start 2024-09-21T01:37:37.742 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:37:37.727+0000 7fcb38cef640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcb341022a0 0x7fcb3419b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:37:37.742 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:37:37.727+0000 7fcb38cef640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcb34107be0 0x7fcb3419b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:37:37.742 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:37:37.727+0000 7fcb38cef640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcb34108530 0x7fcb3419bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:37:37.742 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:37:37.727+0000 7fcb38cef640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fcb34112920 con 0x7fcb34107be0 2024-09-21T01:37:37.742 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:37:37.727+0000 7fcb38cef640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fcb341127a0 con 0x7fcb341022a0 2024-09-21T01:37:37.742 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:37:37.727+0000 7fcb38cef640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fcb34112aa0 con 0x7fcb34108530 2024-09-21T01:37:37.743 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:37:37.727+0000 7fcb31d9b640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcb34107be0 0x7fcb3419b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:37:37.743 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:37:37.727+0000 7fcb31d9b640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcb34107be0 0x7fcb3419b710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:58142/0 (socket says 172.21.15.83:58142) 2024-09-21T01:37:37.743 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:37:37.727+0000 7fcb31d9b640 1 -- 172.21.15.83:0/1544029595 learned_addr learned my addr 172.21.15.83:0/1544029595 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:37:37.743 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:37:37.727+0000 7fcb32d9d640 1 --2- 172.21.15.83:0/1544029595 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcb34108530 0x7fcb3419bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:37:37.743 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:37:37.727+0000 7fcb3259c640 1 --2- 172.21.15.83:0/1544029595 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcb341022a0 0x7fcb3419b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:37:37.743 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:37:37.727+0000 7fcb31d9b640 1 -- 172.21.15.83:0/1544029595 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcb34108530 msgr2=0x7fcb3419bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:37:37.743 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:37:37.727+0000 7fcb31d9b640 1 --2- 172.21.15.83:0/1544029595 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcb34108530 0x7fcb3419bc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:37:37.743 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:37:37.727+0000 7fcb31d9b640 1 -- 172.21.15.83:0/1544029595 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcb341022a0 msgr2=0x7fcb3419b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:37:37.743 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:37:37.727+0000 7fcb31d9b640 1 --2- 172.21.15.83:0/1544029595 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcb341022a0 0x7fcb3419b1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:37:37.743 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:37:37.727+0000 7fcb31d9b640 1 -- 172.21.15.83:0/1544029595 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb341a6460 con 0x7fcb34107be0 2024-09-21T01:37:37.743 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:37:37.727+0000 7fcb3259c640 1 --2- 172.21.15.83:0/1544029595 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcb341022a0 0x7fcb3419b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:37:37.743 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:37:37.727+0000 7fcb31d9b640 1 --2- 172.21.15.83:0/1544029595 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcb34107be0 0x7fcb3419b710 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fcb2800c970 tx=0x7fcb2800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:37:37.743 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:37:37.728+0000 7fcb237fe640 1 -- 172.21.15.83:0/1544029595 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb28007bb0 con 0x7fcb34107be0 2024-09-21T01:37:37.743 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:37:37.728+0000 7fcb237fe640 1 -- 172.21.15.83:0/1544029595 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcb28007d50 con 0x7fcb34107be0 2024-09-21T01:37:37.744 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:37:37.728+0000 7fcb38cef640 1 -- 172.21.15.83:0/1544029595 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb341a6750 con 0x7fcb34107be0 2024-09-21T01:37:37.744 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:37:37.728+0000 7fcb237fe640 1 -- 172.21.15.83:0/1544029595 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb28004da0 con 0x7fcb34107be0 2024-09-21T01:37:37.744 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:37:37.728+0000 7fcb38cef640 1 -- 172.21.15.83:0/1544029595 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb341a6c90 con 0x7fcb34107be0 2024-09-21T01:37:37.744 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:37:37.729+0000 7fcb38cef640 1 -- 172.21.15.83:0/1544029595 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb341026b0 con 0x7fcb34107be0 2024-09-21T01:37:37.744 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:37:37.730+0000 7fcb237fe640 1 -- 172.21.15.83:0/1544029595 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 20) ==== 154529+0+0 (secure 0 0 0) 0x7fcb28005000 con 0x7fcb34107be0 2024-09-21T01:37:37.744 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:37:37.731+0000 7fcb237fe640 1 --2- 172.21.15.83:0/1544029595 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fcb1c0b6590 0x7fcb1c0b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:37:37.744 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:37:37.731+0000 7fcb3259c640 1 --2- 172.21.15.83:0/1544029595 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fcb1c0b6590 0x7fcb1c0b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:37:37.744 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:37:37.731+0000 7fcb237fe640 1 -- 172.21.15.83:0/1544029595 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 6077+0+0 (secure 0 0 0) 0x7fcb280e6c90 con 0x7fcb34107be0 2024-09-21T01:37:37.744 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:37:37.732+0000 7fcb3259c640 1 --2- 172.21.15.83:0/1544029595 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fcb1c0b6590 0x7fcb1c0b8aa0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fcb24005c40 tx=0x7fcb2400a410 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:37:37.744 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:37:37.735+0000 7fcb237fe640 1 -- 172.21.15.83:0/1544029595 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fcb28014030 con 0x7fcb34107be0 2024-09-21T01:37:37.926 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:37:37.926+0000 7fcb38cef640 1 -- 172.21.15.83:0/1544029595 --> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi083:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7fcb3410a380 con 0x7fcb1c0b6590 2024-09-21T01:37:38.536 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:37:38 smithi083 ceph-mon[31370]: purged_snaps scrub starts 2024-09-21T01:37:38.536 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:37:38 smithi083 ceph-mon[31370]: purged_snaps scrub ok 2024-09-21T01:37:38.537 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:37:38 smithi083 ceph-mon[31370]: Detected new or changed devices on smithi142 2024-09-21T01:37:38.537 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:37:38 smithi083 ceph-mon[31370]: Adjusting osd_memory_target on smithi142 to 5696M 2024-09-21T01:37:38.537 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:37:38 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T01:37:38.537 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:37:38 smithi083 ceph-mon[31370]: osd.8 [v2:172.21.15.142:6816/1860679473,v1:172.21.15.142:6817/1860679473] boot 2024-09-21T01:37:38.537 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:37:38 smithi083 ceph-mon[31370]: osdmap e52: 9 total, 9 up, 9 in 2024-09-21T01:37:38.537 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:37:38 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T01:37:38.537 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:37:38 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T01:37:38.537 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:37:38 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T01:37:38.537 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:37:38 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:37:38.715 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:37:38 smithi142 ceph-mon[34050]: purged_snaps scrub starts 2024-09-21T01:37:38.715 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:37:38 smithi142 ceph-mon[34050]: purged_snaps scrub ok 2024-09-21T01:37:38.715 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:37:38 smithi142 ceph-mon[34050]: Detected new or changed devices on smithi142 2024-09-21T01:37:38.715 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:37:38 smithi142 ceph-mon[34050]: Adjusting osd_memory_target on smithi142 to 5696M 2024-09-21T01:37:38.715 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:37:38 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T01:37:38.715 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:37:38 smithi142 ceph-mon[34050]: osd.8 [v2:172.21.15.142:6816/1860679473,v1:172.21.15.142:6817/1860679473] boot 2024-09-21T01:37:38.715 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:37:38 smithi142 ceph-mon[34050]: osdmap e52: 9 total, 9 up, 9 in 2024-09-21T01:37:38.715 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:37:38 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T01:37:38.715 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:37:38 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T01:37:38.715 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:37:38 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T01:37:38.716 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:37:38 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:37:38.717 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:37:38 smithi119 ceph-mon[33693]: purged_snaps scrub starts 2024-09-21T01:37:38.718 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:37:38 smithi119 ceph-mon[33693]: purged_snaps scrub ok 2024-09-21T01:37:38.718 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:37:38 smithi119 ceph-mon[33693]: Detected new or changed devices on smithi142 2024-09-21T01:37:38.718 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:37:38 smithi119 ceph-mon[33693]: Adjusting osd_memory_target on smithi142 to 5696M 2024-09-21T01:37:38.718 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:37:38 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T01:37:38.718 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:37:38 smithi119 ceph-mon[33693]: osd.8 [v2:172.21.15.142:6816/1860679473,v1:172.21.15.142:6817/1860679473] boot 2024-09-21T01:37:38.718 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:37:38 smithi119 ceph-mon[33693]: osdmap e52: 9 total, 9 up, 9 in 2024-09-21T01:37:38.718 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:37:38 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T01:37:38.718 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:37:38 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T01:37:38.718 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:37:38 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T01:37:38.718 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:37:38 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:37:39.513 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:37:39 smithi083 ceph-mon[31370]: from='client.14655 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi083:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:37:39.513 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:37:39 smithi083 ceph-mon[31370]: osdmap e53: 9 total, 9 up, 9 in 2024-09-21T01:37:39.513 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:37:39 smithi083 ceph-mon[31370]: pgmap v176: 1 pgs: 1 remapped+peering; 577 KiB data, 266 MiB used, 804 GiB / 805 GiB avail 2024-09-21T01:37:39.602 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:37:39 smithi142 ceph-mon[34050]: from='client.14655 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi083:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:37:39.602 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:37:39 smithi142 ceph-mon[34050]: osdmap e53: 9 total, 9 up, 9 in 2024-09-21T01:37:39.603 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:37:39 smithi142 ceph-mon[34050]: pgmap v176: 1 pgs: 1 remapped+peering; 577 KiB data, 266 MiB used, 804 GiB / 805 GiB avail 2024-09-21T01:37:39.717 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:37:39 smithi119 ceph-mon[33693]: from='client.14655 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi083:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:37:39.718 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:37:39 smithi119 ceph-mon[33693]: osdmap e53: 9 total, 9 up, 9 in 2024-09-21T01:37:39.718 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:37:39 smithi119 ceph-mon[33693]: pgmap v176: 1 pgs: 1 remapped+peering; 577 KiB data, 266 MiB used, 804 GiB / 805 GiB avail 2024-09-21T01:37:40.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:37:40 smithi083 ceph-mon[31370]: osdmap e54: 9 total, 9 up, 9 in 2024-09-21T01:37:40.714 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:37:40 smithi142 ceph-mon[34050]: osdmap e54: 9 total, 9 up, 9 in 2024-09-21T01:37:40.717 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:37:40 smithi119 ceph-mon[33693]: osdmap e54: 9 total, 9 up, 9 in 2024-09-21T01:37:41.553 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:37:41 smithi083 ceph-mon[31370]: from='client.? 172.21.15.83:0/263141444' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "18a70ee6-56df-4f5c-868d-5db5e72a1859"} : dispatch 2024-09-21T01:37:41.554 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:37:41 smithi083 ceph-mon[31370]: from='client.? 172.21.15.83:0/263141444' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "18a70ee6-56df-4f5c-868d-5db5e72a1859"}]': finished 2024-09-21T01:37:41.554 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:37:41 smithi083 ceph-mon[31370]: osdmap e55: 10 total, 9 up, 10 in 2024-09-21T01:37:41.554 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:37:41 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T01:37:41.554 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:37:41 smithi083 ceph-mon[31370]: pgmap v179: 1 pgs: 1 remapped+peering; 577 KiB data, 266 MiB used, 804 GiB / 805 GiB avail 2024-09-21T01:37:41.554 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:37:41 smithi083 ceph-mon[31370]: from='client.? 172.21.15.83:0/2048008696' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T01:37:41.715 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:37:41 smithi142 ceph-mon[34050]: from='client.? 172.21.15.83:0/263141444' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "18a70ee6-56df-4f5c-868d-5db5e72a1859"} : dispatch 2024-09-21T01:37:41.715 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:37:41 smithi142 ceph-mon[34050]: from='client.? 172.21.15.83:0/263141444' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "18a70ee6-56df-4f5c-868d-5db5e72a1859"}]': finished 2024-09-21T01:37:41.715 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:37:41 smithi142 ceph-mon[34050]: osdmap e55: 10 total, 9 up, 10 in 2024-09-21T01:37:41.715 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:37:41 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T01:37:41.715 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:37:41 smithi142 ceph-mon[34050]: pgmap v179: 1 pgs: 1 remapped+peering; 577 KiB data, 266 MiB used, 804 GiB / 805 GiB avail 2024-09-21T01:37:41.715 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:37:41 smithi142 ceph-mon[34050]: from='client.? 172.21.15.83:0/2048008696' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T01:37:41.717 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:37:41 smithi119 ceph-mon[33693]: from='client.? 172.21.15.83:0/263141444' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "18a70ee6-56df-4f5c-868d-5db5e72a1859"} : dispatch 2024-09-21T01:37:41.717 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:37:41 smithi119 ceph-mon[33693]: from='client.? 172.21.15.83:0/263141444' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "18a70ee6-56df-4f5c-868d-5db5e72a1859"}]': finished 2024-09-21T01:37:41.717 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:37:41 smithi119 ceph-mon[33693]: osdmap e55: 10 total, 9 up, 10 in 2024-09-21T01:37:41.717 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:37:41 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T01:37:41.717 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:37:41 smithi119 ceph-mon[33693]: pgmap v179: 1 pgs: 1 remapped+peering; 577 KiB data, 266 MiB used, 804 GiB / 805 GiB avail 2024-09-21T01:37:41.718 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:37:41 smithi119 ceph-mon[33693]: from='client.? 172.21.15.83:0/2048008696' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T01:37:44.053 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:37:43 smithi083 ceph-mon[31370]: pgmap v180: 1 pgs: 1 remapped+peering; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-09-21T01:37:44.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:37:43 smithi142 ceph-mon[34050]: pgmap v180: 1 pgs: 1 remapped+peering; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-09-21T01:37:44.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:37:43 smithi119 ceph-mon[33693]: pgmap v180: 1 pgs: 1 remapped+peering; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-09-21T01:37:45.877 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:37:45 smithi083 ceph-mon[31370]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail; 89 KiB/s, 0 objects/s recovering 2024-09-21T01:37:46.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:37:45 smithi142 ceph-mon[34050]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail; 89 KiB/s, 0 objects/s recovering 2024-09-21T01:37:46.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:37:45 smithi119 ceph-mon[33693]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail; 89 KiB/s, 0 objects/s recovering 2024-09-21T01:37:47.863 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:37:47 smithi083 ceph-mon[31370]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T01:37:48.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:37:47 smithi142 ceph-mon[34050]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T01:37:48.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:37:47 smithi119 ceph-mon[33693]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T01:37:50.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:37:49 smithi083 ceph-mon[31370]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-09-21T01:37:50.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:37:49 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2024-09-21T01:37:50.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:37:49 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:37:50.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:37:49 smithi142 ceph-mon[34050]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-09-21T01:37:50.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:37:49 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2024-09-21T01:37:50.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:37:49 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:37:50.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:37:49 smithi119 ceph-mon[33693]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-09-21T01:37:50.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:37:49 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2024-09-21T01:37:50.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:37:49 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:37:51.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:37:50 smithi083 ceph-mon[31370]: Deploying daemon osd.9 on smithi083 2024-09-21T01:37:51.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:37:50 smithi142 ceph-mon[34050]: Deploying daemon osd.9 on smithi083 2024-09-21T01:37:51.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:37:50 smithi119 ceph-mon[33693]: Deploying daemon osd.9 on smithi083 2024-09-21T01:37:51.923 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:37:51 smithi083 ceph-mon[31370]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail; 56 KiB/s, 0 objects/s recovering 2024-09-21T01:37:52.116 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:37:51 smithi142 ceph-mon[34050]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail; 56 KiB/s, 0 objects/s recovering 2024-09-21T01:37:52.119 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:37:51 smithi119 ceph-mon[33693]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail; 56 KiB/s, 0 objects/s recovering 2024-09-21T01:37:54.004 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:37:53 smithi083 ceph-mon[31370]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T01:37:54.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:37:53 smithi142 ceph-mon[34050]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T01:37:54.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:37:53 smithi119 ceph-mon[33693]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T01:37:55.170 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:37:54 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:37:55.170 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:37:54 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:37:55.171 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:37:54 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:37:55.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:37:54 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:37:55.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:37:54 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:37:55.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:37:54 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:37:55.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:37:54 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:37:55.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:37:54 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:37:55.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:37:54 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:37:56.071 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:37:55 smithi083 ceph-mon[31370]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T01:37:56.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:37:55 smithi142 ceph-mon[34050]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T01:37:56.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:37:55 smithi119 ceph-mon[33693]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T01:37:58.188 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:37:57 smithi083 ceph-mon[31370]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-09-21T01:37:58.188 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:37:57 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:37:58.188 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:37:57 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:37:58.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:37:57 smithi142 ceph-mon[34050]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-09-21T01:37:58.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:37:57 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:37:58.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:37:57 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:37:58.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:37:57 smithi119 ceph-mon[33693]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-09-21T01:37:58.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:37:57 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:37:58.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:37:57 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:37:58.227 INFO:teuthology.orchestra.run.smithi083.stdout:Created osd(s) 9 on host 'smithi083' 2024-09-21T01:37:58.228 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:37:58.226+0000 7fcb237fe640 1 -- 172.21.15.83:0/1544029595 <== mgr.14223 v2:172.21.15.83:6800/1748483157 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fcb3410a380 con 0x7fcb1c0b6590 2024-09-21T01:37:58.230 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:37:58.229+0000 7fcb38cef640 1 -- 172.21.15.83:0/1544029595 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fcb1c0b6590 msgr2=0x7fcb1c0b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:37:58.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:37:58.229+0000 7fcb38cef640 1 --2- 172.21.15.83:0/1544029595 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fcb1c0b6590 0x7fcb1c0b8aa0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fcb24005c40 tx=0x7fcb2400a410 comp rx=0 tx=0).stop 2024-09-21T01:37:58.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:37:58.229+0000 7fcb38cef640 1 -- 172.21.15.83:0/1544029595 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcb34107be0 msgr2=0x7fcb3419b710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:37:58.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:37:58.229+0000 7fcb38cef640 1 --2- 172.21.15.83:0/1544029595 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcb34107be0 0x7fcb3419b710 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fcb2800c970 tx=0x7fcb2800ce30 comp rx=0 tx=0).stop 2024-09-21T01:37:58.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:37:58.229+0000 7fcb38cef640 1 -- 172.21.15.83:0/1544029595 shutdown_connections 2024-09-21T01:37:58.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:37:58.229+0000 7fcb38cef640 1 --2- 172.21.15.83:0/1544029595 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fcb1c0b6590 0x7fcb1c0b8aa0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:37:58.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:37:58.229+0000 7fcb38cef640 1 --2- 172.21.15.83:0/1544029595 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcb34108530 0x7fcb3419bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:37:58.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:37:58.229+0000 7fcb38cef640 1 --2- 172.21.15.83:0/1544029595 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcb34107be0 0x7fcb3419b710 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:37:58.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:37:58.229+0000 7fcb38cef640 1 --2- 172.21.15.83:0/1544029595 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcb341022a0 0x7fcb3419b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:37:58.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:37:58.229+0000 7fcb38cef640 1 -- 172.21.15.83:0/1544029595 >> 172.21.15.83:0/1544029595 conn(0x7fcb34079ec0 msgr2=0x7fcb34103bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:37:58.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:37:58.229+0000 7fcb38cef640 1 -- 172.21.15.83:0/1544029595 shutdown_connections 2024-09-21T01:37:58.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:37:58.229+0000 7fcb38cef640 1 -- 172.21.15.83:0/1544029595 wait complete. 2024-09-21T01:37:58.886 DEBUG:teuthology.orchestra.run.smithi083:osd.9> sudo journalctl -f -n 0 -u ceph-f7697ecc-77b8-11ef-baf5-efdc52797490@osd.9.service 2024-09-21T01:37:58.888 INFO:tasks.cephadm:Deploying osd.10 on smithi119 with /dev/vg_nvme/lv_1... 2024-09-21T01:37:58.888 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_1 2024-09-21T01:37:59.129 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:37:58 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:37:59.129 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:37:58 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:37:59.129 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:37:58 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:37:59.130 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:37:58 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:37:59.130 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:37:58 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:37:59.130 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:37:58 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:37:59.145 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T01:37:59.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:37:58 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:37:59.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:37:58 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:37:59.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:37:58 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:37:59.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:37:58 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:37:59.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:37:58 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:37:59.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:37:58 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:37:59.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:37:58 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:37:59.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:37:58 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:37:59.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:37:58 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:37:59.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:37:58 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:37:59.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:37:58 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:37:59.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:37:58 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:38:00.067 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:37:59 smithi083 ceph-mon[31370]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-09-21T01:38:00.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:37:59 smithi142 ceph-mon[34050]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-09-21T01:38:00.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:37:59 smithi119 ceph-mon[33693]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-09-21T01:38:01.304 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:38:00 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:38:00.936+0000 7fc2172b3640 -1 osd.9 0 log_to_monitors true 2024-09-21T01:38:01.766 INFO:teuthology.orchestra.run.smithi119.stdout: 2024-09-21T01:38:01.791 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi119:vg_nvme/lv_1 2024-09-21T01:38:02.048 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T01:38:02.169 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:38:01 smithi119 ceph-mon[33693]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-09-21T01:38:02.169 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:38:01 smithi119 ceph-mon[33693]: from='osd.9 [v2:172.21.15.83:6826/3636757924,v1:172.21.15.83:6827/3636757924]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2024-09-21T01:38:02.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:38:01 smithi142 ceph-mon[34050]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-09-21T01:38:02.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:38:01 smithi142 ceph-mon[34050]: from='osd.9 [v2:172.21.15.83:6826/3636757924,v1:172.21.15.83:6827/3636757924]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2024-09-21T01:38:02.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:38:01 smithi083 ceph-mon[31370]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-09-21T01:38:02.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:38:01 smithi083 ceph-mon[31370]: from='osd.9 [v2:172.21.15.83:6826/3636757924,v1:172.21.15.83:6827/3636757924]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2024-09-21T01:38:02.577 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:38:02.576+0000 7fb74e14e640 1 -- 172.21.15.119:0/2545482496 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb748102ae0 msgr2=0x7fb748102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:38:02.577 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:38:02.576+0000 7fb74e14e640 1 --2- 172.21.15.119:0/2545482496 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb748102ae0 0x7fb748102ef0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fb738009900 tx=0x7fb73802a410 comp rx=0 tx=0).stop 2024-09-21T01:38:02.577 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:38:02.576+0000 7fb74e14e640 1 -- 172.21.15.119:0/2545482496 shutdown_connections 2024-09-21T01:38:02.578 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:38:02.576+0000 7fb74e14e640 1 --2- 172.21.15.119:0/2545482496 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb748108d70 0x7fb74810f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:38:02.578 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:38:02.576+0000 7fb74e14e640 1 --2- 172.21.15.119:0/2545482496 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb748108420 0x7fb748108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:38:02.578 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:38:02.576+0000 7fb74e14e640 1 --2- 172.21.15.119:0/2545482496 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb748102ae0 0x7fb748102ef0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:38:02.578 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:38:02.576+0000 7fb74e14e640 1 -- 172.21.15.119:0/2545482496 >> 172.21.15.119:0/2545482496 conn(0x7fb748079770 msgr2=0x7fb748079b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:38:02.578 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:38:02.576+0000 7fb74e14e640 1 -- 172.21.15.119:0/2545482496 shutdown_connections 2024-09-21T01:38:02.578 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:38:02.576+0000 7fb74e14e640 1 -- 172.21.15.119:0/2545482496 wait complete. 2024-09-21T01:38:02.578 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:38:02.576+0000 7fb74e14e640 1 Processor -- start 2024-09-21T01:38:02.578 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:38:02.577+0000 7fb74e14e640 1 -- start start 2024-09-21T01:38:02.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:38:02.577+0000 7fb74e14e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb748102ae0 0x7fb74819b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:38:02.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:38:02.577+0000 7fb74e14e640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb748108420 0x7fb74819b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:38:02.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:38:02.577+0000 7fb74e14e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb748108d70 0x7fb74819bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:38:02.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:38:02.577+0000 7fb74e14e640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fb7481128e0 con 0x7fb748108420 2024-09-21T01:38:02.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:38:02.577+0000 7fb74e14e640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fb748112760 con 0x7fb748102ae0 2024-09-21T01:38:02.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:38:02.577+0000 7fb74e14e640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fb748112a60 con 0x7fb748108d70 2024-09-21T01:38:02.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:38:02.577+0000 7fb7477fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb748102ae0 0x7fb74819b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:38:02.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:38:02.577+0000 7fb7477fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb748102ae0 0x7fb74819b2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:36366/0 (socket says 172.21.15.119:36366) 2024-09-21T01:38:02.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:38:02.577+0000 7fb7477fe640 1 -- 172.21.15.119:0/472959296 learned_addr learned my addr 172.21.15.119:0/472959296 (peer_addr_for_me v2:172.21.15.119:0/0) 2024-09-21T01:38:02.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:38:02.577+0000 7fb746ffd640 1 --2- 172.21.15.119:0/472959296 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb748108420 0x7fb74819b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:38:02.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:38:02.577+0000 7fb747fff640 1 --2- 172.21.15.119:0/472959296 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb748108d70 0x7fb74819bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:38:02.580 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:38:02.578+0000 7fb7477fe640 1 -- 172.21.15.119:0/472959296 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb748108d70 msgr2=0x7fb74819bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:38:02.581 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:38:02.578+0000 7fb7477fe640 1 --2- 172.21.15.119:0/472959296 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb748108d70 0x7fb74819bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:38:02.581 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:38:02.578+0000 7fb7477fe640 1 -- 172.21.15.119:0/472959296 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb748108420 msgr2=0x7fb74819b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:38:02.581 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:38:02.578+0000 7fb7477fe640 1 --2- 172.21.15.119:0/472959296 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb748108420 0x7fb74819b7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:38:02.581 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:38:02.578+0000 7fb7477fe640 1 -- 172.21.15.119:0/472959296 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7481a6540 con 0x7fb748102ae0 2024-09-21T01:38:02.581 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:38:02.578+0000 7fb7477fe640 1 --2- 172.21.15.119:0/472959296 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb748102ae0 0x7fb74819b2b0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fb738009230 tx=0x7fb738004270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:38:02.581 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:38:02.578+0000 7fb744ff9640 1 -- 172.21.15.119:0/472959296 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb73803f030 con 0x7fb748102ae0 2024-09-21T01:38:02.581 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:38:02.578+0000 7fb74e14e640 1 -- 172.21.15.119:0/472959296 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7481a67d0 con 0x7fb748102ae0 2024-09-21T01:38:02.581 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:38:02.578+0000 7fb744ff9640 1 -- 172.21.15.119:0/472959296 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb738003a80 con 0x7fb748102ae0 2024-09-21T01:38:02.581 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:38:02.578+0000 7fb744ff9640 1 -- 172.21.15.119:0/472959296 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb738035070 con 0x7fb748102ae0 2024-09-21T01:38:02.581 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:38:02.578+0000 7fb74e14e640 1 -- 172.21.15.119:0/472959296 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7481a6cb0 con 0x7fb748102ae0 2024-09-21T01:38:02.581 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:38:02.579+0000 7fb74e14e640 1 -- 172.21.15.119:0/472959296 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb748103d60 con 0x7fb748102ae0 2024-09-21T01:38:02.582 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:38:02.581+0000 7fb744ff9640 1 -- 172.21.15.119:0/472959296 <== mon.2 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 20) ==== 154529+0+0 (secure 0 0 0) 0x7fb738042030 con 0x7fb748102ae0 2024-09-21T01:38:02.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:38:02.582+0000 7fb744ff9640 1 --2- 172.21.15.119:0/472959296 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fb7300b6590 0x7fb7300b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:38:02.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:38:02.582+0000 7fb744ff9640 1 -- 172.21.15.119:0/472959296 <== mon.2 v2:172.21.15.119:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 6180+0+0 (secure 0 0 0) 0x7fb738107690 con 0x7fb748102ae0 2024-09-21T01:38:02.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:38:02.582+0000 7fb746ffd640 1 --2- 172.21.15.119:0/472959296 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fb7300b6590 0x7fb7300b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:38:02.583 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:38:02.583+0000 7fb746ffd640 1 --2- 172.21.15.119:0/472959296 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fb7300b6590 0x7fb7300b8aa0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fb7481053d0 tx=0x7fb73c00b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:38:02.586 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:38:02.585+0000 7fb744ff9640 1 -- 172.21.15.119:0/472959296 <== mon.2 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb7380d2ab0 con 0x7fb748102ae0 2024-09-21T01:38:02.775 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:38:02.774+0000 7fb74e14e640 1 -- 172.21.15.119:0/472959296 --> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi119:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7fb748063800 con 0x7fb7300b6590 2024-09-21T01:38:03.161 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:38:02 smithi119 ceph-mon[33693]: from='osd.9 [v2:172.21.15.83:6826/3636757924,v1:172.21.15.83:6827/3636757924]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-21T01:38:03.161 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:38:02 smithi119 ceph-mon[33693]: osdmap e56: 10 total, 9 up, 10 in 2024-09-21T01:38:03.162 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:38:02 smithi119 ceph-mon[33693]: from='osd.9 [v2:172.21.15.83:6826/3636757924,v1:172.21.15.83:6827/3636757924]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi083", "root=default"]} : dispatch 2024-09-21T01:38:03.162 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:38:02 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T01:38:03.162 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:38:02 smithi119 ceph-mon[33693]: Detected new or changed devices on smithi083 2024-09-21T01:38:03.162 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:38:02 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:38:03.162 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:38:02 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:38:03.162 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:38:02 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T01:38:03.162 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:38:02 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T01:38:03.162 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:38:02 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T01:38:03.162 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:38:02 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-21T01:38:03.162 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:38:02 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:38:03.162 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:38:02 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:38:03.162 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:38:02 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:38:03.163 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:38:02 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:38:03.163 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:38:02 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T01:38:03.163 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:38:02 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T01:38:03.163 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:38:02 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:38:03.163 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:38:02 smithi119 ceph-mon[33693]: from='osd.9 [v2:172.21.15.83:6826/3636757924,v1:172.21.15.83:6827/3636757924]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi083", "root=default"]}]': finished 2024-09-21T01:38:03.163 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:38:02 smithi119 ceph-mon[33693]: osdmap e57: 10 total, 9 up, 10 in 2024-09-21T01:38:03.163 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:38:02 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T01:38:03.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:38:02 smithi142 ceph-mon[34050]: from='osd.9 [v2:172.21.15.83:6826/3636757924,v1:172.21.15.83:6827/3636757924]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-21T01:38:03.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:38:02 smithi142 ceph-mon[34050]: osdmap e56: 10 total, 9 up, 10 in 2024-09-21T01:38:03.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:38:02 smithi142 ceph-mon[34050]: from='osd.9 [v2:172.21.15.83:6826/3636757924,v1:172.21.15.83:6827/3636757924]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi083", "root=default"]} : dispatch 2024-09-21T01:38:03.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:38:02 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T01:38:03.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:38:02 smithi142 ceph-mon[34050]: Detected new or changed devices on smithi083 2024-09-21T01:38:03.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:38:02 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:38:03.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:38:02 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:38:03.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:38:02 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T01:38:03.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:38:02 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T01:38:03.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:38:02 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T01:38:03.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:38:02 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-21T01:38:03.216 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:38:02 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:38:03.216 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:38:02 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:38:03.216 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:38:02 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:38:03.216 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:38:02 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:38:03.216 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:38:02 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T01:38:03.216 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:38:02 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T01:38:03.216 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:38:02 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:38:03.216 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:38:02 smithi142 ceph-mon[34050]: from='osd.9 [v2:172.21.15.83:6826/3636757924,v1:172.21.15.83:6827/3636757924]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi083", "root=default"]}]': finished 2024-09-21T01:38:03.216 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:38:02 smithi142 ceph-mon[34050]: osdmap e57: 10 total, 9 up, 10 in 2024-09-21T01:38:03.216 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:38:02 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T01:38:03.304 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:38:02 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:38:02.823+0000 7fc213235640 -1 osd.9 0 waiting for initial osdmap 2024-09-21T01:38:03.304 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:38:02 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:38:02.840+0000 7fc20f033640 -1 osd.9 57 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T01:38:03.305 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:38:02 smithi083 ceph-mon[31370]: from='osd.9 [v2:172.21.15.83:6826/3636757924,v1:172.21.15.83:6827/3636757924]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-21T01:38:03.305 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:38:02 smithi083 ceph-mon[31370]: osdmap e56: 10 total, 9 up, 10 in 2024-09-21T01:38:03.305 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:38:02 smithi083 ceph-mon[31370]: from='osd.9 [v2:172.21.15.83:6826/3636757924,v1:172.21.15.83:6827/3636757924]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi083", "root=default"]} : dispatch 2024-09-21T01:38:03.305 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:38:02 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T01:38:03.305 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:38:02 smithi083 ceph-mon[31370]: Detected new or changed devices on smithi083 2024-09-21T01:38:03.305 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:38:02 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:38:03.306 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:38:02 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:38:03.306 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:38:02 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T01:38:03.306 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:38:02 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T01:38:03.306 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:38:02 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T01:38:03.306 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:38:02 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-21T01:38:03.306 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:38:02 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:38:03.307 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:38:02 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:38:03.307 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:38:02 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:38:03.307 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:38:02 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:38:03.307 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:38:02 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T01:38:03.307 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:38:02 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T01:38:03.307 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:38:02 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:38:03.308 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:38:02 smithi083 ceph-mon[31370]: from='osd.9 [v2:172.21.15.83:6826/3636757924,v1:172.21.15.83:6827/3636757924]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi083", "root=default"]}]': finished 2024-09-21T01:38:03.308 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:38:02 smithi083 ceph-mon[31370]: osdmap e57: 10 total, 9 up, 10 in 2024-09-21T01:38:03.308 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:38:02 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T01:38:04.165 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:38:03 smithi083 ceph-mon[31370]: Adjusting osd_memory_target on smithi083 to 4272M 2024-09-21T01:38:04.166 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:38:03 smithi083 ceph-mon[31370]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-09-21T01:38:04.166 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:38:03 smithi083 ceph-mon[31370]: from='client.24485 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi119:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:38:04.166 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:38:03 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T01:38:04.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:38:03 smithi142 ceph-mon[34050]: Adjusting osd_memory_target on smithi083 to 4272M 2024-09-21T01:38:04.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:38:03 smithi142 ceph-mon[34050]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-09-21T01:38:04.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:38:03 smithi142 ceph-mon[34050]: from='client.24485 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi119:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:38:04.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:38:03 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T01:38:04.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:38:03 smithi119 ceph-mon[33693]: Adjusting osd_memory_target on smithi083 to 4272M 2024-09-21T01:38:04.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:38:03 smithi119 ceph-mon[33693]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-09-21T01:38:04.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:38:03 smithi119 ceph-mon[33693]: from='client.24485 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi119:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:38:04.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:38:03 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T01:38:04.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:38:04 smithi119 ceph-mon[33693]: purged_snaps scrub starts 2024-09-21T01:38:04.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:38:04 smithi119 ceph-mon[33693]: purged_snaps scrub ok 2024-09-21T01:38:04.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:38:04 smithi119 ceph-mon[33693]: osd.9 [v2:172.21.15.83:6826/3636757924,v1:172.21.15.83:6827/3636757924] boot 2024-09-21T01:38:04.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:38:04 smithi119 ceph-mon[33693]: osdmap e58: 10 total, 10 up, 10 in 2024-09-21T01:38:04.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:38:04 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T01:38:05.120 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:38:04 smithi083 ceph-mon[31370]: purged_snaps scrub starts 2024-09-21T01:38:05.120 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:38:04 smithi083 ceph-mon[31370]: purged_snaps scrub ok 2024-09-21T01:38:05.120 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:38:04 smithi083 ceph-mon[31370]: osd.9 [v2:172.21.15.83:6826/3636757924,v1:172.21.15.83:6827/3636757924] boot 2024-09-21T01:38:05.121 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:38:04 smithi083 ceph-mon[31370]: osdmap e58: 10 total, 10 up, 10 in 2024-09-21T01:38:05.121 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:38:04 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T01:38:05.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:38:04 smithi142 ceph-mon[34050]: purged_snaps scrub starts 2024-09-21T01:38:05.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:38:04 smithi142 ceph-mon[34050]: purged_snaps scrub ok 2024-09-21T01:38:05.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:38:04 smithi142 ceph-mon[34050]: osd.9 [v2:172.21.15.83:6826/3636757924,v1:172.21.15.83:6827/3636757924] boot 2024-09-21T01:38:05.216 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:38:04 smithi142 ceph-mon[34050]: osdmap e58: 10 total, 10 up, 10 in 2024-09-21T01:38:05.216 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:38:04 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T01:38:05.966 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:38:05 smithi119 ceph-mon[33693]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-09-21T01:38:05.966 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:38:05 smithi119 ceph-mon[33693]: osdmap e59: 10 total, 10 up, 10 in 2024-09-21T01:38:05.966 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:38:05 smithi119 ceph-mon[33693]: from='client.? 172.21.15.119:0/3626158741' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "0d32c3de-db03-42c3-9914-07d675aaa339"} : dispatch 2024-09-21T01:38:05.966 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:38:05 smithi119 ceph-mon[33693]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "0d32c3de-db03-42c3-9914-07d675aaa339"} : dispatch 2024-09-21T01:38:05.967 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:38:05 smithi119 ceph-mon[33693]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0d32c3de-db03-42c3-9914-07d675aaa339"}]': finished 2024-09-21T01:38:05.967 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:38:05 smithi119 ceph-mon[33693]: osdmap e60: 11 total, 10 up, 11 in 2024-09-21T01:38:05.967 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:38:05 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T01:38:06.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:38:05 smithi142 ceph-mon[34050]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-09-21T01:38:06.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:38:05 smithi142 ceph-mon[34050]: osdmap e59: 10 total, 10 up, 10 in 2024-09-21T01:38:06.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:38:05 smithi142 ceph-mon[34050]: from='client.? 172.21.15.119:0/3626158741' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "0d32c3de-db03-42c3-9914-07d675aaa339"} : dispatch 2024-09-21T01:38:06.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:38:05 smithi142 ceph-mon[34050]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "0d32c3de-db03-42c3-9914-07d675aaa339"} : dispatch 2024-09-21T01:38:06.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:38:05 smithi142 ceph-mon[34050]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0d32c3de-db03-42c3-9914-07d675aaa339"}]': finished 2024-09-21T01:38:06.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:38:05 smithi142 ceph-mon[34050]: osdmap e60: 11 total, 10 up, 11 in 2024-09-21T01:38:06.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:38:05 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T01:38:06.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:38:05 smithi083 ceph-mon[31370]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-09-21T01:38:06.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:38:05 smithi083 ceph-mon[31370]: osdmap e59: 10 total, 10 up, 10 in 2024-09-21T01:38:06.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:38:05 smithi083 ceph-mon[31370]: from='client.? 172.21.15.119:0/3626158741' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "0d32c3de-db03-42c3-9914-07d675aaa339"} : dispatch 2024-09-21T01:38:06.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:38:05 smithi083 ceph-mon[31370]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "0d32c3de-db03-42c3-9914-07d675aaa339"} : dispatch 2024-09-21T01:38:06.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:38:05 smithi083 ceph-mon[31370]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0d32c3de-db03-42c3-9914-07d675aaa339"}]': finished 2024-09-21T01:38:06.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:38:05 smithi083 ceph-mon[31370]: osdmap e60: 11 total, 10 up, 11 in 2024-09-21T01:38:06.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:38:05 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T01:38:07.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:38:06 smithi142 ceph-mon[34050]: from='client.? 172.21.15.119:0/1505796649' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T01:38:07.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:38:06 smithi119 ceph-mon[33693]: from='client.? 172.21.15.119:0/1505796649' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T01:38:07.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:38:06 smithi083 ceph-mon[31370]: from='client.? 172.21.15.119:0/1505796649' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T01:38:08.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:38:07 smithi142 ceph-mon[34050]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 294 MiB used, 894 GiB / 894 GiB avail 2024-09-21T01:38:08.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:38:07 smithi119 ceph-mon[33693]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 294 MiB used, 894 GiB / 894 GiB avail 2024-09-21T01:38:08.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:38:07 smithi083 ceph-mon[31370]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 294 MiB used, 894 GiB / 894 GiB avail 2024-09-21T01:38:09.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:38:08 smithi142 ceph-mon[34050]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 294 MiB used, 894 GiB / 894 GiB avail 2024-09-21T01:38:09.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:38:08 smithi119 ceph-mon[33693]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 294 MiB used, 894 GiB / 894 GiB avail 2024-09-21T01:38:09.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:38:08 smithi083 ceph-mon[31370]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 294 MiB used, 894 GiB / 894 GiB avail 2024-09-21T01:38:11.904 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:38:11 smithi119 ceph-mon[33693]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 294 MiB used, 894 GiB / 894 GiB avail 2024-09-21T01:38:12.053 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:38:11 smithi083 ceph-mon[31370]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 294 MiB used, 894 GiB / 894 GiB avail 2024-09-21T01:38:12.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:38:11 smithi142 ceph-mon[34050]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 294 MiB used, 894 GiB / 894 GiB avail 2024-09-21T01:38:14.053 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:38:13 smithi083 ceph-mon[31370]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 294 MiB used, 894 GiB / 894 GiB avail 2024-09-21T01:38:14.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:38:13 smithi142 ceph-mon[34050]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 294 MiB used, 894 GiB / 894 GiB avail 2024-09-21T01:38:14.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:38:13 smithi119 ceph-mon[33693]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 294 MiB used, 894 GiB / 894 GiB avail 2024-09-21T01:38:15.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:38:14 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2024-09-21T01:38:15.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:38:14 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:38:15.184 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:38:14 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2024-09-21T01:38:15.184 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:38:14 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:38:15.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:38:14 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2024-09-21T01:38:15.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:38:14 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:38:15.938 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:38:15 smithi119 ceph-mon[33693]: Deploying daemon osd.10 on smithi119 2024-09-21T01:38:15.938 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:38:15 smithi119 ceph-mon[33693]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 294 MiB used, 894 GiB / 894 GiB avail 2024-09-21T01:38:16.053 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:38:15 smithi083 ceph-mon[31370]: Deploying daemon osd.10 on smithi119 2024-09-21T01:38:16.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:38:15 smithi083 ceph-mon[31370]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 294 MiB used, 894 GiB / 894 GiB avail 2024-09-21T01:38:16.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:38:15 smithi142 ceph-mon[34050]: Deploying daemon osd.10 on smithi119 2024-09-21T01:38:16.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:38:15 smithi142 ceph-mon[34050]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 294 MiB used, 894 GiB / 894 GiB avail 2024-09-21T01:38:17.858 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:38:17 smithi119 ceph-mon[33693]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 294 MiB used, 894 GiB / 894 GiB avail 2024-09-21T01:38:18.053 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:38:17 smithi083 ceph-mon[31370]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 294 MiB used, 894 GiB / 894 GiB avail 2024-09-21T01:38:18.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:38:17 smithi142 ceph-mon[34050]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 294 MiB used, 894 GiB / 894 GiB avail 2024-09-21T01:38:20.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:38:19 smithi142 ceph-mon[34050]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 294 MiB used, 894 GiB / 894 GiB avail 2024-09-21T01:38:20.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:38:19 smithi119 ceph-mon[33693]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 294 MiB used, 894 GiB / 894 GiB avail 2024-09-21T01:38:20.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:38:19 smithi083 ceph-mon[31370]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 294 MiB used, 894 GiB / 894 GiB avail 2024-09-21T01:38:21.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:38:20 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:38:21.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:38:20 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:38:21.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:38:20 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:38:21.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:38:20 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:38:21.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:38:20 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:38:21.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:38:20 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:38:21.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:38:20 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:38:21.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:38:20 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:38:21.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:38:20 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:38:22.116 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:38:21 smithi142 ceph-mon[34050]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 294 MiB used, 894 GiB / 894 GiB avail 2024-09-21T01:38:22.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:38:21 smithi119 ceph-mon[33693]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 294 MiB used, 894 GiB / 894 GiB avail 2024-09-21T01:38:22.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:38:21 smithi083 ceph-mon[31370]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 294 MiB used, 894 GiB / 894 GiB avail 2024-09-21T01:38:23.654 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:38:23.654+0000 7fb744ff9640 1 -- 172.21.15.119:0/472959296 <== mgr.14223 v2:172.21.15.83:6800/1748483157 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7fb748063800 con 0x7fb7300b6590 2024-09-21T01:38:23.655 INFO:teuthology.orchestra.run.smithi119.stdout:Created osd(s) 10 on host 'smithi119' 2024-09-21T01:38:23.657 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:38:23.656+0000 7fb74e14e640 1 -- 172.21.15.119:0/472959296 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fb7300b6590 msgr2=0x7fb7300b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:38:23.657 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:38:23.656+0000 7fb74e14e640 1 --2- 172.21.15.119:0/472959296 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fb7300b6590 0x7fb7300b8aa0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fb7481053d0 tx=0x7fb73c00b390 comp rx=0 tx=0).stop 2024-09-21T01:38:23.657 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:38:23.656+0000 7fb74e14e640 1 -- 172.21.15.119:0/472959296 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb748102ae0 msgr2=0x7fb74819b2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:38:23.657 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:38:23.656+0000 7fb74e14e640 1 --2- 172.21.15.119:0/472959296 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb748102ae0 0x7fb74819b2b0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fb738009230 tx=0x7fb738004270 comp rx=0 tx=0).stop 2024-09-21T01:38:23.657 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:38:23.656+0000 7fb74e14e640 1 -- 172.21.15.119:0/472959296 shutdown_connections 2024-09-21T01:38:23.657 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:38:23.656+0000 7fb74e14e640 1 --2- 172.21.15.119:0/472959296 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fb7300b6590 0x7fb7300b8aa0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:38:23.657 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:38:23.656+0000 7fb74e14e640 1 --2- 172.21.15.119:0/472959296 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb748108d70 0x7fb74819bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:38:23.657 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:38:23.656+0000 7fb74e14e640 1 --2- 172.21.15.119:0/472959296 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb748108420 0x7fb74819b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:38:23.657 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:38:23.656+0000 7fb74e14e640 1 --2- 172.21.15.119:0/472959296 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb748102ae0 0x7fb74819b2b0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:38:23.658 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:38:23.656+0000 7fb74e14e640 1 -- 172.21.15.119:0/472959296 >> 172.21.15.119:0/472959296 conn(0x7fb748079770 msgr2=0x7fb7481065c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:38:23.658 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:38:23.656+0000 7fb74e14e640 1 -- 172.21.15.119:0/472959296 shutdown_connections 2024-09-21T01:38:23.658 INFO:teuthology.orchestra.run.smithi119.stderr:2024-09-21T01:38:23.656+0000 7fb74e14e640 1 -- 172.21.15.119:0/472959296 wait complete. 2024-09-21T01:38:23.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:38:23 smithi119 ceph-mon[33693]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 294 MiB used, 894 GiB / 894 GiB avail 2024-09-21T01:38:23.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:38:23 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:38:23.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:38:23 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:38:23.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:38:23 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:38:23.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:38:23 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:38:23.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:38:23 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:38:23.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:38:23 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:38:23.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:38:23 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:38:23.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:38:23 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:38:24.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:38:23 smithi142 ceph-mon[34050]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 294 MiB used, 894 GiB / 894 GiB avail 2024-09-21T01:38:24.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:38:23 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:38:24.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:38:23 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:38:24.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:38:23 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:38:24.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:38:23 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:38:24.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:38:23 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:38:24.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:38:23 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:38:24.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:38:23 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:38:24.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:38:23 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:38:24.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:38:23 smithi083 ceph-mon[31370]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 294 MiB used, 894 GiB / 894 GiB avail 2024-09-21T01:38:24.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:38:23 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:38:24.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:38:23 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:38:24.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:38:23 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:38:24.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:38:23 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:38:24.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:38:23 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:38:24.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:38:23 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:38:24.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:38:23 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:38:24.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:38:23 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:38:24.344 DEBUG:teuthology.orchestra.run.smithi119:osd.10> sudo journalctl -f -n 0 -u ceph-f7697ecc-77b8-11ef-baf5-efdc52797490@osd.10.service 2024-09-21T01:38:24.347 INFO:tasks.cephadm:Deploying osd.11 on smithi142 with /dev/vg_nvme/lv_1... 2024-09-21T01:38:24.347 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_1 2024-09-21T01:38:24.601 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T01:38:25.999 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:38:25 smithi142 ceph-mon[34050]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 294 MiB used, 894 GiB / 894 GiB avail 2024-09-21T01:38:26.182 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:38:25 smithi119 ceph-mon[33693]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 294 MiB used, 894 GiB / 894 GiB avail 2024-09-21T01:38:26.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:38:25 smithi083 ceph-mon[31370]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 294 MiB used, 894 GiB / 894 GiB avail 2024-09-21T01:38:26.464 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:38:26 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:38:26.180+0000 7f7347e84640 -1 osd.10 0 log_to_monitors true 2024-09-21T01:38:27.083 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:38:26 smithi119 ceph-mon[33693]: from='osd.10 [v2:172.21.15.119:6824/2561963910,v1:172.21.15.119:6825/2561963910]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-21T01:38:27.084 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:38:26 smithi119 ceph-mon[33693]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-21T01:38:27.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:38:26 smithi142 ceph-mon[34050]: from='osd.10 [v2:172.21.15.119:6824/2561963910,v1:172.21.15.119:6825/2561963910]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-21T01:38:27.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:38:26 smithi142 ceph-mon[34050]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-21T01:38:27.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:38:26 smithi083 ceph-mon[31370]: from='osd.10 [v2:172.21.15.119:6824/2561963910,v1:172.21.15.119:6825/2561963910]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-21T01:38:27.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:38:26 smithi083 ceph-mon[31370]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-21T01:38:27.311 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-09-21T01:38:27.338 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi142:vg_nvme/lv_1 2024-09-21T01:38:27.590 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T01:38:27.965 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:38:27 smithi142 ceph-mon[34050]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 294 MiB used, 894 GiB / 894 GiB avail 2024-09-21T01:38:27.965 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:38:27 smithi142 ceph-mon[34050]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-21T01:38:27.965 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:38:27 smithi142 ceph-mon[34050]: from='osd.10 [v2:172.21.15.119:6824/2561963910,v1:172.21.15.119:6825/2561963910]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi119", "root=default"]} : dispatch 2024-09-21T01:38:27.965 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:38:27 smithi142 ceph-mon[34050]: osdmap e61: 11 total, 10 up, 11 in 2024-09-21T01:38:27.965 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:38:27 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T01:38:27.965 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:38:27 smithi142 ceph-mon[34050]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi119", "root=default"]} : dispatch 2024-09-21T01:38:27.965 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:38:27 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:38:27.965 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:38:27 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:38:27.965 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:38:27 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T01:38:27.965 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:38:27 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T01:38:27.966 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:38:27 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T01:38:27.966 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:38:27 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-21T01:38:27.966 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:38:27 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:38:27.966 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:38:27 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:38:27.966 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:38:27 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:38:27.966 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:38:27 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:38:28.118 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:38:28.089+0000 7fdd5db61640 1 -- 172.21.15.142:0/928720797 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdd58103b60 msgr2=0x7fdd58103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:38:28.118 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:38:28.089+0000 7fdd5db61640 1 --2- 172.21.15.142:0/928720797 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdd58103b60 0x7fdd58103f70 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fdd48009900 tx=0x7fdd4802a410 comp rx=0 tx=0).stop 2024-09-21T01:38:28.118 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:38:28.089+0000 7fdd5db61640 1 -- 172.21.15.142:0/928720797 shutdown_connections 2024-09-21T01:38:28.118 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:38:28.089+0000 7fdd5db61640 1 --2- 172.21.15.142:0/928720797 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdd58109df0 0x7fdd58110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:38:28.118 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:38:28.089+0000 7fdd5db61640 1 --2- 172.21.15.142:0/928720797 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdd581094a0 0x7fdd581098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:38:28.118 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:38:28.089+0000 7fdd5db61640 1 --2- 172.21.15.142:0/928720797 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdd58103b60 0x7fdd58103f70 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:38:28.118 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:38:28.089+0000 7fdd5db61640 1 -- 172.21.15.142:0/928720797 >> 172.21.15.142:0/928720797 conn(0x7fdd5807b850 msgr2=0x7fdd5807bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:38:28.118 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:38:28.089+0000 7fdd5db61640 1 -- 172.21.15.142:0/928720797 shutdown_connections 2024-09-21T01:38:28.119 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:38:28.089+0000 7fdd5db61640 1 -- 172.21.15.142:0/928720797 wait complete. 2024-09-21T01:38:28.119 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:38:28.090+0000 7fdd5db61640 1 Processor -- start 2024-09-21T01:38:28.119 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:38:28.090+0000 7fdd5db61640 1 -- start start 2024-09-21T01:38:28.119 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:38:28.090+0000 7fdd5db61640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdd58103b60 0x7fdd5819a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:38:28.119 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:38:28.090+0000 7fdd5db61640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdd581094a0 0x7fdd5819a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:38:28.119 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:38:28.090+0000 7fdd5db61640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdd58109df0 0x7fdd5819fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:38:28.119 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:38:28.090+0000 7fdd5db61640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fdd58113960 con 0x7fdd58103b60 2024-09-21T01:38:28.119 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:38:28.090+0000 7fdd5db61640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fdd581137e0 con 0x7fdd58109df0 2024-09-21T01:38:28.119 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:38:28.090+0000 7fdd5db61640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fdd58113ae0 con 0x7fdd581094a0 2024-09-21T01:38:28.119 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:38:28.091+0000 7fdd56ffd640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdd581094a0 0x7fdd5819a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:38:28.119 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:38:28.091+0000 7fdd56ffd640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdd581094a0 0x7fdd5819a930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:36224/0 (socket says 172.21.15.142:36224) 2024-09-21T01:38:28.120 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:38:28.091+0000 7fdd56ffd640 1 -- 172.21.15.142:0/528206143 learned_addr learned my addr 172.21.15.142:0/528206143 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-21T01:38:28.120 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:38:28.091+0000 7fdd57fff640 1 --2- 172.21.15.142:0/528206143 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdd58109df0 0x7fdd5819fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:38:28.120 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:38:28.091+0000 7fdd577fe640 1 --2- 172.21.15.142:0/528206143 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdd58103b60 0x7fdd5819a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:38:28.120 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:38:28.091+0000 7fdd56ffd640 1 -- 172.21.15.142:0/528206143 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdd58109df0 msgr2=0x7fdd5819fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:38:28.120 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:38:28.091+0000 7fdd56ffd640 1 --2- 172.21.15.142:0/528206143 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdd58109df0 0x7fdd5819fbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:38:28.120 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:38:28.091+0000 7fdd56ffd640 1 -- 172.21.15.142:0/528206143 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdd58103b60 msgr2=0x7fdd5819a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:38:28.120 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:38:28.091+0000 7fdd56ffd640 1 --2- 172.21.15.142:0/528206143 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdd58103b60 0x7fdd5819a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:38:28.120 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:38:28.091+0000 7fdd56ffd640 1 -- 172.21.15.142:0/528206143 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd581a0300 con 0x7fdd581094a0 2024-09-21T01:38:28.120 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:38:28.091+0000 7fdd577fe640 1 --2- 172.21.15.142:0/528206143 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdd58103b60 0x7fdd5819a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:38:28.121 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:38:28.091+0000 7fdd56ffd640 1 --2- 172.21.15.142:0/528206143 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdd581094a0 0x7fdd5819a930 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fdd4c00c970 tx=0x7fdd4c00ce30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:38:28.121 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:38:28.091+0000 7fdd54ff9640 1 -- 172.21.15.142:0/528206143 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd4c007bb0 con 0x7fdd581094a0 2024-09-21T01:38:28.121 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:38:28.091+0000 7fdd5db61640 1 -- 172.21.15.142:0/528206143 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd581a05f0 con 0x7fdd581094a0 2024-09-21T01:38:28.121 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:38:28.091+0000 7fdd54ff9640 1 -- 172.21.15.142:0/528206143 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdd4c007d50 con 0x7fdd581094a0 2024-09-21T01:38:28.121 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:38:28.091+0000 7fdd54ff9640 1 -- 172.21.15.142:0/528206143 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd4c004d40 con 0x7fdd581094a0 2024-09-21T01:38:28.121 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:38:28.091+0000 7fdd5db61640 1 -- 172.21.15.142:0/528206143 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd581a6d50 con 0x7fdd581094a0 2024-09-21T01:38:28.121 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:38:28.092+0000 7fdd5db61640 1 -- 172.21.15.142:0/528206143 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd58103f70 con 0x7fdd581094a0 2024-09-21T01:38:28.121 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:38:28.094+0000 7fdd54ff9640 1 -- 172.21.15.142:0/528206143 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 20) ==== 154529+0+0 (secure 0 0 0) 0x7fdd4c004fe0 con 0x7fdd581094a0 2024-09-21T01:38:28.121 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:38:28.094+0000 7fdd54ff9640 1 --2- 172.21.15.142:0/528206143 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fdd400b6560 0x7fdd400b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:38:28.121 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:38:28.095+0000 7fdd54ff9640 1 -- 172.21.15.142:0/528206143 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 6629+0+0 (secure 0 0 0) 0x7fdd4c0e6dd0 con 0x7fdd581094a0 2024-09-21T01:38:28.122 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:38:28.095+0000 7fdd577fe640 1 --2- 172.21.15.142:0/528206143 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fdd400b6560 0x7fdd400b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:38:28.122 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:38:28.095+0000 7fdd577fe640 1 --2- 172.21.15.142:0/528206143 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fdd400b6560 0x7fdd400b8a70 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fdd48000c00 tx=0x7fdd48005a20 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:38:28.122 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:38:28.098+0000 7fdd54ff9640 1 -- 172.21.15.142:0/528206143 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fdd4c014030 con 0x7fdd581094a0 2024-09-21T01:38:28.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:38:27 smithi119 ceph-mon[33693]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 294 MiB used, 894 GiB / 894 GiB avail 2024-09-21T01:38:28.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:38:27 smithi119 ceph-mon[33693]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-21T01:38:28.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:38:27 smithi119 ceph-mon[33693]: from='osd.10 [v2:172.21.15.119:6824/2561963910,v1:172.21.15.119:6825/2561963910]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi119", "root=default"]} : dispatch 2024-09-21T01:38:28.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:38:27 smithi119 ceph-mon[33693]: osdmap e61: 11 total, 10 up, 11 in 2024-09-21T01:38:28.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:38:27 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T01:38:28.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:38:27 smithi119 ceph-mon[33693]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi119", "root=default"]} : dispatch 2024-09-21T01:38:28.219 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:38:27 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:38:28.219 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:38:27 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:38:28.219 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:38:27 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T01:38:28.219 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:38:27 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T01:38:28.219 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:38:27 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T01:38:28.219 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:38:27 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-21T01:38:28.219 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:38:27 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:38:28.220 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:38:27 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:38:28.220 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:38:27 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:38:28.220 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:38:27 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:38:28.285 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:38:28.285+0000 7fdd5db61640 1 -- 172.21.15.142:0/528206143 --> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi142:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7fdd58063800 con 0x7fdd400b6560 2024-09-21T01:38:28.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:38:27 smithi083 ceph-mon[31370]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 294 MiB used, 894 GiB / 894 GiB avail 2024-09-21T01:38:28.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:38:27 smithi083 ceph-mon[31370]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-21T01:38:28.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:38:27 smithi083 ceph-mon[31370]: from='osd.10 [v2:172.21.15.119:6824/2561963910,v1:172.21.15.119:6825/2561963910]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi119", "root=default"]} : dispatch 2024-09-21T01:38:28.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:38:27 smithi083 ceph-mon[31370]: osdmap e61: 11 total, 10 up, 11 in 2024-09-21T01:38:28.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:38:27 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T01:38:28.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:38:27 smithi083 ceph-mon[31370]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi119", "root=default"]} : dispatch 2024-09-21T01:38:28.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:38:27 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:38:28.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:38:27 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:38:28.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:38:27 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T01:38:28.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:38:27 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T01:38:28.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:38:27 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T01:38:28.305 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:38:27 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-21T01:38:28.305 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:38:27 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:38:28.305 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:38:27 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:38:28.305 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:38:27 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:38:28.305 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:38:27 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:38:28.717 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:38:28 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:38:28.243+0000 7f7343e06640 -1 osd.10 0 waiting for initial osdmap 2024-09-21T01:38:28.717 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:38:28 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:38:28.255+0000 7f733bbfc640 -1 osd.10 62 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T01:38:28.898 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:38:28 smithi142 ceph-mon[34050]: Detected new or changed devices on smithi119 2024-09-21T01:38:28.899 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:38:28 smithi142 ceph-mon[34050]: Adjusting osd_memory_target on smithi119 to 4272M 2024-09-21T01:38:28.899 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:38:28 smithi142 ceph-mon[34050]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]': finished 2024-09-21T01:38:28.899 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:38:28 smithi142 ceph-mon[34050]: osdmap e62: 11 total, 10 up, 11 in 2024-09-21T01:38:28.899 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:38:28 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T01:38:28.899 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:38:28 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T01:38:28.899 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:38:28 smithi142 ceph-mon[34050]: from='osd.10 ' entity='osd.10' 2024-09-21T01:38:28.899 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:38:28 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T01:38:28.899 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:38:28 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T01:38:28.899 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:38:28 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:38:28.899 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:38:28 smithi142 ceph-mon[34050]: osd.10 [v2:172.21.15.119:6824/2561963910,v1:172.21.15.119:6825/2561963910] boot 2024-09-21T01:38:28.899 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:38:28 smithi142 ceph-mon[34050]: osdmap e63: 11 total, 11 up, 11 in 2024-09-21T01:38:28.899 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:38:28 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T01:38:29.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:38:28 smithi119 ceph-mon[33693]: Detected new or changed devices on smithi119 2024-09-21T01:38:29.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:38:28 smithi119 ceph-mon[33693]: Adjusting osd_memory_target on smithi119 to 4272M 2024-09-21T01:38:29.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:38:28 smithi119 ceph-mon[33693]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]': finished 2024-09-21T01:38:29.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:38:28 smithi119 ceph-mon[33693]: osdmap e62: 11 total, 10 up, 11 in 2024-09-21T01:38:29.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:38:28 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T01:38:29.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:38:28 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T01:38:29.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:38:28 smithi119 ceph-mon[33693]: from='osd.10 ' entity='osd.10' 2024-09-21T01:38:29.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:38:28 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T01:38:29.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:38:28 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T01:38:29.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:38:28 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:38:29.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:38:28 smithi119 ceph-mon[33693]: osd.10 [v2:172.21.15.119:6824/2561963910,v1:172.21.15.119:6825/2561963910] boot 2024-09-21T01:38:29.219 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:38:28 smithi119 ceph-mon[33693]: osdmap e63: 11 total, 11 up, 11 in 2024-09-21T01:38:29.219 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:38:28 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T01:38:29.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:38:28 smithi083 ceph-mon[31370]: Detected new or changed devices on smithi119 2024-09-21T01:38:29.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:38:28 smithi083 ceph-mon[31370]: Adjusting osd_memory_target on smithi119 to 4272M 2024-09-21T01:38:29.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:38:28 smithi083 ceph-mon[31370]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi119", "root=default"]}]': finished 2024-09-21T01:38:29.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:38:28 smithi083 ceph-mon[31370]: osdmap e62: 11 total, 10 up, 11 in 2024-09-21T01:38:29.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:38:28 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T01:38:29.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:38:28 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T01:38:29.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:38:28 smithi083 ceph-mon[31370]: from='osd.10 ' entity='osd.10' 2024-09-21T01:38:29.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:38:28 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T01:38:29.305 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:38:28 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T01:38:29.305 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:38:28 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:38:29.305 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:38:28 smithi083 ceph-mon[31370]: osd.10 [v2:172.21.15.119:6824/2561963910,v1:172.21.15.119:6825/2561963910] boot 2024-09-21T01:38:29.305 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:38:28 smithi083 ceph-mon[31370]: osdmap e63: 11 total, 11 up, 11 in 2024-09-21T01:38:29.305 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:38:28 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T01:38:29.938 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:38:29 smithi142 ceph-mon[34050]: purged_snaps scrub starts 2024-09-21T01:38:29.938 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:38:29 smithi142 ceph-mon[34050]: purged_snaps scrub ok 2024-09-21T01:38:29.938 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:38:29 smithi142 ceph-mon[34050]: from='client.24523 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi142:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:38:29.938 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:38:29 smithi142 ceph-mon[34050]: pgmap v210: 1 pgs: 1 peering; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-09-21T01:38:29.938 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:38:29 smithi142 ceph-mon[34050]: osdmap e64: 11 total, 11 up, 11 in 2024-09-21T01:38:30.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:38:29 smithi119 ceph-mon[33693]: purged_snaps scrub starts 2024-09-21T01:38:30.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:38:29 smithi119 ceph-mon[33693]: purged_snaps scrub ok 2024-09-21T01:38:30.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:38:29 smithi119 ceph-mon[33693]: from='client.24523 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi142:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:38:30.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:38:29 smithi119 ceph-mon[33693]: pgmap v210: 1 pgs: 1 peering; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-09-21T01:38:30.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:38:29 smithi119 ceph-mon[33693]: osdmap e64: 11 total, 11 up, 11 in 2024-09-21T01:38:30.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:38:29 smithi083 ceph-mon[31370]: purged_snaps scrub starts 2024-09-21T01:38:30.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:38:29 smithi083 ceph-mon[31370]: purged_snaps scrub ok 2024-09-21T01:38:30.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:38:29 smithi083 ceph-mon[31370]: from='client.24523 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi142:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:38:30.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:38:29 smithi083 ceph-mon[31370]: pgmap v210: 1 pgs: 1 peering; 577 KiB data, 295 MiB used, 894 GiB / 894 GiB avail 2024-09-21T01:38:30.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:38:29 smithi083 ceph-mon[31370]: osdmap e64: 11 total, 11 up, 11 in 2024-09-21T01:38:31.205 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:38:30 smithi083 ceph-mon[31370]: from='client.? 172.21.15.142:0/2742644011' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "3a3b444d-b316-4256-bfad-378db29f0824"} : dispatch 2024-09-21T01:38:31.205 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:38:30 smithi083 ceph-mon[31370]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "3a3b444d-b316-4256-bfad-378db29f0824"} : dispatch 2024-09-21T01:38:31.205 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:38:30 smithi083 ceph-mon[31370]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3a3b444d-b316-4256-bfad-378db29f0824"}]': finished 2024-09-21T01:38:31.205 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:38:30 smithi083 ceph-mon[31370]: osdmap e65: 12 total, 11 up, 12 in 2024-09-21T01:38:31.205 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:38:30 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T01:38:31.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:38:30 smithi142 ceph-mon[34050]: from='client.? 172.21.15.142:0/2742644011' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "3a3b444d-b316-4256-bfad-378db29f0824"} : dispatch 2024-09-21T01:38:31.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:38:30 smithi142 ceph-mon[34050]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "3a3b444d-b316-4256-bfad-378db29f0824"} : dispatch 2024-09-21T01:38:31.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:38:30 smithi142 ceph-mon[34050]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3a3b444d-b316-4256-bfad-378db29f0824"}]': finished 2024-09-21T01:38:31.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:38:30 smithi142 ceph-mon[34050]: osdmap e65: 12 total, 11 up, 12 in 2024-09-21T01:38:31.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:38:30 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T01:38:31.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:38:30 smithi119 ceph-mon[33693]: from='client.? 172.21.15.142:0/2742644011' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "3a3b444d-b316-4256-bfad-378db29f0824"} : dispatch 2024-09-21T01:38:31.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:38:30 smithi119 ceph-mon[33693]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "3a3b444d-b316-4256-bfad-378db29f0824"} : dispatch 2024-09-21T01:38:31.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:38:30 smithi119 ceph-mon[33693]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3a3b444d-b316-4256-bfad-378db29f0824"}]': finished 2024-09-21T01:38:31.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:38:30 smithi119 ceph-mon[33693]: osdmap e65: 12 total, 11 up, 12 in 2024-09-21T01:38:31.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:38:30 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T01:38:32.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:38:31 smithi142 ceph-mon[34050]: pgmap v214: 1 pgs: 1 peering; 577 KiB data, 361 MiB used, 983 GiB / 983 GiB avail 2024-09-21T01:38:32.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:38:31 smithi142 ceph-mon[34050]: from='client.? 172.21.15.142:0/1397448042' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T01:38:32.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:38:31 smithi119 ceph-mon[33693]: pgmap v214: 1 pgs: 1 peering; 577 KiB data, 361 MiB used, 983 GiB / 983 GiB avail 2024-09-21T01:38:32.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:38:31 smithi119 ceph-mon[33693]: from='client.? 172.21.15.142:0/1397448042' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T01:38:32.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:38:31 smithi083 ceph-mon[31370]: pgmap v214: 1 pgs: 1 peering; 577 KiB data, 361 MiB used, 983 GiB / 983 GiB avail 2024-09-21T01:38:32.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:38:31 smithi083 ceph-mon[31370]: from='client.? 172.21.15.142:0/1397448042' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T01:38:33.967 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:38:33 smithi119 ceph-mon[33693]: pgmap v215: 1 pgs: 1 peering; 577 KiB data, 361 MiB used, 983 GiB / 983 GiB avail 2024-09-21T01:38:34.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:38:33 smithi142 ceph-mon[34050]: pgmap v215: 1 pgs: 1 peering; 577 KiB data, 361 MiB used, 983 GiB / 983 GiB avail 2024-09-21T01:38:34.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:38:33 smithi083 ceph-mon[31370]: pgmap v215: 1 pgs: 1 peering; 577 KiB data, 361 MiB used, 983 GiB / 983 GiB avail 2024-09-21T01:38:36.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:38:35 smithi142 ceph-mon[34050]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T01:38:36.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:38:35 smithi119 ceph-mon[33693]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T01:38:36.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:38:35 smithi083 ceph-mon[31370]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T01:38:38.165 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:38:37 smithi142 ceph-mon[34050]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 983 GiB / 983 GiB avail; 73 KiB/s, 0 objects/s recovering 2024-09-21T01:38:38.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:38:37 smithi119 ceph-mon[33693]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 983 GiB / 983 GiB avail; 73 KiB/s, 0 objects/s recovering 2024-09-21T01:38:38.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:38:37 smithi083 ceph-mon[31370]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 983 GiB / 983 GiB avail; 73 KiB/s, 0 objects/s recovering 2024-09-21T01:38:39.965 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:38:39 smithi142 ceph-mon[34050]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 983 GiB / 983 GiB avail; 64 KiB/s, 0 objects/s recovering 2024-09-21T01:38:39.965 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:38:39 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2024-09-21T01:38:39.965 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:38:39 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:38:40.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:38:39 smithi119 ceph-mon[33693]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 983 GiB / 983 GiB avail; 64 KiB/s, 0 objects/s recovering 2024-09-21T01:38:40.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:38:39 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2024-09-21T01:38:40.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:38:39 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:38:40.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:38:39 smithi083 ceph-mon[31370]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 983 GiB / 983 GiB avail; 64 KiB/s, 0 objects/s recovering 2024-09-21T01:38:40.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:38:39 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2024-09-21T01:38:40.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:38:39 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:38:40.964 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:38:40 smithi142 ceph-mon[34050]: Deploying daemon osd.11 on smithi142 2024-09-21T01:38:41.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:38:40 smithi119 ceph-mon[33693]: Deploying daemon osd.11 on smithi142 2024-09-21T01:38:41.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:38:40 smithi083 ceph-mon[31370]: Deploying daemon osd.11 on smithi142 2024-09-21T01:38:41.964 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:38:41 smithi142 ceph-mon[34050]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 983 GiB / 983 GiB avail; 57 KiB/s, 0 objects/s recovering 2024-09-21T01:38:42.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:38:41 smithi119 ceph-mon[33693]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 983 GiB / 983 GiB avail; 57 KiB/s, 0 objects/s recovering 2024-09-21T01:38:42.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:38:41 smithi083 ceph-mon[31370]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 983 GiB / 983 GiB avail; 57 KiB/s, 0 objects/s recovering 2024-09-21T01:38:43.081 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:38:42 smithi142 ceph-mon[34050]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T01:38:43.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:38:42 smithi119 ceph-mon[33693]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T01:38:43.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:38:42 smithi083 ceph-mon[31370]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T01:38:46.036 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:38:45 smithi142 ceph-mon[34050]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T01:38:46.036 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:38:45 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:38:46.036 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:38:45 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:38:46.037 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:38:45 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:38:46.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:38:45 smithi083 ceph-mon[31370]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T01:38:46.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:38:45 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:38:46.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:38:45 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:38:46.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:38:45 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:38:46.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:38:45 smithi119 ceph-mon[33693]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T01:38:46.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:38:45 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:38:46.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:38:45 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:38:46.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:38:45 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:38:48.053 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:38:47 smithi083 ceph-mon[31370]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 983 GiB / 983 GiB avail 2024-09-21T01:38:48.117 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:38:47 smithi142 ceph-mon[34050]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 983 GiB / 983 GiB avail 2024-09-21T01:38:48.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:38:47 smithi119 ceph-mon[33693]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 983 GiB / 983 GiB avail 2024-09-21T01:38:48.761 INFO:teuthology.orchestra.run.smithi142.stdout:Created osd(s) 11 on host 'smithi142' 2024-09-21T01:38:48.762 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:38:48.761+0000 7fdd54ff9640 1 -- 172.21.15.142:0/528206143 <== mgr.14223 v2:172.21.15.83:6800/1748483157 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7fdd58063800 con 0x7fdd400b6560 2024-09-21T01:38:48.764 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:38:48.763+0000 7fdd5db61640 1 -- 172.21.15.142:0/528206143 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fdd400b6560 msgr2=0x7fdd400b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:38:48.764 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:38:48.763+0000 7fdd5db61640 1 --2- 172.21.15.142:0/528206143 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fdd400b6560 0x7fdd400b8a70 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fdd48000c00 tx=0x7fdd48005a20 comp rx=0 tx=0).stop 2024-09-21T01:38:48.764 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:38:48.763+0000 7fdd5db61640 1 -- 172.21.15.142:0/528206143 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdd581094a0 msgr2=0x7fdd5819a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:38:48.764 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:38:48.763+0000 7fdd5db61640 1 --2- 172.21.15.142:0/528206143 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdd581094a0 0x7fdd5819a930 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fdd4c00c970 tx=0x7fdd4c00ce30 comp rx=0 tx=0).stop 2024-09-21T01:38:48.764 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:38:48.763+0000 7fdd5db61640 1 -- 172.21.15.142:0/528206143 shutdown_connections 2024-09-21T01:38:48.764 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:38:48.763+0000 7fdd5db61640 1 --2- 172.21.15.142:0/528206143 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fdd400b6560 0x7fdd400b8a70 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:38:48.764 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:38:48.763+0000 7fdd5db61640 1 --2- 172.21.15.142:0/528206143 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdd58109df0 0x7fdd5819fbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:38:48.764 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:38:48.763+0000 7fdd5db61640 1 --2- 172.21.15.142:0/528206143 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdd581094a0 0x7fdd5819a930 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:38:48.764 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:38:48.763+0000 7fdd5db61640 1 --2- 172.21.15.142:0/528206143 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdd58103b60 0x7fdd5819a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:38:48.764 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:38:48.763+0000 7fdd5db61640 1 -- 172.21.15.142:0/528206143 >> 172.21.15.142:0/528206143 conn(0x7fdd5807b850 msgr2=0x7fdd58107590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:38:48.764 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:38:48.764+0000 7fdd5db61640 1 -- 172.21.15.142:0/528206143 shutdown_connections 2024-09-21T01:38:48.765 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:38:48.764+0000 7fdd5db61640 1 -- 172.21.15.142:0/528206143 wait complete. 2024-09-21T01:38:49.431 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:38:49 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:38:49.431 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:38:49 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:38:49.431 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:38:49 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:38:49.431 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:38:49 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:38:49.431 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:38:49 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:38:49.431 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:38:49 smithi142 ceph-mon[34050]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 983 GiB / 983 GiB avail 2024-09-21T01:38:49.431 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:38:49 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:38:49.431 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:38:49 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:38:49.431 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:38:49 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:38:49.457 DEBUG:teuthology.orchestra.run.smithi142:osd.11> sudo journalctl -f -n 0 -u ceph-f7697ecc-77b8-11ef-baf5-efdc52797490@osd.11.service 2024-09-21T01:38:49.459 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-09-21T01:38:49.459 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph osd stat -f json 2024-09-21T01:38:49.467 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:38:49 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:38:49.467 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:38:49 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:38:49.467 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:38:49 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:38:49.467 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:38:49 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:38:49.468 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:38:49 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:38:49.468 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:38:49 smithi119 ceph-mon[33693]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 983 GiB / 983 GiB avail 2024-09-21T01:38:49.468 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:38:49 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:38:49.468 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:38:49 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:38:49.468 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:38:49 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:38:49.488 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:38:49 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:38:49.488 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:38:49 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:38:49.488 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:38:49 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:38:49.488 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:38:49 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:38:49.488 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:38:49 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:38:49.488 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:38:49 smithi083 ceph-mon[31370]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 983 GiB / 983 GiB avail 2024-09-21T01:38:49.488 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:38:49 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:38:49.488 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:38:49 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:38:49.488 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:38:49 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:38:49.719 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:38:50.230 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:50.222+0000 7f82633e5640 1 -- 172.21.15.83:0/4113529221 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f825c1083c0 msgr2=0x7f825c1087d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:38:50.230 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:50.222+0000 7f82633e5640 1 --2- 172.21.15.83:0/4113529221 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f825c1083c0 0x7f825c1087d0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f824c009900 tx=0x7f824c02a410 comp rx=0 tx=0).stop 2024-09-21T01:38:50.230 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:50.222+0000 7f82633e5640 1 -- 172.21.15.83:0/4113529221 shutdown_connections 2024-09-21T01:38:50.230 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:50.222+0000 7f82633e5640 1 --2- 172.21.15.83:0/4113529221 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f825c108d10 0x7f825c10f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:38:50.230 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:50.222+0000 7f82633e5640 1 --2- 172.21.15.83:0/4113529221 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f825c1083c0 0x7f825c1087d0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:38:50.230 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:50.222+0000 7f82633e5640 1 --2- 172.21.15.83:0/4113529221 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f825c102a80 0x7f825c102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:38:50.230 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:50.222+0000 7f82633e5640 1 -- 172.21.15.83:0/4113529221 >> 172.21.15.83:0/4113529221 conn(0x7f825c079740 msgr2=0x7f825c079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:38:50.230 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:50.222+0000 7f82633e5640 1 -- 172.21.15.83:0/4113529221 shutdown_connections 2024-09-21T01:38:50.230 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:50.222+0000 7f82633e5640 1 -- 172.21.15.83:0/4113529221 wait complete. 2024-09-21T01:38:50.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:50.223+0000 7f82633e5640 1 Processor -- start 2024-09-21T01:38:50.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:50.223+0000 7f82633e5640 1 -- start start 2024-09-21T01:38:50.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:50.223+0000 7f82633e5640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f825c102a80 0x7f825c19c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:38:50.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:50.223+0000 7f82633e5640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f825c1083c0 0x7f825c19cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:38:50.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:50.223+0000 7f82633e5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f825c108d10 0x7f825c1a1e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:38:50.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:50.223+0000 7f82633e5640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f825c112880 con 0x7f825c102a80 2024-09-21T01:38:50.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:50.223+0000 7f82633e5640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f825c112700 con 0x7f825c1083c0 2024-09-21T01:38:50.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:50.223+0000 7f82633e5640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f825c112a00 con 0x7f825c108d10 2024-09-21T01:38:50.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:50.223+0000 7f8261181640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f825c102a80 0x7f825c19c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:38:50.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:50.223+0000 7f8261181640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f825c102a80 0x7f825c19c650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:35100/0 (socket says 172.21.15.83:35100) 2024-09-21T01:38:50.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:50.223+0000 7f8261181640 1 -- 172.21.15.83:0/221516779 learned_addr learned my addr 172.21.15.83:0/221516779 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:38:50.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:50.223+0000 7f8261982640 1 --2- 172.21.15.83:0/221516779 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f825c108d10 0x7f825c1a1e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:38:50.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:50.223+0000 7f8260980640 1 --2- 172.21.15.83:0/221516779 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f825c1083c0 0x7f825c19cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:38:50.232 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:50.223+0000 7f8261181640 1 -- 172.21.15.83:0/221516779 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f825c108d10 msgr2=0x7f825c1a1e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:38:50.232 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:50.223+0000 7f8261181640 1 --2- 172.21.15.83:0/221516779 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f825c108d10 0x7f825c1a1e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:38:50.232 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:50.223+0000 7f8261181640 1 -- 172.21.15.83:0/221516779 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f825c1083c0 msgr2=0x7f825c19cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:38:50.232 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:50.223+0000 7f8261181640 1 --2- 172.21.15.83:0/221516779 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f825c1083c0 0x7f825c19cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:38:50.232 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:50.223+0000 7f8261181640 1 -- 172.21.15.83:0/221516779 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f825c1a25c0 con 0x7f825c102a80 2024-09-21T01:38:50.232 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:50.223+0000 7f8261982640 1 --2- 172.21.15.83:0/221516779 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f825c108d10 0x7f825c1a1e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:38:50.232 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:50.223+0000 7f8260980640 1 --2- 172.21.15.83:0/221516779 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f825c1083c0 0x7f825c19cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:38:50.232 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:50.223+0000 7f8261181640 1 --2- 172.21.15.83:0/221516779 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f825c102a80 0x7f825c19c650 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f825800c890 tx=0x7f825800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:38:50.232 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:50.224+0000 7f82527fc640 1 -- 172.21.15.83:0/221516779 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8258004220 con 0x7f825c102a80 2024-09-21T01:38:50.232 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:50.224+0000 7f82633e5640 1 -- 172.21.15.83:0/221516779 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f825c1a28b0 con 0x7f825c102a80 2024-09-21T01:38:50.232 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:50.224+0000 7f82527fc640 1 -- 172.21.15.83:0/221516779 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8258007e40 con 0x7f825c102a80 2024-09-21T01:38:50.232 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:50.224+0000 7f82527fc640 1 -- 172.21.15.83:0/221516779 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8258004a00 con 0x7f825c102a80 2024-09-21T01:38:50.232 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:50.224+0000 7f82633e5640 1 -- 172.21.15.83:0/221516779 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f825c1a9010 con 0x7f825c102a80 2024-09-21T01:38:50.233 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:50.225+0000 7f82633e5640 1 -- 172.21.15.83:0/221516779 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f825c102e90 con 0x7f825c102a80 2024-09-21T01:38:50.233 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:50.226+0000 7f82527fc640 1 -- 172.21.15.83:0/221516779 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 20) ==== 154529+0+0 (secure 0 0 0) 0x7f82580079b0 con 0x7f825c102a80 2024-09-21T01:38:50.233 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:50.227+0000 7f82527fc640 1 --2- 172.21.15.83:0/221516779 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f82480b6560 0x7f82480b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:38:50.233 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:50.227+0000 7f82527fc640 1 -- 172.21.15.83:0/221516779 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 7024+0+0 (secure 0 0 0) 0x7f82580e6c50 con 0x7f825c102a80 2024-09-21T01:38:50.233 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:50.227+0000 7f8260980640 1 --2- 172.21.15.83:0/221516779 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f82480b6560 0x7f82480b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:38:50.233 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:50.228+0000 7f8260980640 1 --2- 172.21.15.83:0/221516779 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f82480b6560 0x7f82480b8a70 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f824c005ab0 tx=0x7f824c005fd0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:38:50.233 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:50.231+0000 7f82527fc640 1 -- 172.21.15.83:0/221516779 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f82580ec020 con 0x7f825c102a80 2024-09-21T01:38:50.431 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:50.431+0000 7f82633e5640 1 -- 172.21.15.83:0/221516779 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f825c1a9350 con 0x7f825c102a80 2024-09-21T01:38:50.432 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:50.431+0000 7f82527fc640 1 -- 172.21.15.83:0/221516779 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v65) ==== 74+0+133 (secure 0 0 0) 0x7f8258014030 con 0x7f825c102a80 2024-09-21T01:38:50.432 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T01:38:50.434 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:50.434+0000 7f82633e5640 1 -- 172.21.15.83:0/221516779 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f82480b6560 msgr2=0x7f82480b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:38:50.434 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:50.434+0000 7f82633e5640 1 --2- 172.21.15.83:0/221516779 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f82480b6560 0x7f82480b8a70 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f824c005ab0 tx=0x7f824c005fd0 comp rx=0 tx=0).stop 2024-09-21T01:38:50.435 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:50.434+0000 7f82633e5640 1 -- 172.21.15.83:0/221516779 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f825c102a80 msgr2=0x7f825c19c650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:38:50.435 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:50.434+0000 7f82633e5640 1 --2- 172.21.15.83:0/221516779 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f825c102a80 0x7f825c19c650 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f825800c890 tx=0x7f825800cd50 comp rx=0 tx=0).stop 2024-09-21T01:38:50.435 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:50.434+0000 7f82633e5640 1 -- 172.21.15.83:0/221516779 shutdown_connections 2024-09-21T01:38:50.435 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:50.434+0000 7f82633e5640 1 --2- 172.21.15.83:0/221516779 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f82480b6560 0x7f82480b8a70 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:38:50.435 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:50.434+0000 7f82633e5640 1 --2- 172.21.15.83:0/221516779 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f825c108d10 0x7f825c1a1e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:38:50.435 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:50.434+0000 7f82633e5640 1 --2- 172.21.15.83:0/221516779 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f825c1083c0 0x7f825c19cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:38:50.435 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:50.434+0000 7f82633e5640 1 --2- 172.21.15.83:0/221516779 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f825c102a80 0x7f825c19c650 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:38:50.435 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:50.434+0000 7f82633e5640 1 -- 172.21.15.83:0/221516779 >> 172.21.15.83:0/221516779 conn(0x7f825c079740 msgr2=0x7f825c06ba60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:38:50.435 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:50.434+0000 7f82633e5640 1 -- 172.21.15.83:0/221516779 shutdown_connections 2024-09-21T01:38:50.435 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:50.434+0000 7f82633e5640 1 -- 172.21.15.83:0/221516779 wait complete. 2024-09-21T01:38:50.596 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:38:50 smithi142 ceph-mon[34050]: from='client.? 172.21.15.83:0/221516779' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T01:38:50.750 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:38:50 smithi083 ceph-mon[31370]: from='client.? 172.21.15.83:0/221516779' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T01:38:50.967 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:38:50 smithi119 ceph-mon[33693]: from='client.? 172.21.15.83:0/221516779' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T01:38:51.180 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":65,"num_osds":12,"num_up_osds":11,"osd_up_since":1726882708,"num_in_osds":12,"osd_in_since":1726882710,"num_remapped_pgs":0} 2024-09-21T01:38:51.215 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:38:50 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:38:50.937+0000 7fb20fba0640 -1 osd.11 0 log_to_monitors true 2024-09-21T01:38:51.804 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:38:51 smithi083 ceph-mon[31370]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 983 GiB / 983 GiB avail 2024-09-21T01:38:51.805 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:38:51 smithi083 ceph-mon[31370]: from='osd.11 [v2:172.21.15.142:6824/1174646198,v1:172.21.15.142:6825/1174646198]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-21T01:38:51.805 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:38:51 smithi083 ceph-mon[31370]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-21T01:38:51.964 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:38:51 smithi142 ceph-mon[34050]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 983 GiB / 983 GiB avail 2024-09-21T01:38:51.964 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:38:51 smithi142 ceph-mon[34050]: from='osd.11 [v2:172.21.15.142:6824/1174646198,v1:172.21.15.142:6825/1174646198]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-21T01:38:51.965 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:38:51 smithi142 ceph-mon[34050]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-21T01:38:51.971 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:38:51 smithi119 ceph-mon[33693]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 983 GiB / 983 GiB avail 2024-09-21T01:38:51.971 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:38:51 smithi119 ceph-mon[33693]: from='osd.11 [v2:172.21.15.142:6824/1174646198,v1:172.21.15.142:6825/1174646198]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-21T01:38:51.971 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:38:51 smithi119 ceph-mon[33693]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-21T01:38:52.182 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph osd stat -f json 2024-09-21T01:38:52.435 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:38:52.714 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:38:52 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:38:52.499+0000 7fb20bb22640 -1 osd.11 0 waiting for initial osdmap 2024-09-21T01:38:52.714 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:38:52 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:38:52.512+0000 7fb207920640 -1 osd.11 67 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T01:38:52.715 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:38:52 smithi142 ceph-mon[34050]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-21T01:38:52.715 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:38:52 smithi142 ceph-mon[34050]: osdmap e66: 12 total, 11 up, 12 in 2024-09-21T01:38:52.715 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:38:52 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T01:38:52.715 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:38:52 smithi142 ceph-mon[34050]: from='osd.11 [v2:172.21.15.142:6824/1174646198,v1:172.21.15.142:6825/1174646198]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi142", "root=default"]} : dispatch 2024-09-21T01:38:52.715 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:38:52 smithi142 ceph-mon[34050]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi142", "root=default"]} : dispatch 2024-09-21T01:38:52.715 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:38:52 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:38:52.715 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:38:52 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:38:52.715 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:38:52 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T01:38:52.715 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:38:52 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T01:38:52.715 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:38:52 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T01:38:52.715 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:38:52 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-21T01:38:52.716 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:38:52 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:38:52.716 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:38:52 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:38:52.716 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:38:52 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:38:52.716 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:38:52 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:38:52.804 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:38:52 smithi083 ceph-mon[31370]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-21T01:38:52.804 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:38:52 smithi083 ceph-mon[31370]: osdmap e66: 12 total, 11 up, 12 in 2024-09-21T01:38:52.804 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:38:52 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T01:38:52.804 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:38:52 smithi083 ceph-mon[31370]: from='osd.11 [v2:172.21.15.142:6824/1174646198,v1:172.21.15.142:6825/1174646198]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi142", "root=default"]} : dispatch 2024-09-21T01:38:52.804 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:38:52 smithi083 ceph-mon[31370]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi142", "root=default"]} : dispatch 2024-09-21T01:38:52.804 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:38:52 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:38:52.804 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:38:52 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:38:52.804 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:38:52 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T01:38:52.804 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:38:52 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T01:38:52.805 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:38:52 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T01:38:52.805 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:38:52 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-21T01:38:52.805 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:38:52 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:38:52.805 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:38:52 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:38:52.805 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:38:52 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:38:52.805 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:38:52 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:38:52.869 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:38:52 smithi119 ceph-mon[33693]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-21T01:38:52.869 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:38:52 smithi119 ceph-mon[33693]: osdmap e66: 12 total, 11 up, 12 in 2024-09-21T01:38:52.870 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:38:52 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T01:38:52.870 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:38:52 smithi119 ceph-mon[33693]: from='osd.11 [v2:172.21.15.142:6824/1174646198,v1:172.21.15.142:6825/1174646198]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi142", "root=default"]} : dispatch 2024-09-21T01:38:52.870 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:38:52 smithi119 ceph-mon[33693]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi142", "root=default"]} : dispatch 2024-09-21T01:38:52.870 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:38:52 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:38:52.870 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:38:52 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:38:52.870 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:38:52 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T01:38:52.870 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:38:52 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T01:38:52.870 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:38:52 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T01:38:52.870 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:38:52 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-21T01:38:52.870 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:38:52 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:38:52.870 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:38:52 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:38:52.870 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:38:52 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:38:52.870 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:38:52 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:38:52.940 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:52.937+0000 7fca31121640 1 -- 172.21.15.83:0/1044318187 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fca2c103b60 msgr2=0x7fca2c103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:38:52.940 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:52.937+0000 7fca31121640 1 --2- 172.21.15.83:0/1044318187 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fca2c103b60 0x7fca2c103f70 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fca1c009900 tx=0x7fca1c02a410 comp rx=0 tx=0).stop 2024-09-21T01:38:52.940 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:52.937+0000 7fca31121640 1 -- 172.21.15.83:0/1044318187 shutdown_connections 2024-09-21T01:38:52.940 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:52.937+0000 7fca31121640 1 --2- 172.21.15.83:0/1044318187 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fca2c109df0 0x7fca2c110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:38:52.940 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:52.937+0000 7fca31121640 1 --2- 172.21.15.83:0/1044318187 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fca2c1094a0 0x7fca2c1098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:38:52.940 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:52.937+0000 7fca31121640 1 --2- 172.21.15.83:0/1044318187 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fca2c103b60 0x7fca2c103f70 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:38:52.940 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:52.937+0000 7fca31121640 1 -- 172.21.15.83:0/1044318187 >> 172.21.15.83:0/1044318187 conn(0x7fca2c07b850 msgr2=0x7fca2c07bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:38:52.941 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:52.938+0000 7fca31121640 1 -- 172.21.15.83:0/1044318187 shutdown_connections 2024-09-21T01:38:52.941 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:52.938+0000 7fca31121640 1 -- 172.21.15.83:0/1044318187 wait complete. 2024-09-21T01:38:52.941 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:52.938+0000 7fca31121640 1 Processor -- start 2024-09-21T01:38:52.941 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:52.939+0000 7fca31121640 1 -- start start 2024-09-21T01:38:52.941 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:52.939+0000 7fca31121640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fca2c103b60 0x7fca2c19a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:38:52.941 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:52.939+0000 7fca31121640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fca2c1094a0 0x7fca2c19a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:38:52.941 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:52.939+0000 7fca31121640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fca2c109df0 0x7fca2c19fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:38:52.941 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:52.939+0000 7fca31121640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fca2c113960 con 0x7fca2c103b60 2024-09-21T01:38:52.941 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:52.939+0000 7fca31121640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fca2c1137e0 con 0x7fca2c109df0 2024-09-21T01:38:52.941 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:52.939+0000 7fca31121640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fca2c113ae0 con 0x7fca2c1094a0 2024-09-21T01:38:52.941 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:52.939+0000 7fca2ad9d640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fca2c103b60 0x7fca2c19a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:38:52.941 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:52.939+0000 7fca2ad9d640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fca2c103b60 0x7fca2c19a450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:35120/0 (socket says 172.21.15.83:35120) 2024-09-21T01:38:52.941 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:52.939+0000 7fca2ad9d640 1 -- 172.21.15.83:0/1443903576 learned_addr learned my addr 172.21.15.83:0/1443903576 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:38:52.941 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:52.939+0000 7fca2a59c640 1 --2- 172.21.15.83:0/1443903576 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fca2c1094a0 0x7fca2c19a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:38:52.942 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:52.939+0000 7fca2b59e640 1 --2- 172.21.15.83:0/1443903576 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fca2c109df0 0x7fca2c19fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:38:52.942 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:52.940+0000 7fca2ad9d640 1 -- 172.21.15.83:0/1443903576 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fca2c1094a0 msgr2=0x7fca2c19a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:38:52.942 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:52.940+0000 7fca2ad9d640 1 --2- 172.21.15.83:0/1443903576 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fca2c1094a0 0x7fca2c19a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:38:52.943 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:52.940+0000 7fca2ad9d640 1 -- 172.21.15.83:0/1443903576 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fca2c109df0 msgr2=0x7fca2c19fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:38:52.943 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:52.940+0000 7fca2ad9d640 1 --2- 172.21.15.83:0/1443903576 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fca2c109df0 0x7fca2c19fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:38:52.943 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:52.940+0000 7fca2ad9d640 1 -- 172.21.15.83:0/1443903576 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca2c1a03c0 con 0x7fca2c103b60 2024-09-21T01:38:52.943 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:52.940+0000 7fca2ad9d640 1 --2- 172.21.15.83:0/1443903576 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fca2c103b60 0x7fca2c19a450 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fca1c009230 tx=0x7fca1c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:38:52.943 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:52.940+0000 7fca13fff640 1 -- 172.21.15.83:0/1443903576 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca1c03f030 con 0x7fca2c103b60 2024-09-21T01:38:52.943 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:52.940+0000 7fca13fff640 1 -- 172.21.15.83:0/1443903576 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fca1c003a80 con 0x7fca2c103b60 2024-09-21T01:38:52.943 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:52.941+0000 7fca31121640 1 -- 172.21.15.83:0/1443903576 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca2c1a0650 con 0x7fca2c103b60 2024-09-21T01:38:52.943 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:52.941+0000 7fca13fff640 1 -- 172.21.15.83:0/1443903576 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca1c035070 con 0x7fca2c103b60 2024-09-21T01:38:52.943 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:52.941+0000 7fca31121640 1 -- 172.21.15.83:0/1443903576 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca2c0755f0 con 0x7fca2c103b60 2024-09-21T01:38:52.943 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:52.942+0000 7fca31121640 1 -- 172.21.15.83:0/1443903576 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca2c104de0 con 0x7fca2c103b60 2024-09-21T01:38:52.943 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:52.943+0000 7fca13fff640 1 -- 172.21.15.83:0/1443903576 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 20) ==== 154529+0+0 (secure 0 0 0) 0x7fca1c042030 con 0x7fca2c103b60 2024-09-21T01:38:52.944 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:52.944+0000 7fca13fff640 1 --2- 172.21.15.83:0/1443903576 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fca140b6560 0x7fca140b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:38:52.945 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:52.944+0000 7fca2a59c640 1 --2- 172.21.15.83:0/1443903576 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fca140b6560 0x7fca140b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:38:52.945 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:52.944+0000 7fca13fff640 1 -- 172.21.15.83:0/1443903576 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 7062+0+0 (secure 0 0 0) 0x7fca1c107980 con 0x7fca2c103b60 2024-09-21T01:38:52.945 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:52.945+0000 7fca2a59c640 1 --2- 172.21.15.83:0/1443903576 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fca140b6560 0x7fca140b8a70 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fca2c1065a0 tx=0x7fca2000b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:38:52.948 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:52.948+0000 7fca13fff640 1 -- 172.21.15.83:0/1443903576 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fca1c0d2ab0 con 0x7fca2c103b60 2024-09-21T01:38:53.127 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:53.127+0000 7fca31121640 1 -- 172.21.15.83:0/1443903576 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7fca2c10bbc0 con 0x7fca2c103b60 2024-09-21T01:38:53.128 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:53.127+0000 7fca13fff640 1 -- 172.21.15.83:0/1443903576 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v67) ==== 74+0+133 (secure 0 0 0) 0x7fca1c0d79f0 con 0x7fca2c103b60 2024-09-21T01:38:53.128 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T01:38:53.130 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:53.130+0000 7fca31121640 1 -- 172.21.15.83:0/1443903576 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fca140b6560 msgr2=0x7fca140b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:38:53.130 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:53.130+0000 7fca31121640 1 --2- 172.21.15.83:0/1443903576 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fca140b6560 0x7fca140b8a70 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fca2c1065a0 tx=0x7fca2000b390 comp rx=0 tx=0).stop 2024-09-21T01:38:53.130 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:53.130+0000 7fca31121640 1 -- 172.21.15.83:0/1443903576 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fca2c103b60 msgr2=0x7fca2c19a450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:38:53.131 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:53.130+0000 7fca31121640 1 --2- 172.21.15.83:0/1443903576 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fca2c103b60 0x7fca2c19a450 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fca1c009230 tx=0x7fca1c004270 comp rx=0 tx=0).stop 2024-09-21T01:38:53.131 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:53.130+0000 7fca31121640 1 -- 172.21.15.83:0/1443903576 shutdown_connections 2024-09-21T01:38:53.131 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:53.130+0000 7fca31121640 1 --2- 172.21.15.83:0/1443903576 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fca140b6560 0x7fca140b8a70 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:38:53.131 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:53.130+0000 7fca31121640 1 --2- 172.21.15.83:0/1443903576 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fca2c109df0 0x7fca2c19fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:38:53.131 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:53.130+0000 7fca31121640 1 --2- 172.21.15.83:0/1443903576 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fca2c1094a0 0x7fca2c19a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:38:53.131 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:53.130+0000 7fca31121640 1 --2- 172.21.15.83:0/1443903576 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fca2c103b60 0x7fca2c19a450 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:38:53.131 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:53.130+0000 7fca31121640 1 -- 172.21.15.83:0/1443903576 >> 172.21.15.83:0/1443903576 conn(0x7fca2c07b850 msgr2=0x7fca2c107650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:38:53.131 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:53.130+0000 7fca31121640 1 -- 172.21.15.83:0/1443903576 shutdown_connections 2024-09-21T01:38:53.131 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:53.130+0000 7fca31121640 1 -- 172.21.15.83:0/1443903576 wait complete. 2024-09-21T01:38:53.786 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:38:53 smithi142 ceph-mon[34050]: Detected new or changed devices on smithi142 2024-09-21T01:38:53.786 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:38:53 smithi142 ceph-mon[34050]: Adjusting osd_memory_target on smithi142 to 4272M 2024-09-21T01:38:53.786 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:38:53 smithi142 ceph-mon[34050]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi142", "root=default"]}]': finished 2024-09-21T01:38:53.786 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:38:53 smithi142 ceph-mon[34050]: osdmap e67: 12 total, 11 up, 12 in 2024-09-21T01:38:53.786 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:38:53 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T01:38:53.786 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:38:53 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T01:38:53.786 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:38:53 smithi142 ceph-mon[34050]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 983 GiB / 983 GiB avail 2024-09-21T01:38:53.786 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:38:53 smithi142 ceph-mon[34050]: from='client.? 172.21.15.83:0/1443903576' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T01:38:53.786 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:38:53 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T01:38:53.804 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:38:53 smithi083 ceph-mon[31370]: Detected new or changed devices on smithi142 2024-09-21T01:38:53.804 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:38:53 smithi083 ceph-mon[31370]: Adjusting osd_memory_target on smithi142 to 4272M 2024-09-21T01:38:53.804 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:38:53 smithi083 ceph-mon[31370]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi142", "root=default"]}]': finished 2024-09-21T01:38:53.804 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:38:53 smithi083 ceph-mon[31370]: osdmap e67: 12 total, 11 up, 12 in 2024-09-21T01:38:53.804 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:38:53 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T01:38:53.804 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:38:53 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T01:38:53.804 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:38:53 smithi083 ceph-mon[31370]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 983 GiB / 983 GiB avail 2024-09-21T01:38:53.804 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:38:53 smithi083 ceph-mon[31370]: from='client.? 172.21.15.83:0/1443903576' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T01:38:53.804 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:38:53 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T01:38:53.936 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":67,"num_osds":12,"num_up_osds":11,"osd_up_since":1726882708,"num_in_osds":12,"osd_in_since":1726882710,"num_remapped_pgs":0} 2024-09-21T01:38:53.967 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:38:53 smithi119 ceph-mon[33693]: Detected new or changed devices on smithi142 2024-09-21T01:38:53.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:38:53 smithi119 ceph-mon[33693]: Adjusting osd_memory_target on smithi142 to 4272M 2024-09-21T01:38:53.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:38:53 smithi119 ceph-mon[33693]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi142", "root=default"]}]': finished 2024-09-21T01:38:53.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:38:53 smithi119 ceph-mon[33693]: osdmap e67: 12 total, 11 up, 12 in 2024-09-21T01:38:53.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:38:53 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T01:38:53.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:38:53 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T01:38:53.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:38:53 smithi119 ceph-mon[33693]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 983 GiB / 983 GiB avail 2024-09-21T01:38:53.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:38:53 smithi119 ceph-mon[33693]: from='client.? 172.21.15.83:0/1443903576' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T01:38:53.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:38:53 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T01:38:54.804 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:38:54 smithi083 ceph-mon[31370]: purged_snaps scrub starts 2024-09-21T01:38:54.804 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:38:54 smithi083 ceph-mon[31370]: purged_snaps scrub ok 2024-09-21T01:38:54.804 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:38:54 smithi083 ceph-mon[31370]: osd.11 [v2:172.21.15.142:6824/1174646198,v1:172.21.15.142:6825/1174646198] boot 2024-09-21T01:38:54.804 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:38:54 smithi083 ceph-mon[31370]: osdmap e68: 12 total, 12 up, 12 in 2024-09-21T01:38:54.804 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:38:54 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T01:38:54.937 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph osd stat -f json 2024-09-21T01:38:54.964 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:38:54 smithi142 ceph-mon[34050]: purged_snaps scrub starts 2024-09-21T01:38:54.965 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:38:54 smithi142 ceph-mon[34050]: purged_snaps scrub ok 2024-09-21T01:38:54.965 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:38:54 smithi142 ceph-mon[34050]: osd.11 [v2:172.21.15.142:6824/1174646198,v1:172.21.15.142:6825/1174646198] boot 2024-09-21T01:38:54.965 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:38:54 smithi142 ceph-mon[34050]: osdmap e68: 12 total, 12 up, 12 in 2024-09-21T01:38:54.965 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:38:54 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T01:38:54.967 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:38:54 smithi119 ceph-mon[33693]: purged_snaps scrub starts 2024-09-21T01:38:54.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:38:54 smithi119 ceph-mon[33693]: purged_snaps scrub ok 2024-09-21T01:38:54.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:38:54 smithi119 ceph-mon[33693]: osd.11 [v2:172.21.15.142:6824/1174646198,v1:172.21.15.142:6825/1174646198] boot 2024-09-21T01:38:54.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:38:54 smithi119 ceph-mon[33693]: osdmap e68: 12 total, 12 up, 12 in 2024-09-21T01:38:54.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:38:54 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T01:38:55.195 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:38:55.579 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:38:55 smithi083 ceph-mon[31370]: osdmap e69: 12 total, 12 up, 12 in 2024-09-21T01:38:55.579 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:38:55 smithi083 ceph-mon[31370]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:38:55.688 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:55.667+0000 7f53590d7640 1 -- 172.21.15.83:0/2295026605 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5354102ae0 msgr2=0x7f5354102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:38:55.688 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:55.667+0000 7f53590d7640 1 --2- 172.21.15.83:0/2295026605 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5354102ae0 0x7f5354102ef0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f5344009900 tx=0x7f534402a410 comp rx=0 tx=0).stop 2024-09-21T01:38:55.688 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:55.667+0000 7f53590d7640 1 -- 172.21.15.83:0/2295026605 shutdown_connections 2024-09-21T01:38:55.688 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:55.667+0000 7f53590d7640 1 --2- 172.21.15.83:0/2295026605 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5354108d20 0x7f535410f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:38:55.688 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:55.667+0000 7f53590d7640 1 --2- 172.21.15.83:0/2295026605 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f53541083d0 0x7f53541087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:38:55.689 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:55.667+0000 7f53590d7640 1 --2- 172.21.15.83:0/2295026605 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5354102ae0 0x7f5354102ef0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:38:55.689 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:55.667+0000 7f53590d7640 1 -- 172.21.15.83:0/2295026605 >> 172.21.15.83:0/2295026605 conn(0x7f5354079760 msgr2=0x7f5354079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:38:55.689 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:55.667+0000 7f53590d7640 1 -- 172.21.15.83:0/2295026605 shutdown_connections 2024-09-21T01:38:55.689 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:55.667+0000 7f53590d7640 1 -- 172.21.15.83:0/2295026605 wait complete. 2024-09-21T01:38:55.689 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:55.668+0000 7f53590d7640 1 Processor -- start 2024-09-21T01:38:55.689 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:55.668+0000 7f53590d7640 1 -- start start 2024-09-21T01:38:55.689 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:55.668+0000 7f53590d7640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5354102ae0 0x7f5354198f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:38:55.689 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:55.668+0000 7f53590d7640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f53541083d0 0x7f53541994a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:38:55.689 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:55.668+0000 7f53590d7640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5354108d20 0x7f53541999e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:38:55.689 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:55.668+0000 7f53590d7640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f5354112840 con 0x7f5354102ae0 2024-09-21T01:38:55.689 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:55.668+0000 7f53590d7640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f53541126c0 con 0x7f53541083d0 2024-09-21T01:38:55.689 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:55.668+0000 7f53590d7640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f53541129c0 con 0x7f5354108d20 2024-09-21T01:38:55.689 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:55.668+0000 7f5352d9d640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5354102ae0 0x7f5354198f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:38:55.689 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:55.668+0000 7f5352d9d640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5354102ae0 0x7f5354198f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:52518/0 (socket says 172.21.15.83:52518) 2024-09-21T01:38:55.690 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:55.668+0000 7f5352d9d640 1 -- 172.21.15.83:0/2726712927 learned_addr learned my addr 172.21.15.83:0/2726712927 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:38:55.690 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:55.669+0000 7f535259c640 1 --2- 172.21.15.83:0/2726712927 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f53541083d0 0x7f53541994a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:38:55.690 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:55.669+0000 7f535359e640 1 --2- 172.21.15.83:0/2726712927 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5354108d20 0x7f53541999e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:38:55.690 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:55.669+0000 7f5352d9d640 1 -- 172.21.15.83:0/2726712927 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5354108d20 msgr2=0x7f53541999e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:38:55.690 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:55.669+0000 7f5352d9d640 1 --2- 172.21.15.83:0/2726712927 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5354108d20 0x7f53541999e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:38:55.690 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:55.669+0000 7f5352d9d640 1 -- 172.21.15.83:0/2726712927 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f53541083d0 msgr2=0x7f53541994a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:38:55.690 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:55.669+0000 7f5352d9d640 1 --2- 172.21.15.83:0/2726712927 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f53541083d0 0x7f53541994a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:38:55.690 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:55.669+0000 7f5352d9d640 1 -- 172.21.15.83:0/2726712927 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53541a8610 con 0x7f5354102ae0 2024-09-21T01:38:55.690 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:55.669+0000 7f5352d9d640 1 --2- 172.21.15.83:0/2726712927 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5354102ae0 0x7f5354198f60 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f5344009230 tx=0x7f5344004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:38:55.690 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:55.669+0000 7f534bfff640 1 -- 172.21.15.83:0/2726712927 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f534403f030 con 0x7f5354102ae0 2024-09-21T01:38:55.690 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:55.669+0000 7f53590d7640 1 -- 172.21.15.83:0/2726712927 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53541a88a0 con 0x7f5354102ae0 2024-09-21T01:38:55.690 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:55.669+0000 7f534bfff640 1 -- 172.21.15.83:0/2726712927 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5344003a80 con 0x7f5354102ae0 2024-09-21T01:38:55.690 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:55.669+0000 7f534bfff640 1 -- 172.21.15.83:0/2726712927 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5344035070 con 0x7f5354102ae0 2024-09-21T01:38:55.690 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:55.669+0000 7f53590d7640 1 -- 172.21.15.83:0/2726712927 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53541a8d80 con 0x7f5354102ae0 2024-09-21T01:38:55.691 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:55.670+0000 7f53590d7640 1 -- 172.21.15.83:0/2726712927 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5354103d10 con 0x7f5354102ae0 2024-09-21T01:38:55.691 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:55.672+0000 7f534bfff640 1 -- 172.21.15.83:0/2726712927 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 20) ==== 154529+0+0 (secure 0 0 0) 0x7f5344042030 con 0x7f5354102ae0 2024-09-21T01:38:55.691 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:55.672+0000 7f534bfff640 1 --2- 172.21.15.83:0/2726712927 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f53400b6560 0x7f53400b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:38:55.691 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:55.673+0000 7f535259c640 1 --2- 172.21.15.83:0/2726712927 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f53400b6560 0x7f53400b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:38:55.691 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:55.673+0000 7f534bfff640 1 -- 172.21.15.83:0/2726712927 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7342+0+0 (secure 0 0 0) 0x7f5344107c20 con 0x7f5354102ae0 2024-09-21T01:38:55.691 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:55.673+0000 7f535259c640 1 --2- 172.21.15.83:0/2726712927 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f53400b6560 0x7f53400b8a70 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f533c005fd0 tx=0x7f533c005850 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:38:55.691 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:55.676+0000 7f534bfff640 1 -- 172.21.15.83:0/2726712927 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f53440ce880 con 0x7f5354102ae0 2024-09-21T01:38:55.855 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:55.855+0000 7f53590d7640 1 -- 172.21.15.83:0/2726712927 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f5354102ef0 con 0x7f5354102ae0 2024-09-21T01:38:55.856 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:55.855+0000 7f534bfff640 1 -- 172.21.15.83:0/2726712927 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v69) ==== 74+0+133 (secure 0 0 0) 0x7f5354102ef0 con 0x7f5354102ae0 2024-09-21T01:38:55.856 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T01:38:55.858 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:55.858+0000 7f53590d7640 1 -- 172.21.15.83:0/2726712927 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f53400b6560 msgr2=0x7f53400b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:38:55.858 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:55.858+0000 7f53590d7640 1 --2- 172.21.15.83:0/2726712927 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f53400b6560 0x7f53400b8a70 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f533c005fd0 tx=0x7f533c005850 comp rx=0 tx=0).stop 2024-09-21T01:38:55.858 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:55.858+0000 7f53590d7640 1 -- 172.21.15.83:0/2726712927 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5354102ae0 msgr2=0x7f5354198f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:38:55.858 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:55.858+0000 7f53590d7640 1 --2- 172.21.15.83:0/2726712927 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5354102ae0 0x7f5354198f60 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f5344009230 tx=0x7f5344004270 comp rx=0 tx=0).stop 2024-09-21T01:38:55.858 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:55.858+0000 7f53590d7640 1 -- 172.21.15.83:0/2726712927 shutdown_connections 2024-09-21T01:38:55.859 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:55.858+0000 7f53590d7640 1 --2- 172.21.15.83:0/2726712927 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f53400b6560 0x7f53400b8a70 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:38:55.859 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:55.858+0000 7f53590d7640 1 --2- 172.21.15.83:0/2726712927 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5354108d20 0x7f53541999e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:38:55.859 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:55.858+0000 7f53590d7640 1 --2- 172.21.15.83:0/2726712927 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f53541083d0 0x7f53541994a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:38:55.859 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:55.858+0000 7f53590d7640 1 --2- 172.21.15.83:0/2726712927 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5354102ae0 0x7f5354198f60 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:38:55.859 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:55.858+0000 7f53590d7640 1 -- 172.21.15.83:0/2726712927 >> 172.21.15.83:0/2726712927 conn(0x7f5354079760 msgr2=0x7f53541015f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:38:55.859 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:55.858+0000 7f53590d7640 1 -- 172.21.15.83:0/2726712927 shutdown_connections 2024-09-21T01:38:55.859 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:55.858+0000 7f53590d7640 1 -- 172.21.15.83:0/2726712927 wait complete. 2024-09-21T01:38:55.964 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:38:55 smithi142 ceph-mon[34050]: osdmap e69: 12 total, 12 up, 12 in 2024-09-21T01:38:55.964 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:38:55 smithi142 ceph-mon[34050]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:38:55.967 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:38:55 smithi119 ceph-mon[33693]: osdmap e69: 12 total, 12 up, 12 in 2024-09-21T01:38:55.967 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:38:55 smithi119 ceph-mon[33693]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:38:56.565 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":69,"num_osds":12,"num_up_osds":12,"osd_up_since":1726882733,"num_in_osds":12,"osd_in_since":1726882710,"num_remapped_pgs":0} 2024-09-21T01:38:56.565 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T01:38:56.588 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:38:56 smithi083 ceph-mon[31370]: from='client.? 172.21.15.83:0/2726712927' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T01:38:56.808 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:38:56.964 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:38:56 smithi142 ceph-mon[34050]: from='client.? 172.21.15.83:0/2726712927' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T01:38:57.035 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:38:56 smithi119 ceph-mon[33693]: from='client.? 172.21.15.83:0/2726712927' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T01:38:57.297 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:57.278+0000 7f90ff287640 1 -- 172.21.15.83:0/3276193711 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f90f810de70 msgr2=0x7f90f8110340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:38:57.297 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:57.278+0000 7f90ff287640 1 --2- 172.21.15.83:0/3276193711 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f90f810de70 0x7f90f8110340 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f90f0009ca0 tx=0x7f90f002a8c0 comp rx=0 tx=0).stop 2024-09-21T01:38:57.297 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:57.278+0000 7f90ff287640 1 -- 172.21.15.83:0/3276193711 shutdown_connections 2024-09-21T01:38:57.297 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:57.278+0000 7f90ff287640 1 --2- 172.21.15.83:0/3276193711 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f90f810de70 0x7f90f8110340 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:38:57.298 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:57.278+0000 7f90ff287640 1 --2- 172.21.15.83:0/3276193711 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f90f81052a0 0x7f90f810d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:38:57.298 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:57.278+0000 7f90ff287640 1 --2- 172.21.15.83:0/3276193711 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f90f81048c0 0x7f90f8104cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:38:57.298 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:57.278+0000 7f90ff287640 1 -- 172.21.15.83:0/3276193711 >> 172.21.15.83:0/3276193711 conn(0x7f90f80797b0 msgr2=0x7f90f8079bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:38:57.298 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:57.278+0000 7f90ff287640 1 -- 172.21.15.83:0/3276193711 shutdown_connections 2024-09-21T01:38:57.298 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:57.278+0000 7f90ff287640 1 -- 172.21.15.83:0/3276193711 wait complete. 2024-09-21T01:38:57.298 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:57.279+0000 7f90ff287640 1 Processor -- start 2024-09-21T01:38:57.298 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:57.279+0000 7f90ff287640 1 -- start start 2024-09-21T01:38:57.298 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:57.279+0000 7f90ff287640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f90f81048c0 0x7f90f819a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:38:57.298 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:57.279+0000 7f90ff287640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f90f81052a0 0x7f90f819a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:38:57.298 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:57.279+0000 7f90ff287640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f90f810de70 0x7f90f819fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:38:57.298 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:57.279+0000 7f90ff287640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f90f81139d0 con 0x7f90f810de70 2024-09-21T01:38:57.298 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:57.279+0000 7f90ff287640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f90f8113850 con 0x7f90f81048c0 2024-09-21T01:38:57.298 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:57.279+0000 7f90ff287640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f90f8113b50 con 0x7f90f81052a0 2024-09-21T01:38:57.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:57.279+0000 7f90fd824640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f90f810de70 0x7f90f819fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:38:57.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:57.279+0000 7f90fd824640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f90f810de70 0x7f90f819fc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:52528/0 (socket says 172.21.15.83:52528) 2024-09-21T01:38:57.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:57.279+0000 7f90fd824640 1 -- 172.21.15.83:0/1183425178 learned_addr learned my addr 172.21.15.83:0/1183425178 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:38:57.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:57.279+0000 7f90fc822640 1 --2- 172.21.15.83:0/1183425178 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f90f81052a0 0x7f90f819a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:38:57.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:57.279+0000 7f90fd023640 1 --2- 172.21.15.83:0/1183425178 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f90f81048c0 0x7f90f819a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:38:57.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:57.280+0000 7f90fd824640 1 -- 172.21.15.83:0/1183425178 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f90f81052a0 msgr2=0x7f90f819a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:38:57.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:57.280+0000 7f90fd824640 1 --2- 172.21.15.83:0/1183425178 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f90f81052a0 0x7f90f819a9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:38:57.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:57.280+0000 7f90fd824640 1 -- 172.21.15.83:0/1183425178 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f90f81048c0 msgr2=0x7f90f819a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:38:57.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:57.280+0000 7f90fd824640 1 --2- 172.21.15.83:0/1183425178 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f90f81048c0 0x7f90f819a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:38:57.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:57.280+0000 7f90fd824640 1 -- 172.21.15.83:0/1183425178 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90f81a0370 con 0x7f90f810de70 2024-09-21T01:38:57.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:57.280+0000 7f90fd824640 1 --2- 172.21.15.83:0/1183425178 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f90f810de70 0x7f90f819fc40 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f90f0005cc0 tx=0x7f90f0032a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:38:57.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:57.280+0000 7f90ee7fc640 1 -- 172.21.15.83:0/1183425178 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90f0032e00 con 0x7f90f810de70 2024-09-21T01:38:57.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:57.280+0000 7f90ee7fc640 1 -- 172.21.15.83:0/1183425178 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f90f00044d0 con 0x7f90f810de70 2024-09-21T01:38:57.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:57.280+0000 7f90ff287640 1 -- 172.21.15.83:0/1183425178 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90f81a0600 con 0x7f90f810de70 2024-09-21T01:38:57.300 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:57.280+0000 7f90ee7fc640 1 -- 172.21.15.83:0/1183425178 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90f0030b70 con 0x7f90f810de70 2024-09-21T01:38:57.300 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:57.280+0000 7f90ff287640 1 -- 172.21.15.83:0/1183425178 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90f81a6dc0 con 0x7f90f810de70 2024-09-21T01:38:57.300 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:57.281+0000 7f90ff287640 1 -- 172.21.15.83:0/1183425178 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90f8104cd0 con 0x7f90f810de70 2024-09-21T01:38:57.300 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:57.282+0000 7f90ee7fc640 1 -- 172.21.15.83:0/1183425178 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 20) ==== 154529+0+0 (secure 0 0 0) 0x7f90f0030d10 con 0x7f90f810de70 2024-09-21T01:38:57.300 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:57.284+0000 7f90ee7fc640 1 --2- 172.21.15.83:0/1183425178 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f90e40b6560 0x7f90e40b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:38:57.300 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:57.284+0000 7f90fd023640 1 --2- 172.21.15.83:0/1183425178 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f90e40b6560 0x7f90e40b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:38:57.300 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:57.284+0000 7f90ee7fc640 1 -- 172.21.15.83:0/1183425178 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7342+0+0 (secure 0 0 0) 0x7f90f01083f0 con 0x7f90f810de70 2024-09-21T01:38:57.300 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:57.284+0000 7f90fd023640 1 --2- 172.21.15.83:0/1183425178 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f90e40b6560 0x7f90e40b8a70 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f90f400bbe0 tx=0x7f90f400b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:38:57.300 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:57.287+0000 7f90ee7fc640 1 -- 172.21.15.83:0/1183425178 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f90f00cefb0 con 0x7f90f810de70 2024-09-21T01:38:57.466 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:57.465+0000 7f90ff287640 1 -- 172.21.15.83:0/1183425178 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f90f81a6ff0 con 0x7f90f810de70 2024-09-21T01:38:57.467 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:57.467+0000 7f90ee7fc640 1 -- 172.21.15.83:0/1183425178 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v69) ==== 74+0+18809 (secure 0 0 0) 0x7f90f00d3390 con 0x7f90f810de70 2024-09-21T01:38:57.467 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T01:38:57.468 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":69,"fsid":"f7697ecc-77b8-11ef-baf5-efdc52797490","created":"2024-09-21T01:31:22.250342+0000","modified":"2024-09-21T01:38:54.512869+0000","last_up_change":"2024-09-21T01:38:53.501659+0000","last_in_change":"2024-09-21T01:38:30.688516+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T01:35:06.977668+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"66947512-01ee-4bf0-87b0-98a168cf50dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":3563457494},{"type":"v1","addr":"172.21.15.83:6803","nonce":3563457494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":3563457494},{"type":"v1","addr":"172.21.15.83:6805","nonce":3563457494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":3563457494},{"type":"v1","addr":"172.21.15.83:6809","nonce":3563457494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":3563457494},{"type":"v1","addr":"172.21.15.83:6807","nonce":3563457494}]},"public_addr":"172.21.15.83:6803/3563457494","cluster_addr":"172.21.15.83:6805/3563457494","heartbeat_back_addr":"172.21.15.83:6809/3563457494","heartbeat_front_addr":"172.21.15.83:6807/3563457494","state":["exists","up"]},{"osd":1,"uuid":"f7818a08-86a5-412d-a164-cfeb18f8650a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":2066870220},{"type":"v1","addr":"172.21.15.119:6801","nonce":2066870220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":2066870220},{"type":"v1","addr":"172.21.15.119:6803","nonce":2066870220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":2066870220},{"type":"v1","addr":"172.21.15.119:6807","nonce":2066870220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":2066870220},{"type":"v1","addr":"172.21.15.119:6805","nonce":2066870220}]},"public_addr":"172.21.15.119:6801/2066870220","cluster_addr":"172.21.15.119:6803/2066870220","heartbeat_back_addr":"172.21.15.119:6807/2066870220","heartbeat_front_addr":"172.21.15.119:6805/2066870220","state":["exists","up"]},{"osd":2,"uuid":"0d1a3870-c67a-4783-85f9-be2bb36f7722","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":3955936117},{"type":"v1","addr":"172.21.15.142:6801","nonce":3955936117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3955936117},{"type":"v1","addr":"172.21.15.142:6803","nonce":3955936117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":3955936117},{"type":"v1","addr":"172.21.15.142:6807","nonce":3955936117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":3955936117},{"type":"v1","addr":"172.21.15.142:6805","nonce":3955936117}]},"public_addr":"172.21.15.142:6801/3955936117","cluster_addr":"172.21.15.142:6803/3955936117","heartbeat_back_addr":"172.21.15.142:6807/3955936117","heartbeat_front_addr":"172.21.15.142:6805/3955936117","state":["exists","up"]},{"osd":3,"uuid":"a4cb1a36-3495-4d36-92da-ed3b6e852d14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":3746834093},{"type":"v1","addr":"172.21.15.83:6811","nonce":3746834093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":3746834093},{"type":"v1","addr":"172.21.15.83:6813","nonce":3746834093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":3746834093},{"type":"v1","addr":"172.21.15.83:6817","nonce":3746834093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":3746834093},{"type":"v1","addr":"172.21.15.83:6815","nonce":3746834093}]},"public_addr":"172.21.15.83:6811/3746834093","cluster_addr":"172.21.15.83:6813/3746834093","heartbeat_back_addr":"172.21.15.83:6817/3746834093","heartbeat_front_addr":"172.21.15.83:6815/3746834093","state":["exists","up"]},{"osd":4,"uuid":"d6f2ec78-7f08-473b-a96c-e8590f5d2f25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":3083907785},{"type":"v1","addr":"172.21.15.119:6809","nonce":3083907785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":3083907785},{"type":"v1","addr":"172.21.15.119:6811","nonce":3083907785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":3083907785},{"type":"v1","addr":"172.21.15.119:6815","nonce":3083907785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":3083907785},{"type":"v1","addr":"172.21.15.119:6813","nonce":3083907785}]},"public_addr":"172.21.15.119:6809/3083907785","cluster_addr":"172.21.15.119:6811/3083907785","heartbeat_back_addr":"172.21.15.119:6815/3083907785","heartbeat_front_addr":"172.21.15.119:6813/3083907785","state":["exists","up"]},{"osd":5,"uuid":"c571d04d-d3ea-4d74-8867-e4c7816f4e0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":349001002},{"type":"v1","addr":"172.21.15.142:6809","nonce":349001002}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":349001002},{"type":"v1","addr":"172.21.15.142:6811","nonce":349001002}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":349001002},{"type":"v1","addr":"172.21.15.142:6815","nonce":349001002}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":349001002},{"type":"v1","addr":"172.21.15.142:6813","nonce":349001002}]},"public_addr":"172.21.15.142:6809/349001002","cluster_addr":"172.21.15.142:6811/349001002","heartbeat_back_addr":"172.21.15.142:6815/349001002","heartbeat_front_addr":"172.21.15.142:6813/349001002","state":["exists","up"]},{"osd":6,"uuid":"6e1b6fe9-700a-448a-b382-59b97896ea7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":771651063},{"type":"v1","addr":"172.21.15.83:6819","nonce":771651063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":771651063},{"type":"v1","addr":"172.21.15.83:6821","nonce":771651063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":771651063},{"type":"v1","addr":"172.21.15.83:6825","nonce":771651063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":771651063},{"type":"v1","addr":"172.21.15.83:6823","nonce":771651063}]},"public_addr":"172.21.15.83:6819/771651063","cluster_addr":"172.21.15.83:6821/771651063","heartbeat_back_addr":"172.21.15.83:6825/771651063","heartbeat_front_addr":"172.21.15.83:6823/771651063","state":["exists","up"]},{"osd":7,"uuid":"283bfae4-5f50-4f9e-860e-bbfd47e005e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":1556984819},{"type":"v1","addr":"172.21.15.119:6817","nonce":1556984819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":1556984819},{"type":"v1","addr":"172.21.15.119:6819","nonce":1556984819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":1556984819},{"type":"v1","addr":"172.21.15.119:6823","nonce":1556984819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":1556984819},{"type":"v1","addr":"172.21.15.119:6821","nonce":1556984819}]},"public_addr":"172.21.15.119:6817/1556984819","cluster_addr":"172.21.15.119:6819/1556984819","heartbeat_back_addr":"172.21.15.119:6823/1556984819","heartbeat_front_addr":"172.21.15.119:6821/1556984819","state":["exists","up"]},{"osd":8,"uuid":"d46e56d4-ed4e-42c3-a315-66af014bd93a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":1860679473},{"type":"v1","addr":"172.21.15.142:6817","nonce":1860679473}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":1860679473},{"type":"v1","addr":"172.21.15.142:6819","nonce":1860679473}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":1860679473},{"type":"v1","addr":"172.21.15.142:6823","nonce":1860679473}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":1860679473},{"type":"v1","addr":"172.21.15.142:6821","nonce":1860679473}]},"public_addr":"172.21.15.142:6817/1860679473","cluster_addr":"172.21.15.142:6819/1860679473","heartbeat_back_addr":"172.21.15.142:6823/1860679473","heartbeat_front_addr":"172.21.15.142:6821/1860679473","state":["exists","up"]},{"osd":9,"uuid":"18a70ee6-56df-4f5c-868d-5db5e72a1859","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":3636757924},{"type":"v1","addr":"172.21.15.83:6827","nonce":3636757924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":3636757924},{"type":"v1","addr":"172.21.15.83:6829","nonce":3636757924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6832","nonce":3636757924},{"type":"v1","addr":"172.21.15.83:6833","nonce":3636757924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":3636757924},{"type":"v1","addr":"172.21.15.83:6831","nonce":3636757924}]},"public_addr":"172.21.15.83:6827/3636757924","cluster_addr":"172.21.15.83:6829/3636757924","heartbeat_back_addr":"172.21.15.83:6833/3636757924","heartbeat_front_addr":"172.21.15.83:6831/3636757924","state":["exists","up"]},{"osd":10,"uuid":"0d32c3de-db03-42c3-9914-07d675aaa339","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":2561963910},{"type":"v1","addr":"172.21.15.119:6825","nonce":2561963910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":2561963910},{"type":"v1","addr":"172.21.15.119:6827","nonce":2561963910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2561963910},{"type":"v1","addr":"172.21.15.119:6831","nonce":2561963910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2561963910},{"type":"v1","addr":"172.21.15.119:6829","nonce":2561963910}]},"public_addr":"172.21.15.119:6825/2561963910","cluster_addr":"172.21.15.119:6827/2561963910","heartbeat_back_addr":"172.21.15.119:6831/2561963910","heartbeat_front_addr":"172.21.15.119:6829/2561963910","state":["exists","up"]},{"osd":11,"uuid":"3a3b444d-b316-4256-bfad-378db29f0824","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":1174646198},{"type":"v1","addr":"172.21.15.142:6825","nonce":1174646198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":1174646198},{"type":"v1","addr":"172.21.15.142:6827","nonce":1174646198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1174646198},{"type":"v1","addr":"172.21.15.142:6831","nonce":1174646198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1174646198},{"type":"v1","addr":"172.21.15.142:6829","nonce":1174646198}]},"public_addr":"172.21.15.142:6825/1174646198","cluster_addr":"172.21.15.142:6827/1174646198","heartbeat_back_addr":"172.21.15.142:6831/1174646198","heartbeat_front_addr":"172.21.15.142:6829/1174646198","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:34:15.337672+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:34:39.259716+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:35:03.348886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:35:29.465711+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:35:53.744378+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:36:19.488785+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:36:45.708616+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:37:11.501065+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:37:36.027277+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:38:01.903625+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:38:27.215212+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:38:51.891278+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.83:0/1619062496":"2024-09-22T01:33:08.666525+0000","172.21.15.83:0/2412709299":"2024-09-22T01:31:45.834450+0000","172.21.15.83:6800/4290325964":"2024-09-22T01:31:45.834450+0000","172.21.15.83:6801/4290325964":"2024-09-22T01:31:45.834450+0000","172.21.15.83:0/1440681183":"2024-09-22T01:31:45.834450+0000","172.21.15.83:0/2745413305":"2024-09-22T01:31:45.834450+0000","172.21.15.83:6800/1393748565":"2024-09-22T01:33:08.666525+0000","172.21.15.83:0/110411274":"2024-09-22T01:32:10.073024+0000","172.21.15.83:0/4267551123":"2024-09-22T01:33:08.666525+0000","172.21.15.83:0/1068434643":"2024-09-22T01:32:10.073024+0000","172.21.15.83:6800/2963261730":"2024-09-22T01:32:10.073024+0000","172.21.15.83:0/3544333975":"2024-09-22T01:32:10.073024+0000","172.21.15.83:6801/1393748565":"2024-09-22T01:33:08.666525+0000","172.21.15.83:6801/2963261730":"2024-09-22T01:32:10.073024+0000","172.21.15.83:0/1915285091":"2024-09-22T01:33:08.666525+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T01:38:57.470 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:57.469+0000 7f90ff287640 1 -- 172.21.15.83:0/1183425178 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f90e40b6560 msgr2=0x7f90e40b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:38:57.470 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:57.469+0000 7f90ff287640 1 --2- 172.21.15.83:0/1183425178 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f90e40b6560 0x7f90e40b8a70 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f90f400bbe0 tx=0x7f90f400b390 comp rx=0 tx=0).stop 2024-09-21T01:38:57.470 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:57.469+0000 7f90ff287640 1 -- 172.21.15.83:0/1183425178 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f90f810de70 msgr2=0x7f90f819fc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:38:57.470 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:57.469+0000 7f90ff287640 1 --2- 172.21.15.83:0/1183425178 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f90f810de70 0x7f90f819fc40 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f90f0005cc0 tx=0x7f90f0032a10 comp rx=0 tx=0).stop 2024-09-21T01:38:57.470 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:57.469+0000 7f90ff287640 1 -- 172.21.15.83:0/1183425178 shutdown_connections 2024-09-21T01:38:57.470 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:57.469+0000 7f90ff287640 1 --2- 172.21.15.83:0/1183425178 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f90e40b6560 0x7f90e40b8a70 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:38:57.470 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:57.469+0000 7f90ff287640 1 --2- 172.21.15.83:0/1183425178 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f90f810de70 0x7f90f819fc40 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:38:57.470 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:57.469+0000 7f90ff287640 1 --2- 172.21.15.83:0/1183425178 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f90f81052a0 0x7f90f819a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:38:57.470 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:57.469+0000 7f90ff287640 1 --2- 172.21.15.83:0/1183425178 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f90f81048c0 0x7f90f819a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:38:57.471 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:57.469+0000 7f90ff287640 1 -- 172.21.15.83:0/1183425178 >> 172.21.15.83:0/1183425178 conn(0x7f90f80797b0 msgr2=0x7f90f8100690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:38:57.471 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:57.469+0000 7f90ff287640 1 -- 172.21.15.83:0/1183425178 shutdown_connections 2024-09-21T01:38:57.471 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:57.469+0000 7f90ff287640 1 -- 172.21.15.83:0/1183425178 wait complete. 2024-09-21T01:38:57.803 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:38:57 smithi083 ceph-mon[31370]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:38:57.804 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:38:57 smithi083 ceph-mon[31370]: from='client.? 172.21.15.83:0/1183425178' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T01:38:57.964 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:38:57 smithi142 ceph-mon[34050]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:38:57.964 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:38:57 smithi142 ceph-mon[34050]: from='client.? 172.21.15.83:0/1183425178' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T01:38:57.967 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:38:57 smithi119 ceph-mon[33693]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:38:57.967 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:38:57 smithi119 ceph-mon[33693]: from='client.? 172.21.15.83:0/1183425178' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T01:38:58.156 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-21T01:35:06.977668+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-21T01:38:58.156 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph osd pool get .mgr pg_num 2024-09-21T01:38:58.440 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:38:58.949 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:58.931+0000 7f1be4fea640 1 -- 172.21.15.83:0/3164886251 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1be0103b60 msgr2=0x7f1be0103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:38:58.949 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:58.931+0000 7f1be4fea640 1 --2- 172.21.15.83:0/3164886251 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1be0103b60 0x7f1be0103f70 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f1bd0009900 tx=0x7f1bd002a410 comp rx=0 tx=0).stop 2024-09-21T01:38:58.949 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:58.931+0000 7f1be4fea640 1 -- 172.21.15.83:0/3164886251 shutdown_connections 2024-09-21T01:38:58.949 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:58.931+0000 7f1be4fea640 1 --2- 172.21.15.83:0/3164886251 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1be0109df0 0x7f1be0110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:38:58.949 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:58.931+0000 7f1be4fea640 1 --2- 172.21.15.83:0/3164886251 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1be01094a0 0x7f1be01098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:38:58.949 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:58.931+0000 7f1be4fea640 1 --2- 172.21.15.83:0/3164886251 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1be0103b60 0x7f1be0103f70 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:38:58.949 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:58.931+0000 7f1be4fea640 1 -- 172.21.15.83:0/3164886251 >> 172.21.15.83:0/3164886251 conn(0x7f1be007b850 msgr2=0x7f1be007bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:38:58.950 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:58.931+0000 7f1be4fea640 1 -- 172.21.15.83:0/3164886251 shutdown_connections 2024-09-21T01:38:58.950 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:58.931+0000 7f1be4fea640 1 -- 172.21.15.83:0/3164886251 wait complete. 2024-09-21T01:38:58.950 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:58.932+0000 7f1be4fea640 1 Processor -- start 2024-09-21T01:38:58.950 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:58.932+0000 7f1be4fea640 1 -- start start 2024-09-21T01:38:58.950 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:58.933+0000 7f1be4fea640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1be0103b60 0x7f1be019a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:38:58.950 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:58.933+0000 7f1be4fea640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1be01094a0 0x7f1be019a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:38:58.950 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:58.933+0000 7f1be4fea640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1be0109df0 0x7f1be019fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:38:58.950 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:58.933+0000 7f1be4fea640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f1be01139c0 con 0x7f1be0109df0 2024-09-21T01:38:58.950 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:58.933+0000 7f1be4fea640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f1be0113840 con 0x7f1be01094a0 2024-09-21T01:38:58.950 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:58.933+0000 7f1be4fea640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f1be0113b40 con 0x7f1be0103b60 2024-09-21T01:38:58.951 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:58.933+0000 7f1bded9d640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1be0109df0 0x7f1be019fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:38:58.951 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:58.933+0000 7f1bded9d640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1be0109df0 0x7f1be019fc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:52552/0 (socket says 172.21.15.83:52552) 2024-09-21T01:38:58.951 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:58.933+0000 7f1bded9d640 1 -- 172.21.15.83:0/4050745064 learned_addr learned my addr 172.21.15.83:0/4050745064 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:38:58.951 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:58.933+0000 7f1bde59c640 1 --2- 172.21.15.83:0/4050745064 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1be0103b60 0x7f1be019a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:38:58.951 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:58.933+0000 7f1bddd9b640 1 --2- 172.21.15.83:0/4050745064 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1be01094a0 0x7f1be019a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:38:58.951 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:58.933+0000 7f1bded9d640 1 -- 172.21.15.83:0/4050745064 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1be0103b60 msgr2=0x7f1be019a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:38:58.951 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:58.933+0000 7f1bded9d640 1 --2- 172.21.15.83:0/4050745064 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1be0103b60 0x7f1be019a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:38:58.951 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:58.933+0000 7f1bded9d640 1 -- 172.21.15.83:0/4050745064 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1be01094a0 msgr2=0x7f1be019a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:38:58.951 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:58.933+0000 7f1bded9d640 1 --2- 172.21.15.83:0/4050745064 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1be01094a0 0x7f1be019a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:38:58.951 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:58.933+0000 7f1bded9d640 1 -- 172.21.15.83:0/4050745064 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1be01a0380 con 0x7f1be0109df0 2024-09-21T01:38:58.951 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:58.933+0000 7f1bddd9b640 1 --2- 172.21.15.83:0/4050745064 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1be01094a0 0x7f1be019a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:38:58.952 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:58.933+0000 7f1bded9d640 1 --2- 172.21.15.83:0/4050745064 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1be0109df0 0x7f1be019fc50 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f1bd800b970 tx=0x7f1bd800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:38:58.952 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:58.933+0000 7f1bd77fe640 1 -- 172.21.15.83:0/4050745064 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bd8019070 con 0x7f1be0109df0 2024-09-21T01:38:58.952 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:58.933+0000 7f1be4fea640 1 -- 172.21.15.83:0/4050745064 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1be01a0670 con 0x7f1be0109df0 2024-09-21T01:38:58.952 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:58.933+0000 7f1bd77fe640 1 -- 172.21.15.83:0/4050745064 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1bd8014440 con 0x7f1be0109df0 2024-09-21T01:38:58.952 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:58.933+0000 7f1bd77fe640 1 -- 172.21.15.83:0/4050745064 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bd80075d0 con 0x7f1be0109df0 2024-09-21T01:38:58.952 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:58.934+0000 7f1be4fea640 1 -- 172.21.15.83:0/4050745064 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1be01a6dd0 con 0x7f1be0109df0 2024-09-21T01:38:58.952 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:58.935+0000 7f1be4fea640 1 -- 172.21.15.83:0/4050745064 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1be0103f70 con 0x7f1be0109df0 2024-09-21T01:38:58.952 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:58.936+0000 7f1bd77fe640 1 -- 172.21.15.83:0/4050745064 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 20) ==== 154529+0+0 (secure 0 0 0) 0x7f1bd801c070 con 0x7f1be0109df0 2024-09-21T01:38:58.952 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:58.937+0000 7f1bd77fe640 1 --2- 172.21.15.83:0/4050745064 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f1bcc0b6560 0x7f1bcc0b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:38:58.952 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:58.937+0000 7f1bde59c640 1 --2- 172.21.15.83:0/4050745064 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f1bcc0b6560 0x7f1bcc0b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:38:58.952 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:58.937+0000 7f1bd77fe640 1 -- 172.21.15.83:0/4050745064 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7342+0+0 (secure 0 0 0) 0x7f1bd80e68c0 con 0x7f1be0109df0 2024-09-21T01:38:58.953 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:58.937+0000 7f1bde59c640 1 --2- 172.21.15.83:0/4050745064 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f1bcc0b6560 0x7f1bcc0b8a70 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f1bd00057c0 tx=0x7f1bd00058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:38:58.953 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:58.940+0000 7f1bd77fe640 1 -- 172.21.15.83:0/4050745064 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f1bd80b1900 con 0x7f1be0109df0 2024-09-21T01:38:59.119 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:59.118+0000 7f1be4fea640 1 -- 172.21.15.83:0/4050745064 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f1be002e640 con 0x7f1be0109df0 2024-09-21T01:38:59.119 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:59.119+0000 7f1bd77fe640 1 -- 172.21.15.83:0/4050745064 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v69) ==== 93+0+10 (secure 0 0 0) 0x7f1bd80b6840 con 0x7f1be0109df0 2024-09-21T01:38:59.119 INFO:teuthology.orchestra.run.smithi083.stdout:pg_num: 1 2024-09-21T01:38:59.122 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:59.121+0000 7f1be4fea640 1 -- 172.21.15.83:0/4050745064 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f1bcc0b6560 msgr2=0x7f1bcc0b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:38:59.122 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:59.121+0000 7f1be4fea640 1 --2- 172.21.15.83:0/4050745064 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f1bcc0b6560 0x7f1bcc0b8a70 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f1bd00057c0 tx=0x7f1bd00058d0 comp rx=0 tx=0).stop 2024-09-21T01:38:59.122 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:59.121+0000 7f1be4fea640 1 -- 172.21.15.83:0/4050745064 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1be0109df0 msgr2=0x7f1be019fc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:38:59.122 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:59.121+0000 7f1be4fea640 1 --2- 172.21.15.83:0/4050745064 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1be0109df0 0x7f1be019fc50 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f1bd800b970 tx=0x7f1bd800be30 comp rx=0 tx=0).stop 2024-09-21T01:38:59.122 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:59.121+0000 7f1be4fea640 1 -- 172.21.15.83:0/4050745064 shutdown_connections 2024-09-21T01:38:59.122 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:59.121+0000 7f1be4fea640 1 --2- 172.21.15.83:0/4050745064 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f1bcc0b6560 0x7f1bcc0b8a70 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:38:59.122 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:59.121+0000 7f1be4fea640 1 --2- 172.21.15.83:0/4050745064 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1be0109df0 0x7f1be019fc50 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:38:59.122 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:59.121+0000 7f1be4fea640 1 --2- 172.21.15.83:0/4050745064 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1be01094a0 0x7f1be019a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:38:59.122 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:59.121+0000 7f1be4fea640 1 --2- 172.21.15.83:0/4050745064 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1be0103b60 0x7f1be019a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:38:59.122 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:59.121+0000 7f1be4fea640 1 -- 172.21.15.83:0/4050745064 >> 172.21.15.83:0/4050745064 conn(0x7f1be007b850 msgr2=0x7f1be01075a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:38:59.123 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:59.121+0000 7f1be4fea640 1 -- 172.21.15.83:0/4050745064 shutdown_connections 2024-09-21T01:38:59.123 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:38:59.121+0000 7f1be4fea640 1 -- 172.21.15.83:0/4050745064 wait complete. 2024-09-21T01:38:59.862 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:38:59 smithi083 ceph-mon[31370]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:38:59.863 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:38:59 smithi083 ceph-mon[31370]: from='client.? 172.21.15.83:0/4050745064' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T01:38:59.891 INFO:tasks.cephadm:Adding mds.a on smithi083 2024-09-21T01:38:59.891 INFO:tasks.cephadm:Adding mds.d on smithi083 2024-09-21T01:38:59.891 INFO:tasks.cephadm:Adding mds.g on smithi083 2024-09-21T01:38:59.891 INFO:tasks.cephadm:Adding mds.j on smithi083 2024-09-21T01:38:59.891 INFO:tasks.cephadm:Adding mds.b on smithi119 2024-09-21T01:38:59.891 INFO:tasks.cephadm:Adding mds.e on smithi119 2024-09-21T01:38:59.891 INFO:tasks.cephadm:Adding mds.h on smithi119 2024-09-21T01:38:59.891 INFO:tasks.cephadm:Adding mds.k on smithi119 2024-09-21T01:38:59.891 INFO:tasks.cephadm:Adding mds.c on smithi142 2024-09-21T01:38:59.891 INFO:tasks.cephadm:Adding mds.f on smithi142 2024-09-21T01:38:59.891 INFO:tasks.cephadm:Adding mds.i on smithi142 2024-09-21T01:38:59.892 INFO:tasks.cephadm:Adding mds.l on smithi142 2024-09-21T01:38:59.892 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph orch apply mds all '12;smithi083=a;smithi083=d;smithi083=g;smithi083=j;smithi119=b;smithi119=e;smithi119=h;smithi119=k;smithi142=c;smithi142=f;smithi142=i;smithi142=l' 2024-09-21T01:39:00.150 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T01:39:00.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:38:59 smithi142 ceph-mon[34050]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:39:00.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:38:59 smithi142 ceph-mon[34050]: from='client.? 172.21.15.83:0/4050745064' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T01:39:00.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:38:59 smithi119 ceph-mon[33693]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:39:00.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:38:59 smithi119 ceph-mon[33693]: from='client.? 172.21.15.83:0/4050745064' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T01:39:00.658 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:39:00.644+0000 7fc340dfd640 1 -- 172.21.15.142:0/2581987333 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc33c1083a0 msgr2=0x7fc33c1087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:39:00.659 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:39:00.644+0000 7fc340dfd640 1 --2- 172.21.15.142:0/2581987333 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc33c1083a0 0x7fc33c1087b0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fc330009900 tx=0x7fc33002a410 comp rx=0 tx=0).stop 2024-09-21T01:39:00.659 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:39:00.644+0000 7fc340dfd640 1 -- 172.21.15.142:0/2581987333 shutdown_connections 2024-09-21T01:39:00.659 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:39:00.644+0000 7fc340dfd640 1 --2- 172.21.15.142:0/2581987333 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc33c108cf0 0x7fc33c10f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:00.659 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:39:00.644+0000 7fc340dfd640 1 --2- 172.21.15.142:0/2581987333 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc33c1083a0 0x7fc33c1087b0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:00.659 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:39:00.644+0000 7fc340dfd640 1 --2- 172.21.15.142:0/2581987333 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc33c102a60 0x7fc33c102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:00.659 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:39:00.644+0000 7fc340dfd640 1 -- 172.21.15.142:0/2581987333 >> 172.21.15.142:0/2581987333 conn(0x7fc33c079730 msgr2=0x7fc33c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:39:00.659 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:39:00.644+0000 7fc340dfd640 1 -- 172.21.15.142:0/2581987333 shutdown_connections 2024-09-21T01:39:00.659 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:39:00.644+0000 7fc340dfd640 1 -- 172.21.15.142:0/2581987333 wait complete. 2024-09-21T01:39:00.659 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:39:00.645+0000 7fc340dfd640 1 Processor -- start 2024-09-21T01:39:00.659 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:39:00.645+0000 7fc340dfd640 1 -- start start 2024-09-21T01:39:00.659 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:39:00.645+0000 7fc340dfd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc33c102a60 0x7fc33c19a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:39:00.659 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:39:00.645+0000 7fc340dfd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc33c1083a0 0x7fc33c19a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:39:00.660 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:39:00.645+0000 7fc340dfd640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc33c108cf0 0x7fc33c19fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:39:00.660 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:39:00.645+0000 7fc340dfd640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fc33c112850 con 0x7fc33c102a60 2024-09-21T01:39:00.660 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:39:00.645+0000 7fc340dfd640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fc33c1126d0 con 0x7fc33c1083a0 2024-09-21T01:39:00.660 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:39:00.645+0000 7fc340dfd640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fc33c1129d0 con 0x7fc33c108cf0 2024-09-21T01:39:00.660 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:39:00.645+0000 7fc33ad9d640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc33c108cf0 0x7fc33c19fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:39:00.660 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:39:00.645+0000 7fc33ad9d640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc33c108cf0 0x7fc33c19fc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:49496/0 (socket says 172.21.15.142:49496) 2024-09-21T01:39:00.660 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:39:00.645+0000 7fc33ad9d640 1 -- 172.21.15.142:0/2801511992 learned_addr learned my addr 172.21.15.142:0/2801511992 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-09-21T01:39:00.660 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:39:00.645+0000 7fc339d9b640 1 --2- 172.21.15.142:0/2801511992 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc33c1083a0 0x7fc33c19a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:39:00.660 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:39:00.645+0000 7fc33a59c640 1 --2- 172.21.15.142:0/2801511992 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc33c102a60 0x7fc33c19a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:39:00.660 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:39:00.646+0000 7fc33ad9d640 1 -- 172.21.15.142:0/2801511992 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc33c1083a0 msgr2=0x7fc33c19a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:39:00.660 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:39:00.646+0000 7fc33ad9d640 1 --2- 172.21.15.142:0/2801511992 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc33c1083a0 0x7fc33c19a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:00.660 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:39:00.646+0000 7fc33ad9d640 1 -- 172.21.15.142:0/2801511992 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc33c102a60 msgr2=0x7fc33c19a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:39:00.660 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:39:00.646+0000 7fc33ad9d640 1 --2- 172.21.15.142:0/2801511992 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc33c102a60 0x7fc33c19a3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:00.661 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:39:00.646+0000 7fc33ad9d640 1 -- 172.21.15.142:0/2801511992 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc33c1a02a0 con 0x7fc33c108cf0 2024-09-21T01:39:00.661 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:39:00.646+0000 7fc33ad9d640 1 --2- 172.21.15.142:0/2801511992 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc33c108cf0 0x7fc33c19fc30 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fc33400b970 tx=0x7fc33400be30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:39:00.661 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:39:00.646+0000 7fc32b7fe640 1 -- 172.21.15.142:0/2801511992 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc334019070 con 0x7fc33c108cf0 2024-09-21T01:39:00.661 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:39:00.646+0000 7fc32b7fe640 1 -- 172.21.15.142:0/2801511992 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc334014440 con 0x7fc33c108cf0 2024-09-21T01:39:00.661 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:39:00.646+0000 7fc340dfd640 1 -- 172.21.15.142:0/2801511992 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc33c1a0590 con 0x7fc33c108cf0 2024-09-21T01:39:00.661 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:39:00.646+0000 7fc32b7fe640 1 -- 172.21.15.142:0/2801511992 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3340075d0 con 0x7fc33c108cf0 2024-09-21T01:39:00.661 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:39:00.646+0000 7fc340dfd640 1 -- 172.21.15.142:0/2801511992 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc33c1a6db0 con 0x7fc33c108cf0 2024-09-21T01:39:00.661 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:39:00.647+0000 7fc340dfd640 1 -- 172.21.15.142:0/2801511992 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc33c102e70 con 0x7fc33c108cf0 2024-09-21T01:39:00.661 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:39:00.649+0000 7fc32b7fe640 1 -- 172.21.15.142:0/2801511992 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 20) ==== 154529+0+0 (secure 0 0 0) 0x7fc33401c070 con 0x7fc33c108cf0 2024-09-21T01:39:00.661 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:39:00.649+0000 7fc32b7fe640 1 --2- 172.21.15.142:0/2801511992 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fc3240b6610 0x7fc3240b8b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:39:00.661 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:39:00.649+0000 7fc32b7fe640 1 -- 172.21.15.142:0/2801511992 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7342+0+0 (secure 0 0 0) 0x7fc3340e6350 con 0x7fc33c108cf0 2024-09-21T01:39:00.661 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:39:00.650+0000 7fc33a59c640 1 --2- 172.21.15.142:0/2801511992 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fc3240b6610 0x7fc3240b8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:39:00.661 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:39:00.650+0000 7fc33a59c640 1 --2- 172.21.15.142:0/2801511992 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fc3240b6610 0x7fc3240b8b20 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fc32c005e10 tx=0x7fc32c005da0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:39:00.661 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:39:00.654+0000 7fc32b7fe640 1 -- 172.21.15.142:0/2801511992 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc3340b1390 con 0x7fc33c108cf0 2024-09-21T01:39:00.843 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:39:00.842+0000 7fc340dfd640 1 -- 172.21.15.142:0/2801511992 --> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi083=a;smithi083=d;smithi083=g;smithi083=j;smithi119=b;smithi119=e;smithi119=h;smithi119=k;smithi142=c;smithi142=f;smithi142=i;smithi142=l", "target": ["mon-mgr", ""]}) -- 0x7fc33c10bb20 con 0x7fc3240b6610 2024-09-21T01:39:00.851 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:39:00.851+0000 7fc32b7fe640 1 -- 172.21.15.142:0/2801511992 <== mgr.14223 v2:172.21.15.83:6800/1748483157 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7fc33c10bb20 con 0x7fc3240b6610 2024-09-21T01:39:00.851 INFO:teuthology.orchestra.run.smithi142.stdout:Scheduled mds.all update... 2024-09-21T01:39:00.854 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:39:00.853+0000 7fc340dfd640 1 -- 172.21.15.142:0/2801511992 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fc3240b6610 msgr2=0x7fc3240b8b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:39:00.854 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:39:00.853+0000 7fc340dfd640 1 --2- 172.21.15.142:0/2801511992 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fc3240b6610 0x7fc3240b8b20 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fc32c005e10 tx=0x7fc32c005da0 comp rx=0 tx=0).stop 2024-09-21T01:39:00.854 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:39:00.853+0000 7fc340dfd640 1 -- 172.21.15.142:0/2801511992 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc33c108cf0 msgr2=0x7fc33c19fc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:39:00.854 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:39:00.853+0000 7fc340dfd640 1 --2- 172.21.15.142:0/2801511992 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc33c108cf0 0x7fc33c19fc30 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fc33400b970 tx=0x7fc33400be30 comp rx=0 tx=0).stop 2024-09-21T01:39:00.854 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:39:00.853+0000 7fc340dfd640 1 -- 172.21.15.142:0/2801511992 shutdown_connections 2024-09-21T01:39:00.854 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:39:00.853+0000 7fc340dfd640 1 --2- 172.21.15.142:0/2801511992 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fc3240b6610 0x7fc3240b8b20 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:00.854 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:39:00.853+0000 7fc340dfd640 1 --2- 172.21.15.142:0/2801511992 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc33c108cf0 0x7fc33c19fc30 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:00.854 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:39:00.853+0000 7fc340dfd640 1 --2- 172.21.15.142:0/2801511992 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc33c1083a0 0x7fc33c19a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:00.854 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:39:00.853+0000 7fc340dfd640 1 --2- 172.21.15.142:0/2801511992 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc33c102a60 0x7fc33c19a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:00.854 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:39:00.853+0000 7fc340dfd640 1 -- 172.21.15.142:0/2801511992 >> 172.21.15.142:0/2801511992 conn(0x7fc33c079730 msgr2=0x7fc33c06b2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:39:00.855 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:39:00.853+0000 7fc340dfd640 1 -- 172.21.15.142:0/2801511992 shutdown_connections 2024-09-21T01:39:00.855 INFO:teuthology.orchestra.run.smithi142.stderr:2024-09-21T01:39:00.854+0000 7fc340dfd640 1 -- 172.21.15.142:0/2801511992 wait complete. 2024-09-21T01:39:01.541 DEBUG:teuthology.orchestra.run.smithi083:mds.a> sudo journalctl -f -n 0 -u ceph-f7697ecc-77b8-11ef-baf5-efdc52797490@mds.a.service 2024-09-21T01:39:01.543 DEBUG:teuthology.orchestra.run.smithi083:mds.d> sudo journalctl -f -n 0 -u ceph-f7697ecc-77b8-11ef-baf5-efdc52797490@mds.d.service 2024-09-21T01:39:01.586 DEBUG:teuthology.orchestra.run.smithi083:mds.g> sudo journalctl -f -n 0 -u ceph-f7697ecc-77b8-11ef-baf5-efdc52797490@mds.g.service 2024-09-21T01:39:01.629 DEBUG:teuthology.orchestra.run.smithi083:mds.j> sudo journalctl -f -n 0 -u ceph-f7697ecc-77b8-11ef-baf5-efdc52797490@mds.j.service 2024-09-21T01:39:01.672 DEBUG:teuthology.orchestra.run.smithi119:mds.b> sudo journalctl -f -n 0 -u ceph-f7697ecc-77b8-11ef-baf5-efdc52797490@mds.b.service 2024-09-21T01:39:01.675 DEBUG:teuthology.orchestra.run.smithi119:mds.e> sudo journalctl -f -n 0 -u ceph-f7697ecc-77b8-11ef-baf5-efdc52797490@mds.e.service 2024-09-21T01:39:01.718 DEBUG:teuthology.orchestra.run.smithi119:mds.h> sudo journalctl -f -n 0 -u ceph-f7697ecc-77b8-11ef-baf5-efdc52797490@mds.h.service 2024-09-21T01:39:01.761 DEBUG:teuthology.orchestra.run.smithi119:mds.k> sudo journalctl -f -n 0 -u ceph-f7697ecc-77b8-11ef-baf5-efdc52797490@mds.k.service 2024-09-21T01:39:01.804 DEBUG:teuthology.orchestra.run.smithi142:mds.c> sudo journalctl -f -n 0 -u ceph-f7697ecc-77b8-11ef-baf5-efdc52797490@mds.c.service 2024-09-21T01:39:01.806 DEBUG:teuthology.orchestra.run.smithi142:mds.f> sudo journalctl -f -n 0 -u ceph-f7697ecc-77b8-11ef-baf5-efdc52797490@mds.f.service 2024-09-21T01:39:01.850 DEBUG:teuthology.orchestra.run.smithi142:mds.i> sudo journalctl -f -n 0 -u ceph-f7697ecc-77b8-11ef-baf5-efdc52797490@mds.i.service 2024-09-21T01:39:01.893 DEBUG:teuthology.orchestra.run.smithi142:mds.l> sudo journalctl -f -n 0 -u ceph-f7697ecc-77b8-11ef-baf5-efdc52797490@mds.l.service 2024-09-21T01:39:01.936 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-09-21T01:39:01.936 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T01:39:01.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:01 smithi119 ceph-mon[33693]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:39:01.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:01 smithi119 ceph-mon[33693]: from='client.24568 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi083=a;smithi083=d;smithi083=g;smithi083=j;smithi119=b;smithi119=e;smithi119=h;smithi119=k;smithi142=c;smithi142=f;smithi142=i;smithi142=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:39:01.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:01 smithi119 ceph-mon[33693]: Saving service mds.all spec with placement smithi083=a;smithi083=d;smithi083=g;smithi083=j;smithi119=b;smithi119=e;smithi119=h;smithi119=k;smithi142=c;smithi142=f;smithi142=i;smithi142=l;count:12 2024-09-21T01:39:01.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:01 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:39:01.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:01 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:39:01.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:01 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:39:01.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:01 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:39:01.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:01 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:39:01.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:01 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T01:39:01.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:01 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T01:39:01.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:01 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:39:02.185 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:39:02.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:01 smithi142 ceph-mon[34050]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:39:02.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:01 smithi142 ceph-mon[34050]: from='client.24568 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi083=a;smithi083=d;smithi083=g;smithi083=j;smithi119=b;smithi119=e;smithi119=h;smithi119=k;smithi142=c;smithi142=f;smithi142=i;smithi142=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:39:02.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:01 smithi142 ceph-mon[34050]: Saving service mds.all spec with placement smithi083=a;smithi083=d;smithi083=g;smithi083=j;smithi119=b;smithi119=e;smithi119=h;smithi119=k;smithi142=c;smithi142=f;smithi142=i;smithi142=l;count:12 2024-09-21T01:39:02.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:01 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:39:02.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:01 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:39:02.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:01 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:39:02.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:01 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:39:02.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:01 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:39:02.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:01 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T01:39:02.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:01 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T01:39:02.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:01 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:39:02.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:01 smithi083 ceph-mon[31370]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:39:02.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:01 smithi083 ceph-mon[31370]: from='client.24568 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi083=a;smithi083=d;smithi083=g;smithi083=j;smithi119=b;smithi119=e;smithi119=h;smithi119=k;smithi142=c;smithi142=f;smithi142=i;smithi142=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:39:02.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:01 smithi083 ceph-mon[31370]: Saving service mds.all spec with placement smithi083=a;smithi083=d;smithi083=g;smithi083=j;smithi119=b;smithi119=e;smithi119=h;smithi119=k;smithi142=c;smithi142=f;smithi142=i;smithi142=l;count:12 2024-09-21T01:39:02.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:01 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:39:02.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:01 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:39:02.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:01 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:39:02.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:01 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:39:02.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:01 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:39:02.305 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:01 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T01:39:02.305 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:01 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T01:39:02.305 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:01 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:39:02.726 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:02.699+0000 7f4d4e932640 1 -- 172.21.15.83:0/3834842699 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4d481083c0 msgr2=0x7f4d481087d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:39:02.726 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:02.699+0000 7f4d4e932640 1 --2- 172.21.15.83:0/3834842699 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4d481083c0 0x7f4d481087d0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f4d3c009900 tx=0x7f4d3c02a410 comp rx=0 tx=0).stop 2024-09-21T01:39:02.726 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:02.699+0000 7f4d4e932640 1 -- 172.21.15.83:0/3834842699 shutdown_connections 2024-09-21T01:39:02.726 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:02.699+0000 7f4d4e932640 1 --2- 172.21.15.83:0/3834842699 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4d48108d10 0x7f4d4810f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:02.726 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:02.699+0000 7f4d4e932640 1 --2- 172.21.15.83:0/3834842699 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4d481083c0 0x7f4d481087d0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:02.727 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:02.699+0000 7f4d4e932640 1 --2- 172.21.15.83:0/3834842699 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4d48102a80 0x7f4d48102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:02.727 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:02.699+0000 7f4d4e932640 1 -- 172.21.15.83:0/3834842699 >> 172.21.15.83:0/3834842699 conn(0x7f4d48079740 msgr2=0x7f4d48079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:39:02.727 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:02.699+0000 7f4d4e932640 1 -- 172.21.15.83:0/3834842699 shutdown_connections 2024-09-21T01:39:02.727 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:02.699+0000 7f4d4e932640 1 -- 172.21.15.83:0/3834842699 wait complete. 2024-09-21T01:39:02.727 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:02.700+0000 7f4d4e932640 1 Processor -- start 2024-09-21T01:39:02.727 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:02.700+0000 7f4d4e932640 1 -- start start 2024-09-21T01:39:02.727 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:02.700+0000 7f4d4e932640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4d48102a80 0x7f4d4819a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:39:02.727 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:02.700+0000 7f4d4e932640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4d481083c0 0x7f4d4819a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:39:02.727 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:02.700+0000 7f4d4e932640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4d48108d10 0x7f4d4819fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:39:02.728 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:02.700+0000 7f4d4e932640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f4d48112830 con 0x7f4d48102a80 2024-09-21T01:39:02.728 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:02.700+0000 7f4d4e932640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f4d481126b0 con 0x7f4d48108d10 2024-09-21T01:39:02.728 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:02.700+0000 7f4d4e932640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f4d481129b0 con 0x7f4d481083c0 2024-09-21T01:39:02.728 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:02.700+0000 7f4d47fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4d48102a80 0x7f4d4819a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:39:02.728 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:02.700+0000 7f4d47fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4d48102a80 0x7f4d4819a3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:52566/0 (socket says 172.21.15.83:52566) 2024-09-21T01:39:02.728 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:02.700+0000 7f4d47fff640 1 -- 172.21.15.83:0/4033725620 learned_addr learned my addr 172.21.15.83:0/4033725620 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:39:02.728 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:02.700+0000 7f4d477fe640 1 --2- 172.21.15.83:0/4033725620 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4d481083c0 0x7f4d4819a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:39:02.728 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:02.700+0000 7f4d4cecf640 1 --2- 172.21.15.83:0/4033725620 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4d48108d10 0x7f4d4819fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:39:02.728 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:02.701+0000 7f4d47fff640 1 -- 172.21.15.83:0/4033725620 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4d481083c0 msgr2=0x7f4d4819a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:39:02.728 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:02.701+0000 7f4d47fff640 1 --2- 172.21.15.83:0/4033725620 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4d481083c0 0x7f4d4819a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:02.728 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:02.701+0000 7f4d47fff640 1 -- 172.21.15.83:0/4033725620 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4d48108d10 msgr2=0x7f4d4819fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:39:02.729 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:02.701+0000 7f4d47fff640 1 --2- 172.21.15.83:0/4033725620 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4d48108d10 0x7f4d4819fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:02.729 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:02.701+0000 7f4d47fff640 1 -- 172.21.15.83:0/4033725620 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d481a0360 con 0x7f4d48102a80 2024-09-21T01:39:02.729 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:02.701+0000 7f4d4cecf640 1 --2- 172.21.15.83:0/4033725620 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4d48108d10 0x7f4d4819fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:39:02.729 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:02.701+0000 7f4d47fff640 1 --2- 172.21.15.83:0/4033725620 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4d48102a80 0x7f4d4819a3f0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f4d3800c890 tx=0x7f4d3800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:39:02.729 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:02.701+0000 7f4d457fa640 1 -- 172.21.15.83:0/4033725620 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d38004220 con 0x7f4d48102a80 2024-09-21T01:39:02.729 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:02.701+0000 7f4d4e932640 1 -- 172.21.15.83:0/4033725620 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d481a0650 con 0x7f4d48102a80 2024-09-21T01:39:02.729 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:02.701+0000 7f4d457fa640 1 -- 172.21.15.83:0/4033725620 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4d38007e40 con 0x7f4d48102a80 2024-09-21T01:39:02.729 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:02.701+0000 7f4d457fa640 1 -- 172.21.15.83:0/4033725620 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d38004a00 con 0x7f4d48102a80 2024-09-21T01:39:02.729 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:02.701+0000 7f4d4e932640 1 -- 172.21.15.83:0/4033725620 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d481a6db0 con 0x7f4d48102a80 2024-09-21T01:39:02.729 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:02.702+0000 7f4d4e932640 1 -- 172.21.15.83:0/4033725620 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d48103d00 con 0x7f4d48102a80 2024-09-21T01:39:02.730 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:02.703+0000 7f4d457fa640 1 -- 172.21.15.83:0/4033725620 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 20) ==== 154529+0+0 (secure 0 0 0) 0x7f4d380079b0 con 0x7f4d48102a80 2024-09-21T01:39:02.730 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:02.704+0000 7f4d457fa640 1 --2- 172.21.15.83:0/4033725620 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f4d300b6560 0x7f4d300b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:39:02.730 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:02.704+0000 7f4d477fe640 1 --2- 172.21.15.83:0/4033725620 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f4d300b6560 0x7f4d300b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:39:02.730 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:02.704+0000 7f4d457fa640 1 -- 172.21.15.83:0/4033725620 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7342+0+0 (secure 0 0 0) 0x7f4d380e70c0 con 0x7f4d48102a80 2024-09-21T01:39:02.730 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:02.705+0000 7f4d477fe640 1 --2- 172.21.15.83:0/4033725620 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f4d300b6560 0x7f4d300b8a70 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f4d3c004770 tx=0x7f4d3c0058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:39:02.730 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:02.707+0000 7f4d457fa640 1 -- 172.21.15.83:0/4033725620 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4d38014030 con 0x7f4d48102a80 2024-09-21T01:39:02.923 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:02.923+0000 7f4d4e932640 1 -- 172.21.15.83:0/4033725620 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4d4810bb50 con 0x7f4d48102a80 2024-09-21T01:39:02.924 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:02 smithi083 ceph-mon[31370]: Deploying daemon mds.l on smithi142 2024-09-21T01:39:02.924 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:02.923+0000 7f4d457fa640 1 -- 172.21.15.83:0/4033725620 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+611 (secure 0 0 0) 0x7f4d380add20 con 0x7f4d48102a80 2024-09-21T01:39:02.924 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T01:39:02.924 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":1,"btime":"2024-09-21T01:31:22:250084+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-09-21T01:39:02.925 INFO:teuthology.orchestra.run.smithi083.stderr:dumped fsmap epoch 1 2024-09-21T01:39:02.926 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:02.926+0000 7f4d4e932640 1 -- 172.21.15.83:0/4033725620 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f4d300b6560 msgr2=0x7f4d300b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:39:02.926 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:02.926+0000 7f4d4e932640 1 --2- 172.21.15.83:0/4033725620 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f4d300b6560 0x7f4d300b8a70 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f4d3c004770 tx=0x7f4d3c0058d0 comp rx=0 tx=0).stop 2024-09-21T01:39:02.927 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:02.926+0000 7f4d4e932640 1 -- 172.21.15.83:0/4033725620 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4d48102a80 msgr2=0x7f4d4819a3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:39:02.927 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:02.926+0000 7f4d4e932640 1 --2- 172.21.15.83:0/4033725620 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4d48102a80 0x7f4d4819a3f0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f4d3800c890 tx=0x7f4d3800cd50 comp rx=0 tx=0).stop 2024-09-21T01:39:02.927 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:02.926+0000 7f4d4e932640 1 -- 172.21.15.83:0/4033725620 shutdown_connections 2024-09-21T01:39:02.927 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:02.926+0000 7f4d4e932640 1 --2- 172.21.15.83:0/4033725620 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f4d300b6560 0x7f4d300b8a70 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:02.927 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:02.926+0000 7f4d4e932640 1 --2- 172.21.15.83:0/4033725620 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4d48108d10 0x7f4d4819fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:02.927 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:02.926+0000 7f4d4e932640 1 --2- 172.21.15.83:0/4033725620 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4d481083c0 0x7f4d4819a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:02.927 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:02.926+0000 7f4d4e932640 1 --2- 172.21.15.83:0/4033725620 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4d48102a80 0x7f4d4819a3f0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:02.927 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:02.926+0000 7f4d4e932640 1 -- 172.21.15.83:0/4033725620 >> 172.21.15.83:0/4033725620 conn(0x7f4d48079740 msgr2=0x7f4d4806c010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:39:02.927 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:02.926+0000 7f4d4e932640 1 -- 172.21.15.83:0/4033725620 shutdown_connections 2024-09-21T01:39:02.927 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:02.926+0000 7f4d4e932640 1 -- 172.21.15.83:0/4033725620 wait complete. 2024-09-21T01:39:02.995 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:02 smithi142 ceph-mon[34050]: Deploying daemon mds.l on smithi142 2024-09-21T01:39:03.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:02 smithi119 ceph-mon[33693]: Deploying daemon mds.l on smithi142 2024-09-21T01:39:03.378 INFO:journalctl@ceph.mds.l.smithi142.stdout:Sep 21 01:39:03 smithi142 systemd[1]: Starting Ceph mds.l for f7697ecc-77b8-11ef-baf5-efdc52797490... 2024-09-21T01:39:03.650 INFO:journalctl@ceph.mds.l.smithi142.stdout:Sep 21 01:39:03 smithi142 podman[62972]: 2024-09-21 01:39:03.280523978 +0000 UTC m=+0.015884838 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T01:39:03.650 INFO:journalctl@ceph.mds.l.smithi142.stdout:Sep 21 01:39:03 smithi142 podman[62972]: 2024-09-21 01:39:03.398997056 +0000 UTC m=+0.134357953 container create 884e269293142c40a9fca2720d5c02f5a42d2249855542d912046cd83fe735b5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mds-l, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T01:39:03.650 INFO:journalctl@ceph.mds.l.smithi142.stdout:Sep 21 01:39:03 smithi142 podman[62972]: 2024-09-21 01:39:03.648439862 +0000 UTC m=+0.383800718 container init 884e269293142c40a9fca2720d5c02f5a42d2249855542d912046cd83fe735b5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mds-l, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, ceph=True) 2024-09-21T01:39:03.964 INFO:journalctl@ceph.mds.l.smithi142.stdout:Sep 21 01:39:03 smithi142 podman[62972]: 2024-09-21 01:39:03.651267114 +0000 UTC m=+0.386627968 container start 884e269293142c40a9fca2720d5c02f5a42d2249855542d912046cd83fe735b5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mds-l, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-09-21T01:39:03.964 INFO:journalctl@ceph.mds.l.smithi142.stdout:Sep 21 01:39:03 smithi142 ceph-mds[62991]: -- 172.21.15.142:0/1381233426 <== mon.1 v2:172.21.15.142:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55afea043860 con 0x55afee1eb600 2024-09-21T01:39:03.965 INFO:journalctl@ceph.mds.l.smithi142.stdout:Sep 21 01:39:03 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mds-l[62987]: starting mds.l at 2024-09-21T01:39:03.965 INFO:journalctl@ceph.mds.l.smithi142.stdout:Sep 21 01:39:03 smithi142 bash[62972]: 884e269293142c40a9fca2720d5c02f5a42d2249855542d912046cd83fe735b5 2024-09-21T01:39:03.965 INFO:journalctl@ceph.mds.l.smithi142.stdout:Sep 21 01:39:03 smithi142 systemd[1]: Started Ceph mds.l for f7697ecc-77b8-11ef-baf5-efdc52797490. 2024-09-21T01:39:03.965 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:03 smithi142 ceph-mon[34050]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:39:03.965 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:03 smithi142 ceph-mon[34050]: from='client.? 172.21.15.83:0/4033725620' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:39:03.965 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:03 smithi142 ceph-mon[34050]: mds.? [v2:172.21.15.142:6832/2841606990,v1:172.21.15.142:6833/2841606990] up:boot 2024-09-21T01:39:03.965 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:03 smithi142 ceph-mon[34050]: fsmap 1 up:standby 2024-09-21T01:39:03.965 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:03 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-09-21T01:39:03.965 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:03 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:39:03.965 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:03 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:39:03.965 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:03 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:39:03.966 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:03 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T01:39:03.966 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:03 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T01:39:03.966 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:03 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:39:03.967 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:03 smithi119 ceph-mon[33693]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:39:03.967 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:03 smithi119 ceph-mon[33693]: from='client.? 172.21.15.83:0/4033725620' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:39:03.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:03 smithi119 ceph-mon[33693]: mds.? [v2:172.21.15.142:6832/2841606990,v1:172.21.15.142:6833/2841606990] up:boot 2024-09-21T01:39:03.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:03 smithi119 ceph-mon[33693]: fsmap 1 up:standby 2024-09-21T01:39:03.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:03 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-09-21T01:39:03.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:03 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:39:03.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:03 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:39:03.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:03 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:39:03.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:03 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T01:39:03.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:03 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T01:39:03.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:03 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:39:04.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:03 smithi083 ceph-mon[31370]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:39:04.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:03 smithi083 ceph-mon[31370]: from='client.? 172.21.15.83:0/4033725620' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:39:04.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:03 smithi083 ceph-mon[31370]: mds.? [v2:172.21.15.142:6832/2841606990,v1:172.21.15.142:6833/2841606990] up:boot 2024-09-21T01:39:04.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:03 smithi083 ceph-mon[31370]: fsmap 1 up:standby 2024-09-21T01:39:04.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:03 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-09-21T01:39:04.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:03 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:39:04.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:03 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:39:04.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:03 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:39:04.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:03 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T01:39:04.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:03 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T01:39:04.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:03 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:39:05.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:04 smithi142 ceph-mon[34050]: Deploying daemon mds.k on smithi119 2024-09-21T01:39:05.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:04 smithi142 ceph-mon[34050]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:39:05.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:04 smithi119 ceph-mon[33693]: Deploying daemon mds.k on smithi119 2024-09-21T01:39:05.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:04 smithi119 ceph-mon[33693]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:39:05.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:04 smithi083 ceph-mon[31370]: Deploying daemon mds.k on smithi119 2024-09-21T01:39:05.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:04 smithi083 ceph-mon[31370]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:39:05.684 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T01:39:05.941 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:39:05.965 INFO:journalctl@ceph.mds.k.smithi119.stdout:Sep 21 01:39:05 smithi119 systemd[1]: Starting Ceph mds.k for f7697ecc-77b8-11ef-baf5-efdc52797490... 2024-09-21T01:39:06.217 INFO:journalctl@ceph.mds.k.smithi119.stdout:Sep 21 01:39:05 smithi119 podman[62067]: 2024-09-21 01:39:05.867287348 +0000 UTC m=+0.016023799 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T01:39:06.218 INFO:journalctl@ceph.mds.k.smithi119.stdout:Sep 21 01:39:05 smithi119 podman[62067]: 2024-09-21 01:39:05.984844959 +0000 UTC m=+0.133581400 container create cba2f40bb2335a07e732bdbe6decac242985d16970f89abb1d19b149cb039b1d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mds-k, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731) 2024-09-21T01:39:06.501 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:06.477+0000 7f9dfbe58640 1 -- 172.21.15.83:0/891003228 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9df4102ae0 msgr2=0x7f9df4102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:39:06.502 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:06.477+0000 7f9dfbe58640 1 --2- 172.21.15.83:0/891003228 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9df4102ae0 0x7f9df4102ef0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f9df0009900 tx=0x7f9df002a410 comp rx=0 tx=0).stop 2024-09-21T01:39:06.502 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:06.477+0000 7f9dfbe58640 1 -- 172.21.15.83:0/891003228 shutdown_connections 2024-09-21T01:39:06.502 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:06.477+0000 7f9dfbe58640 1 --2- 172.21.15.83:0/891003228 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9df4108d20 0x7f9df410f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:06.502 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:06.477+0000 7f9dfbe58640 1 --2- 172.21.15.83:0/891003228 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9df41083d0 0x7f9df41087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:06.502 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:06.477+0000 7f9dfbe58640 1 --2- 172.21.15.83:0/891003228 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9df4102ae0 0x7f9df4102ef0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:06.502 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:06.477+0000 7f9dfbe58640 1 -- 172.21.15.83:0/891003228 >> 172.21.15.83:0/891003228 conn(0x7f9df4079790 msgr2=0x7f9df4079ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:39:06.502 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:06.477+0000 7f9dfbe58640 1 -- 172.21.15.83:0/891003228 shutdown_connections 2024-09-21T01:39:06.502 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:06.477+0000 7f9dfbe58640 1 -- 172.21.15.83:0/891003228 wait complete. 2024-09-21T01:39:06.502 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:06.477+0000 7f9dfbe58640 1 Processor -- start 2024-09-21T01:39:06.502 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:06.477+0000 7f9dfbe58640 1 -- start start 2024-09-21T01:39:06.502 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:06.478+0000 7f9dfbe58640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9df4102ae0 0x7f9df419a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:39:06.502 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:06.478+0000 7f9dfbe58640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9df41083d0 0x7f9df419aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:39:06.503 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:06.478+0000 7f9dfbe58640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9df4108d20 0x7f9df419fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:39:06.503 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:06.478+0000 7f9dfbe58640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f9df4112890 con 0x7f9df41083d0 2024-09-21T01:39:06.503 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:06.478+0000 7f9dfbe58640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f9df4112710 con 0x7f9df4102ae0 2024-09-21T01:39:06.503 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:06.478+0000 7f9dfbe58640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f9df4112a10 con 0x7f9df4108d20 2024-09-21T01:39:06.503 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:06.478+0000 7f9df93f3640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9df41083d0 0x7f9df419aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:39:06.503 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:06.478+0000 7f9df93f3640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9df41083d0 0x7f9df419aa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:33210/0 (socket says 172.21.15.83:33210) 2024-09-21T01:39:06.503 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:06.478+0000 7f9df93f3640 1 -- 172.21.15.83:0/1366063148 learned_addr learned my addr 172.21.15.83:0/1366063148 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:39:06.503 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:06.478+0000 7f9dfa3f5640 1 --2- 172.21.15.83:0/1366063148 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9df4108d20 0x7f9df419fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:39:06.503 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:06.478+0000 7f9df9bf4640 1 --2- 172.21.15.83:0/1366063148 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9df4102ae0 0x7f9df419a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:39:06.503 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:06.478+0000 7f9df93f3640 1 -- 172.21.15.83:0/1366063148 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9df4108d20 msgr2=0x7f9df419fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:39:06.503 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:06.478+0000 7f9df93f3640 1 --2- 172.21.15.83:0/1366063148 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9df4108d20 0x7f9df419fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:06.503 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:06.478+0000 7f9df93f3640 1 -- 172.21.15.83:0/1366063148 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9df4102ae0 msgr2=0x7f9df419a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:39:06.503 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:06.478+0000 7f9df93f3640 1 --2- 172.21.15.83:0/1366063148 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9df4102ae0 0x7f9df419a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:06.503 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:06.478+0000 7f9df93f3640 1 -- 172.21.15.83:0/1366063148 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9df41a0400 con 0x7f9df41083d0 2024-09-21T01:39:06.503 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:06.478+0000 7f9df93f3640 1 --2- 172.21.15.83:0/1366063148 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9df41083d0 0x7f9df419aa30 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f9de400d740 tx=0x7f9de400dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:39:06.503 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:06.478+0000 7f9deaffd640 1 -- 172.21.15.83:0/1366063148 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9de4017070 con 0x7f9df41083d0 2024-09-21T01:39:06.504 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:06.479+0000 7f9dfbe58640 1 -- 172.21.15.83:0/1366063148 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9df41a06f0 con 0x7f9df41083d0 2024-09-21T01:39:06.504 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:06.479+0000 7f9deaffd640 1 -- 172.21.15.83:0/1366063148 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9de400de50 con 0x7f9df41083d0 2024-09-21T01:39:06.504 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:06.479+0000 7f9deaffd640 1 -- 172.21.15.83:0/1366063148 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9de400f620 con 0x7f9df41083d0 2024-09-21T01:39:06.504 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:06.479+0000 7f9dfbe58640 1 -- 172.21.15.83:0/1366063148 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9df41a6e50 con 0x7f9df41083d0 2024-09-21T01:39:06.504 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:06.480+0000 7f9dfbe58640 1 -- 172.21.15.83:0/1366063148 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9df4102ef0 con 0x7f9df41083d0 2024-09-21T01:39:06.504 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:06.481+0000 7f9deaffd640 1 -- 172.21.15.83:0/1366063148 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 20) ==== 154529+0+0 (secure 0 0 0) 0x7f9de401a070 con 0x7f9df41083d0 2024-09-21T01:39:06.504 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:06.482+0000 7f9deaffd640 1 --2- 172.21.15.83:0/1366063148 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f9de00b6560 0x7f9de00b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:39:06.504 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:06.482+0000 7f9df9bf4640 1 --2- 172.21.15.83:0/1366063148 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f9de00b6560 0x7f9de00b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:39:06.504 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:06.482+0000 7f9deaffd640 1 -- 172.21.15.83:0/1366063148 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7342+0+0 (secure 0 0 0) 0x7f9de40e6910 con 0x7f9df41083d0 2024-09-21T01:39:06.504 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:06.482+0000 7f9df9bf4640 1 --2- 172.21.15.83:0/1366063148 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f9de00b6560 0x7f9de00b8a70 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f9df00057c0 tx=0x7f9df00058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:39:06.504 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:06.486+0000 7f9deaffd640 1 -- 172.21.15.83:0/1366063148 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f9de40b1950 con 0x7f9df41083d0 2024-09-21T01:39:06.718 INFO:journalctl@ceph.mds.k.smithi119.stdout:Sep 21 01:39:06 smithi119 podman[62067]: 2024-09-21 01:39:06.220796745 +0000 UTC m=+0.369533191 container init cba2f40bb2335a07e732bdbe6decac242985d16970f89abb1d19b149cb039b1d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mds-k, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-09-21T01:39:06.718 INFO:journalctl@ceph.mds.k.smithi119.stdout:Sep 21 01:39:06 smithi119 podman[62067]: 2024-09-21 01:39:06.224620763 +0000 UTC m=+0.373357202 container start cba2f40bb2335a07e732bdbe6decac242985d16970f89abb1d19b149cb039b1d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mds-k, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T01:39:06.718 INFO:journalctl@ceph.mds.k.smithi119.stdout:Sep 21 01:39:06 smithi119 ceph-mds[62086]: -- 172.21.15.119:0/963241258 <== mon.2 v2:172.21.15.119:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55d049e4b860 con 0x55d04dff3a80 2024-09-21T01:39:06.718 INFO:journalctl@ceph.mds.k.smithi119.stdout:Sep 21 01:39:06 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mds-k[62082]: starting mds.k at 2024-09-21T01:39:06.718 INFO:journalctl@ceph.mds.k.smithi119.stdout:Sep 21 01:39:06 smithi119 bash[62067]: cba2f40bb2335a07e732bdbe6decac242985d16970f89abb1d19b149cb039b1d 2024-09-21T01:39:06.718 INFO:journalctl@ceph.mds.k.smithi119.stdout:Sep 21 01:39:06 smithi119 systemd[1]: Started Ceph mds.k for f7697ecc-77b8-11ef-baf5-efdc52797490. 2024-09-21T01:39:06.719 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:06.717+0000 7f9dfbe58640 1 -- 172.21.15.83:0/1366063148 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9df410b570 con 0x7f9df41083d0 2024-09-21T01:39:06.719 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:06.718+0000 7f9deaffd640 1 -- 172.21.15.83:0/1366063148 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+2266 (secure 0 0 0) 0x7f9de40b6890 con 0x7f9df41083d0 2024-09-21T01:39:06.719 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T01:39:06.719 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":3,"btime":"2024-09-21T01:39:06:312674+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24569,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/2839502433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":2839502433},{"type":"v1","addr":"172.21.15.119:6833","nonce":2839502433}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24580,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6833/2841606990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":2841606990},{"type":"v1","addr":"172.21.15.142:6833","nonce":2841606990}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-21T01:39:06.719 INFO:teuthology.orchestra.run.smithi083.stderr:dumped fsmap epoch 3 2024-09-21T01:39:06.721 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:06.720+0000 7f9dfbe58640 1 -- 172.21.15.83:0/1366063148 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f9de00b6560 msgr2=0x7f9de00b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:39:06.721 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:06.720+0000 7f9dfbe58640 1 --2- 172.21.15.83:0/1366063148 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f9de00b6560 0x7f9de00b8a70 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f9df00057c0 tx=0x7f9df00058d0 comp rx=0 tx=0).stop 2024-09-21T01:39:06.721 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:06.720+0000 7f9dfbe58640 1 -- 172.21.15.83:0/1366063148 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9df41083d0 msgr2=0x7f9df419aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:39:06.721 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:06.720+0000 7f9dfbe58640 1 --2- 172.21.15.83:0/1366063148 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9df41083d0 0x7f9df419aa30 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f9de400d740 tx=0x7f9de400dc00 comp rx=0 tx=0).stop 2024-09-21T01:39:06.721 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:06.720+0000 7f9dfbe58640 1 -- 172.21.15.83:0/1366063148 shutdown_connections 2024-09-21T01:39:06.721 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:06.720+0000 7f9dfbe58640 1 --2- 172.21.15.83:0/1366063148 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f9de00b6560 0x7f9de00b8a70 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:06.721 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:06.720+0000 7f9dfbe58640 1 --2- 172.21.15.83:0/1366063148 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9df4108d20 0x7f9df419fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:06.721 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:06.720+0000 7f9dfbe58640 1 --2- 172.21.15.83:0/1366063148 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9df41083d0 0x7f9df419aa30 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:06.721 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:06.720+0000 7f9dfbe58640 1 --2- 172.21.15.83:0/1366063148 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9df4102ae0 0x7f9df419a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:06.721 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:06.720+0000 7f9dfbe58640 1 -- 172.21.15.83:0/1366063148 >> 172.21.15.83:0/1366063148 conn(0x7f9df4079790 msgr2=0x7f9df4101be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:39:06.721 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:06.720+0000 7f9dfbe58640 1 -- 172.21.15.83:0/1366063148 shutdown_connections 2024-09-21T01:39:06.721 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:06.720+0000 7f9dfbe58640 1 -- 172.21.15.83:0/1366063148 wait complete. 2024-09-21T01:39:07.554 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:07 smithi083 ceph-mon[31370]: mds.? [v2:172.21.15.119:6832/2839502433,v1:172.21.15.119:6833/2839502433] up:boot 2024-09-21T01:39:07.554 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:07 smithi083 ceph-mon[31370]: fsmap 2 up:standby 2024-09-21T01:39:07.554 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:07 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-09-21T01:39:07.554 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:07 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:39:07.554 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:07 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:39:07.554 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:07 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:39:07.554 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:07 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T01:39:07.554 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:07 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T01:39:07.554 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:07 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:39:07.554 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:07 smithi083 ceph-mon[31370]: Deploying daemon mds.j on smithi083 2024-09-21T01:39:07.554 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:07 smithi083 ceph-mon[31370]: from='client.? 172.21.15.83:0/1366063148' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:39:07.555 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:07 smithi083 ceph-mon[31370]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:39:07.632 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:07 smithi119 ceph-mon[33693]: mds.? [v2:172.21.15.119:6832/2839502433,v1:172.21.15.119:6833/2839502433] up:boot 2024-09-21T01:39:07.632 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:07 smithi119 ceph-mon[33693]: fsmap 2 up:standby 2024-09-21T01:39:07.632 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:07 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-09-21T01:39:07.632 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:07 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:39:07.632 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:07 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:39:07.632 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:07 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:39:07.632 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:07 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T01:39:07.632 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:07 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T01:39:07.632 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:07 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:39:07.632 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:07 smithi119 ceph-mon[33693]: Deploying daemon mds.j on smithi083 2024-09-21T01:39:07.632 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:07 smithi119 ceph-mon[33693]: from='client.? 172.21.15.83:0/1366063148' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:39:07.632 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:07 smithi119 ceph-mon[33693]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:39:07.714 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:07 smithi142 ceph-mon[34050]: mds.? [v2:172.21.15.119:6832/2839502433,v1:172.21.15.119:6833/2839502433] up:boot 2024-09-21T01:39:07.715 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:07 smithi142 ceph-mon[34050]: fsmap 2 up:standby 2024-09-21T01:39:07.715 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:07 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-09-21T01:39:07.715 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:07 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:39:07.715 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:07 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:39:07.715 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:07 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:39:07.715 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:07 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T01:39:07.715 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:07 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T01:39:07.715 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:07 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:39:07.715 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:07 smithi142 ceph-mon[34050]: Deploying daemon mds.j on smithi083 2024-09-21T01:39:07.715 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:07 smithi142 ceph-mon[34050]: from='client.? 172.21.15.83:0/1366063148' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:39:07.715 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:07 smithi142 ceph-mon[34050]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:39:09.304 INFO:journalctl@ceph.mds.j.smithi083.stdout:Sep 21 01:39:09 smithi083 systemd[1]: Starting Ceph mds.j for f7697ecc-77b8-11ef-baf5-efdc52797490... 2024-09-21T01:39:09.623 INFO:journalctl@ceph.mds.j.smithi083.stdout:Sep 21 01:39:09 smithi083 podman[72624]: 2024-09-21 01:39:09.272209796 +0000 UTC m=+0.015704380 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T01:39:09.623 INFO:journalctl@ceph.mds.j.smithi083.stdout:Sep 21 01:39:09 smithi083 podman[72624]: 2024-09-21 01:39:09.378674768 +0000 UTC m=+0.122169383 container create d15b41d88073d285d4ddac8fdd3b07b21d1954a719f2132c33ca76b031920f9b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mds-j, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T01:39:09.699 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T01:39:09.970 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:39:10.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:09 smithi083 ceph-mon[31370]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:39:10.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:09 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:39:10.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:09 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:39:10.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:09 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:39:10.054 INFO:journalctl@ceph.mds.j.smithi083.stdout:Sep 21 01:39:09 smithi083 podman[72624]: 2024-09-21 01:39:09.623427062 +0000 UTC m=+0.366921641 container init d15b41d88073d285d4ddac8fdd3b07b21d1954a719f2132c33ca76b031920f9b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mds-j, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-09-21T01:39:10.054 INFO:journalctl@ceph.mds.j.smithi083.stdout:Sep 21 01:39:09 smithi083 podman[72624]: 2024-09-21 01:39:09.626257299 +0000 UTC m=+0.369751868 container start d15b41d88073d285d4ddac8fdd3b07b21d1954a719f2132c33ca76b031920f9b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mds-j, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T01:39:10.054 INFO:journalctl@ceph.mds.j.smithi083.stdout:Sep 21 01:39:09 smithi083 ceph-mds[72643]: -- 172.21.15.83:0/1016405636 <== mon.0 v2:172.21.15.83:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5565bb9f1860 con 0x5565bfb99600 2024-09-21T01:39:10.054 INFO:journalctl@ceph.mds.j.smithi083.stdout:Sep 21 01:39:09 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mds-j[72639]: starting mds.j at 2024-09-21T01:39:10.054 INFO:journalctl@ceph.mds.j.smithi083.stdout:Sep 21 01:39:09 smithi083 bash[72624]: d15b41d88073d285d4ddac8fdd3b07b21d1954a719f2132c33ca76b031920f9b 2024-09-21T01:39:10.054 INFO:journalctl@ceph.mds.j.smithi083.stdout:Sep 21 01:39:09 smithi083 systemd[1]: Started Ceph mds.j for f7697ecc-77b8-11ef-baf5-efdc52797490. 2024-09-21T01:39:10.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:09 smithi142 ceph-mon[34050]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:39:10.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:09 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:39:10.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:09 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:39:10.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:09 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:39:10.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:09 smithi119 ceph-mon[33693]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:39:10.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:09 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:39:10.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:09 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:39:10.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:09 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:39:10.454 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:10.453+0000 7f2139d15640 1 -- 172.21.15.83:0/2944006986 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2134108cf0 msgr2=0x7f213410f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:39:10.454 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:10.453+0000 7f2139d15640 1 --2- 172.21.15.83:0/2944006986 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2134108cf0 0x7f213410f520 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f212c009ca0 tx=0x7f212c02a8c0 comp rx=0 tx=0).stop 2024-09-21T01:39:10.455 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:10.453+0000 7f2139d15640 1 -- 172.21.15.83:0/2944006986 shutdown_connections 2024-09-21T01:39:10.455 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:10.453+0000 7f2139d15640 1 --2- 172.21.15.83:0/2944006986 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2134108cf0 0x7f213410f520 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:10.455 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:10.453+0000 7f2139d15640 1 --2- 172.21.15.83:0/2944006986 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f21341083a0 0x7f21341087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:10.455 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:10.453+0000 7f2139d15640 1 --2- 172.21.15.83:0/2944006986 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2134102a60 0x7f2134102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:10.455 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:10.453+0000 7f2139d15640 1 -- 172.21.15.83:0/2944006986 >> 172.21.15.83:0/2944006986 conn(0x7f2134079730 msgr2=0x7f2134079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:39:10.455 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:10.453+0000 7f2139d15640 1 -- 172.21.15.83:0/2944006986 shutdown_connections 2024-09-21T01:39:10.455 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:10.453+0000 7f2139d15640 1 -- 172.21.15.83:0/2944006986 wait complete. 2024-09-21T01:39:10.455 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:10.454+0000 7f2139d15640 1 Processor -- start 2024-09-21T01:39:10.455 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:10.454+0000 7f2139d15640 1 -- start start 2024-09-21T01:39:10.457 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:10.454+0000 7f2139d15640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2134102a60 0x7f2134198e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:39:10.457 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:10.454+0000 7f2139d15640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f21341083a0 0x7f21341993a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:39:10.457 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:10.454+0000 7f2139d15640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2134108cf0 0x7f21341998e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:39:10.457 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:10.454+0000 7f2139d15640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f2134112860 con 0x7f2134108cf0 2024-09-21T01:39:10.457 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:10.454+0000 7f2139d15640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f21341126e0 con 0x7f2134102a60 2024-09-21T01:39:10.457 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:10.455+0000 7f2139d15640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f21341129e0 con 0x7f21341083a0 2024-09-21T01:39:10.457 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:10.455+0000 7f2133fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2134108cf0 0x7f21341998e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:39:10.457 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:10.455+0000 7f2133fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2134108cf0 0x7f21341998e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:33240/0 (socket says 172.21.15.83:33240) 2024-09-21T01:39:10.457 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:10.455+0000 7f2133fff640 1 -- 172.21.15.83:0/335256773 learned_addr learned my addr 172.21.15.83:0/335256773 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:39:10.457 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:10.455+0000 7f212affd640 1 --2- 172.21.15.83:0/335256773 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f21341083a0 0x7f21341993a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:39:10.458 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:10.455+0000 7f21337fe640 1 --2- 172.21.15.83:0/335256773 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2134102a60 0x7f2134198e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:39:10.458 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:10.455+0000 7f2133fff640 1 -- 172.21.15.83:0/335256773 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f21341083a0 msgr2=0x7f21341993a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:39:10.458 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:10.455+0000 7f2133fff640 1 --2- 172.21.15.83:0/335256773 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f21341083a0 0x7f21341993a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:10.458 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:10.455+0000 7f2133fff640 1 -- 172.21.15.83:0/335256773 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2134102a60 msgr2=0x7f2134198e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:39:10.458 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:10.455+0000 7f2133fff640 1 --2- 172.21.15.83:0/335256773 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2134102a60 0x7f2134198e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:10.458 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:10.455+0000 7f2133fff640 1 -- 172.21.15.83:0/335256773 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f213419e0b0 con 0x7f2134108cf0 2024-09-21T01:39:10.458 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:10.455+0000 7f2133fff640 1 --2- 172.21.15.83:0/335256773 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2134108cf0 0x7f21341998e0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f212c031040 tx=0x7f212c032bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:39:10.458 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:10.455+0000 7f21317fa640 1 -- 172.21.15.83:0/335256773 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f212c004040 con 0x7f2134108cf0 2024-09-21T01:39:10.458 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:10.456+0000 7f21317fa640 1 -- 172.21.15.83:0/335256773 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f212c004670 con 0x7f2134108cf0 2024-09-21T01:39:10.458 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:10.456+0000 7f2139d15640 1 -- 172.21.15.83:0/335256773 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f213419e340 con 0x7f2134108cf0 2024-09-21T01:39:10.458 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:10.456+0000 7f21317fa640 1 -- 172.21.15.83:0/335256773 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f212c030c50 con 0x7f2134108cf0 2024-09-21T01:39:10.458 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:10.456+0000 7f2139d15640 1 -- 172.21.15.83:0/335256773 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f213419e880 con 0x7f2134108cf0 2024-09-21T01:39:10.458 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:10.457+0000 7f2139d15640 1 -- 172.21.15.83:0/335256773 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2134103ce0 con 0x7f2134108cf0 2024-09-21T01:39:10.459 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:10.458+0000 7f21317fa640 1 -- 172.21.15.83:0/335256773 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 20) ==== 154529+0+0 (secure 0 0 0) 0x7f212c0041e0 con 0x7f2134108cf0 2024-09-21T01:39:10.459 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:10.459+0000 7f21317fa640 1 --2- 172.21.15.83:0/335256773 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f21200b6560 0x7f21200b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:39:10.459 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:10.459+0000 7f21337fe640 1 --2- 172.21.15.83:0/335256773 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f21200b6560 0x7f21200b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:39:10.459 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:10.459+0000 7f21317fa640 1 -- 172.21.15.83:0/335256773 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7342+0+0 (secure 0 0 0) 0x7f212c1084d0 con 0x7f2134108cf0 2024-09-21T01:39:10.460 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:10.459+0000 7f21337fe640 1 --2- 172.21.15.83:0/335256773 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f21200b6560 0x7f21200b8a70 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f2124005e10 tx=0x7f2124005da0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:39:10.462 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:10.462+0000 7f21317fa640 1 -- 172.21.15.83:0/335256773 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f212c0cf130 con 0x7f2134108cf0 2024-09-21T01:39:10.684 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:10.683+0000 7f2139d15640 1 -- 172.21.15.83:0/335256773 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2134102e70 con 0x7f2134108cf0 2024-09-21T01:39:10.684 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:10.684+0000 7f21317fa640 1 -- 172.21.15.83:0/335256773 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) ==== 93+0+3091 (secure 0 0 0) 0x7f212c0098b0 con 0x7f2134108cf0 2024-09-21T01:39:10.685 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T01:39:10.685 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":4,"btime":"2024-09-21T01:39:09:808157+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14775,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6835/1105040204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":1105040204},{"type":"v1","addr":"172.21.15.83:6835","nonce":1105040204}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24569,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/2839502433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":2839502433},{"type":"v1","addr":"172.21.15.119:6833","nonce":2839502433}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24580,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6833/2841606990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":2841606990},{"type":"v1","addr":"172.21.15.142:6833","nonce":2841606990}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-21T01:39:10.685 INFO:teuthology.orchestra.run.smithi083.stderr:dumped fsmap epoch 4 2024-09-21T01:39:10.687 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:10.686+0000 7f2139d15640 1 -- 172.21.15.83:0/335256773 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f21200b6560 msgr2=0x7f21200b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:39:10.687 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:10.686+0000 7f2139d15640 1 --2- 172.21.15.83:0/335256773 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f21200b6560 0x7f21200b8a70 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f2124005e10 tx=0x7f2124005da0 comp rx=0 tx=0).stop 2024-09-21T01:39:10.687 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:10.686+0000 7f2139d15640 1 -- 172.21.15.83:0/335256773 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2134108cf0 msgr2=0x7f21341998e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:39:10.687 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:10.686+0000 7f2139d15640 1 --2- 172.21.15.83:0/335256773 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2134108cf0 0x7f21341998e0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f212c031040 tx=0x7f212c032bc0 comp rx=0 tx=0).stop 2024-09-21T01:39:10.687 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:10.686+0000 7f2139d15640 1 -- 172.21.15.83:0/335256773 shutdown_connections 2024-09-21T01:39:10.687 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:10.686+0000 7f2139d15640 1 --2- 172.21.15.83:0/335256773 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f21200b6560 0x7f21200b8a70 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:10.687 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:10.686+0000 7f2139d15640 1 --2- 172.21.15.83:0/335256773 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2134108cf0 0x7f21341998e0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:10.688 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:10.686+0000 7f2139d15640 1 --2- 172.21.15.83:0/335256773 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f21341083a0 0x7f21341993a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:10.688 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:10.686+0000 7f2139d15640 1 --2- 172.21.15.83:0/335256773 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2134102a60 0x7f2134198e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:10.688 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:10.686+0000 7f2139d15640 1 -- 172.21.15.83:0/335256773 >> 172.21.15.83:0/335256773 conn(0x7f2134079730 msgr2=0x7f2134104370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:39:10.688 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:10.687+0000 7f2139d15640 1 -- 172.21.15.83:0/335256773 shutdown_connections 2024-09-21T01:39:10.688 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:10.687+0000 7f2139d15640 1 -- 172.21.15.83:0/335256773 wait complete. 2024-09-21T01:39:11.008 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:10 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T01:39:11.008 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:10 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T01:39:11.008 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:10 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:39:11.008 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:10 smithi083 ceph-mon[31370]: Deploying daemon mds.d on smithi083 2024-09-21T01:39:11.008 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:10 smithi083 ceph-mon[31370]: mds.? [v2:172.21.15.83:6834/1105040204,v1:172.21.15.83:6835/1105040204] up:boot 2024-09-21T01:39:11.008 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:10 smithi083 ceph-mon[31370]: fsmap 3 up:standby 2024-09-21T01:39:11.009 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:10 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2024-09-21T01:39:11.009 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:10 smithi083 ceph-mon[31370]: from='client.? 172.21.15.83:0/335256773' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:39:11.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:10 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T01:39:11.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:10 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T01:39:11.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:10 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:39:11.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:10 smithi142 ceph-mon[34050]: Deploying daemon mds.d on smithi083 2024-09-21T01:39:11.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:10 smithi142 ceph-mon[34050]: mds.? [v2:172.21.15.83:6834/1105040204,v1:172.21.15.83:6835/1105040204] up:boot 2024-09-21T01:39:11.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:10 smithi142 ceph-mon[34050]: fsmap 3 up:standby 2024-09-21T01:39:11.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:10 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2024-09-21T01:39:11.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:10 smithi142 ceph-mon[34050]: from='client.? 172.21.15.83:0/335256773' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:39:11.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:10 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T01:39:11.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:10 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T01:39:11.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:10 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:39:11.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:10 smithi119 ceph-mon[33693]: Deploying daemon mds.d on smithi083 2024-09-21T01:39:11.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:10 smithi119 ceph-mon[33693]: mds.? [v2:172.21.15.83:6834/1105040204,v1:172.21.15.83:6835/1105040204] up:boot 2024-09-21T01:39:11.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:10 smithi119 ceph-mon[33693]: fsmap 3 up:standby 2024-09-21T01:39:11.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:10 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2024-09-21T01:39:11.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:10 smithi119 ceph-mon[33693]: from='client.? 172.21.15.83:0/335256773' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:39:12.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:11 smithi142 ceph-mon[34050]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:39:12.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:11 smithi119 ceph-mon[33693]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:39:12.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:11 smithi083 ceph-mon[31370]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:39:13.036 INFO:journalctl@ceph.mds.d.smithi083.stdout:Sep 21 01:39:12 smithi083 systemd[1]: Starting Ceph mds.d for f7697ecc-77b8-11ef-baf5-efdc52797490... 2024-09-21T01:39:13.304 INFO:journalctl@ceph.mds.d.smithi083.stdout:Sep 21 01:39:13 smithi083 podman[73009]: 2024-09-21 01:39:12.938929168 +0000 UTC m=+0.016231976 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T01:39:13.304 INFO:journalctl@ceph.mds.d.smithi083.stdout:Sep 21 01:39:13 smithi083 podman[73009]: 2024-09-21 01:39:13.050126654 +0000 UTC m=+0.127429449 container create 0362213760c23ab75f8d4380746d4bb0891727f0567ab0416d15c191b06ab8eb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mds-d, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731) 2024-09-21T01:39:13.804 INFO:journalctl@ceph.mds.d.smithi083.stdout:Sep 21 01:39:13 smithi083 podman[73009]: 2024-09-21 01:39:13.318480644 +0000 UTC m=+0.395783451 container init 0362213760c23ab75f8d4380746d4bb0891727f0567ab0416d15c191b06ab8eb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mds-d, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-09-21T01:39:13.804 INFO:journalctl@ceph.mds.d.smithi083.stdout:Sep 21 01:39:13 smithi083 podman[73009]: 2024-09-21 01:39:13.321370999 +0000 UTC m=+0.398673792 container start 0362213760c23ab75f8d4380746d4bb0891727f0567ab0416d15c191b06ab8eb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mds-d, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T01:39:13.804 INFO:journalctl@ceph.mds.d.smithi083.stdout:Sep 21 01:39:13 smithi083 ceph-mds[73028]: -- 172.21.15.83:0/2198617341 <== mon.0 v2:172.21.15.83:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5622070d1860 con 0x56220b279180 2024-09-21T01:39:13.804 INFO:journalctl@ceph.mds.d.smithi083.stdout:Sep 21 01:39:13 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mds-d[73024]: starting mds.d at 2024-09-21T01:39:13.804 INFO:journalctl@ceph.mds.d.smithi083.stdout:Sep 21 01:39:13 smithi083 bash[73009]: 0362213760c23ab75f8d4380746d4bb0891727f0567ab0416d15c191b06ab8eb 2024-09-21T01:39:13.804 INFO:journalctl@ceph.mds.d.smithi083.stdout:Sep 21 01:39:13 smithi083 systemd[1]: Started Ceph mds.d for f7697ecc-77b8-11ef-baf5-efdc52797490. 2024-09-21T01:39:13.889 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T01:39:14.107 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:13 smithi119 ceph-mon[33693]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:39:14.107 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:13 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:39:14.108 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:13 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:39:14.108 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:13 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:39:14.108 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:13 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T01:39:14.108 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:13 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T01:39:14.108 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:13 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:39:14.136 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:39:14.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:13 smithi142 ceph-mon[34050]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:39:14.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:13 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:39:14.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:13 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:39:14.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:13 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:39:14.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:13 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T01:39:14.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:13 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T01:39:14.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:13 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:39:14.254 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:13 smithi083 ceph-mon[31370]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:39:14.254 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:13 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:39:14.254 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:13 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:39:14.254 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:13 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:39:14.254 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:13 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T01:39:14.254 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:13 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T01:39:14.254 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:13 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:39:14.620 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:14.601+0000 7feb5b3a4640 1 -- 172.21.15.83:0/3288857045 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7feb54109e10 msgr2=0x7feb54110640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:39:14.621 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:14.601+0000 7feb5b3a4640 1 --2- 172.21.15.83:0/3288857045 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7feb54109e10 0x7feb54110640 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7feb44009900 tx=0x7feb4402a410 comp rx=0 tx=0).stop 2024-09-21T01:39:14.621 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:14.601+0000 7feb5b3a4640 1 -- 172.21.15.83:0/3288857045 shutdown_connections 2024-09-21T01:39:14.621 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:14.601+0000 7feb5b3a4640 1 --2- 172.21.15.83:0/3288857045 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7feb54109e10 0x7feb54110640 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:14.621 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:14.601+0000 7feb5b3a4640 1 --2- 172.21.15.83:0/3288857045 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feb541094c0 0x7feb541098d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:14.621 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:14.601+0000 7feb5b3a4640 1 --2- 172.21.15.83:0/3288857045 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feb54103b80 0x7feb54103f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:14.621 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:14.601+0000 7feb5b3a4640 1 -- 172.21.15.83:0/3288857045 >> 172.21.15.83:0/3288857045 conn(0x7feb540ff610 msgr2=0x7feb54101a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:39:14.621 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:14.601+0000 7feb5b3a4640 1 -- 172.21.15.83:0/3288857045 shutdown_connections 2024-09-21T01:39:14.621 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:14.601+0000 7feb5b3a4640 1 -- 172.21.15.83:0/3288857045 wait complete. 2024-09-21T01:39:14.621 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:14.602+0000 7feb5b3a4640 1 Processor -- start 2024-09-21T01:39:14.621 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:14.602+0000 7feb5b3a4640 1 -- start start 2024-09-21T01:39:14.621 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:14.602+0000 7feb5b3a4640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feb54103b80 0x7feb5419a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:39:14.621 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:14.602+0000 7feb5b3a4640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feb541094c0 0x7feb5419a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:39:14.622 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:14.602+0000 7feb5b3a4640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7feb54109e10 0x7feb5419fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:39:14.622 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:14.602+0000 7feb5b3a4640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7feb541139c0 con 0x7feb54109e10 2024-09-21T01:39:14.622 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:14.602+0000 7feb5b3a4640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7feb54113840 con 0x7feb541094c0 2024-09-21T01:39:14.622 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:14.602+0000 7feb5b3a4640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7feb54113b40 con 0x7feb54103b80 2024-09-21T01:39:14.622 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:14.602+0000 7feb59941640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7feb54109e10 0x7feb5419fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:39:14.622 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:14.602+0000 7feb59941640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7feb54109e10 0x7feb5419fc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:34672/0 (socket says 172.21.15.83:34672) 2024-09-21T01:39:14.622 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:14.602+0000 7feb59941640 1 -- 172.21.15.83:0/1780202419 learned_addr learned my addr 172.21.15.83:0/1780202419 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:39:14.622 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:14.602+0000 7feb59140640 1 --2- 172.21.15.83:0/1780202419 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feb54103b80 0x7feb5419a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:39:14.622 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:14.602+0000 7feb5893f640 1 --2- 172.21.15.83:0/1780202419 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feb541094c0 0x7feb5419a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:39:14.622 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:14.603+0000 7feb59941640 1 -- 172.21.15.83:0/1780202419 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feb54103b80 msgr2=0x7feb5419a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:39:14.622 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:14.603+0000 7feb59941640 1 --2- 172.21.15.83:0/1780202419 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feb54103b80 0x7feb5419a3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:14.622 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:14.603+0000 7feb59941640 1 -- 172.21.15.83:0/1780202419 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feb541094c0 msgr2=0x7feb5419a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:39:14.622 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:14.603+0000 7feb59941640 1 --2- 172.21.15.83:0/1780202419 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feb541094c0 0x7feb5419a970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:14.623 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:14.603+0000 7feb59941640 1 -- 172.21.15.83:0/1780202419 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb541a0280 con 0x7feb54109e10 2024-09-21T01:39:14.623 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:14.603+0000 7feb59941640 1 --2- 172.21.15.83:0/1780202419 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7feb54109e10 0x7feb5419fc10 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7feb44005ab0 tx=0x7feb440042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:39:14.623 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:14.603+0000 7feb527fc640 1 -- 172.21.15.83:0/1780202419 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb4403f030 con 0x7feb54109e10 2024-09-21T01:39:14.623 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:14.603+0000 7feb527fc640 1 -- 172.21.15.83:0/1780202419 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7feb44003c90 con 0x7feb54109e10 2024-09-21T01:39:14.623 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:14.603+0000 7feb527fc640 1 -- 172.21.15.83:0/1780202419 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb44035070 con 0x7feb54109e10 2024-09-21T01:39:14.623 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:14.603+0000 7feb5b3a4640 1 -- 172.21.15.83:0/1780202419 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb541a0510 con 0x7feb54109e10 2024-09-21T01:39:14.623 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:14.603+0000 7feb5b3a4640 1 -- 172.21.15.83:0/1780202419 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb541a6d90 con 0x7feb54109e10 2024-09-21T01:39:14.623 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:14.604+0000 7feb5b3a4640 1 -- 172.21.15.83:0/1780202419 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb54104e00 con 0x7feb54109e10 2024-09-21T01:39:14.623 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:14.605+0000 7feb527fc640 1 -- 172.21.15.83:0/1780202419 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 20) ==== 154529+0+0 (secure 0 0 0) 0x7feb44042030 con 0x7feb54109e10 2024-09-21T01:39:14.623 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:14.606+0000 7feb527fc640 1 --2- 172.21.15.83:0/1780202419 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7feb3c0b6610 0x7feb3c0b8b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:39:14.623 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:14.606+0000 7feb59140640 1 --2- 172.21.15.83:0/1780202419 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7feb3c0b6610 0x7feb3c0b8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:39:14.623 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:14.606+0000 7feb527fc640 1 -- 172.21.15.83:0/1780202419 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7342+0+0 (secure 0 0 0) 0x7feb441079c0 con 0x7feb54109e10 2024-09-21T01:39:14.623 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:14.607+0000 7feb59140640 1 --2- 172.21.15.83:0/1780202419 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7feb3c0b6610 0x7feb3c0b8b20 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7feb4c007350 tx=0x7feb4c0072e0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:39:14.623 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:14.610+0000 7feb527fc640 1 -- 172.21.15.83:0/1780202419 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7feb440ce620 con 0x7feb54109e10 2024-09-21T01:39:14.825 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:14.825+0000 7feb5b3a4640 1 -- 172.21.15.83:0/1780202419 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7feb5410bc60 con 0x7feb54109e10 2024-09-21T01:39:14.826 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:14.825+0000 7feb527fc640 1 -- 172.21.15.83:0/1780202419 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) ==== 93+0+3916 (secure 0 0 0) 0x7feb440d2a00 con 0x7feb54109e10 2024-09-21T01:39:14.826 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T01:39:14.826 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":5,"btime":"2024-09-21T01:39:13:822476+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14775,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6835/1105040204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":1105040204},{"type":"v1","addr":"172.21.15.83:6835","nonce":1105040204}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14787,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/2234789563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6836","nonce":2234789563},{"type":"v1","addr":"172.21.15.83:6837","nonce":2234789563}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24569,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/2839502433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":2839502433},{"type":"v1","addr":"172.21.15.119:6833","nonce":2839502433}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24580,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6833/2841606990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":2841606990},{"type":"v1","addr":"172.21.15.142:6833","nonce":2841606990}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-21T01:39:14.827 INFO:teuthology.orchestra.run.smithi083.stderr:dumped fsmap epoch 5 2024-09-21T01:39:14.828 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:14.828+0000 7feb5b3a4640 1 -- 172.21.15.83:0/1780202419 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7feb3c0b6610 msgr2=0x7feb3c0b8b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:39:14.828 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:14.828+0000 7feb5b3a4640 1 --2- 172.21.15.83:0/1780202419 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7feb3c0b6610 0x7feb3c0b8b20 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7feb4c007350 tx=0x7feb4c0072e0 comp rx=0 tx=0).stop 2024-09-21T01:39:14.828 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:14.828+0000 7feb5b3a4640 1 -- 172.21.15.83:0/1780202419 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7feb54109e10 msgr2=0x7feb5419fc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:39:14.828 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:14.828+0000 7feb5b3a4640 1 --2- 172.21.15.83:0/1780202419 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7feb54109e10 0x7feb5419fc10 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7feb44005ab0 tx=0x7feb440042f0 comp rx=0 tx=0).stop 2024-09-21T01:39:14.828 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:14.828+0000 7feb5b3a4640 1 -- 172.21.15.83:0/1780202419 shutdown_connections 2024-09-21T01:39:14.829 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:14.828+0000 7feb5b3a4640 1 --2- 172.21.15.83:0/1780202419 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7feb3c0b6610 0x7feb3c0b8b20 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:14.829 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:14.828+0000 7feb5b3a4640 1 --2- 172.21.15.83:0/1780202419 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7feb54109e10 0x7feb5419fc10 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:14.829 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:14.828+0000 7feb5b3a4640 1 --2- 172.21.15.83:0/1780202419 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feb541094c0 0x7feb5419a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:14.829 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:14.828+0000 7feb5b3a4640 1 --2- 172.21.15.83:0/1780202419 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feb54103b80 0x7feb5419a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:14.829 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:14.828+0000 7feb5b3a4640 1 -- 172.21.15.83:0/1780202419 >> 172.21.15.83:0/1780202419 conn(0x7feb540ff610 msgr2=0x7feb54101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:39:14.829 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:14.828+0000 7feb5b3a4640 1 -- 172.21.15.83:0/1780202419 shutdown_connections 2024-09-21T01:39:14.829 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:14.828+0000 7feb5b3a4640 1 -- 172.21.15.83:0/1780202419 wait complete. 2024-09-21T01:39:15.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:14 smithi142 ceph-mon[34050]: Deploying daemon mds.e on smithi119 2024-09-21T01:39:15.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:14 smithi142 ceph-mon[34050]: mds.? [v2:172.21.15.83:6836/2234789563,v1:172.21.15.83:6837/2234789563] up:boot 2024-09-21T01:39:15.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:14 smithi142 ceph-mon[34050]: fsmap 4 up:standby 2024-09-21T01:39:15.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:14 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2024-09-21T01:39:15.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:14 smithi142 ceph-mon[34050]: from='client.? 172.21.15.83:0/1780202419' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:39:15.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:14 smithi119 ceph-mon[33693]: Deploying daemon mds.e on smithi119 2024-09-21T01:39:15.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:14 smithi119 ceph-mon[33693]: mds.? [v2:172.21.15.83:6836/2234789563,v1:172.21.15.83:6837/2234789563] up:boot 2024-09-21T01:39:15.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:14 smithi119 ceph-mon[33693]: fsmap 4 up:standby 2024-09-21T01:39:15.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:14 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2024-09-21T01:39:15.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:14 smithi119 ceph-mon[33693]: from='client.? 172.21.15.83:0/1780202419' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:39:15.256 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:14 smithi083 ceph-mon[31370]: Deploying daemon mds.e on smithi119 2024-09-21T01:39:15.257 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:14 smithi083 ceph-mon[31370]: mds.? [v2:172.21.15.83:6836/2234789563,v1:172.21.15.83:6837/2234789563] up:boot 2024-09-21T01:39:15.257 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:14 smithi083 ceph-mon[31370]: fsmap 4 up:standby 2024-09-21T01:39:15.257 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:14 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2024-09-21T01:39:15.257 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:14 smithi083 ceph-mon[31370]: from='client.? 172.21.15.83:0/1780202419' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:39:15.640 INFO:journalctl@ceph.mds.e.smithi119.stdout:Sep 21 01:39:15 smithi119 systemd[1]: Starting Ceph mds.e for f7697ecc-77b8-11ef-baf5-efdc52797490... 2024-09-21T01:39:15.903 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:15 smithi119 ceph-mon[33693]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:39:15.904 INFO:journalctl@ceph.mds.e.smithi119.stdout:Sep 21 01:39:15 smithi119 podman[62347]: 2024-09-21 01:39:15.542683433 +0000 UTC m=+0.015601851 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T01:39:15.904 INFO:journalctl@ceph.mds.e.smithi119.stdout:Sep 21 01:39:15 smithi119 podman[62347]: 2024-09-21 01:39:15.64887002 +0000 UTC m=+0.121788424 container create c478ffa752086d26ae404d35f35254ad2b4ec6a12633617ba31b09326b9e50f7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mds-e, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux ) 2024-09-21T01:39:15.904 INFO:journalctl@ceph.mds.e.smithi119.stdout:Sep 21 01:39:15 smithi119 podman[62347]: 2024-09-21 01:39:15.868642773 +0000 UTC m=+0.341561187 container init c478ffa752086d26ae404d35f35254ad2b4ec6a12633617ba31b09326b9e50f7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mds-e, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-09-21T01:39:15.904 INFO:journalctl@ceph.mds.e.smithi119.stdout:Sep 21 01:39:15 smithi119 podman[62347]: 2024-09-21 01:39:15.871636283 +0000 UTC m=+0.344554689 container start c478ffa752086d26ae404d35f35254ad2b4ec6a12633617ba31b09326b9e50f7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mds-e, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-09-21T01:39:16.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:15 smithi142 ceph-mon[34050]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:39:16.217 INFO:journalctl@ceph.mds.e.smithi119.stdout:Sep 21 01:39:15 smithi119 ceph-mds[62367]: -- 172.21.15.119:0/839250493 <== mon.2 v2:172.21.15.119:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56176e939860 con 0x561772ae1a80 2024-09-21T01:39:16.217 INFO:journalctl@ceph.mds.e.smithi119.stdout:Sep 21 01:39:15 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mds-e[62363]: starting mds.e at 2024-09-21T01:39:16.217 INFO:journalctl@ceph.mds.e.smithi119.stdout:Sep 21 01:39:15 smithi119 bash[62347]: c478ffa752086d26ae404d35f35254ad2b4ec6a12633617ba31b09326b9e50f7 2024-09-21T01:39:16.217 INFO:journalctl@ceph.mds.e.smithi119.stdout:Sep 21 01:39:15 smithi119 systemd[1]: Started Ceph mds.e for f7697ecc-77b8-11ef-baf5-efdc52797490. 2024-09-21T01:39:16.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:15 smithi083 ceph-mon[31370]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:39:17.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:17 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:39:17.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:17 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:39:17.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:17 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:39:17.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:17 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T01:39:17.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:17 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T01:39:17.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:17 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:39:17.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:17 smithi083 ceph-mon[31370]: Deploying daemon mds.f on smithi142 2024-09-21T01:39:17.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:17 smithi083 ceph-mon[31370]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:39:17.305 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:17 smithi083 ceph-mon[31370]: mds.? [v2:172.21.15.119:6834/415902608,v1:172.21.15.119:6835/415902608] up:boot 2024-09-21T01:39:17.305 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:17 smithi083 ceph-mon[31370]: fsmap 5 up:standby 2024-09-21T01:39:17.305 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:17 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-21T01:39:17.435 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:17 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:39:17.435 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:17 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:39:17.435 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:17 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:39:17.435 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:17 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T01:39:17.435 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:17 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T01:39:17.436 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:17 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:39:17.436 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:17 smithi142 ceph-mon[34050]: Deploying daemon mds.f on smithi142 2024-09-21T01:39:17.436 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:17 smithi142 ceph-mon[34050]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:39:17.436 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:17 smithi142 ceph-mon[34050]: mds.? [v2:172.21.15.119:6834/415902608,v1:172.21.15.119:6835/415902608] up:boot 2024-09-21T01:39:17.436 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:17 smithi142 ceph-mon[34050]: fsmap 5 up:standby 2024-09-21T01:39:17.436 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:17 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-21T01:39:17.467 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:17 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:39:17.467 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:17 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:39:17.467 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:17 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:39:17.468 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:17 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T01:39:17.468 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:17 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T01:39:17.468 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:17 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:39:17.468 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:17 smithi119 ceph-mon[33693]: Deploying daemon mds.f on smithi142 2024-09-21T01:39:17.468 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:17 smithi119 ceph-mon[33693]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:39:17.468 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:17 smithi119 ceph-mon[33693]: mds.? [v2:172.21.15.119:6834/415902608,v1:172.21.15.119:6835/415902608] up:boot 2024-09-21T01:39:17.468 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:17 smithi119 ceph-mon[33693]: fsmap 5 up:standby 2024-09-21T01:39:17.468 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:17 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-21T01:39:17.611 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T01:39:17.871 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:39:18.113 INFO:journalctl@ceph.mds.f.smithi142.stdout:Sep 21 01:39:17 smithi142 systemd[1]: Starting Ceph mds.f for f7697ecc-77b8-11ef-baf5-efdc52797490... 2024-09-21T01:39:18.388 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:18.368+0000 7fdfcd45b640 1 -- 172.21.15.83:0/276414787 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdfc8109e20 msgr2=0x7fdfc8110650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:39:18.388 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:18.368+0000 7fdfcd45b640 1 --2- 172.21.15.83:0/276414787 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdfc8109e20 0x7fdfc8110650 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fdfc0009ca0 tx=0x7fdfc002a8c0 comp rx=0 tx=0).stop 2024-09-21T01:39:18.389 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:18.368+0000 7fdfcd45b640 1 -- 172.21.15.83:0/276414787 shutdown_connections 2024-09-21T01:39:18.389 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:18.368+0000 7fdfcd45b640 1 --2- 172.21.15.83:0/276414787 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdfc8109e20 0x7fdfc8110650 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:18.389 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:18.368+0000 7fdfcd45b640 1 --2- 172.21.15.83:0/276414787 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdfc81094d0 0x7fdfc81098e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:18.389 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:18.368+0000 7fdfcd45b640 1 --2- 172.21.15.83:0/276414787 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdfc8103b90 0x7fdfc8103fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:18.389 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:18.368+0000 7fdfcd45b640 1 -- 172.21.15.83:0/276414787 >> 172.21.15.83:0/276414787 conn(0x7fdfc80ff600 msgr2=0x7fdfc8101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:39:18.389 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:18.368+0000 7fdfcd45b640 1 -- 172.21.15.83:0/276414787 shutdown_connections 2024-09-21T01:39:18.389 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:18.368+0000 7fdfcd45b640 1 -- 172.21.15.83:0/276414787 wait complete. 2024-09-21T01:39:18.389 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:18.369+0000 7fdfcd45b640 1 Processor -- start 2024-09-21T01:39:18.389 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:18.369+0000 7fdfcd45b640 1 -- start start 2024-09-21T01:39:18.389 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:18.369+0000 7fdfcd45b640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdfc8103b90 0x7fdfc819a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:39:18.389 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:18.369+0000 7fdfcd45b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdfc81094d0 0x7fdfc819a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:39:18.389 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:18.369+0000 7fdfcd45b640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdfc8109e20 0x7fdfc819fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:39:18.390 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:18.369+0000 7fdfcd45b640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fdfc81139e0 con 0x7fdfc8103b90 2024-09-21T01:39:18.390 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:18.369+0000 7fdfcd45b640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fdfc8113860 con 0x7fdfc81094d0 2024-09-21T01:39:18.390 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:18.369+0000 7fdfcd45b640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fdfc8113b60 con 0x7fdfc8109e20 2024-09-21T01:39:18.390 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:18.370+0000 7fdfc6ffd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdfc8103b90 0x7fdfc819a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:39:18.390 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:18.370+0000 7fdfc6ffd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdfc8103b90 0x7fdfc819a390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:34678/0 (socket says 172.21.15.83:34678) 2024-09-21T01:39:18.390 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:18.370+0000 7fdfc6ffd640 1 -- 172.21.15.83:0/3510176399 learned_addr learned my addr 172.21.15.83:0/3510176399 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:39:18.390 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:18.370+0000 7fdfc67fc640 1 --2- 172.21.15.83:0/3510176399 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdfc81094d0 0x7fdfc819a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:39:18.390 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:18.370+0000 7fdfc77fe640 1 --2- 172.21.15.83:0/3510176399 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdfc8109e20 0x7fdfc819fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:39:18.390 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:18.370+0000 7fdfc6ffd640 1 -- 172.21.15.83:0/3510176399 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdfc8109e20 msgr2=0x7fdfc819fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:39:18.390 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:18.370+0000 7fdfc6ffd640 1 --2- 172.21.15.83:0/3510176399 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdfc8109e20 0x7fdfc819fbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:18.390 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:18.370+0000 7fdfc6ffd640 1 -- 172.21.15.83:0/3510176399 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdfc81094d0 msgr2=0x7fdfc819a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:39:18.390 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:18.370+0000 7fdfc6ffd640 1 --2- 172.21.15.83:0/3510176399 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdfc81094d0 0x7fdfc819a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:18.391 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:18.370+0000 7fdfc6ffd640 1 -- 172.21.15.83:0/3510176399 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfc81a0240 con 0x7fdfc8103b90 2024-09-21T01:39:18.391 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:18.370+0000 7fdfc77fe640 1 --2- 172.21.15.83:0/3510176399 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdfc8109e20 0x7fdfc819fbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:39:18.391 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:18.370+0000 7fdfc6ffd640 1 --2- 172.21.15.83:0/3510176399 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdfc8103b90 0x7fdfc819a390 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fdfb800c920 tx=0x7fdfb800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:39:18.391 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:18.370+0000 7fdfaffff640 1 -- 172.21.15.83:0/3510176399 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfb8007c70 con 0x7fdfc8103b90 2024-09-21T01:39:18.391 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:18.370+0000 7fdfcd45b640 1 -- 172.21.15.83:0/3510176399 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdfc81a0530 con 0x7fdfc8103b90 2024-09-21T01:39:18.391 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:18.370+0000 7fdfaffff640 1 -- 172.21.15.83:0/3510176399 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdfb8007e10 con 0x7fdfc8103b90 2024-09-21T01:39:18.391 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:18.370+0000 7fdfaffff640 1 -- 172.21.15.83:0/3510176399 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfb80186f0 con 0x7fdfc8103b90 2024-09-21T01:39:18.391 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:18.370+0000 7fdfcd45b640 1 -- 172.21.15.83:0/3510176399 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdfc81a6d50 con 0x7fdfc8103b90 2024-09-21T01:39:18.391 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:18.372+0000 7fdfcd45b640 1 -- 172.21.15.83:0/3510176399 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdfc8103fa0 con 0x7fdfc8103b90 2024-09-21T01:39:18.391 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:18.373+0000 7fdfaffff640 1 -- 172.21.15.83:0/3510176399 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 20) ==== 154529+0+0 (secure 0 0 0) 0x7fdfb800f450 con 0x7fdfc8103b90 2024-09-21T01:39:18.391 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:18.374+0000 7fdfaffff640 1 --2- 172.21.15.83:0/3510176399 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fdfb00b6590 0x7fdfb00b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:39:18.391 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:18.374+0000 7fdfc67fc640 1 --2- 172.21.15.83:0/3510176399 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fdfb00b6590 0x7fdfb00b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:39:18.391 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:18.374+0000 7fdfaffff640 1 -- 172.21.15.83:0/3510176399 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7342+0+0 (secure 0 0 0) 0x7fdfb80e7170 con 0x7fdfc8103b90 2024-09-21T01:39:18.391 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:18.374+0000 7fdfc67fc640 1 --2- 172.21.15.83:0/3510176399 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fdfb00b6590 0x7fdfb00b8aa0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fdfc8102d00 tx=0x7fdfbc00b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:39:18.392 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:18.378+0000 7fdfaffff640 1 -- 172.21.15.83:0/3510176399 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fdfb8014030 con 0x7fdfc8103b90 2024-09-21T01:39:18.392 INFO:journalctl@ceph.mds.f.smithi142.stdout:Sep 21 01:39:18 smithi142 podman[63243]: 2024-09-21 01:39:18.016187791 +0000 UTC m=+0.015654618 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T01:39:18.392 INFO:journalctl@ceph.mds.f.smithi142.stdout:Sep 21 01:39:18 smithi142 podman[63243]: 2024-09-21 01:39:18.133355622 +0000 UTC m=+0.132822430 container create fd9589afba7ff91daa815b13c37ad0168a2e7958dcefa8eb90df034f5b6439df (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mds-f, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS) 2024-09-21T01:39:18.392 INFO:journalctl@ceph.mds.f.smithi142.stdout:Sep 21 01:39:18 smithi142 podman[63243]: 2024-09-21 01:39:18.352539759 +0000 UTC m=+0.352006587 container init fd9589afba7ff91daa815b13c37ad0168a2e7958dcefa8eb90df034f5b6439df (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mds-f, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-09-21T01:39:18.392 INFO:journalctl@ceph.mds.f.smithi142.stdout:Sep 21 01:39:18 smithi142 podman[63243]: 2024-09-21 01:39:18.355545612 +0000 UTC m=+0.355012424 container start fd9589afba7ff91daa815b13c37ad0168a2e7958dcefa8eb90df034f5b6439df (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mds-f, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T01:39:18.610 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:18.608+0000 7fdfcd45b640 1 -- 172.21.15.83:0/3510176399 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdfc810bc70 con 0x7fdfc8103b90 2024-09-21T01:39:18.610 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:18.609+0000 7fdfaffff640 1 -- 172.21.15.83:0/3510176399 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5569 (secure 0 0 0) 0x7fdfb80addd0 con 0x7fdfc8103b90 2024-09-21T01:39:18.611 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T01:39:18.611 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":7,"btime":"2024-09-21T01:39:18:444501+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14775,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6835/1105040204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":1105040204},{"type":"v1","addr":"172.21.15.83:6835","nonce":1105040204}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14787,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/2234789563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6836","nonce":2234789563},{"type":"v1","addr":"172.21.15.83:6837","nonce":2234789563}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24569,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/2839502433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":2839502433},{"type":"v1","addr":"172.21.15.119:6833","nonce":2839502433}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24580,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6833/2841606990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":2841606990},{"type":"v1","addr":"172.21.15.142:6833","nonce":2841606990}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24599,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/415902608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":415902608},{"type":"v1","addr":"172.21.15.119:6835","nonce":415902608}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24607,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/3009088510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":3009088510},{"type":"v1","addr":"172.21.15.142:6835","nonce":3009088510}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[]} 2024-09-21T01:39:18.611 INFO:teuthology.orchestra.run.smithi083.stderr:dumped fsmap epoch 7 2024-09-21T01:39:18.613 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:18.611+0000 7fdfcd45b640 1 -- 172.21.15.83:0/3510176399 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fdfb00b6590 msgr2=0x7fdfb00b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:39:18.613 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:18.611+0000 7fdfcd45b640 1 --2- 172.21.15.83:0/3510176399 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fdfb00b6590 0x7fdfb00b8aa0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fdfc8102d00 tx=0x7fdfbc00b390 comp rx=0 tx=0).stop 2024-09-21T01:39:18.613 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:18.611+0000 7fdfcd45b640 1 -- 172.21.15.83:0/3510176399 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdfc8103b90 msgr2=0x7fdfc819a390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:39:18.613 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:18.611+0000 7fdfcd45b640 1 --2- 172.21.15.83:0/3510176399 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdfc8103b90 0x7fdfc819a390 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fdfb800c920 tx=0x7fdfb800cde0 comp rx=0 tx=0).stop 2024-09-21T01:39:18.613 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:18.611+0000 7fdfcd45b640 1 -- 172.21.15.83:0/3510176399 shutdown_connections 2024-09-21T01:39:18.613 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:18.611+0000 7fdfcd45b640 1 --2- 172.21.15.83:0/3510176399 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fdfb00b6590 0x7fdfb00b8aa0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:18.614 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:18.611+0000 7fdfcd45b640 1 --2- 172.21.15.83:0/3510176399 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdfc8109e20 0x7fdfc819fbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:18.614 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:18.611+0000 7fdfcd45b640 1 --2- 172.21.15.83:0/3510176399 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdfc81094d0 0x7fdfc819a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:18.614 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:18.611+0000 7fdfcd45b640 1 --2- 172.21.15.83:0/3510176399 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdfc8103b90 0x7fdfc819a390 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:18.614 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:18.611+0000 7fdfcd45b640 1 -- 172.21.15.83:0/3510176399 >> 172.21.15.83:0/3510176399 conn(0x7fdfc80ff600 msgr2=0x7fdfc8108b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:39:18.614 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:18.611+0000 7fdfcd45b640 1 -- 172.21.15.83:0/3510176399 shutdown_connections 2024-09-21T01:39:18.614 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:18.611+0000 7fdfcd45b640 1 -- 172.21.15.83:0/3510176399 wait complete. 2024-09-21T01:39:18.714 INFO:journalctl@ceph.mds.f.smithi142.stdout:Sep 21 01:39:18 smithi142 ceph-mds[63262]: -- 172.21.15.142:0/2329760186 <== mon.1 v2:172.21.15.142:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x559b9d225860 con 0x559ba13cda80 2024-09-21T01:39:18.714 INFO:journalctl@ceph.mds.f.smithi142.stdout:Sep 21 01:39:18 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mds-f[63258]: starting mds.f at 2024-09-21T01:39:18.715 INFO:journalctl@ceph.mds.f.smithi142.stdout:Sep 21 01:39:18 smithi142 bash[63243]: fd9589afba7ff91daa815b13c37ad0168a2e7958dcefa8eb90df034f5b6439df 2024-09-21T01:39:18.715 INFO:journalctl@ceph.mds.f.smithi142.stdout:Sep 21 01:39:18 smithi142 systemd[1]: Started Ceph mds.f for f7697ecc-77b8-11ef-baf5-efdc52797490. 2024-09-21T01:39:19.554 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:19 smithi083 ceph-mon[31370]: mds.? [v2:172.21.15.142:6834/3009088510,v1:172.21.15.142:6835/3009088510] up:boot 2024-09-21T01:39:19.554 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:19 smithi083 ceph-mon[31370]: fsmap 6 up:standby 2024-09-21T01:39:19.554 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:19 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-21T01:39:19.554 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:19 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:39:19.554 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:19 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:39:19.554 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:19 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:39:19.554 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:19 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T01:39:19.555 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:19 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T01:39:19.555 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:19 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:39:19.555 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:19 smithi083 ceph-mon[31370]: Deploying daemon mds.c on smithi142 2024-09-21T01:39:19.555 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:19 smithi083 ceph-mon[31370]: from='client.? 172.21.15.83:0/3510176399' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:39:19.555 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:19 smithi083 ceph-mon[31370]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:39:19.714 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:19 smithi142 ceph-mon[34050]: mds.? [v2:172.21.15.142:6834/3009088510,v1:172.21.15.142:6835/3009088510] up:boot 2024-09-21T01:39:19.715 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:19 smithi142 ceph-mon[34050]: fsmap 6 up:standby 2024-09-21T01:39:19.715 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:19 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-21T01:39:19.715 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:19 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:39:19.715 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:19 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:39:19.715 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:19 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:39:19.715 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:19 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T01:39:19.715 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:19 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T01:39:19.715 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:19 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:39:19.715 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:19 smithi142 ceph-mon[34050]: Deploying daemon mds.c on smithi142 2024-09-21T01:39:19.715 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:19 smithi142 ceph-mon[34050]: from='client.? 172.21.15.83:0/3510176399' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:39:19.715 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:19 smithi142 ceph-mon[34050]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:39:19.718 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:19 smithi119 ceph-mon[33693]: mds.? [v2:172.21.15.142:6834/3009088510,v1:172.21.15.142:6835/3009088510] up:boot 2024-09-21T01:39:19.718 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:19 smithi119 ceph-mon[33693]: fsmap 6 up:standby 2024-09-21T01:39:19.718 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:19 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-21T01:39:19.718 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:19 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:39:19.718 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:19 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:39:19.718 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:19 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:39:19.718 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:19 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T01:39:19.718 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:19 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T01:39:19.718 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:19 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:39:19.719 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:19 smithi119 ceph-mon[33693]: Deploying daemon mds.c on smithi142 2024-09-21T01:39:19.719 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:19 smithi119 ceph-mon[33693]: from='client.? 172.21.15.83:0/3510176399' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:39:19.719 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:19 smithi119 ceph-mon[33693]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:39:20.701 INFO:journalctl@ceph.mds.c.smithi142.stdout:Sep 21 01:39:20 smithi142 systemd[1]: Starting Ceph mds.c for f7697ecc-77b8-11ef-baf5-efdc52797490... 2024-09-21T01:39:20.964 INFO:journalctl@ceph.mds.c.smithi142.stdout:Sep 21 01:39:20 smithi142 podman[63512]: 2024-09-21 01:39:20.603303912 +0000 UTC m=+0.015373502 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T01:39:20.964 INFO:journalctl@ceph.mds.c.smithi142.stdout:Sep 21 01:39:20 smithi142 podman[63512]: 2024-09-21 01:39:20.704425478 +0000 UTC m=+0.116495101 container create 98e7d6abd2f896e49169529501ab1894466d97aebc8eb0b733372c1f8f994abd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mds-c, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2) 2024-09-21T01:39:21.323 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T01:39:21.464 INFO:journalctl@ceph.mds.c.smithi142.stdout:Sep 21 01:39:20 smithi142 podman[63512]: 2024-09-21 01:39:20.968768179 +0000 UTC m=+0.380837768 container init 98e7d6abd2f896e49169529501ab1894466d97aebc8eb0b733372c1f8f994abd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mds-c, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-09-21T01:39:21.465 INFO:journalctl@ceph.mds.c.smithi142.stdout:Sep 21 01:39:20 smithi142 podman[63512]: 2024-09-21 01:39:20.971452892 +0000 UTC m=+0.383522475 container start 98e7d6abd2f896e49169529501ab1894466d97aebc8eb0b733372c1f8f994abd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mds-c, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T01:39:21.465 INFO:journalctl@ceph.mds.c.smithi142.stdout:Sep 21 01:39:21 smithi142 ceph-mds[63531]: -- 172.21.15.142:0/2848661541 <== mon.1 v2:172.21.15.142:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x561165b73860 con 0x561169d1b180 2024-09-21T01:39:21.465 INFO:journalctl@ceph.mds.c.smithi142.stdout:Sep 21 01:39:21 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mds-c[63527]: starting mds.c at 2024-09-21T01:39:21.465 INFO:journalctl@ceph.mds.c.smithi142.stdout:Sep 21 01:39:21 smithi142 bash[63512]: 98e7d6abd2f896e49169529501ab1894466d97aebc8eb0b733372c1f8f994abd 2024-09-21T01:39:21.465 INFO:journalctl@ceph.mds.c.smithi142.stdout:Sep 21 01:39:21 smithi142 systemd[1]: Started Ceph mds.c for f7697ecc-77b8-11ef-baf5-efdc52797490. 2024-09-21T01:39:21.581 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:39:21.952 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:21 smithi083 ceph-mon[31370]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:39:21.953 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:21 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:39:21.953 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:21 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:39:21.953 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:21 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:39:21.953 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:21 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T01:39:21.953 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:21 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T01:39:21.953 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:21 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:39:22.050 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:22.038+0000 7f9f7f27c640 1 -- 172.21.15.83:0/1730807203 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9f781083f0 msgr2=0x7f9f78108800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:39:22.050 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:22.038+0000 7f9f7f27c640 1 --2- 172.21.15.83:0/1730807203 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9f781083f0 0x7f9f78108800 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f9f74009900 tx=0x7f9f7402a410 comp rx=0 tx=0).stop 2024-09-21T01:39:22.050 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:22.038+0000 7f9f7f27c640 1 -- 172.21.15.83:0/1730807203 shutdown_connections 2024-09-21T01:39:22.050 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:22.038+0000 7f9f7f27c640 1 --2- 172.21.15.83:0/1730807203 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9f78108d40 0x7f9f7810f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:22.051 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:22.038+0000 7f9f7f27c640 1 --2- 172.21.15.83:0/1730807203 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9f781083f0 0x7f9f78108800 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:22.051 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:22.038+0000 7f9f7f27c640 1 --2- 172.21.15.83:0/1730807203 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9f78103180 0x7f9f78103590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:22.051 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:22.038+0000 7f9f7f27c640 1 -- 172.21.15.83:0/1730807203 >> 172.21.15.83:0/1730807203 conn(0x7f9f78079e10 msgr2=0x7f9f7807a220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:39:22.051 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:22.038+0000 7f9f7f27c640 1 -- 172.21.15.83:0/1730807203 shutdown_connections 2024-09-21T01:39:22.051 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:22.038+0000 7f9f7f27c640 1 -- 172.21.15.83:0/1730807203 wait complete. 2024-09-21T01:39:22.051 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:22.039+0000 7f9f7f27c640 1 Processor -- start 2024-09-21T01:39:22.051 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:22.039+0000 7f9f7f27c640 1 -- start start 2024-09-21T01:39:22.051 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:22.039+0000 7f9f7f27c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9f78103180 0x7f9f7819b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:39:22.051 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:22.039+0000 7f9f7f27c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9f781083f0 0x7f9f7819b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:39:22.051 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:22.039+0000 7f9f7f27c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9f78108d40 0x7f9f7819bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:39:22.051 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:22.039+0000 7f9f7f27c640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f9f781128b0 con 0x7f9f781083f0 2024-09-21T01:39:22.051 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:22.039+0000 7f9f7f27c640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f9f78112730 con 0x7f9f78108d40 2024-09-21T01:39:22.051 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:22.039+0000 7f9f7f27c640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f9f78112a30 con 0x7f9f78103180 2024-09-21T01:39:22.052 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:22.039+0000 7f9f7c817640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9f781083f0 0x7f9f7819b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:39:22.052 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:22.039+0000 7f9f7c817640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9f781083f0 0x7f9f7819b6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:34698/0 (socket says 172.21.15.83:34698) 2024-09-21T01:39:22.052 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:22.039+0000 7f9f7c817640 1 -- 172.21.15.83:0/3702790217 learned_addr learned my addr 172.21.15.83:0/3702790217 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:39:22.052 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:22.040+0000 7f9f7d018640 1 --2- 172.21.15.83:0/3702790217 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9f78103180 0x7f9f7819b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:39:22.052 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:22.040+0000 7f9f7d819640 1 --2- 172.21.15.83:0/3702790217 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9f78108d40 0x7f9f7819bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:39:22.052 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:22.040+0000 7f9f7c817640 1 -- 172.21.15.83:0/3702790217 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9f78103180 msgr2=0x7f9f7819b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:39:22.052 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:22.040+0000 7f9f7c817640 1 --2- 172.21.15.83:0/3702790217 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9f78103180 0x7f9f7819b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:22.052 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:22.040+0000 7f9f7c817640 1 -- 172.21.15.83:0/3702790217 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9f78108d40 msgr2=0x7f9f7819bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:39:22.052 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:22.040+0000 7f9f7c817640 1 --2- 172.21.15.83:0/3702790217 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9f78108d40 0x7f9f7819bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:22.052 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:22.040+0000 7f9f7c817640 1 -- 172.21.15.83:0/3702790217 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f781a64b0 con 0x7f9f781083f0 2024-09-21T01:39:22.052 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:22.040+0000 7f9f7c817640 1 --2- 172.21.15.83:0/3702790217 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9f781083f0 0x7f9f7819b6e0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f9f74004770 tx=0x7f9f74004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:39:22.052 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:22.040+0000 7f9f6a7fc640 1 -- 172.21.15.83:0/3702790217 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f7403f030 con 0x7f9f781083f0 2024-09-21T01:39:22.052 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:22.040+0000 7f9f6a7fc640 1 -- 172.21.15.83:0/3702790217 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9f74004440 con 0x7f9f781083f0 2024-09-21T01:39:22.053 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:22.040+0000 7f9f7f27c640 1 -- 172.21.15.83:0/3702790217 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f781a6740 con 0x7f9f781083f0 2024-09-21T01:39:22.053 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:22.040+0000 7f9f6a7fc640 1 -- 172.21.15.83:0/3702790217 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f74035070 con 0x7f9f781083f0 2024-09-21T01:39:22.053 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:22.040+0000 7f9f7f27c640 1 -- 172.21.15.83:0/3702790217 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f781a6c20 con 0x7f9f781083f0 2024-09-21T01:39:22.053 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:22.041+0000 7f9f7f27c640 1 -- 172.21.15.83:0/3702790217 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f78103590 con 0x7f9f781083f0 2024-09-21T01:39:22.053 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:22.043+0000 7f9f6a7fc640 1 -- 172.21.15.83:0/3702790217 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 20) ==== 154529+0+0 (secure 0 0 0) 0x7f9f74042030 con 0x7f9f781083f0 2024-09-21T01:39:22.053 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:22.043+0000 7f9f6a7fc640 1 --2- 172.21.15.83:0/3702790217 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f9f640b6560 0x7f9f640b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:39:22.053 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:22.044+0000 7f9f6a7fc640 1 -- 172.21.15.83:0/3702790217 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7342+0+0 (secure 0 0 0) 0x7f9f741077d0 con 0x7f9f781083f0 2024-09-21T01:39:22.053 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:22.044+0000 7f9f7d018640 1 --2- 172.21.15.83:0/3702790217 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f9f640b6560 0x7f9f640b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:39:22.053 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:22.044+0000 7f9f7d018640 1 --2- 172.21.15.83:0/3702790217 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f9f640b6560 0x7f9f640b8a70 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f9f781029a0 tx=0x7f9f6c005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:39:22.053 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:22.047+0000 7f9f6a7fc640 1 -- 172.21.15.83:0/3702790217 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f9f740ce430 con 0x7f9f781083f0 2024-09-21T01:39:22.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:21 smithi142 ceph-mon[34050]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:39:22.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:21 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:39:22.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:21 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:39:22.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:21 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:39:22.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:21 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T01:39:22.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:21 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T01:39:22.216 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:21 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:39:22.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:21 smithi119 ceph-mon[33693]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:39:22.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:21 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:39:22.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:21 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:39:22.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:21 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:39:22.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:21 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T01:39:22.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:21 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T01:39:22.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:21 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:39:22.266 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:22.265+0000 7f9f7f27c640 1 -- 172.21.15.83:0/3702790217 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9f7802e640 con 0x7f9f781083f0 2024-09-21T01:39:22.267 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:22.266+0000 7f9f6a7fc640 1 -- 172.21.15.83:0/3702790217 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6397 (secure 0 0 0) 0x7f9f740d2810 con 0x7f9f781083f0 2024-09-21T01:39:22.267 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T01:39:22.267 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":8,"btime":"2024-09-21T01:39:21:801714+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14775,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6835/1105040204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":1105040204},{"type":"v1","addr":"172.21.15.83:6835","nonce":1105040204}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14787,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/2234789563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6836","nonce":2234789563},{"type":"v1","addr":"172.21.15.83:6837","nonce":2234789563}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24569,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/2839502433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":2839502433},{"type":"v1","addr":"172.21.15.119:6833","nonce":2839502433}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24580,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6833/2841606990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":2841606990},{"type":"v1","addr":"172.21.15.142:6833","nonce":2841606990}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24599,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/415902608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":415902608},{"type":"v1","addr":"172.21.15.119:6835","nonce":415902608}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24607,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/3009088510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":3009088510},{"type":"v1","addr":"172.21.15.142:6835","nonce":3009088510}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24613,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/3847200126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6836","nonce":3847200126},{"type":"v1","addr":"172.21.15.142:6837","nonce":3847200126}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[]} 2024-09-21T01:39:22.267 INFO:teuthology.orchestra.run.smithi083.stderr:dumped fsmap epoch 8 2024-09-21T01:39:22.269 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:22.268+0000 7f9f7f27c640 1 -- 172.21.15.83:0/3702790217 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f9f640b6560 msgr2=0x7f9f640b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:39:22.269 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:22.268+0000 7f9f7f27c640 1 --2- 172.21.15.83:0/3702790217 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f9f640b6560 0x7f9f640b8a70 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f9f781029a0 tx=0x7f9f6c005f90 comp rx=0 tx=0).stop 2024-09-21T01:39:22.270 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:22.268+0000 7f9f7f27c640 1 -- 172.21.15.83:0/3702790217 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9f781083f0 msgr2=0x7f9f7819b6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:39:22.270 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:22.268+0000 7f9f7f27c640 1 --2- 172.21.15.83:0/3702790217 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9f781083f0 0x7f9f7819b6e0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f9f74004770 tx=0x7f9f74004040 comp rx=0 tx=0).stop 2024-09-21T01:39:22.270 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:22.268+0000 7f9f7f27c640 1 -- 172.21.15.83:0/3702790217 shutdown_connections 2024-09-21T01:39:22.270 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:22.268+0000 7f9f7f27c640 1 --2- 172.21.15.83:0/3702790217 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f9f640b6560 0x7f9f640b8a70 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:22.270 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:22.268+0000 7f9f7f27c640 1 --2- 172.21.15.83:0/3702790217 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9f78108d40 0x7f9f7819bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:22.270 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:22.268+0000 7f9f7f27c640 1 --2- 172.21.15.83:0/3702790217 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9f781083f0 0x7f9f7819b6e0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:22.270 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:22.268+0000 7f9f7f27c640 1 --2- 172.21.15.83:0/3702790217 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9f78103180 0x7f9f7819b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:22.270 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:22.268+0000 7f9f7f27c640 1 -- 172.21.15.83:0/3702790217 >> 172.21.15.83:0/3702790217 conn(0x7f9f78079e10 msgr2=0x7f9f78106500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:39:22.270 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:22.268+0000 7f9f7f27c640 1 -- 172.21.15.83:0/3702790217 shutdown_connections 2024-09-21T01:39:22.270 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:22.268+0000 7f9f7f27c640 1 -- 172.21.15.83:0/3702790217 wait complete. 2024-09-21T01:39:22.967 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:22 smithi119 ceph-mon[33693]: Deploying daemon mds.h on smithi119 2024-09-21T01:39:22.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:22 smithi119 ceph-mon[33693]: mds.? [v2:172.21.15.142:6836/3847200126,v1:172.21.15.142:6837/3847200126] up:boot 2024-09-21T01:39:22.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:22 smithi119 ceph-mon[33693]: fsmap 7 up:standby 2024-09-21T01:39:22.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:22 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-21T01:39:22.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:22 smithi119 ceph-mon[33693]: from='client.? 172.21.15.83:0/3702790217' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:39:23.053 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:22 smithi083 ceph-mon[31370]: Deploying daemon mds.h on smithi119 2024-09-21T01:39:23.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:22 smithi083 ceph-mon[31370]: mds.? [v2:172.21.15.142:6836/3847200126,v1:172.21.15.142:6837/3847200126] up:boot 2024-09-21T01:39:23.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:22 smithi083 ceph-mon[31370]: fsmap 7 up:standby 2024-09-21T01:39:23.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:22 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-21T01:39:23.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:22 smithi083 ceph-mon[31370]: from='client.? 172.21.15.83:0/3702790217' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:39:23.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:22 smithi142 ceph-mon[34050]: Deploying daemon mds.h on smithi119 2024-09-21T01:39:23.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:22 smithi142 ceph-mon[34050]: mds.? [v2:172.21.15.142:6836/3847200126,v1:172.21.15.142:6837/3847200126] up:boot 2024-09-21T01:39:23.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:22 smithi142 ceph-mon[34050]: fsmap 7 up:standby 2024-09-21T01:39:23.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:22 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-21T01:39:23.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:22 smithi142 ceph-mon[34050]: from='client.? 172.21.15.83:0/3702790217' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:39:23.366 INFO:journalctl@ceph.mds.h.smithi119.stdout:Sep 21 01:39:23 smithi119 systemd[1]: Starting Ceph mds.h for f7697ecc-77b8-11ef-baf5-efdc52797490... 2024-09-21T01:39:23.623 INFO:journalctl@ceph.mds.h.smithi119.stdout:Sep 21 01:39:23 smithi119 podman[62617]: 2024-09-21 01:39:23.269055934 +0000 UTC m=+0.016238149 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T01:39:23.623 INFO:journalctl@ceph.mds.h.smithi119.stdout:Sep 21 01:39:23 smithi119 podman[62617]: 2024-09-21 01:39:23.406015541 +0000 UTC m=+0.153197739 container create 774eb2d30891599d03e60601a9a334b92c5a31f220353945bf97b9d61f5b4f87 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mds-h, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T01:39:23.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:23 smithi119 ceph-mon[33693]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:39:23.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:23 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:39:23.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:23 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:39:23.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:23 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:39:23.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:23 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T01:39:23.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:23 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T01:39:23.969 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:23 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:39:23.969 INFO:journalctl@ceph.mds.h.smithi119.stdout:Sep 21 01:39:23 smithi119 podman[62617]: 2024-09-21 01:39:23.64290624 +0000 UTC m=+0.390088452 container init 774eb2d30891599d03e60601a9a334b92c5a31f220353945bf97b9d61f5b4f87 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mds-h, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-09-21T01:39:23.969 INFO:journalctl@ceph.mds.h.smithi119.stdout:Sep 21 01:39:23 smithi119 podman[62617]: 2024-09-21 01:39:23.64671002 +0000 UTC m=+0.393892219 container start 774eb2d30891599d03e60601a9a334b92c5a31f220353945bf97b9d61f5b4f87 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mds-h, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True) 2024-09-21T01:39:23.969 INFO:journalctl@ceph.mds.h.smithi119.stdout:Sep 21 01:39:23 smithi119 ceph-mds[62644]: -- 172.21.15.119:0/1089020407 <== mon.2 v2:172.21.15.119:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5652435f1860 con 0x565247799600 2024-09-21T01:39:23.969 INFO:journalctl@ceph.mds.h.smithi119.stdout:Sep 21 01:39:23 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mds-h[62632]: starting mds.h at 2024-09-21T01:39:23.969 INFO:journalctl@ceph.mds.h.smithi119.stdout:Sep 21 01:39:23 smithi119 bash[62617]: 774eb2d30891599d03e60601a9a334b92c5a31f220353945bf97b9d61f5b4f87 2024-09-21T01:39:23.969 INFO:journalctl@ceph.mds.h.smithi119.stdout:Sep 21 01:39:23 smithi119 systemd[1]: Started Ceph mds.h for f7697ecc-77b8-11ef-baf5-efdc52797490. 2024-09-21T01:39:24.190 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:23 smithi142 ceph-mon[34050]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:39:24.190 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:23 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:39:24.190 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:23 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:39:24.191 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:23 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:39:24.191 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:23 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T01:39:24.191 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:23 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T01:39:24.191 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:23 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:39:24.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:23 smithi083 ceph-mon[31370]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:39:24.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:23 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:39:24.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:23 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:39:24.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:23 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:39:24.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:23 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T01:39:24.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:23 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T01:39:24.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:23 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:39:24.876 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T01:39:25.136 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:39:25.207 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:24 smithi142 ceph-mon[34050]: Deploying daemon mds.i on smithi142 2024-09-21T01:39:25.207 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:24 smithi142 ceph-mon[34050]: mds.? [v2:172.21.15.119:6836/3619222976,v1:172.21.15.119:6837/3619222976] up:boot 2024-09-21T01:39:25.207 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:24 smithi142 ceph-mon[34050]: fsmap 8 up:standby 2024-09-21T01:39:25.207 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:24 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-21T01:39:25.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:24 smithi119 ceph-mon[33693]: Deploying daemon mds.i on smithi142 2024-09-21T01:39:25.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:24 smithi119 ceph-mon[33693]: mds.? [v2:172.21.15.119:6836/3619222976,v1:172.21.15.119:6837/3619222976] up:boot 2024-09-21T01:39:25.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:24 smithi119 ceph-mon[33693]: fsmap 8 up:standby 2024-09-21T01:39:25.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:24 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-21T01:39:25.256 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:24 smithi083 ceph-mon[31370]: Deploying daemon mds.i on smithi142 2024-09-21T01:39:25.256 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:24 smithi083 ceph-mon[31370]: mds.? [v2:172.21.15.119:6836/3619222976,v1:172.21.15.119:6837/3619222976] up:boot 2024-09-21T01:39:25.257 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:24 smithi083 ceph-mon[31370]: fsmap 8 up:standby 2024-09-21T01:39:25.257 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:24 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-21T01:39:25.635 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:25.615+0000 7fd61b829640 1 -- 172.21.15.83:0/1363840202 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd614102a60 msgr2=0x7fd614102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:39:25.635 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:25.615+0000 7fd61b829640 1 --2- 172.21.15.83:0/1363840202 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd614102a60 0x7fd614102e70 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fd610009900 tx=0x7fd61002a410 comp rx=0 tx=0).stop 2024-09-21T01:39:25.635 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:25.615+0000 7fd61b829640 1 -- 172.21.15.83:0/1363840202 shutdown_connections 2024-09-21T01:39:25.635 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:25.615+0000 7fd61b829640 1 --2- 172.21.15.83:0/1363840202 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd614108cf0 0x7fd61410f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:25.635 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:25.615+0000 7fd61b829640 1 --2- 172.21.15.83:0/1363840202 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd6141083a0 0x7fd6141087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:25.635 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:25.615+0000 7fd61b829640 1 --2- 172.21.15.83:0/1363840202 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd614102a60 0x7fd614102e70 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:25.635 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:25.615+0000 7fd61b829640 1 -- 172.21.15.83:0/1363840202 >> 172.21.15.83:0/1363840202 conn(0x7fd614079730 msgr2=0x7fd614079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:39:25.635 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:25.615+0000 7fd61b829640 1 -- 172.21.15.83:0/1363840202 shutdown_connections 2024-09-21T01:39:25.635 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:25.615+0000 7fd61b829640 1 -- 172.21.15.83:0/1363840202 wait complete. 2024-09-21T01:39:25.635 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:25.616+0000 7fd61b829640 1 Processor -- start 2024-09-21T01:39:25.635 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:25.616+0000 7fd61b829640 1 -- start start 2024-09-21T01:39:25.636 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:25.616+0000 7fd61b829640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd614102a60 0x7fd6141992c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:39:25.636 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:25.616+0000 7fd61b829640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd6141083a0 0x7fd614199860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:39:25.636 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:25.616+0000 7fd61b829640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd614108cf0 0x7fd61419eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:39:25.636 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:25.616+0000 7fd61b829640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fd614112870 con 0x7fd6141083a0 2024-09-21T01:39:25.636 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:25.616+0000 7fd61b829640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fd6141126f0 con 0x7fd614102a60 2024-09-21T01:39:25.636 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:25.616+0000 7fd61b829640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fd6141129f0 con 0x7fd614108cf0 2024-09-21T01:39:25.636 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:25.617+0000 7fd618dc4640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd6141083a0 0x7fd614199860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:39:25.636 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:25.617+0000 7fd618dc4640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd6141083a0 0x7fd614199860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:50636/0 (socket says 172.21.15.83:50636) 2024-09-21T01:39:25.636 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:25.617+0000 7fd618dc4640 1 -- 172.21.15.83:0/1596736899 learned_addr learned my addr 172.21.15.83:0/1596736899 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:39:25.636 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:25.617+0000 7fd619dc6640 1 --2- 172.21.15.83:0/1596736899 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd614108cf0 0x7fd61419eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:39:25.636 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:25.617+0000 7fd6195c5640 1 --2- 172.21.15.83:0/1596736899 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd614102a60 0x7fd6141992c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:39:25.636 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:25.617+0000 7fd618dc4640 1 -- 172.21.15.83:0/1596736899 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd614108cf0 msgr2=0x7fd61419eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:39:25.637 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:25.617+0000 7fd618dc4640 1 --2- 172.21.15.83:0/1596736899 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd614108cf0 0x7fd61419eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:25.637 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:25.617+0000 7fd618dc4640 1 -- 172.21.15.83:0/1596736899 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd614102a60 msgr2=0x7fd6141992c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:39:25.637 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:25.617+0000 7fd618dc4640 1 --2- 172.21.15.83:0/1596736899 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd614102a60 0x7fd6141992c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:25.637 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:25.617+0000 7fd618dc4640 1 -- 172.21.15.83:0/1596736899 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd61419f230 con 0x7fd6141083a0 2024-09-21T01:39:25.637 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:25.617+0000 7fd618dc4640 1 --2- 172.21.15.83:0/1596736899 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd6141083a0 0x7fd614199860 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fd604005fd0 tx=0x7fd60400dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:39:25.637 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:25.617+0000 7fd60a7fc640 1 -- 172.21.15.83:0/1596736899 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd604017070 con 0x7fd6141083a0 2024-09-21T01:39:25.637 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:25.617+0000 7fd60a7fc640 1 -- 172.21.15.83:0/1596736899 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd604009c30 con 0x7fd6141083a0 2024-09-21T01:39:25.637 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:25.617+0000 7fd61b829640 1 -- 172.21.15.83:0/1596736899 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd61419f520 con 0x7fd6141083a0 2024-09-21T01:39:25.637 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:25.617+0000 7fd60a7fc640 1 -- 172.21.15.83:0/1596736899 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd604003c70 con 0x7fd6141083a0 2024-09-21T01:39:25.637 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:25.617+0000 7fd61b829640 1 -- 172.21.15.83:0/1596736899 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6141a5c80 con 0x7fd6141083a0 2024-09-21T01:39:25.637 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:25.618+0000 7fd61b829640 1 -- 172.21.15.83:0/1596736899 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd614102e70 con 0x7fd6141083a0 2024-09-21T01:39:25.637 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:25.621+0000 7fd60a7fc640 1 -- 172.21.15.83:0/1596736899 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 20) ==== 154529+0+0 (secure 0 0 0) 0x7fd604003e10 con 0x7fd6141083a0 2024-09-21T01:39:25.637 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:25.621+0000 7fd60a7fc640 1 --2- 172.21.15.83:0/1596736899 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fd6000b65e0 0x7fd6000b8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:39:25.637 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:25.621+0000 7fd6195c5640 1 --2- 172.21.15.83:0/1596736899 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fd6000b65e0 0x7fd6000b8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:39:25.638 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:25.622+0000 7fd60a7fc640 1 -- 172.21.15.83:0/1596736899 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7342+0+0 (secure 0 0 0) 0x7fd6040e73e0 con 0x7fd6141083a0 2024-09-21T01:39:25.638 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:25.622+0000 7fd6195c5640 1 --2- 172.21.15.83:0/1596736899 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fd6000b65e0 0x7fd6000b8af0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fd610000c00 tx=0x7fd610009680 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:39:25.638 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:25.625+0000 7fd60a7fc640 1 -- 172.21.15.83:0/1596736899 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd604020030 con 0x7fd6141083a0 2024-09-21T01:39:25.828 INFO:journalctl@ceph.mds.i.smithi142.stdout:Sep 21 01:39:25 smithi142 systemd[1]: Starting Ceph mds.i for f7697ecc-77b8-11ef-baf5-efdc52797490... 2024-09-21T01:39:25.847 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T01:39:25.847 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":9,"btime":"2024-09-21T01:39:23:813961+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14775,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6835/1105040204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":1105040204},{"type":"v1","addr":"172.21.15.83:6835","nonce":1105040204}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14787,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/2234789563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6836","nonce":2234789563},{"type":"v1","addr":"172.21.15.83:6837","nonce":2234789563}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24569,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/2839502433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":2839502433},{"type":"v1","addr":"172.21.15.119:6833","nonce":2839502433}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24580,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6833/2841606990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":2841606990},{"type":"v1","addr":"172.21.15.142:6833","nonce":2841606990}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24599,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/415902608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":415902608},{"type":"v1","addr":"172.21.15.119:6835","nonce":415902608}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24607,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/3009088510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":3009088510},{"type":"v1","addr":"172.21.15.142:6835","nonce":3009088510}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24613,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/3847200126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6836","nonce":3847200126},{"type":"v1","addr":"172.21.15.142:6837","nonce":3847200126}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24626,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/3619222976","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":3619222976},{"type":"v1","addr":"172.21.15.119:6837","nonce":3619222976}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-09-21T01:39:25.847 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:25.844+0000 7fd61b829640 1 -- 172.21.15.83:0/1596736899 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd61419a3f0 con 0x7fd6141083a0 2024-09-21T01:39:25.847 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:25.845+0000 7fd60a7fc640 1 -- 172.21.15.83:0/1596736899 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+7225 (secure 0 0 0) 0x7fd61419a3f0 con 0x7fd6141083a0 2024-09-21T01:39:25.848 INFO:teuthology.orchestra.run.smithi083.stderr:dumped fsmap epoch 9 2024-09-21T01:39:25.849 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:25.847+0000 7fd61b829640 1 -- 172.21.15.83:0/1596736899 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fd6000b65e0 msgr2=0x7fd6000b8af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:39:25.849 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:25.847+0000 7fd61b829640 1 --2- 172.21.15.83:0/1596736899 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fd6000b65e0 0x7fd6000b8af0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fd610000c00 tx=0x7fd610009680 comp rx=0 tx=0).stop 2024-09-21T01:39:25.850 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:25.847+0000 7fd61b829640 1 -- 172.21.15.83:0/1596736899 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd6141083a0 msgr2=0x7fd614199860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:39:25.850 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:25.847+0000 7fd61b829640 1 --2- 172.21.15.83:0/1596736899 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd6141083a0 0x7fd614199860 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fd604005fd0 tx=0x7fd60400dde0 comp rx=0 tx=0).stop 2024-09-21T01:39:25.850 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:25.847+0000 7fd61b829640 1 -- 172.21.15.83:0/1596736899 shutdown_connections 2024-09-21T01:39:25.850 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:25.847+0000 7fd61b829640 1 --2- 172.21.15.83:0/1596736899 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fd6000b65e0 0x7fd6000b8af0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:25.850 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:25.847+0000 7fd61b829640 1 --2- 172.21.15.83:0/1596736899 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd614108cf0 0x7fd61419eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:25.850 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:25.847+0000 7fd61b829640 1 --2- 172.21.15.83:0/1596736899 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd6141083a0 0x7fd614199860 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:25.851 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:25.847+0000 7fd61b829640 1 --2- 172.21.15.83:0/1596736899 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd614102a60 0x7fd6141992c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:25.851 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:25.847+0000 7fd61b829640 1 -- 172.21.15.83:0/1596736899 >> 172.21.15.83:0/1596736899 conn(0x7fd614079730 msgr2=0x7fd6141014e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:39:25.851 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:25.847+0000 7fd61b829640 1 -- 172.21.15.83:0/1596736899 shutdown_connections 2024-09-21T01:39:25.851 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:25.847+0000 7fd61b829640 1 -- 172.21.15.83:0/1596736899 wait complete. 2024-09-21T01:39:26.128 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:25 smithi142 ceph-mon[34050]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:39:26.129 INFO:journalctl@ceph.mds.i.smithi142.stdout:Sep 21 01:39:25 smithi142 podman[63794]: 2024-09-21 01:39:25.783442371 +0000 UTC m=+0.016145663 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T01:39:26.129 INFO:journalctl@ceph.mds.i.smithi142.stdout:Sep 21 01:39:25 smithi142 podman[63794]: 2024-09-21 01:39:25.901242763 +0000 UTC m=+0.133946043 container create 5a605597b7bd67439d2644f000dcd27e6edc8a60b9b0f2705ef49b9fbc3f8ef9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mds-i, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-09-21T01:39:26.129 INFO:journalctl@ceph.mds.i.smithi142.stdout:Sep 21 01:39:26 smithi142 podman[63794]: 2024-09-21 01:39:26.128888876 +0000 UTC m=+0.361592156 container init 5a605597b7bd67439d2644f000dcd27e6edc8a60b9b0f2705ef49b9fbc3f8ef9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mds-i, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-09-21T01:39:26.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:25 smithi119 ceph-mon[33693]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:39:26.222 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:25 smithi083 ceph-mon[31370]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:39:26.464 INFO:journalctl@ceph.mds.i.smithi142.stdout:Sep 21 01:39:26 smithi142 podman[63794]: 2024-09-21 01:39:26.131966112 +0000 UTC m=+0.364669392 container start 5a605597b7bd67439d2644f000dcd27e6edc8a60b9b0f2705ef49b9fbc3f8ef9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mds-i, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-09-21T01:39:26.465 INFO:journalctl@ceph.mds.i.smithi142.stdout:Sep 21 01:39:26 smithi142 ceph-mds[63814]: -- 172.21.15.142:0/2704417176 <== mon.1 v2:172.21.15.142:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55f8b4c63860 con 0x55f8b8e0b600 2024-09-21T01:39:26.465 INFO:journalctl@ceph.mds.i.smithi142.stdout:Sep 21 01:39:26 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mds-i[63810]: starting mds.i at 2024-09-21T01:39:26.465 INFO:journalctl@ceph.mds.i.smithi142.stdout:Sep 21 01:39:26 smithi142 bash[63794]: 5a605597b7bd67439d2644f000dcd27e6edc8a60b9b0f2705ef49b9fbc3f8ef9 2024-09-21T01:39:26.465 INFO:journalctl@ceph.mds.i.smithi142.stdout:Sep 21 01:39:26 smithi142 systemd[1]: Started Ceph mds.i for f7697ecc-77b8-11ef-baf5-efdc52797490. 2024-09-21T01:39:27.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:26 smithi142 ceph-mon[34050]: from='client.? 172.21.15.83:0/1596736899' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:39:27.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:26 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:39:27.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:26 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:39:27.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:26 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:39:27.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:26 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T01:39:27.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:26 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T01:39:27.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:26 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:39:27.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:26 smithi119 ceph-mon[33693]: from='client.? 172.21.15.83:0/1596736899' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:39:27.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:26 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:39:27.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:26 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:39:27.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:26 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:39:27.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:26 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T01:39:27.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:26 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T01:39:27.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:26 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:39:27.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:26 smithi083 ceph-mon[31370]: from='client.? 172.21.15.83:0/1596736899' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:39:27.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:26 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:39:27.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:26 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:39:27.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:26 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:39:27.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:26 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T01:39:27.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:26 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T01:39:27.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:26 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:39:27.998 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:27 smithi083 ceph-mon[31370]: Deploying daemon mds.g on smithi083 2024-09-21T01:39:27.998 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:27 smithi083 ceph-mon[31370]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:39:27.998 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:27 smithi083 ceph-mon[31370]: mds.? [v2:172.21.15.142:6838/1817880741,v1:172.21.15.142:6839/1817880741] up:boot 2024-09-21T01:39:27.998 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:27 smithi083 ceph-mon[31370]: fsmap 9 up:standby 2024-09-21T01:39:27.998 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:27 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-21T01:39:28.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:27 smithi142 ceph-mon[34050]: Deploying daemon mds.g on smithi083 2024-09-21T01:39:28.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:27 smithi142 ceph-mon[34050]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:39:28.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:27 smithi142 ceph-mon[34050]: mds.? [v2:172.21.15.142:6838/1817880741,v1:172.21.15.142:6839/1817880741] up:boot 2024-09-21T01:39:28.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:27 smithi142 ceph-mon[34050]: fsmap 9 up:standby 2024-09-21T01:39:28.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:27 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-21T01:39:28.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:27 smithi119 ceph-mon[33693]: Deploying daemon mds.g on smithi083 2024-09-21T01:39:28.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:27 smithi119 ceph-mon[33693]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:39:28.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:27 smithi119 ceph-mon[33693]: mds.? [v2:172.21.15.142:6838/1817880741,v1:172.21.15.142:6839/1817880741] up:boot 2024-09-21T01:39:28.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:27 smithi119 ceph-mon[33693]: fsmap 9 up:standby 2024-09-21T01:39:28.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:27 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-21T01:39:28.304 INFO:journalctl@ceph.mds.g.smithi083.stdout:Sep 21 01:39:28 smithi083 systemd[1]: Starting Ceph mds.g for f7697ecc-77b8-11ef-baf5-efdc52797490... 2024-09-21T01:39:28.561 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T01:39:28.723 INFO:journalctl@ceph.mds.g.smithi083.stdout:Sep 21 01:39:28 smithi083 podman[73748]: 2024-09-21 01:39:28.290633382 +0000 UTC m=+0.015749245 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T01:39:28.723 INFO:journalctl@ceph.mds.g.smithi083.stdout:Sep 21 01:39:28 smithi083 podman[73748]: 2024-09-21 01:39:28.420452515 +0000 UTC m=+0.145568367 container create 916c01e0c41057f9bbaf94125d16f4ba8b47c57137fb3f01c57dcb61306b3e6a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mds-g, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2) 2024-09-21T01:39:28.723 INFO:journalctl@ceph.mds.g.smithi083.stdout:Sep 21 01:39:28 smithi083 podman[73748]: 2024-09-21 01:39:28.723621918 +0000 UTC m=+0.448737783 container init 916c01e0c41057f9bbaf94125d16f4ba8b47c57137fb3f01c57dcb61306b3e6a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mds-g, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T01:39:28.906 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:39:29.030 INFO:journalctl@ceph.mds.g.smithi083.stdout:Sep 21 01:39:28 smithi083 podman[73748]: 2024-09-21 01:39:28.726808282 +0000 UTC m=+0.451924140 container start 916c01e0c41057f9bbaf94125d16f4ba8b47c57137fb3f01c57dcb61306b3e6a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mds-g, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True) 2024-09-21T01:39:29.030 INFO:journalctl@ceph.mds.g.smithi083.stdout:Sep 21 01:39:28 smithi083 ceph-mds[73786]: -- 172.21.15.83:0/3477649089 <== mon.0 v2:172.21.15.83:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55ef3c309c20 con 0x55ef404b1180 2024-09-21T01:39:29.030 INFO:journalctl@ceph.mds.g.smithi083.stdout:Sep 21 01:39:28 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mds-g[73764]: starting mds.g at 2024-09-21T01:39:29.030 INFO:journalctl@ceph.mds.g.smithi083.stdout:Sep 21 01:39:28 smithi083 bash[73748]: 916c01e0c41057f9bbaf94125d16f4ba8b47c57137fb3f01c57dcb61306b3e6a 2024-09-21T01:39:29.030 INFO:journalctl@ceph.mds.g.smithi083.stdout:Sep 21 01:39:28 smithi083 systemd[1]: Started Ceph mds.g for f7697ecc-77b8-11ef-baf5-efdc52797490. 2024-09-21T01:39:29.436 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:29.421+0000 7fc993be7640 1 -- 172.21.15.83:0/289568815 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc98c101f70 msgr2=0x7fc98c102380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:39:29.436 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:29.421+0000 7fc993be7640 1 --2- 172.21.15.83:0/289568815 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc98c101f70 0x7fc98c102380 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fc984009ca0 tx=0x7fc98402a8c0 comp rx=0 tx=0).stop 2024-09-21T01:39:29.436 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:29.421+0000 7fc993be7640 1 -- 172.21.15.83:0/289568815 shutdown_connections 2024-09-21T01:39:29.437 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:29.421+0000 7fc993be7640 1 --2- 172.21.15.83:0/289568815 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc98c109e00 0x7fc98c110630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:29.437 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:29.421+0000 7fc993be7640 1 --2- 172.21.15.83:0/289568815 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc98c1094b0 0x7fc98c1098c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:29.437 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:29.421+0000 7fc993be7640 1 --2- 172.21.15.83:0/289568815 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc98c101f70 0x7fc98c102380 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:29.437 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:29.421+0000 7fc993be7640 1 -- 172.21.15.83:0/289568815 >> 172.21.15.83:0/289568815 conn(0x7fc98c077c60 msgr2=0x7fc98c0780a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:39:29.437 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:29.421+0000 7fc993be7640 1 -- 172.21.15.83:0/289568815 shutdown_connections 2024-09-21T01:39:29.437 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:29.421+0000 7fc993be7640 1 -- 172.21.15.83:0/289568815 wait complete. 2024-09-21T01:39:29.437 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:29.422+0000 7fc993be7640 1 Processor -- start 2024-09-21T01:39:29.437 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:29.422+0000 7fc993be7640 1 -- start start 2024-09-21T01:39:29.437 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:29.422+0000 7fc993be7640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc98c101f70 0x7fc98c19a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:39:29.437 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:29.422+0000 7fc993be7640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc98c1094b0 0x7fc98c19a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:39:29.437 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:29.422+0000 7fc993be7640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc98c109e00 0x7fc98c19fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:39:29.437 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:29.422+0000 7fc993be7640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fc98c1139c0 con 0x7fc98c1094b0 2024-09-21T01:39:29.437 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:29.422+0000 7fc993be7640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fc98c113840 con 0x7fc98c101f70 2024-09-21T01:39:29.437 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:29.422+0000 7fc993be7640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fc98c113b40 con 0x7fc98c109e00 2024-09-21T01:39:29.437 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:29.422+0000 7fc991182640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc98c1094b0 0x7fc98c19a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:39:29.438 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:29.422+0000 7fc991182640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc98c1094b0 0x7fc98c19a950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:50672/0 (socket says 172.21.15.83:50672) 2024-09-21T01:39:29.438 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:29.422+0000 7fc991182640 1 -- 172.21.15.83:0/3612693320 learned_addr learned my addr 172.21.15.83:0/3612693320 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:39:29.438 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:29.422+0000 7fc991983640 1 --2- 172.21.15.83:0/3612693320 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc98c101f70 0x7fc98c19a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:39:29.438 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:29.422+0000 7fc992184640 1 --2- 172.21.15.83:0/3612693320 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc98c109e00 0x7fc98c19fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:39:29.438 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:29.423+0000 7fc991182640 1 -- 172.21.15.83:0/3612693320 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc98c109e00 msgr2=0x7fc98c19fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:39:29.438 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:29.423+0000 7fc991182640 1 --2- 172.21.15.83:0/3612693320 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc98c109e00 0x7fc98c19fbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:29.438 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:29.423+0000 7fc991182640 1 -- 172.21.15.83:0/3612693320 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc98c101f70 msgr2=0x7fc98c19a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:39:29.438 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:29.423+0000 7fc991182640 1 --2- 172.21.15.83:0/3612693320 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc98c101f70 0x7fc98c19a3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:29.438 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:29.423+0000 7fc991182640 1 -- 172.21.15.83:0/3612693320 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc98c1a0320 con 0x7fc98c1094b0 2024-09-21T01:39:29.438 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:29.423+0000 7fc992184640 1 --2- 172.21.15.83:0/3612693320 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc98c109e00 0x7fc98c19fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:39:29.438 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:29.423+0000 7fc991182640 1 --2- 172.21.15.83:0/3612693320 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc98c1094b0 0x7fc98c19a950 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fc98000e9f0 tx=0x7fc98000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:39:29.438 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:29.423+0000 7fc98affd640 1 -- 172.21.15.83:0/3612693320 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc98000ccc0 con 0x7fc98c1094b0 2024-09-21T01:39:29.438 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:29.423+0000 7fc993be7640 1 -- 172.21.15.83:0/3612693320 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc98c1a0610 con 0x7fc98c1094b0 2024-09-21T01:39:29.438 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:29.423+0000 7fc98affd640 1 -- 172.21.15.83:0/3612693320 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc9800108c0 con 0x7fc98c1094b0 2024-09-21T01:39:29.438 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:29.423+0000 7fc98affd640 1 -- 172.21.15.83:0/3612693320 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc980018660 con 0x7fc98c1094b0 2024-09-21T01:39:29.439 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:29.423+0000 7fc993be7640 1 -- 172.21.15.83:0/3612693320 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc98c1a6d70 con 0x7fc98c1094b0 2024-09-21T01:39:29.439 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:29.424+0000 7fc993be7640 1 -- 172.21.15.83:0/3612693320 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc98c102380 con 0x7fc98c1094b0 2024-09-21T01:39:29.439 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:29.426+0000 7fc98affd640 1 -- 172.21.15.83:0/3612693320 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 20) ==== 154529+0+0 (secure 0 0 0) 0x7fc980010430 con 0x7fc98c1094b0 2024-09-21T01:39:29.439 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:29.426+0000 7fc98affd640 1 --2- 172.21.15.83:0/3612693320 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fc9740b6560 0x7fc9740b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:39:29.439 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:29.426+0000 7fc991983640 1 --2- 172.21.15.83:0/3612693320 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fc9740b6560 0x7fc9740b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:39:29.439 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:29.426+0000 7fc98affd640 1 -- 172.21.15.83:0/3612693320 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7342+0+0 (secure 0 0 0) 0x7fc9800e78d0 con 0x7fc98c1094b0 2024-09-21T01:39:29.439 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:29.427+0000 7fc991983640 1 --2- 172.21.15.83:0/3612693320 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fc9740b6560 0x7fc9740b8a70 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fc984000f80 tx=0x7fc984031000 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:39:29.439 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:29.430+0000 7fc98affd640 1 -- 172.21.15.83:0/3612693320 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc9800ae530 con 0x7fc98c1094b0 2024-09-21T01:39:29.654 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:29.654+0000 7fc993be7640 1 -- 172.21.15.83:0/3612693320 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc98c19b4e0 con 0x7fc98c1094b0 2024-09-21T01:39:29.655 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:29.654+0000 7fc98affd640 1 -- 172.21.15.83:0/3612693320 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) ==== 94+0+8878 (secure 0 0 0) 0x7fc9800b2910 con 0x7fc98c1094b0 2024-09-21T01:39:29.655 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T01:39:29.655 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":11,"btime":"2024-09-21T01:39:28:835025+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14775,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6835/1105040204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":1105040204},{"type":"v1","addr":"172.21.15.83:6835","nonce":1105040204}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14787,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/2234789563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6836","nonce":2234789563},{"type":"v1","addr":"172.21.15.83:6837","nonce":2234789563}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14838,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6839/136258364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6838","nonce":136258364},{"type":"v1","addr":"172.21.15.83:6839","nonce":136258364}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24569,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/2839502433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":2839502433},{"type":"v1","addr":"172.21.15.119:6833","nonce":2839502433}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24580,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6833/2841606990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":2841606990},{"type":"v1","addr":"172.21.15.142:6833","nonce":2841606990}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24599,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/415902608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":415902608},{"type":"v1","addr":"172.21.15.119:6835","nonce":415902608}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24607,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/3009088510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":3009088510},{"type":"v1","addr":"172.21.15.142:6835","nonce":3009088510}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24613,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/3847200126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6836","nonce":3847200126},{"type":"v1","addr":"172.21.15.142:6837","nonce":3847200126}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24626,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/3619222976","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":3619222976},{"type":"v1","addr":"172.21.15.119:6837","nonce":3619222976}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24631,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6839/1817880741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6838","nonce":1817880741},{"type":"v1","addr":"172.21.15.142:6839","nonce":1817880741}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-21T01:39:29.655 INFO:teuthology.orchestra.run.smithi083.stderr:dumped fsmap epoch 11 2024-09-21T01:39:29.657 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:29.657+0000 7fc993be7640 1 -- 172.21.15.83:0/3612693320 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fc9740b6560 msgr2=0x7fc9740b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:39:29.657 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:29.657+0000 7fc993be7640 1 --2- 172.21.15.83:0/3612693320 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fc9740b6560 0x7fc9740b8a70 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fc984000f80 tx=0x7fc984031000 comp rx=0 tx=0).stop 2024-09-21T01:39:29.658 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:29.657+0000 7fc993be7640 1 -- 172.21.15.83:0/3612693320 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc98c1094b0 msgr2=0x7fc98c19a950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:39:29.658 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:29.657+0000 7fc993be7640 1 --2- 172.21.15.83:0/3612693320 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc98c1094b0 0x7fc98c19a950 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fc98000e9f0 tx=0x7fc98000eeb0 comp rx=0 tx=0).stop 2024-09-21T01:39:29.658 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:29.657+0000 7fc993be7640 1 -- 172.21.15.83:0/3612693320 shutdown_connections 2024-09-21T01:39:29.658 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:29.657+0000 7fc993be7640 1 --2- 172.21.15.83:0/3612693320 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fc9740b6560 0x7fc9740b8a70 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:29.658 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:29.657+0000 7fc993be7640 1 --2- 172.21.15.83:0/3612693320 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc98c109e00 0x7fc98c19fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:29.658 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:29.657+0000 7fc993be7640 1 --2- 172.21.15.83:0/3612693320 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc98c1094b0 0x7fc98c19a950 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:29.658 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:29.657+0000 7fc993be7640 1 --2- 172.21.15.83:0/3612693320 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc98c101f70 0x7fc98c19a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:29.658 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:29.657+0000 7fc993be7640 1 -- 172.21.15.83:0/3612693320 >> 172.21.15.83:0/3612693320 conn(0x7fc98c077c60 msgr2=0x7fc98c1075a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:39:29.658 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:29.657+0000 7fc993be7640 1 -- 172.21.15.83:0/3612693320 shutdown_connections 2024-09-21T01:39:29.658 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:29.657+0000 7fc993be7640 1 -- 172.21.15.83:0/3612693320 wait complete. 2024-09-21T01:39:30.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:29 smithi083 ceph-mon[31370]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:39:30.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:29 smithi083 ceph-mon[31370]: mds.? [v2:172.21.15.83:6838/136258364,v1:172.21.15.83:6839/136258364] up:boot 2024-09-21T01:39:30.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:29 smithi083 ceph-mon[31370]: fsmap 10 up:standby 2024-09-21T01:39:30.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:29 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-09-21T01:39:30.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:29 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:39:30.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:29 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:39:30.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:29 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:39:30.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:29 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T01:39:30.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:29 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T01:39:30.055 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:29 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:39:30.055 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:29 smithi083 ceph-mon[31370]: from='client.? 172.21.15.83:0/3612693320' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:39:30.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:29 smithi142 ceph-mon[34050]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:39:30.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:29 smithi142 ceph-mon[34050]: mds.? [v2:172.21.15.83:6838/136258364,v1:172.21.15.83:6839/136258364] up:boot 2024-09-21T01:39:30.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:29 smithi142 ceph-mon[34050]: fsmap 10 up:standby 2024-09-21T01:39:30.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:29 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-09-21T01:39:30.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:29 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:39:30.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:29 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:39:30.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:29 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:39:30.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:29 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T01:39:30.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:29 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T01:39:30.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:29 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:39:30.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:29 smithi142 ceph-mon[34050]: from='client.? 172.21.15.83:0/3612693320' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:39:30.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:29 smithi119 ceph-mon[33693]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:39:30.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:29 smithi119 ceph-mon[33693]: mds.? [v2:172.21.15.83:6838/136258364,v1:172.21.15.83:6839/136258364] up:boot 2024-09-21T01:39:30.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:29 smithi119 ceph-mon[33693]: fsmap 10 up:standby 2024-09-21T01:39:30.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:29 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-09-21T01:39:30.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:29 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:39:30.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:29 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:39:30.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:29 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:39:30.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:29 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T01:39:30.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:29 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T01:39:30.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:29 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:39:30.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:29 smithi119 ceph-mon[33693]: from='client.? 172.21.15.83:0/3612693320' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:39:31.051 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:30 smithi083 ceph-mon[31370]: Deploying daemon mds.a on smithi083 2024-09-21T01:39:31.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:30 smithi142 ceph-mon[34050]: Deploying daemon mds.a on smithi083 2024-09-21T01:39:31.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:30 smithi119 ceph-mon[33693]: Deploying daemon mds.a on smithi083 2024-09-21T01:39:32.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:31 smithi083 ceph-mon[31370]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:39:32.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:31 smithi142 ceph-mon[34050]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:39:32.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:31 smithi119 ceph-mon[33693]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:39:32.443 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T01:39:32.701 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:39:33.180 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:33.171+0000 7f3a71897640 1 -- 172.21.15.83:0/4285154767 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3a6c102ac0 msgr2=0x7f3a6c102ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:39:33.181 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:33.171+0000 7f3a71897640 1 --2- 172.21.15.83:0/4285154767 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3a6c102ac0 0x7f3a6c102ed0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f3a5c009900 tx=0x7f3a5c02a410 comp rx=0 tx=0).stop 2024-09-21T01:39:33.181 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:33.171+0000 7f3a71897640 1 -- 172.21.15.83:0/4285154767 shutdown_connections 2024-09-21T01:39:33.181 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:33.171+0000 7f3a71897640 1 --2- 172.21.15.83:0/4285154767 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3a6c108d00 0x7f3a6c10f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:33.181 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:33.171+0000 7f3a71897640 1 --2- 172.21.15.83:0/4285154767 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3a6c1083b0 0x7f3a6c1087c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:33.181 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:33.171+0000 7f3a71897640 1 --2- 172.21.15.83:0/4285154767 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3a6c102ac0 0x7f3a6c102ed0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:33.181 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:33.171+0000 7f3a71897640 1 -- 172.21.15.83:0/4285154767 >> 172.21.15.83:0/4285154767 conn(0x7f3a6c079720 msgr2=0x7f3a6c079b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:39:33.181 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:33.171+0000 7f3a71897640 1 -- 172.21.15.83:0/4285154767 shutdown_connections 2024-09-21T01:39:33.181 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:33.171+0000 7f3a71897640 1 -- 172.21.15.83:0/4285154767 wait complete. 2024-09-21T01:39:33.181 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:33.172+0000 7f3a71897640 1 Processor -- start 2024-09-21T01:39:33.181 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:33.172+0000 7f3a71897640 1 -- start start 2024-09-21T01:39:33.181 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:33.172+0000 7f3a71897640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3a6c102ac0 0x7f3a6c0ff650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:39:33.181 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:33.172+0000 7f3a71897640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3a6c1083b0 0x7f3a6c0ffb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:39:33.182 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:33.172+0000 7f3a71897640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3a6c108d00 0x7f3a6c1000d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:39:33.182 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:33.172+0000 7f3a71897640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f3a6c112870 con 0x7f3a6c102ac0 2024-09-21T01:39:33.182 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:33.173+0000 7f3a71897640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f3a6c1126f0 con 0x7f3a6c1083b0 2024-09-21T01:39:33.182 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:33.173+0000 7f3a71897640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f3a6c1129f0 con 0x7f3a6c108d00 2024-09-21T01:39:33.182 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:33.173+0000 7f3a6affd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3a6c102ac0 0x7f3a6c0ff650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:39:33.182 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:33.173+0000 7f3a6affd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3a6c102ac0 0x7f3a6c0ff650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:39398/0 (socket says 172.21.15.83:39398) 2024-09-21T01:39:33.182 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:33.173+0000 7f3a6affd640 1 -- 172.21.15.83:0/2759371292 learned_addr learned my addr 172.21.15.83:0/2759371292 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:39:33.182 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:33.173+0000 7f3a6a7fc640 1 --2- 172.21.15.83:0/2759371292 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3a6c1083b0 0x7f3a6c0ffb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:39:33.182 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:33.173+0000 7f3a6affd640 1 -- 172.21.15.83:0/2759371292 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3a6c108d00 msgr2=0x7f3a6c1000d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:39:33.182 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:33.173+0000 7f3a6b7fe640 1 --2- 172.21.15.83:0/2759371292 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3a6c108d00 0x7f3a6c1000d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:39:33.182 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:33.173+0000 7f3a6affd640 1 --2- 172.21.15.83:0/2759371292 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3a6c108d00 0x7f3a6c1000d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:33.182 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:33.173+0000 7f3a6affd640 1 -- 172.21.15.83:0/2759371292 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3a6c1083b0 msgr2=0x7f3a6c0ffb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:39:33.183 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:33.173+0000 7f3a6affd640 1 --2- 172.21.15.83:0/2759371292 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3a6c1083b0 0x7f3a6c0ffb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:33.183 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:33.173+0000 7f3a6affd640 1 -- 172.21.15.83:0/2759371292 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a6c1a8690 con 0x7f3a6c102ac0 2024-09-21T01:39:33.183 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:33.173+0000 7f3a6affd640 1 --2- 172.21.15.83:0/2759371292 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3a6c102ac0 0x7f3a6c0ff650 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f3a5c009230 tx=0x7f3a5c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:39:33.183 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:33.173+0000 7f3a70895640 1 -- 172.21.15.83:0/2759371292 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a5c03f030 con 0x7f3a6c102ac0 2024-09-21T01:39:33.183 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:33.173+0000 7f3a71897640 1 -- 172.21.15.83:0/2759371292 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a6c1a8920 con 0x7f3a6c102ac0 2024-09-21T01:39:33.183 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:33.173+0000 7f3a70895640 1 -- 172.21.15.83:0/2759371292 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3a5c003a80 con 0x7f3a6c102ac0 2024-09-21T01:39:33.183 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:33.173+0000 7f3a70895640 1 -- 172.21.15.83:0/2759371292 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a5c035070 con 0x7f3a6c102ac0 2024-09-21T01:39:33.183 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:33.173+0000 7f3a71897640 1 -- 172.21.15.83:0/2759371292 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a6c1a8e50 con 0x7f3a6c102ac0 2024-09-21T01:39:33.183 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:33.174+0000 7f3a71897640 1 -- 172.21.15.83:0/2759371292 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a6c102ed0 con 0x7f3a6c102ac0 2024-09-21T01:39:33.183 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:33.176+0000 7f3a70895640 1 -- 172.21.15.83:0/2759371292 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 20) ==== 154529+0+0 (secure 0 0 0) 0x7f3a5c042030 con 0x7f3a6c102ac0 2024-09-21T01:39:33.183 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:33.176+0000 7f3a70895640 1 --2- 172.21.15.83:0/2759371292 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f3a540b6560 0x7f3a540b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:39:33.183 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:33.177+0000 7f3a6a7fc640 1 --2- 172.21.15.83:0/2759371292 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f3a540b6560 0x7f3a540b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:39:33.183 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:33.177+0000 7f3a70895640 1 -- 172.21.15.83:0/2759371292 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7342+0+0 (secure 0 0 0) 0x7f3a5c107b10 con 0x7f3a6c102ac0 2024-09-21T01:39:33.183 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:33.177+0000 7f3a6a7fc640 1 --2- 172.21.15.83:0/2759371292 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f3a540b6560 0x7f3a540b8a70 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f3a6c1049a0 tx=0x7f3a60005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:39:33.183 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:33.180+0000 7f3a70895640 1 -- 172.21.15.83:0/2759371292 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3a5c0ce770 con 0x7f3a6c102ac0 2024-09-21T01:39:33.395 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:33.394+0000 7f3a71897640 1 -- 172.21.15.83:0/2759371292 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3a6c100950 con 0x7f3a6c102ac0 2024-09-21T01:39:33.395 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:33.395+0000 7f3a70895640 1 -- 172.21.15.83:0/2759371292 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+9701 (secure 0 0 0) 0x7f3a6c100950 con 0x7f3a6c102ac0 2024-09-21T01:39:33.396 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T01:39:33.396 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":12,"btime":"2024-09-21T01:39:32:849842+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14775,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6835/1105040204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":1105040204},{"type":"v1","addr":"172.21.15.83:6835","nonce":1105040204}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14787,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/2234789563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6836","nonce":2234789563},{"type":"v1","addr":"172.21.15.83:6837","nonce":2234789563}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14838,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6839/136258364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6838","nonce":136258364},{"type":"v1","addr":"172.21.15.83:6839","nonce":136258364}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14850,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6841/129439444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6840","nonce":129439444},{"type":"v1","addr":"172.21.15.83:6841","nonce":129439444}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24569,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/2839502433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":2839502433},{"type":"v1","addr":"172.21.15.119:6833","nonce":2839502433}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24580,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6833/2841606990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":2841606990},{"type":"v1","addr":"172.21.15.142:6833","nonce":2841606990}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24599,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/415902608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":415902608},{"type":"v1","addr":"172.21.15.119:6835","nonce":415902608}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24607,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/3009088510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":3009088510},{"type":"v1","addr":"172.21.15.142:6835","nonce":3009088510}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24613,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/3847200126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6836","nonce":3847200126},{"type":"v1","addr":"172.21.15.142:6837","nonce":3847200126}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24626,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/3619222976","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":3619222976},{"type":"v1","addr":"172.21.15.119:6837","nonce":3619222976}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24631,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6839/1817880741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6838","nonce":1817880741},{"type":"v1","addr":"172.21.15.142:6839","nonce":1817880741}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-21T01:39:33.396 INFO:teuthology.orchestra.run.smithi083.stderr:dumped fsmap epoch 12 2024-09-21T01:39:33.398 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:33.397+0000 7f3a71897640 1 -- 172.21.15.83:0/2759371292 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f3a540b6560 msgr2=0x7f3a540b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:39:33.398 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:33.397+0000 7f3a71897640 1 --2- 172.21.15.83:0/2759371292 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f3a540b6560 0x7f3a540b8a70 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f3a6c1049a0 tx=0x7f3a60005f90 comp rx=0 tx=0).stop 2024-09-21T01:39:33.398 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:33.397+0000 7f3a71897640 1 -- 172.21.15.83:0/2759371292 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3a6c102ac0 msgr2=0x7f3a6c0ff650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:39:33.398 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:33.397+0000 7f3a71897640 1 --2- 172.21.15.83:0/2759371292 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3a6c102ac0 0x7f3a6c0ff650 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f3a5c009230 tx=0x7f3a5c004270 comp rx=0 tx=0).stop 2024-09-21T01:39:33.398 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:33.397+0000 7f3a71897640 1 -- 172.21.15.83:0/2759371292 shutdown_connections 2024-09-21T01:39:33.398 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:33.397+0000 7f3a71897640 1 --2- 172.21.15.83:0/2759371292 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f3a540b6560 0x7f3a540b8a70 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:33.398 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:33.397+0000 7f3a71897640 1 --2- 172.21.15.83:0/2759371292 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3a6c108d00 0x7f3a6c1000d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:33.398 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:33.397+0000 7f3a71897640 1 --2- 172.21.15.83:0/2759371292 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3a6c1083b0 0x7f3a6c0ffb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:33.399 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:33.397+0000 7f3a71897640 1 --2- 172.21.15.83:0/2759371292 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3a6c102ac0 0x7f3a6c0ff650 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:33.399 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:33.397+0000 7f3a71897640 1 -- 172.21.15.83:0/2759371292 >> 172.21.15.83:0/2759371292 conn(0x7f3a6c079720 msgr2=0x7f3a6c101b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:39:33.399 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:33.397+0000 7f3a71897640 1 -- 172.21.15.83:0/2759371292 shutdown_connections 2024-09-21T01:39:33.399 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:33.397+0000 7f3a71897640 1 -- 172.21.15.83:0/2759371292 wait complete. 2024-09-21T01:39:33.769 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:33 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:39:33.770 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:33 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:39:33.770 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:33 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:39:33.770 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:33 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T01:39:33.770 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:33 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T01:39:33.770 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:33 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:39:33.770 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:33 smithi083 ceph-mon[31370]: Deploying daemon mds.b on smithi119 2024-09-21T01:39:33.770 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:33 smithi083 ceph-mon[31370]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:39:33.770 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:33 smithi083 ceph-mon[31370]: mds.? [v2:172.21.15.83:6840/129439444,v1:172.21.15.83:6841/129439444] up:boot 2024-09-21T01:39:33.770 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:33 smithi083 ceph-mon[31370]: fsmap 11 up:standby 2024-09-21T01:39:33.770 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:33 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-09-21T01:39:33.770 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:33 smithi083 ceph-mon[31370]: from='client.? 172.21.15.83:0/2759371292' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:39:33.892 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:33 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:39:33.893 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:33 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:39:33.893 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:33 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:39:33.893 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:33 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T01:39:33.893 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:33 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T01:39:33.893 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:33 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:39:33.893 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:33 smithi119 ceph-mon[33693]: Deploying daemon mds.b on smithi119 2024-09-21T01:39:33.893 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:33 smithi119 ceph-mon[33693]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:39:33.893 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:33 smithi119 ceph-mon[33693]: mds.? [v2:172.21.15.83:6840/129439444,v1:172.21.15.83:6841/129439444] up:boot 2024-09-21T01:39:33.893 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:33 smithi119 ceph-mon[33693]: fsmap 11 up:standby 2024-09-21T01:39:33.893 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:33 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-09-21T01:39:33.893 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:33 smithi119 ceph-mon[33693]: from='client.? 172.21.15.83:0/2759371292' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:39:33.964 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:33 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:39:33.964 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:33 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:39:33.965 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:33 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:39:33.965 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:33 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T01:39:33.965 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:33 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T01:39:33.965 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:33 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:39:33.965 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:33 smithi142 ceph-mon[34050]: Deploying daemon mds.b on smithi119 2024-09-21T01:39:33.965 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:33 smithi142 ceph-mon[34050]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:39:33.965 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:33 smithi142 ceph-mon[34050]: mds.? [v2:172.21.15.83:6840/129439444,v1:172.21.15.83:6841/129439444] up:boot 2024-09-21T01:39:33.965 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:33 smithi142 ceph-mon[34050]: fsmap 11 up:standby 2024-09-21T01:39:33.965 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:33 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-09-21T01:39:33.965 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:33 smithi142 ceph-mon[34050]: from='client.? 172.21.15.83:0/2759371292' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:39:34.468 INFO:journalctl@ceph.mds.b.smithi119.stdout:Sep 21 01:39:34 smithi119 systemd[1]: Starting Ceph mds.b for f7697ecc-77b8-11ef-baf5-efdc52797490... 2024-09-21T01:39:34.755 INFO:journalctl@ceph.mds.b.smithi119.stdout:Sep 21 01:39:34 smithi119 podman[62894]: 2024-09-21 01:39:34.505877849 +0000 UTC m=+0.015763020 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T01:39:34.755 INFO:journalctl@ceph.mds.b.smithi119.stdout:Sep 21 01:39:34 smithi119 podman[62894]: 2024-09-21 01:39:34.624809913 +0000 UTC m=+0.134695130 container create 13a7f0fdc45c8a56ad820582decdb2d427a512169199d67a0e538926450c1aaa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mds-b, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T01:39:35.218 INFO:journalctl@ceph.mds.b.smithi119.stdout:Sep 21 01:39:34 smithi119 podman[62894]: 2024-09-21 01:39:34.8729597 +0000 UTC m=+0.382844871 container init 13a7f0fdc45c8a56ad820582decdb2d427a512169199d67a0e538926450c1aaa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mds-b, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True) 2024-09-21T01:39:35.218 INFO:journalctl@ceph.mds.b.smithi119.stdout:Sep 21 01:39:34 smithi119 podman[62894]: 2024-09-21 01:39:34.875930321 +0000 UTC m=+0.385815501 container start 13a7f0fdc45c8a56ad820582decdb2d427a512169199d67a0e538926450c1aaa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mds-b, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T01:39:35.218 INFO:journalctl@ceph.mds.b.smithi119.stdout:Sep 21 01:39:34 smithi119 ceph-mds[62914]: -- 172.21.15.119:0/759201630 <== mon.2 v2:172.21.15.119:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55b9e46ed860 con 0x55b9e8895180 2024-09-21T01:39:35.218 INFO:journalctl@ceph.mds.b.smithi119.stdout:Sep 21 01:39:34 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mds-b[62910]: starting mds.b at 2024-09-21T01:39:35.218 INFO:journalctl@ceph.mds.b.smithi119.stdout:Sep 21 01:39:34 smithi119 bash[62894]: 13a7f0fdc45c8a56ad820582decdb2d427a512169199d67a0e538926450c1aaa 2024-09-21T01:39:35.218 INFO:journalctl@ceph.mds.b.smithi119.stdout:Sep 21 01:39:34 smithi119 systemd[1]: Started Ceph mds.b for f7697ecc-77b8-11ef-baf5-efdc52797490. 2024-09-21T01:39:35.917 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:35 smithi083 ceph-mon[31370]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:39:35.917 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:35 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:39:35.917 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:35 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:39:35.917 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:35 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:39:35.917 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:35 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:39:35.917 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:35 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:39:35.917 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:35 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:39:35.964 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:35 smithi142 ceph-mon[34050]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:39:35.965 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:35 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:39:35.965 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:35 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:39:35.965 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:35 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:39:35.965 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:35 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:39:35.965 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:35 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:39:35.965 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:35 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:39:35.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:35 smithi119 ceph-mon[33693]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:39:35.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:35 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:39:35.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:35 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:39:35.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:35 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:39:35.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:35 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:39:35.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:35 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:39:35.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:35 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:39:36.098 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T01:39:36.365 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:39:36.883 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:36.873+0000 7fa7440f6640 1 -- 172.21.15.83:0/410871711 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa73c108d00 msgr2=0x7fa73c10f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:39:36.883 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:36.873+0000 7fa7440f6640 1 --2- 172.21.15.83:0/410871711 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa73c108d00 0x7fa73c10f530 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fa734009ca0 tx=0x7fa73402a8c0 comp rx=0 tx=0).stop 2024-09-21T01:39:36.884 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:36.873+0000 7fa7440f6640 1 -- 172.21.15.83:0/410871711 shutdown_connections 2024-09-21T01:39:36.884 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:36.873+0000 7fa7440f6640 1 --2- 172.21.15.83:0/410871711 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa73c108d00 0x7fa73c10f530 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:36.884 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:36.873+0000 7fa7440f6640 1 --2- 172.21.15.83:0/410871711 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa73c1083b0 0x7fa73c1087c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:36.885 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:36.873+0000 7fa7440f6640 1 --2- 172.21.15.83:0/410871711 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa73c102a70 0x7fa73c102e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:36.885 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:36.873+0000 7fa7440f6640 1 -- 172.21.15.83:0/410871711 >> 172.21.15.83:0/410871711 conn(0x7fa73c079710 msgr2=0x7fa73c079b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:39:36.885 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:36.874+0000 7fa7440f6640 1 -- 172.21.15.83:0/410871711 shutdown_connections 2024-09-21T01:39:36.885 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:36.874+0000 7fa7440f6640 1 -- 172.21.15.83:0/410871711 wait complete. 2024-09-21T01:39:36.885 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:36.874+0000 7fa7440f6640 1 Processor -- start 2024-09-21T01:39:36.886 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:36.874+0000 7fa7440f6640 1 -- start start 2024-09-21T01:39:36.886 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:36.874+0000 7fa7440f6640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa73c102a70 0x7fa73c199350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:39:36.886 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:36.874+0000 7fa7440f6640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa73c1083b0 0x7fa73c1998f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:39:36.886 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:36.874+0000 7fa7440f6640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa73c108d00 0x7fa73c19eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:39:36.886 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:36.874+0000 7fa7440f6640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fa73c1128c0 con 0x7fa73c1083b0 2024-09-21T01:39:36.886 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:36.874+0000 7fa7440f6640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fa73c112740 con 0x7fa73c108d00 2024-09-21T01:39:36.886 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:36.874+0000 7fa7440f6640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fa73c112a40 con 0x7fa73c102a70 2024-09-21T01:39:36.886 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:36.875+0000 7fa741691640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa73c1083b0 0x7fa73c1998f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:39:36.886 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:36.875+0000 7fa741691640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa73c1083b0 0x7fa73c1998f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:39426/0 (socket says 172.21.15.83:39426) 2024-09-21T01:39:36.886 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:36.875+0000 7fa741691640 1 -- 172.21.15.83:0/1702853542 learned_addr learned my addr 172.21.15.83:0/1702853542 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:39:36.886 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:36.875+0000 7fa742693640 1 --2- 172.21.15.83:0/1702853542 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa73c108d00 0x7fa73c19eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:39:36.886 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:36.875+0000 7fa741691640 1 -- 172.21.15.83:0/1702853542 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa73c102a70 msgr2=0x7fa73c199350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:39:36.886 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:36.875+0000 7fa741e92640 1 --2- 172.21.15.83:0/1702853542 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa73c102a70 0x7fa73c199350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:39:36.886 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:36.875+0000 7fa741691640 1 --2- 172.21.15.83:0/1702853542 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa73c102a70 0x7fa73c199350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:36.887 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:36.875+0000 7fa741691640 1 -- 172.21.15.83:0/1702853542 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa73c108d00 msgr2=0x7fa73c19eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:39:36.887 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:36.875+0000 7fa741691640 1 --2- 172.21.15.83:0/1702853542 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa73c108d00 0x7fa73c19eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:36.887 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:36.875+0000 7fa741691640 1 -- 172.21.15.83:0/1702853542 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa73c19f2c0 con 0x7fa73c1083b0 2024-09-21T01:39:36.887 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:36.875+0000 7fa741e92640 1 --2- 172.21.15.83:0/1702853542 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa73c102a70 0x7fa73c199350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:39:36.887 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:36.875+0000 7fa741691640 1 --2- 172.21.15.83:0/1702853542 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa73c1083b0 0x7fa73c1998f0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fa73800eb00 tx=0x7fa738009ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:39:36.887 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:36.875+0000 7fa72effd640 1 -- 172.21.15.83:0/1702853542 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa73801c070 con 0x7fa73c1083b0 2024-09-21T01:39:36.887 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:36.875+0000 7fa7440f6640 1 -- 172.21.15.83:0/1702853542 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa73c19f5b0 con 0x7fa73c1083b0 2024-09-21T01:39:36.887 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:36.875+0000 7fa72effd640 1 -- 172.21.15.83:0/1702853542 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa73800bbd0 con 0x7fa73c1083b0 2024-09-21T01:39:36.887 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:36.875+0000 7fa72effd640 1 -- 172.21.15.83:0/1702853542 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa738016410 con 0x7fa73c1083b0 2024-09-21T01:39:36.887 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:36.875+0000 7fa7440f6640 1 -- 172.21.15.83:0/1702853542 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa73c06bb80 con 0x7fa73c1083b0 2024-09-21T01:39:36.887 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:36.876+0000 7fa7440f6640 1 -- 172.21.15.83:0/1702853542 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa73c103cf0 con 0x7fa73c1083b0 2024-09-21T01:39:36.887 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:36.878+0000 7fa72effd640 1 -- 172.21.15.83:0/1702853542 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 20) ==== 154529+0+0 (secure 0 0 0) 0x7fa73801f070 con 0x7fa73c1083b0 2024-09-21T01:39:36.887 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:36.878+0000 7fa72effd640 1 --2- 172.21.15.83:0/1702853542 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fa7280b6560 0x7fa7280b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:39:36.887 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:36.879+0000 7fa741e92640 1 --2- 172.21.15.83:0/1702853542 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fa7280b6560 0x7fa7280b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:39:36.887 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:36.879+0000 7fa72effd640 1 -- 172.21.15.83:0/1702853542 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7342+0+0 (secure 0 0 0) 0x7fa7380e8670 con 0x7fa73c1083b0 2024-09-21T01:39:36.887 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:36.879+0000 7fa741e92640 1 --2- 172.21.15.83:0/1702853542 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fa7280b6560 0x7fa7280b8a70 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fa730009b50 tx=0x7fa730005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:39:36.888 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:36.883+0000 7fa72effd640 1 -- 172.21.15.83:0/1702853542 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa7380af2d0 con 0x7fa73c1083b0 2024-09-21T01:39:37.053 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:36 smithi083 ceph-mon[31370]: mds.? [v2:172.21.15.119:6838/3106757092,v1:172.21.15.119:6839/3106757092] up:boot 2024-09-21T01:39:37.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:36 smithi083 ceph-mon[31370]: fsmap 12 up:standby 2024-09-21T01:39:37.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:36 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-21T01:39:37.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:36 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:39:37.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:36 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:39:37.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:36 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:39:37.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:36 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:39:37.122 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:37.122+0000 7fa7440f6640 1 -- 172.21.15.83:0/1702853542 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa73c06c600 con 0x7fa73c1083b0 2024-09-21T01:39:37.123 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:37.122+0000 7fa72effd640 1 -- 172.21.15.83:0/1702853542 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+10530 (secure 0 0 0) 0x7fa7380b36b0 con 0x7fa73c1083b0 2024-09-21T01:39:37.123 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T01:39:37.123 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":13,"btime":"2024-09-21T01:39:35:805097+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14775,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6835/1105040204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":1105040204},{"type":"v1","addr":"172.21.15.83:6835","nonce":1105040204}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14787,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/2234789563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6836","nonce":2234789563},{"type":"v1","addr":"172.21.15.83:6837","nonce":2234789563}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14838,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6839/136258364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6838","nonce":136258364},{"type":"v1","addr":"172.21.15.83:6839","nonce":136258364}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14850,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6841/129439444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6840","nonce":129439444},{"type":"v1","addr":"172.21.15.83:6841","nonce":129439444}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24569,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/2839502433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":2839502433},{"type":"v1","addr":"172.21.15.119:6833","nonce":2839502433}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24580,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6833/2841606990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":2841606990},{"type":"v1","addr":"172.21.15.142:6833","nonce":2841606990}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24599,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/415902608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":415902608},{"type":"v1","addr":"172.21.15.119:6835","nonce":415902608}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24607,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/3009088510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":3009088510},{"type":"v1","addr":"172.21.15.142:6835","nonce":3009088510}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24613,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/3847200126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6836","nonce":3847200126},{"type":"v1","addr":"172.21.15.142:6837","nonce":3847200126}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24626,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/3619222976","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":3619222976},{"type":"v1","addr":"172.21.15.119:6837","nonce":3619222976}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24631,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6839/1817880741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6838","nonce":1817880741},{"type":"v1","addr":"172.21.15.142:6839","nonce":1817880741}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24653,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6839/3106757092","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":3106757092},{"type":"v1","addr":"172.21.15.119:6839","nonce":3106757092}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[]} 2024-09-21T01:39:37.123 INFO:teuthology.orchestra.run.smithi083.stderr:dumped fsmap epoch 13 2024-09-21T01:39:37.125 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:37.125+0000 7fa7440f6640 1 -- 172.21.15.83:0/1702853542 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fa7280b6560 msgr2=0x7fa7280b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:39:37.126 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:37.125+0000 7fa7440f6640 1 --2- 172.21.15.83:0/1702853542 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fa7280b6560 0x7fa7280b8a70 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fa730009b50 tx=0x7fa730005f90 comp rx=0 tx=0).stop 2024-09-21T01:39:37.126 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:37.125+0000 7fa7440f6640 1 -- 172.21.15.83:0/1702853542 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa73c1083b0 msgr2=0x7fa73c1998f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:39:37.126 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:37.125+0000 7fa7440f6640 1 --2- 172.21.15.83:0/1702853542 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa73c1083b0 0x7fa73c1998f0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fa73800eb00 tx=0x7fa738009ec0 comp rx=0 tx=0).stop 2024-09-21T01:39:37.126 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:37.125+0000 7fa7440f6640 1 -- 172.21.15.83:0/1702853542 shutdown_connections 2024-09-21T01:39:37.126 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:37.125+0000 7fa7440f6640 1 --2- 172.21.15.83:0/1702853542 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fa7280b6560 0x7fa7280b8a70 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:37.126 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:37.125+0000 7fa7440f6640 1 --2- 172.21.15.83:0/1702853542 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa73c108d00 0x7fa73c19eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:37.126 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:37.125+0000 7fa7440f6640 1 --2- 172.21.15.83:0/1702853542 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa73c1083b0 0x7fa73c1998f0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:37.126 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:37.125+0000 7fa7440f6640 1 --2- 172.21.15.83:0/1702853542 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa73c102a70 0x7fa73c199350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:37.126 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:37.125+0000 7fa7440f6640 1 -- 172.21.15.83:0/1702853542 >> 172.21.15.83:0/1702853542 conn(0x7fa73c079710 msgr2=0x7fa73c104420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:39:37.126 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:37.125+0000 7fa7440f6640 1 -- 172.21.15.83:0/1702853542 shutdown_connections 2024-09-21T01:39:37.126 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:37.125+0000 7fa7440f6640 1 -- 172.21.15.83:0/1702853542 wait complete. 2024-09-21T01:39:37.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:36 smithi142 ceph-mon[34050]: mds.? [v2:172.21.15.119:6838/3106757092,v1:172.21.15.119:6839/3106757092] up:boot 2024-09-21T01:39:37.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:36 smithi142 ceph-mon[34050]: fsmap 12 up:standby 2024-09-21T01:39:37.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:36 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-21T01:39:37.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:36 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:39:37.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:36 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:39:37.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:36 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:39:37.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:36 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:39:37.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:36 smithi119 ceph-mon[33693]: mds.? [v2:172.21.15.119:6838/3106757092,v1:172.21.15.119:6839/3106757092] up:boot 2024-09-21T01:39:37.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:36 smithi119 ceph-mon[33693]: fsmap 12 up:standby 2024-09-21T01:39:37.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:36 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-21T01:39:37.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:36 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:39:37.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:36 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:39:37.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:36 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:39:37.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:36 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:39:37.836 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph --format=json-pretty osd lspools 2024-09-21T01:39:37.964 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:37 smithi142 ceph-mon[34050]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:39:37.964 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:37 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:39:37.965 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:37 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:39:37.965 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:37 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:39:37.965 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:37 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:39:37.965 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:37 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:39:37.965 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:37 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:39:37.965 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:37 smithi142 ceph-mon[34050]: from='client.? 172.21.15.83:0/1702853542' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:39:37.967 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:37 smithi119 ceph-mon[33693]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:39:37.967 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:37 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:39:37.967 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:37 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:39:37.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:37 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:39:37.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:37 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:39:37.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:37 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:39:37.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:37 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:39:37.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:37 smithi119 ceph-mon[33693]: from='client.? 172.21.15.83:0/1702853542' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:39:38.159 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:37 smithi083 ceph-mon[31370]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:39:38.159 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:37 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:39:38.159 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:37 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:39:38.159 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:37 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:39:38.159 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:37 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:39:38.159 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:37 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:39:38.159 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:37 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:39:38.159 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:37 smithi083 ceph-mon[31370]: from='client.? 172.21.15.83:0/1702853542' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:39:38.639 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:39:39.174 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:39.163+0000 7f8d6a0c8640 1 -- 172.21.15.83:0/4060451583 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8d64104920 msgr2=0x7f8d64104d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:39:39.174 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:39.163+0000 7f8d6a0c8640 1 --2- 172.21.15.83:0/4060451583 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8d64104920 0x7f8d64104d30 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f8d54009900 tx=0x7f8d5402a410 comp rx=0 tx=0).stop 2024-09-21T01:39:39.174 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:39.163+0000 7f8d6a0c8640 1 -- 172.21.15.83:0/4060451583 shutdown_connections 2024-09-21T01:39:39.174 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:39.163+0000 7f8d6a0c8640 1 --2- 172.21.15.83:0/4060451583 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8d6410ded0 0x7f8d64110370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:39.174 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:39.163+0000 7f8d6a0c8640 1 --2- 172.21.15.83:0/4060451583 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8d64105350 0x7f8d6410d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:39.174 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:39.163+0000 7f8d6a0c8640 1 --2- 172.21.15.83:0/4060451583 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8d64104920 0x7f8d64104d30 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:39.174 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:39.163+0000 7f8d6a0c8640 1 -- 172.21.15.83:0/4060451583 >> 172.21.15.83:0/4060451583 conn(0x7f8d64079770 msgr2=0x7f8d64079b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:39:39.174 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:39.163+0000 7f8d6a0c8640 1 -- 172.21.15.83:0/4060451583 shutdown_connections 2024-09-21T01:39:39.174 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:39.163+0000 7f8d6a0c8640 1 -- 172.21.15.83:0/4060451583 wait complete. 2024-09-21T01:39:39.174 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:39.163+0000 7f8d6a0c8640 1 Processor -- start 2024-09-21T01:39:39.175 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:39.164+0000 7f8d6a0c8640 1 -- start start 2024-09-21T01:39:39.175 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:39.164+0000 7f8d6a0c8640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8d64104920 0x7f8d6419a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:39:39.175 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:39.164+0000 7f8d6a0c8640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8d64105350 0x7f8d6419aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:39:39.175 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:39.164+0000 7f8d6a0c8640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8d6410ded0 0x7f8d6419fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:39:39.175 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:39.164+0000 7f8d6a0c8640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f8d64113a60 con 0x7f8d6410ded0 2024-09-21T01:39:39.175 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:39.164+0000 7f8d6a0c8640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f8d641138e0 con 0x7f8d64105350 2024-09-21T01:39:39.175 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:39.164+0000 7f8d6a0c8640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f8d64113be0 con 0x7f8d64104920 2024-09-21T01:39:39.175 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:39.164+0000 7f8d63fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8d6410ded0 0x7f8d6419fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:39:39.175 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:39.164+0000 7f8d63fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8d6410ded0 0x7f8d6419fd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:39444/0 (socket says 172.21.15.83:39444) 2024-09-21T01:39:39.175 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:39.164+0000 7f8d63fff640 1 -- 172.21.15.83:0/780034222 learned_addr learned my addr 172.21.15.83:0/780034222 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:39:39.175 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:39.164+0000 7f8d62ffd640 1 --2- 172.21.15.83:0/780034222 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8d64105350 0x7f8d6419aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:39:39.175 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:39.164+0000 7f8d637fe640 1 --2- 172.21.15.83:0/780034222 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8d64104920 0x7f8d6419a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:39:39.175 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:39.164+0000 7f8d63fff640 1 -- 172.21.15.83:0/780034222 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8d64104920 msgr2=0x7f8d6419a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:39:39.175 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:39.164+0000 7f8d63fff640 1 --2- 172.21.15.83:0/780034222 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8d64104920 0x7f8d6419a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:39.175 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:39.164+0000 7f8d63fff640 1 -- 172.21.15.83:0/780034222 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8d64105350 msgr2=0x7f8d6419aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:39:39.176 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:39.164+0000 7f8d63fff640 1 --2- 172.21.15.83:0/780034222 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8d64105350 0x7f8d6419aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:39.176 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:39.164+0000 7f8d63fff640 1 -- 172.21.15.83:0/780034222 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d641a0440 con 0x7f8d6410ded0 2024-09-21T01:39:39.176 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:39.164+0000 7f8d62ffd640 1 --2- 172.21.15.83:0/780034222 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8d64105350 0x7f8d6419aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:39:39.176 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:39.164+0000 7f8d63fff640 1 --2- 172.21.15.83:0/780034222 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8d6410ded0 0x7f8d6419fd10 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f8d5c00b970 tx=0x7f8d5c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:39:39.176 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:39.165+0000 7f8d60ff9640 1 -- 172.21.15.83:0/780034222 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d5c019070 con 0x7f8d6410ded0 2024-09-21T01:39:39.176 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:39.165+0000 7f8d60ff9640 1 -- 172.21.15.83:0/780034222 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8d5c014440 con 0x7f8d6410ded0 2024-09-21T01:39:39.176 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:39.165+0000 7f8d60ff9640 1 -- 172.21.15.83:0/780034222 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d5c0075d0 con 0x7f8d6410ded0 2024-09-21T01:39:39.176 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:39.165+0000 7f8d6a0c8640 1 -- 172.21.15.83:0/780034222 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d641a0730 con 0x7f8d6410ded0 2024-09-21T01:39:39.176 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:39.165+0000 7f8d6a0c8640 1 -- 172.21.15.83:0/780034222 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d641a6e90 con 0x7f8d6410ded0 2024-09-21T01:39:39.176 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:39.166+0000 7f8d6a0c8640 1 -- 172.21.15.83:0/780034222 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d6406c1a0 con 0x7f8d6410ded0 2024-09-21T01:39:39.176 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:39.167+0000 7f8d60ff9640 1 -- 172.21.15.83:0/780034222 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 20) ==== 154529+0+0 (secure 0 0 0) 0x7f8d5c01c070 con 0x7f8d6410ded0 2024-09-21T01:39:39.176 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:39.168+0000 7f8d60ff9640 1 --2- 172.21.15.83:0/780034222 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f8d500b6560 0x7f8d500b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:39:39.176 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:39.168+0000 7f8d637fe640 1 --2- 172.21.15.83:0/780034222 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f8d500b6560 0x7f8d500b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:39:39.176 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:39.168+0000 7f8d60ff9640 1 -- 172.21.15.83:0/780034222 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7342+0+0 (secure 0 0 0) 0x7f8d5c0e69a0 con 0x7f8d6410ded0 2024-09-21T01:39:39.176 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:39.169+0000 7f8d637fe640 1 --2- 172.21.15.83:0/780034222 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f8d500b6560 0x7f8d500b8a70 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f8d54006010 tx=0x7f8d54000bc0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:39:39.176 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:39.171+0000 7f8d60ff9640 1 -- 172.21.15.83:0/780034222 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8d5c0ad600 con 0x7f8d6410ded0 2024-09-21T01:39:39.367 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:39.367+0000 7f8d6a0c8640 1 -- 172.21.15.83:0/780034222 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f8d64104d30 con 0x7f8d6410ded0 2024-09-21T01:39:39.368 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:39.367+0000 7f8d60ff9640 1 -- 172.21.15.83:0/780034222 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v69) ==== 84+0+65 (secure 0 0 0) 0x7f8d5c0b19e0 con 0x7f8d6410ded0 2024-09-21T01:39:39.368 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T01:39:39.368 INFO:teuthology.orchestra.run.smithi083.stdout:[ 2024-09-21T01:39:39.368 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-21T01:39:39.368 INFO:teuthology.orchestra.run.smithi083.stdout: "poolnum": 1, 2024-09-21T01:39:39.368 INFO:teuthology.orchestra.run.smithi083.stdout: "poolname": ".mgr" 2024-09-21T01:39:39.368 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:39:39.369 INFO:teuthology.orchestra.run.smithi083.stdout:] 2024-09-21T01:39:39.370 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:39.370+0000 7f8d6a0c8640 1 -- 172.21.15.83:0/780034222 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f8d500b6560 msgr2=0x7f8d500b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:39:39.370 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:39.370+0000 7f8d6a0c8640 1 --2- 172.21.15.83:0/780034222 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f8d500b6560 0x7f8d500b8a70 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f8d54006010 tx=0x7f8d54000bc0 comp rx=0 tx=0).stop 2024-09-21T01:39:39.370 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:39.370+0000 7f8d6a0c8640 1 -- 172.21.15.83:0/780034222 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8d6410ded0 msgr2=0x7f8d6419fd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:39:39.371 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:39.370+0000 7f8d6a0c8640 1 --2- 172.21.15.83:0/780034222 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8d6410ded0 0x7f8d6419fd10 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f8d5c00b970 tx=0x7f8d5c00be30 comp rx=0 tx=0).stop 2024-09-21T01:39:39.371 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:39.370+0000 7f8d6a0c8640 1 -- 172.21.15.83:0/780034222 shutdown_connections 2024-09-21T01:39:39.371 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:39.370+0000 7f8d6a0c8640 1 --2- 172.21.15.83:0/780034222 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f8d500b6560 0x7f8d500b8a70 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:39.371 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:39.370+0000 7f8d6a0c8640 1 --2- 172.21.15.83:0/780034222 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8d6410ded0 0x7f8d6419fd10 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:39.371 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:39.370+0000 7f8d6a0c8640 1 --2- 172.21.15.83:0/780034222 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8d64105350 0x7f8d6419aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:39.371 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:39.370+0000 7f8d6a0c8640 1 --2- 172.21.15.83:0/780034222 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8d64104920 0x7f8d6419a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:39.371 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:39.370+0000 7f8d6a0c8640 1 -- 172.21.15.83:0/780034222 >> 172.21.15.83:0/780034222 conn(0x7f8d64079770 msgr2=0x7f8d640ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:39:39.371 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:39.370+0000 7f8d6a0c8640 1 -- 172.21.15.83:0/780034222 shutdown_connections 2024-09-21T01:39:39.371 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:39.370+0000 7f8d6a0c8640 1 -- 172.21.15.83:0/780034222 wait complete. 2024-09-21T01:39:39.714 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:39 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:39:39.715 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:39 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:39:39.715 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:39 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:39:39.715 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:39 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:39:39.715 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:39 smithi142 ceph-mon[34050]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:39:39.715 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:39 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:39:39.715 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:39 smithi142 ceph-mon[34050]: from='client.? 172.21.15.83:0/780034222' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2024-09-21T01:39:39.717 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:39 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:39:39.718 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:39 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:39:39.718 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:39 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:39:39.718 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:39 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:39:39.718 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:39 smithi119 ceph-mon[33693]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:39:39.718 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:39 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:39:39.718 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:39 smithi119 ceph-mon[33693]: from='client.? 172.21.15.83:0/780034222' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2024-09-21T01:39:39.744 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:39 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:39:39.744 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:39 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:39:39.744 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:39 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:39:39.744 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:39 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:39:39.744 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:39 smithi083 ceph-mon[31370]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:39:39.744 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:39 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:39:39.744 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:39 smithi083 ceph-mon[31370]: from='client.? 172.21.15.83:0/780034222' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2024-09-21T01:39:40.099 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-21T01:39:40.100 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-21T01:39:40.371 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:39:40.858 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:40.851+0000 7fe462f22640 1 -- 172.21.15.83:0/322102260 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe45c103bb0 msgr2=0x7fe45c103fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:39:40.858 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:40.851+0000 7fe462f22640 1 --2- 172.21.15.83:0/322102260 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe45c103bb0 0x7fe45c103fc0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fe450009900 tx=0x7fe45002a410 comp rx=0 tx=0).stop 2024-09-21T01:39:40.858 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:40.851+0000 7fe462f22640 1 -- 172.21.15.83:0/322102260 shutdown_connections 2024-09-21T01:39:40.858 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:40.851+0000 7fe462f22640 1 --2- 172.21.15.83:0/322102260 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe45c109e40 0x7fe45c110670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:40.859 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:40.851+0000 7fe462f22640 1 --2- 172.21.15.83:0/322102260 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe45c1094f0 0x7fe45c109900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:40.859 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:40.851+0000 7fe462f22640 1 --2- 172.21.15.83:0/322102260 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe45c103bb0 0x7fe45c103fc0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:40.859 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:40.851+0000 7fe462f22640 1 -- 172.21.15.83:0/322102260 >> 172.21.15.83:0/322102260 conn(0x7fe45c0ff600 msgr2=0x7fe45c101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:39:40.859 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:40.851+0000 7fe462f22640 1 -- 172.21.15.83:0/322102260 shutdown_connections 2024-09-21T01:39:40.859 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:40.851+0000 7fe462f22640 1 -- 172.21.15.83:0/322102260 wait complete. 2024-09-21T01:39:40.859 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:40.851+0000 7fe462f22640 1 Processor -- start 2024-09-21T01:39:40.859 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:40.851+0000 7fe462f22640 1 -- start start 2024-09-21T01:39:40.859 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:40.852+0000 7fe462f22640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe45c103bb0 0x7fe45c19a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:39:40.859 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:40.852+0000 7fe462f22640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe45c1094f0 0x7fe45c19aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:39:40.859 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:40.852+0000 7fe462f22640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe45c109e40 0x7fe45c19fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:39:40.860 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:40.852+0000 7fe462f22640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fe45c1139f0 con 0x7fe45c109e40 2024-09-21T01:39:40.860 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:40.852+0000 7fe462f22640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fe45c113870 con 0x7fe45c103bb0 2024-09-21T01:39:40.860 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:40.852+0000 7fe462f22640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fe45c113b70 con 0x7fe45c1094f0 2024-09-21T01:39:40.860 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:40.852+0000 7fe4614bf640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe45c109e40 0x7fe45c19fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:39:40.860 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:40.852+0000 7fe4614bf640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe45c109e40 0x7fe45c19fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:39474/0 (socket says 172.21.15.83:39474) 2024-09-21T01:39:40.860 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:40.852+0000 7fe4614bf640 1 -- 172.21.15.83:0/341196031 learned_addr learned my addr 172.21.15.83:0/341196031 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:39:40.860 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:40.852+0000 7fe460cbe640 1 --2- 172.21.15.83:0/341196031 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe45c103bb0 0x7fe45c19a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:39:40.860 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:40.852+0000 7fe45bfff640 1 --2- 172.21.15.83:0/341196031 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe45c1094f0 0x7fe45c19aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:39:40.860 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:40.852+0000 7fe4614bf640 1 -- 172.21.15.83:0/341196031 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe45c1094f0 msgr2=0x7fe45c19aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:39:40.860 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:40.852+0000 7fe4614bf640 1 --2- 172.21.15.83:0/341196031 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe45c1094f0 0x7fe45c19aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:40.860 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:40.852+0000 7fe4614bf640 1 -- 172.21.15.83:0/341196031 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe45c103bb0 msgr2=0x7fe45c19a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:39:40.860 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:40.852+0000 7fe4614bf640 1 --2- 172.21.15.83:0/341196031 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe45c103bb0 0x7fe45c19a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:40.861 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:40.852+0000 7fe4614bf640 1 -- 172.21.15.83:0/341196031 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe45c1a0450 con 0x7fe45c109e40 2024-09-21T01:39:40.861 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:40.852+0000 7fe4614bf640 1 --2- 172.21.15.83:0/341196031 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe45c109e40 0x7fe45c19fd20 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fe45400cad0 tx=0x7fe45400ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:39:40.861 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:40.852+0000 7fe459ffb640 1 -- 172.21.15.83:0/341196031 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe45400ad60 con 0x7fe45c109e40 2024-09-21T01:39:40.861 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:40.852+0000 7fe459ffb640 1 -- 172.21.15.83:0/341196031 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe454005020 con 0x7fe45c109e40 2024-09-21T01:39:40.861 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:40.852+0000 7fe459ffb640 1 -- 172.21.15.83:0/341196031 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe45400f6b0 con 0x7fe45c109e40 2024-09-21T01:39:40.861 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:40.852+0000 7fe462f22640 1 -- 172.21.15.83:0/341196031 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe45c1a0740 con 0x7fe45c109e40 2024-09-21T01:39:40.861 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:40.853+0000 7fe462f22640 1 -- 172.21.15.83:0/341196031 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe45c1a6ea0 con 0x7fe45c109e40 2024-09-21T01:39:40.861 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:40.854+0000 7fe462f22640 1 -- 172.21.15.83:0/341196031 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe45c103fc0 con 0x7fe45c109e40 2024-09-21T01:39:40.861 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:40.855+0000 7fe459ffb640 1 -- 172.21.15.83:0/341196031 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 20) ==== 154529+0+0 (secure 0 0 0) 0x7fe4540051d0 con 0x7fe45c109e40 2024-09-21T01:39:40.861 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:40.856+0000 7fe459ffb640 1 --2- 172.21.15.83:0/341196031 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fe44c0b65e0 0x7fe44c0b8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:39:40.861 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:40.856+0000 7fe460cbe640 1 --2- 172.21.15.83:0/341196031 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fe44c0b65e0 0x7fe44c0b8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:39:40.861 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:40.856+0000 7fe459ffb640 1 -- 172.21.15.83:0/341196031 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7342+0+0 (secure 0 0 0) 0x7fe4540e7370 con 0x7fe45c109e40 2024-09-21T01:39:40.862 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:40.857+0000 7fe460cbe640 1 --2- 172.21.15.83:0/341196031 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fe44c0b65e0 0x7fe44c0b8af0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fe4500057c0 tx=0x7fe4500058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:39:40.862 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:40.860+0000 7fe459ffb640 1 -- 172.21.15.83:0/341196031 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe454014030 con 0x7fe45c109e40 2024-09-21T01:39:41.037 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:41.037+0000 7fe462f22640 1 -- 172.21.15.83:0/341196031 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fe45c19b610 con 0x7fe45c109e40 2024-09-21T01:39:41.250 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:41.249+0000 7fe459ffb640 1 -- 172.21.15.83:0/341196031 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v70) ==== 138+0+0 (secure 0 0 0) 0x7fe45c19b610 con 0x7fe45c109e40 2024-09-21T01:39:41.250 INFO:teuthology.orchestra.run.smithi083.stderr:pool 'cephfs_metadata' created 2024-09-21T01:39:41.253 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:41.252+0000 7fe462f22640 1 -- 172.21.15.83:0/341196031 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fe44c0b65e0 msgr2=0x7fe44c0b8af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:39:41.253 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:41.252+0000 7fe462f22640 1 --2- 172.21.15.83:0/341196031 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fe44c0b65e0 0x7fe44c0b8af0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fe4500057c0 tx=0x7fe4500058d0 comp rx=0 tx=0).stop 2024-09-21T01:39:41.253 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:41.252+0000 7fe462f22640 1 -- 172.21.15.83:0/341196031 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe45c109e40 msgr2=0x7fe45c19fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:39:41.253 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:41.252+0000 7fe462f22640 1 --2- 172.21.15.83:0/341196031 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe45c109e40 0x7fe45c19fd20 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fe45400cad0 tx=0x7fe45400ced0 comp rx=0 tx=0).stop 2024-09-21T01:39:41.253 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:41.252+0000 7fe462f22640 1 -- 172.21.15.83:0/341196031 shutdown_connections 2024-09-21T01:39:41.253 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:41.252+0000 7fe462f22640 1 --2- 172.21.15.83:0/341196031 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fe44c0b65e0 0x7fe44c0b8af0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:41.253 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:41.252+0000 7fe462f22640 1 --2- 172.21.15.83:0/341196031 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe45c109e40 0x7fe45c19fd20 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:41.253 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:41.252+0000 7fe462f22640 1 --2- 172.21.15.83:0/341196031 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe45c1094f0 0x7fe45c19aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:41.253 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:41.252+0000 7fe462f22640 1 --2- 172.21.15.83:0/341196031 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe45c103bb0 0x7fe45c19a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:41.254 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:41.252+0000 7fe462f22640 1 -- 172.21.15.83:0/341196031 >> 172.21.15.83:0/341196031 conn(0x7fe45c0ff600 msgr2=0x7fe45c101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:39:41.254 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:41.252+0000 7fe462f22640 1 -- 172.21.15.83:0/341196031 shutdown_connections 2024-09-21T01:39:41.254 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:41.253+0000 7fe462f22640 1 -- 172.21.15.83:0/341196031 wait complete. 2024-09-21T01:39:41.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:41 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:39:41.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:41 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:39:41.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:41 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:39:41.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:41 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:39:41.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:41 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:39:41.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:41 smithi083 ceph-mon[31370]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:39:41.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:41 smithi083 ceph-mon[31370]: from='client.? 172.21.15.83:0/341196031' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2024-09-21T01:39:41.714 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:41 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:39:41.715 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:41 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:39:41.715 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:41 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:39:41.715 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:41 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:39:41.715 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:41 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:39:41.715 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:41 smithi142 ceph-mon[34050]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:39:41.715 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:41 smithi142 ceph-mon[34050]: from='client.? 172.21.15.83:0/341196031' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2024-09-21T01:39:41.717 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:41 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:39:41.717 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:41 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:39:41.718 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:41 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:39:41.718 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:41 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:39:41.718 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:41 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:39:41.718 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:41 smithi119 ceph-mon[33693]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:39:41.718 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:41 smithi119 ceph-mon[33693]: from='client.? 172.21.15.83:0/341196031' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2024-09-21T01:39:41.962 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-09-21T01:39:42.217 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:39:42.485 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:42 smithi083 ceph-mon[31370]: from='client.? 172.21.15.83:0/341196031' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-21T01:39:42.485 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:42 smithi083 ceph-mon[31370]: osdmap e70: 12 total, 12 up, 12 in 2024-09-21T01:39:42.689 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:42.688+0000 7facd5b0e640 1 -- 172.21.15.83:0/3404061148 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7facd01049b0 msgr2=0x7facd0104dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:39:42.689 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:42.688+0000 7facd5b0e640 1 --2- 172.21.15.83:0/3404061148 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7facd01049b0 0x7facd0104dc0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7facc0009ca0 tx=0x7facc002a8c0 comp rx=0 tx=0).stop 2024-09-21T01:39:42.689 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:42.688+0000 7facd5b0e640 1 -- 172.21.15.83:0/3404061148 shutdown_connections 2024-09-21T01:39:42.689 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:42.688+0000 7facd5b0e640 1 --2- 172.21.15.83:0/3404061148 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7facd010de10 0x7facd0110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:42.689 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:42.688+0000 7facd5b0e640 1 --2- 172.21.15.83:0/3404061148 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7facd0105300 0x7facd010d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:42.689 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:42.688+0000 7facd5b0e640 1 --2- 172.21.15.83:0/3404061148 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7facd01049b0 0x7facd0104dc0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:42.689 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:42.688+0000 7facd5b0e640 1 -- 172.21.15.83:0/3404061148 >> 172.21.15.83:0/3404061148 conn(0x7facd0079730 msgr2=0x7facd0079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:39:42.690 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:42.688+0000 7facd5b0e640 1 -- 172.21.15.83:0/3404061148 shutdown_connections 2024-09-21T01:39:42.690 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:42.688+0000 7facd5b0e640 1 -- 172.21.15.83:0/3404061148 wait complete. 2024-09-21T01:39:42.690 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:42.689+0000 7facd5b0e640 1 Processor -- start 2024-09-21T01:39:42.691 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:42.689+0000 7facd5b0e640 1 -- start start 2024-09-21T01:39:42.691 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:42.689+0000 7facd5b0e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7facd01049b0 0x7facd019c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:39:42.691 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:42.689+0000 7facd5b0e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7facd0105300 0x7facd019cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:39:42.692 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:42.689+0000 7facd5b0e640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7facd010de10 0x7facd01a1e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:39:42.692 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:42.689+0000 7facd5b0e640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7facd0113990 con 0x7facd010de10 2024-09-21T01:39:42.692 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:42.689+0000 7facd5b0e640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7facd0113810 con 0x7facd01049b0 2024-09-21T01:39:42.692 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:42.689+0000 7facd5b0e640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7facd0113b10 con 0x7facd0105300 2024-09-21T01:39:42.692 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:42.689+0000 7faccffff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7facd010de10 0x7facd01a1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:39:42.692 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:42.690+0000 7faccffff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7facd010de10 0x7facd01a1e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:39490/0 (socket says 172.21.15.83:39490) 2024-09-21T01:39:42.692 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:42.690+0000 7faccffff640 1 -- 172.21.15.83:0/596531259 learned_addr learned my addr 172.21.15.83:0/596531259 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:39:42.692 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:42.690+0000 7faccf7fe640 1 --2- 172.21.15.83:0/596531259 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7facd01049b0 0x7facd019c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:39:42.692 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:42.690+0000 7facceffd640 1 --2- 172.21.15.83:0/596531259 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7facd0105300 0x7facd019cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:39:42.692 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:42.690+0000 7faccffff640 1 -- 172.21.15.83:0/596531259 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7facd0105300 msgr2=0x7facd019cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:39:42.692 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:42.690+0000 7faccffff640 1 --2- 172.21.15.83:0/596531259 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7facd0105300 0x7facd019cbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:42.692 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:42.690+0000 7faccffff640 1 -- 172.21.15.83:0/596531259 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7facd01049b0 msgr2=0x7facd019c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:39:42.692 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:42.690+0000 7faccffff640 1 --2- 172.21.15.83:0/596531259 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7facd01049b0 0x7facd019c620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:42.692 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:42.690+0000 7faccffff640 1 -- 172.21.15.83:0/596531259 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facd01a2590 con 0x7facd010de10 2024-09-21T01:39:42.693 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:42.690+0000 7facceffd640 1 --2- 172.21.15.83:0/596531259 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7facd0105300 0x7facd019cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:39:42.693 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:42.690+0000 7faccffff640 1 --2- 172.21.15.83:0/596531259 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7facd010de10 0x7facd01a1e60 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7facc800c970 tx=0x7facc800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:39:42.693 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:42.690+0000 7facccff9640 1 -- 172.21.15.83:0/596531259 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facc8007bb0 con 0x7facd010de10 2024-09-21T01:39:42.693 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:42.690+0000 7facd5b0e640 1 -- 172.21.15.83:0/596531259 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7facd01a2880 con 0x7facd010de10 2024-09-21T01:39:42.693 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:42.690+0000 7facccff9640 1 -- 172.21.15.83:0/596531259 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7facc8007d50 con 0x7facd010de10 2024-09-21T01:39:42.693 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:42.690+0000 7facccff9640 1 -- 172.21.15.83:0/596531259 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facc8004d50 con 0x7facd010de10 2024-09-21T01:39:42.693 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:42.690+0000 7facd5b0e640 1 -- 172.21.15.83:0/596531259 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7facd01a8fe0 con 0x7facd010de10 2024-09-21T01:39:42.694 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:42.691+0000 7facd5b0e640 1 -- 172.21.15.83:0/596531259 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7facd0104dc0 con 0x7facd010de10 2024-09-21T01:39:42.694 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:42.693+0000 7facccff9640 1 -- 172.21.15.83:0/596531259 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 20) ==== 154529+0+0 (secure 0 0 0) 0x7facc8005000 con 0x7facd010de10 2024-09-21T01:39:42.694 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:42.694+0000 7facccff9640 1 --2- 172.21.15.83:0/596531259 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7facbc0b6560 0x7facbc0b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:39:42.694 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:42.694+0000 7faccf7fe640 1 --2- 172.21.15.83:0/596531259 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7facbc0b6560 0x7facbc0b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:39:42.694 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:42.694+0000 7facccff9640 1 -- 172.21.15.83:0/596531259 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7712+0+0 (secure 0 0 0) 0x7facc80e7190 con 0x7facd010de10 2024-09-21T01:39:42.694 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:42.694+0000 7faccf7fe640 1 --2- 172.21.15.83:0/596531259 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7facbc0b6560 0x7facbc0b8a70 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7facc0000f80 tx=0x7facc0031000 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:39:42.697 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:42.697+0000 7facccff9640 1 -- 172.21.15.83:0/596531259 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7facc8014030 con 0x7facd010de10 2024-09-21T01:39:42.714 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:42 smithi142 ceph-mon[34050]: from='client.? 172.21.15.83:0/341196031' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-21T01:39:42.715 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:42 smithi142 ceph-mon[34050]: osdmap e70: 12 total, 12 up, 12 in 2024-09-21T01:39:42.717 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:42 smithi119 ceph-mon[33693]: from='client.? 172.21.15.83:0/341196031' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-21T01:39:42.717 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:42 smithi119 ceph-mon[33693]: osdmap e70: 12 total, 12 up, 12 in 2024-09-21T01:39:42.877 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:42.877+0000 7facd5b0e640 1 -- 172.21.15.83:0/596531259 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) -- 0x7facd019d750 con 0x7facd010de10 2024-09-21T01:39:43.266 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:43.265+0000 7facccff9640 1 -- 172.21.15.83:0/596531259 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v72) ==== 171+0+0 (secure 0 0 0) 0x7facd019d750 con 0x7facd010de10 2024-09-21T01:39:43.266 INFO:teuthology.orchestra.run.smithi083.stderr:pool 'cephfs_data' created 2024-09-21T01:39:43.269 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:43.268+0000 7facd5b0e640 1 -- 172.21.15.83:0/596531259 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7facbc0b6560 msgr2=0x7facbc0b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:39:43.269 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:43.268+0000 7facd5b0e640 1 --2- 172.21.15.83:0/596531259 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7facbc0b6560 0x7facbc0b8a70 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7facc0000f80 tx=0x7facc0031000 comp rx=0 tx=0).stop 2024-09-21T01:39:43.269 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:43.268+0000 7facd5b0e640 1 -- 172.21.15.83:0/596531259 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7facd010de10 msgr2=0x7facd01a1e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:39:43.269 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:43.268+0000 7facd5b0e640 1 --2- 172.21.15.83:0/596531259 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7facd010de10 0x7facd01a1e60 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7facc800c970 tx=0x7facc800ce30 comp rx=0 tx=0).stop 2024-09-21T01:39:43.269 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:43.268+0000 7facd5b0e640 1 -- 172.21.15.83:0/596531259 shutdown_connections 2024-09-21T01:39:43.269 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:43.268+0000 7facd5b0e640 1 --2- 172.21.15.83:0/596531259 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7facbc0b6560 0x7facbc0b8a70 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:43.269 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:43.268+0000 7facd5b0e640 1 --2- 172.21.15.83:0/596531259 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7facd010de10 0x7facd01a1e60 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:43.269 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:43.268+0000 7facd5b0e640 1 --2- 172.21.15.83:0/596531259 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7facd0105300 0x7facd019cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:43.269 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:43.268+0000 7facd5b0e640 1 --2- 172.21.15.83:0/596531259 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7facd01049b0 0x7facd019c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:43.269 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:43.268+0000 7facd5b0e640 1 -- 172.21.15.83:0/596531259 >> 172.21.15.83:0/596531259 conn(0x7facd0079730 msgr2=0x7facd01005f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:39:43.270 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:43.268+0000 7facd5b0e640 1 -- 172.21.15.83:0/596531259 shutdown_connections 2024-09-21T01:39:43.270 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:43.269+0000 7facd5b0e640 1 -- 172.21.15.83:0/596531259 wait complete. 2024-09-21T01:39:43.554 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:43 smithi083 ceph-mon[31370]: osdmap e71: 12 total, 12 up, 12 in 2024-09-21T01:39:43.554 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:43 smithi083 ceph-mon[31370]: pgmap v256: 33 pgs: 11 creating+peering, 21 unknown, 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:39:43.554 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:43 smithi083 ceph-mon[31370]: from='client.? 172.21.15.83:0/596531259' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} : dispatch 2024-09-21T01:39:43.715 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:43 smithi142 ceph-mon[34050]: osdmap e71: 12 total, 12 up, 12 in 2024-09-21T01:39:43.715 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:43 smithi142 ceph-mon[34050]: pgmap v256: 33 pgs: 11 creating+peering, 21 unknown, 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:39:43.715 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:43 smithi142 ceph-mon[34050]: from='client.? 172.21.15.83:0/596531259' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} : dispatch 2024-09-21T01:39:43.717 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:43 smithi119 ceph-mon[33693]: osdmap e71: 12 total, 12 up, 12 in 2024-09-21T01:39:43.718 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:43 smithi119 ceph-mon[33693]: pgmap v256: 33 pgs: 11 creating+peering, 21 unknown, 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:39:43.718 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:43 smithi119 ceph-mon[33693]: from='client.? 172.21.15.83:0/596531259' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} : dispatch 2024-09-21T01:39:44.149 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-21T01:39:44.417 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:39:44.537 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:44 smithi083 ceph-mon[31370]: from='client.? 172.21.15.83:0/596531259' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-09-21T01:39:44.538 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:44 smithi083 ceph-mon[31370]: osdmap e72: 12 total, 12 up, 12 in 2024-09-21T01:39:44.714 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:44 smithi142 ceph-mon[34050]: from='client.? 172.21.15.83:0/596531259' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-09-21T01:39:44.715 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:44 smithi142 ceph-mon[34050]: osdmap e72: 12 total, 12 up, 12 in 2024-09-21T01:39:44.717 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:44 smithi119 ceph-mon[33693]: from='client.? 172.21.15.83:0/596531259' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-09-21T01:39:44.717 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:44 smithi119 ceph-mon[33693]: osdmap e72: 12 total, 12 up, 12 in 2024-09-21T01:39:44.935 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:44.920+0000 7f67c0b89640 1 -- 172.21.15.83:0/1351545396 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f67bc1083b0 msgr2=0x7f67bc1087c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:39:44.935 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:44.920+0000 7f67c0b89640 1 --2- 172.21.15.83:0/1351545396 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f67bc1083b0 0x7f67bc1087c0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f67a4009900 tx=0x7f67a402a410 comp rx=0 tx=0).stop 2024-09-21T01:39:44.935 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:44.920+0000 7f67c0b89640 1 -- 172.21.15.83:0/1351545396 shutdown_connections 2024-09-21T01:39:44.935 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:44.920+0000 7f67c0b89640 1 --2- 172.21.15.83:0/1351545396 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f67bc108d00 0x7f67bc10f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:44.936 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:44.920+0000 7f67c0b89640 1 --2- 172.21.15.83:0/1351545396 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f67bc1083b0 0x7f67bc1087c0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:44.936 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:44.920+0000 7f67c0b89640 1 --2- 172.21.15.83:0/1351545396 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f67bc102a70 0x7f67bc102e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:44.936 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:44.920+0000 7f67c0b89640 1 -- 172.21.15.83:0/1351545396 >> 172.21.15.83:0/1351545396 conn(0x7f67bc079710 msgr2=0x7f67bc079b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:39:44.936 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:44.920+0000 7f67c0b89640 1 -- 172.21.15.83:0/1351545396 shutdown_connections 2024-09-21T01:39:44.936 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:44.920+0000 7f67c0b89640 1 -- 172.21.15.83:0/1351545396 wait complete. 2024-09-21T01:39:44.936 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:44.921+0000 7f67c0b89640 1 Processor -- start 2024-09-21T01:39:44.936 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:44.922+0000 7f67c0b89640 1 -- start start 2024-09-21T01:39:44.936 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:44.922+0000 7f67c0b89640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f67bc102a70 0x7f67bc19a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:39:44.936 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:44.922+0000 7f67c0b89640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f67bc1083b0 0x7f67bc19aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:39:44.936 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:44.922+0000 7f67c0b89640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f67bc108d00 0x7f67bc19fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:39:44.936 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:44.922+0000 7f67c0b89640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f67bc113990 con 0x7f67bc102a70 2024-09-21T01:39:44.936 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:44.922+0000 7f67c0b89640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f67bc113810 con 0x7f67bc1083b0 2024-09-21T01:39:44.936 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:44.922+0000 7f67c0b89640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f67bc113b10 con 0x7f67bc108d00 2024-09-21T01:39:44.936 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:44.922+0000 7f67ba59c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f67bc102a70 0x7f67bc19a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:39:44.937 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:44.922+0000 7f67ba59c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f67bc102a70 0x7f67bc19a480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:55494/0 (socket says 172.21.15.83:55494) 2024-09-21T01:39:44.937 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:44.922+0000 7f67ba59c640 1 -- 172.21.15.83:0/4152771448 learned_addr learned my addr 172.21.15.83:0/4152771448 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:39:44.937 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:44.922+0000 7f67b3fff640 1 --2- 172.21.15.83:0/4152771448 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f67bc1083b0 0x7f67bc19aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:39:44.937 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:44.922+0000 7f67bad9d640 1 --2- 172.21.15.83:0/4152771448 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f67bc108d00 0x7f67bc19fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:39:44.937 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:44.922+0000 7f67ba59c640 1 -- 172.21.15.83:0/4152771448 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f67bc108d00 msgr2=0x7f67bc19fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:39:44.937 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:44.922+0000 7f67ba59c640 1 --2- 172.21.15.83:0/4152771448 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f67bc108d00 0x7f67bc19fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:44.937 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:44.922+0000 7f67ba59c640 1 -- 172.21.15.83:0/4152771448 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f67bc1083b0 msgr2=0x7f67bc19aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:39:44.937 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:44.922+0000 7f67ba59c640 1 --2- 172.21.15.83:0/4152771448 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f67bc1083b0 0x7f67bc19aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:44.937 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:44.922+0000 7f67ba59c640 1 -- 172.21.15.83:0/4152771448 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67bc1a03f0 con 0x7f67bc102a70 2024-09-21T01:39:44.937 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:44.922+0000 7f67bad9d640 1 --2- 172.21.15.83:0/4152771448 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f67bc108d00 0x7f67bc19fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:39:44.937 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:44.922+0000 7f67b3fff640 1 --2- 172.21.15.83:0/4152771448 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f67bc1083b0 0x7f67bc19aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:39:44.937 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:44.922+0000 7f67ba59c640 1 --2- 172.21.15.83:0/4152771448 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f67bc102a70 0x7f67bc19a480 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f67ac00b4a0 tx=0x7f67ac00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:39:44.937 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:44.923+0000 7f67b37fe640 1 -- 172.21.15.83:0/4152771448 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67ac014070 con 0x7f67bc102a70 2024-09-21T01:39:44.937 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:44.923+0000 7f67b37fe640 1 -- 172.21.15.83:0/4152771448 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f67ac010aa0 con 0x7f67bc102a70 2024-09-21T01:39:44.938 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:44.923+0000 7f67b37fe640 1 -- 172.21.15.83:0/4152771448 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67ac017b70 con 0x7f67bc102a70 2024-09-21T01:39:44.938 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:44.923+0000 7f67c0b89640 1 -- 172.21.15.83:0/4152771448 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67bc1a06e0 con 0x7f67bc102a70 2024-09-21T01:39:44.938 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:44.923+0000 7f67c0b89640 1 -- 172.21.15.83:0/4152771448 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67bc1a6e40 con 0x7f67bc102a70 2024-09-21T01:39:44.938 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:44.924+0000 7f67c0b89640 1 -- 172.21.15.83:0/4152771448 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67bc103cf0 con 0x7f67bc102a70 2024-09-21T01:39:44.938 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:44.925+0000 7f67b37fe640 1 -- 172.21.15.83:0/4152771448 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 20) ==== 154529+0+0 (secure 0 0 0) 0x7f67ac017070 con 0x7f67bc102a70 2024-09-21T01:39:44.938 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:44.926+0000 7f67b37fe640 1 --2- 172.21.15.83:0/4152771448 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f67a80b65e0 0x7f67a80b8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:39:44.938 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:44.926+0000 7f67b3fff640 1 --2- 172.21.15.83:0/4152771448 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f67a80b65e0 0x7f67a80b8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:39:44.938 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:44.926+0000 7f67b37fe640 1 -- 172.21.15.83:0/4152771448 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8094+0+0 (secure 0 0 0) 0x7f67ac0e6940 con 0x7f67bc102a70 2024-09-21T01:39:44.938 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:44.927+0000 7f67b3fff640 1 --2- 172.21.15.83:0/4152771448 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f67a80b65e0 0x7f67a80b8af0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f67a40057c0 tx=0x7f67a4009680 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:39:44.938 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:44.929+0000 7f67b37fe640 1 -- 172.21.15.83:0/4152771448 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f67ac0ad2b0 con 0x7f67bc102a70 2024-09-21T01:39:45.144 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:45.143+0000 7f67c0b89640 1 -- 172.21.15.83:0/4152771448 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f67bc102e80 con 0x7f67bc102a70 2024-09-21T01:39:45.279 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:45.278+0000 7f67b37fe640 1 -- 172.21.15.83:0/4152771448 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) ==== 172+0+0 (secure 0 0 0) 0x7f67bc102e80 con 0x7f67bc102a70 2024-09-21T01:39:45.279 INFO:teuthology.orchestra.run.smithi083.stderr:new fs with metadata pool 2 and data pool 3 2024-09-21T01:39:45.281 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:45.281+0000 7f67c0b89640 1 -- 172.21.15.83:0/4152771448 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f67a80b65e0 msgr2=0x7f67a80b8af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:39:45.281 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:45.281+0000 7f67c0b89640 1 --2- 172.21.15.83:0/4152771448 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f67a80b65e0 0x7f67a80b8af0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f67a40057c0 tx=0x7f67a4009680 comp rx=0 tx=0).stop 2024-09-21T01:39:45.282 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:45.281+0000 7f67c0b89640 1 -- 172.21.15.83:0/4152771448 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f67bc102a70 msgr2=0x7f67bc19a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:39:45.282 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:45.281+0000 7f67c0b89640 1 --2- 172.21.15.83:0/4152771448 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f67bc102a70 0x7f67bc19a480 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f67ac00b4a0 tx=0x7f67ac00b960 comp rx=0 tx=0).stop 2024-09-21T01:39:45.282 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:45.281+0000 7f67c0b89640 1 -- 172.21.15.83:0/4152771448 shutdown_connections 2024-09-21T01:39:45.282 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:45.281+0000 7f67c0b89640 1 --2- 172.21.15.83:0/4152771448 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f67a80b65e0 0x7f67a80b8af0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:45.282 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:45.281+0000 7f67c0b89640 1 --2- 172.21.15.83:0/4152771448 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f67bc108d00 0x7f67bc19fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:45.282 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:45.281+0000 7f67c0b89640 1 --2- 172.21.15.83:0/4152771448 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f67bc1083b0 0x7f67bc19aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:45.282 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:45.281+0000 7f67c0b89640 1 --2- 172.21.15.83:0/4152771448 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f67bc102a70 0x7f67bc19a480 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:45.282 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:45.281+0000 7f67c0b89640 1 -- 172.21.15.83:0/4152771448 >> 172.21.15.83:0/4152771448 conn(0x7f67bc079710 msgr2=0x7f67bc106500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:39:45.282 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:45.281+0000 7f67c0b89640 1 -- 172.21.15.83:0/4152771448 shutdown_connections 2024-09-21T01:39:45.282 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:45.281+0000 7f67c0b89640 1 -- 172.21.15.83:0/4152771448 wait complete. 2024-09-21T01:39:45.554 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:45 smithi083 ceph-mon[31370]: osdmap e73: 12 total, 12 up, 12 in 2024-09-21T01:39:45.554 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:45 smithi083 ceph-mon[31370]: pgmap v259: 97 pgs: 23 active+clean, 15 creating+peering, 59 unknown; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:39:45.554 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:45 smithi083 ceph-mon[31370]: from='client.? 172.21.15.83:0/4152771448' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2024-09-21T01:39:45.554 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:45 smithi083 ceph-mon[31370]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-21T01:39:45.714 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:45 smithi142 ceph-mon[34050]: osdmap e73: 12 total, 12 up, 12 in 2024-09-21T01:39:45.715 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:45 smithi142 ceph-mon[34050]: pgmap v259: 97 pgs: 23 active+clean, 15 creating+peering, 59 unknown; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:39:45.715 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:45 smithi142 ceph-mon[34050]: from='client.? 172.21.15.83:0/4152771448' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2024-09-21T01:39:45.715 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:45 smithi142 ceph-mon[34050]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-21T01:39:45.717 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:45 smithi119 ceph-mon[33693]: osdmap e73: 12 total, 12 up, 12 in 2024-09-21T01:39:45.717 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:45 smithi119 ceph-mon[33693]: pgmap v259: 97 pgs: 23 active+clean, 15 creating+peering, 59 unknown; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:39:45.718 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:45 smithi119 ceph-mon[33693]: from='client.? 172.21.15.83:0/4152771448' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2024-09-21T01:39:45.718 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:45 smithi119 ceph-mon[33693]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-21T01:39:45.908 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-09-21T01:39:45.909 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-09-21T01:39:46.153 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:39:46.554 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:46 smithi083 ceph-mon[31370]: osdmap e74: 12 total, 12 up, 12 in 2024-09-21T01:39:46.554 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:46 smithi083 ceph-mon[31370]: from='client.? 172.21.15.83:0/4152771448' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-21T01:39:46.554 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:46 smithi083 ceph-mon[31370]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-21T01:39:46.554 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:46 smithi083 ceph-mon[31370]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-21T01:39:46.644 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:46.604+0000 7f5fb66d4640 1 -- 172.21.15.83:0/4133836810 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5fb01094f0 msgr2=0x7f5fb0109900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:39:46.644 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:46.604+0000 7f5fb66d4640 1 --2- 172.21.15.83:0/4133836810 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5fb01094f0 0x7f5fb0109900 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f5fa4009900 tx=0x7f5fa402a410 comp rx=0 tx=0).stop 2024-09-21T01:39:46.644 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:46.605+0000 7f5fb66d4640 1 -- 172.21.15.83:0/4133836810 shutdown_connections 2024-09-21T01:39:46.644 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:46.605+0000 7f5fb66d4640 1 --2- 172.21.15.83:0/4133836810 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5fb0109e40 0x7f5fb0110670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:46.645 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:46.605+0000 7f5fb66d4640 1 --2- 172.21.15.83:0/4133836810 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5fb01094f0 0x7f5fb0109900 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:46.645 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:46.605+0000 7f5fb66d4640 1 --2- 172.21.15.83:0/4133836810 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5fb0103bb0 0x7f5fb0103fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:46.645 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:46.605+0000 7f5fb66d4640 1 -- 172.21.15.83:0/4133836810 >> 172.21.15.83:0/4133836810 conn(0x7f5fb00ff600 msgr2=0x7f5fb0101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:39:46.645 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:46.605+0000 7f5fb66d4640 1 -- 172.21.15.83:0/4133836810 shutdown_connections 2024-09-21T01:39:46.645 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:46.605+0000 7f5fb66d4640 1 -- 172.21.15.83:0/4133836810 wait complete. 2024-09-21T01:39:46.645 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:46.605+0000 7f5fb66d4640 1 Processor -- start 2024-09-21T01:39:46.645 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:46.605+0000 7f5fb66d4640 1 -- start start 2024-09-21T01:39:46.645 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:46.606+0000 7f5fb66d4640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5fb0103bb0 0x7f5fb0075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:39:46.645 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:46.606+0000 7f5fb66d4640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5fb01094f0 0x7f5fb0075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:39:46.645 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:46.606+0000 7f5fb66d4640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5fb0109e40 0x7f5fb0076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:39:46.645 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:46.606+0000 7f5fb66d4640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f5fb01139b0 con 0x7f5fb01094f0 2024-09-21T01:39:46.645 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:46.606+0000 7f5fb66d4640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f5fb0113830 con 0x7f5fb0109e40 2024-09-21T01:39:46.645 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:46.606+0000 7f5fb66d4640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f5fb0113b30 con 0x7f5fb0103bb0 2024-09-21T01:39:46.646 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:46.606+0000 7f5faf7fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5fb01094f0 0x7f5fb0075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:39:46.646 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:46.606+0000 7f5faf7fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5fb01094f0 0x7f5fb0075c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:55514/0 (socket says 172.21.15.83:55514) 2024-09-21T01:39:46.646 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:46.606+0000 7f5faf7fe640 1 -- 172.21.15.83:0/3601106263 learned_addr learned my addr 172.21.15.83:0/3601106263 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:39:46.646 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:46.606+0000 7f5faffff640 1 --2- 172.21.15.83:0/3601106263 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5fb0103bb0 0x7f5fb0075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:39:46.646 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:46.606+0000 7f5fb4c71640 1 --2- 172.21.15.83:0/3601106263 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5fb0109e40 0x7f5fb0076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:39:46.646 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:46.606+0000 7f5faf7fe640 1 -- 172.21.15.83:0/3601106263 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5fb0103bb0 msgr2=0x7f5fb0075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:39:46.646 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:46.606+0000 7f5faf7fe640 1 --2- 172.21.15.83:0/3601106263 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5fb0103bb0 0x7f5fb0075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:46.646 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:46.606+0000 7f5faf7fe640 1 -- 172.21.15.83:0/3601106263 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5fb0109e40 msgr2=0x7f5fb0076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:39:46.646 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:46.606+0000 7f5faf7fe640 1 --2- 172.21.15.83:0/3601106263 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5fb0109e40 0x7f5fb0076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:46.646 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:46.606+0000 7f5faf7fe640 1 -- 172.21.15.83:0/3601106263 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fb01a8680 con 0x7f5fb01094f0 2024-09-21T01:39:46.646 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:46.606+0000 7f5faf7fe640 1 --2- 172.21.15.83:0/3601106263 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5fb01094f0 0x7f5fb0075c50 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f5fa4005940 tx=0x7f5fa40040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:39:46.646 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:46.607+0000 7f5fad7fa640 1 -- 172.21.15.83:0/3601106263 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fa403f030 con 0x7f5fb01094f0 2024-09-21T01:39:46.646 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:46.607+0000 7f5fb66d4640 1 -- 172.21.15.83:0/3601106263 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5fb01a8910 con 0x7f5fb01094f0 2024-09-21T01:39:46.647 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:46.607+0000 7f5fad7fa640 1 -- 172.21.15.83:0/3601106263 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5fa4003a80 con 0x7f5fb01094f0 2024-09-21T01:39:46.647 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:46.607+0000 7f5fad7fa640 1 -- 172.21.15.83:0/3601106263 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fa4035070 con 0x7f5fb01094f0 2024-09-21T01:39:46.647 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:46.607+0000 7f5fb66d4640 1 -- 172.21.15.83:0/3601106263 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5fb01a8e40 con 0x7f5fb01094f0 2024-09-21T01:39:46.647 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:46.608+0000 7f5fb66d4640 1 -- 172.21.15.83:0/3601106263 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5fb0103fc0 con 0x7f5fb01094f0 2024-09-21T01:39:46.647 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:46.609+0000 7f5fad7fa640 1 -- 172.21.15.83:0/3601106263 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 20) ==== 154529+0+0 (secure 0 0 0) 0x7f5fa4042030 con 0x7f5fb01094f0 2024-09-21T01:39:46.647 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:46.610+0000 7f5fad7fa640 1 --2- 172.21.15.83:0/3601106263 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f5f980b6560 0x7f5f980b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:39:46.647 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:46.610+0000 7f5faffff640 1 --2- 172.21.15.83:0/3601106263 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f5f980b6560 0x7f5f980b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:39:46.647 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:46.610+0000 7f5fad7fa640 1 -- 172.21.15.83:0/3601106263 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8194+0+0 (secure 0 0 0) 0x7f5fa4107d20 con 0x7f5fb01094f0 2024-09-21T01:39:46.647 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:46.610+0000 7f5faffff640 1 --2- 172.21.15.83:0/3601106263 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f5f980b6560 0x7f5f980b8a70 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f5fa0005fd0 tx=0x7f5fa0005e40 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:39:46.647 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:46.613+0000 7f5fad7fa640 1 -- 172.21.15.83:0/3601106263 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f5fa40ce5d0 con 0x7f5fb01094f0 2024-09-21T01:39:46.714 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:46 smithi142 ceph-mon[34050]: osdmap e74: 12 total, 12 up, 12 in 2024-09-21T01:39:46.714 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:46 smithi142 ceph-mon[34050]: from='client.? 172.21.15.83:0/4152771448' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-21T01:39:46.714 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:46 smithi142 ceph-mon[34050]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-21T01:39:46.715 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:46 smithi142 ceph-mon[34050]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-21T01:39:46.717 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:46 smithi119 ceph-mon[33693]: osdmap e74: 12 total, 12 up, 12 in 2024-09-21T01:39:46.717 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:46 smithi119 ceph-mon[33693]: from='client.? 172.21.15.83:0/4152771448' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-21T01:39:46.717 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:46 smithi119 ceph-mon[33693]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-21T01:39:46.717 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:46 smithi119 ceph-mon[33693]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-21T01:39:46.801 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:46.801+0000 7f5fb66d4640 1 -- 172.21.15.83:0/3601106263 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) -- 0x7f5fb0076a10 con 0x7f5fb01094f0 2024-09-21T01:39:47.304 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:47.303+0000 7f5fad7fa640 1 -- 172.21.15.83:0/3601106263 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v75) ==== 157+0+0 (secure 0 0 0) 0x7f5fb0076a10 con 0x7f5fb01094f0 2024-09-21T01:39:47.306 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:47.306+0000 7f5fb66d4640 1 -- 172.21.15.83:0/3601106263 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f5f980b6560 msgr2=0x7f5f980b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:39:47.307 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:47.306+0000 7f5fb66d4640 1 --2- 172.21.15.83:0/3601106263 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f5f980b6560 0x7f5f980b8a70 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f5fa0005fd0 tx=0x7f5fa0005e40 comp rx=0 tx=0).stop 2024-09-21T01:39:47.307 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:47.306+0000 7f5fb66d4640 1 -- 172.21.15.83:0/3601106263 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5fb01094f0 msgr2=0x7f5fb0075c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:39:47.307 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:47.306+0000 7f5fb66d4640 1 --2- 172.21.15.83:0/3601106263 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5fb01094f0 0x7f5fb0075c50 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f5fa4005940 tx=0x7f5fa40040e0 comp rx=0 tx=0).stop 2024-09-21T01:39:47.307 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:47.306+0000 7f5fb66d4640 1 -- 172.21.15.83:0/3601106263 shutdown_connections 2024-09-21T01:39:47.307 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:47.306+0000 7f5fb66d4640 1 --2- 172.21.15.83:0/3601106263 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f5f980b6560 0x7f5f980b8a70 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:47.307 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:47.306+0000 7f5fb66d4640 1 --2- 172.21.15.83:0/3601106263 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5fb0109e40 0x7f5fb0076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:47.307 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:47.306+0000 7f5fb66d4640 1 --2- 172.21.15.83:0/3601106263 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5fb01094f0 0x7f5fb0075c50 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:47.307 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:47.306+0000 7f5fb66d4640 1 --2- 172.21.15.83:0/3601106263 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5fb0103bb0 0x7f5fb0075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:47.307 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:47.306+0000 7f5fb66d4640 1 -- 172.21.15.83:0/3601106263 >> 172.21.15.83:0/3601106263 conn(0x7f5fb00ff600 msgr2=0x7f5fb0101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:39:47.307 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:47.306+0000 7f5fb66d4640 1 -- 172.21.15.83:0/3601106263 shutdown_connections 2024-09-21T01:39:47.308 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:47.306+0000 7f5fb66d4640 1 -- 172.21.15.83:0/3601106263 wait complete. 2024-09-21T01:39:47.554 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:47 smithi083 ceph-mon[31370]: mds.? [v2:172.21.15.119:6838/3106757092,v1:172.21.15.119:6839/3106757092] up:active 2024-09-21T01:39:47.554 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:47 smithi083 ceph-mon[31370]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T01:39:47.554 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:47 smithi083 ceph-mon[31370]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T01:39:47.554 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:47 smithi083 ceph-mon[31370]: pgmap v261: 97 pgs: 62 active+clean, 7 creating+peering, 28 unknown; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s wr, 1 op/s 2024-09-21T01:39:47.554 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:47 smithi083 ceph-mon[31370]: from='client.? 172.21.15.83:0/3601106263' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} : dispatch 2024-09-21T01:39:47.714 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:47 smithi142 ceph-mon[34050]: mds.? [v2:172.21.15.119:6838/3106757092,v1:172.21.15.119:6839/3106757092] up:active 2024-09-21T01:39:47.715 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:47 smithi142 ceph-mon[34050]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T01:39:47.715 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:47 smithi142 ceph-mon[34050]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T01:39:47.715 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:47 smithi142 ceph-mon[34050]: pgmap v261: 97 pgs: 62 active+clean, 7 creating+peering, 28 unknown; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s wr, 1 op/s 2024-09-21T01:39:47.715 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:47 smithi142 ceph-mon[34050]: from='client.? 172.21.15.83:0/3601106263' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} : dispatch 2024-09-21T01:39:47.717 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:47 smithi119 ceph-mon[33693]: mds.? [v2:172.21.15.119:6838/3106757092,v1:172.21.15.119:6839/3106757092] up:active 2024-09-21T01:39:47.718 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:47 smithi119 ceph-mon[33693]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T01:39:47.718 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:47 smithi119 ceph-mon[33693]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T01:39:47.718 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:47 smithi119 ceph-mon[33693]: pgmap v261: 97 pgs: 62 active+clean, 7 creating+peering, 28 unknown; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s wr, 1 op/s 2024-09-21T01:39:47.718 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:47 smithi119 ceph-mon[33693]: from='client.? 172.21.15.83:0/3601106263' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} : dispatch 2024-09-21T01:39:47.959 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-09-21T01:39:48.204 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:39:48.557 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:48 smithi083 ceph-mon[31370]: from='client.? 172.21.15.83:0/3601106263' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-09-21T01:39:48.558 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:48 smithi083 ceph-mon[31370]: osdmap e75: 12 total, 12 up, 12 in 2024-09-21T01:39:48.653 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:48.650+0000 7f8717a72640 1 -- 172.21.15.83:0/700012463 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8710102670 msgr2=0x7f8710102a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:39:48.653 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:48.650+0000 7f8717a72640 1 --2- 172.21.15.83:0/700012463 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8710102670 0x7f8710102a80 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f870c009900 tx=0x7f870c02a410 comp rx=0 tx=0).stop 2024-09-21T01:39:48.653 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:48.650+0000 7f8717a72640 1 -- 172.21.15.83:0/700012463 shutdown_connections 2024-09-21T01:39:48.653 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:48.650+0000 7f8717a72640 1 --2- 172.21.15.83:0/700012463 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8710107c00 0x7f87101080e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:48.653 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:48.650+0000 7f8717a72640 1 --2- 172.21.15.83:0/700012463 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f87101030a0 0x7f87101076c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:48.653 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:48.650+0000 7f8717a72640 1 --2- 172.21.15.83:0/700012463 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8710102670 0x7f8710102a80 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:48.653 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:48.650+0000 7f8717a72640 1 -- 172.21.15.83:0/700012463 >> 172.21.15.83:0/700012463 conn(0x7f87100797e0 msgr2=0x7f8710079bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:39:48.653 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:48.650+0000 7f8717a72640 1 -- 172.21.15.83:0/700012463 shutdown_connections 2024-09-21T01:39:48.653 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:48.650+0000 7f8717a72640 1 -- 172.21.15.83:0/700012463 wait complete. 2024-09-21T01:39:48.653 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:48.651+0000 7f8717a72640 1 Processor -- start 2024-09-21T01:39:48.653 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:48.651+0000 7f8717a72640 1 -- start start 2024-09-21T01:39:48.654 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:48.651+0000 7f8717a72640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8710102670 0x7f87101a0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:39:48.654 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:48.651+0000 7f8717a72640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f87101030a0 0x7f87101a1070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:39:48.654 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:48.651+0000 7f8717a72640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8710107c00 0x7f87101a6310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:39:48.654 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:48.651+0000 7f8717a72640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f871011a020 con 0x7f87101030a0 2024-09-21T01:39:48.654 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:48.651+0000 7f8717a72640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f8710119ea0 con 0x7f8710107c00 2024-09-21T01:39:48.654 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:48.651+0000 7f8717a72640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f871011a1a0 con 0x7f8710102670 2024-09-21T01:39:48.654 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:48.652+0000 7f871500d640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f87101030a0 0x7f87101a1070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:39:48.654 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:48.652+0000 7f871500d640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f87101030a0 0x7f87101a1070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:55532/0 (socket says 172.21.15.83:55532) 2024-09-21T01:39:48.654 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:48.652+0000 7f871500d640 1 -- 172.21.15.83:0/301988249 learned_addr learned my addr 172.21.15.83:0/301988249 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:39:48.654 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:48.652+0000 7f871580e640 1 --2- 172.21.15.83:0/301988249 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8710102670 0x7f87101a0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:39:48.654 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:48.652+0000 7f871600f640 1 --2- 172.21.15.83:0/301988249 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8710107c00 0x7f87101a6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:39:48.654 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:48.652+0000 7f871500d640 1 -- 172.21.15.83:0/301988249 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8710102670 msgr2=0x7f87101a0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:39:48.655 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:48.652+0000 7f871500d640 1 --2- 172.21.15.83:0/301988249 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8710102670 0x7f87101a0ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:48.655 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:48.652+0000 7f871500d640 1 -- 172.21.15.83:0/301988249 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8710107c00 msgr2=0x7f87101a6310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:39:48.655 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:48.652+0000 7f871500d640 1 --2- 172.21.15.83:0/301988249 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8710107c00 0x7f87101a6310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:48.655 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:48.652+0000 7f871500d640 1 -- 172.21.15.83:0/301988249 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87101a6a40 con 0x7f87101030a0 2024-09-21T01:39:48.655 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:48.652+0000 7f871500d640 1 --2- 172.21.15.83:0/301988249 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f87101030a0 0x7f87101a1070 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f870000b450 tx=0x7f870000b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:39:48.655 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:48.652+0000 7f8706ffd640 1 -- 172.21.15.83:0/301988249 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8700015020 con 0x7f87101030a0 2024-09-21T01:39:48.655 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:48.652+0000 7f8706ffd640 1 -- 172.21.15.83:0/301988249 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8700011d20 con 0x7f87101030a0 2024-09-21T01:39:48.655 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:48.652+0000 7f8717a72640 1 -- 172.21.15.83:0/301988249 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87101a6d30 con 0x7f87101030a0 2024-09-21T01:39:48.655 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:48.652+0000 7f8706ffd640 1 -- 172.21.15.83:0/301988249 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8700010e10 con 0x7f87101030a0 2024-09-21T01:39:48.655 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:48.652+0000 7f8717a72640 1 -- 172.21.15.83:0/301988249 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87101ad490 con 0x7f87101030a0 2024-09-21T01:39:48.656 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:48.654+0000 7f8717a72640 1 -- 172.21.15.83:0/301988249 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f871006c1a0 con 0x7f87101030a0 2024-09-21T01:39:48.656 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:48.655+0000 7f8706ffd640 1 -- 172.21.15.83:0/301988249 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 20) ==== 154529+0+0 (secure 0 0 0) 0x7f8700018020 con 0x7f87101030a0 2024-09-21T01:39:48.656 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:48.655+0000 7f8706ffd640 1 --2- 172.21.15.83:0/301988249 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f86fc0b6560 0x7f86fc0b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:39:48.656 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:48.656+0000 7f871580e640 1 --2- 172.21.15.83:0/301988249 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f86fc0b6560 0x7f86fc0b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:39:48.656 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:48.656+0000 7f8706ffd640 1 -- 172.21.15.83:0/301988249 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8492+0+0 (secure 0 0 0) 0x7f87000e6ee0 con 0x7f87101030a0 2024-09-21T01:39:48.656 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:48.656+0000 7f871580e640 1 --2- 172.21.15.83:0/301988249 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f86fc0b6560 0x7f86fc0b8a70 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f870c0057c0 tx=0x7f870c0058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:39:48.660 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:48.660+0000 7f8706ffd640 1 -- 172.21.15.83:0/301988249 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f870001f020 con 0x7f87101030a0 2024-09-21T01:39:48.714 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:48 smithi142 ceph-mon[34050]: from='client.? 172.21.15.83:0/3601106263' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-09-21T01:39:48.715 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:48 smithi142 ceph-mon[34050]: osdmap e75: 12 total, 12 up, 12 in 2024-09-21T01:39:48.717 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:48 smithi119 ceph-mon[33693]: from='client.? 172.21.15.83:0/3601106263' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-09-21T01:39:48.717 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:48 smithi119 ceph-mon[33693]: osdmap e75: 12 total, 12 up, 12 in 2024-09-21T01:39:48.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:48.841+0000 7f8717a72640 1 -- 172.21.15.83:0/301988249 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f87101ad750 con 0x7f87101030a0 2024-09-21T01:39:49.714 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:49 smithi142 ceph-mon[34050]: pgmap v263: 97 pgs: 93 active+clean, 4 creating+peering; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s wr, 6 op/s 2024-09-21T01:39:49.715 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:49 smithi142 ceph-mon[34050]: from='client.? 172.21.15.83:0/301988249' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2024-09-21T01:39:49.717 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:49 smithi119 ceph-mon[33693]: pgmap v263: 97 pgs: 93 active+clean, 4 creating+peering; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s wr, 6 op/s 2024-09-21T01:39:49.717 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:49 smithi119 ceph-mon[33693]: from='client.? 172.21.15.83:0/301988249' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2024-09-21T01:39:49.804 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:49 smithi083 ceph-mon[31370]: pgmap v263: 97 pgs: 93 active+clean, 4 creating+peering; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s wr, 6 op/s 2024-09-21T01:39:49.804 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:49 smithi083 ceph-mon[31370]: from='client.? 172.21.15.83:0/301988249' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2024-09-21T01:39:50.316 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:50.315+0000 7f8706ffd640 1 -- 172.21.15.83:0/301988249 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v77) ==== 228+0+0 (secure 0 0 0) 0x7f870000d040 con 0x7f87101030a0 2024-09-21T01:39:50.316 INFO:teuthology.orchestra.run.smithi083.stderr:pool 'cephfs_data_ec' created 2024-09-21T01:39:50.320 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:50.319+0000 7f8717a72640 1 -- 172.21.15.83:0/301988249 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f86fc0b6560 msgr2=0x7f86fc0b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:39:50.320 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:50.319+0000 7f8717a72640 1 --2- 172.21.15.83:0/301988249 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f86fc0b6560 0x7f86fc0b8a70 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f870c0057c0 tx=0x7f870c0058d0 comp rx=0 tx=0).stop 2024-09-21T01:39:50.320 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:50.319+0000 7f8717a72640 1 -- 172.21.15.83:0/301988249 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f87101030a0 msgr2=0x7f87101a1070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:39:50.320 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:50.319+0000 7f8717a72640 1 --2- 172.21.15.83:0/301988249 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f87101030a0 0x7f87101a1070 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f870000b450 tx=0x7f870000b910 comp rx=0 tx=0).stop 2024-09-21T01:39:50.320 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:50.320+0000 7f8717a72640 1 -- 172.21.15.83:0/301988249 shutdown_connections 2024-09-21T01:39:50.320 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:50.320+0000 7f8717a72640 1 --2- 172.21.15.83:0/301988249 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f86fc0b6560 0x7f86fc0b8a70 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:50.321 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:50.320+0000 7f8717a72640 1 --2- 172.21.15.83:0/301988249 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8710107c00 0x7f87101a6310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:50.321 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:50.320+0000 7f8717a72640 1 --2- 172.21.15.83:0/301988249 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f87101030a0 0x7f87101a1070 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:50.321 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:50.320+0000 7f8717a72640 1 --2- 172.21.15.83:0/301988249 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8710102670 0x7f87101a0ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:50.321 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:50.320+0000 7f8717a72640 1 -- 172.21.15.83:0/301988249 >> 172.21.15.83:0/301988249 conn(0x7f87100797e0 msgr2=0x7f8710105690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:39:50.321 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:50.320+0000 7f8717a72640 1 -- 172.21.15.83:0/301988249 shutdown_connections 2024-09-21T01:39:50.321 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:50.320+0000 7f8717a72640 1 -- 172.21.15.83:0/301988249 wait complete. 2024-09-21T01:39:50.640 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:50 smithi083 ceph-mon[31370]: osdmap e76: 12 total, 12 up, 12 in 2024-09-21T01:39:50.714 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:50 smithi142 ceph-mon[34050]: osdmap e76: 12 total, 12 up, 12 in 2024-09-21T01:39:50.717 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:50 smithi119 ceph-mon[33693]: osdmap e76: 12 total, 12 up, 12 in 2024-09-21T01:39:50.974 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-09-21T01:39:51.218 INFO:journalctl@ceph.mds.b.smithi119.stdout:Sep 21 01:39:50 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mds-b[62910]: 2024-09-21T01:39:50.819+0000 7f9fb9ce4640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-21T01:39:51.222 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:39:51.612 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:51 smithi083 ceph-mon[31370]: from='client.? 172.21.15.83:0/301988249' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-21T01:39:51.613 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:51 smithi083 ceph-mon[31370]: osdmap e77: 12 total, 12 up, 12 in 2024-09-21T01:39:51.613 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:51 smithi083 ceph-mon[31370]: pgmap v266: 129 pgs: 32 unknown, 97 active+clean; 579 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s wr, 8 op/s 2024-09-21T01:39:51.613 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:51 smithi083 ceph-mon[31370]: osdmap e78: 12 total, 12 up, 12 in 2024-09-21T01:39:51.714 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:51 smithi142 ceph-mon[34050]: from='client.? 172.21.15.83:0/301988249' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-21T01:39:51.714 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:51 smithi142 ceph-mon[34050]: osdmap e77: 12 total, 12 up, 12 in 2024-09-21T01:39:51.715 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:51 smithi142 ceph-mon[34050]: pgmap v266: 129 pgs: 32 unknown, 97 active+clean; 579 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s wr, 8 op/s 2024-09-21T01:39:51.715 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:51 smithi142 ceph-mon[34050]: osdmap e78: 12 total, 12 up, 12 in 2024-09-21T01:39:51.717 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:51 smithi119 ceph-mon[33693]: from='client.? 172.21.15.83:0/301988249' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-21T01:39:51.717 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:51 smithi119 ceph-mon[33693]: osdmap e77: 12 total, 12 up, 12 in 2024-09-21T01:39:51.718 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:51 smithi119 ceph-mon[33693]: pgmap v266: 129 pgs: 32 unknown, 97 active+clean; 579 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s wr, 8 op/s 2024-09-21T01:39:51.718 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:51 smithi119 ceph-mon[33693]: osdmap e78: 12 total, 12 up, 12 in 2024-09-21T01:39:51.721 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:51.706+0000 7f1f4bd25640 1 -- 172.21.15.83:0/895066498 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1f44109df0 msgr2=0x7f1f44110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:39:51.721 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:51.706+0000 7f1f4bd25640 1 --2- 172.21.15.83:0/895066498 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1f44109df0 0x7f1f44110620 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f1f3c009900 tx=0x7f1f3c02a410 comp rx=0 tx=0).stop 2024-09-21T01:39:51.721 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:51.706+0000 7f1f4bd25640 1 -- 172.21.15.83:0/895066498 shutdown_connections 2024-09-21T01:39:51.721 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:51.706+0000 7f1f4bd25640 1 --2- 172.21.15.83:0/895066498 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1f44109df0 0x7f1f44110620 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:51.721 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:51.706+0000 7f1f4bd25640 1 --2- 172.21.15.83:0/895066498 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1f441094a0 0x7f1f441098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:51.722 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:51.706+0000 7f1f4bd25640 1 --2- 172.21.15.83:0/895066498 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1f44103b60 0x7f1f44103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:51.722 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:51.706+0000 7f1f4bd25640 1 -- 172.21.15.83:0/895066498 >> 172.21.15.83:0/895066498 conn(0x7f1f4407b850 msgr2=0x7f1f4407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:39:51.722 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:51.706+0000 7f1f4bd25640 1 -- 172.21.15.83:0/895066498 shutdown_connections 2024-09-21T01:39:51.722 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:51.706+0000 7f1f4bd25640 1 -- 172.21.15.83:0/895066498 wait complete. 2024-09-21T01:39:51.722 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:51.706+0000 7f1f4bd25640 1 Processor -- start 2024-09-21T01:39:51.722 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:51.706+0000 7f1f4bd25640 1 -- start start 2024-09-21T01:39:51.722 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:51.707+0000 7f1f4bd25640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1f44103b60 0x7f1f4419a370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:39:51.722 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:51.707+0000 7f1f4bd25640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1f441094a0 0x7f1f4419a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:39:51.722 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:51.707+0000 7f1f4bd25640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1f44109df0 0x7f1f4419fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:39:51.722 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:51.707+0000 7f1f4bd25640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f1f44113960 con 0x7f1f44109df0 2024-09-21T01:39:51.722 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:51.707+0000 7f1f4bd25640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f1f441137e0 con 0x7f1f441094a0 2024-09-21T01:39:51.722 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:51.707+0000 7f1f4bd25640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f1f44113ae0 con 0x7f1f44103b60 2024-09-21T01:39:51.722 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:51.707+0000 7f1f4a2c2640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1f44109df0 0x7f1f4419fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:39:51.722 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:51.707+0000 7f1f4a2c2640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1f44109df0 0x7f1f4419fbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:55552/0 (socket says 172.21.15.83:55552) 2024-09-21T01:39:51.722 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:51.707+0000 7f1f4a2c2640 1 -- 172.21.15.83:0/1780786764 learned_addr learned my addr 172.21.15.83:0/1780786764 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:39:51.723 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:51.707+0000 7f1f49ac1640 1 --2- 172.21.15.83:0/1780786764 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1f44103b60 0x7f1f4419a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:39:51.723 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:51.707+0000 7f1f492c0640 1 --2- 172.21.15.83:0/1780786764 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1f441094a0 0x7f1f4419a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:39:51.723 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:51.707+0000 7f1f4a2c2640 1 -- 172.21.15.83:0/1780786764 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1f44103b60 msgr2=0x7f1f4419a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:39:51.723 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:51.707+0000 7f1f4a2c2640 1 --2- 172.21.15.83:0/1780786764 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1f44103b60 0x7f1f4419a370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:51.723 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:51.707+0000 7f1f4a2c2640 1 -- 172.21.15.83:0/1780786764 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1f441094a0 msgr2=0x7f1f4419a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:39:51.723 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:51.707+0000 7f1f4a2c2640 1 --2- 172.21.15.83:0/1780786764 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1f441094a0 0x7f1f4419a910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:51.723 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:51.707+0000 7f1f4a2c2640 1 -- 172.21.15.83:0/1780786764 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f441a0220 con 0x7f1f44109df0 2024-09-21T01:39:51.723 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:51.707+0000 7f1f4a2c2640 1 --2- 172.21.15.83:0/1780786764 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1f44109df0 0x7f1f4419fbb0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f1f3c005ab0 tx=0x7f1f3c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:39:51.723 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:51.708+0000 7f1f42ffd640 1 -- 172.21.15.83:0/1780786764 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f3c03f030 con 0x7f1f44109df0 2024-09-21T01:39:51.723 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:51.708+0000 7f1f42ffd640 1 -- 172.21.15.83:0/1780786764 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1f3c003c90 con 0x7f1f44109df0 2024-09-21T01:39:51.723 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:51.708+0000 7f1f42ffd640 1 -- 172.21.15.83:0/1780786764 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f3c035070 con 0x7f1f44109df0 2024-09-21T01:39:51.723 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:51.708+0000 7f1f4bd25640 1 -- 172.21.15.83:0/1780786764 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f441a04b0 con 0x7f1f44109df0 2024-09-21T01:39:51.723 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:51.708+0000 7f1f4bd25640 1 -- 172.21.15.83:0/1780786764 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f441a0940 con 0x7f1f44109df0 2024-09-21T01:39:51.723 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:51.709+0000 7f1f4bd25640 1 -- 172.21.15.83:0/1780786764 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f44103f70 con 0x7f1f44109df0 2024-09-21T01:39:51.723 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:51.710+0000 7f1f42ffd640 1 -- 172.21.15.83:0/1780786764 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 20) ==== 154529+0+0 (secure 0 0 0) 0x7f1f3c042030 con 0x7f1f44109df0 2024-09-21T01:39:51.724 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:51.711+0000 7f1f42ffd640 1 --2- 172.21.15.83:0/1780786764 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f1f2c0b6590 0x7f1f2c0b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:39:51.724 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:51.711+0000 7f1f49ac1640 1 --2- 172.21.15.83:0/1780786764 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f1f2c0b6590 0x7f1f2c0b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:39:51.724 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:51.711+0000 7f1f42ffd640 1 -- 172.21.15.83:0/1780786764 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8985+0+0 (secure 0 0 0) 0x7f1f3c108040 con 0x7f1f44109df0 2024-09-21T01:39:51.724 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:51.711+0000 7f1f49ac1640 1 --2- 172.21.15.83:0/1780786764 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f1f2c0b6590 0x7f1f2c0b8aa0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f1f34007ec0 tx=0x7f1f340075b0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:39:51.724 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:51.714+0000 7f1f42ffd640 1 -- 172.21.15.83:0/1780786764 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f1f3c0ce5e0 con 0x7f1f44109df0 2024-09-21T01:39:51.893 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:51.893+0000 7f1f4bd25640 1 -- 172.21.15.83:0/1780786764 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) -- 0x7f1f4419b4a0 con 0x7f1f44109df0 2024-09-21T01:39:52.319 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:52.319+0000 7f1f42ffd640 1 -- 172.21.15.83:0/1780786764 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v79) ==== 169+0+0 (secure 0 0 0) 0x7f1f4419b4a0 con 0x7f1f44109df0 2024-09-21T01:39:52.319 INFO:teuthology.orchestra.run.smithi083.stderr:set pool 4 allow_ec_overwrites to true 2024-09-21T01:39:52.323 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:52.322+0000 7f1f4bd25640 1 -- 172.21.15.83:0/1780786764 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f1f2c0b6590 msgr2=0x7f1f2c0b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:39:52.323 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:52.322+0000 7f1f4bd25640 1 --2- 172.21.15.83:0/1780786764 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f1f2c0b6590 0x7f1f2c0b8aa0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f1f34007ec0 tx=0x7f1f340075b0 comp rx=0 tx=0).stop 2024-09-21T01:39:52.323 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:52.322+0000 7f1f4bd25640 1 -- 172.21.15.83:0/1780786764 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1f44109df0 msgr2=0x7f1f4419fbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:39:52.323 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:52.322+0000 7f1f4bd25640 1 --2- 172.21.15.83:0/1780786764 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1f44109df0 0x7f1f4419fbb0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f1f3c005ab0 tx=0x7f1f3c0042f0 comp rx=0 tx=0).stop 2024-09-21T01:39:52.323 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:52.322+0000 7f1f4bd25640 1 -- 172.21.15.83:0/1780786764 shutdown_connections 2024-09-21T01:39:52.323 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:52.322+0000 7f1f4bd25640 1 --2- 172.21.15.83:0/1780786764 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f1f2c0b6590 0x7f1f2c0b8aa0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:52.323 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:52.322+0000 7f1f4bd25640 1 --2- 172.21.15.83:0/1780786764 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1f44109df0 0x7f1f4419fbb0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:52.323 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:52.322+0000 7f1f4bd25640 1 --2- 172.21.15.83:0/1780786764 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1f441094a0 0x7f1f4419a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:52.323 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:52.322+0000 7f1f4bd25640 1 --2- 172.21.15.83:0/1780786764 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1f44103b60 0x7f1f4419a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:52.323 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:52.322+0000 7f1f4bd25640 1 -- 172.21.15.83:0/1780786764 >> 172.21.15.83:0/1780786764 conn(0x7f1f4407b850 msgr2=0x7f1f44107590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:39:52.323 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:52.322+0000 7f1f4bd25640 1 -- 172.21.15.83:0/1780786764 shutdown_connections 2024-09-21T01:39:52.323 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:52.322+0000 7f1f4bd25640 1 -- 172.21.15.83:0/1780786764 wait complete. 2024-09-21T01:39:52.608 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:52 smithi083 ceph-mon[31370]: from='client.? 172.21.15.83:0/1780786764' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} : dispatch 2024-09-21T01:39:52.609 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:52 smithi083 ceph-mon[31370]: from='client.? 172.21.15.83:0/1780786764' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-09-21T01:39:52.609 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:52 smithi083 ceph-mon[31370]: osdmap e79: 12 total, 12 up, 12 in 2024-09-21T01:39:52.616 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:52 smithi142 ceph-mon[34050]: from='client.? 172.21.15.83:0/1780786764' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} : dispatch 2024-09-21T01:39:52.616 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:52 smithi142 ceph-mon[34050]: from='client.? 172.21.15.83:0/1780786764' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-09-21T01:39:52.616 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:52 smithi142 ceph-mon[34050]: osdmap e79: 12 total, 12 up, 12 in 2024-09-21T01:39:52.619 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:52 smithi119 ceph-mon[33693]: from='client.? 172.21.15.83:0/1780786764' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} : dispatch 2024-09-21T01:39:52.619 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:52 smithi119 ceph-mon[33693]: from='client.? 172.21.15.83:0/1780786764' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-09-21T01:39:52.619 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:52 smithi119 ceph-mon[33693]: osdmap e79: 12 total, 12 up, 12 in 2024-09-21T01:39:53.030 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph fs add_data_pool cephfs cephfs_data_ec 2024-09-21T01:39:53.284 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:39:53.611 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:53 smithi083 ceph-mon[31370]: pgmap v269: 129 pgs: 4 creating+peering, 14 unknown, 111 active+clean; 579 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s wr, 2 op/s 2024-09-21T01:39:53.627 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:53 smithi142 ceph-mon[34050]: pgmap v269: 129 pgs: 4 creating+peering, 14 unknown, 111 active+clean; 579 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s wr, 2 op/s 2024-09-21T01:39:53.717 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:53 smithi119 ceph-mon[33693]: pgmap v269: 129 pgs: 4 creating+peering, 14 unknown, 111 active+clean; 579 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s wr, 2 op/s 2024-09-21T01:39:53.815 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:53.813+0000 7fa57db54640 1 -- 172.21.15.83:0/1612543165 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa57810de40 msgr2=0x7fa578110330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:39:53.816 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:53.813+0000 7fa57db54640 1 --2- 172.21.15.83:0/1612543165 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa57810de40 0x7fa578110330 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fa570009ca0 tx=0x7fa57002a8c0 comp rx=0 tx=0).stop 2024-09-21T01:39:53.816 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:53.813+0000 7fa57db54640 1 -- 172.21.15.83:0/1612543165 shutdown_connections 2024-09-21T01:39:53.816 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:53.813+0000 7fa57db54640 1 --2- 172.21.15.83:0/1612543165 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa57810de40 0x7fa578110330 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:53.816 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:53.813+0000 7fa57db54640 1 --2- 172.21.15.83:0/1612543165 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa578105330 0x7fa57810d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:53.816 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:53.813+0000 7fa57db54640 1 --2- 172.21.15.83:0/1612543165 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa5781049e0 0x7fa578104df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:53.816 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:53.813+0000 7fa57db54640 1 -- 172.21.15.83:0/1612543165 >> 172.21.15.83:0/1612543165 conn(0x7fa578079750 msgr2=0x7fa578079b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:39:53.816 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:53.813+0000 7fa57db54640 1 -- 172.21.15.83:0/1612543165 shutdown_connections 2024-09-21T01:39:53.816 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:53.813+0000 7fa57db54640 1 -- 172.21.15.83:0/1612543165 wait complete. 2024-09-21T01:39:53.816 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:53.814+0000 7fa57db54640 1 Processor -- start 2024-09-21T01:39:53.816 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:53.814+0000 7fa57db54640 1 -- start start 2024-09-21T01:39:53.816 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:53.814+0000 7fa57db54640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa5781049e0 0x7fa578102720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:39:53.817 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:53.814+0000 7fa57db54640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa578105330 0x7fa578102c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:39:53.817 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:53.814+0000 7fa57db54640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa57810de40 0x7fa5781031a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:39:53.817 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:53.814+0000 7fa57db54640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fa5781139a0 con 0x7fa578105330 2024-09-21T01:39:53.817 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:53.814+0000 7fa57db54640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fa578113820 con 0x7fa5781049e0 2024-09-21T01:39:53.817 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:53.814+0000 7fa57db54640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fa578113b20 con 0x7fa57810de40 2024-09-21T01:39:53.817 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:53.814+0000 7fa576ffd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa578105330 0x7fa578102c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:39:53.817 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:53.814+0000 7fa576ffd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa578105330 0x7fa578102c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:48862/0 (socket says 172.21.15.83:48862) 2024-09-21T01:39:53.817 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:53.814+0000 7fa576ffd640 1 -- 172.21.15.83:0/3074262618 learned_addr learned my addr 172.21.15.83:0/3074262618 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:39:53.817 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:53.814+0000 7fa5777fe640 1 --2- 172.21.15.83:0/3074262618 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa5781049e0 0x7fa578102720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:39:53.817 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:53.814+0000 7fa577fff640 1 --2- 172.21.15.83:0/3074262618 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa57810de40 0x7fa5781031a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:39:53.817 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:53.815+0000 7fa576ffd640 1 -- 172.21.15.83:0/3074262618 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa57810de40 msgr2=0x7fa5781031a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:39:53.817 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:53.815+0000 7fa576ffd640 1 --2- 172.21.15.83:0/3074262618 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa57810de40 0x7fa5781031a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:53.817 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:53.815+0000 7fa576ffd640 1 -- 172.21.15.83:0/3074262618 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa5781049e0 msgr2=0x7fa578102720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:39:53.818 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:53.815+0000 7fa576ffd640 1 --2- 172.21.15.83:0/3074262618 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa5781049e0 0x7fa578102720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:53.818 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:53.815+0000 7fa576ffd640 1 -- 172.21.15.83:0/3074262618 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5781a8730 con 0x7fa578105330 2024-09-21T01:39:53.818 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:53.815+0000 7fa5777fe640 1 --2- 172.21.15.83:0/3074262618 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa5781049e0 0x7fa578102720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:39:53.818 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:53.815+0000 7fa576ffd640 1 --2- 172.21.15.83:0/3074262618 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa578105330 0x7fa578102c60 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fa56c00d740 tx=0x7fa56c00dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:39:53.818 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:53.815+0000 7fa574ff9640 1 -- 172.21.15.83:0/3074262618 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa56c017070 con 0x7fa578105330 2024-09-21T01:39:53.818 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:53.815+0000 7fa574ff9640 1 -- 172.21.15.83:0/3074262618 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa56c00de50 con 0x7fa578105330 2024-09-21T01:39:53.818 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:53.815+0000 7fa57db54640 1 -- 172.21.15.83:0/3074262618 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5781a8a20 con 0x7fa578105330 2024-09-21T01:39:53.818 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:53.815+0000 7fa574ff9640 1 -- 172.21.15.83:0/3074262618 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa56c00f620 con 0x7fa578105330 2024-09-21T01:39:53.818 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:53.815+0000 7fa57db54640 1 -- 172.21.15.83:0/3074262618 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5781a8f60 con 0x7fa578105330 2024-09-21T01:39:53.819 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:53.816+0000 7fa57db54640 1 -- 172.21.15.83:0/3074262618 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa57806c280 con 0x7fa578105330 2024-09-21T01:39:53.819 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:53.817+0000 7fa574ff9640 1 -- 172.21.15.83:0/3074262618 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 20) ==== 154529+0+0 (secure 0 0 0) 0x7fa56c01a070 con 0x7fa578105330 2024-09-21T01:39:53.819 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:53.818+0000 7fa574ff9640 1 --2- 172.21.15.83:0/3074262618 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fa5600b6560 0x7fa5600b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:39:53.819 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:53.818+0000 7fa5777fe640 1 --2- 172.21.15.83:0/3074262618 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fa5600b6560 0x7fa5600b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:39:53.819 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:53.818+0000 7fa574ff9640 1 -- 172.21.15.83:0/3074262618 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8985+0+0 (secure 0 0 0) 0x7fa56c0e7040 con 0x7fa578105330 2024-09-21T01:39:53.819 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:53.819+0000 7fa5777fe640 1 --2- 172.21.15.83:0/3074262618 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fa5600b6560 0x7fa5600b8a70 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fa568005fd0 tx=0x7fa568005850 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:39:53.822 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:53.821+0000 7fa574ff9640 1 -- 172.21.15.83:0/3074262618 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa56c0ad5e0 con 0x7fa578105330 2024-09-21T01:39:54.038 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:54.038+0000 7fa57db54640 1 -- 172.21.15.83:0/3074262618 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) -- 0x7fa578104df0 con 0x7fa578105330 2024-09-21T01:39:54.360 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:54.360+0000 7fa574ff9640 1 -- 172.21.15.83:0/3074262618 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v17) ==== 137+0+0 (secure 0 0 0) 0x7fa56c0b19c0 con 0x7fa578105330 2024-09-21T01:39:54.360 INFO:teuthology.orchestra.run.smithi083.stderr:added data pool 4 to fsmap 2024-09-21T01:39:54.363 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:54.362+0000 7fa57db54640 1 -- 172.21.15.83:0/3074262618 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fa5600b6560 msgr2=0x7fa5600b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:39:54.363 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:54.362+0000 7fa57db54640 1 --2- 172.21.15.83:0/3074262618 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fa5600b6560 0x7fa5600b8a70 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fa568005fd0 tx=0x7fa568005850 comp rx=0 tx=0).stop 2024-09-21T01:39:54.363 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:54.362+0000 7fa57db54640 1 -- 172.21.15.83:0/3074262618 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa578105330 msgr2=0x7fa578102c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:39:54.363 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:54.362+0000 7fa57db54640 1 --2- 172.21.15.83:0/3074262618 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa578105330 0x7fa578102c60 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fa56c00d740 tx=0x7fa56c00dc00 comp rx=0 tx=0).stop 2024-09-21T01:39:54.363 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:54.362+0000 7fa57db54640 1 -- 172.21.15.83:0/3074262618 shutdown_connections 2024-09-21T01:39:54.363 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:54.362+0000 7fa57db54640 1 --2- 172.21.15.83:0/3074262618 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fa5600b6560 0x7fa5600b8a70 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:54.363 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:54.362+0000 7fa57db54640 1 --2- 172.21.15.83:0/3074262618 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa57810de40 0x7fa5781031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:54.363 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:54.362+0000 7fa57db54640 1 --2- 172.21.15.83:0/3074262618 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa578105330 0x7fa578102c60 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:54.363 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:54.362+0000 7fa57db54640 1 --2- 172.21.15.83:0/3074262618 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa5781049e0 0x7fa578102720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:54.364 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:54.362+0000 7fa57db54640 1 -- 172.21.15.83:0/3074262618 >> 172.21.15.83:0/3074262618 conn(0x7fa578079750 msgr2=0x7fa578100660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:39:54.364 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:54.362+0000 7fa57db54640 1 -- 172.21.15.83:0/3074262618 shutdown_connections 2024-09-21T01:39:54.364 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:54.362+0000 7fa57db54640 1 -- 172.21.15.83:0/3074262618 wait complete. 2024-09-21T01:39:54.676 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:54 smithi083 ceph-mon[31370]: from='client.? 172.21.15.83:0/3074262618' entity='client.admin' cmd={"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} : dispatch 2024-09-21T01:39:54.714 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:54 smithi142 ceph-mon[34050]: from='client.? 172.21.15.83:0/3074262618' entity='client.admin' cmd={"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} : dispatch 2024-09-21T01:39:54.717 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:54 smithi119 ceph-mon[33693]: from='client.? 172.21.15.83:0/3074262618' entity='client.admin' cmd={"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} : dispatch 2024-09-21T01:39:54.994 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T01:39:55.242 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:39:55.623 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:55 smithi083 ceph-mon[31370]: osdmap e80: 12 total, 12 up, 12 in 2024-09-21T01:39:55.623 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:55 smithi083 ceph-mon[31370]: from='client.? 172.21.15.83:0/3074262618' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-09-21T01:39:55.623 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:55 smithi083 ceph-mon[31370]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T01:39:55.623 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:55 smithi083 ceph-mon[31370]: pgmap v271: 129 pgs: 4 creating+peering, 4 unknown, 121 active+clean; 579 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:39:55.714 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:55 smithi142 ceph-mon[34050]: osdmap e80: 12 total, 12 up, 12 in 2024-09-21T01:39:55.715 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:55 smithi142 ceph-mon[34050]: from='client.? 172.21.15.83:0/3074262618' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-09-21T01:39:55.715 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:55 smithi142 ceph-mon[34050]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T01:39:55.715 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:55 smithi142 ceph-mon[34050]: pgmap v271: 129 pgs: 4 creating+peering, 4 unknown, 121 active+clean; 579 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:39:55.717 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:55 smithi119 ceph-mon[33693]: osdmap e80: 12 total, 12 up, 12 in 2024-09-21T01:39:55.717 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:55 smithi119 ceph-mon[33693]: from='client.? 172.21.15.83:0/3074262618' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-09-21T01:39:55.718 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:55 smithi119 ceph-mon[33693]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T01:39:55.718 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:55 smithi119 ceph-mon[33693]: pgmap v271: 129 pgs: 4 creating+peering, 4 unknown, 121 active+clean; 579 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:39:55.723 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:55.712+0000 7f842f3db640 1 -- 172.21.15.83:0/3840648827 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f84281094a0 msgr2=0x7f84281098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:39:55.723 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:55.712+0000 7f842f3db640 1 --2- 172.21.15.83:0/3840648827 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f84281094a0 0x7f84281098b0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f8418009900 tx=0x7f841802a410 comp rx=0 tx=0).stop 2024-09-21T01:39:55.723 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:55.712+0000 7f842f3db640 1 -- 172.21.15.83:0/3840648827 shutdown_connections 2024-09-21T01:39:55.723 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:55.712+0000 7f842f3db640 1 --2- 172.21.15.83:0/3840648827 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8428109df0 0x7f8428110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:55.724 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:55.712+0000 7f842f3db640 1 --2- 172.21.15.83:0/3840648827 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f84281094a0 0x7f84281098b0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:55.724 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:55.712+0000 7f842f3db640 1 --2- 172.21.15.83:0/3840648827 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8428103b60 0x7f8428103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:55.724 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:55.712+0000 7f842f3db640 1 -- 172.21.15.83:0/3840648827 >> 172.21.15.83:0/3840648827 conn(0x7f842807b850 msgr2=0x7f842807bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:39:55.724 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:55.713+0000 7f842f3db640 1 -- 172.21.15.83:0/3840648827 shutdown_connections 2024-09-21T01:39:55.724 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:55.713+0000 7f842f3db640 1 -- 172.21.15.83:0/3840648827 wait complete. 2024-09-21T01:39:55.724 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:55.713+0000 7f842f3db640 1 Processor -- start 2024-09-21T01:39:55.724 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:55.713+0000 7f842f3db640 1 -- start start 2024-09-21T01:39:55.724 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:55.713+0000 7f842f3db640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8428103b60 0x7f842819a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:39:55.724 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:55.713+0000 7f842f3db640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f84281094a0 0x7f842819a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:39:55.724 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:55.713+0000 7f842f3db640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8428109df0 0x7f842819fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:39:55.724 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:55.713+0000 7f842f3db640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f8428113960 con 0x7f8428109df0 2024-09-21T01:39:55.724 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:55.713+0000 7f842f3db640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f84281137e0 con 0x7f84281094a0 2024-09-21T01:39:55.724 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:55.713+0000 7f842f3db640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f8428113ae0 con 0x7f8428103b60 2024-09-21T01:39:55.724 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:55.714+0000 7f842d978640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8428109df0 0x7f842819fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:39:55.724 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:55.714+0000 7f842d978640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8428109df0 0x7f842819fc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:48880/0 (socket says 172.21.15.83:48880) 2024-09-21T01:39:55.725 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:55.714+0000 7f842d978640 1 -- 172.21.15.83:0/2210258028 learned_addr learned my addr 172.21.15.83:0/2210258028 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:39:55.725 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:55.714+0000 7f842d177640 1 --2- 172.21.15.83:0/2210258028 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8428103b60 0x7f842819a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:39:55.725 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:55.714+0000 7f842c976640 1 --2- 172.21.15.83:0/2210258028 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f84281094a0 0x7f842819a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:39:55.725 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:55.714+0000 7f842d978640 1 -- 172.21.15.83:0/2210258028 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8428103b60 msgr2=0x7f842819a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:39:55.725 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:55.714+0000 7f842d978640 1 --2- 172.21.15.83:0/2210258028 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8428103b60 0x7f842819a3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:55.725 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:55.714+0000 7f842d978640 1 -- 172.21.15.83:0/2210258028 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f84281094a0 msgr2=0x7f842819a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:39:55.725 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:55.714+0000 7f842d978640 1 --2- 172.21.15.83:0/2210258028 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f84281094a0 0x7f842819a970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:55.725 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:55.714+0000 7f842d978640 1 -- 172.21.15.83:0/2210258028 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84281a0340 con 0x7f8428109df0 2024-09-21T01:39:55.725 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:55.714+0000 7f842c976640 1 --2- 172.21.15.83:0/2210258028 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f84281094a0 0x7f842819a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:39:55.725 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:55.714+0000 7f842d978640 1 --2- 172.21.15.83:0/2210258028 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8428109df0 0x7f842819fc10 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f842000cad0 tx=0x7f842000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:39:55.725 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:55.714+0000 7f841e7fc640 1 -- 172.21.15.83:0/2210258028 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f842000ae20 con 0x7f8428109df0 2024-09-21T01:39:55.725 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:55.714+0000 7f841e7fc640 1 -- 172.21.15.83:0/2210258028 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8420005020 con 0x7f8428109df0 2024-09-21T01:39:55.725 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:55.714+0000 7f842f3db640 1 -- 172.21.15.83:0/2210258028 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84281a0630 con 0x7f8428109df0 2024-09-21T01:39:55.725 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:55.714+0000 7f841e7fc640 1 -- 172.21.15.83:0/2210258028 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f842000f6b0 con 0x7f8428109df0 2024-09-21T01:39:55.726 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:55.714+0000 7f842f3db640 1 -- 172.21.15.83:0/2210258028 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84281a6d90 con 0x7f8428109df0 2024-09-21T01:39:55.726 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:55.715+0000 7f842f3db640 1 -- 172.21.15.83:0/2210258028 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8428103f70 con 0x7f8428109df0 2024-09-21T01:39:55.726 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:55.717+0000 7f841e7fc640 1 -- 172.21.15.83:0/2210258028 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 20) ==== 154529+0+0 (secure 0 0 0) 0x7f84200051d0 con 0x7f8428109df0 2024-09-21T01:39:55.726 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:55.717+0000 7f841e7fc640 1 --2- 172.21.15.83:0/2210258028 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f84140b6560 0x7f84140b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:39:55.726 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:55.718+0000 7f842d177640 1 --2- 172.21.15.83:0/2210258028 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f84140b6560 0x7f84140b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:39:55.726 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:55.718+0000 7f841e7fc640 1 -- 172.21.15.83:0/2210258028 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 9017+0+0 (secure 0 0 0) 0x7f84200e79b0 con 0x7f8428109df0 2024-09-21T01:39:55.726 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:55.718+0000 7f842d177640 1 --2- 172.21.15.83:0/2210258028 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f84140b6560 0x7f84140b8a70 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f8424005d00 tx=0x7f842400b410 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:39:55.726 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:55.722+0000 7f841e7fc640 1 -- 172.21.15.83:0/2210258028 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8420014030 con 0x7f8428109df0 2024-09-21T01:39:55.934 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:55.934+0000 7f842f3db640 1 -- 172.21.15.83:0/2210258028 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f842802e640 con 0x7f8428109df0 2024-09-21T01:39:55.935 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:55.935+0000 7f841e7fc640 1 -- 172.21.15.83:0/2210258028 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+11848 (secure 0 0 0) 0x7f84200adf30 con 0x7f8428109df0 2024-09-21T01:39:55.935 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T01:39:55.936 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":17,"btime":"2024-09-21T01:39:54:349960+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14775,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6835/1105040204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":1105040204},{"type":"v1","addr":"172.21.15.83:6835","nonce":1105040204}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14787,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/2234789563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6836","nonce":2234789563},{"type":"v1","addr":"172.21.15.83:6837","nonce":2234789563}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14838,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6839/136258364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6838","nonce":136258364},{"type":"v1","addr":"172.21.15.83:6839","nonce":136258364}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14850,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6841/129439444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6840","nonce":129439444},{"type":"v1","addr":"172.21.15.83:6841","nonce":129439444}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24569,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/2839502433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":2839502433},{"type":"v1","addr":"172.21.15.119:6833","nonce":2839502433}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24580,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6833/2841606990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":2841606990},{"type":"v1","addr":"172.21.15.142:6833","nonce":2841606990}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24599,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/415902608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":415902608},{"type":"v1","addr":"172.21.15.119:6835","nonce":415902608}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24607,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/3009088510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":3009088510},{"type":"v1","addr":"172.21.15.142:6835","nonce":3009088510}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24613,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/3847200126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6836","nonce":3847200126},{"type":"v1","addr":"172.21.15.142:6837","nonce":3847200126}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24626,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/3619222976","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":3619222976},{"type":"v1","addr":"172.21.15.119:6837","nonce":3619222976}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24631,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6839/1817880741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6838","nonce":1817880741},{"type":"v1","addr":"172.21.15.142:6839","nonce":1817880741}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T01:39:45.145124+0000","modified":"2024-09-21T01:39:54.039893+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24653},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24653":{"gid":24653,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.119:6839/3106757092","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":3106757092},{"type":"v1","addr":"172.21.15.119:6839","nonce":3106757092}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24653,"qdb_cluster":[24653]},"id":1}]} 2024-09-21T01:39:55.936 INFO:teuthology.orchestra.run.smithi083.stderr:dumped fsmap epoch 17 2024-09-21T01:39:55.938 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:55.937+0000 7f842f3db640 1 -- 172.21.15.83:0/2210258028 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f84140b6560 msgr2=0x7f84140b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:39:55.938 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:55.937+0000 7f842f3db640 1 --2- 172.21.15.83:0/2210258028 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f84140b6560 0x7f84140b8a70 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f8424005d00 tx=0x7f842400b410 comp rx=0 tx=0).stop 2024-09-21T01:39:55.938 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:55.937+0000 7f842f3db640 1 -- 172.21.15.83:0/2210258028 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8428109df0 msgr2=0x7f842819fc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:39:55.938 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:55.937+0000 7f842f3db640 1 --2- 172.21.15.83:0/2210258028 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8428109df0 0x7f842819fc10 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f842000cad0 tx=0x7f842000cf90 comp rx=0 tx=0).stop 2024-09-21T01:39:55.938 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:55.937+0000 7f842f3db640 1 -- 172.21.15.83:0/2210258028 shutdown_connections 2024-09-21T01:39:55.938 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:55.937+0000 7f842f3db640 1 --2- 172.21.15.83:0/2210258028 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f84140b6560 0x7f84140b8a70 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:55.938 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:55.937+0000 7f842f3db640 1 --2- 172.21.15.83:0/2210258028 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8428109df0 0x7f842819fc10 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:55.938 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:55.937+0000 7f842f3db640 1 --2- 172.21.15.83:0/2210258028 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f84281094a0 0x7f842819a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:55.938 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:55.937+0000 7f842f3db640 1 --2- 172.21.15.83:0/2210258028 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8428103b60 0x7f842819a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:55.939 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:55.937+0000 7f842f3db640 1 -- 172.21.15.83:0/2210258028 >> 172.21.15.83:0/2210258028 conn(0x7f842807b850 msgr2=0x7f84281075e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:39:55.939 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:55.937+0000 7f842f3db640 1 -- 172.21.15.83:0/2210258028 shutdown_connections 2024-09-21T01:39:55.939 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:55.937+0000 7f842f3db640 1 -- 172.21.15.83:0/2210258028 wait complete. 2024-09-21T01:39:56.554 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:56 smithi083 ceph-mon[31370]: from='client.? 172.21.15.83:0/2210258028' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:39:56.660 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T01:39:56.714 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:56 smithi142 ceph-mon[34050]: from='client.? 172.21.15.83:0/2210258028' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:39:56.717 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:56 smithi119 ceph-mon[33693]: from='client.? 172.21.15.83:0/2210258028' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:39:56.909 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:39:57.407 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:57.379+0000 7fc094857640 1 -- 172.21.15.83:0/1655576639 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc090103b80 msgr2=0x7fc090103f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:39:57.407 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:57.379+0000 7fc094857640 1 --2- 172.21.15.83:0/1655576639 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc090103b80 0x7fc090103f90 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fc080009900 tx=0x7fc08002a410 comp rx=0 tx=0).stop 2024-09-21T01:39:57.407 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:57.379+0000 7fc094857640 1 -- 172.21.15.83:0/1655576639 shutdown_connections 2024-09-21T01:39:57.407 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:57.379+0000 7fc094857640 1 --2- 172.21.15.83:0/1655576639 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc090109e10 0x7fc090110640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:57.407 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:57.379+0000 7fc094857640 1 --2- 172.21.15.83:0/1655576639 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc0901094c0 0x7fc0901098d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:57.407 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:57.379+0000 7fc094857640 1 --2- 172.21.15.83:0/1655576639 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc090103b80 0x7fc090103f90 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:57.407 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:57.379+0000 7fc094857640 1 -- 172.21.15.83:0/1655576639 >> 172.21.15.83:0/1655576639 conn(0x7fc0900ff5d0 msgr2=0x7fc090101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:39:57.407 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:57.379+0000 7fc094857640 1 -- 172.21.15.83:0/1655576639 shutdown_connections 2024-09-21T01:39:57.407 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:57.379+0000 7fc094857640 1 -- 172.21.15.83:0/1655576639 wait complete. 2024-09-21T01:39:57.408 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:57.380+0000 7fc094857640 1 Processor -- start 2024-09-21T01:39:57.408 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:57.380+0000 7fc094857640 1 -- start start 2024-09-21T01:39:57.408 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:57.380+0000 7fc094857640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc090103b80 0x7fc09019a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:39:57.408 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:57.380+0000 7fc094857640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc0901094c0 0x7fc09019a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:39:57.408 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:57.380+0000 7fc094857640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc090109e10 0x7fc09019fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:39:57.408 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:57.380+0000 7fc094857640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fc090113980 con 0x7fc090103b80 2024-09-21T01:39:57.408 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:57.380+0000 7fc094857640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fc090113800 con 0x7fc090109e10 2024-09-21T01:39:57.408 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:57.380+0000 7fc094857640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fc090113b00 con 0x7fc0901094c0 2024-09-21T01:39:57.408 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:57.380+0000 7fc08e59c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc090103b80 0x7fc09019a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:39:57.408 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:57.380+0000 7fc08e59c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc090103b80 0x7fc09019a410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:48898/0 (socket says 172.21.15.83:48898) 2024-09-21T01:39:57.408 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:57.380+0000 7fc08e59c640 1 -- 172.21.15.83:0/2569535658 learned_addr learned my addr 172.21.15.83:0/2569535658 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:39:57.408 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:57.380+0000 7fc08ed9d640 1 --2- 172.21.15.83:0/2569535658 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc090109e10 0x7fc09019fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:39:57.408 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:57.380+0000 7fc08dd9b640 1 --2- 172.21.15.83:0/2569535658 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc0901094c0 0x7fc09019a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:39:57.409 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:57.381+0000 7fc08e59c640 1 -- 172.21.15.83:0/2569535658 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc0901094c0 msgr2=0x7fc09019a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:39:57.409 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:57.381+0000 7fc08e59c640 1 --2- 172.21.15.83:0/2569535658 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc0901094c0 0x7fc09019a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:57.409 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:57.381+0000 7fc08e59c640 1 -- 172.21.15.83:0/2569535658 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc090109e10 msgr2=0x7fc09019fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:39:57.409 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:57.381+0000 7fc08e59c640 1 --2- 172.21.15.83:0/2569535658 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc090109e10 0x7fc09019fc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:57.409 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:57.381+0000 7fc08e59c640 1 -- 172.21.15.83:0/2569535658 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0901a0380 con 0x7fc090103b80 2024-09-21T01:39:57.409 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:57.381+0000 7fc08dd9b640 1 --2- 172.21.15.83:0/2569535658 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc0901094c0 0x7fc09019a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:39:57.409 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:57.381+0000 7fc08e59c640 1 --2- 172.21.15.83:0/2569535658 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc090103b80 0x7fc09019a410 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fc080009230 tx=0x7fc080004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:39:57.409 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:57.381+0000 7fc07f7fe640 1 -- 172.21.15.83:0/2569535658 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc08003f030 con 0x7fc090103b80 2024-09-21T01:39:57.409 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:57.381+0000 7fc094857640 1 -- 172.21.15.83:0/2569535658 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0901a0610 con 0x7fc090103b80 2024-09-21T01:39:57.409 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:57.381+0000 7fc07f7fe640 1 -- 172.21.15.83:0/2569535658 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc080003a80 con 0x7fc090103b80 2024-09-21T01:39:57.409 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:57.381+0000 7fc07f7fe640 1 -- 172.21.15.83:0/2569535658 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc080035070 con 0x7fc090103b80 2024-09-21T01:39:57.409 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:57.381+0000 7fc094857640 1 -- 172.21.15.83:0/2569535658 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0901a6dd0 con 0x7fc090103b80 2024-09-21T01:39:57.409 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:57.382+0000 7fc094857640 1 -- 172.21.15.83:0/2569535658 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc090103f90 con 0x7fc090103b80 2024-09-21T01:39:57.409 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:57.384+0000 7fc07f7fe640 1 -- 172.21.15.83:0/2569535658 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 20) ==== 154529+0+0 (secure 0 0 0) 0x7fc080042030 con 0x7fc090103b80 2024-09-21T01:39:57.410 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:57.384+0000 7fc07f7fe640 1 --2- 172.21.15.83:0/2569535658 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fc0780b6560 0x7fc0780b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:39:57.410 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:57.384+0000 7fc08dd9b640 1 --2- 172.21.15.83:0/2569535658 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fc0780b6560 0x7fc0780b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:39:57.410 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:57.384+0000 7fc07f7fe640 1 -- 172.21.15.83:0/2569535658 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 9017+0+0 (secure 0 0 0) 0x7fc080108260 con 0x7fc090103b80 2024-09-21T01:39:57.410 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:57.385+0000 7fc08dd9b640 1 --2- 172.21.15.83:0/2569535658 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fc0780b6560 0x7fc0780b8a70 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fc090109070 tx=0x7fc084005e50 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:39:57.410 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:57.387+0000 7fc07f7fe640 1 -- 172.21.15.83:0/2569535658 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc0800ce7e0 con 0x7fc090103b80 2024-09-21T01:39:57.553 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:57 smithi083 ceph-mon[31370]: pgmap v272: 129 pgs: 129 active+clean; 579 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:39:57.566 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:57.566+0000 7fc094857640 1 -- 172.21.15.83:0/2569535658 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc09010bbe0 con 0x7fc090103b80 2024-09-21T01:39:57.568 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:57.567+0000 7fc07f7fe640 1 -- 172.21.15.83:0/2569535658 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) ==== 74+0+24553 (secure 0 0 0) 0x7fc0800d2bc0 con 0x7fc090103b80 2024-09-21T01:39:57.568 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T01:39:57.568 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":80,"fsid":"f7697ecc-77b8-11ef-baf5-efdc52797490","created":"2024-09-21T01:31:22.250342+0000","modified":"2024-09-21T01:39:54.039731+0000","last_up_change":"2024-09-21T01:38:53.501659+0000","last_in_change":"2024-09-21T01:38:30.688516+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T01:35:06.977668+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T01:39:41.041950+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T01:39:42.882272+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T01:39:49.320532+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"66947512-01ee-4bf0-87b0-98a168cf50dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":3563457494},{"type":"v1","addr":"172.21.15.83:6803","nonce":3563457494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":3563457494},{"type":"v1","addr":"172.21.15.83:6805","nonce":3563457494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":3563457494},{"type":"v1","addr":"172.21.15.83:6809","nonce":3563457494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":3563457494},{"type":"v1","addr":"172.21.15.83:6807","nonce":3563457494}]},"public_addr":"172.21.15.83:6803/3563457494","cluster_addr":"172.21.15.83:6805/3563457494","heartbeat_back_addr":"172.21.15.83:6809/3563457494","heartbeat_front_addr":"172.21.15.83:6807/3563457494","state":["exists","up"]},{"osd":1,"uuid":"f7818a08-86a5-412d-a164-cfeb18f8650a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":2066870220},{"type":"v1","addr":"172.21.15.119:6801","nonce":2066870220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":2066870220},{"type":"v1","addr":"172.21.15.119:6803","nonce":2066870220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":2066870220},{"type":"v1","addr":"172.21.15.119:6807","nonce":2066870220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":2066870220},{"type":"v1","addr":"172.21.15.119:6805","nonce":2066870220}]},"public_addr":"172.21.15.119:6801/2066870220","cluster_addr":"172.21.15.119:6803/2066870220","heartbeat_back_addr":"172.21.15.119:6807/2066870220","heartbeat_front_addr":"172.21.15.119:6805/2066870220","state":["exists","up"]},{"osd":2,"uuid":"0d1a3870-c67a-4783-85f9-be2bb36f7722","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":3955936117},{"type":"v1","addr":"172.21.15.142:6801","nonce":3955936117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3955936117},{"type":"v1","addr":"172.21.15.142:6803","nonce":3955936117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":3955936117},{"type":"v1","addr":"172.21.15.142:6807","nonce":3955936117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":3955936117},{"type":"v1","addr":"172.21.15.142:6805","nonce":3955936117}]},"public_addr":"172.21.15.142:6801/3955936117","cluster_addr":"172.21.15.142:6803/3955936117","heartbeat_back_addr":"172.21.15.142:6807/3955936117","heartbeat_front_addr":"172.21.15.142:6805/3955936117","state":["exists","up"]},{"osd":3,"uuid":"a4cb1a36-3495-4d36-92da-ed3b6e852d14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":3746834093},{"type":"v1","addr":"172.21.15.83:6811","nonce":3746834093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":3746834093},{"type":"v1","addr":"172.21.15.83:6813","nonce":3746834093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":3746834093},{"type":"v1","addr":"172.21.15.83:6817","nonce":3746834093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":3746834093},{"type":"v1","addr":"172.21.15.83:6815","nonce":3746834093}]},"public_addr":"172.21.15.83:6811/3746834093","cluster_addr":"172.21.15.83:6813/3746834093","heartbeat_back_addr":"172.21.15.83:6817/3746834093","heartbeat_front_addr":"172.21.15.83:6815/3746834093","state":["exists","up"]},{"osd":4,"uuid":"d6f2ec78-7f08-473b-a96c-e8590f5d2f25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":3083907785},{"type":"v1","addr":"172.21.15.119:6809","nonce":3083907785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":3083907785},{"type":"v1","addr":"172.21.15.119:6811","nonce":3083907785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":3083907785},{"type":"v1","addr":"172.21.15.119:6815","nonce":3083907785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":3083907785},{"type":"v1","addr":"172.21.15.119:6813","nonce":3083907785}]},"public_addr":"172.21.15.119:6809/3083907785","cluster_addr":"172.21.15.119:6811/3083907785","heartbeat_back_addr":"172.21.15.119:6815/3083907785","heartbeat_front_addr":"172.21.15.119:6813/3083907785","state":["exists","up"]},{"osd":5,"uuid":"c571d04d-d3ea-4d74-8867-e4c7816f4e0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":349001002},{"type":"v1","addr":"172.21.15.142:6809","nonce":349001002}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":349001002},{"type":"v1","addr":"172.21.15.142:6811","nonce":349001002}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":349001002},{"type":"v1","addr":"172.21.15.142:6815","nonce":349001002}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":349001002},{"type":"v1","addr":"172.21.15.142:6813","nonce":349001002}]},"public_addr":"172.21.15.142:6809/349001002","cluster_addr":"172.21.15.142:6811/349001002","heartbeat_back_addr":"172.21.15.142:6815/349001002","heartbeat_front_addr":"172.21.15.142:6813/349001002","state":["exists","up"]},{"osd":6,"uuid":"6e1b6fe9-700a-448a-b382-59b97896ea7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":771651063},{"type":"v1","addr":"172.21.15.83:6819","nonce":771651063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":771651063},{"type":"v1","addr":"172.21.15.83:6821","nonce":771651063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":771651063},{"type":"v1","addr":"172.21.15.83:6825","nonce":771651063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":771651063},{"type":"v1","addr":"172.21.15.83:6823","nonce":771651063}]},"public_addr":"172.21.15.83:6819/771651063","cluster_addr":"172.21.15.83:6821/771651063","heartbeat_back_addr":"172.21.15.83:6825/771651063","heartbeat_front_addr":"172.21.15.83:6823/771651063","state":["exists","up"]},{"osd":7,"uuid":"283bfae4-5f50-4f9e-860e-bbfd47e005e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":1556984819},{"type":"v1","addr":"172.21.15.119:6817","nonce":1556984819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":1556984819},{"type":"v1","addr":"172.21.15.119:6819","nonce":1556984819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":1556984819},{"type":"v1","addr":"172.21.15.119:6823","nonce":1556984819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":1556984819},{"type":"v1","addr":"172.21.15.119:6821","nonce":1556984819}]},"public_addr":"172.21.15.119:6817/1556984819","cluster_addr":"172.21.15.119:6819/1556984819","heartbeat_back_addr":"172.21.15.119:6823/1556984819","heartbeat_front_addr":"172.21.15.119:6821/1556984819","state":["exists","up"]},{"osd":8,"uuid":"d46e56d4-ed4e-42c3-a315-66af014bd93a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":1860679473},{"type":"v1","addr":"172.21.15.142:6817","nonce":1860679473}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":1860679473},{"type":"v1","addr":"172.21.15.142:6819","nonce":1860679473}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":1860679473},{"type":"v1","addr":"172.21.15.142:6823","nonce":1860679473}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":1860679473},{"type":"v1","addr":"172.21.15.142:6821","nonce":1860679473}]},"public_addr":"172.21.15.142:6817/1860679473","cluster_addr":"172.21.15.142:6819/1860679473","heartbeat_back_addr":"172.21.15.142:6823/1860679473","heartbeat_front_addr":"172.21.15.142:6821/1860679473","state":["exists","up"]},{"osd":9,"uuid":"18a70ee6-56df-4f5c-868d-5db5e72a1859","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":3636757924},{"type":"v1","addr":"172.21.15.83:6827","nonce":3636757924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":3636757924},{"type":"v1","addr":"172.21.15.83:6829","nonce":3636757924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6832","nonce":3636757924},{"type":"v1","addr":"172.21.15.83:6833","nonce":3636757924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":3636757924},{"type":"v1","addr":"172.21.15.83:6831","nonce":3636757924}]},"public_addr":"172.21.15.83:6827/3636757924","cluster_addr":"172.21.15.83:6829/3636757924","heartbeat_back_addr":"172.21.15.83:6833/3636757924","heartbeat_front_addr":"172.21.15.83:6831/3636757924","state":["exists","up"]},{"osd":10,"uuid":"0d32c3de-db03-42c3-9914-07d675aaa339","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":2561963910},{"type":"v1","addr":"172.21.15.119:6825","nonce":2561963910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":2561963910},{"type":"v1","addr":"172.21.15.119:6827","nonce":2561963910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2561963910},{"type":"v1","addr":"172.21.15.119:6831","nonce":2561963910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2561963910},{"type":"v1","addr":"172.21.15.119:6829","nonce":2561963910}]},"public_addr":"172.21.15.119:6825/2561963910","cluster_addr":"172.21.15.119:6827/2561963910","heartbeat_back_addr":"172.21.15.119:6831/2561963910","heartbeat_front_addr":"172.21.15.119:6829/2561963910","state":["exists","up"]},{"osd":11,"uuid":"3a3b444d-b316-4256-bfad-378db29f0824","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":1174646198},{"type":"v1","addr":"172.21.15.142:6825","nonce":1174646198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":1174646198},{"type":"v1","addr":"172.21.15.142:6827","nonce":1174646198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1174646198},{"type":"v1","addr":"172.21.15.142:6831","nonce":1174646198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1174646198},{"type":"v1","addr":"172.21.15.142:6829","nonce":1174646198}]},"public_addr":"172.21.15.142:6825/1174646198","cluster_addr":"172.21.15.142:6827/1174646198","heartbeat_back_addr":"172.21.15.142:6831/1174646198","heartbeat_front_addr":"172.21.15.142:6829/1174646198","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:34:15.337672+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:34:39.259716+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:35:03.348886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:35:29.465711+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:35:53.744378+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:36:19.488785+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:36:45.708616+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:37:11.501065+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:37:36.027277+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:38:01.903625+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:38:27.215212+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:38:51.891278+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.83:0/1619062496":"2024-09-22T01:33:08.666525+0000","172.21.15.83:0/2412709299":"2024-09-22T01:31:45.834450+0000","172.21.15.83:6800/4290325964":"2024-09-22T01:31:45.834450+0000","172.21.15.83:6801/4290325964":"2024-09-22T01:31:45.834450+0000","172.21.15.83:0/1440681183":"2024-09-22T01:31:45.834450+0000","172.21.15.83:0/2745413305":"2024-09-22T01:31:45.834450+0000","172.21.15.83:6800/1393748565":"2024-09-22T01:33:08.666525+0000","172.21.15.83:0/110411274":"2024-09-22T01:32:10.073024+0000","172.21.15.83:0/4267551123":"2024-09-22T01:33:08.666525+0000","172.21.15.83:0/1068434643":"2024-09-22T01:32:10.073024+0000","172.21.15.83:6800/2963261730":"2024-09-22T01:32:10.073024+0000","172.21.15.83:0/3544333975":"2024-09-22T01:32:10.073024+0000","172.21.15.83:6801/1393748565":"2024-09-22T01:33:08.666525+0000","172.21.15.83:6801/2963261730":"2024-09-22T01:32:10.073024+0000","172.21.15.83:0/1915285091":"2024-09-22T01:33:08.666525+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T01:39:57.570 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:57.570+0000 7fc094857640 1 -- 172.21.15.83:0/2569535658 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fc0780b6560 msgr2=0x7fc0780b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:39:57.570 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:57.570+0000 7fc094857640 1 --2- 172.21.15.83:0/2569535658 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fc0780b6560 0x7fc0780b8a70 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fc090109070 tx=0x7fc084005e50 comp rx=0 tx=0).stop 2024-09-21T01:39:57.570 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:57.570+0000 7fc094857640 1 -- 172.21.15.83:0/2569535658 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc090103b80 msgr2=0x7fc09019a410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:39:57.571 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:57.570+0000 7fc094857640 1 --2- 172.21.15.83:0/2569535658 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc090103b80 0x7fc09019a410 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fc080009230 tx=0x7fc080004270 comp rx=0 tx=0).stop 2024-09-21T01:39:57.571 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:57.570+0000 7fc094857640 1 -- 172.21.15.83:0/2569535658 shutdown_connections 2024-09-21T01:39:57.571 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:57.570+0000 7fc094857640 1 --2- 172.21.15.83:0/2569535658 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fc0780b6560 0x7fc0780b8a70 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:57.571 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:57.570+0000 7fc094857640 1 --2- 172.21.15.83:0/2569535658 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc090109e10 0x7fc09019fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:57.571 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:57.570+0000 7fc094857640 1 --2- 172.21.15.83:0/2569535658 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc0901094c0 0x7fc09019a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:57.571 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:57.570+0000 7fc094857640 1 --2- 172.21.15.83:0/2569535658 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc090103b80 0x7fc09019a410 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:57.571 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:57.570+0000 7fc094857640 1 -- 172.21.15.83:0/2569535658 >> 172.21.15.83:0/2569535658 conn(0x7fc0900ff5d0 msgr2=0x7fc0901019f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:39:57.571 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:57.570+0000 7fc094857640 1 -- 172.21.15.83:0/2569535658 shutdown_connections 2024-09-21T01:39:57.571 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:57.570+0000 7fc094857640 1 -- 172.21.15.83:0/2569535658 wait complete. 2024-09-21T01:39:57.714 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:57 smithi142 ceph-mon[34050]: pgmap v272: 129 pgs: 129 active+clean; 579 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:39:57.717 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:57 smithi119 ceph-mon[33693]: pgmap v272: 129 pgs: 129 active+clean; 579 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:39:58.216 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T01:39:58.463 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:39:58.714 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:58 smithi142 ceph-mon[34050]: from='client.? 172.21.15.83:0/2569535658' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T01:39:58.717 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:58 smithi119 ceph-mon[33693]: from='client.? 172.21.15.83:0/2569535658' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T01:39:58.725 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:58 smithi083 ceph-mon[31370]: from='client.? 172.21.15.83:0/2569535658' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T01:39:58.974 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:58.938+0000 7f423a370640 1 -- 172.21.15.83:0/1149687611 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4234108d20 msgr2=0x7f423410f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:39:58.975 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:58.938+0000 7f423a370640 1 --2- 172.21.15.83:0/1149687611 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4234108d20 0x7f423410f550 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f422c009ca0 tx=0x7f422c02a8c0 comp rx=0 tx=0).stop 2024-09-21T01:39:58.975 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:58.938+0000 7f423a370640 1 -- 172.21.15.83:0/1149687611 shutdown_connections 2024-09-21T01:39:58.975 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:58.938+0000 7f423a370640 1 --2- 172.21.15.83:0/1149687611 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4234108d20 0x7f423410f550 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:58.975 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:58.938+0000 7f423a370640 1 --2- 172.21.15.83:0/1149687611 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f42341083d0 0x7f42341087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:58.975 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:58.938+0000 7f423a370640 1 --2- 172.21.15.83:0/1149687611 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4234102a90 0x7f4234102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:58.975 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:58.938+0000 7f423a370640 1 -- 172.21.15.83:0/1149687611 >> 172.21.15.83:0/1149687611 conn(0x7f4234079750 msgr2=0x7f4234079b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:39:58.975 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:58.938+0000 7f423a370640 1 -- 172.21.15.83:0/1149687611 shutdown_connections 2024-09-21T01:39:58.975 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:58.938+0000 7f423a370640 1 -- 172.21.15.83:0/1149687611 wait complete. 2024-09-21T01:39:58.975 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:58.939+0000 7f423a370640 1 Processor -- start 2024-09-21T01:39:58.975 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:58.939+0000 7f423a370640 1 -- start start 2024-09-21T01:39:58.975 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:58.939+0000 7f423a370640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4234102a90 0x7f423419b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:39:58.975 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:58.939+0000 7f423a370640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f42341083d0 0x7f423419b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:39:58.976 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:58.939+0000 7f423a370640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4234108d20 0x7f423419bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:39:58.976 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:58.939+0000 7f423a370640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f4234112890 con 0x7f42341083d0 2024-09-21T01:39:58.976 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:58.939+0000 7f423a370640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f4234112710 con 0x7f4234108d20 2024-09-21T01:39:58.976 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:58.939+0000 7f423a370640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f4234112a10 con 0x7f4234102a90 2024-09-21T01:39:58.976 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:58.939+0000 7f422bfff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f42341083d0 0x7f423419b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:39:58.976 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:58.939+0000 7f422bfff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f42341083d0 0x7f423419b660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:48910/0 (socket says 172.21.15.83:48910) 2024-09-21T01:39:58.976 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:58.939+0000 7f422bfff640 1 -- 172.21.15.83:0/2576252584 learned_addr learned my addr 172.21.15.83:0/2576252584 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:39:58.976 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:58.939+0000 7f423890d640 1 --2- 172.21.15.83:0/2576252584 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4234108d20 0x7f423419bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:39:58.976 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:58.939+0000 7f422bfff640 1 -- 172.21.15.83:0/2576252584 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4234102a90 msgr2=0x7f423419b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:39:58.976 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:58.939+0000 7f422bfff640 1 --2- 172.21.15.83:0/2576252584 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4234102a90 0x7f423419b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:58.976 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:58.939+0000 7f422bfff640 1 -- 172.21.15.83:0/2576252584 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4234108d20 msgr2=0x7f423419bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:39:58.976 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:58.939+0000 7f422bfff640 1 --2- 172.21.15.83:0/2576252584 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4234108d20 0x7f423419bba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:58.976 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:58.939+0000 7f422bfff640 1 -- 172.21.15.83:0/2576252584 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42341a6350 con 0x7f42341083d0 2024-09-21T01:39:58.977 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:58.939+0000 7f423890d640 1 --2- 172.21.15.83:0/2576252584 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4234108d20 0x7f423419bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:39:58.977 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:58.940+0000 7f422bfff640 1 --2- 172.21.15.83:0/2576252584 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f42341083d0 0x7f423419b660 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f421c00c970 tx=0x7f421c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:39:58.977 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:58.940+0000 7f4231ffb640 1 -- 172.21.15.83:0/2576252584 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f421c007bb0 con 0x7f42341083d0 2024-09-21T01:39:58.977 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:58.940+0000 7f4231ffb640 1 -- 172.21.15.83:0/2576252584 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f421c007d50 con 0x7f42341083d0 2024-09-21T01:39:58.977 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:58.940+0000 7f423a370640 1 -- 172.21.15.83:0/2576252584 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42341a6640 con 0x7f42341083d0 2024-09-21T01:39:58.977 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:58.940+0000 7f4231ffb640 1 -- 172.21.15.83:0/2576252584 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f421c004e10 con 0x7f42341083d0 2024-09-21T01:39:58.977 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:58.940+0000 7f423a370640 1 -- 172.21.15.83:0/2576252584 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42341a6bd0 con 0x7f42341083d0 2024-09-21T01:39:58.977 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:58.941+0000 7f423a370640 1 -- 172.21.15.83:0/2576252584 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4234103d10 con 0x7f42341083d0 2024-09-21T01:39:58.977 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:58.942+0000 7f4231ffb640 1 -- 172.21.15.83:0/2576252584 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 20) ==== 154529+0+0 (secure 0 0 0) 0x7f421c005000 con 0x7f42341083d0 2024-09-21T01:39:58.977 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:58.943+0000 7f4231ffb640 1 --2- 172.21.15.83:0/2576252584 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f42200b65e0 0x7f42200b8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:39:58.977 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:58.943+0000 7f4233fff640 1 --2- 172.21.15.83:0/2576252584 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f42200b65e0 0x7f42200b8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:39:58.977 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:58.943+0000 7f4231ffb640 1 -- 172.21.15.83:0/2576252584 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 9017+0+0 (secure 0 0 0) 0x7f421c0e7780 con 0x7f42341083d0 2024-09-21T01:39:58.977 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:58.944+0000 7f4233fff640 1 --2- 172.21.15.83:0/2576252584 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f42200b65e0 0x7f42200b8af0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f423406c700 tx=0x7f4224005c70 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:39:58.977 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:58.946+0000 7f4231ffb640 1 -- 172.21.15.83:0/2576252584 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f421c014030 con 0x7f42341083d0 2024-09-21T01:39:59.125 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:59.125+0000 7f423a370640 1 -- 172.21.15.83:0/2576252584 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f423406bfb0 con 0x7f42341083d0 2024-09-21T01:39:59.127 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:59.126+0000 7f4231ffb640 1 -- 172.21.15.83:0/2576252584 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) ==== 74+0+24553 (secure 0 0 0) 0x7f421c0add80 con 0x7f42341083d0 2024-09-21T01:39:59.127 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T01:39:59.128 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":80,"fsid":"f7697ecc-77b8-11ef-baf5-efdc52797490","created":"2024-09-21T01:31:22.250342+0000","modified":"2024-09-21T01:39:54.039731+0000","last_up_change":"2024-09-21T01:38:53.501659+0000","last_in_change":"2024-09-21T01:38:30.688516+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T01:35:06.977668+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T01:39:41.041950+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T01:39:42.882272+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T01:39:49.320532+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"66947512-01ee-4bf0-87b0-98a168cf50dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":3563457494},{"type":"v1","addr":"172.21.15.83:6803","nonce":3563457494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":3563457494},{"type":"v1","addr":"172.21.15.83:6805","nonce":3563457494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":3563457494},{"type":"v1","addr":"172.21.15.83:6809","nonce":3563457494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":3563457494},{"type":"v1","addr":"172.21.15.83:6807","nonce":3563457494}]},"public_addr":"172.21.15.83:6803/3563457494","cluster_addr":"172.21.15.83:6805/3563457494","heartbeat_back_addr":"172.21.15.83:6809/3563457494","heartbeat_front_addr":"172.21.15.83:6807/3563457494","state":["exists","up"]},{"osd":1,"uuid":"f7818a08-86a5-412d-a164-cfeb18f8650a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":2066870220},{"type":"v1","addr":"172.21.15.119:6801","nonce":2066870220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":2066870220},{"type":"v1","addr":"172.21.15.119:6803","nonce":2066870220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":2066870220},{"type":"v1","addr":"172.21.15.119:6807","nonce":2066870220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":2066870220},{"type":"v1","addr":"172.21.15.119:6805","nonce":2066870220}]},"public_addr":"172.21.15.119:6801/2066870220","cluster_addr":"172.21.15.119:6803/2066870220","heartbeat_back_addr":"172.21.15.119:6807/2066870220","heartbeat_front_addr":"172.21.15.119:6805/2066870220","state":["exists","up"]},{"osd":2,"uuid":"0d1a3870-c67a-4783-85f9-be2bb36f7722","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":3955936117},{"type":"v1","addr":"172.21.15.142:6801","nonce":3955936117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3955936117},{"type":"v1","addr":"172.21.15.142:6803","nonce":3955936117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":3955936117},{"type":"v1","addr":"172.21.15.142:6807","nonce":3955936117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":3955936117},{"type":"v1","addr":"172.21.15.142:6805","nonce":3955936117}]},"public_addr":"172.21.15.142:6801/3955936117","cluster_addr":"172.21.15.142:6803/3955936117","heartbeat_back_addr":"172.21.15.142:6807/3955936117","heartbeat_front_addr":"172.21.15.142:6805/3955936117","state":["exists","up"]},{"osd":3,"uuid":"a4cb1a36-3495-4d36-92da-ed3b6e852d14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":3746834093},{"type":"v1","addr":"172.21.15.83:6811","nonce":3746834093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":3746834093},{"type":"v1","addr":"172.21.15.83:6813","nonce":3746834093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":3746834093},{"type":"v1","addr":"172.21.15.83:6817","nonce":3746834093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":3746834093},{"type":"v1","addr":"172.21.15.83:6815","nonce":3746834093}]},"public_addr":"172.21.15.83:6811/3746834093","cluster_addr":"172.21.15.83:6813/3746834093","heartbeat_back_addr":"172.21.15.83:6817/3746834093","heartbeat_front_addr":"172.21.15.83:6815/3746834093","state":["exists","up"]},{"osd":4,"uuid":"d6f2ec78-7f08-473b-a96c-e8590f5d2f25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":3083907785},{"type":"v1","addr":"172.21.15.119:6809","nonce":3083907785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":3083907785},{"type":"v1","addr":"172.21.15.119:6811","nonce":3083907785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":3083907785},{"type":"v1","addr":"172.21.15.119:6815","nonce":3083907785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":3083907785},{"type":"v1","addr":"172.21.15.119:6813","nonce":3083907785}]},"public_addr":"172.21.15.119:6809/3083907785","cluster_addr":"172.21.15.119:6811/3083907785","heartbeat_back_addr":"172.21.15.119:6815/3083907785","heartbeat_front_addr":"172.21.15.119:6813/3083907785","state":["exists","up"]},{"osd":5,"uuid":"c571d04d-d3ea-4d74-8867-e4c7816f4e0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":349001002},{"type":"v1","addr":"172.21.15.142:6809","nonce":349001002}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":349001002},{"type":"v1","addr":"172.21.15.142:6811","nonce":349001002}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":349001002},{"type":"v1","addr":"172.21.15.142:6815","nonce":349001002}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":349001002},{"type":"v1","addr":"172.21.15.142:6813","nonce":349001002}]},"public_addr":"172.21.15.142:6809/349001002","cluster_addr":"172.21.15.142:6811/349001002","heartbeat_back_addr":"172.21.15.142:6815/349001002","heartbeat_front_addr":"172.21.15.142:6813/349001002","state":["exists","up"]},{"osd":6,"uuid":"6e1b6fe9-700a-448a-b382-59b97896ea7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":771651063},{"type":"v1","addr":"172.21.15.83:6819","nonce":771651063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":771651063},{"type":"v1","addr":"172.21.15.83:6821","nonce":771651063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":771651063},{"type":"v1","addr":"172.21.15.83:6825","nonce":771651063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":771651063},{"type":"v1","addr":"172.21.15.83:6823","nonce":771651063}]},"public_addr":"172.21.15.83:6819/771651063","cluster_addr":"172.21.15.83:6821/771651063","heartbeat_back_addr":"172.21.15.83:6825/771651063","heartbeat_front_addr":"172.21.15.83:6823/771651063","state":["exists","up"]},{"osd":7,"uuid":"283bfae4-5f50-4f9e-860e-bbfd47e005e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":1556984819},{"type":"v1","addr":"172.21.15.119:6817","nonce":1556984819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":1556984819},{"type":"v1","addr":"172.21.15.119:6819","nonce":1556984819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":1556984819},{"type":"v1","addr":"172.21.15.119:6823","nonce":1556984819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":1556984819},{"type":"v1","addr":"172.21.15.119:6821","nonce":1556984819}]},"public_addr":"172.21.15.119:6817/1556984819","cluster_addr":"172.21.15.119:6819/1556984819","heartbeat_back_addr":"172.21.15.119:6823/1556984819","heartbeat_front_addr":"172.21.15.119:6821/1556984819","state":["exists","up"]},{"osd":8,"uuid":"d46e56d4-ed4e-42c3-a315-66af014bd93a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":1860679473},{"type":"v1","addr":"172.21.15.142:6817","nonce":1860679473}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":1860679473},{"type":"v1","addr":"172.21.15.142:6819","nonce":1860679473}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":1860679473},{"type":"v1","addr":"172.21.15.142:6823","nonce":1860679473}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":1860679473},{"type":"v1","addr":"172.21.15.142:6821","nonce":1860679473}]},"public_addr":"172.21.15.142:6817/1860679473","cluster_addr":"172.21.15.142:6819/1860679473","heartbeat_back_addr":"172.21.15.142:6823/1860679473","heartbeat_front_addr":"172.21.15.142:6821/1860679473","state":["exists","up"]},{"osd":9,"uuid":"18a70ee6-56df-4f5c-868d-5db5e72a1859","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":3636757924},{"type":"v1","addr":"172.21.15.83:6827","nonce":3636757924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":3636757924},{"type":"v1","addr":"172.21.15.83:6829","nonce":3636757924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6832","nonce":3636757924},{"type":"v1","addr":"172.21.15.83:6833","nonce":3636757924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":3636757924},{"type":"v1","addr":"172.21.15.83:6831","nonce":3636757924}]},"public_addr":"172.21.15.83:6827/3636757924","cluster_addr":"172.21.15.83:6829/3636757924","heartbeat_back_addr":"172.21.15.83:6833/3636757924","heartbeat_front_addr":"172.21.15.83:6831/3636757924","state":["exists","up"]},{"osd":10,"uuid":"0d32c3de-db03-42c3-9914-07d675aaa339","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":2561963910},{"type":"v1","addr":"172.21.15.119:6825","nonce":2561963910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":2561963910},{"type":"v1","addr":"172.21.15.119:6827","nonce":2561963910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2561963910},{"type":"v1","addr":"172.21.15.119:6831","nonce":2561963910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2561963910},{"type":"v1","addr":"172.21.15.119:6829","nonce":2561963910}]},"public_addr":"172.21.15.119:6825/2561963910","cluster_addr":"172.21.15.119:6827/2561963910","heartbeat_back_addr":"172.21.15.119:6831/2561963910","heartbeat_front_addr":"172.21.15.119:6829/2561963910","state":["exists","up"]},{"osd":11,"uuid":"3a3b444d-b316-4256-bfad-378db29f0824","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":1174646198},{"type":"v1","addr":"172.21.15.142:6825","nonce":1174646198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":1174646198},{"type":"v1","addr":"172.21.15.142:6827","nonce":1174646198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1174646198},{"type":"v1","addr":"172.21.15.142:6831","nonce":1174646198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1174646198},{"type":"v1","addr":"172.21.15.142:6829","nonce":1174646198}]},"public_addr":"172.21.15.142:6825/1174646198","cluster_addr":"172.21.15.142:6827/1174646198","heartbeat_back_addr":"172.21.15.142:6831/1174646198","heartbeat_front_addr":"172.21.15.142:6829/1174646198","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:34:15.337672+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:34:39.259716+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:35:03.348886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:35:29.465711+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:35:53.744378+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:36:19.488785+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:36:45.708616+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:37:11.501065+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:37:36.027277+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:38:01.903625+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:38:27.215212+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:38:51.891278+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.83:0/1619062496":"2024-09-22T01:33:08.666525+0000","172.21.15.83:0/2412709299":"2024-09-22T01:31:45.834450+0000","172.21.15.83:6800/4290325964":"2024-09-22T01:31:45.834450+0000","172.21.15.83:6801/4290325964":"2024-09-22T01:31:45.834450+0000","172.21.15.83:0/1440681183":"2024-09-22T01:31:45.834450+0000","172.21.15.83:0/2745413305":"2024-09-22T01:31:45.834450+0000","172.21.15.83:6800/1393748565":"2024-09-22T01:33:08.666525+0000","172.21.15.83:0/110411274":"2024-09-22T01:32:10.073024+0000","172.21.15.83:0/4267551123":"2024-09-22T01:33:08.666525+0000","172.21.15.83:0/1068434643":"2024-09-22T01:32:10.073024+0000","172.21.15.83:6800/2963261730":"2024-09-22T01:32:10.073024+0000","172.21.15.83:0/3544333975":"2024-09-22T01:32:10.073024+0000","172.21.15.83:6801/1393748565":"2024-09-22T01:33:08.666525+0000","172.21.15.83:6801/2963261730":"2024-09-22T01:32:10.073024+0000","172.21.15.83:0/1915285091":"2024-09-22T01:33:08.666525+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T01:39:59.129 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:59.129+0000 7f423a370640 1 -- 172.21.15.83:0/2576252584 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f42200b65e0 msgr2=0x7f42200b8af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:39:59.129 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:59.129+0000 7f423a370640 1 --2- 172.21.15.83:0/2576252584 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f42200b65e0 0x7f42200b8af0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f423406c700 tx=0x7f4224005c70 comp rx=0 tx=0).stop 2024-09-21T01:39:59.129 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:59.129+0000 7f423a370640 1 -- 172.21.15.83:0/2576252584 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f42341083d0 msgr2=0x7f423419b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:39:59.129 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:59.129+0000 7f423a370640 1 --2- 172.21.15.83:0/2576252584 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f42341083d0 0x7f423419b660 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f421c00c970 tx=0x7f421c00ce30 comp rx=0 tx=0).stop 2024-09-21T01:39:59.129 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:59.129+0000 7f423a370640 1 -- 172.21.15.83:0/2576252584 shutdown_connections 2024-09-21T01:39:59.130 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:59.129+0000 7f423a370640 1 --2- 172.21.15.83:0/2576252584 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f42200b65e0 0x7f42200b8af0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:59.130 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:59.129+0000 7f423a370640 1 --2- 172.21.15.83:0/2576252584 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4234108d20 0x7f423419bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:59.130 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:59.129+0000 7f423a370640 1 --2- 172.21.15.83:0/2576252584 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f42341083d0 0x7f423419b660 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:59.130 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:59.129+0000 7f423a370640 1 --2- 172.21.15.83:0/2576252584 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4234102a90 0x7f423419b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:39:59.130 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:59.129+0000 7f423a370640 1 -- 172.21.15.83:0/2576252584 >> 172.21.15.83:0/2576252584 conn(0x7f4234079750 msgr2=0x7f42341043a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:39:59.130 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:59.129+0000 7f423a370640 1 -- 172.21.15.83:0/2576252584 shutdown_connections 2024-09-21T01:39:59.130 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:39:59.129+0000 7f423a370640 1 -- 172.21.15.83:0/2576252584 wait complete. 2024-09-21T01:39:59.714 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:59 smithi142 ceph-mon[34050]: pgmap v273: 129 pgs: 129 active+clean; 579 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:39:59.714 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:39:59 smithi142 ceph-mon[34050]: from='client.? 172.21.15.83:0/2576252584' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T01:39:59.717 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:59 smithi119 ceph-mon[33693]: pgmap v273: 129 pgs: 129 active+clean; 579 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:39:59.717 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:39:59 smithi119 ceph-mon[33693]: from='client.? 172.21.15.83:0/2576252584' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T01:39:59.762 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:59 smithi083 ceph-mon[31370]: pgmap v273: 129 pgs: 129 active+clean; 579 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:39:59.763 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:39:59 smithi083 ceph-mon[31370]: from='client.? 172.21.15.83:0/2576252584' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T01:39:59.805 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T01:40:00.051 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:40:00.505 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:40:00 smithi083 ceph-mon[31370]: overall HEALTH_OK 2024-09-21T01:40:00.508 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:00.504+0000 7f6696e76640 1 -- 172.21.15.83:0/1915389833 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6690103b60 msgr2=0x7f6690103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:40:00.508 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:00.504+0000 7f6696e76640 1 --2- 172.21.15.83:0/1915389833 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6690103b60 0x7f6690103f70 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f6684009900 tx=0x7f668402a410 comp rx=0 tx=0).stop 2024-09-21T01:40:00.508 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:00.504+0000 7f6696e76640 1 -- 172.21.15.83:0/1915389833 shutdown_connections 2024-09-21T01:40:00.508 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:00.504+0000 7f6696e76640 1 --2- 172.21.15.83:0/1915389833 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6690109df0 0x7f6690110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:00.508 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:00.504+0000 7f6696e76640 1 --2- 172.21.15.83:0/1915389833 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f66901094a0 0x7f66901098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:00.508 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:00.504+0000 7f6696e76640 1 --2- 172.21.15.83:0/1915389833 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6690103b60 0x7f6690103f70 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:00.508 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:00.504+0000 7f6696e76640 1 -- 172.21.15.83:0/1915389833 >> 172.21.15.83:0/1915389833 conn(0x7f669007b850 msgr2=0x7f669007bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:40:00.508 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:00.504+0000 7f6696e76640 1 -- 172.21.15.83:0/1915389833 shutdown_connections 2024-09-21T01:40:00.508 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:00.504+0000 7f6696e76640 1 -- 172.21.15.83:0/1915389833 wait complete. 2024-09-21T01:40:00.508 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:00.505+0000 7f6696e76640 1 Processor -- start 2024-09-21T01:40:00.508 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:00.505+0000 7f6696e76640 1 -- start start 2024-09-21T01:40:00.508 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:00.505+0000 7f6696e76640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6690103b60 0x7f669019a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:40:00.509 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:00.505+0000 7f6696e76640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f66901094a0 0x7f669019a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:40:00.509 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:00.505+0000 7f6696e76640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6690109df0 0x7f669019fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:40:00.509 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:00.505+0000 7f6696e76640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f6690113960 con 0x7f6690103b60 2024-09-21T01:40:00.509 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:00.505+0000 7f6696e76640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f66901137e0 con 0x7f6690109df0 2024-09-21T01:40:00.509 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:00.505+0000 7f6696e76640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f6690113ae0 con 0x7f66901094a0 2024-09-21T01:40:00.509 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:00.505+0000 7f6694c12640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6690103b60 0x7f669019a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:40:00.509 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:00.505+0000 7f6694c12640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6690103b60 0x7f669019a450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:48920/0 (socket says 172.21.15.83:48920) 2024-09-21T01:40:00.509 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:00.505+0000 7f6694c12640 1 -- 172.21.15.83:0/1217824633 learned_addr learned my addr 172.21.15.83:0/1217824633 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:40:00.509 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:00.505+0000 7f6695413640 1 --2- 172.21.15.83:0/1217824633 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6690109df0 0x7f669019fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:40:00.509 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:00.505+0000 7f668ffff640 1 --2- 172.21.15.83:0/1217824633 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f66901094a0 0x7f669019a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:40:00.509 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:00.506+0000 7f6694c12640 1 -- 172.21.15.83:0/1217824633 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f66901094a0 msgr2=0x7f669019a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:40:00.509 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:00.506+0000 7f6694c12640 1 --2- 172.21.15.83:0/1217824633 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f66901094a0 0x7f669019a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:00.509 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:00.506+0000 7f6694c12640 1 -- 172.21.15.83:0/1217824633 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6690109df0 msgr2=0x7f669019fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:40:00.509 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:00.506+0000 7f6694c12640 1 --2- 172.21.15.83:0/1217824633 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6690109df0 0x7f669019fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:00.509 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:00.506+0000 7f6694c12640 1 -- 172.21.15.83:0/1217824633 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66901a0300 con 0x7f6690103b60 2024-09-21T01:40:00.510 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:00.506+0000 7f6694c12640 1 --2- 172.21.15.83:0/1217824633 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6690103b60 0x7f669019a450 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f6684009230 tx=0x7f6684004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:40:00.510 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:00.506+0000 7f668dffb640 1 -- 172.21.15.83:0/1217824633 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f668403f030 con 0x7f6690103b60 2024-09-21T01:40:00.510 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:00.506+0000 7f668dffb640 1 -- 172.21.15.83:0/1217824633 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6684003a80 con 0x7f6690103b60 2024-09-21T01:40:00.510 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:00.506+0000 7f6696e76640 1 -- 172.21.15.83:0/1217824633 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66901a0590 con 0x7f6690103b60 2024-09-21T01:40:00.510 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:00.506+0000 7f668dffb640 1 -- 172.21.15.83:0/1217824633 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6684035070 con 0x7f6690103b60 2024-09-21T01:40:00.510 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:00.506+0000 7f6696e76640 1 -- 172.21.15.83:0/1217824633 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66901a0a70 con 0x7f6690103b60 2024-09-21T01:40:00.510 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:00.507+0000 7f6696e76640 1 -- 172.21.15.83:0/1217824633 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6690103f70 con 0x7f6690103b60 2024-09-21T01:40:00.510 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:00.509+0000 7f668dffb640 1 -- 172.21.15.83:0/1217824633 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 20) ==== 154529+0+0 (secure 0 0 0) 0x7f6684042030 con 0x7f6690103b60 2024-09-21T01:40:00.511 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:00.510+0000 7f668dffb640 1 --2- 172.21.15.83:0/1217824633 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f66800b6590 0x7f66800b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:40:00.511 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:00.510+0000 7f668ffff640 1 --2- 172.21.15.83:0/1217824633 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f66800b6590 0x7f66800b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:40:00.511 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:00.510+0000 7f668dffb640 1 -- 172.21.15.83:0/1217824633 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 9017+0+0 (secure 0 0 0) 0x7f6684108150 con 0x7f6690103b60 2024-09-21T01:40:00.511 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:00.510+0000 7f668ffff640 1 --2- 172.21.15.83:0/1217824633 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f66800b6590 0x7f66800b8aa0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f66901065a0 tx=0x7f667c00b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:40:00.514 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:00.513+0000 7f668dffb640 1 -- 172.21.15.83:0/1217824633 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f66840d2ab0 con 0x7f6690103b60 2024-09-21T01:40:00.714 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:40:00 smithi142 ceph-mon[34050]: overall HEALTH_OK 2024-09-21T01:40:00.717 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:40:00 smithi119 ceph-mon[33693]: overall HEALTH_OK 2024-09-21T01:40:00.729 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:00.728+0000 7f6696e76640 1 -- 172.21.15.83:0/1217824633 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f669019b580 con 0x7f6690103b60 2024-09-21T01:40:00.730 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:00.729+0000 7f668dffb640 1 -- 172.21.15.83:0/1217824633 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+11848 (secure 0 0 0) 0x7f66840d79f0 con 0x7f6690103b60 2024-09-21T01:40:00.731 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T01:40:00.731 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":17,"btime":"2024-09-21T01:39:54:349960+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14775,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6835/1105040204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":1105040204},{"type":"v1","addr":"172.21.15.83:6835","nonce":1105040204}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14787,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/2234789563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6836","nonce":2234789563},{"type":"v1","addr":"172.21.15.83:6837","nonce":2234789563}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14838,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6839/136258364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6838","nonce":136258364},{"type":"v1","addr":"172.21.15.83:6839","nonce":136258364}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14850,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6841/129439444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6840","nonce":129439444},{"type":"v1","addr":"172.21.15.83:6841","nonce":129439444}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24569,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/2839502433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":2839502433},{"type":"v1","addr":"172.21.15.119:6833","nonce":2839502433}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24580,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6833/2841606990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":2841606990},{"type":"v1","addr":"172.21.15.142:6833","nonce":2841606990}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24599,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/415902608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":415902608},{"type":"v1","addr":"172.21.15.119:6835","nonce":415902608}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24607,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/3009088510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":3009088510},{"type":"v1","addr":"172.21.15.142:6835","nonce":3009088510}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24613,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/3847200126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6836","nonce":3847200126},{"type":"v1","addr":"172.21.15.142:6837","nonce":3847200126}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24626,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/3619222976","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":3619222976},{"type":"v1","addr":"172.21.15.119:6837","nonce":3619222976}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24631,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6839/1817880741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6838","nonce":1817880741},{"type":"v1","addr":"172.21.15.142:6839","nonce":1817880741}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T01:39:45.145124+0000","modified":"2024-09-21T01:39:54.039893+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24653},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24653":{"gid":24653,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.119:6839/3106757092","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":3106757092},{"type":"v1","addr":"172.21.15.119:6839","nonce":3106757092}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24653,"qdb_cluster":[24653]},"id":1}]} 2024-09-21T01:40:00.731 INFO:teuthology.orchestra.run.smithi083.stderr:dumped fsmap epoch 17 2024-09-21T01:40:00.733 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:00.731+0000 7f6696e76640 1 -- 172.21.15.83:0/1217824633 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f66800b6590 msgr2=0x7f66800b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:40:00.733 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:00.731+0000 7f6696e76640 1 --2- 172.21.15.83:0/1217824633 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f66800b6590 0x7f66800b8aa0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f66901065a0 tx=0x7f667c00b390 comp rx=0 tx=0).stop 2024-09-21T01:40:00.733 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:00.731+0000 7f6696e76640 1 -- 172.21.15.83:0/1217824633 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6690103b60 msgr2=0x7f669019a450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:40:00.733 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:00.731+0000 7f6696e76640 1 --2- 172.21.15.83:0/1217824633 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6690103b60 0x7f669019a450 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f6684009230 tx=0x7f6684004270 comp rx=0 tx=0).stop 2024-09-21T01:40:00.733 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:00.731+0000 7f6696e76640 1 -- 172.21.15.83:0/1217824633 shutdown_connections 2024-09-21T01:40:00.733 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:00.731+0000 7f6696e76640 1 --2- 172.21.15.83:0/1217824633 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f66800b6590 0x7f66800b8aa0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:00.733 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:00.731+0000 7f6696e76640 1 --2- 172.21.15.83:0/1217824633 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6690109df0 0x7f669019fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:00.733 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:00.731+0000 7f6696e76640 1 --2- 172.21.15.83:0/1217824633 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f66901094a0 0x7f669019a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:00.733 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:00.731+0000 7f6696e76640 1 --2- 172.21.15.83:0/1217824633 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6690103b60 0x7f669019a450 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:00.733 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:00.731+0000 7f6696e76640 1 -- 172.21.15.83:0/1217824633 >> 172.21.15.83:0/1217824633 conn(0x7f669007b850 msgr2=0x7f6690107650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:40:00.733 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:00.731+0000 7f6696e76640 1 -- 172.21.15.83:0/1217824633 shutdown_connections 2024-09-21T01:40:00.733 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:00.731+0000 7f6696e76640 1 -- 172.21.15.83:0/1217824633 wait complete. 2024-09-21T01:40:01.424 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T01:40:01.671 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:40:01.715 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:40:01 smithi142 ceph-mon[34050]: from='client.? 172.21.15.83:0/1217824633' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:40:01.715 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:40:01 smithi142 ceph-mon[34050]: pgmap v274: 129 pgs: 129 active+clean; 579 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:40:01.717 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:40:01 smithi119 ceph-mon[33693]: from='client.? 172.21.15.83:0/1217824633' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:40:01.717 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:40:01 smithi119 ceph-mon[33693]: pgmap v274: 129 pgs: 129 active+clean; 579 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:40:01.791 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:40:01 smithi083 ceph-mon[31370]: from='client.? 172.21.15.83:0/1217824633' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:40:01.791 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:40:01 smithi083 ceph-mon[31370]: pgmap v274: 129 pgs: 129 active+clean; 579 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:40:02.156 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:02.154+0000 7fe60fee3640 1 -- 172.21.15.83:0/3430731347 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe608109e00 msgr2=0x7fe608110630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:40:02.156 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:02.154+0000 7fe60fee3640 1 --2- 172.21.15.83:0/3430731347 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe608109e00 0x7fe608110630 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fe600009ca0 tx=0x7fe60002a8c0 comp rx=0 tx=0).stop 2024-09-21T01:40:02.156 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:02.154+0000 7fe60fee3640 1 -- 172.21.15.83:0/3430731347 shutdown_connections 2024-09-21T01:40:02.156 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:02.154+0000 7fe60fee3640 1 --2- 172.21.15.83:0/3430731347 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe608109e00 0x7fe608110630 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:02.156 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:02.154+0000 7fe60fee3640 1 --2- 172.21.15.83:0/3430731347 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe6081094b0 0x7fe6081098c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:02.156 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:02.154+0000 7fe60fee3640 1 --2- 172.21.15.83:0/3430731347 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe608101f70 0x7fe608102380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:02.156 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:02.154+0000 7fe60fee3640 1 -- 172.21.15.83:0/3430731347 >> 172.21.15.83:0/3430731347 conn(0x7fe608077c60 msgr2=0x7fe6080780a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:40:02.156 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:02.154+0000 7fe60fee3640 1 -- 172.21.15.83:0/3430731347 shutdown_connections 2024-09-21T01:40:02.156 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:02.154+0000 7fe60fee3640 1 -- 172.21.15.83:0/3430731347 wait complete. 2024-09-21T01:40:02.158 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:02.155+0000 7fe60fee3640 1 Processor -- start 2024-09-21T01:40:02.158 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:02.155+0000 7fe60fee3640 1 -- start start 2024-09-21T01:40:02.158 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:02.155+0000 7fe60fee3640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe608101f70 0x7fe60819a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:40:02.158 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:02.155+0000 7fe60fee3640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe6081094b0 0x7fe60819a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:40:02.158 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:02.155+0000 7fe60fee3640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe608109e00 0x7fe60819fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:40:02.158 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:02.155+0000 7fe60fee3640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fe608113a40 con 0x7fe6081094b0 2024-09-21T01:40:02.158 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:02.155+0000 7fe60fee3640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fe6081138c0 con 0x7fe608101f70 2024-09-21T01:40:02.158 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:02.155+0000 7fe60fee3640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fe608113bc0 con 0x7fe608109e00 2024-09-21T01:40:02.159 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:02.155+0000 7fe60d47e640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe6081094b0 0x7fe60819a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:40:02.159 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:02.155+0000 7fe60d47e640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe6081094b0 0x7fe60819a990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:48934/0 (socket says 172.21.15.83:48934) 2024-09-21T01:40:02.159 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:02.155+0000 7fe60d47e640 1 -- 172.21.15.83:0/3275552709 learned_addr learned my addr 172.21.15.83:0/3275552709 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:40:02.159 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:02.155+0000 7fe60dc7f640 1 --2- 172.21.15.83:0/3275552709 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe608101f70 0x7fe60819a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:40:02.159 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:02.156+0000 7fe60d47e640 1 -- 172.21.15.83:0/3275552709 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe608109e00 msgr2=0x7fe60819fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:40:02.159 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:02.156+0000 7fe60e480640 1 --2- 172.21.15.83:0/3275552709 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe608109e00 0x7fe60819fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:40:02.159 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:02.156+0000 7fe60d47e640 1 --2- 172.21.15.83:0/3275552709 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe608109e00 0x7fe60819fc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:02.159 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:02.156+0000 7fe60d47e640 1 -- 172.21.15.83:0/3275552709 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe608101f70 msgr2=0x7fe60819a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:40:02.159 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:02.156+0000 7fe60d47e640 1 --2- 172.21.15.83:0/3275552709 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe608101f70 0x7fe60819a3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:02.159 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:02.156+0000 7fe60d47e640 1 -- 172.21.15.83:0/3275552709 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6081a0360 con 0x7fe6081094b0 2024-09-21T01:40:02.159 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:02.156+0000 7fe60d47e640 1 --2- 172.21.15.83:0/3275552709 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe6081094b0 0x7fe60819a990 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fe5f800c970 tx=0x7fe5f800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:40:02.159 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:02.156+0000 7fe5feffd640 1 -- 172.21.15.83:0/3275552709 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5f8004220 con 0x7fe6081094b0 2024-09-21T01:40:02.159 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:02.156+0000 7fe5feffd640 1 -- 172.21.15.83:0/3275552709 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe5f8007e40 con 0x7fe6081094b0 2024-09-21T01:40:02.160 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:02.156+0000 7fe60fee3640 1 -- 172.21.15.83:0/3275552709 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6081a0650 con 0x7fe6081094b0 2024-09-21T01:40:02.160 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:02.156+0000 7fe5feffd640 1 -- 172.21.15.83:0/3275552709 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5f80047a0 con 0x7fe6081094b0 2024-09-21T01:40:02.160 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:02.156+0000 7fe60fee3640 1 -- 172.21.15.83:0/3275552709 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6081a6db0 con 0x7fe6081094b0 2024-09-21T01:40:02.160 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:02.157+0000 7fe60fee3640 1 -- 172.21.15.83:0/3275552709 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe608102380 con 0x7fe6081094b0 2024-09-21T01:40:02.161 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:02.158+0000 7fe5feffd640 1 -- 172.21.15.83:0/3275552709 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 20) ==== 154529+0+0 (secure 0 0 0) 0x7fe5f80079b0 con 0x7fe6081094b0 2024-09-21T01:40:02.161 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:02.159+0000 7fe5feffd640 1 --2- 172.21.15.83:0/3275552709 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fe5f40b6560 0x7fe5f40b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:40:02.161 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:02.159+0000 7fe60dc7f640 1 --2- 172.21.15.83:0/3275552709 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fe5f40b6560 0x7fe5f40b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:40:02.161 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:02.159+0000 7fe5feffd640 1 -- 172.21.15.83:0/3275552709 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 9017+0+0 (secure 0 0 0) 0x7fe5f80e7810 con 0x7fe6081094b0 2024-09-21T01:40:02.161 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:02.160+0000 7fe60dc7f640 1 --2- 172.21.15.83:0/3275552709 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fe5f40b6560 0x7fe5f40b8a70 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fe604009890 tx=0x7fe604008040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:40:02.163 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:02.162+0000 7fe5feffd640 1 -- 172.21.15.83:0/3275552709 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe5f8014030 con 0x7fe6081094b0 2024-09-21T01:40:02.344 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:02.342+0000 7fe60fee3640 1 -- 172.21.15.83:0/3275552709 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe60819b520 con 0x7fe6081094b0 2024-09-21T01:40:02.345 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:02.344+0000 7fe5feffd640 1 -- 172.21.15.83:0/3275552709 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) ==== 74+0+24553 (secure 0 0 0) 0x7fe60819b520 con 0x7fe6081094b0 2024-09-21T01:40:02.345 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T01:40:02.346 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":80,"fsid":"f7697ecc-77b8-11ef-baf5-efdc52797490","created":"2024-09-21T01:31:22.250342+0000","modified":"2024-09-21T01:39:54.039731+0000","last_up_change":"2024-09-21T01:38:53.501659+0000","last_in_change":"2024-09-21T01:38:30.688516+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T01:35:06.977668+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T01:39:41.041950+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T01:39:42.882272+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T01:39:49.320532+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"66947512-01ee-4bf0-87b0-98a168cf50dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":3563457494},{"type":"v1","addr":"172.21.15.83:6803","nonce":3563457494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":3563457494},{"type":"v1","addr":"172.21.15.83:6805","nonce":3563457494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":3563457494},{"type":"v1","addr":"172.21.15.83:6809","nonce":3563457494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":3563457494},{"type":"v1","addr":"172.21.15.83:6807","nonce":3563457494}]},"public_addr":"172.21.15.83:6803/3563457494","cluster_addr":"172.21.15.83:6805/3563457494","heartbeat_back_addr":"172.21.15.83:6809/3563457494","heartbeat_front_addr":"172.21.15.83:6807/3563457494","state":["exists","up"]},{"osd":1,"uuid":"f7818a08-86a5-412d-a164-cfeb18f8650a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":2066870220},{"type":"v1","addr":"172.21.15.119:6801","nonce":2066870220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":2066870220},{"type":"v1","addr":"172.21.15.119:6803","nonce":2066870220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":2066870220},{"type":"v1","addr":"172.21.15.119:6807","nonce":2066870220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":2066870220},{"type":"v1","addr":"172.21.15.119:6805","nonce":2066870220}]},"public_addr":"172.21.15.119:6801/2066870220","cluster_addr":"172.21.15.119:6803/2066870220","heartbeat_back_addr":"172.21.15.119:6807/2066870220","heartbeat_front_addr":"172.21.15.119:6805/2066870220","state":["exists","up"]},{"osd":2,"uuid":"0d1a3870-c67a-4783-85f9-be2bb36f7722","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":3955936117},{"type":"v1","addr":"172.21.15.142:6801","nonce":3955936117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3955936117},{"type":"v1","addr":"172.21.15.142:6803","nonce":3955936117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":3955936117},{"type":"v1","addr":"172.21.15.142:6807","nonce":3955936117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":3955936117},{"type":"v1","addr":"172.21.15.142:6805","nonce":3955936117}]},"public_addr":"172.21.15.142:6801/3955936117","cluster_addr":"172.21.15.142:6803/3955936117","heartbeat_back_addr":"172.21.15.142:6807/3955936117","heartbeat_front_addr":"172.21.15.142:6805/3955936117","state":["exists","up"]},{"osd":3,"uuid":"a4cb1a36-3495-4d36-92da-ed3b6e852d14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":3746834093},{"type":"v1","addr":"172.21.15.83:6811","nonce":3746834093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":3746834093},{"type":"v1","addr":"172.21.15.83:6813","nonce":3746834093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":3746834093},{"type":"v1","addr":"172.21.15.83:6817","nonce":3746834093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":3746834093},{"type":"v1","addr":"172.21.15.83:6815","nonce":3746834093}]},"public_addr":"172.21.15.83:6811/3746834093","cluster_addr":"172.21.15.83:6813/3746834093","heartbeat_back_addr":"172.21.15.83:6817/3746834093","heartbeat_front_addr":"172.21.15.83:6815/3746834093","state":["exists","up"]},{"osd":4,"uuid":"d6f2ec78-7f08-473b-a96c-e8590f5d2f25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":3083907785},{"type":"v1","addr":"172.21.15.119:6809","nonce":3083907785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":3083907785},{"type":"v1","addr":"172.21.15.119:6811","nonce":3083907785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":3083907785},{"type":"v1","addr":"172.21.15.119:6815","nonce":3083907785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":3083907785},{"type":"v1","addr":"172.21.15.119:6813","nonce":3083907785}]},"public_addr":"172.21.15.119:6809/3083907785","cluster_addr":"172.21.15.119:6811/3083907785","heartbeat_back_addr":"172.21.15.119:6815/3083907785","heartbeat_front_addr":"172.21.15.119:6813/3083907785","state":["exists","up"]},{"osd":5,"uuid":"c571d04d-d3ea-4d74-8867-e4c7816f4e0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":349001002},{"type":"v1","addr":"172.21.15.142:6809","nonce":349001002}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":349001002},{"type":"v1","addr":"172.21.15.142:6811","nonce":349001002}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":349001002},{"type":"v1","addr":"172.21.15.142:6815","nonce":349001002}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":349001002},{"type":"v1","addr":"172.21.15.142:6813","nonce":349001002}]},"public_addr":"172.21.15.142:6809/349001002","cluster_addr":"172.21.15.142:6811/349001002","heartbeat_back_addr":"172.21.15.142:6815/349001002","heartbeat_front_addr":"172.21.15.142:6813/349001002","state":["exists","up"]},{"osd":6,"uuid":"6e1b6fe9-700a-448a-b382-59b97896ea7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":771651063},{"type":"v1","addr":"172.21.15.83:6819","nonce":771651063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":771651063},{"type":"v1","addr":"172.21.15.83:6821","nonce":771651063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":771651063},{"type":"v1","addr":"172.21.15.83:6825","nonce":771651063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":771651063},{"type":"v1","addr":"172.21.15.83:6823","nonce":771651063}]},"public_addr":"172.21.15.83:6819/771651063","cluster_addr":"172.21.15.83:6821/771651063","heartbeat_back_addr":"172.21.15.83:6825/771651063","heartbeat_front_addr":"172.21.15.83:6823/771651063","state":["exists","up"]},{"osd":7,"uuid":"283bfae4-5f50-4f9e-860e-bbfd47e005e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":1556984819},{"type":"v1","addr":"172.21.15.119:6817","nonce":1556984819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":1556984819},{"type":"v1","addr":"172.21.15.119:6819","nonce":1556984819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":1556984819},{"type":"v1","addr":"172.21.15.119:6823","nonce":1556984819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":1556984819},{"type":"v1","addr":"172.21.15.119:6821","nonce":1556984819}]},"public_addr":"172.21.15.119:6817/1556984819","cluster_addr":"172.21.15.119:6819/1556984819","heartbeat_back_addr":"172.21.15.119:6823/1556984819","heartbeat_front_addr":"172.21.15.119:6821/1556984819","state":["exists","up"]},{"osd":8,"uuid":"d46e56d4-ed4e-42c3-a315-66af014bd93a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":1860679473},{"type":"v1","addr":"172.21.15.142:6817","nonce":1860679473}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":1860679473},{"type":"v1","addr":"172.21.15.142:6819","nonce":1860679473}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":1860679473},{"type":"v1","addr":"172.21.15.142:6823","nonce":1860679473}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":1860679473},{"type":"v1","addr":"172.21.15.142:6821","nonce":1860679473}]},"public_addr":"172.21.15.142:6817/1860679473","cluster_addr":"172.21.15.142:6819/1860679473","heartbeat_back_addr":"172.21.15.142:6823/1860679473","heartbeat_front_addr":"172.21.15.142:6821/1860679473","state":["exists","up"]},{"osd":9,"uuid":"18a70ee6-56df-4f5c-868d-5db5e72a1859","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":3636757924},{"type":"v1","addr":"172.21.15.83:6827","nonce":3636757924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":3636757924},{"type":"v1","addr":"172.21.15.83:6829","nonce":3636757924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6832","nonce":3636757924},{"type":"v1","addr":"172.21.15.83:6833","nonce":3636757924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":3636757924},{"type":"v1","addr":"172.21.15.83:6831","nonce":3636757924}]},"public_addr":"172.21.15.83:6827/3636757924","cluster_addr":"172.21.15.83:6829/3636757924","heartbeat_back_addr":"172.21.15.83:6833/3636757924","heartbeat_front_addr":"172.21.15.83:6831/3636757924","state":["exists","up"]},{"osd":10,"uuid":"0d32c3de-db03-42c3-9914-07d675aaa339","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":2561963910},{"type":"v1","addr":"172.21.15.119:6825","nonce":2561963910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":2561963910},{"type":"v1","addr":"172.21.15.119:6827","nonce":2561963910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2561963910},{"type":"v1","addr":"172.21.15.119:6831","nonce":2561963910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2561963910},{"type":"v1","addr":"172.21.15.119:6829","nonce":2561963910}]},"public_addr":"172.21.15.119:6825/2561963910","cluster_addr":"172.21.15.119:6827/2561963910","heartbeat_back_addr":"172.21.15.119:6831/2561963910","heartbeat_front_addr":"172.21.15.119:6829/2561963910","state":["exists","up"]},{"osd":11,"uuid":"3a3b444d-b316-4256-bfad-378db29f0824","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":1174646198},{"type":"v1","addr":"172.21.15.142:6825","nonce":1174646198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":1174646198},{"type":"v1","addr":"172.21.15.142:6827","nonce":1174646198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1174646198},{"type":"v1","addr":"172.21.15.142:6831","nonce":1174646198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1174646198},{"type":"v1","addr":"172.21.15.142:6829","nonce":1174646198}]},"public_addr":"172.21.15.142:6825/1174646198","cluster_addr":"172.21.15.142:6827/1174646198","heartbeat_back_addr":"172.21.15.142:6831/1174646198","heartbeat_front_addr":"172.21.15.142:6829/1174646198","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:34:15.337672+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:34:39.259716+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:35:03.348886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:35:29.465711+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:35:53.744378+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:36:19.488785+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:36:45.708616+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:37:11.501065+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:37:36.027277+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:38:01.903625+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:38:27.215212+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:38:51.891278+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.83:0/1619062496":"2024-09-22T01:33:08.666525+0000","172.21.15.83:0/2412709299":"2024-09-22T01:31:45.834450+0000","172.21.15.83:6800/4290325964":"2024-09-22T01:31:45.834450+0000","172.21.15.83:6801/4290325964":"2024-09-22T01:31:45.834450+0000","172.21.15.83:0/1440681183":"2024-09-22T01:31:45.834450+0000","172.21.15.83:0/2745413305":"2024-09-22T01:31:45.834450+0000","172.21.15.83:6800/1393748565":"2024-09-22T01:33:08.666525+0000","172.21.15.83:0/110411274":"2024-09-22T01:32:10.073024+0000","172.21.15.83:0/4267551123":"2024-09-22T01:33:08.666525+0000","172.21.15.83:0/1068434643":"2024-09-22T01:32:10.073024+0000","172.21.15.83:6800/2963261730":"2024-09-22T01:32:10.073024+0000","172.21.15.83:0/3544333975":"2024-09-22T01:32:10.073024+0000","172.21.15.83:6801/1393748565":"2024-09-22T01:33:08.666525+0000","172.21.15.83:6801/2963261730":"2024-09-22T01:32:10.073024+0000","172.21.15.83:0/1915285091":"2024-09-22T01:33:08.666525+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T01:40:02.348 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:02.346+0000 7fe60fee3640 1 -- 172.21.15.83:0/3275552709 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fe5f40b6560 msgr2=0x7fe5f40b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:40:02.348 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:02.346+0000 7fe60fee3640 1 --2- 172.21.15.83:0/3275552709 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fe5f40b6560 0x7fe5f40b8a70 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fe604009890 tx=0x7fe604008040 comp rx=0 tx=0).stop 2024-09-21T01:40:02.348 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:02.346+0000 7fe60fee3640 1 -- 172.21.15.83:0/3275552709 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe6081094b0 msgr2=0x7fe60819a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:40:02.348 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:02.346+0000 7fe60fee3640 1 --2- 172.21.15.83:0/3275552709 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe6081094b0 0x7fe60819a990 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fe5f800c970 tx=0x7fe5f800ce30 comp rx=0 tx=0).stop 2024-09-21T01:40:02.348 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:02.346+0000 7fe60fee3640 1 -- 172.21.15.83:0/3275552709 shutdown_connections 2024-09-21T01:40:02.348 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:02.346+0000 7fe60fee3640 1 --2- 172.21.15.83:0/3275552709 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fe5f40b6560 0x7fe5f40b8a70 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:02.348 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:02.346+0000 7fe60fee3640 1 --2- 172.21.15.83:0/3275552709 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe608109e00 0x7fe60819fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:02.348 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:02.346+0000 7fe60fee3640 1 --2- 172.21.15.83:0/3275552709 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe6081094b0 0x7fe60819a990 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:02.348 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:02.346+0000 7fe60fee3640 1 --2- 172.21.15.83:0/3275552709 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe608101f70 0x7fe60819a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:02.348 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:02.346+0000 7fe60fee3640 1 -- 172.21.15.83:0/3275552709 >> 172.21.15.83:0/3275552709 conn(0x7fe608077c60 msgr2=0x7fe6081074a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:40:02.348 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:02.346+0000 7fe60fee3640 1 -- 172.21.15.83:0/3275552709 shutdown_connections 2024-09-21T01:40:02.348 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:02.346+0000 7fe60fee3640 1 -- 172.21.15.83:0/3275552709 wait complete. 2024-09-21T01:40:02.714 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:40:02 smithi142 ceph-mon[34050]: from='client.? 172.21.15.83:0/3275552709' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T01:40:02.717 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:40:02 smithi119 ceph-mon[33693]: from='client.? 172.21.15.83:0/3275552709' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T01:40:02.801 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:40:02 smithi083 ceph-mon[31370]: from='client.? 172.21.15.83:0/3275552709' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T01:40:03.009 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-21T01:39:45.145124+0000', 'modified': '2024-09-21T01:39:54.039893+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 24653}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24653': {'gid': 24653, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.119:6839/3106757092', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.119:6838', 'nonce': 3106757092}, {'type': 'v1', 'addr': '172.21.15.119:6839', 'nonce': 3106757092}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1, 'qdb_leader': 24653, 'qdb_cluster': [24653]} 2024-09-21T01:40:03.009 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-21T01:40:03.009 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph tell mds.b status 2024-09-21T01:40:03.255 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:40:03.635 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:40:03 smithi083 ceph-mon[31370]: pgmap v275: 129 pgs: 129 active+clean; 579 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:40:03.714 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:40:03 smithi142 ceph-mon[34050]: pgmap v275: 129 pgs: 129 active+clean; 579 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:40:03.717 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:40:03 smithi119 ceph-mon[33693]: pgmap v275: 129 pgs: 129 active+clean; 579 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:40:03.736 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.724+0000 7f6f755aa640 1 -- 172.21.15.83:0/2414139305 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6f701083a0 msgr2=0x7f6f701087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:40:03.736 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.724+0000 7f6f755aa640 1 --2- 172.21.15.83:0/2414139305 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6f701083a0 0x7f6f701087b0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f6f58009900 tx=0x7f6f5802a410 comp rx=0 tx=0).stop 2024-09-21T01:40:03.736 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.724+0000 7f6f755aa640 1 -- 172.21.15.83:0/2414139305 shutdown_connections 2024-09-21T01:40:03.736 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.724+0000 7f6f755aa640 1 --2- 172.21.15.83:0/2414139305 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6f70108cf0 0x7f6f7010f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:03.736 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.724+0000 7f6f755aa640 1 --2- 172.21.15.83:0/2414139305 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6f701083a0 0x7f6f701087b0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:03.736 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.724+0000 7f6f755aa640 1 --2- 172.21.15.83:0/2414139305 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f70102a60 0x7f6f70102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:03.736 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.724+0000 7f6f755aa640 1 -- 172.21.15.83:0/2414139305 >> 172.21.15.83:0/2414139305 conn(0x7f6f70079730 msgr2=0x7f6f70079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:40:03.736 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.724+0000 7f6f755aa640 1 -- 172.21.15.83:0/2414139305 shutdown_connections 2024-09-21T01:40:03.736 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.724+0000 7f6f755aa640 1 -- 172.21.15.83:0/2414139305 wait complete. 2024-09-21T01:40:03.736 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.724+0000 7f6f755aa640 1 Processor -- start 2024-09-21T01:40:03.736 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.725+0000 7f6f755aa640 1 -- start start 2024-09-21T01:40:03.737 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.725+0000 7f6f755aa640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f70102a60 0x7f6f7019a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:40:03.737 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.725+0000 7f6f755aa640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6f701083a0 0x7f6f7019a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:40:03.737 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.725+0000 7f6f755aa640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6f70108cf0 0x7f6f7019fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:40:03.737 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.725+0000 7f6f755aa640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f6f70112810 con 0x7f6f70108cf0 2024-09-21T01:40:03.737 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.725+0000 7f6f755aa640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f6f70112690 con 0x7f6f701083a0 2024-09-21T01:40:03.737 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.725+0000 7f6f755aa640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f6f70112990 con 0x7f6f70102a60 2024-09-21T01:40:03.737 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.725+0000 7f6f6f7fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6f70108cf0 0x7f6f7019fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:40:03.737 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.725+0000 7f6f6f7fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6f70108cf0 0x7f6f7019fbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:42592/0 (socket says 172.21.15.83:42592) 2024-09-21T01:40:03.737 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.725+0000 7f6f6f7fe640 1 -- 172.21.15.83:0/3864920994 learned_addr learned my addr 172.21.15.83:0/3864920994 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:40:03.737 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.725+0000 7f6f6effd640 1 --2- 172.21.15.83:0/3864920994 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f70102a60 0x7f6f7019a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:40:03.737 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.725+0000 7f6f6e7fc640 1 --2- 172.21.15.83:0/3864920994 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6f701083a0 0x7f6f7019a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:40:03.737 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.725+0000 7f6f6f7fe640 1 -- 172.21.15.83:0/3864920994 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f70102a60 msgr2=0x7f6f7019a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:40:03.737 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.725+0000 7f6f6f7fe640 1 --2- 172.21.15.83:0/3864920994 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f70102a60 0x7f6f7019a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:03.737 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.725+0000 7f6f6f7fe640 1 -- 172.21.15.83:0/3864920994 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6f701083a0 msgr2=0x7f6f7019a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:40:03.738 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.725+0000 7f6f6f7fe640 1 --2- 172.21.15.83:0/3864920994 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6f701083a0 0x7f6f7019a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:03.738 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.725+0000 7f6f6f7fe640 1 -- 172.21.15.83:0/3864920994 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f701a0240 con 0x7f6f70108cf0 2024-09-21T01:40:03.738 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.726+0000 7f6f6f7fe640 1 --2- 172.21.15.83:0/3864920994 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6f70108cf0 0x7f6f7019fbd0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f6f6000d950 tx=0x7f6f6000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:40:03.738 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.726+0000 7f6f67fff640 1 -- 172.21.15.83:0/3864920994 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f60017030 con 0x7f6f70108cf0 2024-09-21T01:40:03.738 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.726+0000 7f6f755aa640 1 -- 172.21.15.83:0/3864920994 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f701a0530 con 0x7f6f70108cf0 2024-09-21T01:40:03.738 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.726+0000 7f6f67fff640 1 -- 172.21.15.83:0/3864920994 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6f60004020 con 0x7f6f70108cf0 2024-09-21T01:40:03.738 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.726+0000 7f6f67fff640 1 -- 172.21.15.83:0/3864920994 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f60003ab0 con 0x7f6f70108cf0 2024-09-21T01:40:03.738 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.726+0000 7f6f755aa640 1 -- 172.21.15.83:0/3864920994 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f701a6d50 con 0x7f6f70108cf0 2024-09-21T01:40:03.738 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.729+0000 7f6f7bb1e740 1 Processor -- start 2024-09-21T01:40:03.738 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.729+0000 7f6f67fff640 1 -- 172.21.15.83:0/3864920994 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 20) ==== 154529+0+0 (secure 0 0 0) 0x7f6f6001a070 con 0x7f6f70108cf0 2024-09-21T01:40:03.738 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.729+0000 7f6f7bb1e740 1 -- start start 2024-09-21T01:40:03.738 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.729+0000 7f6f7bb1e740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56055681ef60 0x560556bc4f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:40:03.738 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.729+0000 7f6f7bb1e740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5605567f60a0 0x560556bc5440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:40:03.738 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.729+0000 7f6f7bb1e740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5605567fe280 0x560556bc5980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:40:03.739 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.729+0000 7f6f7bb1e740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x560556b3cc10 con 0x56055681ef60 2024-09-21T01:40:03.739 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.730+0000 7f6f7bb1e740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x560556b2c040 con 0x5605567fe280 2024-09-21T01:40:03.739 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.730+0000 7f6f7bb1e740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x560556b2fe50 con 0x5605567f60a0 2024-09-21T01:40:03.739 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.730+0000 7f6f6e7fc640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56055681ef60 0x560556bc4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:40:03.739 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.730+0000 7f6f6e7fc640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56055681ef60 0x560556bc4f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:42606/0 (socket says 172.21.15.83:42606) 2024-09-21T01:40:03.739 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.730+0000 7f6f6e7fc640 1 -- 172.21.15.83:0/1166185290 learned_addr learned my addr 172.21.15.83:0/1166185290 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:40:03.739 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.730+0000 7f6f6effd640 1 --2- 172.21.15.83:0/1166185290 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5605567f60a0 0x560556bc5440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:40:03.739 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.730+0000 7f6f6e7fc640 1 -- 172.21.15.83:0/1166185290 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5605567f60a0 msgr2=0x560556bc5440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:40:03.739 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.730+0000 7f6f6e7fc640 1 --2- 172.21.15.83:0/1166185290 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5605567f60a0 0x560556bc5440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:03.739 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.730+0000 7f6f67fff640 1 --2- 172.21.15.83:0/3864920994 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f6f5c0b6590 0x7f6f5c0b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:40:03.739 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.730+0000 7f6f6e7fc640 1 -- 172.21.15.83:0/1166185290 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5605567fe280 msgr2=0x560556bc5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:40:03.739 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.730+0000 7f6f6e7fc640 1 --2- 172.21.15.83:0/1166185290 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5605567fe280 0x560556bc5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:03.739 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.730+0000 7f6f6e7fc640 1 -- 172.21.15.83:0/1166185290 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56055688a540 con 0x56055681ef60 2024-09-21T01:40:03.740 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.730+0000 7f6f6f7fe640 1 --2- 172.21.15.83:0/3864920994 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f6f5c0b6590 0x7f6f5c0b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:40:03.740 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.730+0000 7f6f6e7fc640 1 --2- 172.21.15.83:0/1166185290 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56055681ef60 0x560556bc4f00 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f6f580057c0 tx=0x7f6f58031cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=244f52df1656ba01 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:40:03.740 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.730+0000 7f6f67fff640 1 -- 172.21.15.83:0/3864920994 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 9017+0+0 (secure 0 0 0) 0x7f6f600e6db0 con 0x7f6f70108cf0 2024-09-21T01:40:03.740 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.730+0000 7f6f657fa640 1 -- 172.21.15.83:0/1166185290 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f58035070 con 0x56055681ef60 2024-09-21T01:40:03.740 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.730+0000 7f6f657fa640 1 -- 172.21.15.83:0/1166185290 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6f58041070 con 0x56055681ef60 2024-09-21T01:40:03.740 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.730+0000 7f6f657fa640 1 -- 172.21.15.83:0/1166185290 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f58003970 con 0x56055681ef60 2024-09-21T01:40:03.740 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.731+0000 7f6f7bb1e740 1 -- 172.21.15.83:0/1166185290 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56055681ef60 msgr2=0x560556bc4f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:40:03.740 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.731+0000 7f6f6f7fe640 1 --2- 172.21.15.83:0/3864920994 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f6f5c0b6590 0x7f6f5c0b8aa0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f6f600a9200 tx=0x7f6f600e70b0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:40:03.740 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.731+0000 7f6f7bb1e740 1 --2- 172.21.15.83:0/1166185290 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56055681ef60 0x560556bc4f00 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f6f580057c0 tx=0x7f6f58031cb0 comp rx=0 tx=0).stop 2024-09-21T01:40:03.740 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.731+0000 7f6f7bb1e740 1 -- 172.21.15.83:0/1166185290 shutdown_connections 2024-09-21T01:40:03.740 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.731+0000 7f6f7bb1e740 1 --2- 172.21.15.83:0/1166185290 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5605567fe280 0x560556bc5980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:03.740 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.731+0000 7f6f7bb1e740 1 --2- 172.21.15.83:0/1166185290 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5605567f60a0 0x560556bc5440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:03.740 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.731+0000 7f6f7bb1e740 1 --2- 172.21.15.83:0/1166185290 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x56055681ef60 0x560556bc4f00 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:03.740 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.731+0000 7f6f7bb1e740 1 -- 172.21.15.83:0/1166185290 >> 172.21.15.83:0/1166185290 conn(0x560556813350 msgr2=0x560556bc2df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:40:03.741 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.732+0000 7f6f7bb1e740 1 -- 172.21.15.83:0/1166185290 shutdown_connections 2024-09-21T01:40:03.741 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.732+0000 7f6f7bb1e740 1 -- 172.21.15.83:0/1166185290 wait complete. 2024-09-21T01:40:03.741 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.732+0000 7f6f7bb1e740 1 -- start start 2024-09-21T01:40:03.741 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.732+0000 7f6f7bb1e740 1 Processor -- start 2024-09-21T01:40:03.741 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.732+0000 7f6f7bb1e740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5605567f60a0 0x560556bd09d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:40:03.741 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.732+0000 7f6f7bb1e740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5605567fe280 0x560556bd0f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:40:03.741 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.732+0000 7f6f7bb1e740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56055681ef60 0x560556bdc970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:40:03.741 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.732+0000 7f6f7bb1e740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x56055698d5f0 con 0x5605567f60a0 2024-09-21T01:40:03.741 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.732+0000 7f6f7bb1e740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x560556ac7010 con 0x56055681ef60 2024-09-21T01:40:03.741 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.732+0000 7f6f7bb1e740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x560556bd3680 con 0x5605567fe280 2024-09-21T01:40:03.741 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.732+0000 7f6f7bb1e740 10 client.0 _ll_register_callbacks cb 0x560556b26340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:40:03.741 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.732+0000 7f6f6e7fc640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5605567f60a0 0x560556bd09d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:40:03.741 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.732+0000 7f6f6e7fc640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5605567f60a0 0x560556bd09d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:42614/0 (socket says 172.21.15.83:42614) 2024-09-21T01:40:03.741 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.732+0000 7f6f6e7fc640 1 -- 172.21.15.83:0/2745230604 learned_addr learned my addr 172.21.15.83:0/2745230604 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:40:03.741 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.733+0000 7f6f6effd640 1 --2- 172.21.15.83:0/2745230604 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5605567fe280 0x560556bd0f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:40:03.742 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.733+0000 7f6f6e7fc640 1 -- 172.21.15.83:0/2745230604 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5605567fe280 msgr2=0x560556bd0f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:40:03.742 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.733+0000 7f6f6e7fc640 1 --2- 172.21.15.83:0/2745230604 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5605567fe280 0x560556bd0f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:03.742 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.733+0000 7f6f6e7fc640 1 -- 172.21.15.83:0/2745230604 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56055681ef60 msgr2=0x560556bdc970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:40:03.742 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.733+0000 7f6f6e7fc640 1 --2- 172.21.15.83:0/2745230604 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56055681ef60 0x560556bdc970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:03.742 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.733+0000 7f6f6e7fc640 1 -- 172.21.15.83:0/2745230604 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560556af4a00 con 0x5605567f60a0 2024-09-21T01:40:03.742 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.733+0000 7f6f6e7fc640 1 --2- 172.21.15.83:0/2745230604 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5605567f60a0 0x560556bd09d0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f6f580058e0 tx=0x7f6f58031a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba45eadf9f6b5e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:40:03.742 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.733+0000 7f6f567fc640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-09-21T01:40:03.742 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.733+0000 7f6f567fc640 1 -- 172.21.15.83:0/2745230604 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f58035050 con 0x5605567f60a0 2024-09-21T01:40:03.742 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.733+0000 7f6f567fc640 1 -- 172.21.15.83:0/2745230604 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 9017+0+0 (secure 0 0 0) 0x7f6f5804f670 con 0x5605567f60a0 2024-09-21T01:40:03.742 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.733+0000 7f6f7bb1e740 1 -- 172.21.15.83:0/2745230604 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6f58041070 con 0x5605567f60a0 2024-09-21T01:40:03.742 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.733+0000 7f6f567fc640 1 -- 172.21.15.83:0/2745230604 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f6f58058050 con 0x5605567f60a0 2024-09-21T01:40:03.742 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.733+0000 7f6f7bb1e740 10 client.14955 fetch_fsmap learned FSMap version 17 2024-09-21T01:40:03.742 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.733+0000 7f6f7bb1e740 1 -- 172.21.15.83:0/2745230604 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=4+}) -- 0x560556bdf5a0 con 0x5605567f60a0 2024-09-21T01:40:03.742 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.734+0000 7f6f567fc640 1 -- 172.21.15.83:0/2745230604 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6f58041070 con 0x5605567f60a0 2024-09-21T01:40:03.743 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.734+0000 7f6f567fc640 1 -- 172.21.15.83:0/2745230604 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 17) ==== 8350+0+0 (secure 0 0 0) 0x7f6f5803b530 con 0x5605567f60a0 2024-09-21T01:40:03.743 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.734+0000 7f6f7bb1e740 10 client.14955 fetch_fsmap finished waiting for FSMap version 17 2024-09-21T01:40:03.743 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.734+0000 7f6f7bb1e740 10 client.14955 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-21T01:40:03.743 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.734+0000 7f6f7bb1e740 20 client.14955 populate_metadata read hostname 'smithi083' 2024-09-21T01:40:03.743 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.734+0000 7f6f7bb1e740 1 --2- 172.21.15.83:0/2745230604 >> [v2:172.21.15.119:6838/3106757092,v1:172.21.15.119:6839/3106757092] conn(0x5605567dd8e0 0x560556be2b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:40:03.743 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.734+0000 7f6f7bb1e740 4 client.14955 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:40:03.743 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.734+0000 7f6f7bb1e740 1 -- 172.21.15.83:0/2745230604 --> [v2:172.21.15.119:6838/3106757092,v1:172.21.15.119:6839/3106757092] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560556b3eb60 con 0x5605567dd8e0 2024-09-21T01:40:03.743 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.734+0000 7f6f6effd640 1 --2- 172.21.15.83:0/2745230604 >> [v2:172.21.15.119:6838/3106757092,v1:172.21.15.119:6839/3106757092] conn(0x5605567dd8e0 0x560556be2b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:40:03.743 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.735+0000 7f6f567fc640 10 client.14955 ms_handle_connect on v2:172.21.15.119:6838/3106757092 2024-09-21T01:40:03.743 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.735+0000 7f6f6effd640 1 --2- 172.21.15.83:0/2745230604 >> [v2:172.21.15.119:6838/3106757092,v1:172.21.15.119:6839/3106757092] conn(0x5605567dd8e0 0x560556be2b60 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=372e50b4a6b1b5e server_cookie=894a5f0dbe25bac5 in_seq=0 out_seq=0 2024-09-21T01:40:03.744 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.735+0000 7f6f567fc640 1 -- 172.21.15.83:0/2745230604 <== mds.0 v2:172.21.15.119:6838/3106757092 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560556b3eb60 con 0x5605567dd8e0 2024-09-21T01:40:03.744 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.735+0000 7f6f567fc640 10 client.14955 handle_command_reply: tid=0 2024-09-21T01:40:03.744 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.736+0000 7f6f7bb1e740 1 client.14955 shutdown 2024-09-21T01:40:03.744 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.736+0000 7f6f7bb1e740 1 -- 172.21.15.83:0/2745230604 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5605567f60a0 msgr2=0x560556bd09d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:40:03.744 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.736+0000 7f6f7bb1e740 1 --2- 172.21.15.83:0/2745230604 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5605567f60a0 0x560556bd09d0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f6f580058e0 tx=0x7f6f58031a70 comp rx=0 tx=0).stop 2024-09-21T01:40:03.745 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.736+0000 7f6f7bb1e740 1 -- 172.21.15.83:0/2745230604 shutdown_connections 2024-09-21T01:40:03.745 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.736+0000 7f6f7bb1e740 1 --2- 172.21.15.83:0/2745230604 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56055681ef60 0x560556bdc970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:03.745 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.736+0000 7f6f7bb1e740 1 --2- 172.21.15.83:0/2745230604 >> [v2:172.21.15.119:6838/3106757092,v1:172.21.15.119:6839/3106757092] conn(0x5605567dd8e0 0x560556be2b60 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:03.745 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.736+0000 7f6f7bb1e740 1 --2- 172.21.15.83:0/2745230604 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5605567fe280 0x560556bd0f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:03.745 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.736+0000 7f6f7bb1e740 1 --2- 172.21.15.83:0/2745230604 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5605567f60a0 0x560556bd09d0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:03.745 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.736+0000 7f6f7bb1e740 1 -- 172.21.15.83:0/2745230604 >> 172.21.15.83:0/2745230604 conn(0x560556813350 msgr2=0x560556bc80b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:40:03.745 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.736+0000 7f6f567fc640 0 client.14955 ms_handle_reset on v2:172.21.15.119:6838/3106757092 2024-09-21T01:40:03.745 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.736+0000 7f6f7bb1e740 1 -- 172.21.15.83:0/2745230604 shutdown_connections 2024-09-21T01:40:03.745 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.736+0000 7f6f7bb1e740 1 -- 172.21.15.83:0/2745230604 wait complete. 2024-09-21T01:40:03.745 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.736+0000 7f6f7bb1e740 20 client.14955 trim_cache size 0 max 16384 2024-09-21T01:40:03.755 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.753+0000 7f6f7bb1e740 1 Processor -- start 2024-09-21T01:40:03.755 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.754+0000 7f6f7bb1e740 1 -- start start 2024-09-21T01:40:03.755 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.754+0000 7f6f7bb1e740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5605567f60a0 0x560556bc2fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:40:03.755 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.754+0000 7f6f7bb1e740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5605567fe280 0x560556bc8710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:40:03.755 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.754+0000 7f6f7bb1e740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56055681ef60 0x560556bcd9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:40:03.755 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.754+0000 7f6f7bb1e740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x560556be0ea0 con 0x5605567f60a0 2024-09-21T01:40:03.756 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.754+0000 7f6f7bb1e740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x560556be1570 con 0x56055681ef60 2024-09-21T01:40:03.756 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.754+0000 7f6f7bb1e740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x560556be1c40 con 0x5605567fe280 2024-09-21T01:40:03.756 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.754+0000 7f6f6e7fc640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5605567f60a0 0x560556bc2fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:40:03.756 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.754+0000 7f6f6e7fc640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5605567f60a0 0x560556bc2fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:42628/0 (socket says 172.21.15.83:42628) 2024-09-21T01:40:03.756 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.754+0000 7f6f6e7fc640 1 -- 172.21.15.83:0/1649846631 learned_addr learned my addr 172.21.15.83:0/1649846631 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:40:03.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.754+0000 7f6f6e7fc640 1 --2- 172.21.15.83:0/1649846631 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56055681ef60 0x560556bcd9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:40:03.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.754+0000 7f6f6effd640 1 --2- 172.21.15.83:0/1649846631 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5605567fe280 0x560556bc8710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:40:03.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.754+0000 7f6f6e7fc640 1 -- 172.21.15.83:0/1649846631 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5605567fe280 msgr2=0x560556bc8710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:40:03.758 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.754+0000 7f6f6e7fc640 1 --2- 172.21.15.83:0/1649846631 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5605567fe280 0x560556bc8710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:03.758 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.754+0000 7f6f6e7fc640 1 -- 172.21.15.83:0/1649846631 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56055681ef60 msgr2=0x560556bcd9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:40:03.758 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.754+0000 7f6f6e7fc640 1 --2- 172.21.15.83:0/1649846631 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56055681ef60 0x560556bcd9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:03.758 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.754+0000 7f6f6e7fc640 1 -- 172.21.15.83:0/1649846631 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560556bcecd0 con 0x5605567f60a0 2024-09-21T01:40:03.758 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.755+0000 7f6f6e7fc640 1 --2- 172.21.15.83:0/1649846631 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5605567f60a0 0x560556bc2fc0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f6f5803b980 tx=0x7f6f58005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1ae259dd99a31a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:40:03.758 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.755+0000 7f6f64ff9640 1 -- 172.21.15.83:0/1649846631 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f58061070 con 0x5605567f60a0 2024-09-21T01:40:03.758 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.755+0000 7f6f64ff9640 1 -- 172.21.15.83:0/1649846631 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6f58041040 con 0x5605567f60a0 2024-09-21T01:40:03.758 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.755+0000 7f6f64ff9640 1 -- 172.21.15.83:0/1649846631 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f58035070 con 0x5605567f60a0 2024-09-21T01:40:03.758 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.756+0000 7f6f7bb1e740 1 -- 172.21.15.83:0/1649846631 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5605567f60a0 msgr2=0x560556bc2fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:40:03.758 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.756+0000 7f6f7bb1e740 1 --2- 172.21.15.83:0/1649846631 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5605567f60a0 0x560556bc2fc0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f6f5803b980 tx=0x7f6f58005fd0 comp rx=0 tx=0).stop 2024-09-21T01:40:03.758 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.756+0000 7f6f7bb1e740 1 -- 172.21.15.83:0/1649846631 shutdown_connections 2024-09-21T01:40:03.758 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.756+0000 7f6f7bb1e740 1 --2- 172.21.15.83:0/1649846631 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56055681ef60 0x560556bcd9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:03.758 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.756+0000 7f6f7bb1e740 1 --2- 172.21.15.83:0/1649846631 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5605567fe280 0x560556bc8710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:03.759 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.756+0000 7f6f7bb1e740 1 --2- 172.21.15.83:0/1649846631 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5605567f60a0 0x560556bc2fc0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:03.759 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.756+0000 7f6f7bb1e740 1 -- 172.21.15.83:0/1649846631 >> 172.21.15.83:0/1649846631 conn(0x560556813350 msgr2=0x560556bc8000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:40:03.759 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.756+0000 7f6f7bb1e740 1 -- 172.21.15.83:0/1649846631 shutdown_connections 2024-09-21T01:40:03.759 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.756+0000 7f6f7bb1e740 1 -- 172.21.15.83:0/1649846631 wait complete. 2024-09-21T01:40:03.759 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.756+0000 7f6f7bb1e740 1 -- start start 2024-09-21T01:40:03.759 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.756+0000 7f6f7bb1e740 1 Processor -- start 2024-09-21T01:40:03.762 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.756+0000 7f6f7bb1e740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5605567f60a0 0x560556be7260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:40:03.762 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.756+0000 7f6f7bb1e740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5605567fe280 0x560556be7840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:40:03.762 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.756+0000 7f6f7bb1e740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56055681ef60 0x560556c4d030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:40:03.762 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.756+0000 7f6f7bb1e740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x560556be29e0 con 0x5605567f60a0 2024-09-21T01:40:03.762 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.756+0000 7f6f7bb1e740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x560556be2310 con 0x56055681ef60 2024-09-21T01:40:03.762 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.756+0000 7f6f7bb1e740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x560556be30b0 con 0x5605567fe280 2024-09-21T01:40:03.762 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.757+0000 7f6f7bb1e740 10 client.0 _ll_register_callbacks cb 0x7f6f68007910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:40:03.762 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.757+0000 7f6f6e7fc640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5605567f60a0 0x560556be7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:40:03.762 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.757+0000 7f6f6e7fc640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5605567f60a0 0x560556be7260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:42642/0 (socket says 172.21.15.83:42642) 2024-09-21T01:40:03.762 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.757+0000 7f6f6e7fc640 1 -- 172.21.15.83:0/1455853156 learned_addr learned my addr 172.21.15.83:0/1455853156 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:40:03.762 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.757+0000 7f6f6effd640 1 --2- 172.21.15.83:0/1455853156 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5605567fe280 0x560556be7840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:40:03.763 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.757+0000 7f6f6e7fc640 1 --2- 172.21.15.83:0/1455853156 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56055681ef60 0x560556c4d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:40:03.763 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.757+0000 7f6f6e7fc640 1 -- 172.21.15.83:0/1455853156 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5605567fe280 msgr2=0x560556be7840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:40:03.763 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.757+0000 7f6f6e7fc640 1 --2- 172.21.15.83:0/1455853156 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5605567fe280 0x560556be7840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:03.763 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.757+0000 7f6f6e7fc640 1 -- 172.21.15.83:0/1455853156 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56055681ef60 msgr2=0x560556c4d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:40:03.763 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.757+0000 7f6f6e7fc640 1 --2- 172.21.15.83:0/1455853156 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56055681ef60 0x560556c4d030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:03.763 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.757+0000 7f6f6e7fc640 1 -- 172.21.15.83:0/1455853156 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560556c4d570 con 0x5605567f60a0 2024-09-21T01:40:03.763 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.757+0000 7f6f6e7fc640 1 --2- 172.21.15.83:0/1455853156 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5605567f60a0 0x560556be7260 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f6f58005ab0 tx=0x7f6f58005a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43566378abe0b600 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:40:03.763 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.757+0000 7f6f567fc640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-09-21T01:40:03.763 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.757+0000 7f6f567fc640 1 -- 172.21.15.83:0/1455853156 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f58061040 con 0x5605567f60a0 2024-09-21T01:40:03.763 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.757+0000 7f6f567fc640 1 -- 172.21.15.83:0/1455853156 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 9017+0+0 (secure 0 0 0) 0x7f6f58031d30 con 0x5605567f60a0 2024-09-21T01:40:03.763 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.757+0000 7f6f7bb1e740 1 -- 172.21.15.83:0/1455853156 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6f58041040 con 0x5605567f60a0 2024-09-21T01:40:03.763 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.757+0000 7f6f567fc640 1 -- 172.21.15.83:0/1455853156 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f6f58035040 con 0x5605567f60a0 2024-09-21T01:40:03.763 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.757+0000 7f6f7bb1e740 10 client.14961 fetch_fsmap learned FSMap version 17 2024-09-21T01:40:03.763 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.757+0000 7f6f7bb1e740 1 -- 172.21.15.83:0/1455853156 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=4+}) -- 0x560556c4e720 con 0x5605567f60a0 2024-09-21T01:40:03.764 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.758+0000 7f6f567fc640 1 -- 172.21.15.83:0/1455853156 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6f58041040 con 0x5605567f60a0 2024-09-21T01:40:03.764 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.758+0000 7f6f567fc640 1 -- 172.21.15.83:0/1455853156 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 17) ==== 8350+0+0 (secure 0 0 0) 0x7f6f58064030 con 0x5605567f60a0 2024-09-21T01:40:03.764 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.758+0000 7f6f7bb1e740 10 client.14961 fetch_fsmap finished waiting for FSMap version 17 2024-09-21T01:40:03.764 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.758+0000 7f6f7bb1e740 10 client.14961 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-21T01:40:03.764 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.758+0000 7f6f7bb1e740 20 client.14961 populate_metadata read hostname 'smithi083' 2024-09-21T01:40:03.764 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.758+0000 7f6f7bb1e740 1 --2- 172.21.15.83:0/1455853156 >> [v2:172.21.15.119:6838/3106757092,v1:172.21.15.119:6839/3106757092] conn(0x5605567b2c90 0x560556c51a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:40:03.764 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.758+0000 7f6f7bb1e740 4 client.14961 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T01:40:03.764 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.758+0000 7f6f7bb1e740 1 -- 172.21.15.83:0/1455853156 --> [v2:172.21.15.119:6838/3106757092,v1:172.21.15.119:6839/3106757092] -- command(tid 0: {"prefix": "status"}) -- 0x560556b3a610 con 0x5605567b2c90 2024-09-21T01:40:03.764 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.758+0000 7f6f6effd640 1 --2- 172.21.15.83:0/1455853156 >> [v2:172.21.15.119:6838/3106757092,v1:172.21.15.119:6839/3106757092] conn(0x5605567b2c90 0x560556c51a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:40:03.764 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.759+0000 7f6f6effd640 1 --2- 172.21.15.83:0/1455853156 >> [v2:172.21.15.119:6838/3106757092,v1:172.21.15.119:6839/3106757092] conn(0x5605567b2c90 0x560556c51a70 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b8ad8699ae0c8124 server_cookie=d4cdca685213667b in_seq=0 out_seq=0 2024-09-21T01:40:03.764 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.759+0000 7f6f567fc640 10 client.14961 ms_handle_connect on v2:172.21.15.119:6838/3106757092 2024-09-21T01:40:03.764 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.759+0000 7f6f567fc640 1 -- 172.21.15.83:0/1455853156 <== mds.0 v2:172.21.15.119:6838/3106757092 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x560556b3a610 con 0x5605567b2c90 2024-09-21T01:40:03.764 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.759+0000 7f6f567fc640 10 client.14961 handle_command_reply: tid=0 2024-09-21T01:40:03.764 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.759+0000 7f6f7bb1e740 1 client.14961 shutdown 2024-09-21T01:40:03.765 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.759+0000 7f6f7bb1e740 1 -- 172.21.15.83:0/1455853156 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5605567f60a0 msgr2=0x560556be7260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:40:03.765 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.759+0000 7f6f7bb1e740 1 --2- 172.21.15.83:0/1455853156 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5605567f60a0 0x560556be7260 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f6f58005ab0 tx=0x7f6f58005a20 comp rx=0 tx=0).stop 2024-09-21T01:40:03.765 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.759+0000 7f6f7bb1e740 1 -- 172.21.15.83:0/1455853156 shutdown_connections 2024-09-21T01:40:03.765 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.759+0000 7f6f7bb1e740 1 --2- 172.21.15.83:0/1455853156 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x56055681ef60 0x560556c4d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:03.765 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.759+0000 7f6f7bb1e740 1 --2- 172.21.15.83:0/1455853156 >> [v2:172.21.15.119:6838/3106757092,v1:172.21.15.119:6839/3106757092] conn(0x5605567b2c90 0x560556c51a70 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:03.765 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.759+0000 7f6f7bb1e740 1 --2- 172.21.15.83:0/1455853156 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5605567fe280 0x560556be7840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:03.765 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.759+0000 7f6f7bb1e740 1 --2- 172.21.15.83:0/1455853156 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5605567f60a0 0x560556be7260 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:03.765 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.759+0000 7f6f567fc640 0 client.14961 ms_handle_reset on v2:172.21.15.119:6838/3106757092 2024-09-21T01:40:03.765 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.759+0000 7f6f7bb1e740 1 -- 172.21.15.83:0/1455853156 >> 172.21.15.83:0/1455853156 conn(0x560556813350 msgr2=0x560556bc2d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:40:03.765 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.759+0000 7f6f7bb1e740 1 -- 172.21.15.83:0/1455853156 shutdown_connections 2024-09-21T01:40:03.765 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.759+0000 7f6f7bb1e740 1 -- 172.21.15.83:0/1455853156 wait complete. 2024-09-21T01:40:03.765 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.759+0000 7f6f7bb1e740 20 client.14961 trim_cache size 0 max 16384 2024-09-21T01:40:03.766 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-09-21T01:40:03.766 INFO:teuthology.orchestra.run.smithi083.stdout: "cluster_fsid": "f7697ecc-77b8-11ef-baf5-efdc52797490", 2024-09-21T01:40:03.766 INFO:teuthology.orchestra.run.smithi083.stdout: "whoami": 0, 2024-09-21T01:40:03.766 INFO:teuthology.orchestra.run.smithi083.stdout: "id": 24653, 2024-09-21T01:40:03.766 INFO:teuthology.orchestra.run.smithi083.stdout: "want_state": "up:active", 2024-09-21T01:40:03.766 INFO:teuthology.orchestra.run.smithi083.stdout: "state": "up:active", 2024-09-21T01:40:03.766 INFO:teuthology.orchestra.run.smithi083.stdout: "fs_name": "cephfs", 2024-09-21T01:40:03.766 INFO:teuthology.orchestra.run.smithi083.stdout: "rank_uptime": 18.47988264, 2024-09-21T01:40:03.766 INFO:teuthology.orchestra.run.smithi083.stdout: "mdsmap_epoch": 17, 2024-09-21T01:40:03.766 INFO:teuthology.orchestra.run.smithi083.stdout: "osdmap_epoch": 80, 2024-09-21T01:40:03.766 INFO:teuthology.orchestra.run.smithi083.stdout: "osdmap_epoch_barrier": 80, 2024-09-21T01:40:03.766 INFO:teuthology.orchestra.run.smithi083.stdout: "uptime": 28.848949661999999 2024-09-21T01:40:03.766 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-09-21T01:40:03.767 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.760+0000 7f6f755aa640 1 -- 172.21.15.83:0/3864920994 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f6f5c0b6590 msgr2=0x7f6f5c0b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:40:03.767 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.760+0000 7f6f755aa640 1 --2- 172.21.15.83:0/3864920994 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f6f5c0b6590 0x7f6f5c0b8aa0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f6f600a9200 tx=0x7f6f600e70b0 comp rx=0 tx=0).stop 2024-09-21T01:40:03.767 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.760+0000 7f6f755aa640 1 -- 172.21.15.83:0/3864920994 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6f70108cf0 msgr2=0x7f6f7019fbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:40:03.767 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.760+0000 7f6f755aa640 1 --2- 172.21.15.83:0/3864920994 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6f70108cf0 0x7f6f7019fbd0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f6f6000d950 tx=0x7f6f6000de10 comp rx=0 tx=0).stop 2024-09-21T01:40:03.767 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.760+0000 7f6f755aa640 1 -- 172.21.15.83:0/3864920994 shutdown_connections 2024-09-21T01:40:03.767 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.760+0000 7f6f755aa640 1 --2- 172.21.15.83:0/3864920994 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f6f5c0b6590 0x7f6f5c0b8aa0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:03.767 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.760+0000 7f6f755aa640 1 --2- 172.21.15.83:0/3864920994 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6f70108cf0 0x7f6f7019fbd0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:03.768 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.760+0000 7f6f755aa640 1 --2- 172.21.15.83:0/3864920994 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6f701083a0 0x7f6f7019a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:03.768 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.760+0000 7f6f755aa640 1 --2- 172.21.15.83:0/3864920994 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f70102a60 0x7f6f7019a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:03.768 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.760+0000 7f6f755aa640 1 -- 172.21.15.83:0/3864920994 >> 172.21.15.83:0/3864920994 conn(0x7f6f70079730 msgr2=0x7f6f7006b2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:40:03.768 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.760+0000 7f6f755aa640 1 -- 172.21.15.83:0/3864920994 shutdown_connections 2024-09-21T01:40:03.768 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:03.760+0000 7f6f755aa640 1 -- 172.21.15.83:0/3864920994 wait complete. 2024-09-21T01:40:04.585 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-21T01:40:04.585 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-09-21T01:40:04.586 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph fs ls 2024-09-21T01:40:04.831 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:40:05.297 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:05.290+0000 7fd8d2f03640 1 -- 172.21.15.83:0/1027638884 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd8cc108d70 msgr2=0x7fd8cc10f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:40:05.298 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:05.290+0000 7fd8d2f03640 1 --2- 172.21.15.83:0/1027638884 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd8cc108d70 0x7fd8cc10f5a0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fd8c4009ca0 tx=0x7fd8c402a8c0 comp rx=0 tx=0).stop 2024-09-21T01:40:05.298 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:05.290+0000 7fd8d2f03640 1 -- 172.21.15.83:0/1027638884 shutdown_connections 2024-09-21T01:40:05.298 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:05.290+0000 7fd8d2f03640 1 --2- 172.21.15.83:0/1027638884 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd8cc108d70 0x7fd8cc10f5a0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:05.298 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:05.290+0000 7fd8d2f03640 1 --2- 172.21.15.83:0/1027638884 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd8cc108420 0x7fd8cc108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:05.298 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:05.290+0000 7fd8d2f03640 1 --2- 172.21.15.83:0/1027638884 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd8cc102ae0 0x7fd8cc102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:05.298 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:05.290+0000 7fd8d2f03640 1 -- 172.21.15.83:0/1027638884 >> 172.21.15.83:0/1027638884 conn(0x7fd8cc079770 msgr2=0x7fd8cc079b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:40:05.298 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:05.290+0000 7fd8d2f03640 1 -- 172.21.15.83:0/1027638884 shutdown_connections 2024-09-21T01:40:05.298 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:05.290+0000 7fd8d2f03640 1 -- 172.21.15.83:0/1027638884 wait complete. 2024-09-21T01:40:05.298 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:05.291+0000 7fd8d2f03640 1 Processor -- start 2024-09-21T01:40:05.298 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:05.291+0000 7fd8d2f03640 1 -- start start 2024-09-21T01:40:05.298 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:05.291+0000 7fd8d2f03640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd8cc102ae0 0x7fd8cc19a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:40:05.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:05.291+0000 7fd8d2f03640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd8cc108420 0x7fd8cc19a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:40:05.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:05.291+0000 7fd8d2f03640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd8cc108d70 0x7fd8cc19fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:40:05.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:05.291+0000 7fd8d2f03640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fd8cc112930 con 0x7fd8cc108420 2024-09-21T01:40:05.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:05.291+0000 7fd8d2f03640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fd8cc1127b0 con 0x7fd8cc108d70 2024-09-21T01:40:05.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:05.291+0000 7fd8d2f03640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fd8cc112ab0 con 0x7fd8cc102ae0 2024-09-21T01:40:05.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:05.291+0000 7fd8cbfff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd8cc108420 0x7fd8cc19a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:40:05.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:05.291+0000 7fd8cbfff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd8cc108420 0x7fd8cc19a970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:42668/0 (socket says 172.21.15.83:42668) 2024-09-21T01:40:05.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:05.291+0000 7fd8cbfff640 1 -- 172.21.15.83:0/2620939702 learned_addr learned my addr 172.21.15.83:0/2620939702 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:40:05.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:05.291+0000 7fd8d0c9f640 1 --2- 172.21.15.83:0/2620939702 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd8cc102ae0 0x7fd8cc19a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:40:05.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:05.291+0000 7fd8d14a0640 1 --2- 172.21.15.83:0/2620939702 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd8cc108d70 0x7fd8cc19fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:40:05.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:05.292+0000 7fd8cbfff640 1 -- 172.21.15.83:0/2620939702 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd8cc102ae0 msgr2=0x7fd8cc19a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:40:05.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:05.292+0000 7fd8cbfff640 1 --2- 172.21.15.83:0/2620939702 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd8cc102ae0 0x7fd8cc19a3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:05.299 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:05.292+0000 7fd8cbfff640 1 -- 172.21.15.83:0/2620939702 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd8cc108d70 msgr2=0x7fd8cc19fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:40:05.300 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:05.292+0000 7fd8cbfff640 1 --2- 172.21.15.83:0/2620939702 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd8cc108d70 0x7fd8cc19fc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:05.300 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:05.292+0000 7fd8cbfff640 1 -- 172.21.15.83:0/2620939702 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8cc1a0340 con 0x7fd8cc108420 2024-09-21T01:40:05.300 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:05.292+0000 7fd8d0c9f640 1 --2- 172.21.15.83:0/2620939702 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd8cc102ae0 0x7fd8cc19a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:40:05.300 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:05.292+0000 7fd8cbfff640 1 --2- 172.21.15.83:0/2620939702 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd8cc108420 0x7fd8cc19a970 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fd8c000e9f0 tx=0x7fd8c000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:40:05.300 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:05.292+0000 7fd8c9ffb640 1 -- 172.21.15.83:0/2620939702 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8c000ccc0 con 0x7fd8cc108420 2024-09-21T01:40:05.300 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:05.292+0000 7fd8c9ffb640 1 -- 172.21.15.83:0/2620939702 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd8c00108c0 con 0x7fd8cc108420 2024-09-21T01:40:05.300 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:05.292+0000 7fd8d2f03640 1 -- 172.21.15.83:0/2620939702 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8cc1a0630 con 0x7fd8cc108420 2024-09-21T01:40:05.300 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:05.292+0000 7fd8c9ffb640 1 -- 172.21.15.83:0/2620939702 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8c0018750 con 0x7fd8cc108420 2024-09-21T01:40:05.300 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:05.292+0000 7fd8d2f03640 1 -- 172.21.15.83:0/2620939702 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8cc1a6d90 con 0x7fd8cc108420 2024-09-21T01:40:05.300 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:05.293+0000 7fd8d2f03640 1 -- 172.21.15.83:0/2620939702 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8cc103d60 con 0x7fd8cc108420 2024-09-21T01:40:05.300 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:05.295+0000 7fd8c9ffb640 1 -- 172.21.15.83:0/2620939702 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 20) ==== 154529+0+0 (secure 0 0 0) 0x7fd8c0010430 con 0x7fd8cc108420 2024-09-21T01:40:05.300 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:05.296+0000 7fd8c9ffb640 1 --2- 172.21.15.83:0/2620939702 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fd8b40b6560 0x7fd8b40b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:40:05.300 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:05.296+0000 7fd8d0c9f640 1 --2- 172.21.15.83:0/2620939702 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fd8b40b6560 0x7fd8b40b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:40:05.300 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:05.296+0000 7fd8c9ffb640 1 -- 172.21.15.83:0/2620939702 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 9017+0+0 (secure 0 0 0) 0x7fd8c00e7fc0 con 0x7fd8cc108420 2024-09-21T01:40:05.301 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:05.296+0000 7fd8d0c9f640 1 --2- 172.21.15.83:0/2620939702 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fd8b40b6560 0x7fd8b40b8a70 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fd8bc009c20 tx=0x7fd8bc005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:40:05.301 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:05.299+0000 7fd8c9ffb640 1 -- 172.21.15.83:0/2620939702 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd8c00ae4e0 con 0x7fd8cc108420 2024-09-21T01:40:05.520 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:05.519+0000 7fd8d2f03640 1 -- 172.21.15.83:0/2620939702 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fd8cc10bbd0 con 0x7fd8cc108420 2024-09-21T01:40:05.521 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:05.519+0000 7fd8c9ffb640 1 -- 172.21.15.83:0/2620939702 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) ==== 53+0+88 (secure 0 0 0) 0x7fd8c00b28c0 con 0x7fd8cc108420 2024-09-21T01:40:05.521 INFO:teuthology.orchestra.run.smithi083.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-21T01:40:05.524 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:05.522+0000 7fd8d2f03640 1 -- 172.21.15.83:0/2620939702 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fd8b40b6560 msgr2=0x7fd8b40b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:40:05.524 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:05.522+0000 7fd8d2f03640 1 --2- 172.21.15.83:0/2620939702 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fd8b40b6560 0x7fd8b40b8a70 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fd8bc009c20 tx=0x7fd8bc005f90 comp rx=0 tx=0).stop 2024-09-21T01:40:05.524 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:05.522+0000 7fd8d2f03640 1 -- 172.21.15.83:0/2620939702 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd8cc108420 msgr2=0x7fd8cc19a970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:40:05.524 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:05.522+0000 7fd8d2f03640 1 --2- 172.21.15.83:0/2620939702 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd8cc108420 0x7fd8cc19a970 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fd8c000e9f0 tx=0x7fd8c000eeb0 comp rx=0 tx=0).stop 2024-09-21T01:40:05.524 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:05.522+0000 7fd8d2f03640 1 -- 172.21.15.83:0/2620939702 shutdown_connections 2024-09-21T01:40:05.524 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:05.522+0000 7fd8d2f03640 1 --2- 172.21.15.83:0/2620939702 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fd8b40b6560 0x7fd8b40b8a70 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:05.525 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:05.522+0000 7fd8d2f03640 1 --2- 172.21.15.83:0/2620939702 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd8cc108d70 0x7fd8cc19fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:05.525 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:05.522+0000 7fd8d2f03640 1 --2- 172.21.15.83:0/2620939702 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd8cc108420 0x7fd8cc19a970 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:05.525 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:05.522+0000 7fd8d2f03640 1 --2- 172.21.15.83:0/2620939702 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd8cc102ae0 0x7fd8cc19a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:05.525 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:05.522+0000 7fd8d2f03640 1 -- 172.21.15.83:0/2620939702 >> 172.21.15.83:0/2620939702 conn(0x7fd8cc079770 msgr2=0x7fd8cc101a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:40:05.525 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:05.522+0000 7fd8d2f03640 1 -- 172.21.15.83:0/2620939702 shutdown_connections 2024-09-21T01:40:05.525 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:05.522+0000 7fd8d2f03640 1 -- 172.21.15.83:0/2620939702 wait complete. 2024-09-21T01:40:06.067 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:40:05 smithi083 ceph-mon[31370]: pgmap v276: 129 pgs: 129 active+clean; 579 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:40:06.068 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:40:05 smithi083 ceph-mon[31370]: from='client.? 172.21.15.83:0/2620939702' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-09-21T01:40:06.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:40:05 smithi142 ceph-mon[34050]: pgmap v276: 129 pgs: 129 active+clean; 579 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:40:06.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:40:05 smithi142 ceph-mon[34050]: from='client.? 172.21.15.83:0/2620939702' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-09-21T01:40:06.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:40:05 smithi119 ceph-mon[33693]: pgmap v276: 129 pgs: 129 active+clean; 579 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:40:06.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:40:05 smithi119 ceph-mon[33693]: from='client.? 172.21.15.83:0/2620939702' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-09-21T01:40:06.315 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-21T01:40:06.315 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-21T01:40:06.315 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi083.front.sepia.ceph.com 2024-09-21T01:40:06.315 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-09-21T01:40:06.315 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-09-21T01:40:06.315 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-21T01:40:06.316 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-21T01:40:06.316 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-21T01:40:06.316 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-09-21T01:40:06.316 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T01:40:06.316 DEBUG:teuthology.orchestra.run.smithi083:> ip addr 2024-09-21T01:40:06.332 INFO:teuthology.orchestra.run.smithi083.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T01:40:06.333 INFO:teuthology.orchestra.run.smithi083.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T01:40:06.333 INFO:teuthology.orchestra.run.smithi083.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T01:40:06.333 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2024-09-21T01:40:06.333 INFO:teuthology.orchestra.run.smithi083.stdout: inet6 ::1/128 scope host 2024-09-21T01:40:06.333 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2024-09-21T01:40:06.333 INFO:teuthology.orchestra.run.smithi083.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T01:40:06.333 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether 0c:c4:7a:d8:da:1e brd ff:ff:ff:ff:ff:ff 2024-09-21T01:40:06.333 INFO:teuthology.orchestra.run.smithi083.stdout: altname enp7s0f0 2024-09-21T01:40:06.334 INFO:teuthology.orchestra.run.smithi083.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T01:40:06.334 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether 0c:c4:7a:d8:da:1f brd ff:ff:ff:ff:ff:ff 2024-09-21T01:40:06.334 INFO:teuthology.orchestra.run.smithi083.stdout: altname enp7s0f1 2024-09-21T01:40:06.334 INFO:teuthology.orchestra.run.smithi083.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T01:40:06.334 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether 0c:c4:7a:8f:ce:90 brd ff:ff:ff:ff:ff:ff 2024-09-21T01:40:06.334 INFO:teuthology.orchestra.run.smithi083.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-21T01:40:06.334 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether 0c:c4:7a:8f:ce:91 brd ff:ff:ff:ff:ff:ff 2024-09-21T01:40:06.334 INFO:teuthology.orchestra.run.smithi083.stdout: inet 172.21.15.83/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-21T01:40:06.334 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft 42220sec preferred_lft 42220sec 2024-09-21T01:40:06.334 INFO:teuthology.orchestra.run.smithi083.stdout: inet6 fe80::ec4:7aff:fe8f:ce91/64 scope link noprefixroute 2024-09-21T01:40:06.335 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2024-09-21T01:40:06.335 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-21T01:40:06.335 DEBUG:teuthology.orchestra.run.smithi083:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T01:40:06.335 DEBUG:teuthology.orchestra.run.smithi083:> set -e 2024-09-21T01:40:06.335 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip link add name ceph-brx type bridge 2024-09-21T01:40:06.335 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip addr flush dev ceph-brx 2024-09-21T01:40:06.336 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip link set ceph-brx up 2024-09-21T01:40:06.336 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-21T01:40:06.336 DEBUG:teuthology.orchestra.run.smithi083:> ') 2024-09-21T01:40:06.422 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:06 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T01:40:06.536 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T01:40:06.543 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T01:40:06.543 DEBUG:teuthology.orchestra.run.smithi083:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-21T01:40:06.569 INFO:teuthology.orchestra.run.smithi083.stdout:1 2024-09-21T01:40:06.570 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T01:40:06.570 DEBUG:teuthology.orchestra.run.smithi083:> route 2024-09-21T01:40:06.645 INFO:teuthology.orchestra.run.smithi083.stdout:Kernel IP routing table 2024-09-21T01:40:06.646 INFO:teuthology.orchestra.run.smithi083.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-21T01:40:06.646 INFO:teuthology.orchestra.run.smithi083.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-21T01:40:06.646 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-21T01:40:06.646 INFO:teuthology.orchestra.run.smithi083.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-21T01:40:06.646 DEBUG:teuthology.orchestra.run.smithi083:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T01:40:06.646 DEBUG:teuthology.orchestra.run.smithi083:> set -e 2024-09-21T01:40:06.647 DEBUG:teuthology.orchestra.run.smithi083:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-21T01:40:06.647 DEBUG:teuthology.orchestra.run.smithi083:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-21T01:40:06.647 DEBUG:teuthology.orchestra.run.smithi083:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-21T01:40:06.647 DEBUG:teuthology.orchestra.run.smithi083:> ') 2024-09-21T01:40:06.734 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:06 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T01:40:06.920 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T01:40:06.925 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T01:40:06.925 DEBUG:teuthology.orchestra.run.smithi083:> ip netns list 2024-09-21T01:40:06.941 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T01:40:06.941 DEBUG:teuthology.orchestra.run.smithi083:> ip netns list-id 2024-09-21T01:40:06.997 DEBUG:teuthology.orchestra.run.smithi083:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T01:40:06.997 DEBUG:teuthology.orchestra.run.smithi083:> set -e 2024-09-21T01:40:06.997 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-21T01:40:06.997 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-09-21T01:40:06.997 DEBUG:teuthology.orchestra.run.smithi083:> ') 2024-09-21T01:40:07.085 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:07 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T01:40:07.109 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T01:40:07.115 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-09-21T01:40:07.115 DEBUG:teuthology.orchestra.run.smithi083:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T01:40:07.115 DEBUG:teuthology.orchestra.run.smithi083:> set -e 2024-09-21T01:40:07.115 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-09-21T01:40:07.115 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-21T01:40:07.115 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-09-21T01:40:07.116 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-09-21T01:40:07.116 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-09-21T01:40:07.116 DEBUG:teuthology.orchestra.run.smithi083:> ') 2024-09-21T01:40:07.163 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:07 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T01:40:07.244 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T01:40:07.250 DEBUG:teuthology.orchestra.run.smithi083:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T01:40:07.250 DEBUG:teuthology.orchestra.run.smithi083:> set -e 2024-09-21T01:40:07.250 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip link set brx.0 up 2024-09-21T01:40:07.251 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip link set dev brx.0 master ceph-brx 2024-09-21T01:40:07.251 DEBUG:teuthology.orchestra.run.smithi083:> ') 2024-09-21T01:40:07.298 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:07 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T01:40:07.320 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T01:40:07.326 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-09-21T01:40:07.326 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T01:40:07.327 DEBUG:teuthology.orchestra.run.smithi083:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-09-21T01:40:07.342 INFO:teuthology.orchestra.run.smithi083.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-09-21T01:40:07.343 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T01:40:07.343 DEBUG:teuthology.orchestra.run.smithi083:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-09-21T01:40:07.398 DEBUG:teuthology.orchestra.run.smithi083:> sudo modprobe fuse 2024-09-21T01:40:07.464 DEBUG:teuthology.orchestra.run.smithi083:> cat /proc/self/mounts | awk '{print $2}' 2024-09-21T01:40:07.521 INFO:teuthology.orchestra.run.smithi083.stdout:/proc 2024-09-21T01:40:07.521 INFO:teuthology.orchestra.run.smithi083.stdout:/sys 2024-09-21T01:40:07.521 INFO:teuthology.orchestra.run.smithi083.stdout:/dev 2024-09-21T01:40:07.521 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/kernel/security 2024-09-21T01:40:07.521 INFO:teuthology.orchestra.run.smithi083.stdout:/dev/shm 2024-09-21T01:40:07.521 INFO:teuthology.orchestra.run.smithi083.stdout:/dev/pts 2024-09-21T01:40:07.521 INFO:teuthology.orchestra.run.smithi083.stdout:/run 2024-09-21T01:40:07.521 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/fs/cgroup 2024-09-21T01:40:07.521 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/fs/pstore 2024-09-21T01:40:07.521 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/fs/bpf 2024-09-21T01:40:07.521 INFO:teuthology.orchestra.run.smithi083.stdout:/ 2024-09-21T01:40:07.521 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/fs/selinux 2024-09-21T01:40:07.521 INFO:teuthology.orchestra.run.smithi083.stdout:/proc/sys/fs/binfmt_misc 2024-09-21T01:40:07.522 INFO:teuthology.orchestra.run.smithi083.stdout:/dev/mqueue 2024-09-21T01:40:07.522 INFO:teuthology.orchestra.run.smithi083.stdout:/dev/hugepages 2024-09-21T01:40:07.522 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/kernel/debug 2024-09-21T01:40:07.522 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/kernel/tracing 2024-09-21T01:40:07.522 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/fs/fuse/connections 2024-09-21T01:40:07.522 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/kernel/config 2024-09-21T01:40:07.522 INFO:teuthology.orchestra.run.smithi083.stdout:/run/credentials/systemd-sysctl.service 2024-09-21T01:40:07.522 INFO:teuthology.orchestra.run.smithi083.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-21T01:40:07.522 INFO:teuthology.orchestra.run.smithi083.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-21T01:40:07.522 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/nfs/rpc_pipefs 2024-09-21T01:40:07.522 INFO:teuthology.orchestra.run.smithi083.stdout:/run/user/1000 2024-09-21T01:40:07.522 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/ceph 2024-09-21T01:40:07.522 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/containers/storage/overlay 2024-09-21T01:40:07.523 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/containers/storage/overlay/8610c479554a68b60b556116ff6e514cdcd9befb70b0d2f3fbdef64d877d75a6/merged 2024-09-21T01:40:07.523 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/containers/storage/overlay/8fc1cebdde878a0da97639d6f35e2c82c46a02343fe7fddd910eee6dc545dbb7/merged 2024-09-21T01:40:07.523 INFO:teuthology.orchestra.run.smithi083.stdout:/run/user/0 2024-09-21T01:40:07.523 INFO:teuthology.orchestra.run.smithi083.stdout:/proc/sys/fs/binfmt_misc 2024-09-21T01:40:07.523 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/containers/storage/overlay/ad76de55564a12f7320a1fa3d68c79ab34a03d565911f777dafcdf10802e7c98/merged 2024-09-21T01:40:07.523 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/containers/storage/overlay/61137218722e21b10cdd26ad45c2efaf869dbdc95d756215c1b84c5bd14f33ac/merged 2024-09-21T01:40:07.523 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/containers/storage/overlay/64d8ca591d18f7fb8b99ae527f80494dcdceee6b86d596b554628a7b397c178b/merged 2024-09-21T01:40:07.523 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/containers/storage/overlay/b096af93d38803bd9e9ef8a24487e7dd393dbe2c34e64ea016823a8e5680e8b2/merged 2024-09-21T01:40:07.523 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/containers/storage/overlay/375d681aa48b1b0f6680477c67fefecf44779154c19359c89efed73b1a57b3c5/merged 2024-09-21T01:40:07.523 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/containers/storage/overlay/a3615517be2fee75ab7f67a8ad7bea0c7d3c81bc139d09f61dd63e684ccfc8a8/merged 2024-09-21T01:40:07.523 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/containers/storage/overlay/800e803861b074a9b64b91d871dcc1e65568a0e413b178b45a454410ab3ac552/merged 2024-09-21T01:40:07.523 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/containers/storage/overlay/f76304c49431914cf0f8d96992df204d511c35206b8a030fff223f7c2dc5bf9f/merged 2024-09-21T01:40:07.523 INFO:teuthology.orchestra.run.smithi083.stdout:/run/netns 2024-09-21T01:40:07.523 INFO:teuthology.orchestra.run.smithi083.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-21T01:40:07.524 INFO:teuthology.orchestra.run.smithi083.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-21T01:40:07.524 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T01:40:07.524 DEBUG:teuthology.orchestra.run.smithi083:> ls /sys/fs/fuse/connections 2024-09-21T01:40:07.576 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-21T01:40:07.576 DEBUG:teuthology.orchestra.run.smithi083:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-09-21T01:40:07.619 DEBUG:teuthology.orchestra.run.smithi083:> sudo modprobe fuse 2024-09-21T01:40:07.645 DEBUG:teuthology.orchestra.run.smithi083:> cat /proc/self/mounts | awk '{print $2}' 2024-09-21T01:40:07.702 INFO:teuthology.orchestra.run.smithi083.stdout:/proc 2024-09-21T01:40:07.702 INFO:teuthology.orchestra.run.smithi083.stdout:/sys 2024-09-21T01:40:07.702 INFO:teuthology.orchestra.run.smithi083.stdout:/dev 2024-09-21T01:40:07.702 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/kernel/security 2024-09-21T01:40:07.702 INFO:teuthology.orchestra.run.smithi083.stdout:/dev/shm 2024-09-21T01:40:07.702 INFO:teuthology.orchestra.run.smithi083.stdout:/dev/pts 2024-09-21T01:40:07.702 INFO:teuthology.orchestra.run.smithi083.stdout:/run 2024-09-21T01:40:07.703 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/fs/cgroup 2024-09-21T01:40:07.703 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/fs/pstore 2024-09-21T01:40:07.703 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/fs/bpf 2024-09-21T01:40:07.703 INFO:teuthology.orchestra.run.smithi083.stdout:/ 2024-09-21T01:40:07.703 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/fs/selinux 2024-09-21T01:40:07.703 INFO:teuthology.orchestra.run.smithi083.stdout:/proc/sys/fs/binfmt_misc 2024-09-21T01:40:07.703 INFO:teuthology.orchestra.run.smithi083.stdout:/dev/mqueue 2024-09-21T01:40:07.703 INFO:teuthology.orchestra.run.smithi083.stdout:/dev/hugepages 2024-09-21T01:40:07.703 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/kernel/debug 2024-09-21T01:40:07.703 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/kernel/tracing 2024-09-21T01:40:07.703 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/fs/fuse/connections 2024-09-21T01:40:07.703 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/kernel/config 2024-09-21T01:40:07.703 INFO:teuthology.orchestra.run.smithi083.stdout:/run/credentials/systemd-sysctl.service 2024-09-21T01:40:07.703 INFO:teuthology.orchestra.run.smithi083.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-21T01:40:07.704 INFO:teuthology.orchestra.run.smithi083.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-21T01:40:07.704 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/nfs/rpc_pipefs 2024-09-21T01:40:07.704 INFO:teuthology.orchestra.run.smithi083.stdout:/run/user/1000 2024-09-21T01:40:07.704 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/ceph 2024-09-21T01:40:07.704 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/containers/storage/overlay 2024-09-21T01:40:07.704 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/containers/storage/overlay/8610c479554a68b60b556116ff6e514cdcd9befb70b0d2f3fbdef64d877d75a6/merged 2024-09-21T01:40:07.704 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/containers/storage/overlay/8fc1cebdde878a0da97639d6f35e2c82c46a02343fe7fddd910eee6dc545dbb7/merged 2024-09-21T01:40:07.704 INFO:teuthology.orchestra.run.smithi083.stdout:/run/user/0 2024-09-21T01:40:07.704 INFO:teuthology.orchestra.run.smithi083.stdout:/proc/sys/fs/binfmt_misc 2024-09-21T01:40:07.704 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/containers/storage/overlay/ad76de55564a12f7320a1fa3d68c79ab34a03d565911f777dafcdf10802e7c98/merged 2024-09-21T01:40:07.704 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/containers/storage/overlay/61137218722e21b10cdd26ad45c2efaf869dbdc95d756215c1b84c5bd14f33ac/merged 2024-09-21T01:40:07.704 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/containers/storage/overlay/64d8ca591d18f7fb8b99ae527f80494dcdceee6b86d596b554628a7b397c178b/merged 2024-09-21T01:40:07.704 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/containers/storage/overlay/b096af93d38803bd9e9ef8a24487e7dd393dbe2c34e64ea016823a8e5680e8b2/merged 2024-09-21T01:40:07.704 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/containers/storage/overlay/375d681aa48b1b0f6680477c67fefecf44779154c19359c89efed73b1a57b3c5/merged 2024-09-21T01:40:07.705 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/containers/storage/overlay/a3615517be2fee75ab7f67a8ad7bea0c7d3c81bc139d09f61dd63e684ccfc8a8/merged 2024-09-21T01:40:07.705 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/containers/storage/overlay/800e803861b074a9b64b91d871dcc1e65568a0e413b178b45a454410ab3ac552/merged 2024-09-21T01:40:07.705 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/containers/storage/overlay/f76304c49431914cf0f8d96992df204d511c35206b8a030fff223f7c2dc5bf9f/merged 2024-09-21T01:40:07.705 INFO:teuthology.orchestra.run.smithi083.stdout:/run/netns 2024-09-21T01:40:07.705 INFO:teuthology.orchestra.run.smithi083.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-21T01:40:07.705 INFO:teuthology.orchestra.run.smithi083.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-21T01:40:07.705 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T01:40:07.705 DEBUG:teuthology.orchestra.run.smithi083:> ls /sys/fs/fuse/connections 2024-09-21T01:40:07.759 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi083.stderr:2024-09-21T01:40:07.758+0000 7ff9cf188480 -1 init, newargv = 0x7ff9b4004ba0 newargc=15 2024-09-21T01:40:07.759 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi083.stderr:ceph-fuse[77209]: starting ceph client 2024-09-21T01:40:07.766 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi083.stderr:ceph-fuse[77209]: starting fuse 2024-09-21T01:40:08.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:40:07 smithi142 ceph-mon[34050]: pgmap v277: 129 pgs: 129 active+clean; 579 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:40:08.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:40:07 smithi119 ceph-mon[33693]: pgmap v277: 129 pgs: 129 active+clean; 579 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:40:08.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:40:07 smithi083 ceph-mon[31370]: pgmap v277: 129 pgs: 129 active+clean; 579 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:40:08.860 DEBUG:teuthology.orchestra.run.smithi083:> sudo modprobe fuse 2024-09-21T01:40:08.889 DEBUG:teuthology.orchestra.run.smithi083:> cat /proc/self/mounts | awk '{print $2}' 2024-09-21T01:40:08.946 INFO:teuthology.orchestra.run.smithi083.stdout:/proc 2024-09-21T01:40:08.947 INFO:teuthology.orchestra.run.smithi083.stdout:/sys 2024-09-21T01:40:08.947 INFO:teuthology.orchestra.run.smithi083.stdout:/dev 2024-09-21T01:40:08.947 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/kernel/security 2024-09-21T01:40:08.947 INFO:teuthology.orchestra.run.smithi083.stdout:/dev/shm 2024-09-21T01:40:08.947 INFO:teuthology.orchestra.run.smithi083.stdout:/dev/pts 2024-09-21T01:40:08.947 INFO:teuthology.orchestra.run.smithi083.stdout:/run 2024-09-21T01:40:08.947 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/fs/cgroup 2024-09-21T01:40:08.947 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/fs/pstore 2024-09-21T01:40:08.947 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/fs/bpf 2024-09-21T01:40:08.947 INFO:teuthology.orchestra.run.smithi083.stdout:/ 2024-09-21T01:40:08.947 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/fs/selinux 2024-09-21T01:40:08.947 INFO:teuthology.orchestra.run.smithi083.stdout:/proc/sys/fs/binfmt_misc 2024-09-21T01:40:08.948 INFO:teuthology.orchestra.run.smithi083.stdout:/dev/mqueue 2024-09-21T01:40:08.948 INFO:teuthology.orchestra.run.smithi083.stdout:/dev/hugepages 2024-09-21T01:40:08.948 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/kernel/debug 2024-09-21T01:40:08.948 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/kernel/tracing 2024-09-21T01:40:08.948 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/fs/fuse/connections 2024-09-21T01:40:08.948 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/kernel/config 2024-09-21T01:40:08.948 INFO:teuthology.orchestra.run.smithi083.stdout:/run/credentials/systemd-sysctl.service 2024-09-21T01:40:08.948 INFO:teuthology.orchestra.run.smithi083.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-21T01:40:08.948 INFO:teuthology.orchestra.run.smithi083.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-21T01:40:08.948 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/nfs/rpc_pipefs 2024-09-21T01:40:08.948 INFO:teuthology.orchestra.run.smithi083.stdout:/run/user/1000 2024-09-21T01:40:08.948 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/ceph 2024-09-21T01:40:08.948 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/containers/storage/overlay 2024-09-21T01:40:08.948 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/containers/storage/overlay/8610c479554a68b60b556116ff6e514cdcd9befb70b0d2f3fbdef64d877d75a6/merged 2024-09-21T01:40:08.948 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/containers/storage/overlay/8fc1cebdde878a0da97639d6f35e2c82c46a02343fe7fddd910eee6dc545dbb7/merged 2024-09-21T01:40:08.948 INFO:teuthology.orchestra.run.smithi083.stdout:/run/user/0 2024-09-21T01:40:08.948 INFO:teuthology.orchestra.run.smithi083.stdout:/proc/sys/fs/binfmt_misc 2024-09-21T01:40:08.949 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/containers/storage/overlay/ad76de55564a12f7320a1fa3d68c79ab34a03d565911f777dafcdf10802e7c98/merged 2024-09-21T01:40:08.949 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/containers/storage/overlay/61137218722e21b10cdd26ad45c2efaf869dbdc95d756215c1b84c5bd14f33ac/merged 2024-09-21T01:40:08.949 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/containers/storage/overlay/64d8ca591d18f7fb8b99ae527f80494dcdceee6b86d596b554628a7b397c178b/merged 2024-09-21T01:40:08.949 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/containers/storage/overlay/b096af93d38803bd9e9ef8a24487e7dd393dbe2c34e64ea016823a8e5680e8b2/merged 2024-09-21T01:40:08.949 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/containers/storage/overlay/375d681aa48b1b0f6680477c67fefecf44779154c19359c89efed73b1a57b3c5/merged 2024-09-21T01:40:08.949 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/containers/storage/overlay/a3615517be2fee75ab7f67a8ad7bea0c7d3c81bc139d09f61dd63e684ccfc8a8/merged 2024-09-21T01:40:08.949 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/containers/storage/overlay/800e803861b074a9b64b91d871dcc1e65568a0e413b178b45a454410ab3ac552/merged 2024-09-21T01:40:08.949 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/containers/storage/overlay/f76304c49431914cf0f8d96992df204d511c35206b8a030fff223f7c2dc5bf9f/merged 2024-09-21T01:40:08.949 INFO:teuthology.orchestra.run.smithi083.stdout:/run/netns 2024-09-21T01:40:08.949 INFO:teuthology.orchestra.run.smithi083.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-21T01:40:08.949 INFO:teuthology.orchestra.run.smithi083.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-21T01:40:08.949 INFO:teuthology.orchestra.run.smithi083.stdout:/home/ubuntu/cephtest/mnt.admin 2024-09-21T01:40:08.949 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T01:40:08.950 DEBUG:teuthology.orchestra.run.smithi083:> ls /sys/fs/fuse/connections 2024-09-21T01:40:09.003 INFO:teuthology.orchestra.run.smithi083.stdout:120 2024-09-21T01:40:09.003 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [120] 2024-09-21T01:40:09.003 DEBUG:teuthology.orchestra.run.smithi083:> sudo stdin-killer -- python3 -c ' 2024-09-21T01:40:09.004 DEBUG:teuthology.orchestra.run.smithi083:> import glob 2024-09-21T01:40:09.004 DEBUG:teuthology.orchestra.run.smithi083:> import re 2024-09-21T01:40:09.004 DEBUG:teuthology.orchestra.run.smithi083:> import os 2024-09-21T01:40:09.004 DEBUG:teuthology.orchestra.run.smithi083:> import subprocess 2024-09-21T01:40:09.004 DEBUG:teuthology.orchestra.run.smithi083:> 2024-09-21T01:40:09.004 DEBUG:teuthology.orchestra.run.smithi083:> def _find_admin_socket(client_name): 2024-09-21T01:40:09.004 DEBUG:teuthology.orchestra.run.smithi083:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-09-21T01:40:09.004 DEBUG:teuthology.orchestra.run.smithi083:> files = glob.glob(asok_path) 2024-09-21T01:40:09.004 DEBUG:teuthology.orchestra.run.smithi083:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-09-21T01:40:09.004 DEBUG:teuthology.orchestra.run.smithi083:> 2024-09-21T01:40:09.004 DEBUG:teuthology.orchestra.run.smithi083:> # Given a non-glob path, it better be there 2024-09-21T01:40:09.004 DEBUG:teuthology.orchestra.run.smithi083:> if "*" not in asok_path: 2024-09-21T01:40:09.004 DEBUG:teuthology.orchestra.run.smithi083:> assert(len(files) == 1) 2024-09-21T01:40:09.004 DEBUG:teuthology.orchestra.run.smithi083:> return files[0] 2024-09-21T01:40:09.004 DEBUG:teuthology.orchestra.run.smithi083:> 2024-09-21T01:40:09.004 DEBUG:teuthology.orchestra.run.smithi083:> for f in files: 2024-09-21T01:40:09.004 DEBUG:teuthology.orchestra.run.smithi083:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-21T01:40:09.005 DEBUG:teuthology.orchestra.run.smithi083:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-21T01:40:09.005 DEBUG:teuthology.orchestra.run.smithi083:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-21T01:40:09.005 DEBUG:teuthology.orchestra.run.smithi083:> contents = proc_f.read() 2024-09-21T01:40:09.005 DEBUG:teuthology.orchestra.run.smithi083:> if mountpoint in contents: 2024-09-21T01:40:09.005 DEBUG:teuthology.orchestra.run.smithi083:> return f 2024-09-21T01:40:09.005 DEBUG:teuthology.orchestra.run.smithi083:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-21T01:40:09.005 DEBUG:teuthology.orchestra.run.smithi083:> 2024-09-21T01:40:09.005 DEBUG:teuthology.orchestra.run.smithi083:> print(_find_admin_socket("client.admin")) 2024-09-21T01:40:09.005 DEBUG:teuthology.orchestra.run.smithi083:> ' 2024-09-21T01:40:09.066 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:40:08 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]} : dispatch 2024-09-21T01:40:09.067 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:40:08 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [8, 11]} : dispatch 2024-09-21T01:40:09.067 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:40:08 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]} : dispatch 2024-09-21T01:40:09.067 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:40:08 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 8, 5, 9]} : dispatch 2024-09-21T01:40:09.067 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:40:08 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [4, 6]} : dispatch 2024-09-21T01:40:09.067 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:40:08 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.3", "id": [5, 8]} : dispatch 2024-09-21T01:40:09.067 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:40:08 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [9, 8]} : dispatch 2024-09-21T01:40:09.067 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:40:08 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [9, 10]} : dispatch 2024-09-21T01:40:09.067 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:40:08 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [9, 8]} : dispatch 2024-09-21T01:40:09.121 INFO:teuthology.orchestra.run.smithi083.stdout:/var/run/ceph/ceph-client.admin.77209.asok 2024-09-21T01:40:09.124 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T01:40:09.131 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.77209.asok 2024-09-21T01:40:09.132 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T01:40:09.132 DEBUG:teuthology.orchestra.run.smithi083:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.77209.asok status 2024-09-21T01:40:09.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:40:08 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]} : dispatch 2024-09-21T01:40:09.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:40:08 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [8, 11]} : dispatch 2024-09-21T01:40:09.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:40:08 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]} : dispatch 2024-09-21T01:40:09.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:40:08 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 8, 5, 9]} : dispatch 2024-09-21T01:40:09.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:40:08 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [4, 6]} : dispatch 2024-09-21T01:40:09.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:40:08 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.3", "id": [5, 8]} : dispatch 2024-09-21T01:40:09.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:40:08 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [9, 8]} : dispatch 2024-09-21T01:40:09.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:40:08 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [9, 10]} : dispatch 2024-09-21T01:40:09.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:40:08 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [9, 8]} : dispatch 2024-09-21T01:40:09.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:40:08 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]} : dispatch 2024-09-21T01:40:09.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:40:08 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [8, 11]} : dispatch 2024-09-21T01:40:09.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:40:08 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]} : dispatch 2024-09-21T01:40:09.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:40:08 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 8, 5, 9]} : dispatch 2024-09-21T01:40:09.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:40:08 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [4, 6]} : dispatch 2024-09-21T01:40:09.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:40:08 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.3", "id": [5, 8]} : dispatch 2024-09-21T01:40:09.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:40:08 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [9, 8]} : dispatch 2024-09-21T01:40:09.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:40:08 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [9, 10]} : dispatch 2024-09-21T01:40:09.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:40:08 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [9, 8]} : dispatch 2024-09-21T01:40:09.275 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-09-21T01:40:09.275 INFO:teuthology.orchestra.run.smithi083.stdout: "metadata": { 2024-09-21T01:40:09.275 INFO:teuthology.orchestra.run.smithi083.stdout: "ceph_sha1": "1843221895adccfb3b692060251dd6a0183bc410", 2024-09-21T01:40:09.275 INFO:teuthology.orchestra.run.smithi083.stdout: "ceph_version": "ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev)", 2024-09-21T01:40:09.275 INFO:teuthology.orchestra.run.smithi083.stdout: "entity_id": "admin", 2024-09-21T01:40:09.275 INFO:teuthology.orchestra.run.smithi083.stdout: "hostname": "smithi083", 2024-09-21T01:40:09.275 INFO:teuthology.orchestra.run.smithi083.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-09-21T01:40:09.275 INFO:teuthology.orchestra.run.smithi083.stdout: "pid": "77209", 2024-09-21T01:40:09.276 INFO:teuthology.orchestra.run.smithi083.stdout: "root": "/" 2024-09-21T01:40:09.276 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:40:09.276 INFO:teuthology.orchestra.run.smithi083.stdout: "dentry_count": 0, 2024-09-21T01:40:09.276 INFO:teuthology.orchestra.run.smithi083.stdout: "dentry_pinned_count": 0, 2024-09-21T01:40:09.276 INFO:teuthology.orchestra.run.smithi083.stdout: "id": 14973, 2024-09-21T01:40:09.276 INFO:teuthology.orchestra.run.smithi083.stdout: "inst": { 2024-09-21T01:40:09.276 INFO:teuthology.orchestra.run.smithi083.stdout: "name": { 2024-09-21T01:40:09.276 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "client", 2024-09-21T01:40:09.276 INFO:teuthology.orchestra.run.smithi083.stdout: "num": 14973 2024-09-21T01:40:09.276 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:40:09.276 INFO:teuthology.orchestra.run.smithi083.stdout: "addr": { 2024-09-21T01:40:09.276 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "v1", 2024-09-21T01:40:09.276 INFO:teuthology.orchestra.run.smithi083.stdout: "addr": "192.168.0.1:0", 2024-09-21T01:40:09.276 INFO:teuthology.orchestra.run.smithi083.stdout: "nonce": 339422327 2024-09-21T01:40:09.277 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:40:09.277 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:40:09.277 INFO:teuthology.orchestra.run.smithi083.stdout: "addr": { 2024-09-21T01:40:09.277 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "v1", 2024-09-21T01:40:09.277 INFO:teuthology.orchestra.run.smithi083.stdout: "addr": "192.168.0.1:0", 2024-09-21T01:40:09.277 INFO:teuthology.orchestra.run.smithi083.stdout: "nonce": 339422327 2024-09-21T01:40:09.277 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:40:09.277 INFO:teuthology.orchestra.run.smithi083.stdout: "inst_str": "client.14973 192.168.0.1:0/339422327", 2024-09-21T01:40:09.277 INFO:teuthology.orchestra.run.smithi083.stdout: "addr_str": "192.168.0.1:0/339422327", 2024-09-21T01:40:09.277 INFO:teuthology.orchestra.run.smithi083.stdout: "inode_count": 1, 2024-09-21T01:40:09.277 INFO:teuthology.orchestra.run.smithi083.stdout: "mds_epoch": 17, 2024-09-21T01:40:09.277 INFO:teuthology.orchestra.run.smithi083.stdout: "osd_epoch": 80, 2024-09-21T01:40:09.277 INFO:teuthology.orchestra.run.smithi083.stdout: "osd_epoch_barrier": 0, 2024-09-21T01:40:09.277 INFO:teuthology.orchestra.run.smithi083.stdout: "blocklisted": false, 2024-09-21T01:40:09.277 INFO:teuthology.orchestra.run.smithi083.stdout: "fs_name": "cephfs" 2024-09-21T01:40:09.278 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-09-21T01:40:09.284 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T01:40:09.284 DEBUG:teuthology.orchestra.run.smithi083:> stat --file-system '--printf=%T 2024-09-21T01:40:09.284 DEBUG:teuthology.orchestra.run.smithi083:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-09-21T01:40:09.300 INFO:teuthology.orchestra.run.smithi083.stdout:fuseblk 2024-09-21T01:40:09.300 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-09-21T01:40:09.301 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T01:40:09.301 DEBUG:teuthology.orchestra.run.smithi083:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-09-21T01:40:09.366 DEBUG:teuthology.orchestra.run.smithi083:> (cd /home/ubuntu/cephtest/mnt.admin && exec stdin-killer --timeout=900 -- bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-09-21T01:40:09.457 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:09 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T01:40:09.476 INFO:teuthology.orchestra.run.smithi083.stdout:# file: . 2024-09-21T01:40:09.476 INFO:teuthology.orchestra.run.smithi083.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-09-21T01:40:09.476 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T01:40:09.477 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T01:40:09.482 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-09-21T01:40:09.482 DEBUG:teuthology.orchestra.run.smithi083:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T01:40:09.500 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph osd blocklist ls 2024-09-21T01:40:09.788 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:40:10.098 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:40:09 smithi083 ceph-mon[31370]: pgmap v278: 129 pgs: 129 active+clean; 579 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:40:10.099 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:40:09 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]}]': finished 2024-09-21T01:40:10.099 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:40:09 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [8, 11]}]': finished 2024-09-21T01:40:10.099 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:40:09 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]}]': finished 2024-09-21T01:40:10.099 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:40:09 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 8, 5, 9]}]': finished 2024-09-21T01:40:10.099 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:40:09 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [4, 6]}]': finished 2024-09-21T01:40:10.099 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:40:09 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.3", "id": [5, 8]}]': finished 2024-09-21T01:40:10.099 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:40:09 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [9, 8]}]': finished 2024-09-21T01:40:10.099 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:40:09 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [9, 10]}]': finished 2024-09-21T01:40:10.099 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:40:09 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [9, 8]}]': finished 2024-09-21T01:40:10.099 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:40:09 smithi083 ceph-mon[31370]: osdmap e81: 12 total, 12 up, 12 in 2024-09-21T01:40:10.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:40:09 smithi142 ceph-mon[34050]: pgmap v278: 129 pgs: 129 active+clean; 579 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:40:10.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:40:09 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]}]': finished 2024-09-21T01:40:10.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:40:09 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [8, 11]}]': finished 2024-09-21T01:40:10.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:40:09 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]}]': finished 2024-09-21T01:40:10.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:40:09 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 8, 5, 9]}]': finished 2024-09-21T01:40:10.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:40:09 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [4, 6]}]': finished 2024-09-21T01:40:10.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:40:09 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.3", "id": [5, 8]}]': finished 2024-09-21T01:40:10.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:40:09 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [9, 8]}]': finished 2024-09-21T01:40:10.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:40:09 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [9, 10]}]': finished 2024-09-21T01:40:10.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:40:09 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [9, 8]}]': finished 2024-09-21T01:40:10.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:40:09 smithi142 ceph-mon[34050]: osdmap e81: 12 total, 12 up, 12 in 2024-09-21T01:40:10.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:40:09 smithi119 ceph-mon[33693]: pgmap v278: 129 pgs: 129 active+clean; 579 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:40:10.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:40:09 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]}]': finished 2024-09-21T01:40:10.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:40:09 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [8, 11]}]': finished 2024-09-21T01:40:10.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:40:09 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]}]': finished 2024-09-21T01:40:10.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:40:09 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 8, 5, 9]}]': finished 2024-09-21T01:40:10.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:40:09 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [4, 6]}]': finished 2024-09-21T01:40:10.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:40:09 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.3", "id": [5, 8]}]': finished 2024-09-21T01:40:10.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:40:09 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [9, 8]}]': finished 2024-09-21T01:40:10.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:40:09 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [9, 10]}]': finished 2024-09-21T01:40:10.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:40:09 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [9, 8]}]': finished 2024-09-21T01:40:10.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:40:09 smithi119 ceph-mon[33693]: osdmap e81: 12 total, 12 up, 12 in 2024-09-21T01:40:10.302 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:10.301+0000 7fe6419c8640 1 -- 172.21.15.83:0/2364822703 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe63c1049b0 msgr2=0x7fe63c104dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:40:10.302 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:10.301+0000 7fe6419c8640 1 --2- 172.21.15.83:0/2364822703 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe63c1049b0 0x7fe63c104dc0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fe62c009ca0 tx=0x7fe62c02a8c0 comp rx=0 tx=0).stop 2024-09-21T01:40:10.302 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:10.301+0000 7fe6419c8640 1 -- 172.21.15.83:0/2364822703 shutdown_connections 2024-09-21T01:40:10.302 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:10.301+0000 7fe6419c8640 1 --2- 172.21.15.83:0/2364822703 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe63c10de10 0x7fe63c110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:10.302 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:10.301+0000 7fe6419c8640 1 --2- 172.21.15.83:0/2364822703 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe63c105300 0x7fe63c10d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:10.302 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:10.301+0000 7fe6419c8640 1 --2- 172.21.15.83:0/2364822703 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe63c1049b0 0x7fe63c104dc0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:10.302 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:10.301+0000 7fe6419c8640 1 -- 172.21.15.83:0/2364822703 >> 172.21.15.83:0/2364822703 conn(0x7fe63c079730 msgr2=0x7fe63c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:40:10.303 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:10.301+0000 7fe6419c8640 1 -- 172.21.15.83:0/2364822703 shutdown_connections 2024-09-21T01:40:10.303 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:10.301+0000 7fe6419c8640 1 -- 172.21.15.83:0/2364822703 wait complete. 2024-09-21T01:40:10.303 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:10.302+0000 7fe6419c8640 1 Processor -- start 2024-09-21T01:40:10.304 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:10.302+0000 7fe6419c8640 1 -- start start 2024-09-21T01:40:10.304 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:10.302+0000 7fe6419c8640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe63c1049b0 0x7fe63c19a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:40:10.304 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:10.302+0000 7fe6419c8640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe63c105300 0x7fe63c19a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:40:10.305 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:10.302+0000 7fe6419c8640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe63c10de10 0x7fe63c19fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:40:10.305 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:10.302+0000 7fe6419c8640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fe63c113990 con 0x7fe63c105300 2024-09-21T01:40:10.305 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:10.302+0000 7fe6419c8640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fe63c113810 con 0x7fe63c10de10 2024-09-21T01:40:10.305 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:10.302+0000 7fe6419c8640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fe63c113b10 con 0x7fe63c1049b0 2024-09-21T01:40:10.305 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:10.302+0000 7fe63a7fc640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe63c105300 0x7fe63c19a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:40:10.305 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:10.303+0000 7fe63a7fc640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe63c105300 0x7fe63c19a9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:42690/0 (socket says 172.21.15.83:42690) 2024-09-21T01:40:10.305 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:10.303+0000 7fe63a7fc640 1 -- 172.21.15.83:0/263680558 learned_addr learned my addr 172.21.15.83:0/263680558 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:40:10.305 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:10.303+0000 7fe63b7fe640 1 --2- 172.21.15.83:0/263680558 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe63c10de10 0x7fe63c19fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:40:10.305 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:10.303+0000 7fe63affd640 1 --2- 172.21.15.83:0/263680558 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe63c1049b0 0x7fe63c19a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:40:10.305 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:10.303+0000 7fe63a7fc640 1 -- 172.21.15.83:0/263680558 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe63c1049b0 msgr2=0x7fe63c19a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:40:10.305 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:10.303+0000 7fe63a7fc640 1 --2- 172.21.15.83:0/263680558 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe63c1049b0 0x7fe63c19a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:10.305 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:10.303+0000 7fe63a7fc640 1 -- 172.21.15.83:0/263680558 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe63c10de10 msgr2=0x7fe63c19fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:40:10.305 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:10.303+0000 7fe63a7fc640 1 --2- 172.21.15.83:0/263680558 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe63c10de10 0x7fe63c19fc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:10.306 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:10.303+0000 7fe63a7fc640 1 -- 172.21.15.83:0/263680558 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe63c1a03b0 con 0x7fe63c105300 2024-09-21T01:40:10.306 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:10.303+0000 7fe63affd640 1 --2- 172.21.15.83:0/263680558 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe63c1049b0 0x7fe63c19a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:40:10.306 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:10.303+0000 7fe63a7fc640 1 --2- 172.21.15.83:0/263680558 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe63c105300 0x7fe63c19a9e0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fe62400c970 tx=0x7fe62400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:40:10.306 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:10.303+0000 7fe6409c6640 1 -- 172.21.15.83:0/263680558 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe624004220 con 0x7fe63c105300 2024-09-21T01:40:10.306 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:10.303+0000 7fe6409c6640 1 -- 172.21.15.83:0/263680558 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe624007e40 con 0x7fe63c105300 2024-09-21T01:40:10.306 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:10.303+0000 7fe6419c8640 1 -- 172.21.15.83:0/263680558 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe63c1a06a0 con 0x7fe63c105300 2024-09-21T01:40:10.306 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:10.303+0000 7fe6409c6640 1 -- 172.21.15.83:0/263680558 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6240047a0 con 0x7fe63c105300 2024-09-21T01:40:10.306 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:10.303+0000 7fe6419c8640 1 -- 172.21.15.83:0/263680558 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe63c1a6e00 con 0x7fe63c105300 2024-09-21T01:40:10.307 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:10.305+0000 7fe6419c8640 1 -- 172.21.15.83:0/263680558 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe63c104dc0 con 0x7fe63c105300 2024-09-21T01:40:10.307 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:10.307+0000 7fe6409c6640 1 -- 172.21.15.83:0/263680558 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 20) ==== 154529+0+0 (secure 0 0 0) 0x7fe6240079b0 con 0x7fe63c105300 2024-09-21T01:40:10.308 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:10.308+0000 7fe6409c6640 1 --2- 172.21.15.83:0/263680558 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fe6280b6560 0x7fe6280b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:40:10.308 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:10.308+0000 7fe63affd640 1 --2- 172.21.15.83:0/263680558 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fe6280b6560 0x7fe6280b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:40:10.308 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:10.308+0000 7fe6409c6640 1 -- 172.21.15.83:0/263680558 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9286+0+0 (secure 0 0 0) 0x7fe6240e7840 con 0x7fe63c105300 2024-09-21T01:40:10.308 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:10.308+0000 7fe63affd640 1 --2- 172.21.15.83:0/263680558 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fe6280b6560 0x7fe6280b8a70 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fe62c000f80 tx=0x7fe62c009410 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:40:10.311 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:10.311+0000 7fe6409c6640 1 -- 172.21.15.83:0/263680558 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe624014030 con 0x7fe63c105300 2024-09-21T01:40:10.501 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:10.501+0000 7fe6419c8640 1 -- 172.21.15.83:0/263680558 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fe63c19b570 con 0x7fe63c105300 2024-09-21T01:40:10.502 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:10.501+0000 7fe6409c6640 1 -- 172.21.15.83:0/263680558 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 15 entries v82) ==== 81+0+887 (secure 0 0 0) 0x7fe63c19b570 con 0x7fe63c105300 2024-09-21T01:40:10.502 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.15.83:0/1619062496 2024-09-22T01:33:08.666525+0000 2024-09-21T01:40:10.502 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.15.83:0/2412709299 2024-09-22T01:31:45.834450+0000 2024-09-21T01:40:10.502 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.15.83:6800/4290325964 2024-09-22T01:31:45.834450+0000 2024-09-21T01:40:10.502 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.15.83:6801/4290325964 2024-09-22T01:31:45.834450+0000 2024-09-21T01:40:10.502 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.15.83:0/1440681183 2024-09-22T01:31:45.834450+0000 2024-09-21T01:40:10.503 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.15.83:0/2745413305 2024-09-22T01:31:45.834450+0000 2024-09-21T01:40:10.503 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.15.83:6800/1393748565 2024-09-22T01:33:08.666525+0000 2024-09-21T01:40:10.503 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.15.83:0/110411274 2024-09-22T01:32:10.073024+0000 2024-09-21T01:40:10.503 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.15.83:0/4267551123 2024-09-22T01:33:08.666525+0000 2024-09-21T01:40:10.503 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.15.83:0/1068434643 2024-09-22T01:32:10.073024+0000 2024-09-21T01:40:10.503 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.15.83:6800/2963261730 2024-09-22T01:32:10.073024+0000 2024-09-21T01:40:10.503 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.15.83:0/3544333975 2024-09-22T01:32:10.073024+0000 2024-09-21T01:40:10.503 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.15.83:6801/1393748565 2024-09-22T01:33:08.666525+0000 2024-09-21T01:40:10.503 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.15.83:6801/2963261730 2024-09-22T01:32:10.073024+0000 2024-09-21T01:40:10.503 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.15.83:0/1915285091 2024-09-22T01:33:08.666525+0000 2024-09-21T01:40:10.503 INFO:teuthology.orchestra.run.smithi083.stderr:listed 15 entries 2024-09-21T01:40:10.504 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:10.504+0000 7fe6419c8640 1 -- 172.21.15.83:0/263680558 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fe6280b6560 msgr2=0x7fe6280b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:40:10.504 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:10.504+0000 7fe6419c8640 1 --2- 172.21.15.83:0/263680558 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fe6280b6560 0x7fe6280b8a70 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fe62c000f80 tx=0x7fe62c009410 comp rx=0 tx=0).stop 2024-09-21T01:40:10.504 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:10.504+0000 7fe6419c8640 1 -- 172.21.15.83:0/263680558 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe63c105300 msgr2=0x7fe63c19a9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:40:10.504 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:10.504+0000 7fe6419c8640 1 --2- 172.21.15.83:0/263680558 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe63c105300 0x7fe63c19a9e0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fe62400c970 tx=0x7fe62400ce30 comp rx=0 tx=0).stop 2024-09-21T01:40:10.505 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:10.504+0000 7fe6419c8640 1 -- 172.21.15.83:0/263680558 shutdown_connections 2024-09-21T01:40:10.505 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:10.504+0000 7fe6419c8640 1 --2- 172.21.15.83:0/263680558 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fe6280b6560 0x7fe6280b8a70 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:10.505 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:10.504+0000 7fe6419c8640 1 --2- 172.21.15.83:0/263680558 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe63c10de10 0x7fe63c19fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:10.505 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:10.504+0000 7fe6419c8640 1 --2- 172.21.15.83:0/263680558 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe63c105300 0x7fe63c19a9e0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:10.505 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:10.504+0000 7fe6419c8640 1 --2- 172.21.15.83:0/263680558 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe63c1049b0 0x7fe63c19a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:10.505 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:10.504+0000 7fe6419c8640 1 -- 172.21.15.83:0/263680558 >> 172.21.15.83:0/263680558 conn(0x7fe63c079730 msgr2=0x7fe63c1008c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:40:10.505 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:10.504+0000 7fe6419c8640 1 -- 172.21.15.83:0/263680558 shutdown_connections 2024-09-21T01:40:10.505 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:10.504+0000 7fe6419c8640 1 -- 172.21.15.83:0/263680558 wait complete. 2024-09-21T01:40:11.132 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:40:10 smithi083 ceph-mon[31370]: osdmap e82: 12 total, 12 up, 12 in 2024-09-21T01:40:11.132 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:40:10 smithi083 ceph-mon[31370]: from='client.? 172.21.15.83:0/263680558' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T01:40:11.158 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-09-21T01:40:11.159 DEBUG:teuthology.orchestra.run.smithi083:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T01:40:11.176 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph osd blocklist ls 2024-09-21T01:40:11.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:40:10 smithi142 ceph-mon[34050]: osdmap e82: 12 total, 12 up, 12 in 2024-09-21T01:40:11.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:40:10 smithi142 ceph-mon[34050]: from='client.? 172.21.15.83:0/263680558' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T01:40:11.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:40:10 smithi119 ceph-mon[33693]: osdmap e82: 12 total, 12 up, 12 in 2024-09-21T01:40:11.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:40:10 smithi119 ceph-mon[33693]: from='client.? 172.21.15.83:0/263680558' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T01:40:11.461 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:40:11.927 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:11.926+0000 7fc71a801640 1 -- 172.21.15.83:0/2767522777 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc7141038f0 msgr2=0x7fc71410f4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:40:11.927 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:11.926+0000 7fc71a801640 1 --2- 172.21.15.83:0/2767522777 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc7141038f0 0x7fc71410f4a0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fc70c009ca0 tx=0x7fc70c02a8c0 comp rx=0 tx=0).stop 2024-09-21T01:40:11.927 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:11.927+0000 7fc71a801640 1 -- 172.21.15.83:0/2767522777 shutdown_connections 2024-09-21T01:40:11.927 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:11.927+0000 7fc71a801640 1 --2- 172.21.15.83:0/2767522777 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc7141038f0 0x7fc71410f4a0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:11.927 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:11.927+0000 7fc71a801640 1 --2- 172.21.15.83:0/2767522777 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc714102fa0 0x7fc7141033b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:11.928 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:11.927+0000 7fc71a801640 1 --2- 172.21.15.83:0/2767522777 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc714107630 0x7fc714107a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:11.928 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:11.927+0000 7fc71a801640 1 -- 172.21.15.83:0/2767522777 >> 172.21.15.83:0/2767522777 conn(0x7fc714079e40 msgr2=0x7fc71407a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:40:11.928 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:11.927+0000 7fc71a801640 1 -- 172.21.15.83:0/2767522777 shutdown_connections 2024-09-21T01:40:11.928 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:11.927+0000 7fc71a801640 1 -- 172.21.15.83:0/2767522777 wait complete. 2024-09-21T01:40:11.929 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:11.927+0000 7fc71a801640 1 Processor -- start 2024-09-21T01:40:11.930 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:11.927+0000 7fc71a801640 1 -- start start 2024-09-21T01:40:11.930 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:11.928+0000 7fc71a801640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc714102fa0 0x7fc71419c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:40:11.930 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:11.928+0000 7fc71a801640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc7141038f0 0x7fc71419cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:40:11.930 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:11.928+0000 7fc71a801640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc714107630 0x7fc7141a1f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:40:11.930 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:11.928+0000 7fc71a801640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fc714112960 con 0x7fc714107630 2024-09-21T01:40:11.930 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:11.928+0000 7fc71a801640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fc7141127e0 con 0x7fc714102fa0 2024-09-21T01:40:11.930 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:11.928+0000 7fc71a801640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fc714112ae0 con 0x7fc7141038f0 2024-09-21T01:40:11.930 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:11.928+0000 7fc718d9e640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc714107630 0x7fc7141a1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:40:11.930 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:11.928+0000 7fc718d9e640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc714107630 0x7fc7141a1f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:42698/0 (socket says 172.21.15.83:42698) 2024-09-21T01:40:11.930 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:11.928+0000 7fc718d9e640 1 -- 172.21.15.83:0/2712482871 learned_addr learned my addr 172.21.15.83:0/2712482871 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:40:11.930 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:11.928+0000 7fc713fff640 1 --2- 172.21.15.83:0/2712482871 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc714102fa0 0x7fc71419c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:40:11.930 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:11.928+0000 7fc7137fe640 1 --2- 172.21.15.83:0/2712482871 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc7141038f0 0x7fc71419cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:40:11.931 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:11.928+0000 7fc718d9e640 1 -- 172.21.15.83:0/2712482871 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc7141038f0 msgr2=0x7fc71419cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:40:11.931 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:11.928+0000 7fc718d9e640 1 --2- 172.21.15.83:0/2712482871 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc7141038f0 0x7fc71419cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:11.931 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:11.928+0000 7fc718d9e640 1 -- 172.21.15.83:0/2712482871 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc714102fa0 msgr2=0x7fc71419c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:40:11.931 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:11.928+0000 7fc718d9e640 1 --2- 172.21.15.83:0/2712482871 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc714102fa0 0x7fc71419c700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:11.931 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:11.929+0000 7fc718d9e640 1 -- 172.21.15.83:0/2712482871 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7141a2670 con 0x7fc714107630 2024-09-21T01:40:11.931 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:11.929+0000 7fc718d9e640 1 --2- 172.21.15.83:0/2712482871 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc714107630 0x7fc7141a1f40 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fc70c005cc0 tx=0x7fc70c032a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:40:11.931 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:11.929+0000 7fc7117fa640 1 -- 172.21.15.83:0/2712482871 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc70c032e00 con 0x7fc714107630 2024-09-21T01:40:11.931 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:11.929+0000 7fc71a801640 1 -- 172.21.15.83:0/2712482871 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7141a2900 con 0x7fc714107630 2024-09-21T01:40:11.931 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:11.929+0000 7fc7117fa640 1 -- 172.21.15.83:0/2712482871 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc70c0044d0 con 0x7fc714107630 2024-09-21T01:40:11.931 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:11.929+0000 7fc7117fa640 1 -- 172.21.15.83:0/2712482871 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc70c030b70 con 0x7fc714107630 2024-09-21T01:40:11.931 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:11.929+0000 7fc71a801640 1 -- 172.21.15.83:0/2712482871 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7141a90c0 con 0x7fc714107630 2024-09-21T01:40:11.932 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:11.930+0000 7fc71a801640 1 -- 172.21.15.83:0/2712482871 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7141033b0 con 0x7fc714107630 2024-09-21T01:40:11.932 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:11.932+0000 7fc7117fa640 1 -- 172.21.15.83:0/2712482871 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 20) ==== 154529+0+0 (secure 0 0 0) 0x7fc70c030d10 con 0x7fc714107630 2024-09-21T01:40:11.933 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:11.932+0000 7fc7117fa640 1 --2- 172.21.15.83:0/2712482871 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fc6fc0b6560 0x7fc6fc0b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:40:11.933 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:11.932+0000 7fc713fff640 1 --2- 172.21.15.83:0/2712482871 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fc6fc0b6560 0x7fc6fc0b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:40:11.933 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:11.932+0000 7fc7117fa640 1 -- 172.21.15.83:0/2712482871 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9286+0+0 (secure 0 0 0) 0x7fc70c108b30 con 0x7fc714107630 2024-09-21T01:40:11.933 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:11.933+0000 7fc713fff640 1 --2- 172.21.15.83:0/2712482871 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fc6fc0b6560 0x7fc6fc0b8a70 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fc704009990 tx=0x7fc704009110 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:40:11.936 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:11.936+0000 7fc7117fa640 1 -- 172.21.15.83:0/2712482871 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc70c0cf030 con 0x7fc714107630 2024-09-21T01:40:12.125 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:12.124+0000 7fc71a801640 1 -- 172.21.15.83:0/2712482871 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fc71419d830 con 0x7fc714107630 2024-09-21T01:40:12.125 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:40:11 smithi083 ceph-mon[31370]: pgmap v281: 129 pgs: 1 activating, 4 peering, 124 active+clean; 579 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 0 op/s 2024-09-21T01:40:12.125 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:12.125+0000 7fc7117fa640 1 -- 172.21.15.83:0/2712482871 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 15 entries v82) ==== 81+0+887 (secure 0 0 0) 0x7fc70c0d3410 con 0x7fc714107630 2024-09-21T01:40:12.125 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.15.83:0/1619062496 2024-09-22T01:33:08.666525+0000 2024-09-21T01:40:12.126 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.15.83:0/2412709299 2024-09-22T01:31:45.834450+0000 2024-09-21T01:40:12.126 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.15.83:6800/4290325964 2024-09-22T01:31:45.834450+0000 2024-09-21T01:40:12.126 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.15.83:6801/4290325964 2024-09-22T01:31:45.834450+0000 2024-09-21T01:40:12.126 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.15.83:0/1440681183 2024-09-22T01:31:45.834450+0000 2024-09-21T01:40:12.126 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.15.83:0/2745413305 2024-09-22T01:31:45.834450+0000 2024-09-21T01:40:12.126 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.15.83:6800/1393748565 2024-09-22T01:33:08.666525+0000 2024-09-21T01:40:12.126 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.15.83:0/110411274 2024-09-22T01:32:10.073024+0000 2024-09-21T01:40:12.126 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.15.83:0/4267551123 2024-09-22T01:33:08.666525+0000 2024-09-21T01:40:12.126 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.15.83:0/1068434643 2024-09-22T01:32:10.073024+0000 2024-09-21T01:40:12.126 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.15.83:6800/2963261730 2024-09-22T01:32:10.073024+0000 2024-09-21T01:40:12.126 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.15.83:0/3544333975 2024-09-22T01:32:10.073024+0000 2024-09-21T01:40:12.126 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.15.83:6801/1393748565 2024-09-22T01:33:08.666525+0000 2024-09-21T01:40:12.126 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.15.83:6801/2963261730 2024-09-22T01:32:10.073024+0000 2024-09-21T01:40:12.127 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.15.83:0/1915285091 2024-09-22T01:33:08.666525+0000 2024-09-21T01:40:12.127 INFO:teuthology.orchestra.run.smithi083.stderr:listed 15 entries 2024-09-21T01:40:12.127 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:12.127+0000 7fc71a801640 1 -- 172.21.15.83:0/2712482871 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fc6fc0b6560 msgr2=0x7fc6fc0b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:40:12.127 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:12.127+0000 7fc71a801640 1 --2- 172.21.15.83:0/2712482871 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fc6fc0b6560 0x7fc6fc0b8a70 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fc704009990 tx=0x7fc704009110 comp rx=0 tx=0).stop 2024-09-21T01:40:12.127 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:12.127+0000 7fc71a801640 1 -- 172.21.15.83:0/2712482871 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc714107630 msgr2=0x7fc7141a1f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:40:12.127 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:12.127+0000 7fc71a801640 1 --2- 172.21.15.83:0/2712482871 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc714107630 0x7fc7141a1f40 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fc70c005cc0 tx=0x7fc70c032a10 comp rx=0 tx=0).stop 2024-09-21T01:40:12.128 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:12.127+0000 7fc71a801640 1 -- 172.21.15.83:0/2712482871 shutdown_connections 2024-09-21T01:40:12.128 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:12.127+0000 7fc71a801640 1 --2- 172.21.15.83:0/2712482871 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fc6fc0b6560 0x7fc6fc0b8a70 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:12.128 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:12.127+0000 7fc71a801640 1 --2- 172.21.15.83:0/2712482871 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc714107630 0x7fc7141a1f40 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:12.129 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:12.127+0000 7fc71a801640 1 --2- 172.21.15.83:0/2712482871 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc7141038f0 0x7fc71419cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:12.129 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:12.127+0000 7fc71a801640 1 --2- 172.21.15.83:0/2712482871 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc714102fa0 0x7fc71419c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:12.129 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:12.127+0000 7fc71a801640 1 -- 172.21.15.83:0/2712482871 >> 172.21.15.83:0/2712482871 conn(0x7fc714079e40 msgr2=0x7fc7141041e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:40:12.129 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:12.127+0000 7fc71a801640 1 -- 172.21.15.83:0/2712482871 shutdown_connections 2024-09-21T01:40:12.129 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:12.127+0000 7fc71a801640 1 -- 172.21.15.83:0/2712482871 wait complete. 2024-09-21T01:40:12.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:40:11 smithi142 ceph-mon[34050]: pgmap v281: 129 pgs: 1 activating, 4 peering, 124 active+clean; 579 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 0 op/s 2024-09-21T01:40:12.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:40:11 smithi119 ceph-mon[33693]: pgmap v281: 129 pgs: 1 activating, 4 peering, 124 active+clean; 579 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 0 op/s 2024-09-21T01:40:12.917 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi083.front.sepia.ceph.com... 2024-09-21T01:40:12.918 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T01:40:12.918 DEBUG:teuthology.orchestra.run.smithi083:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-09-21T01:40:12.943 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi083.stderr:ceph-fuse[77209]: fuse finished with error 0 and tester_r 0 2024-09-21T01:40:12.945 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T01:40:13.147 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:40:12 smithi083 ceph-mon[31370]: from='client.? 172.21.15.83:0/2712482871' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T01:40:13.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:40:12 smithi142 ceph-mon[34050]: from='client.? 172.21.15.83:0/2712482871' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T01:40:13.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:40:12 smithi119 ceph-mon[33693]: from='client.? 172.21.15.83:0/2712482871' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T01:40:14.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:40:13 smithi142 ceph-mon[34050]: pgmap v282: 129 pgs: 1 activating, 4 peering, 124 active+clean; 579 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 0 op/s 2024-09-21T01:40:14.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:40:13 smithi119 ceph-mon[33693]: pgmap v282: 129 pgs: 1 activating, 4 peering, 124 active+clean; 579 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 0 op/s 2024-09-21T01:40:14.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:40:13 smithi083 ceph-mon[31370]: pgmap v282: 129 pgs: 1 activating, 4 peering, 124 active+clean; 579 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 0 op/s 2024-09-21T01:40:16.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:40:15 smithi142 ceph-mon[34050]: pgmap v283: 129 pgs: 1 activating, 128 active+clean; 581 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 639 B/s wr, 0 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T01:40:16.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:40:15 smithi119 ceph-mon[33693]: pgmap v283: 129 pgs: 1 activating, 128 active+clean; 581 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 639 B/s wr, 0 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T01:40:16.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:40:15 smithi083 ceph-mon[31370]: pgmap v283: 129 pgs: 1 activating, 128 active+clean; 581 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 639 B/s wr, 0 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T01:40:18.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:40:17 smithi142 ceph-mon[34050]: pgmap v284: 129 pgs: 129 active+clean; 581 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 639 B/s wr, 0 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T01:40:18.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:40:17 smithi119 ceph-mon[33693]: pgmap v284: 129 pgs: 129 active+clean; 581 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 639 B/s wr, 0 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T01:40:18.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:40:17 smithi083 ceph-mon[31370]: pgmap v284: 129 pgs: 129 active+clean; 581 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 639 B/s wr, 0 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T01:40:19.047 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi083.front.sepia.ceph.com 2024-09-21T01:40:19.047 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T01:40:19.047 DEBUG:teuthology.orchestra.run.smithi083:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-09-21T01:40:19.088 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T01:40:19.384 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:40:19.971 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:19.902+0000 7f179e407640 1 -- 172.21.15.83:0/2709998928 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f17981051b0 msgr2=0x7f17981055c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:40:19.971 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:19.902+0000 7f179e407640 1 --2- 172.21.15.83:0/2709998928 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f17981051b0 0x7f17981055c0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f1780009900 tx=0x7f178002a410 comp rx=0 tx=0).stop 2024-09-21T01:40:19.971 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:19.902+0000 7f179e407640 1 -- 172.21.15.83:0/2709998928 shutdown_connections 2024-09-21T01:40:19.971 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:19.902+0000 7f179e407640 1 --2- 172.21.15.83:0/2709998928 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1798105b00 0x7f179810f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:19.971 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:19.902+0000 7f179e407640 1 --2- 172.21.15.83:0/2709998928 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f17981051b0 0x7f17981055c0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:19.971 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:19.902+0000 7f179e407640 1 --2- 172.21.15.83:0/2709998928 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f17981031a0 0x7f17981035b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:19.971 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:19.902+0000 7f179e407640 1 -- 172.21.15.83:0/2709998928 >> 172.21.15.83:0/2709998928 conn(0x7f1798079e10 msgr2=0x7f179807a220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:40:19.972 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:19.902+0000 7f179e407640 1 -- 172.21.15.83:0/2709998928 shutdown_connections 2024-09-21T01:40:19.972 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:19.902+0000 7f179e407640 1 -- 172.21.15.83:0/2709998928 wait complete. 2024-09-21T01:40:19.972 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:19.903+0000 7f179e407640 1 Processor -- start 2024-09-21T01:40:19.972 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:19.903+0000 7f179e407640 1 -- start start 2024-09-21T01:40:19.972 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:19.903+0000 7f179e407640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f17981031a0 0x7f17980fee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:40:19.972 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:19.903+0000 7f179e407640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f17981051b0 0x7f17980ff380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:40:19.972 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:19.903+0000 7f179e407640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1798105b00 0x7f17980ff8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:40:19.972 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:19.903+0000 7f179e407640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f17981128b0 con 0x7f17981031a0 2024-09-21T01:40:19.972 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:19.903+0000 7f179e407640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f1798112730 con 0x7f1798105b00 2024-09-21T01:40:19.972 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:19.903+0000 7f179e407640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f1798112a30 con 0x7f17981051b0 2024-09-21T01:40:19.972 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:19.903+0000 7f1797fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f17981031a0 0x7f17980fee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:40:19.972 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:19.903+0000 7f1797fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f17981031a0 0x7f17980fee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:50866/0 (socket says 172.21.15.83:50866) 2024-09-21T01:40:19.972 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:19.903+0000 7f1797fff640 1 -- 172.21.15.83:0/3288075402 learned_addr learned my addr 172.21.15.83:0/3288075402 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:40:19.973 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:19.903+0000 7f178ffff640 1 --2- 172.21.15.83:0/3288075402 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f17981051b0 0x7f17980ff380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:40:19.973 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:19.903+0000 7f179c9a4640 1 --2- 172.21.15.83:0/3288075402 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1798105b00 0x7f17980ff8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:40:19.973 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:19.903+0000 7f1797fff640 1 -- 172.21.15.83:0/3288075402 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f17981051b0 msgr2=0x7f17980ff380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:40:19.973 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:19.903+0000 7f1797fff640 1 --2- 172.21.15.83:0/3288075402 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f17981051b0 0x7f17980ff380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:19.973 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:19.903+0000 7f1797fff640 1 -- 172.21.15.83:0/3288075402 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1798105b00 msgr2=0x7f17980ff8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:40:19.973 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:19.903+0000 7f1797fff640 1 --2- 172.21.15.83:0/3288075402 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1798105b00 0x7f17980ff8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:19.973 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:19.903+0000 7f1797fff640 1 -- 172.21.15.83:0/3288075402 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17981a86b0 con 0x7f17981031a0 2024-09-21T01:40:19.973 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:19.903+0000 7f179c9a4640 1 --2- 172.21.15.83:0/3288075402 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1798105b00 0x7f17980ff8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:40:19.973 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:19.903+0000 7f1797fff640 1 --2- 172.21.15.83:0/3288075402 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f17981031a0 0x7f17980fee40 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f178800d950 tx=0x7f178800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:40:19.973 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:19.904+0000 7f1795ffb640 1 -- 172.21.15.83:0/3288075402 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1788017070 con 0x7f17981031a0 2024-09-21T01:40:19.973 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:19.904+0000 7f1795ffb640 1 -- 172.21.15.83:0/3288075402 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1788009c30 con 0x7f17981031a0 2024-09-21T01:40:19.973 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:19.904+0000 7f179e407640 1 -- 172.21.15.83:0/3288075402 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17981a89a0 con 0x7f17981031a0 2024-09-21T01:40:19.973 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:19.904+0000 7f1795ffb640 1 -- 172.21.15.83:0/3288075402 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f178800f620 con 0x7f17981031a0 2024-09-21T01:40:19.974 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:19.904+0000 7f179e407640 1 -- 172.21.15.83:0/3288075402 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17981a8f00 con 0x7f17981031a0 2024-09-21T01:40:19.974 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:19.905+0000 7f179e407640 1 -- 172.21.15.83:0/3288075402 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17981035b0 con 0x7f17981031a0 2024-09-21T01:40:19.974 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:19.906+0000 7f1795ffb640 1 -- 172.21.15.83:0/3288075402 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 20) ==== 154529+0+0 (secure 0 0 0) 0x7f1788005030 con 0x7f17981031a0 2024-09-21T01:40:19.974 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:19.907+0000 7f1795ffb640 1 --2- 172.21.15.83:0/3288075402 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f17840b65e0 0x7f17840b8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:40:19.974 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:19.907+0000 7f178ffff640 1 --2- 172.21.15.83:0/3288075402 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f17840b65e0 0x7f17840b8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:40:19.974 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:19.907+0000 7f1795ffb640 1 -- 172.21.15.83:0/3288075402 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9286+0+0 (secure 0 0 0) 0x7f17880e72e0 con 0x7f17981031a0 2024-09-21T01:40:19.974 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:19.908+0000 7f178ffff640 1 --2- 172.21.15.83:0/3288075402 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f17840b65e0 0x7f17840b8af0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f1780005940 tx=0x7f17800058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:40:19.974 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:19.910+0000 7f1795ffb640 1 -- 172.21.15.83:0/3288075402 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f17880ad7d0 con 0x7f17981031a0 2024-09-21T01:40:20.087 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:20.087+0000 7f179e407640 1 -- 172.21.15.83:0/3288075402 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f17981a92e0 con 0x7f17981031a0 2024-09-21T01:40:20.087 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:40:19 smithi083 ceph-mon[31370]: pgmap v285: 129 pgs: 129 active+clean; 581 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 515 B/s wr, 0 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T01:40:20.088 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:20.088+0000 7f1795ffb640 1 -- 172.21.15.83:0/3288075402 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+25050 (secure 0 0 0) 0x7f1788009de0 con 0x7f17981031a0 2024-09-21T01:40:20.089 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T01:40:20.089 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":82,"fsid":"f7697ecc-77b8-11ef-baf5-efdc52797490","created":"2024-09-21T01:31:22.250342+0000","modified":"2024-09-21T01:40:09.823827+0000","last_up_change":"2024-09-21T01:38:53.501659+0000","last_in_change":"2024-09-21T01:38:30.688516+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T01:35:06.977668+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T01:39:41.041950+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T01:39:42.882272+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T01:39:49.320532+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"66947512-01ee-4bf0-87b0-98a168cf50dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":3563457494},{"type":"v1","addr":"172.21.15.83:6803","nonce":3563457494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":3563457494},{"type":"v1","addr":"172.21.15.83:6805","nonce":3563457494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":3563457494},{"type":"v1","addr":"172.21.15.83:6809","nonce":3563457494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":3563457494},{"type":"v1","addr":"172.21.15.83:6807","nonce":3563457494}]},"public_addr":"172.21.15.83:6803/3563457494","cluster_addr":"172.21.15.83:6805/3563457494","heartbeat_back_addr":"172.21.15.83:6809/3563457494","heartbeat_front_addr":"172.21.15.83:6807/3563457494","state":["exists","up"]},{"osd":1,"uuid":"f7818a08-86a5-412d-a164-cfeb18f8650a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":2066870220},{"type":"v1","addr":"172.21.15.119:6801","nonce":2066870220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":2066870220},{"type":"v1","addr":"172.21.15.119:6803","nonce":2066870220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":2066870220},{"type":"v1","addr":"172.21.15.119:6807","nonce":2066870220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":2066870220},{"type":"v1","addr":"172.21.15.119:6805","nonce":2066870220}]},"public_addr":"172.21.15.119:6801/2066870220","cluster_addr":"172.21.15.119:6803/2066870220","heartbeat_back_addr":"172.21.15.119:6807/2066870220","heartbeat_front_addr":"172.21.15.119:6805/2066870220","state":["exists","up"]},{"osd":2,"uuid":"0d1a3870-c67a-4783-85f9-be2bb36f7722","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":3955936117},{"type":"v1","addr":"172.21.15.142:6801","nonce":3955936117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3955936117},{"type":"v1","addr":"172.21.15.142:6803","nonce":3955936117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":3955936117},{"type":"v1","addr":"172.21.15.142:6807","nonce":3955936117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":3955936117},{"type":"v1","addr":"172.21.15.142:6805","nonce":3955936117}]},"public_addr":"172.21.15.142:6801/3955936117","cluster_addr":"172.21.15.142:6803/3955936117","heartbeat_back_addr":"172.21.15.142:6807/3955936117","heartbeat_front_addr":"172.21.15.142:6805/3955936117","state":["exists","up"]},{"osd":3,"uuid":"a4cb1a36-3495-4d36-92da-ed3b6e852d14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":3746834093},{"type":"v1","addr":"172.21.15.83:6811","nonce":3746834093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":3746834093},{"type":"v1","addr":"172.21.15.83:6813","nonce":3746834093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":3746834093},{"type":"v1","addr":"172.21.15.83:6817","nonce":3746834093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":3746834093},{"type":"v1","addr":"172.21.15.83:6815","nonce":3746834093}]},"public_addr":"172.21.15.83:6811/3746834093","cluster_addr":"172.21.15.83:6813/3746834093","heartbeat_back_addr":"172.21.15.83:6817/3746834093","heartbeat_front_addr":"172.21.15.83:6815/3746834093","state":["exists","up"]},{"osd":4,"uuid":"d6f2ec78-7f08-473b-a96c-e8590f5d2f25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":3083907785},{"type":"v1","addr":"172.21.15.119:6809","nonce":3083907785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":3083907785},{"type":"v1","addr":"172.21.15.119:6811","nonce":3083907785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":3083907785},{"type":"v1","addr":"172.21.15.119:6815","nonce":3083907785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":3083907785},{"type":"v1","addr":"172.21.15.119:6813","nonce":3083907785}]},"public_addr":"172.21.15.119:6809/3083907785","cluster_addr":"172.21.15.119:6811/3083907785","heartbeat_back_addr":"172.21.15.119:6815/3083907785","heartbeat_front_addr":"172.21.15.119:6813/3083907785","state":["exists","up"]},{"osd":5,"uuid":"c571d04d-d3ea-4d74-8867-e4c7816f4e0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":349001002},{"type":"v1","addr":"172.21.15.142:6809","nonce":349001002}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":349001002},{"type":"v1","addr":"172.21.15.142:6811","nonce":349001002}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":349001002},{"type":"v1","addr":"172.21.15.142:6815","nonce":349001002}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":349001002},{"type":"v1","addr":"172.21.15.142:6813","nonce":349001002}]},"public_addr":"172.21.15.142:6809/349001002","cluster_addr":"172.21.15.142:6811/349001002","heartbeat_back_addr":"172.21.15.142:6815/349001002","heartbeat_front_addr":"172.21.15.142:6813/349001002","state":["exists","up"]},{"osd":6,"uuid":"6e1b6fe9-700a-448a-b382-59b97896ea7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":771651063},{"type":"v1","addr":"172.21.15.83:6819","nonce":771651063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":771651063},{"type":"v1","addr":"172.21.15.83:6821","nonce":771651063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":771651063},{"type":"v1","addr":"172.21.15.83:6825","nonce":771651063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":771651063},{"type":"v1","addr":"172.21.15.83:6823","nonce":771651063}]},"public_addr":"172.21.15.83:6819/771651063","cluster_addr":"172.21.15.83:6821/771651063","heartbeat_back_addr":"172.21.15.83:6825/771651063","heartbeat_front_addr":"172.21.15.83:6823/771651063","state":["exists","up"]},{"osd":7,"uuid":"283bfae4-5f50-4f9e-860e-bbfd47e005e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":1556984819},{"type":"v1","addr":"172.21.15.119:6817","nonce":1556984819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":1556984819},{"type":"v1","addr":"172.21.15.119:6819","nonce":1556984819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":1556984819},{"type":"v1","addr":"172.21.15.119:6823","nonce":1556984819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":1556984819},{"type":"v1","addr":"172.21.15.119:6821","nonce":1556984819}]},"public_addr":"172.21.15.119:6817/1556984819","cluster_addr":"172.21.15.119:6819/1556984819","heartbeat_back_addr":"172.21.15.119:6823/1556984819","heartbeat_front_addr":"172.21.15.119:6821/1556984819","state":["exists","up"]},{"osd":8,"uuid":"d46e56d4-ed4e-42c3-a315-66af014bd93a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":1860679473},{"type":"v1","addr":"172.21.15.142:6817","nonce":1860679473}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":1860679473},{"type":"v1","addr":"172.21.15.142:6819","nonce":1860679473}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":1860679473},{"type":"v1","addr":"172.21.15.142:6823","nonce":1860679473}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":1860679473},{"type":"v1","addr":"172.21.15.142:6821","nonce":1860679473}]},"public_addr":"172.21.15.142:6817/1860679473","cluster_addr":"172.21.15.142:6819/1860679473","heartbeat_back_addr":"172.21.15.142:6823/1860679473","heartbeat_front_addr":"172.21.15.142:6821/1860679473","state":["exists","up"]},{"osd":9,"uuid":"18a70ee6-56df-4f5c-868d-5db5e72a1859","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":3636757924},{"type":"v1","addr":"172.21.15.83:6827","nonce":3636757924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":3636757924},{"type":"v1","addr":"172.21.15.83:6829","nonce":3636757924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6832","nonce":3636757924},{"type":"v1","addr":"172.21.15.83:6833","nonce":3636757924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":3636757924},{"type":"v1","addr":"172.21.15.83:6831","nonce":3636757924}]},"public_addr":"172.21.15.83:6827/3636757924","cluster_addr":"172.21.15.83:6829/3636757924","heartbeat_back_addr":"172.21.15.83:6833/3636757924","heartbeat_front_addr":"172.21.15.83:6831/3636757924","state":["exists","up"]},{"osd":10,"uuid":"0d32c3de-db03-42c3-9914-07d675aaa339","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":2561963910},{"type":"v1","addr":"172.21.15.119:6825","nonce":2561963910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":2561963910},{"type":"v1","addr":"172.21.15.119:6827","nonce":2561963910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2561963910},{"type":"v1","addr":"172.21.15.119:6831","nonce":2561963910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2561963910},{"type":"v1","addr":"172.21.15.119:6829","nonce":2561963910}]},"public_addr":"172.21.15.119:6825/2561963910","cluster_addr":"172.21.15.119:6827/2561963910","heartbeat_back_addr":"172.21.15.119:6831/2561963910","heartbeat_front_addr":"172.21.15.119:6829/2561963910","state":["exists","up"]},{"osd":11,"uuid":"3a3b444d-b316-4256-bfad-378db29f0824","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":1174646198},{"type":"v1","addr":"172.21.15.142:6825","nonce":1174646198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":1174646198},{"type":"v1","addr":"172.21.15.142:6827","nonce":1174646198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1174646198},{"type":"v1","addr":"172.21.15.142:6831","nonce":1174646198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1174646198},{"type":"v1","addr":"172.21.15.142:6829","nonce":1174646198}]},"public_addr":"172.21.15.142:6825/1174646198","cluster_addr":"172.21.15.142:6827/1174646198","heartbeat_back_addr":"172.21.15.142:6831/1174646198","heartbeat_front_addr":"172.21.15.142:6829/1174646198","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:34:15.337672+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:34:39.259716+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:35:03.348886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:35:29.465711+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:35:53.744378+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:36:19.488785+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:36:45.708616+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:37:11.501065+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:37:36.027277+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:38:01.903625+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:38:27.215212+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:38:51.891278+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.e","mappings":[{"from":4,"to":8},{"from":5,"to":9}]},{"pgid":"3.11","mappings":[{"from":4,"to":6}]},{"pgid":"4.3","mappings":[{"from":5,"to":8}]},{"pgid":"4.10","mappings":[{"from":9,"to":8}]},{"pgid":"4.12","mappings":[{"from":9,"to":10}]},{"pgid":"4.1c","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.83:0/1619062496":"2024-09-22T01:33:08.666525+0000","172.21.15.83:0/2412709299":"2024-09-22T01:31:45.834450+0000","172.21.15.83:6800/4290325964":"2024-09-22T01:31:45.834450+0000","172.21.15.83:6801/4290325964":"2024-09-22T01:31:45.834450+0000","172.21.15.83:0/1440681183":"2024-09-22T01:31:45.834450+0000","172.21.15.83:0/2745413305":"2024-09-22T01:31:45.834450+0000","172.21.15.83:6800/1393748565":"2024-09-22T01:33:08.666525+0000","172.21.15.83:0/110411274":"2024-09-22T01:32:10.073024+0000","172.21.15.83:0/4267551123":"2024-09-22T01:33:08.666525+0000","172.21.15.83:0/1068434643":"2024-09-22T01:32:10.073024+0000","172.21.15.83:6800/2963261730":"2024-09-22T01:32:10.073024+0000","172.21.15.83:0/3544333975":"2024-09-22T01:32:10.073024+0000","172.21.15.83:6801/1393748565":"2024-09-22T01:33:08.666525+0000","172.21.15.83:6801/2963261730":"2024-09-22T01:32:10.073024+0000","172.21.15.83:0/1915285091":"2024-09-22T01:33:08.666525+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T01:40:20.091 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:20.090+0000 7f179e407640 1 -- 172.21.15.83:0/3288075402 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f17840b65e0 msgr2=0x7f17840b8af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:40:20.091 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:20.090+0000 7f179e407640 1 --2- 172.21.15.83:0/3288075402 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f17840b65e0 0x7f17840b8af0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f1780005940 tx=0x7f17800058d0 comp rx=0 tx=0).stop 2024-09-21T01:40:20.091 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:20.090+0000 7f179e407640 1 -- 172.21.15.83:0/3288075402 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f17981031a0 msgr2=0x7f17980fee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:40:20.091 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:20.090+0000 7f179e407640 1 --2- 172.21.15.83:0/3288075402 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f17981031a0 0x7f17980fee40 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f178800d950 tx=0x7f178800de10 comp rx=0 tx=0).stop 2024-09-21T01:40:20.091 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:20.091+0000 7f179e407640 1 -- 172.21.15.83:0/3288075402 shutdown_connections 2024-09-21T01:40:20.092 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:20.091+0000 7f179e407640 1 --2- 172.21.15.83:0/3288075402 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f17840b65e0 0x7f17840b8af0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:20.092 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:20.091+0000 7f179e407640 1 --2- 172.21.15.83:0/3288075402 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1798105b00 0x7f17980ff8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:20.092 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:20.091+0000 7f179e407640 1 --2- 172.21.15.83:0/3288075402 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f17981051b0 0x7f17980ff380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:20.092 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:20.091+0000 7f179e407640 1 --2- 172.21.15.83:0/3288075402 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f17981031a0 0x7f17980fee40 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:20.092 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:20.091+0000 7f179e407640 1 -- 172.21.15.83:0/3288075402 >> 172.21.15.83:0/3288075402 conn(0x7f1798079e10 msgr2=0x7f17981011d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:40:20.092 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:20.091+0000 7f179e407640 1 -- 172.21.15.83:0/3288075402 shutdown_connections 2024-09-21T01:40:20.092 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:20.091+0000 7f179e407640 1 -- 172.21.15.83:0/3288075402 wait complete. 2024-09-21T01:40:20.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:40:19 smithi142 ceph-mon[34050]: pgmap v285: 129 pgs: 129 active+clean; 581 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 515 B/s wr, 0 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T01:40:20.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:40:19 smithi119 ceph-mon[33693]: pgmap v285: 129 pgs: 129 active+clean; 581 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 515 B/s wr, 0 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T01:40:20.848 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T01:40:21.101 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:40:21.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:40:20 smithi142 ceph-mon[34050]: from='client.? 172.21.15.83:0/3288075402' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T01:40:21.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:40:20 smithi119 ceph-mon[33693]: from='client.? 172.21.15.83:0/3288075402' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T01:40:21.221 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:40:20 smithi083 ceph-mon[31370]: from='client.? 172.21.15.83:0/3288075402' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T01:40:21.581 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:21.557+0000 7fcd02f34640 1 -- 172.21.15.83:0/179577863 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fccfc102a90 msgr2=0x7fccfc102ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:40:21.581 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:21.557+0000 7fcd02f34640 1 --2- 172.21.15.83:0/179577863 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fccfc102a90 0x7fccfc102ea0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fccec009900 tx=0x7fccec02a410 comp rx=0 tx=0).stop 2024-09-21T01:40:21.581 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:21.557+0000 7fcd02f34640 1 -- 172.21.15.83:0/179577863 shutdown_connections 2024-09-21T01:40:21.581 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:21.557+0000 7fcd02f34640 1 --2- 172.21.15.83:0/179577863 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fccfc108d20 0x7fccfc10f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:21.581 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:21.557+0000 7fcd02f34640 1 --2- 172.21.15.83:0/179577863 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fccfc1083d0 0x7fccfc1087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:21.581 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:21.557+0000 7fcd02f34640 1 --2- 172.21.15.83:0/179577863 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fccfc102a90 0x7fccfc102ea0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:21.582 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:21.557+0000 7fcd02f34640 1 -- 172.21.15.83:0/179577863 >> 172.21.15.83:0/179577863 conn(0x7fccfc079750 msgr2=0x7fccfc079b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:40:21.582 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:21.557+0000 7fcd02f34640 1 -- 172.21.15.83:0/179577863 shutdown_connections 2024-09-21T01:40:21.582 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:21.557+0000 7fcd02f34640 1 -- 172.21.15.83:0/179577863 wait complete. 2024-09-21T01:40:21.582 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:21.558+0000 7fcd02f34640 1 Processor -- start 2024-09-21T01:40:21.582 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:21.558+0000 7fcd02f34640 1 -- start start 2024-09-21T01:40:21.582 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:21.558+0000 7fcd02f34640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fccfc102a90 0x7fccfc19b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:40:21.582 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:21.558+0000 7fcd02f34640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fccfc1083d0 0x7fccfc19b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:40:21.582 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:21.559+0000 7fcd02f34640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fccfc108d20 0x7fccfc19bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:40:21.583 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:21.559+0000 7fcd02f34640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fccfc112840 con 0x7fccfc102a90 2024-09-21T01:40:21.583 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:21.559+0000 7fcd02f34640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fccfc1126c0 con 0x7fccfc1083d0 2024-09-21T01:40:21.583 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:21.559+0000 7fcd02f34640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fccfc1129c0 con 0x7fccfc108d20 2024-09-21T01:40:21.583 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:21.559+0000 7fcd00cd0640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fccfc102a90 0x7fccfc19b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:40:21.583 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:21.559+0000 7fcd00cd0640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fccfc102a90 0x7fccfc19b1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:50874/0 (socket says 172.21.15.83:50874) 2024-09-21T01:40:21.583 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:21.559+0000 7fcd00cd0640 1 -- 172.21.15.83:0/1068541927 learned_addr learned my addr 172.21.15.83:0/1068541927 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:40:21.584 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:21.559+0000 7fccfbfff640 1 --2- 172.21.15.83:0/1068541927 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fccfc1083d0 0x7fccfc19b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:40:21.584 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:21.559+0000 7fcd014d1640 1 --2- 172.21.15.83:0/1068541927 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fccfc108d20 0x7fccfc19bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:40:21.584 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:21.559+0000 7fcd00cd0640 1 -- 172.21.15.83:0/1068541927 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fccfc108d20 msgr2=0x7fccfc19bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:40:21.584 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:21.559+0000 7fcd00cd0640 1 --2- 172.21.15.83:0/1068541927 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fccfc108d20 0x7fccfc19bc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:21.584 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:21.559+0000 7fcd00cd0640 1 -- 172.21.15.83:0/1068541927 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fccfc1083d0 msgr2=0x7fccfc19b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:40:21.584 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:21.559+0000 7fcd00cd0640 1 --2- 172.21.15.83:0/1068541927 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fccfc1083d0 0x7fccfc19b730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:21.584 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:21.559+0000 7fcd00cd0640 1 -- 172.21.15.83:0/1068541927 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccfc1a6480 con 0x7fccfc102a90 2024-09-21T01:40:21.584 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:21.559+0000 7fcd00cd0640 1 --2- 172.21.15.83:0/1068541927 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fccfc102a90 0x7fccfc19b1f0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fccec009230 tx=0x7fccec004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:40:21.585 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:21.559+0000 7fccf9ffb640 1 -- 172.21.15.83:0/1068541927 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccec03f030 con 0x7fccfc102a90 2024-09-21T01:40:21.585 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:21.559+0000 7fccf9ffb640 1 -- 172.21.15.83:0/1068541927 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fccec003a80 con 0x7fccfc102a90 2024-09-21T01:40:21.585 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:21.559+0000 7fcd02f34640 1 -- 172.21.15.83:0/1068541927 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fccfc1a6710 con 0x7fccfc102a90 2024-09-21T01:40:21.585 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:21.559+0000 7fccf9ffb640 1 -- 172.21.15.83:0/1068541927 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccec035070 con 0x7fccfc102a90 2024-09-21T01:40:21.585 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:21.560+0000 7fcd02f34640 1 -- 172.21.15.83:0/1068541927 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fccfc1a6bf0 con 0x7fccfc102a90 2024-09-21T01:40:21.585 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:21.560+0000 7fcd02f34640 1 -- 172.21.15.83:0/1068541927 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fccfc103d10 con 0x7fccfc102a90 2024-09-21T01:40:21.585 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:21.562+0000 7fccf9ffb640 1 -- 172.21.15.83:0/1068541927 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 20) ==== 154529+0+0 (secure 0 0 0) 0x7fccec042030 con 0x7fccfc102a90 2024-09-21T01:40:21.585 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:21.563+0000 7fccf9ffb640 1 --2- 172.21.15.83:0/1068541927 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fcce40b6590 0x7fcce40b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:40:21.586 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:21.563+0000 7fccfbfff640 1 --2- 172.21.15.83:0/1068541927 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fcce40b6590 0x7fcce40b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:40:21.586 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:21.563+0000 7fccf9ffb640 1 -- 172.21.15.83:0/1068541927 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9286+0+0 (secure 0 0 0) 0x7fccec1083c0 con 0x7fccfc102a90 2024-09-21T01:40:21.586 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:21.563+0000 7fccfbfff640 1 --2- 172.21.15.83:0/1068541927 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fcce40b6590 0x7fcce40b8aa0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fccf0005fd0 tx=0x7fccf0005850 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:40:21.586 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:21.566+0000 7fccf9ffb640 1 -- 172.21.15.83:0/1068541927 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fccec0ce830 con 0x7fccfc102a90 2024-09-21T01:40:21.746 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:21.744+0000 7fcd02f34640 1 -- 172.21.15.83:0/1068541927 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fccfc102ea0 con 0x7fccfc102a90 2024-09-21T01:40:21.746 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:21.745+0000 7fccf9ffb640 1 -- 172.21.15.83:0/1068541927 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+25050 (secure 0 0 0) 0x7fccec0d2c10 con 0x7fccfc102a90 2024-09-21T01:40:21.746 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T01:40:21.747 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":82,"fsid":"f7697ecc-77b8-11ef-baf5-efdc52797490","created":"2024-09-21T01:31:22.250342+0000","modified":"2024-09-21T01:40:09.823827+0000","last_up_change":"2024-09-21T01:38:53.501659+0000","last_in_change":"2024-09-21T01:38:30.688516+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T01:35:06.977668+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T01:39:41.041950+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T01:39:42.882272+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T01:39:49.320532+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"66947512-01ee-4bf0-87b0-98a168cf50dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":3563457494},{"type":"v1","addr":"172.21.15.83:6803","nonce":3563457494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":3563457494},{"type":"v1","addr":"172.21.15.83:6805","nonce":3563457494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":3563457494},{"type":"v1","addr":"172.21.15.83:6809","nonce":3563457494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":3563457494},{"type":"v1","addr":"172.21.15.83:6807","nonce":3563457494}]},"public_addr":"172.21.15.83:6803/3563457494","cluster_addr":"172.21.15.83:6805/3563457494","heartbeat_back_addr":"172.21.15.83:6809/3563457494","heartbeat_front_addr":"172.21.15.83:6807/3563457494","state":["exists","up"]},{"osd":1,"uuid":"f7818a08-86a5-412d-a164-cfeb18f8650a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":2066870220},{"type":"v1","addr":"172.21.15.119:6801","nonce":2066870220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":2066870220},{"type":"v1","addr":"172.21.15.119:6803","nonce":2066870220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":2066870220},{"type":"v1","addr":"172.21.15.119:6807","nonce":2066870220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":2066870220},{"type":"v1","addr":"172.21.15.119:6805","nonce":2066870220}]},"public_addr":"172.21.15.119:6801/2066870220","cluster_addr":"172.21.15.119:6803/2066870220","heartbeat_back_addr":"172.21.15.119:6807/2066870220","heartbeat_front_addr":"172.21.15.119:6805/2066870220","state":["exists","up"]},{"osd":2,"uuid":"0d1a3870-c67a-4783-85f9-be2bb36f7722","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":3955936117},{"type":"v1","addr":"172.21.15.142:6801","nonce":3955936117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3955936117},{"type":"v1","addr":"172.21.15.142:6803","nonce":3955936117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":3955936117},{"type":"v1","addr":"172.21.15.142:6807","nonce":3955936117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":3955936117},{"type":"v1","addr":"172.21.15.142:6805","nonce":3955936117}]},"public_addr":"172.21.15.142:6801/3955936117","cluster_addr":"172.21.15.142:6803/3955936117","heartbeat_back_addr":"172.21.15.142:6807/3955936117","heartbeat_front_addr":"172.21.15.142:6805/3955936117","state":["exists","up"]},{"osd":3,"uuid":"a4cb1a36-3495-4d36-92da-ed3b6e852d14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":3746834093},{"type":"v1","addr":"172.21.15.83:6811","nonce":3746834093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":3746834093},{"type":"v1","addr":"172.21.15.83:6813","nonce":3746834093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":3746834093},{"type":"v1","addr":"172.21.15.83:6817","nonce":3746834093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":3746834093},{"type":"v1","addr":"172.21.15.83:6815","nonce":3746834093}]},"public_addr":"172.21.15.83:6811/3746834093","cluster_addr":"172.21.15.83:6813/3746834093","heartbeat_back_addr":"172.21.15.83:6817/3746834093","heartbeat_front_addr":"172.21.15.83:6815/3746834093","state":["exists","up"]},{"osd":4,"uuid":"d6f2ec78-7f08-473b-a96c-e8590f5d2f25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":3083907785},{"type":"v1","addr":"172.21.15.119:6809","nonce":3083907785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":3083907785},{"type":"v1","addr":"172.21.15.119:6811","nonce":3083907785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":3083907785},{"type":"v1","addr":"172.21.15.119:6815","nonce":3083907785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":3083907785},{"type":"v1","addr":"172.21.15.119:6813","nonce":3083907785}]},"public_addr":"172.21.15.119:6809/3083907785","cluster_addr":"172.21.15.119:6811/3083907785","heartbeat_back_addr":"172.21.15.119:6815/3083907785","heartbeat_front_addr":"172.21.15.119:6813/3083907785","state":["exists","up"]},{"osd":5,"uuid":"c571d04d-d3ea-4d74-8867-e4c7816f4e0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":349001002},{"type":"v1","addr":"172.21.15.142:6809","nonce":349001002}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":349001002},{"type":"v1","addr":"172.21.15.142:6811","nonce":349001002}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":349001002},{"type":"v1","addr":"172.21.15.142:6815","nonce":349001002}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":349001002},{"type":"v1","addr":"172.21.15.142:6813","nonce":349001002}]},"public_addr":"172.21.15.142:6809/349001002","cluster_addr":"172.21.15.142:6811/349001002","heartbeat_back_addr":"172.21.15.142:6815/349001002","heartbeat_front_addr":"172.21.15.142:6813/349001002","state":["exists","up"]},{"osd":6,"uuid":"6e1b6fe9-700a-448a-b382-59b97896ea7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":771651063},{"type":"v1","addr":"172.21.15.83:6819","nonce":771651063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":771651063},{"type":"v1","addr":"172.21.15.83:6821","nonce":771651063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":771651063},{"type":"v1","addr":"172.21.15.83:6825","nonce":771651063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":771651063},{"type":"v1","addr":"172.21.15.83:6823","nonce":771651063}]},"public_addr":"172.21.15.83:6819/771651063","cluster_addr":"172.21.15.83:6821/771651063","heartbeat_back_addr":"172.21.15.83:6825/771651063","heartbeat_front_addr":"172.21.15.83:6823/771651063","state":["exists","up"]},{"osd":7,"uuid":"283bfae4-5f50-4f9e-860e-bbfd47e005e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":1556984819},{"type":"v1","addr":"172.21.15.119:6817","nonce":1556984819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":1556984819},{"type":"v1","addr":"172.21.15.119:6819","nonce":1556984819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":1556984819},{"type":"v1","addr":"172.21.15.119:6823","nonce":1556984819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":1556984819},{"type":"v1","addr":"172.21.15.119:6821","nonce":1556984819}]},"public_addr":"172.21.15.119:6817/1556984819","cluster_addr":"172.21.15.119:6819/1556984819","heartbeat_back_addr":"172.21.15.119:6823/1556984819","heartbeat_front_addr":"172.21.15.119:6821/1556984819","state":["exists","up"]},{"osd":8,"uuid":"d46e56d4-ed4e-42c3-a315-66af014bd93a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":1860679473},{"type":"v1","addr":"172.21.15.142:6817","nonce":1860679473}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":1860679473},{"type":"v1","addr":"172.21.15.142:6819","nonce":1860679473}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":1860679473},{"type":"v1","addr":"172.21.15.142:6823","nonce":1860679473}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":1860679473},{"type":"v1","addr":"172.21.15.142:6821","nonce":1860679473}]},"public_addr":"172.21.15.142:6817/1860679473","cluster_addr":"172.21.15.142:6819/1860679473","heartbeat_back_addr":"172.21.15.142:6823/1860679473","heartbeat_front_addr":"172.21.15.142:6821/1860679473","state":["exists","up"]},{"osd":9,"uuid":"18a70ee6-56df-4f5c-868d-5db5e72a1859","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":3636757924},{"type":"v1","addr":"172.21.15.83:6827","nonce":3636757924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":3636757924},{"type":"v1","addr":"172.21.15.83:6829","nonce":3636757924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6832","nonce":3636757924},{"type":"v1","addr":"172.21.15.83:6833","nonce":3636757924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":3636757924},{"type":"v1","addr":"172.21.15.83:6831","nonce":3636757924}]},"public_addr":"172.21.15.83:6827/3636757924","cluster_addr":"172.21.15.83:6829/3636757924","heartbeat_back_addr":"172.21.15.83:6833/3636757924","heartbeat_front_addr":"172.21.15.83:6831/3636757924","state":["exists","up"]},{"osd":10,"uuid":"0d32c3de-db03-42c3-9914-07d675aaa339","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":2561963910},{"type":"v1","addr":"172.21.15.119:6825","nonce":2561963910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":2561963910},{"type":"v1","addr":"172.21.15.119:6827","nonce":2561963910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2561963910},{"type":"v1","addr":"172.21.15.119:6831","nonce":2561963910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2561963910},{"type":"v1","addr":"172.21.15.119:6829","nonce":2561963910}]},"public_addr":"172.21.15.119:6825/2561963910","cluster_addr":"172.21.15.119:6827/2561963910","heartbeat_back_addr":"172.21.15.119:6831/2561963910","heartbeat_front_addr":"172.21.15.119:6829/2561963910","state":["exists","up"]},{"osd":11,"uuid":"3a3b444d-b316-4256-bfad-378db29f0824","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":1174646198},{"type":"v1","addr":"172.21.15.142:6825","nonce":1174646198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":1174646198},{"type":"v1","addr":"172.21.15.142:6827","nonce":1174646198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1174646198},{"type":"v1","addr":"172.21.15.142:6831","nonce":1174646198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1174646198},{"type":"v1","addr":"172.21.15.142:6829","nonce":1174646198}]},"public_addr":"172.21.15.142:6825/1174646198","cluster_addr":"172.21.15.142:6827/1174646198","heartbeat_back_addr":"172.21.15.142:6831/1174646198","heartbeat_front_addr":"172.21.15.142:6829/1174646198","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:34:15.337672+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:34:39.259716+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:35:03.348886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:35:29.465711+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:35:53.744378+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:36:19.488785+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:36:45.708616+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:37:11.501065+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:37:36.027277+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:38:01.903625+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:38:27.215212+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:38:51.891278+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.e","mappings":[{"from":4,"to":8},{"from":5,"to":9}]},{"pgid":"3.11","mappings":[{"from":4,"to":6}]},{"pgid":"4.3","mappings":[{"from":5,"to":8}]},{"pgid":"4.10","mappings":[{"from":9,"to":8}]},{"pgid":"4.12","mappings":[{"from":9,"to":10}]},{"pgid":"4.1c","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.83:0/1619062496":"2024-09-22T01:33:08.666525+0000","172.21.15.83:0/2412709299":"2024-09-22T01:31:45.834450+0000","172.21.15.83:6800/4290325964":"2024-09-22T01:31:45.834450+0000","172.21.15.83:6801/4290325964":"2024-09-22T01:31:45.834450+0000","172.21.15.83:0/1440681183":"2024-09-22T01:31:45.834450+0000","172.21.15.83:0/2745413305":"2024-09-22T01:31:45.834450+0000","172.21.15.83:6800/1393748565":"2024-09-22T01:33:08.666525+0000","172.21.15.83:0/110411274":"2024-09-22T01:32:10.073024+0000","172.21.15.83:0/4267551123":"2024-09-22T01:33:08.666525+0000","172.21.15.83:0/1068434643":"2024-09-22T01:32:10.073024+0000","172.21.15.83:6800/2963261730":"2024-09-22T01:32:10.073024+0000","172.21.15.83:0/3544333975":"2024-09-22T01:32:10.073024+0000","172.21.15.83:6801/1393748565":"2024-09-22T01:33:08.666525+0000","172.21.15.83:6801/2963261730":"2024-09-22T01:32:10.073024+0000","172.21.15.83:0/1915285091":"2024-09-22T01:33:08.666525+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T01:40:21.748 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:21.747+0000 7fcd02f34640 1 -- 172.21.15.83:0/1068541927 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fcce40b6590 msgr2=0x7fcce40b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:40:21.748 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:21.747+0000 7fcd02f34640 1 --2- 172.21.15.83:0/1068541927 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fcce40b6590 0x7fcce40b8aa0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fccf0005fd0 tx=0x7fccf0005850 comp rx=0 tx=0).stop 2024-09-21T01:40:21.748 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:21.747+0000 7fcd02f34640 1 -- 172.21.15.83:0/1068541927 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fccfc102a90 msgr2=0x7fccfc19b1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:40:21.748 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:21.747+0000 7fcd02f34640 1 --2- 172.21.15.83:0/1068541927 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fccfc102a90 0x7fccfc19b1f0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fccec009230 tx=0x7fccec004270 comp rx=0 tx=0).stop 2024-09-21T01:40:21.748 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:21.748+0000 7fcd02f34640 1 -- 172.21.15.83:0/1068541927 shutdown_connections 2024-09-21T01:40:21.748 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:21.748+0000 7fcd02f34640 1 --2- 172.21.15.83:0/1068541927 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fcce40b6590 0x7fcce40b8aa0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:21.749 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:21.748+0000 7fcd02f34640 1 --2- 172.21.15.83:0/1068541927 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fccfc108d20 0x7fccfc19bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:21.749 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:21.748+0000 7fcd02f34640 1 --2- 172.21.15.83:0/1068541927 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fccfc1083d0 0x7fccfc19b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:21.749 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:21.748+0000 7fcd02f34640 1 --2- 172.21.15.83:0/1068541927 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fccfc102a90 0x7fccfc19b1f0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:21.749 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:21.748+0000 7fcd02f34640 1 -- 172.21.15.83:0/1068541927 >> 172.21.15.83:0/1068541927 conn(0x7fccfc079750 msgr2=0x7fccfc101500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:40:21.749 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:21.748+0000 7fcd02f34640 1 -- 172.21.15.83:0/1068541927 shutdown_connections 2024-09-21T01:40:21.749 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:21.748+0000 7fcd02f34640 1 -- 172.21.15.83:0/1068541927 wait complete. 2024-09-21T01:40:22.053 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:40:21 smithi083 ceph-mon[31370]: pgmap v286: 129 pgs: 129 active+clean; 581 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 280 B/s wr, 0 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T01:40:22.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:40:21 smithi083 ceph-mon[31370]: from='client.? 172.21.15.83:0/1068541927' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T01:40:22.116 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:40:21 smithi142 ceph-mon[34050]: pgmap v286: 129 pgs: 129 active+clean; 581 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 280 B/s wr, 0 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T01:40:22.116 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:40:21 smithi142 ceph-mon[34050]: from='client.? 172.21.15.83:0/1068541927' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T01:40:22.119 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:40:21 smithi119 ceph-mon[33693]: pgmap v286: 129 pgs: 129 active+clean; 581 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 280 B/s wr, 0 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T01:40:22.119 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:40:21 smithi119 ceph-mon[33693]: from='client.? 172.21.15.83:0/1068541927' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T01:40:22.466 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph fs set cephfs standby_count_wanted 0 2024-09-21T01:40:22.721 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:40:23.053 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:40:22 smithi083 ceph-mon[31370]: pgmap v287: 129 pgs: 129 active+clean; 581 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 0 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T01:40:23.168 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:23.154+0000 7f714dc83640 1 -- 172.21.15.83:0/1228862714 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7148108d20 msgr2=0x7f714810f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:40:23.168 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:23.154+0000 7f714dc83640 1 --2- 172.21.15.83:0/1228862714 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7148108d20 0x7f714810f550 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f7140009ca0 tx=0x7f714002a8c0 comp rx=0 tx=0).stop 2024-09-21T01:40:23.168 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:23.154+0000 7f714dc83640 1 -- 172.21.15.83:0/1228862714 shutdown_connections 2024-09-21T01:40:23.168 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:23.154+0000 7f714dc83640 1 --2- 172.21.15.83:0/1228862714 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7148108d20 0x7f714810f550 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:23.168 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:23.154+0000 7f714dc83640 1 --2- 172.21.15.83:0/1228862714 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f71481083d0 0x7f71481087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:23.168 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:23.154+0000 7f714dc83640 1 --2- 172.21.15.83:0/1228862714 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7148102ae0 0x7f7148102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:23.168 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:23.154+0000 7f714dc83640 1 -- 172.21.15.83:0/1228862714 >> 172.21.15.83:0/1228862714 conn(0x7f71480797b0 msgr2=0x7f7148079bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:40:23.168 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:23.154+0000 7f714dc83640 1 -- 172.21.15.83:0/1228862714 shutdown_connections 2024-09-21T01:40:23.168 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:23.154+0000 7f714dc83640 1 -- 172.21.15.83:0/1228862714 wait complete. 2024-09-21T01:40:23.168 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:23.155+0000 7f714dc83640 1 Processor -- start 2024-09-21T01:40:23.169 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:23.155+0000 7f714dc83640 1 -- start start 2024-09-21T01:40:23.169 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:23.155+0000 7f714dc83640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7148102ae0 0x7f71481992b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:40:23.169 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:23.155+0000 7f714dc83640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f71481083d0 0x7f7148199850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:40:23.169 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:23.155+0000 7f714dc83640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7148108d20 0x7f714819eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:40:23.169 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:23.155+0000 7f714dc83640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f71481128e0 con 0x7f71481083d0 2024-09-21T01:40:23.169 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:23.155+0000 7f714dc83640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f7148112760 con 0x7f7148108d20 2024-09-21T01:40:23.169 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:23.155+0000 7f714dc83640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f7148112a60 con 0x7f7148102ae0 2024-09-21T01:40:23.169 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:23.155+0000 7f713ffff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f71481083d0 0x7f7148199850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:40:23.169 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:23.155+0000 7f713ffff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f71481083d0 0x7f7148199850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:34374/0 (socket says 172.21.15.83:34374) 2024-09-21T01:40:23.169 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:23.155+0000 7f713ffff640 1 -- 172.21.15.83:0/836186645 learned_addr learned my addr 172.21.15.83:0/836186645 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:40:23.169 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:23.156+0000 7f7147fff640 1 --2- 172.21.15.83:0/836186645 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7148108d20 0x7f714819eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:40:23.169 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:23.156+0000 7f71477fe640 1 --2- 172.21.15.83:0/836186645 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7148102ae0 0x7f71481992b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:40:23.169 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:23.156+0000 7f713ffff640 1 -- 172.21.15.83:0/836186645 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7148102ae0 msgr2=0x7f71481992b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:40:23.170 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:23.156+0000 7f713ffff640 1 --2- 172.21.15.83:0/836186645 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7148102ae0 0x7f71481992b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:23.170 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:23.156+0000 7f713ffff640 1 -- 172.21.15.83:0/836186645 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7148108d20 msgr2=0x7f714819eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:40:23.170 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:23.156+0000 7f713ffff640 1 --2- 172.21.15.83:0/836186645 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7148108d20 0x7f714819eaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:23.170 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:23.156+0000 7f713ffff640 1 -- 172.21.15.83:0/836186645 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f714819f220 con 0x7f71481083d0 2024-09-21T01:40:23.170 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:23.156+0000 7f713ffff640 1 --2- 172.21.15.83:0/836186645 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f71481083d0 0x7f7148199850 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f713000e9f0 tx=0x7f713000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:40:23.170 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:23.156+0000 7f71457fa640 1 -- 172.21.15.83:0/836186645 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f713000ccc0 con 0x7f71481083d0 2024-09-21T01:40:23.170 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:23.156+0000 7f71457fa640 1 -- 172.21.15.83:0/836186645 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f71300108c0 con 0x7f71481083d0 2024-09-21T01:40:23.170 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:23.156+0000 7f714dc83640 1 -- 172.21.15.83:0/836186645 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f714819f510 con 0x7f71481083d0 2024-09-21T01:40:23.170 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:23.156+0000 7f71457fa640 1 -- 172.21.15.83:0/836186645 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7130018750 con 0x7f71481083d0 2024-09-21T01:40:23.170 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:23.156+0000 7f714dc83640 1 -- 172.21.15.83:0/836186645 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71481a5c70 con 0x7f71481083d0 2024-09-21T01:40:23.170 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:23.157+0000 7f714dc83640 1 -- 172.21.15.83:0/836186645 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7148102ef0 con 0x7f71481083d0 2024-09-21T01:40:23.170 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:23.159+0000 7f71457fa640 1 -- 172.21.15.83:0/836186645 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 20) ==== 154529+0+0 (secure 0 0 0) 0x7f7130010430 con 0x7f71481083d0 2024-09-21T01:40:23.170 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:23.159+0000 7f71457fa640 1 --2- 172.21.15.83:0/836186645 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f71340b6560 0x7f71340b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:40:23.171 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:23.160+0000 7f71477fe640 1 --2- 172.21.15.83:0/836186645 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f71340b6560 0x7f71340b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:40:23.171 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:23.160+0000 7f71457fa640 1 -- 172.21.15.83:0/836186645 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9286+0+0 (secure 0 0 0) 0x7f71300e7b10 con 0x7f71481083d0 2024-09-21T01:40:23.171 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:23.160+0000 7f71477fe640 1 --2- 172.21.15.83:0/836186645 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f71340b6560 0x7f71340b8a70 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f7138009bd0 tx=0x7f7138005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:40:23.171 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:23.164+0000 7f71457fa640 1 -- 172.21.15.83:0/836186645 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f71300b2360 con 0x7f71481083d0 2024-09-21T01:40:23.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:40:22 smithi142 ceph-mon[34050]: pgmap v287: 129 pgs: 129 active+clean; 581 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 0 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T01:40:23.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:40:22 smithi119 ceph-mon[33693]: pgmap v287: 129 pgs: 129 active+clean; 581 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 0 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T01:40:23.387 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:23.386+0000 7f714dc83640 1 -- 172.21.15.83:0/836186645 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f714802e640 con 0x7f71481083d0 2024-09-21T01:40:23.927 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:23.926+0000 7f71457fa640 1 -- 172.21.15.83:0/836186645 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v18) ==== 118+0+0 (secure 0 0 0) 0x7f71300b72a0 con 0x7f71481083d0 2024-09-21T01:40:23.929 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:23.929+0000 7f714dc83640 1 -- 172.21.15.83:0/836186645 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f71340b6560 msgr2=0x7f71340b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:40:23.929 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:23.929+0000 7f714dc83640 1 --2- 172.21.15.83:0/836186645 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f71340b6560 0x7f71340b8a70 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f7138009bd0 tx=0x7f7138005f90 comp rx=0 tx=0).stop 2024-09-21T01:40:23.929 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:23.929+0000 7f714dc83640 1 -- 172.21.15.83:0/836186645 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f71481083d0 msgr2=0x7f7148199850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:40:23.929 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:23.929+0000 7f714dc83640 1 --2- 172.21.15.83:0/836186645 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f71481083d0 0x7f7148199850 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f713000e9f0 tx=0x7f713000eeb0 comp rx=0 tx=0).stop 2024-09-21T01:40:23.930 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:23.929+0000 7f714dc83640 1 -- 172.21.15.83:0/836186645 shutdown_connections 2024-09-21T01:40:23.930 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:23.929+0000 7f714dc83640 1 --2- 172.21.15.83:0/836186645 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f71340b6560 0x7f71340b8a70 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:23.930 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:23.929+0000 7f714dc83640 1 --2- 172.21.15.83:0/836186645 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7148108d20 0x7f714819eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:23.930 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:23.929+0000 7f714dc83640 1 --2- 172.21.15.83:0/836186645 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f71481083d0 0x7f7148199850 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:23.930 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:23.929+0000 7f714dc83640 1 --2- 172.21.15.83:0/836186645 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7148102ae0 0x7f71481992b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:23.930 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:23.929+0000 7f714dc83640 1 -- 172.21.15.83:0/836186645 >> 172.21.15.83:0/836186645 conn(0x7f71480797b0 msgr2=0x7f71481043e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:40:23.930 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:23.929+0000 7f714dc83640 1 -- 172.21.15.83:0/836186645 shutdown_connections 2024-09-21T01:40:23.930 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:23.929+0000 7f714dc83640 1 -- 172.21.15.83:0/836186645 wait complete. 2024-09-21T01:40:24.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:40:23 smithi083 ceph-mon[31370]: from='client.? 172.21.15.83:0/836186645' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2024-09-21T01:40:24.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:40:23 smithi142 ceph-mon[34050]: from='client.? 172.21.15.83:0/836186645' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2024-09-21T01:40:24.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:40:23 smithi119 ceph-mon[33693]: from='client.? 172.21.15.83:0/836186645' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2024-09-21T01:40:24.528 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 1, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated'}} 2024-09-21T01:40:24.529 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph fs set cephfs allow_standby_replay true 2024-09-21T01:40:24.779 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:40:25.161 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:40:24 smithi083 ceph-mon[31370]: from='client.? 172.21.15.83:0/836186645' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-21T01:40:25.162 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:40:24 smithi083 ceph-mon[31370]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T01:40:25.162 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:40:24 smithi083 ceph-mon[31370]: pgmap v288: 129 pgs: 129 active+clean; 581 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 0 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T01:40:25.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:40:24 smithi142 ceph-mon[34050]: from='client.? 172.21.15.83:0/836186645' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-21T01:40:25.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:40:24 smithi142 ceph-mon[34050]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T01:40:25.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:40:24 smithi142 ceph-mon[34050]: pgmap v288: 129 pgs: 129 active+clean; 581 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 0 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T01:40:25.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:40:24 smithi119 ceph-mon[33693]: from='client.? 172.21.15.83:0/836186645' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-21T01:40:25.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:40:24 smithi119 ceph-mon[33693]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T01:40:25.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:40:24 smithi119 ceph-mon[33693]: pgmap v288: 129 pgs: 129 active+clean; 581 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 0 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T01:40:25.255 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:25.254+0000 7fa919d65640 1 -- 172.21.15.83:0/3433893757 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa914102a80 msgr2=0x7fa914102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:40:25.255 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:25.254+0000 7fa919d65640 1 --2- 172.21.15.83:0/3433893757 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa914102a80 0x7fa914102e90 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fa904009900 tx=0x7fa90402a410 comp rx=0 tx=0).stop 2024-09-21T01:40:25.255 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:25.254+0000 7fa919d65640 1 -- 172.21.15.83:0/3433893757 shutdown_connections 2024-09-21T01:40:25.255 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:25.254+0000 7fa919d65640 1 --2- 172.21.15.83:0/3433893757 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa914108d10 0x7fa91410f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:25.255 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:25.254+0000 7fa919d65640 1 --2- 172.21.15.83:0/3433893757 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa9141083c0 0x7fa9141087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:25.255 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:25.254+0000 7fa919d65640 1 --2- 172.21.15.83:0/3433893757 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa914102a80 0x7fa914102e90 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:25.255 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:25.254+0000 7fa919d65640 1 -- 172.21.15.83:0/3433893757 >> 172.21.15.83:0/3433893757 conn(0x7fa914079740 msgr2=0x7fa914079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:40:25.256 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:25.254+0000 7fa919d65640 1 -- 172.21.15.83:0/3433893757 shutdown_connections 2024-09-21T01:40:25.256 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:25.254+0000 7fa919d65640 1 -- 172.21.15.83:0/3433893757 wait complete. 2024-09-21T01:40:25.256 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:25.255+0000 7fa919d65640 1 Processor -- start 2024-09-21T01:40:25.256 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:25.255+0000 7fa919d65640 1 -- start start 2024-09-21T01:40:25.257 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:25.255+0000 7fa919d65640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa914102a80 0x7fa914199320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:40:25.257 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:25.255+0000 7fa919d65640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa9141083c0 0x7fa9141998c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:40:25.257 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:25.255+0000 7fa919d65640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa914108d10 0x7fa91419eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:40:25.257 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:25.255+0000 7fa919d65640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fa914112830 con 0x7fa9141083c0 2024-09-21T01:40:25.257 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:25.255+0000 7fa919d65640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fa9141126b0 con 0x7fa914102a80 2024-09-21T01:40:25.257 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:25.255+0000 7fa919d65640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fa9141129b0 con 0x7fa914108d10 2024-09-21T01:40:25.258 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:25.255+0000 7fa912ffd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa9141083c0 0x7fa9141998c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:40:25.258 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:25.255+0000 7fa912ffd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa9141083c0 0x7fa9141998c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:34390/0 (socket says 172.21.15.83:34390) 2024-09-21T01:40:25.258 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:25.255+0000 7fa912ffd640 1 -- 172.21.15.83:0/756474481 learned_addr learned my addr 172.21.15.83:0/756474481 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:40:25.258 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:25.255+0000 7fa9137fe640 1 --2- 172.21.15.83:0/756474481 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa914102a80 0x7fa914199320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:40:25.258 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:25.255+0000 7fa913fff640 1 --2- 172.21.15.83:0/756474481 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa914108d10 0x7fa91419eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:40:25.258 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:25.256+0000 7fa912ffd640 1 -- 172.21.15.83:0/756474481 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa914108d10 msgr2=0x7fa91419eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:40:25.258 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:25.256+0000 7fa912ffd640 1 --2- 172.21.15.83:0/756474481 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa914108d10 0x7fa91419eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:25.258 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:25.256+0000 7fa912ffd640 1 -- 172.21.15.83:0/756474481 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa914102a80 msgr2=0x7fa914199320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:40:25.258 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:25.256+0000 7fa912ffd640 1 --2- 172.21.15.83:0/756474481 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa914102a80 0x7fa914199320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:25.258 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:25.256+0000 7fa912ffd640 1 -- 172.21.15.83:0/756474481 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa91419f290 con 0x7fa9141083c0 2024-09-21T01:40:25.258 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:25.256+0000 7fa912ffd640 1 --2- 172.21.15.83:0/756474481 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa9141083c0 0x7fa9141998c0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fa90800c970 tx=0x7fa90800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:40:25.258 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:25.256+0000 7fa910ff9640 1 -- 172.21.15.83:0/756474481 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa908007bb0 con 0x7fa9141083c0 2024-09-21T01:40:25.258 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:25.256+0000 7fa910ff9640 1 -- 172.21.15.83:0/756474481 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa908007d50 con 0x7fa9141083c0 2024-09-21T01:40:25.258 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:25.256+0000 7fa919d65640 1 -- 172.21.15.83:0/756474481 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa91419f580 con 0x7fa9141083c0 2024-09-21T01:40:25.259 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:25.256+0000 7fa910ff9640 1 -- 172.21.15.83:0/756474481 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa908004e10 con 0x7fa9141083c0 2024-09-21T01:40:25.259 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:25.256+0000 7fa919d65640 1 -- 172.21.15.83:0/756474481 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa91406bb40 con 0x7fa9141083c0 2024-09-21T01:40:25.259 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:25.257+0000 7fa919d65640 1 -- 172.21.15.83:0/756474481 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa914103d00 con 0x7fa9141083c0 2024-09-21T01:40:25.259 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:25.259+0000 7fa910ff9640 1 -- 172.21.15.83:0/756474481 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 20) ==== 154529+0+0 (secure 0 0 0) 0x7fa908005000 con 0x7fa9141083c0 2024-09-21T01:40:25.260 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:25.259+0000 7fa910ff9640 1 --2- 172.21.15.83:0/756474481 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fa8fc0b6560 0x7fa8fc0b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:40:25.260 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:25.259+0000 7fa9137fe640 1 --2- 172.21.15.83:0/756474481 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fa8fc0b6560 0x7fa8fc0b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:40:25.260 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:25.259+0000 7fa910ff9640 1 -- 172.21.15.83:0/756474481 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9286+0+0 (secure 0 0 0) 0x7fa9080e77a0 con 0x7fa9141083c0 2024-09-21T01:40:25.260 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:25.260+0000 7fa9137fe640 1 --2- 172.21.15.83:0/756474481 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fa8fc0b6560 0x7fa8fc0b8a70 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fa9040057c0 tx=0x7fa9040058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:40:25.264 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:25.264+0000 7fa910ff9640 1 -- 172.21.15.83:0/756474481 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa908014030 con 0x7fa9141083c0 2024-09-21T01:40:25.479 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:25.478+0000 7fa919d65640 1 -- 172.21.15.83:0/756474481 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7fa91406c5c0 con 0x7fa9141083c0 2024-09-21T01:40:25.939 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:25.938+0000 7fa910ff9640 1 -- 172.21.15.83:0/756474481 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v19) ==== 121+0+0 (secure 0 0 0) 0x7fa9080b1ff0 con 0x7fa9141083c0 2024-09-21T01:40:25.942 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:25.942+0000 7fa919d65640 1 -- 172.21.15.83:0/756474481 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fa8fc0b6560 msgr2=0x7fa8fc0b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:40:25.943 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:25.942+0000 7fa919d65640 1 --2- 172.21.15.83:0/756474481 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fa8fc0b6560 0x7fa8fc0b8a70 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fa9040057c0 tx=0x7fa9040058d0 comp rx=0 tx=0).stop 2024-09-21T01:40:25.943 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:25.942+0000 7fa919d65640 1 -- 172.21.15.83:0/756474481 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa9141083c0 msgr2=0x7fa9141998c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:40:25.943 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:25.942+0000 7fa919d65640 1 --2- 172.21.15.83:0/756474481 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa9141083c0 0x7fa9141998c0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fa90800c970 tx=0x7fa90800ce30 comp rx=0 tx=0).stop 2024-09-21T01:40:25.943 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:25.942+0000 7fa919d65640 1 -- 172.21.15.83:0/756474481 shutdown_connections 2024-09-21T01:40:25.943 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:25.942+0000 7fa919d65640 1 --2- 172.21.15.83:0/756474481 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fa8fc0b6560 0x7fa8fc0b8a70 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:25.943 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:25.942+0000 7fa919d65640 1 --2- 172.21.15.83:0/756474481 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa914108d10 0x7fa91419eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:25.943 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:25.942+0000 7fa919d65640 1 --2- 172.21.15.83:0/756474481 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa9141083c0 0x7fa9141998c0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:25.943 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:25.942+0000 7fa919d65640 1 --2- 172.21.15.83:0/756474481 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa914102a80 0x7fa914199320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:25.943 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:25.942+0000 7fa919d65640 1 -- 172.21.15.83:0/756474481 >> 172.21.15.83:0/756474481 conn(0x7fa914079740 msgr2=0x7fa9141016c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:40:25.943 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:25.942+0000 7fa919d65640 1 -- 172.21.15.83:0/756474481 shutdown_connections 2024-09-21T01:40:25.943 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:25.942+0000 7fa919d65640 1 -- 172.21.15.83:0/756474481 wait complete. 2024-09-21T01:40:26.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:40:25 smithi142 ceph-mon[34050]: from='client.? 172.21.15.83:0/756474481' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2024-09-21T01:40:26.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:40:25 smithi119 ceph-mon[33693]: from='client.? 172.21.15.83:0/756474481' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2024-09-21T01:40:26.256 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:40:25 smithi083 ceph-mon[31370]: from='client.? 172.21.15.83:0/756474481' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2024-09-21T01:40:26.695 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph fs set cephfs session_timeout 300 2024-09-21T01:40:26.944 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:40:27.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:40:26 smithi083 ceph-mon[31370]: from='client.? 172.21.15.83:0/756474481' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-21T01:40:27.211 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:40:26 smithi083 ceph-mon[31370]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T01:40:27.212 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:40:26 smithi083 ceph-mon[31370]: fsmap cephfs:1 {0=b=up:active} 1 up:standby-replay 10 up:standby 2024-09-21T01:40:27.212 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:40:26 smithi083 ceph-mon[31370]: pgmap v289: 129 pgs: 129 active+clean; 581 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s rd, 0 op/s 2024-09-21T01:40:27.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:40:26 smithi142 ceph-mon[34050]: from='client.? 172.21.15.83:0/756474481' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-21T01:40:27.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:40:26 smithi142 ceph-mon[34050]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T01:40:27.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:40:26 smithi142 ceph-mon[34050]: fsmap cephfs:1 {0=b=up:active} 1 up:standby-replay 10 up:standby 2024-09-21T01:40:27.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:40:26 smithi142 ceph-mon[34050]: pgmap v289: 129 pgs: 129 active+clean; 581 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s rd, 0 op/s 2024-09-21T01:40:27.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:40:26 smithi119 ceph-mon[33693]: from='client.? 172.21.15.83:0/756474481' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-21T01:40:27.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:40:26 smithi119 ceph-mon[33693]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T01:40:27.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:40:26 smithi119 ceph-mon[33693]: fsmap cephfs:1 {0=b=up:active} 1 up:standby-replay 10 up:standby 2024-09-21T01:40:27.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:40:26 smithi119 ceph-mon[33693]: pgmap v289: 129 pgs: 129 active+clean; 581 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s rd, 0 op/s 2024-09-21T01:40:27.446 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:27.438+0000 7fef4ebd3640 1 -- 172.21.15.83:0/3055958698 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fef481083a0 msgr2=0x7fef481087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:40:27.446 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:27.438+0000 7fef4ebd3640 1 --2- 172.21.15.83:0/3055958698 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fef481083a0 0x7fef481087b0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fef38009900 tx=0x7fef3802a410 comp rx=0 tx=0).stop 2024-09-21T01:40:27.446 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:27.438+0000 7fef4ebd3640 1 -- 172.21.15.83:0/3055958698 shutdown_connections 2024-09-21T01:40:27.446 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:27.438+0000 7fef4ebd3640 1 --2- 172.21.15.83:0/3055958698 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fef48108cf0 0x7fef4810f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:27.446 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:27.438+0000 7fef4ebd3640 1 --2- 172.21.15.83:0/3055958698 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fef481083a0 0x7fef481087b0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:27.447 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:27.438+0000 7fef4ebd3640 1 --2- 172.21.15.83:0/3055958698 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fef48102a60 0x7fef48102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:27.447 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:27.438+0000 7fef4ebd3640 1 -- 172.21.15.83:0/3055958698 >> 172.21.15.83:0/3055958698 conn(0x7fef48079730 msgr2=0x7fef48079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:40:27.447 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:27.438+0000 7fef4ebd3640 1 -- 172.21.15.83:0/3055958698 shutdown_connections 2024-09-21T01:40:27.447 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:27.438+0000 7fef4ebd3640 1 -- 172.21.15.83:0/3055958698 wait complete. 2024-09-21T01:40:27.447 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:27.439+0000 7fef4ebd3640 1 Processor -- start 2024-09-21T01:40:27.447 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:27.439+0000 7fef4ebd3640 1 -- start start 2024-09-21T01:40:27.447 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:27.439+0000 7fef4ebd3640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fef48102a60 0x7fef481992a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:40:27.447 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:27.439+0000 7fef4ebd3640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fef481083a0 0x7fef48199840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:40:27.447 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:27.439+0000 7fef4ebd3640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fef48108cf0 0x7fef4819eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:40:27.447 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:27.439+0000 7fef4ebd3640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fef48112810 con 0x7fef481083a0 2024-09-21T01:40:27.447 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:27.439+0000 7fef4ebd3640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fef48112690 con 0x7fef48108cf0 2024-09-21T01:40:27.447 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:27.439+0000 7fef4ebd3640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fef48112990 con 0x7fef48102a60 2024-09-21T01:40:27.447 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:27.439+0000 7fef3ffff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fef481083a0 0x7fef48199840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:40:27.447 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:27.439+0000 7fef3ffff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fef481083a0 0x7fef48199840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:34418/0 (socket says 172.21.15.83:34418) 2024-09-21T01:40:27.448 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:27.439+0000 7fef3ffff640 1 -- 172.21.15.83:0/3376191481 learned_addr learned my addr 172.21.15.83:0/3376191481 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:40:27.448 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:27.439+0000 7fef4c96f640 1 --2- 172.21.15.83:0/3376191481 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fef48102a60 0x7fef481992a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:40:27.448 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:27.439+0000 7fef4d170640 1 --2- 172.21.15.83:0/3376191481 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fef48108cf0 0x7fef4819eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:40:27.448 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:27.440+0000 7fef3ffff640 1 -- 172.21.15.83:0/3376191481 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fef48102a60 msgr2=0x7fef481992a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:40:27.448 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:27.440+0000 7fef3ffff640 1 --2- 172.21.15.83:0/3376191481 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fef48102a60 0x7fef481992a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:27.448 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:27.440+0000 7fef3ffff640 1 -- 172.21.15.83:0/3376191481 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fef48108cf0 msgr2=0x7fef4819eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:40:27.448 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:27.440+0000 7fef3ffff640 1 --2- 172.21.15.83:0/3376191481 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fef48108cf0 0x7fef4819eae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:27.448 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:27.440+0000 7fef3ffff640 1 -- 172.21.15.83:0/3376191481 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef4819f210 con 0x7fef481083a0 2024-09-21T01:40:27.448 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:27.440+0000 7fef3ffff640 1 --2- 172.21.15.83:0/3376191481 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fef481083a0 0x7fef48199840 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fef38005940 tx=0x7fef380042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:40:27.448 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:27.440+0000 7fef3dffb640 1 -- 172.21.15.83:0/3376191481 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef3803f030 con 0x7fef481083a0 2024-09-21T01:40:27.448 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:27.440+0000 7fef3dffb640 1 -- 172.21.15.83:0/3376191481 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fef38003c90 con 0x7fef481083a0 2024-09-21T01:40:27.448 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:27.440+0000 7fef4ebd3640 1 -- 172.21.15.83:0/3376191481 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef4819f4a0 con 0x7fef481083a0 2024-09-21T01:40:27.448 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:27.440+0000 7fef3dffb640 1 -- 172.21.15.83:0/3376191481 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef38035070 con 0x7fef481083a0 2024-09-21T01:40:27.448 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:27.440+0000 7fef4ebd3640 1 -- 172.21.15.83:0/3376191481 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef481a5c60 con 0x7fef481083a0 2024-09-21T01:40:27.448 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:27.441+0000 7fef4ebd3640 1 -- 172.21.15.83:0/3376191481 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef48102e70 con 0x7fef481083a0 2024-09-21T01:40:27.449 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:27.443+0000 7fef3dffb640 1 -- 172.21.15.83:0/3376191481 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 20) ==== 154529+0+0 (secure 0 0 0) 0x7fef38042030 con 0x7fef481083a0 2024-09-21T01:40:27.449 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:27.443+0000 7fef3dffb640 1 --2- 172.21.15.83:0/3376191481 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fef300b6560 0x7fef300b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:40:27.449 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:27.444+0000 7fef4c96f640 1 --2- 172.21.15.83:0/3376191481 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fef300b6560 0x7fef300b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:40:27.449 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:27.444+0000 7fef3dffb640 1 -- 172.21.15.83:0/3376191481 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9286+0+0 (secure 0 0 0) 0x7fef38108060 con 0x7fef481083a0 2024-09-21T01:40:27.449 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:27.444+0000 7fef4c96f640 1 --2- 172.21.15.83:0/3376191481 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fef300b6560 0x7fef300b8a70 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fef4400bbe0 tx=0x7fef4400b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:40:27.449 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:27.447+0000 7fef3dffb640 1 -- 172.21.15.83:0/3376191481 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fef380d28b0 con 0x7fef481083a0 2024-09-21T01:40:27.663 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:27.662+0000 7fef4ebd3640 1 -- 172.21.15.83:0/3376191481 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7fef4819a3d0 con 0x7fef481083a0 2024-09-21T01:40:27.954 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:27.953+0000 7fef3dffb640 1 -- 172.21.15.83:0/3376191481 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v21) ==== 115+0+0 (secure 0 0 0) 0x7fef4819a3d0 con 0x7fef481083a0 2024-09-21T01:40:27.956 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:27.956+0000 7fef4ebd3640 1 -- 172.21.15.83:0/3376191481 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fef300b6560 msgr2=0x7fef300b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:40:27.957 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:27.956+0000 7fef4ebd3640 1 --2- 172.21.15.83:0/3376191481 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fef300b6560 0x7fef300b8a70 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fef4400bbe0 tx=0x7fef4400b390 comp rx=0 tx=0).stop 2024-09-21T01:40:27.957 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:27.956+0000 7fef4ebd3640 1 -- 172.21.15.83:0/3376191481 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fef481083a0 msgr2=0x7fef48199840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:40:27.957 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:27.956+0000 7fef4ebd3640 1 --2- 172.21.15.83:0/3376191481 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fef481083a0 0x7fef48199840 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fef38005940 tx=0x7fef380042f0 comp rx=0 tx=0).stop 2024-09-21T01:40:27.957 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:27.956+0000 7fef4ebd3640 1 -- 172.21.15.83:0/3376191481 shutdown_connections 2024-09-21T01:40:27.957 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:27.956+0000 7fef4ebd3640 1 --2- 172.21.15.83:0/3376191481 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fef300b6560 0x7fef300b8a70 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:27.957 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:27.956+0000 7fef4ebd3640 1 --2- 172.21.15.83:0/3376191481 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fef48108cf0 0x7fef4819eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:27.957 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:27.956+0000 7fef4ebd3640 1 --2- 172.21.15.83:0/3376191481 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fef481083a0 0x7fef48199840 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:27.957 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:27.956+0000 7fef4ebd3640 1 --2- 172.21.15.83:0/3376191481 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fef48102a60 0x7fef481992a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:27.957 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:27.956+0000 7fef4ebd3640 1 -- 172.21.15.83:0/3376191481 >> 172.21.15.83:0/3376191481 conn(0x7fef48079730 msgr2=0x7fef48104460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:40:27.957 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:27.956+0000 7fef4ebd3640 1 -- 172.21.15.83:0/3376191481 shutdown_connections 2024-09-21T01:40:27.957 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:27.956+0000 7fef4ebd3640 1 -- 172.21.15.83:0/3376191481 wait complete. 2024-09-21T01:40:28.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:40:27 smithi142 ceph-mon[34050]: from='client.? 172.21.15.83:0/3376191481' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2024-09-21T01:40:28.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:40:27 smithi119 ceph-mon[33693]: from='client.? 172.21.15.83:0/3376191481' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2024-09-21T01:40:28.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:40:27 smithi083 ceph-mon[31370]: from='client.? 172.21.15.83:0/3376191481' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2024-09-21T01:40:28.749 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2, 'subvol_options': '--namespace-isolated'} subvols for filesystem 'cephfs' 2024-09-21T01:40:28.750 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph fs subvolumegroup create cephfs qa 2024-09-21T01:40:29.003 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:40:29.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:40:28 smithi083 ceph-mon[31370]: from='client.? 172.21.15.83:0/3376191481' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-21T01:40:29.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:40:28 smithi083 ceph-mon[31370]: fsmap cephfs:1 {0=b=up:active} 1 up:standby-replay 10 up:standby 2024-09-21T01:40:29.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:40:28 smithi083 ceph-mon[31370]: pgmap v290: 129 pgs: 129 active+clean; 581 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s rd, 0 op/s 2024-09-21T01:40:29.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:40:28 smithi142 ceph-mon[34050]: from='client.? 172.21.15.83:0/3376191481' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-21T01:40:29.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:40:28 smithi142 ceph-mon[34050]: fsmap cephfs:1 {0=b=up:active} 1 up:standby-replay 10 up:standby 2024-09-21T01:40:29.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:40:28 smithi142 ceph-mon[34050]: pgmap v290: 129 pgs: 129 active+clean; 581 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s rd, 0 op/s 2024-09-21T01:40:29.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:40:28 smithi119 ceph-mon[33693]: from='client.? 172.21.15.83:0/3376191481' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-21T01:40:29.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:40:28 smithi119 ceph-mon[33693]: fsmap cephfs:1 {0=b=up:active} 1 up:standby-replay 10 up:standby 2024-09-21T01:40:29.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:40:28 smithi119 ceph-mon[33693]: pgmap v290: 129 pgs: 129 active+clean; 581 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s rd, 0 op/s 2024-09-21T01:40:29.500 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:29.500+0000 7f8584319640 1 -- 172.21.15.83:0/1605392335 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f857c108460 msgr2=0x7f857c108870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:40:29.501 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:29.500+0000 7f8584319640 1 --2- 172.21.15.83:0/1605392335 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f857c108460 0x7f857c108870 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f856c009900 tx=0x7f856c02a410 comp rx=0 tx=0).stop 2024-09-21T01:40:29.501 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:29.500+0000 7f8584319640 1 -- 172.21.15.83:0/1605392335 shutdown_connections 2024-09-21T01:40:29.501 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:29.500+0000 7f8584319640 1 --2- 172.21.15.83:0/1605392335 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f857c108db0 0x7f857c10f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:29.501 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:29.500+0000 7f8584319640 1 --2- 172.21.15.83:0/1605392335 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f857c108460 0x7f857c108870 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:29.501 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:29.500+0000 7f8584319640 1 --2- 172.21.15.83:0/1605392335 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f857c103230 0x7f857c103640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:29.501 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:29.500+0000 7f8584319640 1 -- 172.21.15.83:0/1605392335 >> 172.21.15.83:0/1605392335 conn(0x7f857c079ec0 msgr2=0x7f857c07a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:40:29.501 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:29.500+0000 7f8584319640 1 -- 172.21.15.83:0/1605392335 shutdown_connections 2024-09-21T01:40:29.501 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:29.500+0000 7f8584319640 1 -- 172.21.15.83:0/1605392335 wait complete. 2024-09-21T01:40:29.503 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:29.501+0000 7f8584319640 1 Processor -- start 2024-09-21T01:40:29.503 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:29.501+0000 7f8584319640 1 -- start start 2024-09-21T01:40:29.503 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:29.501+0000 7f8584319640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f857c103230 0x7f857c19a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:40:29.503 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:29.501+0000 7f8584319640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f857c108460 0x7f857c19aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:40:29.503 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:29.501+0000 7f8584319640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f857c108db0 0x7f857c19fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:40:29.504 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:29.501+0000 7f8584319640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f857c113a40 con 0x7f857c103230 2024-09-21T01:40:29.504 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:29.501+0000 7f8584319640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f857c1138c0 con 0x7f857c108db0 2024-09-21T01:40:29.504 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:29.501+0000 7f8584319640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f857c113bc0 con 0x7f857c108460 2024-09-21T01:40:29.504 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:29.501+0000 7f85820b5640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f857c103230 0x7f857c19a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:40:29.504 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:29.501+0000 7f85820b5640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f857c103230 0x7f857c19a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:34432/0 (socket says 172.21.15.83:34432) 2024-09-21T01:40:29.504 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:29.501+0000 7f85820b5640 1 -- 172.21.15.83:0/3049817823 learned_addr learned my addr 172.21.15.83:0/3049817823 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:40:29.504 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:29.501+0000 7f85818b4640 1 --2- 172.21.15.83:0/3049817823 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f857c108460 0x7f857c19aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:40:29.504 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:29.501+0000 7f85828b6640 1 --2- 172.21.15.83:0/3049817823 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f857c108db0 0x7f857c19fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:40:29.504 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:29.501+0000 7f85820b5640 1 -- 172.21.15.83:0/3049817823 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f857c108460 msgr2=0x7f857c19aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:40:29.504 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:29.501+0000 7f85820b5640 1 --2- 172.21.15.83:0/3049817823 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f857c108460 0x7f857c19aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:29.504 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:29.501+0000 7f85820b5640 1 -- 172.21.15.83:0/3049817823 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f857c108db0 msgr2=0x7f857c19fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:40:29.504 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:29.501+0000 7f85820b5640 1 --2- 172.21.15.83:0/3049817823 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f857c108db0 0x7f857c19fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:29.504 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:29.501+0000 7f85820b5640 1 -- 172.21.15.83:0/3049817823 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f857c1a0340 con 0x7f857c103230 2024-09-21T01:40:29.504 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:29.501+0000 7f85828b6640 1 --2- 172.21.15.83:0/3049817823 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f857c108db0 0x7f857c19fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:40:29.504 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:29.501+0000 7f85818b4640 1 --2- 172.21.15.83:0/3049817823 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f857c108460 0x7f857c19aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:40:29.505 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:29.502+0000 7f85820b5640 1 --2- 172.21.15.83:0/3049817823 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f857c103230 0x7f857c19a490 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f857800ea80 tx=0x7f857800ef40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:40:29.505 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:29.502+0000 7f85737fe640 1 -- 172.21.15.83:0/3049817823 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f857800ce40 con 0x7f857c103230 2024-09-21T01:40:29.505 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:29.502+0000 7f85737fe640 1 -- 172.21.15.83:0/3049817823 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8578005020 con 0x7f857c103230 2024-09-21T01:40:29.505 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:29.502+0000 7f85737fe640 1 -- 172.21.15.83:0/3049817823 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85780116d0 con 0x7f857c103230 2024-09-21T01:40:29.505 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:29.502+0000 7f8584319640 1 -- 172.21.15.83:0/3049817823 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f857c1a0630 con 0x7f857c103230 2024-09-21T01:40:29.505 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:29.502+0000 7f8584319640 1 -- 172.21.15.83:0/3049817823 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f857c1a0af0 con 0x7f857c103230 2024-09-21T01:40:29.505 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:29.503+0000 7f8584319640 1 -- 172.21.15.83:0/3049817823 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f857c103640 con 0x7f857c103230 2024-09-21T01:40:29.505 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:29.504+0000 7f85737fe640 1 -- 172.21.15.83:0/3049817823 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 20) ==== 154529+0+0 (secure 0 0 0) 0x7f8578004a40 con 0x7f857c103230 2024-09-21T01:40:29.505 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:29.505+0000 7f85737fe640 1 --2- 172.21.15.83:0/3049817823 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f85680b6610 0x7f85680b8b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:40:29.506 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:29.505+0000 7f85818b4640 1 --2- 172.21.15.83:0/3049817823 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f85680b6610 0x7f85680b8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:40:29.506 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:29.505+0000 7f85737fe640 1 -- 172.21.15.83:0/3049817823 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9286+0+0 (secure 0 0 0) 0x7f85780e7dd0 con 0x7f857c103230 2024-09-21T01:40:29.506 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:29.506+0000 7f85818b4640 1 --2- 172.21.15.83:0/3049817823 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f85680b6610 0x7f85680b8b20 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f856c0057c0 tx=0x7f856c009680 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:40:29.508 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:29.508+0000 7f85737fe640 1 -- 172.21.15.83:0/3049817823 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8578016030 con 0x7f857c103230 2024-09-21T01:40:29.709 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:29.709+0000 7f8584319640 1 -- 172.21.15.83:0/3049817823 --> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f857c063800 con 0x7f85680b6610 2024-09-21T01:40:29.731 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:29.730+0000 7f85737fe640 1 -- 172.21.15.83:0/3049817823 <== mgr.14223 v2:172.21.15.83:6800/1748483157 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f857c063800 con 0x7f85680b6610 2024-09-21T01:40:29.733 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:29.732+0000 7f8584319640 1 -- 172.21.15.83:0/3049817823 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f85680b6610 msgr2=0x7f85680b8b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:40:29.733 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:29.733+0000 7f8584319640 1 --2- 172.21.15.83:0/3049817823 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f85680b6610 0x7f85680b8b20 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f856c0057c0 tx=0x7f856c009680 comp rx=0 tx=0).stop 2024-09-21T01:40:29.733 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:29.733+0000 7f8584319640 1 -- 172.21.15.83:0/3049817823 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f857c103230 msgr2=0x7f857c19a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:40:29.733 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:29.733+0000 7f8584319640 1 --2- 172.21.15.83:0/3049817823 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f857c103230 0x7f857c19a490 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f857800ea80 tx=0x7f857800ef40 comp rx=0 tx=0).stop 2024-09-21T01:40:29.733 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:29.733+0000 7f8584319640 1 -- 172.21.15.83:0/3049817823 shutdown_connections 2024-09-21T01:40:29.733 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:29.733+0000 7f8584319640 1 --2- 172.21.15.83:0/3049817823 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f85680b6610 0x7f85680b8b20 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:29.734 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:29.733+0000 7f8584319640 1 --2- 172.21.15.83:0/3049817823 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f857c108db0 0x7f857c19fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:29.734 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:29.733+0000 7f8584319640 1 --2- 172.21.15.83:0/3049817823 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f857c108460 0x7f857c19aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:29.734 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:29.733+0000 7f8584319640 1 --2- 172.21.15.83:0/3049817823 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f857c103230 0x7f857c19a490 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:29.734 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:29.733+0000 7f8584319640 1 -- 172.21.15.83:0/3049817823 >> 172.21.15.83:0/3049817823 conn(0x7f857c079ec0 msgr2=0x7f857c104580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:40:29.734 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:29.733+0000 7f8584319640 1 -- 172.21.15.83:0/3049817823 shutdown_connections 2024-09-21T01:40:29.734 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:29.733+0000 7f8584319640 1 -- 172.21.15.83:0/3049817823 wait complete. 2024-09-21T01:40:29.963 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 21 01:40:29 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mgr-x[31598]: 2024-09-21T01:40:29.714+0000 7f4320b1a640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T01:40:29.963 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 21 01:40:29 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mgr-x[31598]: 2024-09-21T01:40:29.714+0000 7f4320b1a640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T01:40:29.963 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 21 01:40:29 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mgr-x[31598]: 2024-09-21T01:40:29.714+0000 7f4320b1a640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T01:40:29.963 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 21 01:40:29 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mgr-x[31598]: 2024-09-21T01:40:29.714+0000 7f4320b1a640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T01:40:29.963 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 21 01:40:29 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mgr-x[31598]: 2024-09-21T01:40:29.714+0000 7f4320b1a640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T01:40:30.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:40:29 smithi142 ceph-mon[34050]: from='client.15021 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:40:30.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:40:29 smithi119 ceph-mon[33693]: from='client.15021 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:40:30.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:40:29 smithi083 ceph-mon[31370]: from='client.15021 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:40:30.410 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph fs subvolume create cephfs sv_0 --group_name qa 2024-09-21T01:40:30.656 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:40:31.053 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:40:30 smithi083 ceph-mon[31370]: pgmap v291: 129 pgs: 129 active+clean; 581 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 1 op/s 2024-09-21T01:40:31.196 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:31.180+0000 7f4177244640 1 -- 172.21.15.83:0/3768355391 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4170108cf0 msgr2=0x7f417010f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:40:31.196 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:31.180+0000 7f4177244640 1 --2- 172.21.15.83:0/3768355391 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4170108cf0 0x7f417010f520 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f4168009ca0 tx=0x7f416802a8c0 comp rx=0 tx=0).stop 2024-09-21T01:40:31.196 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:31.180+0000 7f4177244640 1 -- 172.21.15.83:0/3768355391 shutdown_connections 2024-09-21T01:40:31.196 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:31.180+0000 7f4177244640 1 --2- 172.21.15.83:0/3768355391 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4170108cf0 0x7f417010f520 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:31.196 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:31.180+0000 7f4177244640 1 --2- 172.21.15.83:0/3768355391 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f41701083a0 0x7f41701087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:31.197 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:31.180+0000 7f4177244640 1 --2- 172.21.15.83:0/3768355391 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4170102a60 0x7f4170102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:31.197 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:31.180+0000 7f4177244640 1 -- 172.21.15.83:0/3768355391 >> 172.21.15.83:0/3768355391 conn(0x7f4170079730 msgr2=0x7f4170079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:40:31.197 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:31.180+0000 7f4177244640 1 -- 172.21.15.83:0/3768355391 shutdown_connections 2024-09-21T01:40:31.197 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:31.180+0000 7f4177244640 1 -- 172.21.15.83:0/3768355391 wait complete. 2024-09-21T01:40:31.197 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:31.180+0000 7f4177244640 1 Processor -- start 2024-09-21T01:40:31.197 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:31.181+0000 7f4177244640 1 -- start start 2024-09-21T01:40:31.197 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:31.181+0000 7f4177244640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4170102a60 0x7f417019a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:40:31.197 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:31.181+0000 7f4177244640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f41701083a0 0x7f417019a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:40:31.197 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:31.181+0000 7f4177244640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4170108cf0 0x7f417019fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:40:31.197 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:31.181+0000 7f4177244640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f41701128c0 con 0x7f41701083a0 2024-09-21T01:40:31.197 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:31.181+0000 7f4177244640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f4170112740 con 0x7f4170102a60 2024-09-21T01:40:31.197 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:31.181+0000 7f4177244640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f4170112a40 con 0x7f4170108cf0 2024-09-21T01:40:31.197 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:31.181+0000 7f416ffff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f41701083a0 0x7f417019a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:40:31.197 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:31.181+0000 7f416ffff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f41701083a0 0x7f417019a940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:34470/0 (socket says 172.21.15.83:34470) 2024-09-21T01:40:31.198 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:31.181+0000 7f416ffff640 1 -- 172.21.15.83:0/156139597 learned_addr learned my addr 172.21.15.83:0/156139597 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:40:31.198 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:31.181+0000 7f4174fe0640 1 --2- 172.21.15.83:0/156139597 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4170102a60 0x7f417019a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:40:31.198 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:31.181+0000 7f41757e1640 1 --2- 172.21.15.83:0/156139597 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4170108cf0 0x7f417019fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:40:31.198 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:31.181+0000 7f416ffff640 1 -- 172.21.15.83:0/156139597 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4170108cf0 msgr2=0x7f417019fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:40:31.198 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:31.181+0000 7f416ffff640 1 --2- 172.21.15.83:0/156139597 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4170108cf0 0x7f417019fbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:31.198 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:31.181+0000 7f416ffff640 1 -- 172.21.15.83:0/156139597 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4170102a60 msgr2=0x7f417019a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:40:31.198 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:31.181+0000 7f416ffff640 1 --2- 172.21.15.83:0/156139597 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4170102a60 0x7f417019a3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:31.198 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:31.181+0000 7f416ffff640 1 -- 172.21.15.83:0/156139597 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41701a0310 con 0x7f41701083a0 2024-09-21T01:40:31.198 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:31.181+0000 7f4174fe0640 1 --2- 172.21.15.83:0/156139597 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4170102a60 0x7f417019a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:40:31.198 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:31.182+0000 7f416ffff640 1 --2- 172.21.15.83:0/156139597 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f41701083a0 0x7f417019a940 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f415c00b450 tx=0x7f415c00b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:40:31.198 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:31.182+0000 7f416dffb640 1 -- 172.21.15.83:0/156139597 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f415c015020 con 0x7f41701083a0 2024-09-21T01:40:31.198 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:31.182+0000 7f416dffb640 1 -- 172.21.15.83:0/156139597 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f415c011d20 con 0x7f41701083a0 2024-09-21T01:40:31.198 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:31.182+0000 7f416dffb640 1 -- 172.21.15.83:0/156139597 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f415c010e10 con 0x7f41701083a0 2024-09-21T01:40:31.199 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:31.182+0000 7f4177244640 1 -- 172.21.15.83:0/156139597 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41701a0600 con 0x7f41701083a0 2024-09-21T01:40:31.199 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:31.182+0000 7f4177244640 1 -- 172.21.15.83:0/156139597 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41701a6d60 con 0x7f41701083a0 2024-09-21T01:40:31.199 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:31.183+0000 7f4177244640 1 -- 172.21.15.83:0/156139597 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4170102e70 con 0x7f41701083a0 2024-09-21T01:40:31.199 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:31.184+0000 7f416dffb640 1 -- 172.21.15.83:0/156139597 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7f415c018020 con 0x7f41701083a0 2024-09-21T01:40:31.199 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:31.185+0000 7f416dffb640 1 --2- 172.21.15.83:0/156139597 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f41600b6670 0x7f41600b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:40:31.199 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:31.185+0000 7f4174fe0640 1 --2- 172.21.15.83:0/156139597 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f41600b6670 0x7f41600b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:40:31.199 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:31.186+0000 7f416dffb640 1 -- 172.21.15.83:0/156139597 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9286+0+0 (secure 0 0 0) 0x7f415c0e7380 con 0x7f41701083a0 2024-09-21T01:40:31.199 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:31.186+0000 7f4174fe0640 1 --2- 172.21.15.83:0/156139597 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f41600b6670 0x7f41600b8b80 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f41640058c0 tx=0x7f4164005ec0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:40:31.199 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:31.190+0000 7f416dffb640 1 -- 172.21.15.83:0/156139597 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f415c01f020 con 0x7f41701083a0 2024-09-21T01:40:31.398 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:31.398+0000 7f4177244640 1 -- 172.21.15.83:0/156139597 --> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f41700ff7e0 con 0x7f41600b6670 2024-09-21T01:40:31.426 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:31.426+0000 7f416dffb640 1 -- 172.21.15.83:0/156139597 <== mgr.14223 v2:172.21.15.83:6800/1748483157 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f41700ff7e0 con 0x7f41600b6670 2024-09-21T01:40:31.429 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:31.428+0000 7f4177244640 1 -- 172.21.15.83:0/156139597 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f41600b6670 msgr2=0x7f41600b8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:40:31.429 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:31.428+0000 7f4177244640 1 --2- 172.21.15.83:0/156139597 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f41600b6670 0x7f41600b8b80 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f41640058c0 tx=0x7f4164005ec0 comp rx=0 tx=0).stop 2024-09-21T01:40:31.429 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:31.428+0000 7f4177244640 1 -- 172.21.15.83:0/156139597 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f41701083a0 msgr2=0x7f417019a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:40:31.429 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:31.428+0000 7f4177244640 1 --2- 172.21.15.83:0/156139597 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f41701083a0 0x7f417019a940 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f415c00b450 tx=0x7f415c00b910 comp rx=0 tx=0).stop 2024-09-21T01:40:31.429 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:31.428+0000 7f4177244640 1 -- 172.21.15.83:0/156139597 shutdown_connections 2024-09-21T01:40:31.429 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:31.428+0000 7f4177244640 1 --2- 172.21.15.83:0/156139597 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f41600b6670 0x7f41600b8b80 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:31.429 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:31.428+0000 7f4177244640 1 --2- 172.21.15.83:0/156139597 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4170108cf0 0x7f417019fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:31.429 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:31.428+0000 7f4177244640 1 --2- 172.21.15.83:0/156139597 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f41701083a0 0x7f417019a940 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:31.429 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:31.428+0000 7f4177244640 1 --2- 172.21.15.83:0/156139597 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4170102a60 0x7f417019a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:31.429 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:31.429+0000 7f4177244640 1 -- 172.21.15.83:0/156139597 >> 172.21.15.83:0/156139597 conn(0x7f4170079730 msgr2=0x7f4170100ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:40:31.430 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:31.429+0000 7f4177244640 1 -- 172.21.15.83:0/156139597 shutdown_connections 2024-09-21T01:40:31.430 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:31.429+0000 7f4177244640 1 -- 172.21.15.83:0/156139597 wait complete. 2024-09-21T01:40:31.464 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:40:30 smithi142 ceph-mon[34050]: pgmap v291: 129 pgs: 129 active+clean; 581 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 1 op/s 2024-09-21T01:40:31.467 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:40:30 smithi119 ceph-mon[33693]: pgmap v291: 129 pgs: 129 active+clean; 581 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 1 op/s 2024-09-21T01:40:32.116 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:40:31 smithi083 ceph-mon[31370]: mgrmap e21: x(active, since 7m), standbys: z, y 2024-09-21T01:40:32.116 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:40:31 smithi083 ceph-mon[31370]: from='client.15033 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:40:32.143 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-09-21T01:40:32.392 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:40:32.464 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:40:31 smithi142 ceph-mon[34050]: mgrmap e21: x(active, since 7m), standbys: z, y 2024-09-21T01:40:32.465 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:40:31 smithi142 ceph-mon[34050]: from='client.15033 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:40:32.467 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:40:31 smithi119 ceph-mon[33693]: mgrmap e21: x(active, since 7m), standbys: z, y 2024-09-21T01:40:32.468 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:40:31 smithi119 ceph-mon[33693]: from='client.15033 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:40:32.873 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:32.867+0000 7fb52a2af640 1 -- 172.21.15.83:0/639874728 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb524102a60 msgr2=0x7fb524102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:40:32.873 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:32.867+0000 7fb52a2af640 1 --2- 172.21.15.83:0/639874728 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb524102a60 0x7fb524102e70 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fb514009900 tx=0x7fb51402a410 comp rx=0 tx=0).stop 2024-09-21T01:40:32.873 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:32.867+0000 7fb52a2af640 1 -- 172.21.15.83:0/639874728 shutdown_connections 2024-09-21T01:40:32.873 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:32.867+0000 7fb52a2af640 1 --2- 172.21.15.83:0/639874728 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb524108cf0 0x7fb52410f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:32.873 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:32.867+0000 7fb52a2af640 1 --2- 172.21.15.83:0/639874728 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb5241083a0 0x7fb5241087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:32.873 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:32.867+0000 7fb52a2af640 1 --2- 172.21.15.83:0/639874728 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb524102a60 0x7fb524102e70 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:32.873 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:32.867+0000 7fb52a2af640 1 -- 172.21.15.83:0/639874728 >> 172.21.15.83:0/639874728 conn(0x7fb524079730 msgr2=0x7fb524079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:40:32.873 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:32.867+0000 7fb52a2af640 1 -- 172.21.15.83:0/639874728 shutdown_connections 2024-09-21T01:40:32.873 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:32.867+0000 7fb52a2af640 1 -- 172.21.15.83:0/639874728 wait complete. 2024-09-21T01:40:32.873 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:32.868+0000 7fb52a2af640 1 Processor -- start 2024-09-21T01:40:32.873 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:32.868+0000 7fb52a2af640 1 -- start start 2024-09-21T01:40:32.874 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:32.869+0000 7fb52a2af640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb524102a60 0x7fb52419a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:40:32.874 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:32.869+0000 7fb52a2af640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb5241083a0 0x7fb52419a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:40:32.874 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:32.869+0000 7fb52a2af640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb524108cf0 0x7fb52419fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:40:32.874 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:32.869+0000 7fb52a2af640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fb524113930 con 0x7fb524102a60 2024-09-21T01:40:32.874 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:32.869+0000 7fb52a2af640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fb5241137b0 con 0x7fb524108cf0 2024-09-21T01:40:32.874 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:32.869+0000 7fb52a2af640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fb524113ab0 con 0x7fb5241083a0 2024-09-21T01:40:32.874 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:32.869+0000 7fb523fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb524102a60 0x7fb52419a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:40:32.874 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:32.869+0000 7fb523fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb524102a60 0x7fb52419a3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:34500/0 (socket says 172.21.15.83:34500) 2024-09-21T01:40:32.874 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:32.869+0000 7fb523fff640 1 -- 172.21.15.83:0/3657681573 learned_addr learned my addr 172.21.15.83:0/3657681573 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:40:32.874 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:32.869+0000 7fb5237fe640 1 --2- 172.21.15.83:0/3657681573 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb5241083a0 0x7fb52419a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:40:32.874 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:32.869+0000 7fb52884c640 1 --2- 172.21.15.83:0/3657681573 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb524108cf0 0x7fb52419fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:40:32.874 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:32.869+0000 7fb523fff640 1 -- 172.21.15.83:0/3657681573 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb5241083a0 msgr2=0x7fb52419a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:40:32.874 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:32.869+0000 7fb523fff640 1 --2- 172.21.15.83:0/3657681573 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb5241083a0 0x7fb52419a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:32.875 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:32.869+0000 7fb523fff640 1 -- 172.21.15.83:0/3657681573 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb524108cf0 msgr2=0x7fb52419fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:40:32.875 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:32.869+0000 7fb523fff640 1 --2- 172.21.15.83:0/3657681573 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb524108cf0 0x7fb52419fc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:32.875 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:32.869+0000 7fb523fff640 1 -- 172.21.15.83:0/3657681573 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5241a0290 con 0x7fb524102a60 2024-09-21T01:40:32.875 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:32.869+0000 7fb523fff640 1 --2- 172.21.15.83:0/3657681573 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb524102a60 0x7fb52419a3e0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fb514009230 tx=0x7fb514004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:40:32.875 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:32.869+0000 7fb5217fa640 1 -- 172.21.15.83:0/3657681573 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb51403f030 con 0x7fb524102a60 2024-09-21T01:40:32.875 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:32.869+0000 7fb52a2af640 1 -- 172.21.15.83:0/3657681573 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5241a0520 con 0x7fb524102a60 2024-09-21T01:40:32.875 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:32.869+0000 7fb5217fa640 1 -- 172.21.15.83:0/3657681573 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb514003a80 con 0x7fb524102a60 2024-09-21T01:40:32.875 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:32.869+0000 7fb5217fa640 1 -- 172.21.15.83:0/3657681573 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb514035070 con 0x7fb524102a60 2024-09-21T01:40:32.875 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:32.870+0000 7fb52a2af640 1 -- 172.21.15.83:0/3657681573 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5241a0a00 con 0x7fb524102a60 2024-09-21T01:40:32.875 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:32.871+0000 7fb52a2af640 1 -- 172.21.15.83:0/3657681573 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb524102e70 con 0x7fb524102a60 2024-09-21T01:40:32.876 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:32.873+0000 7fb5217fa640 1 -- 172.21.15.83:0/3657681573 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7fb514042030 con 0x7fb524102a60 2024-09-21T01:40:32.876 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:32.874+0000 7fb5217fa640 1 --2- 172.21.15.83:0/3657681573 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fb50c0b6620 0x7fb50c0b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:40:32.876 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:32.874+0000 7fb5237fe640 1 --2- 172.21.15.83:0/3657681573 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fb50c0b6620 0x7fb50c0b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:40:32.876 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:32.874+0000 7fb5217fa640 1 -- 172.21.15.83:0/3657681573 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9286+0+0 (secure 0 0 0) 0x7fb5141084b0 con 0x7fb524102a60 2024-09-21T01:40:32.876 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:32.874+0000 7fb5237fe640 1 --2- 172.21.15.83:0/3657681573 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fb50c0b6620 0x7fb50c0b8b30 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fb524100d90 tx=0x7fb51800a2d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:40:32.877 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:32.877+0000 7fb5217fa640 1 -- 172.21.15.83:0/3657681573 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb5140ce760 con 0x7fb524102a60 2024-09-21T01:40:33.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:40:33 smithi083 ceph-mon[31370]: pgmap v292: 129 pgs: 129 active+clean; 581 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T01:40:33.086 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:33.086+0000 7fb52a2af640 1 -- 172.21.15.83:0/3657681573 --> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7fb524063800 con 0x7fb50c0b6620 2024-09-21T01:40:33.092 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:33.092+0000 7fb5217fa640 1 -- 172.21.15.83:0/3657681573 <== mgr.14223 v2:172.21.15.83:6800/1748483157 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7fb524063800 con 0x7fb50c0b6620 2024-09-21T01:40:33.092 INFO:teuthology.orchestra.run.smithi083.stdout:/volumes/qa/sv_0/d2f98f10-db6a-4a15-b493-6d0ac8493e5a 2024-09-21T01:40:33.094 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:33.094+0000 7fb52a2af640 1 -- 172.21.15.83:0/3657681573 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fb50c0b6620 msgr2=0x7fb50c0b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:40:33.095 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:33.094+0000 7fb52a2af640 1 --2- 172.21.15.83:0/3657681573 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fb50c0b6620 0x7fb50c0b8b30 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fb524100d90 tx=0x7fb51800a2d0 comp rx=0 tx=0).stop 2024-09-21T01:40:33.095 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:33.094+0000 7fb52a2af640 1 -- 172.21.15.83:0/3657681573 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb524102a60 msgr2=0x7fb52419a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:40:33.095 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:33.094+0000 7fb52a2af640 1 --2- 172.21.15.83:0/3657681573 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb524102a60 0x7fb52419a3e0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fb514009230 tx=0x7fb514004270 comp rx=0 tx=0).stop 2024-09-21T01:40:33.095 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:33.094+0000 7fb52a2af640 1 -- 172.21.15.83:0/3657681573 shutdown_connections 2024-09-21T01:40:33.095 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:33.094+0000 7fb52a2af640 1 --2- 172.21.15.83:0/3657681573 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fb50c0b6620 0x7fb50c0b8b30 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:33.095 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:33.094+0000 7fb52a2af640 1 --2- 172.21.15.83:0/3657681573 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb524108cf0 0x7fb52419fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:33.095 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:33.094+0000 7fb52a2af640 1 --2- 172.21.15.83:0/3657681573 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb5241083a0 0x7fb52419a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:33.095 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:33.094+0000 7fb52a2af640 1 --2- 172.21.15.83:0/3657681573 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb524102a60 0x7fb52419a3e0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:33.095 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:33.094+0000 7fb52a2af640 1 -- 172.21.15.83:0/3657681573 >> 172.21.15.83:0/3657681573 conn(0x7fb524079730 msgr2=0x7fb5241014f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:40:33.095 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:33.094+0000 7fb52a2af640 1 -- 172.21.15.83:0/3657681573 shutdown_connections 2024-09-21T01:40:33.095 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:33.094+0000 7fb52a2af640 1 -- 172.21.15.83:0/3657681573 wait complete. 2024-09-21T01:40:33.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:40:33 smithi119 ceph-mon[33693]: pgmap v292: 129 pgs: 129 active+clean; 581 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T01:40:33.464 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:40:33 smithi142 ceph-mon[34050]: pgmap v292: 129 pgs: 129 active+clean; 581 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T01:40:33.760 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph fs subvolume create cephfs sv_1 --group_name qa 2024-09-21T01:40:34.010 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:40:34.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:40:34 smithi142 ceph-mon[34050]: from='client.15039 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:40:34.264 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:40:34 smithi083 ceph-mon[31370]: from='client.15039 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:40:34.467 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:40:34 smithi119 ceph-mon[33693]: from='client.15039 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:40:34.483 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:34.475+0000 7f3eaf4d7640 1 -- 172.21.15.83:0/2494689176 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3ea8108420 msgr2=0x7f3ea8108830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:40:34.483 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:34.475+0000 7f3eaf4d7640 1 --2- 172.21.15.83:0/2494689176 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3ea8108420 0x7f3ea8108830 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f3e98009900 tx=0x7f3e9802a410 comp rx=0 tx=0).stop 2024-09-21T01:40:34.483 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:34.475+0000 7f3eaf4d7640 1 -- 172.21.15.83:0/2494689176 shutdown_connections 2024-09-21T01:40:34.483 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:34.475+0000 7f3eaf4d7640 1 --2- 172.21.15.83:0/2494689176 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3ea8108d70 0x7f3ea810f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:34.483 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:34.475+0000 7f3eaf4d7640 1 --2- 172.21.15.83:0/2494689176 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3ea8108420 0x7f3ea8108830 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:34.483 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:34.475+0000 7f3eaf4d7640 1 --2- 172.21.15.83:0/2494689176 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3ea8102ae0 0x7f3ea8102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:34.483 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:34.475+0000 7f3eaf4d7640 1 -- 172.21.15.83:0/2494689176 >> 172.21.15.83:0/2494689176 conn(0x7f3ea8079770 msgr2=0x7f3ea8079b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:40:34.483 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:34.476+0000 7f3eaf4d7640 1 -- 172.21.15.83:0/2494689176 shutdown_connections 2024-09-21T01:40:34.484 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:34.476+0000 7f3eaf4d7640 1 -- 172.21.15.83:0/2494689176 wait complete. 2024-09-21T01:40:34.484 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:34.476+0000 7f3eaf4d7640 1 Processor -- start 2024-09-21T01:40:34.484 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:34.476+0000 7f3eaf4d7640 1 -- start start 2024-09-21T01:40:34.484 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:34.476+0000 7f3eaf4d7640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3ea8102ae0 0x7f3ea819a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:40:34.484 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:34.476+0000 7f3eaf4d7640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3ea8108420 0x7f3ea819a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:40:34.484 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:34.476+0000 7f3eaf4d7640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3ea8108d70 0x7f3ea819fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:40:34.484 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:34.476+0000 7f3eaf4d7640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f3ea81128e0 con 0x7f3ea8102ae0 2024-09-21T01:40:34.484 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:34.476+0000 7f3eaf4d7640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f3ea8112760 con 0x7f3ea8108d70 2024-09-21T01:40:34.484 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:34.477+0000 7f3eaf4d7640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f3ea8112a60 con 0x7f3ea8108420 2024-09-21T01:40:34.484 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:34.477+0000 7f3ead273640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3ea8102ae0 0x7f3ea819a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:40:34.484 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:34.477+0000 7f3ead273640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3ea8102ae0 0x7f3ea819a420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:50152/0 (socket says 172.21.15.83:50152) 2024-09-21T01:40:34.484 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:34.477+0000 7f3ead273640 1 -- 172.21.15.83:0/3238517540 learned_addr learned my addr 172.21.15.83:0/3238517540 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:40:34.484 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:34.477+0000 7f3eaca72640 1 --2- 172.21.15.83:0/3238517540 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3ea8108420 0x7f3ea819a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:40:34.484 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:34.477+0000 7f3eada74640 1 --2- 172.21.15.83:0/3238517540 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3ea8108d70 0x7f3ea819fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:40:34.484 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:34.477+0000 7f3ead273640 1 -- 172.21.15.83:0/3238517540 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3ea8108420 msgr2=0x7f3ea819a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:40:34.485 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:34.477+0000 7f3ead273640 1 --2- 172.21.15.83:0/3238517540 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3ea8108420 0x7f3ea819a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:34.485 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:34.477+0000 7f3ead273640 1 -- 172.21.15.83:0/3238517540 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3ea8108d70 msgr2=0x7f3ea819fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:40:34.485 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:34.477+0000 7f3ead273640 1 --2- 172.21.15.83:0/3238517540 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3ea8108d70 0x7f3ea819fc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:34.485 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:34.477+0000 7f3ead273640 1 -- 172.21.15.83:0/3238517540 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ea81a0390 con 0x7f3ea8102ae0 2024-09-21T01:40:34.485 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:34.477+0000 7f3eada74640 1 --2- 172.21.15.83:0/3238517540 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3ea8108d70 0x7f3ea819fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:40:34.485 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:34.477+0000 7f3ead273640 1 --2- 172.21.15.83:0/3238517540 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3ea8102ae0 0x7f3ea819a420 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f3ea400d950 tx=0x7f3ea400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:40:34.485 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:34.477+0000 7f3e9e7fc640 1 -- 172.21.15.83:0/3238517540 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ea4017070 con 0x7f3ea8102ae0 2024-09-21T01:40:34.485 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:34.477+0000 7f3e9e7fc640 1 -- 172.21.15.83:0/3238517540 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3ea4009c30 con 0x7f3ea8102ae0 2024-09-21T01:40:34.485 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:34.477+0000 7f3eaf4d7640 1 -- 172.21.15.83:0/3238517540 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ea81a0680 con 0x7f3ea8102ae0 2024-09-21T01:40:34.485 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:34.477+0000 7f3e9e7fc640 1 -- 172.21.15.83:0/3238517540 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ea400f620 con 0x7f3ea8102ae0 2024-09-21T01:40:34.485 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:34.477+0000 7f3eaf4d7640 1 -- 172.21.15.83:0/3238517540 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ea81a6de0 con 0x7f3ea8102ae0 2024-09-21T01:40:34.485 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:34.479+0000 7f3eaf4d7640 1 -- 172.21.15.83:0/3238517540 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ea8103d60 con 0x7f3ea8102ae0 2024-09-21T01:40:34.485 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:34.480+0000 7f3e9e7fc640 1 -- 172.21.15.83:0/3238517540 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7f3ea4010460 con 0x7f3ea8102ae0 2024-09-21T01:40:34.485 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:34.480+0000 7f3e9e7fc640 1 --2- 172.21.15.83:0/3238517540 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f3e940b65f0 0x7f3e940b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:40:34.485 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:34.481+0000 7f3eaca72640 1 --2- 172.21.15.83:0/3238517540 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f3e940b65f0 0x7f3e940b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:40:34.486 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:34.481+0000 7f3e9e7fc640 1 -- 172.21.15.83:0/3238517540 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9286+0+0 (secure 0 0 0) 0x7f3ea40e75f0 con 0x7f3ea8102ae0 2024-09-21T01:40:34.486 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:34.481+0000 7f3eaca72640 1 --2- 172.21.15.83:0/3238517540 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f3e940b65f0 0x7f3e940b8b00 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f3e980057c0 tx=0x7f3e98000bc0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:40:34.486 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:34.485+0000 7f3e9e7fc640 1 -- 172.21.15.83:0/3238517540 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3ea40ad900 con 0x7f3ea8102ae0 2024-09-21T01:40:34.690 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:34.690+0000 7f3eaf4d7640 1 -- 172.21.15.83:0/3238517540 --> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f3ea810bbd0 con 0x7f3e940b65f0 2024-09-21T01:40:34.721 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:34.721+0000 7f3e9e7fc640 1 -- 172.21.15.83:0/3238517540 <== mgr.14223 v2:172.21.15.83:6800/1748483157 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f3ea810bbd0 con 0x7f3e940b65f0 2024-09-21T01:40:34.724 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:34.723+0000 7f3eaf4d7640 1 -- 172.21.15.83:0/3238517540 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f3e940b65f0 msgr2=0x7f3e940b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:40:34.724 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:34.723+0000 7f3eaf4d7640 1 --2- 172.21.15.83:0/3238517540 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f3e940b65f0 0x7f3e940b8b00 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f3e980057c0 tx=0x7f3e98000bc0 comp rx=0 tx=0).stop 2024-09-21T01:40:34.724 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:34.723+0000 7f3eaf4d7640 1 -- 172.21.15.83:0/3238517540 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3ea8102ae0 msgr2=0x7f3ea819a420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:40:34.724 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:34.723+0000 7f3eaf4d7640 1 --2- 172.21.15.83:0/3238517540 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3ea8102ae0 0x7f3ea819a420 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f3ea400d950 tx=0x7f3ea400de10 comp rx=0 tx=0).stop 2024-09-21T01:40:34.724 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:34.723+0000 7f3eaf4d7640 1 -- 172.21.15.83:0/3238517540 shutdown_connections 2024-09-21T01:40:34.724 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:34.723+0000 7f3eaf4d7640 1 --2- 172.21.15.83:0/3238517540 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f3e940b65f0 0x7f3e940b8b00 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:34.724 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:34.723+0000 7f3eaf4d7640 1 --2- 172.21.15.83:0/3238517540 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3ea8108d70 0x7f3ea819fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:34.724 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:34.723+0000 7f3eaf4d7640 1 --2- 172.21.15.83:0/3238517540 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3ea8108420 0x7f3ea819a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:34.724 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:34.723+0000 7f3eaf4d7640 1 --2- 172.21.15.83:0/3238517540 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3ea8102ae0 0x7f3ea819a420 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:34.724 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:34.723+0000 7f3eaf4d7640 1 -- 172.21.15.83:0/3238517540 >> 172.21.15.83:0/3238517540 conn(0x7f3ea8079770 msgr2=0x7f3ea8101b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:40:34.724 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:34.723+0000 7f3eaf4d7640 1 -- 172.21.15.83:0/3238517540 shutdown_connections 2024-09-21T01:40:34.724 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:34.723+0000 7f3eaf4d7640 1 -- 172.21.15.83:0/3238517540 wait complete. 2024-09-21T01:40:35.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:40:35 smithi083 ceph-mon[31370]: from='client.15045 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:40:35.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:40:35 smithi083 ceph-mon[31370]: pgmap v293: 129 pgs: 129 active+clean; 603 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 2.2 KiB/s wr, 2 op/s 2024-09-21T01:40:35.432 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-09-21T01:40:35.464 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:40:35 smithi142 ceph-mon[34050]: from='client.15045 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:40:35.465 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:40:35 smithi142 ceph-mon[34050]: pgmap v293: 129 pgs: 129 active+clean; 603 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 2.2 KiB/s wr, 2 op/s 2024-09-21T01:40:35.467 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:40:35 smithi119 ceph-mon[33693]: from='client.15045 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:40:35.467 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:40:35 smithi119 ceph-mon[33693]: pgmap v293: 129 pgs: 129 active+clean; 603 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 2.2 KiB/s wr, 2 op/s 2024-09-21T01:40:35.677 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:40:36.171 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:36.170+0000 7fe74cb9e640 1 -- 172.21.15.83:0/3215439028 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe748109fa0 msgr2=0x7fe74810a3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:40:36.171 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:36.170+0000 7fe74cb9e640 1 --2- 172.21.15.83:0/3215439028 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe748109fa0 0x7fe74810a3b0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fe738009900 tx=0x7fe73802a3f0 comp rx=0 tx=0).stop 2024-09-21T01:40:36.171 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:36.170+0000 7fe74cb9e640 1 -- 172.21.15.83:0/3215439028 shutdown_connections 2024-09-21T01:40:36.171 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:36.170+0000 7fe74cb9e640 1 --2- 172.21.15.83:0/3215439028 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe748110230 0x7fe748116a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:36.171 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:36.170+0000 7fe74cb9e640 1 --2- 172.21.15.83:0/3215439028 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe74810f8e0 0x7fe74810fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:36.171 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:36.170+0000 7fe74cb9e640 1 --2- 172.21.15.83:0/3215439028 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe748109fa0 0x7fe74810a3b0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:36.171 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:36.170+0000 7fe74cb9e640 1 -- 172.21.15.83:0/3215439028 >> 172.21.15.83:0/3215439028 conn(0x7fe748079580 msgr2=0x7fe7481081e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:40:36.172 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:36.170+0000 7fe74cb9e640 1 -- 172.21.15.83:0/3215439028 shutdown_connections 2024-09-21T01:40:36.172 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:36.170+0000 7fe74cb9e640 1 -- 172.21.15.83:0/3215439028 wait complete. 2024-09-21T01:40:36.174 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:36.171+0000 7fe74cb9e640 1 Processor -- start 2024-09-21T01:40:36.174 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:36.171+0000 7fe74cb9e640 1 -- start start 2024-09-21T01:40:36.174 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:36.172+0000 7fe74cb9e640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe748109fa0 0x7fe7481a0830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:40:36.174 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:36.172+0000 7fe74cb9e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe74810f8e0 0x7fe7481a0dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:40:36.174 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:36.172+0000 7fe74cb9e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe748110230 0x7fe7481a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:40:36.174 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:36.172+0000 7fe74cb9e640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fe748119da0 con 0x7fe748109fa0 2024-09-21T01:40:36.174 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:36.172+0000 7fe74cb9e640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fe748119c20 con 0x7fe74810f8e0 2024-09-21T01:40:36.174 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:36.172+0000 7fe74cb9e640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fe748119f20 con 0x7fe748110230 2024-09-21T01:40:36.174 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:36.172+0000 7fe7477fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe748109fa0 0x7fe7481a0830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:40:36.174 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:36.172+0000 7fe7477fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe748109fa0 0x7fe7481a0830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:50168/0 (socket says 172.21.15.83:50168) 2024-09-21T01:40:36.174 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:36.172+0000 7fe7477fe640 1 -- 172.21.15.83:0/1038541360 learned_addr learned my addr 172.21.15.83:0/1038541360 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:40:36.175 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:36.172+0000 7fe747fff640 1 --2- 172.21.15.83:0/1038541360 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe748110230 0x7fe7481a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:40:36.175 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:36.172+0000 7fe746ffd640 1 --2- 172.21.15.83:0/1038541360 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe74810f8e0 0x7fe7481a0dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:40:36.175 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:36.172+0000 7fe7477fe640 1 -- 172.21.15.83:0/1038541360 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe748110230 msgr2=0x7fe7481a6070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:40:36.175 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:36.172+0000 7fe7477fe640 1 --2- 172.21.15.83:0/1038541360 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe748110230 0x7fe7481a6070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:36.175 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:36.172+0000 7fe7477fe640 1 -- 172.21.15.83:0/1038541360 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe74810f8e0 msgr2=0x7fe7481a0dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:40:36.175 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:36.172+0000 7fe7477fe640 1 --2- 172.21.15.83:0/1038541360 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe74810f8e0 0x7fe7481a0dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:36.175 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:36.172+0000 7fe7477fe640 1 -- 172.21.15.83:0/1038541360 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7481a66e0 con 0x7fe748109fa0 2024-09-21T01:40:36.175 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:36.172+0000 7fe746ffd640 1 --2- 172.21.15.83:0/1038541360 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe74810f8e0 0x7fe7481a0dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:40:36.175 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:36.172+0000 7fe747fff640 1 --2- 172.21.15.83:0/1038541360 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe748110230 0x7fe7481a6070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:40:36.175 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:36.172+0000 7fe7477fe640 1 --2- 172.21.15.83:0/1038541360 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe748109fa0 0x7fe7481a0830 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fe738009230 tx=0x7fe738004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:40:36.175 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:36.173+0000 7fe744ff9640 1 -- 172.21.15.83:0/1038541360 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe73803f030 con 0x7fe748109fa0 2024-09-21T01:40:36.176 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:36.173+0000 7fe744ff9640 1 -- 172.21.15.83:0/1038541360 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe738003a80 con 0x7fe748109fa0 2024-09-21T01:40:36.176 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:36.173+0000 7fe74cb9e640 1 -- 172.21.15.83:0/1038541360 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7481a6970 con 0x7fe748109fa0 2024-09-21T01:40:36.176 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:36.173+0000 7fe744ff9640 1 -- 172.21.15.83:0/1038541360 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe738035070 con 0x7fe748109fa0 2024-09-21T01:40:36.176 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:36.173+0000 7fe74cb9e640 1 -- 172.21.15.83:0/1038541360 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7481a6e50 con 0x7fe748109fa0 2024-09-21T01:40:36.176 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:36.174+0000 7fe74cb9e640 1 -- 172.21.15.83:0/1038541360 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe74810a3b0 con 0x7fe748109fa0 2024-09-21T01:40:36.177 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:36.175+0000 7fe744ff9640 1 -- 172.21.15.83:0/1038541360 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7fe738042030 con 0x7fe748109fa0 2024-09-21T01:40:36.177 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:36.176+0000 7fe744ff9640 1 --2- 172.21.15.83:0/1038541360 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fe7300b6620 0x7fe7300b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:40:36.177 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:36.176+0000 7fe746ffd640 1 --2- 172.21.15.83:0/1038541360 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fe7300b6620 0x7fe7300b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:40:36.177 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:36.176+0000 7fe744ff9640 1 -- 172.21.15.83:0/1038541360 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9286+0+0 (secure 0 0 0) 0x7fe738108130 con 0x7fe748109fa0 2024-09-21T01:40:36.177 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:36.176+0000 7fe746ffd640 1 --2- 172.21.15.83:0/1038541360 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fe7300b6620 0x7fe7300b8b30 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fe73c0058c0 tx=0x7fe73c005850 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:40:36.180 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:36.180+0000 7fe744ff9640 1 -- 172.21.15.83:0/1038541360 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe7380ce440 con 0x7fe748109fa0 2024-09-21T01:40:36.386 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:36.385+0000 7fe74cb9e640 1 -- 172.21.15.83:0/1038541360 --> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7fe748063800 con 0x7fe7300b6620 2024-09-21T01:40:36.390 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:36.390+0000 7fe744ff9640 1 -- 172.21.15.83:0/1038541360 <== mgr.14223 v2:172.21.15.83:6800/1748483157 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7fe748063800 con 0x7fe7300b6620 2024-09-21T01:40:36.391 INFO:teuthology.orchestra.run.smithi083.stdout:/volumes/qa/sv_1/4f689e94-e5c8-4e01-ac59-41c67bfe15d5 2024-09-21T01:40:36.393 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:36.392+0000 7fe74cb9e640 1 -- 172.21.15.83:0/1038541360 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fe7300b6620 msgr2=0x7fe7300b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:40:36.393 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:36.392+0000 7fe74cb9e640 1 --2- 172.21.15.83:0/1038541360 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fe7300b6620 0x7fe7300b8b30 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fe73c0058c0 tx=0x7fe73c005850 comp rx=0 tx=0).stop 2024-09-21T01:40:36.393 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:36.392+0000 7fe74cb9e640 1 -- 172.21.15.83:0/1038541360 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe748109fa0 msgr2=0x7fe7481a0830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:40:36.393 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:36.392+0000 7fe74cb9e640 1 --2- 172.21.15.83:0/1038541360 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe748109fa0 0x7fe7481a0830 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fe738009230 tx=0x7fe738004270 comp rx=0 tx=0).stop 2024-09-21T01:40:36.393 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:36.392+0000 7fe74cb9e640 1 -- 172.21.15.83:0/1038541360 shutdown_connections 2024-09-21T01:40:36.393 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:36.392+0000 7fe74cb9e640 1 --2- 172.21.15.83:0/1038541360 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fe7300b6620 0x7fe7300b8b30 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:36.393 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:36.392+0000 7fe74cb9e640 1 --2- 172.21.15.83:0/1038541360 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe748110230 0x7fe7481a6070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:36.393 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:36.392+0000 7fe74cb9e640 1 --2- 172.21.15.83:0/1038541360 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe74810f8e0 0x7fe7481a0dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:36.393 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:36.392+0000 7fe74cb9e640 1 --2- 172.21.15.83:0/1038541360 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe748109fa0 0x7fe7481a0830 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:36.393 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:36.392+0000 7fe74cb9e640 1 -- 172.21.15.83:0/1038541360 >> 172.21.15.83:0/1038541360 conn(0x7fe748079580 msgr2=0x7fe748079f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:40:36.393 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:36.392+0000 7fe74cb9e640 1 -- 172.21.15.83:0/1038541360 shutdown_connections 2024-09-21T01:40:36.393 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:36.392+0000 7fe74cb9e640 1 -- 172.21.15.83:0/1038541360 wait complete. 2024-09-21T01:40:37.051 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T01:40:37.295 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:40:37.785 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:37.774+0000 7f0a1e2f6640 1 -- 172.21.15.83:0/530807861 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0a181083d0 msgr2=0x7f0a181087e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:40:37.786 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:37.774+0000 7f0a1e2f6640 1 --2- 172.21.15.83:0/530807861 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0a181083d0 0x7f0a181087e0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f0a0c009900 tx=0x7f0a0c02a410 comp rx=0 tx=0).stop 2024-09-21T01:40:37.786 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:37.774+0000 7f0a1e2f6640 1 -- 172.21.15.83:0/530807861 shutdown_connections 2024-09-21T01:40:37.786 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:37.774+0000 7f0a1e2f6640 1 --2- 172.21.15.83:0/530807861 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0a18108d20 0x7f0a1810f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:37.786 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:37.774+0000 7f0a1e2f6640 1 --2- 172.21.15.83:0/530807861 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0a181083d0 0x7f0a181087e0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:37.786 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:37.774+0000 7f0a1e2f6640 1 --2- 172.21.15.83:0/530807861 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0a18102a90 0x7f0a18102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:37.786 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:37.774+0000 7f0a1e2f6640 1 -- 172.21.15.83:0/530807861 >> 172.21.15.83:0/530807861 conn(0x7f0a18079750 msgr2=0x7f0a18079b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:40:37.786 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:37.774+0000 7f0a1e2f6640 1 -- 172.21.15.83:0/530807861 shutdown_connections 2024-09-21T01:40:37.786 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:37.774+0000 7f0a1e2f6640 1 -- 172.21.15.83:0/530807861 wait complete. 2024-09-21T01:40:37.786 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:37.775+0000 7f0a1e2f6640 1 Processor -- start 2024-09-21T01:40:37.786 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:37.775+0000 7f0a1e2f6640 1 -- start start 2024-09-21T01:40:37.786 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:37.776+0000 7f0a1e2f6640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0a18102a90 0x7f0a1819a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:40:37.786 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:37.776+0000 7f0a1e2f6640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0a181083d0 0x7f0a1819ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:40:37.787 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:37.776+0000 7f0a1e2f6640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0a18108d20 0x7f0a1819fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:40:37.787 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:37.776+0000 7f0a1e2f6640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f0a18112900 con 0x7f0a181083d0 2024-09-21T01:40:37.787 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:37.776+0000 7f0a1e2f6640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f0a18112780 con 0x7f0a18102a90 2024-09-21T01:40:37.787 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:37.776+0000 7f0a1e2f6640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f0a18112a80 con 0x7f0a18108d20 2024-09-21T01:40:37.787 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:37.776+0000 7f0a177fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0a181083d0 0x7f0a1819ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:40:37.787 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:37.776+0000 7f0a177fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0a181083d0 0x7f0a1819ab20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:50188/0 (socket says 172.21.15.83:50188) 2024-09-21T01:40:37.787 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:37.776+0000 7f0a177fe640 1 -- 172.21.15.83:0/2697426094 learned_addr learned my addr 172.21.15.83:0/2697426094 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:40:37.787 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:37.776+0000 7f0a1c893640 1 --2- 172.21.15.83:0/2697426094 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0a18108d20 0x7f0a1819fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:40:37.787 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:37.776+0000 7f0a17fff640 1 --2- 172.21.15.83:0/2697426094 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0a18102a90 0x7f0a1819a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:40:37.787 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:37.776+0000 7f0a177fe640 1 -- 172.21.15.83:0/2697426094 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0a18108d20 msgr2=0x7f0a1819fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:40:37.787 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:37.776+0000 7f0a177fe640 1 --2- 172.21.15.83:0/2697426094 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0a18108d20 0x7f0a1819fdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:37.787 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:37.776+0000 7f0a177fe640 1 -- 172.21.15.83:0/2697426094 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0a18102a90 msgr2=0x7f0a1819a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:40:37.787 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:37.776+0000 7f0a177fe640 1 --2- 172.21.15.83:0/2697426094 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0a18102a90 0x7f0a1819a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:37.787 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:37.776+0000 7f0a177fe640 1 -- 172.21.15.83:0/2697426094 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a181a04f0 con 0x7f0a181083d0 2024-09-21T01:40:37.787 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:37.776+0000 7f0a17fff640 1 --2- 172.21.15.83:0/2697426094 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0a18102a90 0x7f0a1819a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:40:37.788 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:37.776+0000 7f0a177fe640 1 --2- 172.21.15.83:0/2697426094 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0a181083d0 0x7f0a1819ab20 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f0a0c005940 tx=0x7f0a0c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:40:37.788 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:37.776+0000 7f0a157fa640 1 -- 172.21.15.83:0/2697426094 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a0c03f030 con 0x7f0a181083d0 2024-09-21T01:40:37.788 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:37.776+0000 7f0a1e2f6640 1 -- 172.21.15.83:0/2697426094 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a181a0780 con 0x7f0a181083d0 2024-09-21T01:40:37.788 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:37.777+0000 7f0a157fa640 1 -- 172.21.15.83:0/2697426094 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0a0c003c90 con 0x7f0a181083d0 2024-09-21T01:40:37.788 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:37.777+0000 7f0a157fa640 1 -- 172.21.15.83:0/2697426094 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a0c035070 con 0x7f0a181083d0 2024-09-21T01:40:37.788 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:37.777+0000 7f0a1e2f6640 1 -- 172.21.15.83:0/2697426094 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a181a6f40 con 0x7f0a181083d0 2024-09-21T01:40:37.788 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:37.778+0000 7f0a1e2f6640 1 -- 172.21.15.83:0/2697426094 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a18103d10 con 0x7f0a181083d0 2024-09-21T01:40:37.788 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:37.779+0000 7f0a157fa640 1 -- 172.21.15.83:0/2697426094 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7f0a0c042030 con 0x7f0a181083d0 2024-09-21T01:40:37.788 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:37.780+0000 7f0a157fa640 1 --2- 172.21.15.83:0/2697426094 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f0a000b65f0 0x7f0a000b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:40:37.788 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:37.780+0000 7f0a17fff640 1 --2- 172.21.15.83:0/2697426094 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f0a000b65f0 0x7f0a000b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:40:37.788 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:37.780+0000 7f0a157fa640 1 -- 172.21.15.83:0/2697426094 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9286+0+0 (secure 0 0 0) 0x7f0a0c107f80 con 0x7f0a181083d0 2024-09-21T01:40:37.788 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:37.780+0000 7f0a17fff640 1 --2- 172.21.15.83:0/2697426094 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f0a000b65f0 0x7f0a000b8b00 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f0a08009930 tx=0x7f0a08008040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:40:37.788 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:37.784+0000 7f0a157fa640 1 -- 172.21.15.83:0/2697426094 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f0a0c0ce290 con 0x7f0a181083d0 2024-09-21T01:40:37.997 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:37.997+0000 7f0a1e2f6640 1 -- 172.21.15.83:0/2697426094 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0a181a7110 con 0x7f0a181083d0 2024-09-21T01:40:37.998 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:40:37 smithi083 ceph-mon[31370]: from='client.15051 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:40:37.998 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:40:37 smithi083 ceph-mon[31370]: pgmap v294: 129 pgs: 129 active+clean; 603 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 2.4 KiB/s wr, 3 op/s 2024-09-21T01:40:37.998 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:37.998+0000 7f0a157fa640 1 -- 172.21.15.83:0/2697426094 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11857 (secure 0 0 0) 0x7f0a0c0d2670 con 0x7f0a181083d0 2024-09-21T01:40:37.999 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T01:40:37.999 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":21,"btime":"2024-09-21T01:40:27:947059+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14775,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6835/1105040204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":1105040204},{"type":"v1","addr":"172.21.15.83:6835","nonce":1105040204}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14787,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/2234789563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6836","nonce":2234789563},{"type":"v1","addr":"172.21.15.83:6837","nonce":2234789563}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14838,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6839/136258364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6838","nonce":136258364},{"type":"v1","addr":"172.21.15.83:6839","nonce":136258364}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14850,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6841/129439444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6840","nonce":129439444},{"type":"v1","addr":"172.21.15.83:6841","nonce":129439444}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24569,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/2839502433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":2839502433},{"type":"v1","addr":"172.21.15.119:6833","nonce":2839502433}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24580,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6833/2841606990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":2841606990},{"type":"v1","addr":"172.21.15.142:6833","nonce":2841606990}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24599,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/415902608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":415902608},{"type":"v1","addr":"172.21.15.119:6835","nonce":415902608}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24607,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/3009088510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":3009088510},{"type":"v1","addr":"172.21.15.142:6835","nonce":3009088510}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24613,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/3847200126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6836","nonce":3847200126},{"type":"v1","addr":"172.21.15.142:6837","nonce":3847200126}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24626,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/3619222976","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":3619222976},{"type":"v1","addr":"172.21.15.119:6837","nonce":3619222976}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T01:39:45.145124+0000","modified":"2024-09-21T01:40:27.664151+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24653},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24631":{"gid":24631,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.142:6839/1817880741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6838","nonce":1817880741},{"type":"v1","addr":"172.21.15.142:6839","nonce":1817880741}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24653":{"gid":24653,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.119:6839/3106757092","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":3106757092},{"type":"v1","addr":"172.21.15.119:6839","nonce":3106757092}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24653,"qdb_cluster":[24653]},"id":1}]} 2024-09-21T01:40:37.999 INFO:teuthology.orchestra.run.smithi083.stderr:dumped fsmap epoch 21 2024-09-21T01:40:38.000 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:38.000+0000 7f0a1e2f6640 1 -- 172.21.15.83:0/2697426094 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f0a000b65f0 msgr2=0x7f0a000b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:40:38.000 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:38.000+0000 7f0a1e2f6640 1 --2- 172.21.15.83:0/2697426094 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f0a000b65f0 0x7f0a000b8b00 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f0a08009930 tx=0x7f0a08008040 comp rx=0 tx=0).stop 2024-09-21T01:40:38.001 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:38.000+0000 7f0a1e2f6640 1 -- 172.21.15.83:0/2697426094 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0a181083d0 msgr2=0x7f0a1819ab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:40:38.001 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:38.000+0000 7f0a1e2f6640 1 --2- 172.21.15.83:0/2697426094 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0a181083d0 0x7f0a1819ab20 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f0a0c005940 tx=0x7f0a0c0042f0 comp rx=0 tx=0).stop 2024-09-21T01:40:38.001 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:38.000+0000 7f0a1e2f6640 1 -- 172.21.15.83:0/2697426094 shutdown_connections 2024-09-21T01:40:38.001 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:38.000+0000 7f0a1e2f6640 1 --2- 172.21.15.83:0/2697426094 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f0a000b65f0 0x7f0a000b8b00 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:38.001 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:38.000+0000 7f0a1e2f6640 1 --2- 172.21.15.83:0/2697426094 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0a18108d20 0x7f0a1819fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:38.001 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:38.000+0000 7f0a1e2f6640 1 --2- 172.21.15.83:0/2697426094 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0a181083d0 0x7f0a1819ab20 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:38.001 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:38.000+0000 7f0a1e2f6640 1 --2- 172.21.15.83:0/2697426094 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0a18102a90 0x7f0a1819a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:38.001 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:38.000+0000 7f0a1e2f6640 1 -- 172.21.15.83:0/2697426094 >> 172.21.15.83:0/2697426094 conn(0x7f0a18079750 msgr2=0x7f0a180ffe40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:40:38.001 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:38.000+0000 7f0a1e2f6640 1 -- 172.21.15.83:0/2697426094 shutdown_connections 2024-09-21T01:40:38.001 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:38.000+0000 7f0a1e2f6640 1 -- 172.21.15.83:0/2697426094 wait complete. 2024-09-21T01:40:38.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:40:37 smithi142 ceph-mon[34050]: from='client.15051 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:40:38.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:40:37 smithi142 ceph-mon[34050]: pgmap v294: 129 pgs: 129 active+clean; 603 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 2.4 KiB/s wr, 3 op/s 2024-09-21T01:40:38.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:40:37 smithi119 ceph-mon[33693]: from='client.15051 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:40:38.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:40:37 smithi119 ceph-mon[33693]: pgmap v294: 129 pgs: 129 active+clean; 603 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 2.4 KiB/s wr, 3 op/s 2024-09-21T01:40:38.602 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T01:40:38.848 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:40:39.115 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:40:38 smithi083 ceph-mon[31370]: from='client.? 172.21.15.83:0/2697426094' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:40:39.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:40:38 smithi142 ceph-mon[34050]: from='client.? 172.21.15.83:0/2697426094' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:40:39.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:40:38 smithi119 ceph-mon[33693]: from='client.? 172.21.15.83:0/2697426094' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:40:39.320 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:39.317+0000 7f6505c43640 1 -- 172.21.15.83:0/2234360969 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f65001094a0 msgr2=0x7f65001098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:40:39.320 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:39.317+0000 7f6505c43640 1 --2- 172.21.15.83:0/2234360969 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f65001094a0 0x7f65001098b0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f64f4009ca0 tx=0x7f64f402a8c0 comp rx=0 tx=0).stop 2024-09-21T01:40:39.320 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:39.317+0000 7f6505c43640 1 -- 172.21.15.83:0/2234360969 shutdown_connections 2024-09-21T01:40:39.320 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:39.317+0000 7f6505c43640 1 --2- 172.21.15.83:0/2234360969 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6500109df0 0x7f6500110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:39.320 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:39.317+0000 7f6505c43640 1 --2- 172.21.15.83:0/2234360969 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f65001094a0 0x7f65001098b0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:39.320 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:39.317+0000 7f6505c43640 1 --2- 172.21.15.83:0/2234360969 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6500103b60 0x7f6500103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:39.320 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:39.317+0000 7f6505c43640 1 -- 172.21.15.83:0/2234360969 >> 172.21.15.83:0/2234360969 conn(0x7f650007b850 msgr2=0x7f650007bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:40:39.320 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:39.317+0000 7f6505c43640 1 -- 172.21.15.83:0/2234360969 shutdown_connections 2024-09-21T01:40:39.320 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:39.317+0000 7f6505c43640 1 -- 172.21.15.83:0/2234360969 wait complete. 2024-09-21T01:40:39.321 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:39.318+0000 7f6505c43640 1 Processor -- start 2024-09-21T01:40:39.321 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:39.318+0000 7f6505c43640 1 -- start start 2024-09-21T01:40:39.321 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:39.318+0000 7f6505c43640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6500103b60 0x7f650019a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:40:39.321 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:39.318+0000 7f6505c43640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f65001094a0 0x7f650019a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:40:39.321 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:39.318+0000 7f6505c43640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6500109df0 0x7f650019fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:40:39.321 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:39.318+0000 7f6505c43640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f65001139b0 con 0x7f65001094a0 2024-09-21T01:40:39.321 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:39.318+0000 7f6505c43640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f6500113830 con 0x7f6500103b60 2024-09-21T01:40:39.321 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:39.318+0000 7f6505c43640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f6500113b30 con 0x7f6500109df0 2024-09-21T01:40:39.321 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:39.318+0000 7f64feffd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f65001094a0 0x7f650019a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:40:39.321 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:39.318+0000 7f64feffd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f65001094a0 0x7f650019a960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:50208/0 (socket says 172.21.15.83:50208) 2024-09-21T01:40:39.321 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:39.318+0000 7f64feffd640 1 -- 172.21.15.83:0/2797692610 learned_addr learned my addr 172.21.15.83:0/2797692610 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:40:39.321 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:39.318+0000 7f64ff7fe640 1 --2- 172.21.15.83:0/2797692610 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6500103b60 0x7f650019a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:40:39.321 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:39.318+0000 7f64fffff640 1 --2- 172.21.15.83:0/2797692610 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6500109df0 0x7f650019fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:40:39.321 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:39.319+0000 7f64feffd640 1 -- 172.21.15.83:0/2797692610 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6500109df0 msgr2=0x7f650019fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:40:39.322 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:39.319+0000 7f64feffd640 1 --2- 172.21.15.83:0/2797692610 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6500109df0 0x7f650019fc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:39.322 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:39.319+0000 7f64feffd640 1 -- 172.21.15.83:0/2797692610 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6500103b60 msgr2=0x7f650019a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:40:39.322 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:39.319+0000 7f64feffd640 1 --2- 172.21.15.83:0/2797692610 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6500103b60 0x7f650019a3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:39.322 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:39.319+0000 7f64feffd640 1 -- 172.21.15.83:0/2797692610 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65001a0330 con 0x7f65001094a0 2024-09-21T01:40:39.322 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:39.319+0000 7f64fffff640 1 --2- 172.21.15.83:0/2797692610 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6500109df0 0x7f650019fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:40:39.322 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:39.319+0000 7f64feffd640 1 --2- 172.21.15.83:0/2797692610 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f65001094a0 0x7f650019a960 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f64f402ade0 tx=0x7f64f4032a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:40:39.322 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:39.319+0000 7f64fcff9640 1 -- 172.21.15.83:0/2797692610 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64f4032e30 con 0x7f65001094a0 2024-09-21T01:40:39.322 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:39.319+0000 7f64fcff9640 1 -- 172.21.15.83:0/2797692610 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f64f40044d0 con 0x7f65001094a0 2024-09-21T01:40:39.322 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:39.319+0000 7f6505c43640 1 -- 172.21.15.83:0/2797692610 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65001a05c0 con 0x7f65001094a0 2024-09-21T01:40:39.322 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:39.319+0000 7f64fcff9640 1 -- 172.21.15.83:0/2797692610 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64f4030c00 con 0x7f65001094a0 2024-09-21T01:40:39.323 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:39.319+0000 7f6505c43640 1 -- 172.21.15.83:0/2797692610 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65001a6d80 con 0x7f65001094a0 2024-09-21T01:40:39.323 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:39.320+0000 7f6505c43640 1 -- 172.21.15.83:0/2797692610 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6500103f70 con 0x7f65001094a0 2024-09-21T01:40:39.323 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:39.322+0000 7f64fcff9640 1 -- 172.21.15.83:0/2797692610 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7f64f4004040 con 0x7f65001094a0 2024-09-21T01:40:39.323 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:39.323+0000 7f64fcff9640 1 --2- 172.21.15.83:0/2797692610 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f64e80b65f0 0x7f64e80b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:40:39.323 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:39.323+0000 7f64ff7fe640 1 --2- 172.21.15.83:0/2797692610 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f64e80b65f0 0x7f64e80b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:40:39.323 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:39.323+0000 7f64fcff9640 1 -- 172.21.15.83:0/2797692610 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9286+0+0 (secure 0 0 0) 0x7f64f4108dc0 con 0x7f65001094a0 2024-09-21T01:40:39.324 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:39.323+0000 7f64ff7fe640 1 --2- 172.21.15.83:0/2797692610 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f64e80b65f0 0x7f64e80b8b00 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f64f0005fd0 tx=0x7f64f000b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:40:39.326 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:39.326+0000 7f64fcff9640 1 -- 172.21.15.83:0/2797692610 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f64f40cf0d0 con 0x7f65001094a0 2024-09-21T01:40:39.508 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:39.507+0000 7f6505c43640 1 -- 172.21.15.83:0/2797692610 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f650010bbc0 con 0x7f65001094a0 2024-09-21T01:40:39.509 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:39.509+0000 7f64fcff9640 1 -- 172.21.15.83:0/2797692610 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+25050 (secure 0 0 0) 0x7f64f40d34b0 con 0x7f65001094a0 2024-09-21T01:40:39.510 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T01:40:39.510 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":82,"fsid":"f7697ecc-77b8-11ef-baf5-efdc52797490","created":"2024-09-21T01:31:22.250342+0000","modified":"2024-09-21T01:40:09.823827+0000","last_up_change":"2024-09-21T01:38:53.501659+0000","last_in_change":"2024-09-21T01:38:30.688516+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T01:35:06.977668+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T01:39:41.041950+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T01:39:42.882272+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T01:39:49.320532+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"66947512-01ee-4bf0-87b0-98a168cf50dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":3563457494},{"type":"v1","addr":"172.21.15.83:6803","nonce":3563457494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":3563457494},{"type":"v1","addr":"172.21.15.83:6805","nonce":3563457494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":3563457494},{"type":"v1","addr":"172.21.15.83:6809","nonce":3563457494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":3563457494},{"type":"v1","addr":"172.21.15.83:6807","nonce":3563457494}]},"public_addr":"172.21.15.83:6803/3563457494","cluster_addr":"172.21.15.83:6805/3563457494","heartbeat_back_addr":"172.21.15.83:6809/3563457494","heartbeat_front_addr":"172.21.15.83:6807/3563457494","state":["exists","up"]},{"osd":1,"uuid":"f7818a08-86a5-412d-a164-cfeb18f8650a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":2066870220},{"type":"v1","addr":"172.21.15.119:6801","nonce":2066870220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":2066870220},{"type":"v1","addr":"172.21.15.119:6803","nonce":2066870220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":2066870220},{"type":"v1","addr":"172.21.15.119:6807","nonce":2066870220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":2066870220},{"type":"v1","addr":"172.21.15.119:6805","nonce":2066870220}]},"public_addr":"172.21.15.119:6801/2066870220","cluster_addr":"172.21.15.119:6803/2066870220","heartbeat_back_addr":"172.21.15.119:6807/2066870220","heartbeat_front_addr":"172.21.15.119:6805/2066870220","state":["exists","up"]},{"osd":2,"uuid":"0d1a3870-c67a-4783-85f9-be2bb36f7722","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":3955936117},{"type":"v1","addr":"172.21.15.142:6801","nonce":3955936117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3955936117},{"type":"v1","addr":"172.21.15.142:6803","nonce":3955936117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":3955936117},{"type":"v1","addr":"172.21.15.142:6807","nonce":3955936117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":3955936117},{"type":"v1","addr":"172.21.15.142:6805","nonce":3955936117}]},"public_addr":"172.21.15.142:6801/3955936117","cluster_addr":"172.21.15.142:6803/3955936117","heartbeat_back_addr":"172.21.15.142:6807/3955936117","heartbeat_front_addr":"172.21.15.142:6805/3955936117","state":["exists","up"]},{"osd":3,"uuid":"a4cb1a36-3495-4d36-92da-ed3b6e852d14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":3746834093},{"type":"v1","addr":"172.21.15.83:6811","nonce":3746834093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":3746834093},{"type":"v1","addr":"172.21.15.83:6813","nonce":3746834093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":3746834093},{"type":"v1","addr":"172.21.15.83:6817","nonce":3746834093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":3746834093},{"type":"v1","addr":"172.21.15.83:6815","nonce":3746834093}]},"public_addr":"172.21.15.83:6811/3746834093","cluster_addr":"172.21.15.83:6813/3746834093","heartbeat_back_addr":"172.21.15.83:6817/3746834093","heartbeat_front_addr":"172.21.15.83:6815/3746834093","state":["exists","up"]},{"osd":4,"uuid":"d6f2ec78-7f08-473b-a96c-e8590f5d2f25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":3083907785},{"type":"v1","addr":"172.21.15.119:6809","nonce":3083907785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":3083907785},{"type":"v1","addr":"172.21.15.119:6811","nonce":3083907785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":3083907785},{"type":"v1","addr":"172.21.15.119:6815","nonce":3083907785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":3083907785},{"type":"v1","addr":"172.21.15.119:6813","nonce":3083907785}]},"public_addr":"172.21.15.119:6809/3083907785","cluster_addr":"172.21.15.119:6811/3083907785","heartbeat_back_addr":"172.21.15.119:6815/3083907785","heartbeat_front_addr":"172.21.15.119:6813/3083907785","state":["exists","up"]},{"osd":5,"uuid":"c571d04d-d3ea-4d74-8867-e4c7816f4e0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":349001002},{"type":"v1","addr":"172.21.15.142:6809","nonce":349001002}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":349001002},{"type":"v1","addr":"172.21.15.142:6811","nonce":349001002}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":349001002},{"type":"v1","addr":"172.21.15.142:6815","nonce":349001002}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":349001002},{"type":"v1","addr":"172.21.15.142:6813","nonce":349001002}]},"public_addr":"172.21.15.142:6809/349001002","cluster_addr":"172.21.15.142:6811/349001002","heartbeat_back_addr":"172.21.15.142:6815/349001002","heartbeat_front_addr":"172.21.15.142:6813/349001002","state":["exists","up"]},{"osd":6,"uuid":"6e1b6fe9-700a-448a-b382-59b97896ea7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":771651063},{"type":"v1","addr":"172.21.15.83:6819","nonce":771651063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":771651063},{"type":"v1","addr":"172.21.15.83:6821","nonce":771651063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":771651063},{"type":"v1","addr":"172.21.15.83:6825","nonce":771651063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":771651063},{"type":"v1","addr":"172.21.15.83:6823","nonce":771651063}]},"public_addr":"172.21.15.83:6819/771651063","cluster_addr":"172.21.15.83:6821/771651063","heartbeat_back_addr":"172.21.15.83:6825/771651063","heartbeat_front_addr":"172.21.15.83:6823/771651063","state":["exists","up"]},{"osd":7,"uuid":"283bfae4-5f50-4f9e-860e-bbfd47e005e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":1556984819},{"type":"v1","addr":"172.21.15.119:6817","nonce":1556984819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":1556984819},{"type":"v1","addr":"172.21.15.119:6819","nonce":1556984819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":1556984819},{"type":"v1","addr":"172.21.15.119:6823","nonce":1556984819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":1556984819},{"type":"v1","addr":"172.21.15.119:6821","nonce":1556984819}]},"public_addr":"172.21.15.119:6817/1556984819","cluster_addr":"172.21.15.119:6819/1556984819","heartbeat_back_addr":"172.21.15.119:6823/1556984819","heartbeat_front_addr":"172.21.15.119:6821/1556984819","state":["exists","up"]},{"osd":8,"uuid":"d46e56d4-ed4e-42c3-a315-66af014bd93a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":1860679473},{"type":"v1","addr":"172.21.15.142:6817","nonce":1860679473}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":1860679473},{"type":"v1","addr":"172.21.15.142:6819","nonce":1860679473}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":1860679473},{"type":"v1","addr":"172.21.15.142:6823","nonce":1860679473}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":1860679473},{"type":"v1","addr":"172.21.15.142:6821","nonce":1860679473}]},"public_addr":"172.21.15.142:6817/1860679473","cluster_addr":"172.21.15.142:6819/1860679473","heartbeat_back_addr":"172.21.15.142:6823/1860679473","heartbeat_front_addr":"172.21.15.142:6821/1860679473","state":["exists","up"]},{"osd":9,"uuid":"18a70ee6-56df-4f5c-868d-5db5e72a1859","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":3636757924},{"type":"v1","addr":"172.21.15.83:6827","nonce":3636757924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":3636757924},{"type":"v1","addr":"172.21.15.83:6829","nonce":3636757924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6832","nonce":3636757924},{"type":"v1","addr":"172.21.15.83:6833","nonce":3636757924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":3636757924},{"type":"v1","addr":"172.21.15.83:6831","nonce":3636757924}]},"public_addr":"172.21.15.83:6827/3636757924","cluster_addr":"172.21.15.83:6829/3636757924","heartbeat_back_addr":"172.21.15.83:6833/3636757924","heartbeat_front_addr":"172.21.15.83:6831/3636757924","state":["exists","up"]},{"osd":10,"uuid":"0d32c3de-db03-42c3-9914-07d675aaa339","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":2561963910},{"type":"v1","addr":"172.21.15.119:6825","nonce":2561963910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":2561963910},{"type":"v1","addr":"172.21.15.119:6827","nonce":2561963910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2561963910},{"type":"v1","addr":"172.21.15.119:6831","nonce":2561963910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2561963910},{"type":"v1","addr":"172.21.15.119:6829","nonce":2561963910}]},"public_addr":"172.21.15.119:6825/2561963910","cluster_addr":"172.21.15.119:6827/2561963910","heartbeat_back_addr":"172.21.15.119:6831/2561963910","heartbeat_front_addr":"172.21.15.119:6829/2561963910","state":["exists","up"]},{"osd":11,"uuid":"3a3b444d-b316-4256-bfad-378db29f0824","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":1174646198},{"type":"v1","addr":"172.21.15.142:6825","nonce":1174646198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":1174646198},{"type":"v1","addr":"172.21.15.142:6827","nonce":1174646198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1174646198},{"type":"v1","addr":"172.21.15.142:6831","nonce":1174646198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1174646198},{"type":"v1","addr":"172.21.15.142:6829","nonce":1174646198}]},"public_addr":"172.21.15.142:6825/1174646198","cluster_addr":"172.21.15.142:6827/1174646198","heartbeat_back_addr":"172.21.15.142:6831/1174646198","heartbeat_front_addr":"172.21.15.142:6829/1174646198","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:34:15.337672+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:34:39.259716+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:35:03.348886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:35:29.465711+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:35:53.744378+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:36:19.488785+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:36:45.708616+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:37:11.501065+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:37:36.027277+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:38:01.903625+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:38:27.215212+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:38:51.891278+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.e","mappings":[{"from":4,"to":8},{"from":5,"to":9}]},{"pgid":"3.11","mappings":[{"from":4,"to":6}]},{"pgid":"4.3","mappings":[{"from":5,"to":8}]},{"pgid":"4.10","mappings":[{"from":9,"to":8}]},{"pgid":"4.12","mappings":[{"from":9,"to":10}]},{"pgid":"4.1c","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.83:0/1619062496":"2024-09-22T01:33:08.666525+0000","172.21.15.83:0/2412709299":"2024-09-22T01:31:45.834450+0000","172.21.15.83:6800/4290325964":"2024-09-22T01:31:45.834450+0000","172.21.15.83:6801/4290325964":"2024-09-22T01:31:45.834450+0000","172.21.15.83:0/1440681183":"2024-09-22T01:31:45.834450+0000","172.21.15.83:0/2745413305":"2024-09-22T01:31:45.834450+0000","172.21.15.83:6800/1393748565":"2024-09-22T01:33:08.666525+0000","172.21.15.83:0/110411274":"2024-09-22T01:32:10.073024+0000","172.21.15.83:0/4267551123":"2024-09-22T01:33:08.666525+0000","172.21.15.83:0/1068434643":"2024-09-22T01:32:10.073024+0000","172.21.15.83:6800/2963261730":"2024-09-22T01:32:10.073024+0000","172.21.15.83:0/3544333975":"2024-09-22T01:32:10.073024+0000","172.21.15.83:6801/1393748565":"2024-09-22T01:33:08.666525+0000","172.21.15.83:6801/2963261730":"2024-09-22T01:32:10.073024+0000","172.21.15.83:0/1915285091":"2024-09-22T01:33:08.666525+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T01:40:39.512 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:39.511+0000 7f6505c43640 1 -- 172.21.15.83:0/2797692610 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f64e80b65f0 msgr2=0x7f64e80b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:40:39.512 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:39.511+0000 7f6505c43640 1 --2- 172.21.15.83:0/2797692610 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f64e80b65f0 0x7f64e80b8b00 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f64f0005fd0 tx=0x7f64f000b390 comp rx=0 tx=0).stop 2024-09-21T01:40:39.512 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:39.511+0000 7f6505c43640 1 -- 172.21.15.83:0/2797692610 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f65001094a0 msgr2=0x7f650019a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:40:39.512 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:39.511+0000 7f6505c43640 1 --2- 172.21.15.83:0/2797692610 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f65001094a0 0x7f650019a960 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f64f402ade0 tx=0x7f64f4032a10 comp rx=0 tx=0).stop 2024-09-21T01:40:39.512 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:39.512+0000 7f6505c43640 1 -- 172.21.15.83:0/2797692610 shutdown_connections 2024-09-21T01:40:39.513 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:39.512+0000 7f6505c43640 1 --2- 172.21.15.83:0/2797692610 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f64e80b65f0 0x7f64e80b8b00 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:39.513 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:39.512+0000 7f6505c43640 1 --2- 172.21.15.83:0/2797692610 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6500109df0 0x7f650019fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:39.513 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:39.512+0000 7f6505c43640 1 --2- 172.21.15.83:0/2797692610 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f65001094a0 0x7f650019a960 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:39.513 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:39.512+0000 7f6505c43640 1 --2- 172.21.15.83:0/2797692610 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6500103b60 0x7f650019a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:39.513 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:39.512+0000 7f6505c43640 1 -- 172.21.15.83:0/2797692610 >> 172.21.15.83:0/2797692610 conn(0x7f650007b850 msgr2=0x7f6500105520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:40:39.513 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:39.512+0000 7f6505c43640 1 -- 172.21.15.83:0/2797692610 shutdown_connections 2024-09-21T01:40:39.513 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:39.512+0000 7f6505c43640 1 -- 172.21.15.83:0/2797692610 wait complete. 2024-09-21T01:40:40.133 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:40:39 smithi083 ceph-mon[31370]: pgmap v295: 129 pgs: 129 active+clean; 604 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 2.5 KiB/s wr, 3 op/s 2024-09-21T01:40:40.133 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:40:39 smithi083 ceph-mon[31370]: from='client.? 172.21.15.83:0/2797692610' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T01:40:40.164 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-21T01:40:40.164 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph pg dump --format=json 2024-09-21T01:40:40.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:40:39 smithi142 ceph-mon[34050]: pgmap v295: 129 pgs: 129 active+clean; 604 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 2.5 KiB/s wr, 3 op/s 2024-09-21T01:40:40.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:40:39 smithi142 ceph-mon[34050]: from='client.? 172.21.15.83:0/2797692610' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T01:40:40.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:40:39 smithi119 ceph-mon[33693]: pgmap v295: 129 pgs: 129 active+clean; 604 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 2.5 KiB/s wr, 3 op/s 2024-09-21T01:40:40.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:40:39 smithi119 ceph-mon[33693]: from='client.? 172.21.15.83:0/2797692610' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T01:40:40.425 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:40:40.946 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:40.892+0000 7f01e4196640 1 -- 172.21.15.83:0/3934042984 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f01dc109df0 msgr2=0x7f01dc110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:40:40.947 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:40.892+0000 7f01e4196640 1 --2- 172.21.15.83:0/3934042984 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f01dc109df0 0x7f01dc110620 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f01cc009900 tx=0x7f01cc02a410 comp rx=0 tx=0).stop 2024-09-21T01:40:40.947 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:40.892+0000 7f01e4196640 1 -- 172.21.15.83:0/3934042984 shutdown_connections 2024-09-21T01:40:40.947 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:40.892+0000 7f01e4196640 1 --2- 172.21.15.83:0/3934042984 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f01dc109df0 0x7f01dc110620 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:40.947 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:40.892+0000 7f01e4196640 1 --2- 172.21.15.83:0/3934042984 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f01dc1094a0 0x7f01dc1098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:40.947 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:40.892+0000 7f01e4196640 1 --2- 172.21.15.83:0/3934042984 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f01dc103b60 0x7f01dc103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:40.947 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:40.892+0000 7f01e4196640 1 -- 172.21.15.83:0/3934042984 >> 172.21.15.83:0/3934042984 conn(0x7f01dc07b850 msgr2=0x7f01dc07bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:40:40.947 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:40.892+0000 7f01e4196640 1 -- 172.21.15.83:0/3934042984 shutdown_connections 2024-09-21T01:40:40.947 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:40.892+0000 7f01e4196640 1 -- 172.21.15.83:0/3934042984 wait complete. 2024-09-21T01:40:40.947 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:40.893+0000 7f01e4196640 1 Processor -- start 2024-09-21T01:40:40.947 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:40.893+0000 7f01e4196640 1 -- start start 2024-09-21T01:40:40.947 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:40.893+0000 7f01e4196640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f01dc103b60 0x7f01dc19a370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:40:40.947 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:40.893+0000 7f01e4196640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f01dc1094a0 0x7f01dc19a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:40:40.947 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:40.893+0000 7f01e4196640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f01dc109df0 0x7f01dc19fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:40:40.947 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:40.893+0000 7f01e4196640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f01dc113960 con 0x7f01dc109df0 2024-09-21T01:40:40.948 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:40.893+0000 7f01e4196640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f01dc1137e0 con 0x7f01dc103b60 2024-09-21T01:40:40.948 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:40.893+0000 7f01e4196640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f01dc113ae0 con 0x7f01dc1094a0 2024-09-21T01:40:40.948 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:40.893+0000 7f01e2733640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f01dc109df0 0x7f01dc19fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:40:40.948 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:40.893+0000 7f01e2733640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f01dc109df0 0x7f01dc19fbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:50214/0 (socket says 172.21.15.83:50214) 2024-09-21T01:40:40.948 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:40.893+0000 7f01e2733640 1 -- 172.21.15.83:0/2930767131 learned_addr learned my addr 172.21.15.83:0/2930767131 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:40:40.948 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:40.893+0000 7f01e1731640 1 --2- 172.21.15.83:0/2930767131 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f01dc1094a0 0x7f01dc19a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:40:40.948 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:40.893+0000 7f01e1f32640 1 --2- 172.21.15.83:0/2930767131 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f01dc103b60 0x7f01dc19a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:40:40.948 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:40.894+0000 7f01e2733640 1 -- 172.21.15.83:0/2930767131 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f01dc1094a0 msgr2=0x7f01dc19a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:40:40.948 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:40.894+0000 7f01e2733640 1 --2- 172.21.15.83:0/2930767131 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f01dc1094a0 0x7f01dc19a910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:40.948 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:40.894+0000 7f01e2733640 1 -- 172.21.15.83:0/2930767131 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f01dc103b60 msgr2=0x7f01dc19a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:40:40.948 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:40.894+0000 7f01e2733640 1 --2- 172.21.15.83:0/2930767131 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f01dc103b60 0x7f01dc19a370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:40.948 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:40.894+0000 7f01e2733640 1 -- 172.21.15.83:0/2930767131 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01dc1a02e0 con 0x7f01dc109df0 2024-09-21T01:40:40.948 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:40.894+0000 7f01e2733640 1 --2- 172.21.15.83:0/2930767131 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f01dc109df0 0x7f01dc19fbb0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f01cc005ab0 tx=0x7f01cc0040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:40:40.948 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:40.894+0000 7f01daffd640 1 -- 172.21.15.83:0/2930767131 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01cc03f030 con 0x7f01dc109df0 2024-09-21T01:40:40.948 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:40.894+0000 7f01daffd640 1 -- 172.21.15.83:0/2930767131 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f01cc003a80 con 0x7f01dc109df0 2024-09-21T01:40:40.948 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:40.894+0000 7f01daffd640 1 -- 172.21.15.83:0/2930767131 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01cc035070 con 0x7f01dc109df0 2024-09-21T01:40:40.949 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:40.894+0000 7f01e4196640 1 -- 172.21.15.83:0/2930767131 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01dc1a0570 con 0x7f01dc109df0 2024-09-21T01:40:40.949 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:40.894+0000 7f01e4196640 1 -- 172.21.15.83:0/2930767131 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01dc1a6d30 con 0x7f01dc109df0 2024-09-21T01:40:40.949 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:40.895+0000 7f01e4196640 1 -- 172.21.15.83:0/2930767131 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01dc104de0 con 0x7f01dc109df0 2024-09-21T01:40:40.949 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:40.896+0000 7f01daffd640 1 -- 172.21.15.83:0/2930767131 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7f01cc042030 con 0x7f01dc109df0 2024-09-21T01:40:40.949 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:40.897+0000 7f01daffd640 1 --2- 172.21.15.83:0/2930767131 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f01c40b65f0 0x7f01c40b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:40:40.949 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:40.897+0000 7f01e1f32640 1 --2- 172.21.15.83:0/2930767131 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f01c40b65f0 0x7f01c40b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:40:40.949 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:40.897+0000 7f01daffd640 1 -- 172.21.15.83:0/2930767131 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9286+0+0 (secure 0 0 0) 0x7f01cc108180 con 0x7f01dc109df0 2024-09-21T01:40:40.949 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:40.898+0000 7f01e1f32640 1 --2- 172.21.15.83:0/2930767131 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f01c40b65f0 0x7f01c40b8b00 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f01d4005fd0 tx=0x7f01d4009760 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:40:40.949 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:40.900+0000 7f01daffd640 1 -- 172.21.15.83:0/2930767131 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f01cc0d2870 con 0x7f01dc109df0 2024-09-21T01:40:41.127 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:41.125+0000 7f01e4196640 1 -- 172.21.15.83:0/2930767131 --> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f01dc063800 con 0x7f01c40b65f0 2024-09-21T01:40:41.127 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:40:40 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:40:41.128 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:40:40 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:40:41.133 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:41.132+0000 7f01daffd640 1 -- 172.21.15.83:0/2930767131 <== mgr.14223 v2:172.21.15.83:6800/1748483157 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340513 (secure 0 0 0) 0x7f01dc063800 con 0x7f01c40b65f0 2024-09-21T01:40:41.137 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T01:40:41.139 INFO:teuthology.orchestra.run.smithi083.stderr:dumped all 2024-09-21T01:40:41.141 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:41.136+0000 7f01e4196640 1 -- 172.21.15.83:0/2930767131 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f01c40b65f0 msgr2=0x7f01c40b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:40:41.141 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:41.136+0000 7f01e4196640 1 --2- 172.21.15.83:0/2930767131 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f01c40b65f0 0x7f01c40b8b00 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f01d4005fd0 tx=0x7f01d4009760 comp rx=0 tx=0).stop 2024-09-21T01:40:41.141 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:41.136+0000 7f01e4196640 1 -- 172.21.15.83:0/2930767131 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f01dc109df0 msgr2=0x7f01dc19fbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:40:41.141 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:41.136+0000 7f01e4196640 1 --2- 172.21.15.83:0/2930767131 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f01dc109df0 0x7f01dc19fbb0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f01cc005ab0 tx=0x7f01cc0040e0 comp rx=0 tx=0).stop 2024-09-21T01:40:41.141 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:41.137+0000 7f01e4196640 1 -- 172.21.15.83:0/2930767131 shutdown_connections 2024-09-21T01:40:41.141 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:41.137+0000 7f01e4196640 1 --2- 172.21.15.83:0/2930767131 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f01c40b65f0 0x7f01c40b8b00 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:41.142 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:41.137+0000 7f01e4196640 1 --2- 172.21.15.83:0/2930767131 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f01dc109df0 0x7f01dc19fbb0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:41.142 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:41.137+0000 7f01e4196640 1 --2- 172.21.15.83:0/2930767131 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f01dc1094a0 0x7f01dc19a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:41.142 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:41.137+0000 7f01e4196640 1 --2- 172.21.15.83:0/2930767131 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f01dc103b60 0x7f01dc19a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:41.142 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:41.137+0000 7f01e4196640 1 -- 172.21.15.83:0/2930767131 >> 172.21.15.83:0/2930767131 conn(0x7f01dc07b850 msgr2=0x7f01dc107530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:40:41.142 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:41.137+0000 7f01e4196640 1 -- 172.21.15.83:0/2930767131 shutdown_connections 2024-09-21T01:40:41.142 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:41.137+0000 7f01e4196640 1 -- 172.21.15.83:0/2930767131 wait complete. 2024-09-21T01:40:41.159 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:40:40 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:40:42.053 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:40:41 smithi083 ceph-mon[31370]: pgmap v296: 129 pgs: 129 active+clean; 630 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 5.0 KiB/s wr, 5 op/s 2024-09-21T01:40:42.053 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:40:41 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:40:42.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:40:41 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:40:42.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:40:41 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:40:42.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:40:41 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:40:42.089 INFO:teuthology.orchestra.run.smithi083.stdout:{"pg_ready":true,"pg_map":{"version":296,"stamp":"2024-09-21T01:40:40.770415+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":644634,"num_objects":26,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":118,"num_read_kb":142,"num_write":198,"num_write_kb":2229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":364348,"kb_used_data":10928,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124577476,"statfs":{"total":1151940427776,"available":1151567335424,"internally_reserved":0,"allocated":11190272,"data_stored":7623668,"data_compressed":390153,"data_compressed_allocated":528384,"data_compressed_original":2555904,"omap_allocated":19139,"internal_metadata":361674045},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":49626,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":35,"num_read_kb":71,"num_write":26,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003859"},"pg_stats":[{"pgid":"2.1f","version":"74'4","reported_seq":40,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:09.831237+0000","last_change":"2024-09-21T01:39:42.267244+0000","last_active":"2024-09-21T01:40:09.831237+0000","last_peered":"2024-09-21T01:40:09.831237+0000","last_clean":"2024-09-21T01:40:09.831237+0000","last_became_active":"2024-09-21T01:39:42.266786+0000","last_became_peered":"2024-09-21T01:39:42.266786+0000","last_unstale":"2024-09-21T01:40:09.831237+0000","last_undegraded":"2024-09-21T01:40:09.831237+0000","last_fullsized":"2024-09-21T01:40:09.831237+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:50:43.594150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:10.061961+0000","last_change":"2024-09-21T01:39:44.292808+0000","last_active":"2024-09-21T01:40:10.061961+0000","last_peered":"2024-09-21T01:40:10.061961+0000","last_clean":"2024-09-21T01:40:10.061961+0000","last_became_active":"2024-09-21T01:39:44.292416+0000","last_became_peered":"2024-09-21T01:39:44.292416+0000","last_unstale":"2024-09-21T01:40:10.061961+0000","last_undegraded":"2024-09-21T01:40:10.061961+0000","last_fullsized":"2024-09-21T01:40:10.061961+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:26:16.332353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:09.830926+0000","last_change":"2024-09-21T01:39:51.339117+0000","last_active":"2024-09-21T01:40:09.830926+0000","last_peered":"2024-09-21T01:40:09.830926+0000","last_clean":"2024-09-21T01:40:09.830926+0000","last_became_active":"2024-09-21T01:39:51.338467+0000","last_became_peered":"2024-09-21T01:39:51.338467+0000","last_unstale":"2024-09-21T01:40:09.830926+0000","last_undegraded":"2024-09-21T01:40:09.830926+0000","last_fullsized":"2024-09-21T01:40:09.830926+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:18:57.119730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"74'1","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:10.062245+0000","last_change":"2024-09-21T01:39:42.550130+0000","last_active":"2024-09-21T01:40:10.062245+0000","last_peered":"2024-09-21T01:40:10.062245+0000","last_clean":"2024-09-21T01:40:10.062245+0000","last_became_active":"2024-09-21T01:39:42.549676+0000","last_became_peered":"2024-09-21T01:39:42.549676+0000","last_unstale":"2024-09-21T01:40:10.062245+0000","last_undegraded":"2024-09-21T01:40:10.062245+0000","last_fullsized":"2024-09-21T01:40:10.062245+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:33:59.954738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:10.061638+0000","last_change":"2024-09-21T01:39:44.293860+0000","last_active":"2024-09-21T01:40:10.061638+0000","last_peered":"2024-09-21T01:40:10.061638+0000","last_clean":"2024-09-21T01:40:10.061638+0000","last_became_active":"2024-09-21T01:39:44.293490+0000","last_became_peered":"2024-09-21T01:39:44.293490+0000","last_unstale":"2024-09-21T01:40:10.061638+0000","last_undegraded":"2024-09-21T01:40:10.061638+0000","last_fullsized":"2024-09-21T01:40:10.061638+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:58:18.325647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:10.061333+0000","last_change":"2024-09-21T01:39:51.335826+0000","last_active":"2024-09-21T01:40:10.061333+0000","last_peered":"2024-09-21T01:40:10.061333+0000","last_clean":"2024-09-21T01:40:10.061333+0000","last_became_active":"2024-09-21T01:39:51.335346+0000","last_became_peered":"2024-09-21T01:39:51.335346+0000","last_unstale":"2024-09-21T01:40:10.061333+0000","last_undegraded":"2024-09-21T01:40:10.061333+0000","last_fullsized":"2024-09-21T01:40:10.061333+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:51:25.921336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"74'2","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:09.836169+0000","last_change":"2024-09-21T01:39:42.270594+0000","last_active":"2024-09-21T01:40:09.836169+0000","last_peered":"2024-09-21T01:40:09.836169+0000","last_clean":"2024-09-21T01:40:09.836169+0000","last_became_active":"2024-09-21T01:39:42.270138+0000","last_became_peered":"2024-09-21T01:39:42.270138+0000","last_unstale":"2024-09-21T01:40:09.836169+0000","last_undegraded":"2024-09-21T01:40:09.836169+0000","last_fullsized":"2024-09-21T01:40:09.836169+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:05:00.604343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:10.061396+0000","last_change":"2024-09-21T01:39:44.294397+0000","last_active":"2024-09-21T01:40:10.061396+0000","last_peered":"2024-09-21T01:40:10.061396+0000","last_clean":"2024-09-21T01:40:10.061396+0000","last_became_active":"2024-09-21T01:39:44.293992+0000","last_became_peered":"2024-09-21T01:39:44.293992+0000","last_unstale":"2024-09-21T01:40:10.061396+0000","last_undegraded":"2024-09-21T01:40:10.061396+0000","last_fullsized":"2024-09-21T01:40:10.061396+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:52:09.459167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:10.061567+0000","last_change":"2024-09-21T01:39:51.338546+0000","last_active":"2024-09-21T01:40:10.061567+0000","last_peered":"2024-09-21T01:40:10.061567+0000","last_clean":"2024-09-21T01:40:10.061567+0000","last_became_active":"2024-09-21T01:39:51.337850+0000","last_became_peered":"2024-09-21T01:39:51.337850+0000","last_unstale":"2024-09-21T01:40:10.061567+0000","last_undegraded":"2024-09-21T01:40:10.061567+0000","last_fullsized":"2024-09-21T01:40:10.061567+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:33:49.497520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"74'2","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:09.835874+0000","last_change":"2024-09-21T01:39:42.264214+0000","last_active":"2024-09-21T01:40:09.835874+0000","last_peered":"2024-09-21T01:40:09.835874+0000","last_clean":"2024-09-21T01:40:09.835874+0000","last_became_active":"2024-09-21T01:39:42.263782+0000","last_became_peered":"2024-09-21T01:39:42.263782+0000","last_unstale":"2024-09-21T01:40:09.835874+0000","last_undegraded":"2024-09-21T01:40:09.835874+0000","last_fullsized":"2024-09-21T01:40:09.835874+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:44:24.965078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:09.839708+0000","last_change":"2024-09-21T01:39:44.296579+0000","last_active":"2024-09-21T01:40:09.839708+0000","last_peered":"2024-09-21T01:40:09.839708+0000","last_clean":"2024-09-21T01:40:09.839708+0000","last_became_active":"2024-09-21T01:39:44.296175+0000","last_became_peered":"2024-09-21T01:39:44.296175+0000","last_unstale":"2024-09-21T01:40:09.839708+0000","last_undegraded":"2024-09-21T01:40:09.839708+0000","last_fullsized":"2024-09-21T01:40:09.839708+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:11:13.920000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:10.061215+0000","last_change":"2024-09-21T01:39:51.339046+0000","last_active":"2024-09-21T01:40:10.061215+0000","last_peered":"2024-09-21T01:40:10.061215+0000","last_clean":"2024-09-21T01:40:10.061215+0000","last_became_active":"2024-09-21T01:39:51.337379+0000","last_became_peered":"2024-09-21T01:39:51.337379+0000","last_unstale":"2024-09-21T01:40:10.061215+0000","last_undegraded":"2024-09-21T01:40:10.061215+0000","last_fullsized":"2024-09-21T01:40:10.061215+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:50:34.321615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:09.828303+0000","last_change":"2024-09-21T01:39:44.296849+0000","last_active":"2024-09-21T01:40:09.828303+0000","last_peered":"2024-09-21T01:40:09.828303+0000","last_clean":"2024-09-21T01:40:09.828303+0000","last_became_active":"2024-09-21T01:39:44.296460+0000","last_became_peered":"2024-09-21T01:39:44.296460+0000","last_unstale":"2024-09-21T01:40:09.828303+0000","last_undegraded":"2024-09-21T01:40:09.828303+0000","last_fullsized":"2024-09-21T01:40:09.828303+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:46:51.258576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"74'2","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:09.842964+0000","last_change":"2024-09-21T01:40:09.842127+0000","last_active":"2024-09-21T01:40:09.842964+0000","last_peered":"2024-09-21T01:40:09.842964+0000","last_clean":"2024-09-21T01:40:09.842964+0000","last_became_active":"2024-09-21T01:40:09.835330+0000","last_became_peered":"2024-09-21T01:40:09.835330+0000","last_unstale":"2024-09-21T01:40:09.842964+0000","last_undegraded":"2024-09-21T01:40:09.842964+0000","last_fullsized":"2024-09-21T01:40:09.842964+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:54:07.455805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:10.061393+0000","last_change":"2024-09-21T01:39:51.459595+0000","last_active":"2024-09-21T01:40:10.061393+0000","last_peered":"2024-09-21T01:40:10.061393+0000","last_clean":"2024-09-21T01:40:10.061393+0000","last_became_active":"2024-09-21T01:39:51.459137+0000","last_became_peered":"2024-09-21T01:39:51.459137+0000","last_unstale":"2024-09-21T01:40:10.061393+0000","last_undegraded":"2024-09-21T01:40:10.061393+0000","last_fullsized":"2024-09-21T01:40:10.061393+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:55:53.800615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:10.061365+0000","last_change":"2024-09-21T01:39:44.288328+0000","last_active":"2024-09-21T01:40:10.061365+0000","last_peered":"2024-09-21T01:40:10.061365+0000","last_clean":"2024-09-21T01:40:10.061365+0000","last_became_active":"2024-09-21T01:39:44.287994+0000","last_became_peered":"2024-09-21T01:39:44.287994+0000","last_unstale":"2024-09-21T01:40:10.061365+0000","last_undegraded":"2024-09-21T01:40:10.061365+0000","last_fullsized":"2024-09-21T01:40:10.061365+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:44:55.075693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":35,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:09.829785+0000","last_change":"2024-09-21T01:39:42.266271+0000","last_active":"2024-09-21T01:40:09.829785+0000","last_peered":"2024-09-21T01:40:09.829785+0000","last_clean":"2024-09-21T01:40:09.829785+0000","last_became_active":"2024-09-21T01:39:42.265904+0000","last_became_peered":"2024-09-21T01:39:42.265904+0000","last_unstale":"2024-09-21T01:40:09.829785+0000","last_undegraded":"2024-09-21T01:40:09.829785+0000","last_fullsized":"2024-09-21T01:40:09.829785+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:43:37.456263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"82'1","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:10.062111+0000","last_change":"2024-09-21T01:39:51.336649+0000","last_active":"2024-09-21T01:40:10.062111+0000","last_peered":"2024-09-21T01:40:10.062111+0000","last_clean":"2024-09-21T01:40:10.062111+0000","last_became_active":"2024-09-21T01:39:51.336153+0000","last_became_peered":"2024-09-21T01:39:51.336153+0000","last_unstale":"2024-09-21T01:40:10.062111+0000","last_undegraded":"2024-09-21T01:40:10.062111+0000","last_fullsized":"2024-09-21T01:40:10.062111+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:56:58.699051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:09.829396+0000","last_change":"2024-09-21T01:39:44.304919+0000","last_active":"2024-09-21T01:40:09.829396+0000","last_peered":"2024-09-21T01:40:09.829396+0000","last_clean":"2024-09-21T01:40:09.829396+0000","last_became_active":"2024-09-21T01:39:44.304509+0000","last_became_peered":"2024-09-21T01:39:44.304509+0000","last_unstale":"2024-09-21T01:40:09.829396+0000","last_undegraded":"2024-09-21T01:40:09.829396+0000","last_fullsized":"2024-09-21T01:40:09.829396+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:57:04.413151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":35,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:10.061112+0000","last_change":"2024-09-21T01:39:42.262536+0000","last_active":"2024-09-21T01:40:10.061112+0000","last_peered":"2024-09-21T01:40:10.061112+0000","last_clean":"2024-09-21T01:40:10.061112+0000","last_became_active":"2024-09-21T01:39:42.262179+0000","last_became_peered":"2024-09-21T01:39:42.262179+0000","last_unstale":"2024-09-21T01:40:10.061112+0000","last_undegraded":"2024-09-21T01:40:10.061112+0000","last_fullsized":"2024-09-21T01:40:10.061112+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:35:14.022839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:09.830860+0000","last_change":"2024-09-21T01:39:51.339664+0000","last_active":"2024-09-21T01:40:09.830860+0000","last_peered":"2024-09-21T01:40:09.830860+0000","last_clean":"2024-09-21T01:40:09.830860+0000","last_became_active":"2024-09-21T01:39:51.339140+0000","last_became_peered":"2024-09-21T01:39:51.339140+0000","last_unstale":"2024-09-21T01:40:09.830860+0000","last_undegraded":"2024-09-21T01:40:09.830860+0000","last_fullsized":"2024-09-21T01:40:09.830860+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:46:49.443937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:09.833458+0000","last_change":"2024-09-21T01:39:44.299174+0000","last_active":"2024-09-21T01:40:09.833458+0000","last_peered":"2024-09-21T01:40:09.833458+0000","last_clean":"2024-09-21T01:40:09.833458+0000","last_became_active":"2024-09-21T01:39:44.298778+0000","last_became_peered":"2024-09-21T01:39:44.298778+0000","last_unstale":"2024-09-21T01:40:09.833458+0000","last_undegraded":"2024-09-21T01:40:09.833458+0000","last_fullsized":"2024-09-21T01:40:09.833458+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:59:17.298726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":34,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:10.061619+0000","last_change":"2024-09-21T01:39:42.550521+0000","last_active":"2024-09-21T01:40:10.061619+0000","last_peered":"2024-09-21T01:40:10.061619+0000","last_clean":"2024-09-21T01:40:10.061619+0000","last_became_active":"2024-09-21T01:39:42.550210+0000","last_became_peered":"2024-09-21T01:39:42.550210+0000","last_unstale":"2024-09-21T01:40:10.061619+0000","last_undegraded":"2024-09-21T01:40:10.061619+0000","last_fullsized":"2024-09-21T01:40:10.061619+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:07:07.234815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:10.062390+0000","last_change":"2024-09-21T01:39:51.461448+0000","last_active":"2024-09-21T01:40:10.062390+0000","last_peered":"2024-09-21T01:40:10.062390+0000","last_clean":"2024-09-21T01:40:10.062390+0000","last_became_active":"2024-09-21T01:39:51.460790+0000","last_became_peered":"2024-09-21T01:39:51.460790+0000","last_unstale":"2024-09-21T01:40:10.062390+0000","last_undegraded":"2024-09-21T01:40:10.062390+0000","last_fullsized":"2024-09-21T01:40:10.062390+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:30:35.032588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:10.061323+0000","last_change":"2024-09-21T01:39:44.298697+0000","last_active":"2024-09-21T01:40:10.061323+0000","last_peered":"2024-09-21T01:40:10.061323+0000","last_clean":"2024-09-21T01:40:10.061323+0000","last_became_active":"2024-09-21T01:39:44.298333+0000","last_became_peered":"2024-09-21T01:39:44.298333+0000","last_unstale":"2024-09-21T01:40:10.061323+0000","last_undegraded":"2024-09-21T01:40:10.061323+0000","last_fullsized":"2024-09-21T01:40:10.061323+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:36:01.932630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"74'2","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:10.062169+0000","last_change":"2024-09-21T01:39:42.257383+0000","last_active":"2024-09-21T01:40:10.062169+0000","last_peered":"2024-09-21T01:40:10.062169+0000","last_clean":"2024-09-21T01:40:10.062169+0000","last_became_active":"2024-09-21T01:39:42.256896+0000","last_became_peered":"2024-09-21T01:39:42.256896+0000","last_unstale":"2024-09-21T01:40:10.062169+0000","last_undegraded":"2024-09-21T01:40:10.062169+0000","last_fullsized":"2024-09-21T01:40:10.062169+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:03:29.350623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:09.831118+0000","last_change":"2024-09-21T01:39:51.342055+0000","last_active":"2024-09-21T01:40:09.831118+0000","last_peered":"2024-09-21T01:40:09.831118+0000","last_clean":"2024-09-21T01:40:09.831118+0000","last_became_active":"2024-09-21T01:39:51.341602+0000","last_became_peered":"2024-09-21T01:39:51.341602+0000","last_unstale":"2024-09-21T01:40:09.831118+0000","last_undegraded":"2024-09-21T01:40:09.831118+0000","last_fullsized":"2024-09-21T01:40:09.831118+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:30:58.290018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:10.062041+0000","last_change":"2024-09-21T01:39:44.296725+0000","last_active":"2024-09-21T01:40:10.062041+0000","last_peered":"2024-09-21T01:40:10.062041+0000","last_clean":"2024-09-21T01:40:10.062041+0000","last_became_active":"2024-09-21T01:39:44.296411+0000","last_became_peered":"2024-09-21T01:39:44.296411+0000","last_unstale":"2024-09-21T01:40:10.062041+0000","last_undegraded":"2024-09-21T01:40:10.062041+0000","last_fullsized":"2024-09-21T01:40:10.062041+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:58:05.357486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"82'6","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:37.293830+0000","last_change":"2024-09-21T01:39:42.262831+0000","last_active":"2024-09-21T01:40:37.293830+0000","last_peered":"2024-09-21T01:40:37.293830+0000","last_clean":"2024-09-21T01:40:37.293830+0000","last_became_active":"2024-09-21T01:39:42.262462+0000","last_became_peered":"2024-09-21T01:39:42.262462+0000","last_unstale":"2024-09-21T01:40:37.293830+0000","last_undegraded":"2024-09-21T01:40:37.293830+0000","last_fullsized":"2024-09-21T01:40:37.293830+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:01:24.950607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:10.060603+0000","last_change":"2024-09-21T01:39:51.460620+0000","last_active":"2024-09-21T01:40:10.060603+0000","last_peered":"2024-09-21T01:40:10.060603+0000","last_clean":"2024-09-21T01:40:10.060603+0000","last_became_active":"2024-09-21T01:39:51.460052+0000","last_became_peered":"2024-09-21T01:39:51.460052+0000","last_unstale":"2024-09-21T01:40:10.060603+0000","last_undegraded":"2024-09-21T01:40:10.060603+0000","last_fullsized":"2024-09-21T01:40:10.060603+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:23:23.284102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:09.827751+0000","last_change":"2024-09-21T01:39:44.293129+0000","last_active":"2024-09-21T01:40:09.827751+0000","last_peered":"2024-09-21T01:40:09.827751+0000","last_clean":"2024-09-21T01:40:09.827751+0000","last_became_active":"2024-09-21T01:39:44.292799+0000","last_became_peered":"2024-09-21T01:39:44.292799+0000","last_unstale":"2024-09-21T01:40:09.827751+0000","last_undegraded":"2024-09-21T01:40:09.827751+0000","last_fullsized":"2024-09-21T01:40:09.827751+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:05:22.484632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":35,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:09.836090+0000","last_change":"2024-09-21T01:39:42.550724+0000","last_active":"2024-09-21T01:40:09.836090+0000","last_peered":"2024-09-21T01:40:09.836090+0000","last_clean":"2024-09-21T01:40:09.836090+0000","last_became_active":"2024-09-21T01:39:42.550334+0000","last_became_peered":"2024-09-21T01:39:42.550334+0000","last_unstale":"2024-09-21T01:40:09.836090+0000","last_undegraded":"2024-09-21T01:40:09.836090+0000","last_fullsized":"2024-09-21T01:40:09.836090+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:15:49.484663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:09.838421+0000","last_change":"2024-09-21T01:40:09.838305+0000","last_active":"2024-09-21T01:40:09.838421+0000","last_peered":"2024-09-21T01:40:09.838421+0000","last_clean":"2024-09-21T01:40:09.838421+0000","last_became_active":"2024-09-21T01:40:09.837734+0000","last_became_peered":"2024-09-21T01:40:09.837734+0000","last_unstale":"2024-09-21T01:40:09.838421+0000","last_undegraded":"2024-09-21T01:40:09.838421+0000","last_fullsized":"2024-09-21T01:40:09.838421+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:38:44.066723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,7,6],"acting":[11,8,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:09.832203+0000","last_change":"2024-09-21T01:39:44.292039+0000","last_active":"2024-09-21T01:40:09.832203+0000","last_peered":"2024-09-21T01:40:09.832203+0000","last_clean":"2024-09-21T01:40:09.832203+0000","last_became_active":"2024-09-21T01:39:44.291640+0000","last_became_peered":"2024-09-21T01:39:44.291640+0000","last_unstale":"2024-09-21T01:40:09.832203+0000","last_undegraded":"2024-09-21T01:40:09.832203+0000","last_fullsized":"2024-09-21T01:40:09.832203+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:24:59.891664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":42,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:10.063271+0000","last_change":"2024-09-21T01:40:10.063162+0000","last_active":"2024-09-21T01:40:10.063271+0000","last_peered":"2024-09-21T01:40:10.063271+0000","last_clean":"2024-09-21T01:40:10.063271+0000","last_became_active":"2024-09-21T01:40:10.062703+0000","last_became_peered":"2024-09-21T01:40:10.062703+0000","last_unstale":"2024-09-21T01:40:10.063271+0000","last_undegraded":"2024-09-21T01:40:10.063271+0000","last_fullsized":"2024-09-21T01:40:10.063271+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:32:04.933701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:09.833481+0000","last_change":"2024-09-21T01:39:51.460023+0000","last_active":"2024-09-21T01:40:09.833481+0000","last_peered":"2024-09-21T01:40:09.833481+0000","last_clean":"2024-09-21T01:40:09.833481+0000","last_became_active":"2024-09-21T01:39:51.459417+0000","last_became_peered":"2024-09-21T01:39:51.459417+0000","last_unstale":"2024-09-21T01:40:09.833481+0000","last_undegraded":"2024-09-21T01:40:09.833481+0000","last_fullsized":"2024-09-21T01:40:09.833481+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:54:24.301176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:09.832029+0000","last_change":"2024-09-21T01:39:44.295559+0000","last_active":"2024-09-21T01:40:09.832029+0000","last_peered":"2024-09-21T01:40:09.832029+0000","last_clean":"2024-09-21T01:40:09.832029+0000","last_became_active":"2024-09-21T01:39:44.294970+0000","last_became_peered":"2024-09-21T01:39:44.294970+0000","last_unstale":"2024-09-21T01:40:09.832029+0000","last_undegraded":"2024-09-21T01:40:09.832029+0000","last_fullsized":"2024-09-21T01:40:09.832029+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:46:16.582188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":35,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:09.828380+0000","last_change":"2024-09-21T01:39:42.269453+0000","last_active":"2024-09-21T01:40:09.828380+0000","last_peered":"2024-09-21T01:40:09.828380+0000","last_clean":"2024-09-21T01:40:09.828380+0000","last_became_active":"2024-09-21T01:39:42.269039+0000","last_became_peered":"2024-09-21T01:39:42.269039+0000","last_unstale":"2024-09-21T01:40:09.828380+0000","last_undegraded":"2024-09-21T01:40:09.828380+0000","last_fullsized":"2024-09-21T01:40:09.828380+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:47:29.053966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:09.827374+0000","last_change":"2024-09-21T01:39:51.337305+0000","last_active":"2024-09-21T01:40:09.827374+0000","last_peered":"2024-09-21T01:40:09.827374+0000","last_clean":"2024-09-21T01:40:09.827374+0000","last_became_active":"2024-09-21T01:39:51.336710+0000","last_became_peered":"2024-09-21T01:39:51.336710+0000","last_unstale":"2024-09-21T01:40:09.827374+0000","last_undegraded":"2024-09-21T01:40:09.827374+0000","last_fullsized":"2024-09-21T01:40:09.827374+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:13:42.333881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:09.839627+0000","last_change":"2024-09-21T01:39:44.297004+0000","last_active":"2024-09-21T01:40:09.839627+0000","last_peered":"2024-09-21T01:40:09.839627+0000","last_clean":"2024-09-21T01:40:09.839627+0000","last_became_active":"2024-09-21T01:39:44.296596+0000","last_became_peered":"2024-09-21T01:39:44.296596+0000","last_unstale":"2024-09-21T01:40:09.839627+0000","last_undegraded":"2024-09-21T01:40:09.839627+0000","last_fullsized":"2024-09-21T01:40:09.839627+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:14:32.542823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":35,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:09.827092+0000","last_change":"2024-09-21T01:39:42.550024+0000","last_active":"2024-09-21T01:40:09.827092+0000","last_peered":"2024-09-21T01:40:09.827092+0000","last_clean":"2024-09-21T01:40:09.827092+0000","last_became_active":"2024-09-21T01:39:42.549638+0000","last_became_peered":"2024-09-21T01:39:42.549638+0000","last_unstale":"2024-09-21T01:40:09.827092+0000","last_undegraded":"2024-09-21T01:40:09.827092+0000","last_fullsized":"2024-09-21T01:40:09.827092+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:23:39.210460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:09.827259+0000","last_change":"2024-09-21T01:39:51.459459+0000","last_active":"2024-09-21T01:40:09.827259+0000","last_peered":"2024-09-21T01:40:09.827259+0000","last_clean":"2024-09-21T01:40:09.827259+0000","last_became_active":"2024-09-21T01:39:51.459020+0000","last_became_peered":"2024-09-21T01:39:51.459020+0000","last_unstale":"2024-09-21T01:40:09.827259+0000","last_undegraded":"2024-09-21T01:40:09.827259+0000","last_fullsized":"2024-09-21T01:40:09.827259+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:50:08.337949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:09.834015+0000","last_change":"2024-09-21T01:40:09.833943+0000","last_active":"2024-09-21T01:40:09.834015+0000","last_peered":"2024-09-21T01:40:09.834015+0000","last_clean":"2024-09-21T01:40:09.834015+0000","last_became_active":"2024-09-21T01:40:09.833486+0000","last_became_peered":"2024-09-21T01:40:09.833486+0000","last_unstale":"2024-09-21T01:40:09.834015+0000","last_undegraded":"2024-09-21T01:40:09.834015+0000","last_fullsized":"2024-09-21T01:40:09.834015+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:26:52.751330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,2],"acting":[6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":35,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:09.828081+0000","last_change":"2024-09-21T01:39:42.267329+0000","last_active":"2024-09-21T01:40:09.828081+0000","last_peered":"2024-09-21T01:40:09.828081+0000","last_clean":"2024-09-21T01:40:09.828081+0000","last_became_active":"2024-09-21T01:39:42.266386+0000","last_became_peered":"2024-09-21T01:39:42.266386+0000","last_unstale":"2024-09-21T01:40:09.828081+0000","last_undegraded":"2024-09-21T01:40:09.828081+0000","last_fullsized":"2024-09-21T01:40:09.828081+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:31:20.877627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:09.840136+0000","last_change":"2024-09-21T01:39:51.461494+0000","last_active":"2024-09-21T01:40:09.840136+0000","last_peered":"2024-09-21T01:40:09.840136+0000","last_clean":"2024-09-21T01:40:09.840136+0000","last_became_active":"2024-09-21T01:39:51.460973+0000","last_became_peered":"2024-09-21T01:39:51.460973+0000","last_unstale":"2024-09-21T01:40:09.840136+0000","last_undegraded":"2024-09-21T01:40:09.840136+0000","last_fullsized":"2024-09-21T01:40:09.840136+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:09:50.319546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:10.061223+0000","last_change":"2024-09-21T01:39:44.300773+0000","last_active":"2024-09-21T01:40:10.061223+0000","last_peered":"2024-09-21T01:40:10.061223+0000","last_clean":"2024-09-21T01:40:10.061223+0000","last_became_active":"2024-09-21T01:39:44.300437+0000","last_became_peered":"2024-09-21T01:39:44.300437+0000","last_unstale":"2024-09-21T01:40:10.061223+0000","last_undegraded":"2024-09-21T01:40:10.061223+0000","last_fullsized":"2024-09-21T01:40:10.061223+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:06:34.171621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":35,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:10.062157+0000","last_change":"2024-09-21T01:39:42.262675+0000","last_active":"2024-09-21T01:40:10.062157+0000","last_peered":"2024-09-21T01:40:10.062157+0000","last_clean":"2024-09-21T01:40:10.062157+0000","last_became_active":"2024-09-21T01:39:42.262282+0000","last_became_peered":"2024-09-21T01:39:42.262282+0000","last_unstale":"2024-09-21T01:40:10.062157+0000","last_undegraded":"2024-09-21T01:40:10.062157+0000","last_fullsized":"2024-09-21T01:40:10.062157+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:26:01.595797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":109,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:09.828212+0000","last_change":"2024-09-21T01:38:31.172876+0000","last_active":"2024-09-21T01:40:09.828212+0000","last_peered":"2024-09-21T01:40:09.828212+0000","last_clean":"2024-09-21T01:40:09.828212+0000","last_became_active":"2024-09-21T01:38:31.167071+0000","last_became_peered":"2024-09-21T01:38:31.167071+0000","last_unstale":"2024-09-21T01:40:09.828212+0000","last_undegraded":"2024-09-21T01:40:09.828212+0000","last_fullsized":"2024-09-21T01:40:09.828212+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:35:07.475056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:35:07.475056+0000","last_clean_scrub_stamp":"2024-09-21T01:35:07.475056+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:56:01.878445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"82'1","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:09.828806+0000","last_change":"2024-09-21T01:39:51.338198+0000","last_active":"2024-09-21T01:40:09.828806+0000","last_peered":"2024-09-21T01:40:09.828806+0000","last_clean":"2024-09-21T01:40:09.828806+0000","last_became_active":"2024-09-21T01:39:51.337743+0000","last_became_peered":"2024-09-21T01:39:51.337743+0000","last_unstale":"2024-09-21T01:40:09.828806+0000","last_undegraded":"2024-09-21T01:40:09.828806+0000","last_fullsized":"2024-09-21T01:40:09.828806+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:19:45.552819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:09.828882+0000","last_change":"2024-09-21T01:39:44.298920+0000","last_active":"2024-09-21T01:40:09.828882+0000","last_peered":"2024-09-21T01:40:09.828882+0000","last_clean":"2024-09-21T01:40:09.828882+0000","last_became_active":"2024-09-21T01:39:44.298381+0000","last_became_peered":"2024-09-21T01:39:44.298381+0000","last_unstale":"2024-09-21T01:40:09.828882+0000","last_undegraded":"2024-09-21T01:40:09.828882+0000","last_fullsized":"2024-09-21T01:40:09.828882+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:12:53.681514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":35,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:09.830882+0000","last_change":"2024-09-21T01:39:42.550808+0000","last_active":"2024-09-21T01:40:09.830882+0000","last_peered":"2024-09-21T01:40:09.830882+0000","last_clean":"2024-09-21T01:40:09.830882+0000","last_became_active":"2024-09-21T01:39:42.550447+0000","last_became_peered":"2024-09-21T01:39:42.550447+0000","last_unstale":"2024-09-21T01:40:09.830882+0000","last_undegraded":"2024-09-21T01:40:09.830882+0000","last_fullsized":"2024-09-21T01:40:09.830882+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:20:56.996378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:10.061009+0000","last_change":"2024-09-21T01:39:51.338490+0000","last_active":"2024-09-21T01:40:10.061009+0000","last_peered":"2024-09-21T01:40:10.061009+0000","last_clean":"2024-09-21T01:40:10.061009+0000","last_became_active":"2024-09-21T01:39:51.338050+0000","last_became_peered":"2024-09-21T01:39:51.338050+0000","last_unstale":"2024-09-21T01:40:10.061009+0000","last_undegraded":"2024-09-21T01:40:10.061009+0000","last_fullsized":"2024-09-21T01:40:10.061009+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:49:56.705893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:09.828540+0000","last_change":"2024-09-21T01:39:44.293976+0000","last_active":"2024-09-21T01:40:09.828540+0000","last_peered":"2024-09-21T01:40:09.828540+0000","last_clean":"2024-09-21T01:40:09.828540+0000","last_became_active":"2024-09-21T01:39:44.293547+0000","last_became_peered":"2024-09-21T01:39:44.293547+0000","last_unstale":"2024-09-21T01:40:09.828540+0000","last_undegraded":"2024-09-21T01:40:09.828540+0000","last_fullsized":"2024-09-21T01:40:09.828540+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:05:07.209936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"74'1","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:09.840219+0000","last_change":"2024-09-21T01:39:42.270124+0000","last_active":"2024-09-21T01:40:09.840219+0000","last_peered":"2024-09-21T01:40:09.840219+0000","last_clean":"2024-09-21T01:40:09.840219+0000","last_became_active":"2024-09-21T01:39:42.269435+0000","last_became_peered":"2024-09-21T01:39:42.269435+0000","last_unstale":"2024-09-21T01:40:09.840219+0000","last_undegraded":"2024-09-21T01:40:09.840219+0000","last_fullsized":"2024-09-21T01:40:09.840219+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:12:08.374394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:10.061183+0000","last_change":"2024-09-21T01:39:51.334459+0000","last_active":"2024-09-21T01:40:10.061183+0000","last_peered":"2024-09-21T01:40:10.061183+0000","last_clean":"2024-09-21T01:40:10.061183+0000","last_became_active":"2024-09-21T01:39:51.334039+0000","last_became_peered":"2024-09-21T01:39:51.334039+0000","last_unstale":"2024-09-21T01:40:10.061183+0000","last_undegraded":"2024-09-21T01:40:10.061183+0000","last_fullsized":"2024-09-21T01:40:10.061183+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:04:44.906648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:09.828864+0000","last_change":"2024-09-21T01:39:44.298467+0000","last_active":"2024-09-21T01:40:09.828864+0000","last_peered":"2024-09-21T01:40:09.828864+0000","last_clean":"2024-09-21T01:40:09.828864+0000","last_became_active":"2024-09-21T01:39:44.298128+0000","last_became_peered":"2024-09-21T01:39:44.298128+0000","last_unstale":"2024-09-21T01:40:09.828864+0000","last_undegraded":"2024-09-21T01:40:09.828864+0000","last_fullsized":"2024-09-21T01:40:09.828864+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:54:11.096417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"74'2","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:09.827654+0000","last_change":"2024-09-21T01:39:42.262761+0000","last_active":"2024-09-21T01:40:09.827654+0000","last_peered":"2024-09-21T01:40:09.827654+0000","last_clean":"2024-09-21T01:40:09.827654+0000","last_became_active":"2024-09-21T01:39:42.262428+0000","last_became_peered":"2024-09-21T01:39:42.262428+0000","last_unstale":"2024-09-21T01:40:09.827654+0000","last_undegraded":"2024-09-21T01:40:09.827654+0000","last_fullsized":"2024-09-21T01:40:09.827654+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:11:50.326638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:09.839102+0000","last_change":"2024-09-21T01:39:51.344320+0000","last_active":"2024-09-21T01:40:09.839102+0000","last_peered":"2024-09-21T01:40:09.839102+0000","last_clean":"2024-09-21T01:40:09.839102+0000","last_became_active":"2024-09-21T01:39:51.343902+0000","last_became_peered":"2024-09-21T01:39:51.343902+0000","last_unstale":"2024-09-21T01:40:09.839102+0000","last_undegraded":"2024-09-21T01:40:09.839102+0000","last_fullsized":"2024-09-21T01:40:09.839102+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:13:36.139159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:09.837909+0000","last_change":"2024-09-21T01:40:09.837769+0000","last_active":"2024-09-21T01:40:09.837909+0000","last_peered":"2024-09-21T01:40:09.837909+0000","last_clean":"2024-09-21T01:40:09.837909+0000","last_became_active":"2024-09-21T01:40:09.837296+0000","last_became_peered":"2024-09-21T01:40:09.837296+0000","last_unstale":"2024-09-21T01:40:09.837909+0000","last_undegraded":"2024-09-21T01:40:09.837909+0000","last_fullsized":"2024-09-21T01:40:09.837909+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:37:20.360076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"74'1","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:09.835689+0000","last_change":"2024-09-21T01:39:42.264955+0000","last_active":"2024-09-21T01:40:09.835689+0000","last_peered":"2024-09-21T01:40:09.835689+0000","last_clean":"2024-09-21T01:40:09.835689+0000","last_became_active":"2024-09-21T01:39:42.264492+0000","last_became_peered":"2024-09-21T01:39:42.264492+0000","last_unstale":"2024-09-21T01:40:09.835689+0000","last_undegraded":"2024-09-21T01:40:09.835689+0000","last_fullsized":"2024-09-21T01:40:09.835689+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:17:38.631521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:09.839331+0000","last_change":"2024-09-21T01:39:51.337908+0000","last_active":"2024-09-21T01:40:09.839331+0000","last_peered":"2024-09-21T01:40:09.839331+0000","last_clean":"2024-09-21T01:40:09.839331+0000","last_became_active":"2024-09-21T01:39:51.337200+0000","last_became_peered":"2024-09-21T01:39:51.337200+0000","last_unstale":"2024-09-21T01:40:09.839331+0000","last_undegraded":"2024-09-21T01:40:09.839331+0000","last_fullsized":"2024-09-21T01:40:09.839331+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:07:18.505959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:10.063647+0000","last_change":"2024-09-21T01:40:10.063539+0000","last_active":"2024-09-21T01:40:10.063647+0000","last_peered":"2024-09-21T01:40:10.063647+0000","last_clean":"2024-09-21T01:40:10.063647+0000","last_became_active":"2024-09-21T01:40:10.062966+0000","last_became_peered":"2024-09-21T01:40:10.062966+0000","last_unstale":"2024-09-21T01:40:10.063647+0000","last_undegraded":"2024-09-21T01:40:10.063647+0000","last_fullsized":"2024-09-21T01:40:10.063647+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:53:20.747493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,1],"acting":[5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"74'8","reported_seq":43,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:09.834143+0000","last_change":"2024-09-21T01:39:42.550795+0000","last_active":"2024-09-21T01:40:09.834143+0000","last_peered":"2024-09-21T01:40:09.834143+0000","last_clean":"2024-09-21T01:40:09.834143+0000","last_became_active":"2024-09-21T01:39:42.550424+0000","last_became_peered":"2024-09-21T01:39:42.550424+0000","last_unstale":"2024-09-21T01:40:09.834143+0000","last_undegraded":"2024-09-21T01:40:09.834143+0000","last_fullsized":"2024-09-21T01:40:09.834143+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:50:53.421080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:09.827620+0000","last_change":"2024-09-21T01:39:51.335239+0000","last_active":"2024-09-21T01:40:09.827620+0000","last_peered":"2024-09-21T01:40:09.827620+0000","last_clean":"2024-09-21T01:40:09.827620+0000","last_became_active":"2024-09-21T01:39:51.334846+0000","last_became_peered":"2024-09-21T01:39:51.334846+0000","last_unstale":"2024-09-21T01:40:09.827620+0000","last_undegraded":"2024-09-21T01:40:09.827620+0000","last_fullsized":"2024-09-21T01:40:09.827620+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:47:30.820219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:09.827932+0000","last_change":"2024-09-21T01:39:44.296080+0000","last_active":"2024-09-21T01:40:09.827932+0000","last_peered":"2024-09-21T01:40:09.827932+0000","last_clean":"2024-09-21T01:40:09.827932+0000","last_became_active":"2024-09-21T01:39:44.295724+0000","last_became_peered":"2024-09-21T01:39:44.295724+0000","last_unstale":"2024-09-21T01:40:09.827932+0000","last_undegraded":"2024-09-21T01:40:09.827932+0000","last_fullsized":"2024-09-21T01:40:09.827932+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:20:56.366350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":35,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:10.062713+0000","last_change":"2024-09-21T01:39:42.264499+0000","last_active":"2024-09-21T01:40:10.062713+0000","last_peered":"2024-09-21T01:40:10.062713+0000","last_clean":"2024-09-21T01:40:10.062713+0000","last_became_active":"2024-09-21T01:39:42.264059+0000","last_became_peered":"2024-09-21T01:39:42.264059+0000","last_unstale":"2024-09-21T01:40:10.062713+0000","last_undegraded":"2024-09-21T01:40:10.062713+0000","last_fullsized":"2024-09-21T01:40:10.062713+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:27:42.970693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:09.831000+0000","last_change":"2024-09-21T01:39:51.329357+0000","last_active":"2024-09-21T01:40:09.831000+0000","last_peered":"2024-09-21T01:40:09.831000+0000","last_clean":"2024-09-21T01:40:09.831000+0000","last_became_active":"2024-09-21T01:39:51.328761+0000","last_became_peered":"2024-09-21T01:39:51.328761+0000","last_unstale":"2024-09-21T01:40:09.831000+0000","last_undegraded":"2024-09-21T01:40:09.831000+0000","last_fullsized":"2024-09-21T01:40:09.831000+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:48:04.089765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:09.828303+0000","last_change":"2024-09-21T01:39:44.295799+0000","last_active":"2024-09-21T01:40:09.828303+0000","last_peered":"2024-09-21T01:40:09.828303+0000","last_clean":"2024-09-21T01:40:09.828303+0000","last_became_active":"2024-09-21T01:39:44.295432+0000","last_became_peered":"2024-09-21T01:39:44.295432+0000","last_unstale":"2024-09-21T01:40:09.828303+0000","last_undegraded":"2024-09-21T01:40:09.828303+0000","last_fullsized":"2024-09-21T01:40:09.828303+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:18:10.702545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":35,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:09.840236+0000","last_change":"2024-09-21T01:39:42.270552+0000","last_active":"2024-09-21T01:40:09.840236+0000","last_peered":"2024-09-21T01:40:09.840236+0000","last_clean":"2024-09-21T01:40:09.840236+0000","last_became_active":"2024-09-21T01:39:42.270158+0000","last_became_peered":"2024-09-21T01:39:42.270158+0000","last_unstale":"2024-09-21T01:40:09.840236+0000","last_undegraded":"2024-09-21T01:40:09.840236+0000","last_fullsized":"2024-09-21T01:40:09.840236+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:19:52.229598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:09.829757+0000","last_change":"2024-09-21T01:39:51.335823+0000","last_active":"2024-09-21T01:40:09.829757+0000","last_peered":"2024-09-21T01:40:09.829757+0000","last_clean":"2024-09-21T01:40:09.829757+0000","last_became_active":"2024-09-21T01:39:51.335363+0000","last_became_peered":"2024-09-21T01:39:51.335363+0000","last_unstale":"2024-09-21T01:40:09.829757+0000","last_undegraded":"2024-09-21T01:40:09.829757+0000","last_fullsized":"2024-09-21T01:40:09.829757+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:33:01.418708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:09.827109+0000","last_change":"2024-09-21T01:39:44.288963+0000","last_active":"2024-09-21T01:40:09.827109+0000","last_peered":"2024-09-21T01:40:09.827109+0000","last_clean":"2024-09-21T01:40:09.827109+0000","last_became_active":"2024-09-21T01:39:44.286967+0000","last_became_peered":"2024-09-21T01:39:44.286967+0000","last_unstale":"2024-09-21T01:40:09.827109+0000","last_undegraded":"2024-09-21T01:40:09.827109+0000","last_fullsized":"2024-09-21T01:40:09.827109+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:02:32.653351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"74'2","reported_seq":38,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:09.830335+0000","last_change":"2024-09-21T01:39:42.268553+0000","last_active":"2024-09-21T01:40:09.830335+0000","last_peered":"2024-09-21T01:40:09.830335+0000","last_clean":"2024-09-21T01:40:09.830335+0000","last_became_active":"2024-09-21T01:39:42.268154+0000","last_became_peered":"2024-09-21T01:39:42.268154+0000","last_unstale":"2024-09-21T01:40:09.830335+0000","last_undegraded":"2024-09-21T01:40:09.830335+0000","last_fullsized":"2024-09-21T01:40:09.830335+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:22:54.223718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:09.839584+0000","last_change":"2024-09-21T01:39:51.342268+0000","last_active":"2024-09-21T01:40:09.839584+0000","last_peered":"2024-09-21T01:40:09.839584+0000","last_clean":"2024-09-21T01:40:09.839584+0000","last_became_active":"2024-09-21T01:39:51.341221+0000","last_became_peered":"2024-09-21T01:39:51.341221+0000","last_unstale":"2024-09-21T01:40:09.839584+0000","last_undegraded":"2024-09-21T01:40:09.839584+0000","last_fullsized":"2024-09-21T01:40:09.839584+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:46:16.297124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:09.835851+0000","last_change":"2024-09-21T01:39:44.300338+0000","last_active":"2024-09-21T01:40:09.835851+0000","last_peered":"2024-09-21T01:40:09.835851+0000","last_clean":"2024-09-21T01:40:09.835851+0000","last_became_active":"2024-09-21T01:39:44.299920+0000","last_became_peered":"2024-09-21T01:39:44.299920+0000","last_unstale":"2024-09-21T01:40:09.835851+0000","last_undegraded":"2024-09-21T01:40:09.835851+0000","last_fullsized":"2024-09-21T01:40:09.835851+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:23:47.631867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"82'24","reported_seq":90,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:37.980153+0000","last_change":"2024-09-21T01:39:42.266883+0000","last_active":"2024-09-21T01:40:37.980153+0000","last_peered":"2024-09-21T01:40:37.980153+0000","last_clean":"2024-09-21T01:40:37.980153+0000","last_became_active":"2024-09-21T01:39:42.266494+0000","last_became_peered":"2024-09-21T01:39:42.266494+0000","last_unstale":"2024-09-21T01:40:37.980153+0000","last_undegraded":"2024-09-21T01:40:37.980153+0000","last_fullsized":"2024-09-21T01:40:37.980153+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:56:46.777522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53234,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":31,"num_read_kb":67,"num_write":24,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:09.842133+0000","last_change":"2024-09-21T01:40:09.842036+0000","last_active":"2024-09-21T01:40:09.842133+0000","last_peered":"2024-09-21T01:40:09.842133+0000","last_clean":"2024-09-21T01:40:09.842133+0000","last_became_active":"2024-09-21T01:40:09.841680+0000","last_became_peered":"2024-09-21T01:40:09.841680+0000","last_unstale":"2024-09-21T01:40:09.842133+0000","last_undegraded":"2024-09-21T01:40:09.842133+0000","last_fullsized":"2024-09-21T01:40:09.842133+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:01:58.366511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,11,5],"acting":[10,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:10.061533+0000","last_change":"2024-09-21T01:39:44.296958+0000","last_active":"2024-09-21T01:40:10.061533+0000","last_peered":"2024-09-21T01:40:10.061533+0000","last_clean":"2024-09-21T01:40:10.061533+0000","last_became_active":"2024-09-21T01:39:44.296588+0000","last_became_peered":"2024-09-21T01:39:44.296588+0000","last_unstale":"2024-09-21T01:40:10.061533+0000","last_undegraded":"2024-09-21T01:40:10.061533+0000","last_fullsized":"2024-09-21T01:40:10.061533+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:04:25.222279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"74'3","reported_seq":38,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:09.839831+0000","last_change":"2024-09-21T01:39:42.550770+0000","last_active":"2024-09-21T01:40:09.839831+0000","last_peered":"2024-09-21T01:40:09.839831+0000","last_clean":"2024-09-21T01:40:09.839831+0000","last_became_active":"2024-09-21T01:39:42.550317+0000","last_became_peered":"2024-09-21T01:39:42.550317+0000","last_unstale":"2024-09-21T01:40:09.839831+0000","last_undegraded":"2024-09-21T01:40:09.839831+0000","last_fullsized":"2024-09-21T01:40:09.839831+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:11:05.269317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:10.061785+0000","last_change":"2024-09-21T01:39:51.342166+0000","last_active":"2024-09-21T01:40:10.061785+0000","last_peered":"2024-09-21T01:40:10.061785+0000","last_clean":"2024-09-21T01:40:10.061785+0000","last_became_active":"2024-09-21T01:39:51.341633+0000","last_became_peered":"2024-09-21T01:39:51.341633+0000","last_unstale":"2024-09-21T01:40:10.061785+0000","last_undegraded":"2024-09-21T01:40:10.061785+0000","last_fullsized":"2024-09-21T01:40:10.061785+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:47:13.524123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:10.061759+0000","last_change":"2024-09-21T01:39:44.297652+0000","last_active":"2024-09-21T01:40:10.061759+0000","last_peered":"2024-09-21T01:40:10.061759+0000","last_clean":"2024-09-21T01:40:10.061759+0000","last_became_active":"2024-09-21T01:39:44.297289+0000","last_became_peered":"2024-09-21T01:39:44.297289+0000","last_unstale":"2024-09-21T01:40:10.061759+0000","last_undegraded":"2024-09-21T01:40:10.061759+0000","last_fullsized":"2024-09-21T01:40:10.061759+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:14:52.834492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":35,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:09.828808+0000","last_change":"2024-09-21T01:39:42.269881+0000","last_active":"2024-09-21T01:40:09.828808+0000","last_peered":"2024-09-21T01:40:09.828808+0000","last_clean":"2024-09-21T01:40:09.828808+0000","last_became_active":"2024-09-21T01:39:42.269498+0000","last_became_peered":"2024-09-21T01:39:42.269498+0000","last_unstale":"2024-09-21T01:40:09.828808+0000","last_undegraded":"2024-09-21T01:40:09.828808+0000","last_fullsized":"2024-09-21T01:40:09.828808+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:10:31.750792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:10.064534+0000","last_change":"2024-09-21T01:40:10.063827+0000","last_active":"2024-09-21T01:40:10.064534+0000","last_peered":"2024-09-21T01:40:10.064534+0000","last_clean":"2024-09-21T01:40:10.064534+0000","last_became_active":"2024-09-21T01:40:10.063206+0000","last_became_peered":"2024-09-21T01:40:10.063206+0000","last_unstale":"2024-09-21T01:40:10.064534+0000","last_undegraded":"2024-09-21T01:40:10.064534+0000","last_fullsized":"2024-09-21T01:40:10.064534+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:33:28.905812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2,4],"acting":[8,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:10.061870+0000","last_change":"2024-09-21T01:39:44.292241+0000","last_active":"2024-09-21T01:40:10.061870+0000","last_peered":"2024-09-21T01:40:10.061870+0000","last_clean":"2024-09-21T01:40:10.061870+0000","last_became_active":"2024-09-21T01:39:44.291808+0000","last_became_peered":"2024-09-21T01:39:44.291808+0000","last_unstale":"2024-09-21T01:40:10.061870+0000","last_undegraded":"2024-09-21T01:40:10.061870+0000","last_fullsized":"2024-09-21T01:40:10.061870+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:47:24.761137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":35,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:09.832583+0000","last_change":"2024-09-21T01:39:42.272047+0000","last_active":"2024-09-21T01:40:09.832583+0000","last_peered":"2024-09-21T01:40:09.832583+0000","last_clean":"2024-09-21T01:40:09.832583+0000","last_became_active":"2024-09-21T01:39:42.271668+0000","last_became_peered":"2024-09-21T01:39:42.271668+0000","last_unstale":"2024-09-21T01:40:09.832583+0000","last_undegraded":"2024-09-21T01:40:09.832583+0000","last_fullsized":"2024-09-21T01:40:09.832583+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:44:09.702328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:10.060992+0000","last_change":"2024-09-21T01:39:51.337760+0000","last_active":"2024-09-21T01:40:10.060992+0000","last_peered":"2024-09-21T01:40:10.060992+0000","last_clean":"2024-09-21T01:40:10.060992+0000","last_became_active":"2024-09-21T01:39:51.337337+0000","last_became_peered":"2024-09-21T01:39:51.337337+0000","last_unstale":"2024-09-21T01:40:10.060992+0000","last_undegraded":"2024-09-21T01:40:10.060992+0000","last_fullsized":"2024-09-21T01:40:10.060992+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:33:49.316833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:10.061110+0000","last_change":"2024-09-21T01:39:51.334722+0000","last_active":"2024-09-21T01:40:10.061110+0000","last_peered":"2024-09-21T01:40:10.061110+0000","last_clean":"2024-09-21T01:40:10.061110+0000","last_became_active":"2024-09-21T01:39:51.334318+0000","last_became_peered":"2024-09-21T01:39:51.334318+0000","last_unstale":"2024-09-21T01:40:10.061110+0000","last_undegraded":"2024-09-21T01:40:10.061110+0000","last_fullsized":"2024-09-21T01:40:10.061110+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:29:17.625223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:09.830956+0000","last_change":"2024-09-21T01:39:44.283183+0000","last_active":"2024-09-21T01:40:09.830956+0000","last_peered":"2024-09-21T01:40:09.830956+0000","last_clean":"2024-09-21T01:40:09.830956+0000","last_became_active":"2024-09-21T01:39:44.282829+0000","last_became_peered":"2024-09-21T01:39:44.282829+0000","last_unstale":"2024-09-21T01:40:09.830956+0000","last_undegraded":"2024-09-21T01:40:09.830956+0000","last_fullsized":"2024-09-21T01:40:09.830956+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:31:43.602584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":35,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:09.839892+0000","last_change":"2024-09-21T01:39:42.267465+0000","last_active":"2024-09-21T01:40:09.839892+0000","last_peered":"2024-09-21T01:40:09.839892+0000","last_clean":"2024-09-21T01:40:09.839892+0000","last_became_active":"2024-09-21T01:39:42.267051+0000","last_became_peered":"2024-09-21T01:39:42.267051+0000","last_unstale":"2024-09-21T01:40:09.839892+0000","last_undegraded":"2024-09-21T01:40:09.839892+0000","last_fullsized":"2024-09-21T01:40:09.839892+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:17:30.917284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:09.830341+0000","last_change":"2024-09-21T01:39:51.338907+0000","last_active":"2024-09-21T01:40:09.830341+0000","last_peered":"2024-09-21T01:40:09.830341+0000","last_clean":"2024-09-21T01:40:09.830341+0000","last_became_active":"2024-09-21T01:39:51.338444+0000","last_became_peered":"2024-09-21T01:39:51.338444+0000","last_unstale":"2024-09-21T01:40:09.830341+0000","last_undegraded":"2024-09-21T01:40:09.830341+0000","last_fullsized":"2024-09-21T01:40:09.830341+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:35:44.819976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:10.060746+0000","last_change":"2024-09-21T01:39:44.293735+0000","last_active":"2024-09-21T01:40:10.060746+0000","last_peered":"2024-09-21T01:40:10.060746+0000","last_clean":"2024-09-21T01:40:10.060746+0000","last_became_active":"2024-09-21T01:39:44.293371+0000","last_became_peered":"2024-09-21T01:39:44.293371+0000","last_unstale":"2024-09-21T01:40:10.060746+0000","last_undegraded":"2024-09-21T01:40:10.060746+0000","last_fullsized":"2024-09-21T01:40:10.060746+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:50:50.404018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":35,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:09.826967+0000","last_change":"2024-09-21T01:39:42.259012+0000","last_active":"2024-09-21T01:40:09.826967+0000","last_peered":"2024-09-21T01:40:09.826967+0000","last_clean":"2024-09-21T01:40:09.826967+0000","last_became_active":"2024-09-21T01:39:42.258665+0000","last_became_peered":"2024-09-21T01:39:42.258665+0000","last_unstale":"2024-09-21T01:40:09.826967+0000","last_undegraded":"2024-09-21T01:40:09.826967+0000","last_fullsized":"2024-09-21T01:40:09.826967+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:25:24.797505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"74'1","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:09.832588+0000","last_change":"2024-09-21T01:39:42.270969+0000","last_active":"2024-09-21T01:40:09.832588+0000","last_peered":"2024-09-21T01:40:09.832588+0000","last_clean":"2024-09-21T01:40:09.832588+0000","last_became_active":"2024-09-21T01:39:42.270629+0000","last_became_peered":"2024-09-21T01:39:42.270629+0000","last_unstale":"2024-09-21T01:40:09.832588+0000","last_undegraded":"2024-09-21T01:40:09.832588+0000","last_fullsized":"2024-09-21T01:40:09.832588+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:30:06.321196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:09.839565+0000","last_change":"2024-09-21T01:39:44.297656+0000","last_active":"2024-09-21T01:40:09.839565+0000","last_peered":"2024-09-21T01:40:09.839565+0000","last_clean":"2024-09-21T01:40:09.839565+0000","last_became_active":"2024-09-21T01:39:44.297273+0000","last_became_peered":"2024-09-21T01:39:44.297273+0000","last_unstale":"2024-09-21T01:40:09.839565+0000","last_undegraded":"2024-09-21T01:40:09.839565+0000","last_fullsized":"2024-09-21T01:40:09.839565+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:35:24.645472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:09.842500+0000","last_change":"2024-09-21T01:40:09.842397+0000","last_active":"2024-09-21T01:40:09.842500+0000","last_peered":"2024-09-21T01:40:09.842500+0000","last_clean":"2024-09-21T01:40:09.842500+0000","last_became_active":"2024-09-21T01:40:09.841934+0000","last_became_peered":"2024-09-21T01:40:09.841934+0000","last_unstale":"2024-09-21T01:40:09.842500+0000","last_undegraded":"2024-09-21T01:40:09.842500+0000","last_fullsized":"2024-09-21T01:40:09.842500+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:06:36.189594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,8,5],"acting":[2,6,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"74'1","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:09.839648+0000","last_change":"2024-09-21T01:39:42.267207+0000","last_active":"2024-09-21T01:40:09.839648+0000","last_peered":"2024-09-21T01:40:09.839648+0000","last_clean":"2024-09-21T01:40:09.839648+0000","last_became_active":"2024-09-21T01:39:42.266829+0000","last_became_peered":"2024-09-21T01:39:42.266829+0000","last_unstale":"2024-09-21T01:40:09.839648+0000","last_undegraded":"2024-09-21T01:40:09.839648+0000","last_fullsized":"2024-09-21T01:40:09.839648+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:03:18.047546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:09.835253+0000","last_change":"2024-09-21T01:39:44.305545+0000","last_active":"2024-09-21T01:40:09.835253+0000","last_peered":"2024-09-21T01:40:09.835253+0000","last_clean":"2024-09-21T01:40:09.835253+0000","last_became_active":"2024-09-21T01:39:44.305195+0000","last_became_peered":"2024-09-21T01:39:44.305195+0000","last_unstale":"2024-09-21T01:40:09.835253+0000","last_undegraded":"2024-09-21T01:40:09.835253+0000","last_fullsized":"2024-09-21T01:40:09.835253+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:26:50.011622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:09.829821+0000","last_change":"2024-09-21T01:39:51.342132+0000","last_active":"2024-09-21T01:40:09.829821+0000","last_peered":"2024-09-21T01:40:09.829821+0000","last_clean":"2024-09-21T01:40:09.829821+0000","last_became_active":"2024-09-21T01:39:51.341668+0000","last_became_peered":"2024-09-21T01:39:51.341668+0000","last_unstale":"2024-09-21T01:40:09.829821+0000","last_undegraded":"2024-09-21T01:40:09.829821+0000","last_fullsized":"2024-09-21T01:40:09.829821+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:28:18.119259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:09.829307+0000","last_change":"2024-09-21T01:39:44.300226+0000","last_active":"2024-09-21T01:40:09.829307+0000","last_peered":"2024-09-21T01:40:09.829307+0000","last_clean":"2024-09-21T01:40:09.829307+0000","last_became_active":"2024-09-21T01:39:44.298740+0000","last_became_peered":"2024-09-21T01:39:44.298740+0000","last_unstale":"2024-09-21T01:40:09.829307+0000","last_undegraded":"2024-09-21T01:40:09.829307+0000","last_fullsized":"2024-09-21T01:40:09.829307+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:05:33.288070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:09.831481+0000","last_change":"2024-09-21T01:39:44.301379+0000","last_active":"2024-09-21T01:40:09.831481+0000","last_peered":"2024-09-21T01:40:09.831481+0000","last_clean":"2024-09-21T01:40:09.831481+0000","last_became_active":"2024-09-21T01:39:44.301011+0000","last_became_peered":"2024-09-21T01:39:44.301011+0000","last_unstale":"2024-09-21T01:40:09.831481+0000","last_undegraded":"2024-09-21T01:40:09.831481+0000","last_fullsized":"2024-09-21T01:40:09.831481+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:16:47.672736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:09.829652+0000","last_change":"2024-09-21T01:39:44.294318+0000","last_active":"2024-09-21T01:40:09.829652+0000","last_peered":"2024-09-21T01:40:09.829652+0000","last_clean":"2024-09-21T01:40:09.829652+0000","last_became_active":"2024-09-21T01:39:44.293941+0000","last_became_peered":"2024-09-21T01:39:44.293941+0000","last_unstale":"2024-09-21T01:40:09.829652+0000","last_undegraded":"2024-09-21T01:40:09.829652+0000","last_fullsized":"2024-09-21T01:40:09.829652+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:27:34.776088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:10.061284+0000","last_change":"2024-09-21T01:39:44.287815+0000","last_active":"2024-09-21T01:40:10.061284+0000","last_peered":"2024-09-21T01:40:10.061284+0000","last_clean":"2024-09-21T01:40:10.061284+0000","last_became_active":"2024-09-21T01:39:44.287471+0000","last_became_peered":"2024-09-21T01:39:44.287471+0000","last_unstale":"2024-09-21T01:40:10.061284+0000","last_undegraded":"2024-09-21T01:40:10.061284+0000","last_fullsized":"2024-09-21T01:40:10.061284+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:13:59.661464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:09.827475+0000","last_change":"2024-09-21T01:39:44.285591+0000","last_active":"2024-09-21T01:40:09.827475+0000","last_peered":"2024-09-21T01:40:09.827475+0000","last_clean":"2024-09-21T01:40:09.827475+0000","last_became_active":"2024-09-21T01:39:44.285253+0000","last_became_peered":"2024-09-21T01:39:44.285253+0000","last_unstale":"2024-09-21T01:40:09.827475+0000","last_undegraded":"2024-09-21T01:40:09.827475+0000","last_fullsized":"2024-09-21T01:40:09.827475+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:58:02.890685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:09.830098+0000","last_change":"2024-09-21T01:39:44.306547+0000","last_active":"2024-09-21T01:40:09.830098+0000","last_peered":"2024-09-21T01:40:09.830098+0000","last_clean":"2024-09-21T01:40:09.830098+0000","last_became_active":"2024-09-21T01:39:44.306116+0000","last_became_peered":"2024-09-21T01:39:44.306116+0000","last_unstale":"2024-09-21T01:40:09.830098+0000","last_undegraded":"2024-09-21T01:40:09.830098+0000","last_fullsized":"2024-09-21T01:40:09.830098+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:58:40.654784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:09.830420+0000","last_change":"2024-09-21T01:39:44.295317+0000","last_active":"2024-09-21T01:40:09.830420+0000","last_peered":"2024-09-21T01:40:09.830420+0000","last_clean":"2024-09-21T01:40:09.830420+0000","last_became_active":"2024-09-21T01:39:44.294936+0000","last_became_peered":"2024-09-21T01:39:44.294936+0000","last_unstale":"2024-09-21T01:40:09.830420+0000","last_undegraded":"2024-09-21T01:40:09.830420+0000","last_fullsized":"2024-09-21T01:40:09.830420+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:32:24.112588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:10.062190+0000","last_change":"2024-09-21T01:39:44.297242+0000","last_active":"2024-09-21T01:40:10.062190+0000","last_peered":"2024-09-21T01:40:10.062190+0000","last_clean":"2024-09-21T01:40:10.062190+0000","last_became_active":"2024-09-21T01:39:44.296072+0000","last_became_peered":"2024-09-21T01:39:44.296072+0000","last_unstale":"2024-09-21T01:40:10.062190+0000","last_undegraded":"2024-09-21T01:40:10.062190+0000","last_fullsized":"2024-09-21T01:40:10.062190+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:22:23.449535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:09.839349+0000","last_change":"2024-09-21T01:39:44.293899+0000","last_active":"2024-09-21T01:40:09.839349+0000","last_peered":"2024-09-21T01:40:09.839349+0000","last_clean":"2024-09-21T01:40:09.839349+0000","last_became_active":"2024-09-21T01:39:44.293502+0000","last_became_peered":"2024-09-21T01:39:44.293502+0000","last_unstale":"2024-09-21T01:40:09.839349+0000","last_undegraded":"2024-09-21T01:40:09.839349+0000","last_fullsized":"2024-09-21T01:40:09.839349+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:07:39.549931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:10.061041+0000","last_change":"2024-09-21T01:39:44.298192+0000","last_active":"2024-09-21T01:40:10.061041+0000","last_peered":"2024-09-21T01:40:10.061041+0000","last_clean":"2024-09-21T01:40:10.061041+0000","last_became_active":"2024-09-21T01:39:44.297834+0000","last_became_peered":"2024-09-21T01:39:44.297834+0000","last_unstale":"2024-09-21T01:40:10.061041+0000","last_undegraded":"2024-09-21T01:40:10.061041+0000","last_fullsized":"2024-09-21T01:40:10.061041+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:41:21.759972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:10.061259+0000","last_change":"2024-09-21T01:39:44.300125+0000","last_active":"2024-09-21T01:40:10.061259+0000","last_peered":"2024-09-21T01:40:10.061259+0000","last_clean":"2024-09-21T01:40:10.061259+0000","last_became_active":"2024-09-21T01:39:44.298047+0000","last_became_peered":"2024-09-21T01:39:44.298047+0000","last_unstale":"2024-09-21T01:40:10.061259+0000","last_undegraded":"2024-09-21T01:40:10.061259+0000","last_fullsized":"2024-09-21T01:40:10.061259+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:31:58.719520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:09.827359+0000","last_change":"2024-09-21T01:39:44.287346+0000","last_active":"2024-09-21T01:40:09.827359+0000","last_peered":"2024-09-21T01:40:09.827359+0000","last_clean":"2024-09-21T01:40:09.827359+0000","last_became_active":"2024-09-21T01:39:44.286999+0000","last_became_peered":"2024-09-21T01:39:44.286999+0000","last_unstale":"2024-09-21T01:40:09.827359+0000","last_undegraded":"2024-09-21T01:40:09.827359+0000","last_fullsized":"2024-09-21T01:40:09.827359+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:42:26.732516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:09.829908+0000","last_change":"2024-09-21T01:39:44.299083+0000","last_active":"2024-09-21T01:40:09.829908+0000","last_peered":"2024-09-21T01:40:09.829908+0000","last_clean":"2024-09-21T01:40:09.829908+0000","last_became_active":"2024-09-21T01:39:44.298194+0000","last_became_peered":"2024-09-21T01:39:44.298194+0000","last_unstale":"2024-09-21T01:40:09.829908+0000","last_undegraded":"2024-09-21T01:40:09.829908+0000","last_fullsized":"2024-09-21T01:40:09.829908+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:22:23.360519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:09.830016+0000","last_change":"2024-09-21T01:39:44.292985+0000","last_active":"2024-09-21T01:40:09.830016+0000","last_peered":"2024-09-21T01:40:09.830016+0000","last_clean":"2024-09-21T01:40:09.830016+0000","last_became_active":"2024-09-21T01:39:44.292565+0000","last_became_peered":"2024-09-21T01:39:44.292565+0000","last_unstale":"2024-09-21T01:40:09.830016+0000","last_undegraded":"2024-09-21T01:40:09.830016+0000","last_fullsized":"2024-09-21T01:40:09.830016+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:03:33.563458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:09.830968+0000","last_change":"2024-09-21T01:39:44.291522+0000","last_active":"2024-09-21T01:40:09.830968+0000","last_peered":"2024-09-21T01:40:09.830968+0000","last_clean":"2024-09-21T01:40:09.830968+0000","last_became_active":"2024-09-21T01:39:44.291173+0000","last_became_peered":"2024-09-21T01:39:44.291173+0000","last_unstale":"2024-09-21T01:40:09.830968+0000","last_undegraded":"2024-09-21T01:40:09.830968+0000","last_fullsized":"2024-09-21T01:40:09.830968+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:41:54.562004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:09.830994+0000","last_change":"2024-09-21T01:39:44.305053+0000","last_active":"2024-09-21T01:40:09.830994+0000","last_peered":"2024-09-21T01:40:09.830994+0000","last_clean":"2024-09-21T01:40:09.830994+0000","last_became_active":"2024-09-21T01:39:44.304651+0000","last_became_peered":"2024-09-21T01:39:44.304651+0000","last_unstale":"2024-09-21T01:40:09.830994+0000","last_undegraded":"2024-09-21T01:40:09.830994+0000","last_fullsized":"2024-09-21T01:40:09.830994+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:15:42.819633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:10.060809+0000","last_change":"2024-09-21T01:39:44.298405+0000","last_active":"2024-09-21T01:40:10.060809+0000","last_peered":"2024-09-21T01:40:10.060809+0000","last_clean":"2024-09-21T01:40:10.060809+0000","last_became_active":"2024-09-21T01:39:44.298010+0000","last_became_peered":"2024-09-21T01:39:44.298010+0000","last_unstale":"2024-09-21T01:40:10.060809+0000","last_undegraded":"2024-09-21T01:40:10.060809+0000","last_fullsized":"2024-09-21T01:40:10.060809+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:09:15.321530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:10.061608+0000","last_change":"2024-09-21T01:39:44.290593+0000","last_active":"2024-09-21T01:40:10.061608+0000","last_peered":"2024-09-21T01:40:10.061608+0000","last_clean":"2024-09-21T01:40:10.061608+0000","last_became_active":"2024-09-21T01:39:44.290235+0000","last_became_peered":"2024-09-21T01:39:44.290235+0000","last_unstale":"2024-09-21T01:40:10.061608+0000","last_undegraded":"2024-09-21T01:40:10.061608+0000","last_fullsized":"2024-09-21T01:40:10.061608+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:52:20.359493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:10.060892+0000","last_change":"2024-09-21T01:39:44.301902+0000","last_active":"2024-09-21T01:40:10.060892+0000","last_peered":"2024-09-21T01:40:10.060892+0000","last_clean":"2024-09-21T01:40:10.060892+0000","last_became_active":"2024-09-21T01:39:44.301494+0000","last_became_peered":"2024-09-21T01:39:44.301494+0000","last_unstale":"2024-09-21T01:40:10.060892+0000","last_undegraded":"2024-09-21T01:40:10.060892+0000","last_fullsized":"2024-09-21T01:40:10.060892+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:06:16.162987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:09.827305+0000","last_change":"2024-09-21T01:39:44.292360+0000","last_active":"2024-09-21T01:40:09.827305+0000","last_peered":"2024-09-21T01:40:09.827305+0000","last_clean":"2024-09-21T01:40:09.827305+0000","last_became_active":"2024-09-21T01:39:44.291995+0000","last_became_peered":"2024-09-21T01:39:44.291995+0000","last_unstale":"2024-09-21T01:40:09.827305+0000","last_undegraded":"2024-09-21T01:40:09.827305+0000","last_fullsized":"2024-09-21T01:40:09.827305+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:29:10.511082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:10.062033+0000","last_change":"2024-09-21T01:39:44.291836+0000","last_active":"2024-09-21T01:40:10.062033+0000","last_peered":"2024-09-21T01:40:10.062033+0000","last_clean":"2024-09-21T01:40:10.062033+0000","last_became_active":"2024-09-21T01:39:44.291459+0000","last_became_peered":"2024-09-21T01:39:44.291459+0000","last_unstale":"2024-09-21T01:40:10.062033+0000","last_undegraded":"2024-09-21T01:40:10.062033+0000","last_fullsized":"2024-09-21T01:40:10.062033+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:11:53.296520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:09.828871+0000","last_change":"2024-09-21T01:39:44.298572+0000","last_active":"2024-09-21T01:40:09.828871+0000","last_peered":"2024-09-21T01:40:09.828871+0000","last_clean":"2024-09-21T01:40:09.828871+0000","last_became_active":"2024-09-21T01:39:44.297903+0000","last_became_peered":"2024-09-21T01:39:44.297903+0000","last_unstale":"2024-09-21T01:40:09.828871+0000","last_undegraded":"2024-09-21T01:40:09.828871+0000","last_fullsized":"2024-09-21T01:40:09.828871+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:25:06.327202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:09.832637+0000","last_change":"2024-09-21T01:39:44.292648+0000","last_active":"2024-09-21T01:40:09.832637+0000","last_peered":"2024-09-21T01:40:09.832637+0000","last_clean":"2024-09-21T01:40:09.832637+0000","last_became_active":"2024-09-21T01:39:44.292215+0000","last_became_peered":"2024-09-21T01:39:44.292215+0000","last_unstale":"2024-09-21T01:40:09.832637+0000","last_undegraded":"2024-09-21T01:40:09.832637+0000","last_fullsized":"2024-09-21T01:40:09.832637+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:43:02.265276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:10.061804+0000","last_change":"2024-09-21T01:39:44.303330+0000","last_active":"2024-09-21T01:40:10.061804+0000","last_peered":"2024-09-21T01:40:10.061804+0000","last_clean":"2024-09-21T01:40:10.061804+0000","last_became_active":"2024-09-21T01:39:44.302862+0000","last_became_peered":"2024-09-21T01:39:44.302862+0000","last_unstale":"2024-09-21T01:40:10.061804+0000","last_undegraded":"2024-09-21T01:40:10.061804+0000","last_fullsized":"2024-09-21T01:40:10.061804+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:58:12.296150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:10.060703+0000","last_change":"2024-09-21T01:39:44.288015+0000","last_active":"2024-09-21T01:40:10.060703+0000","last_peered":"2024-09-21T01:40:10.060703+0000","last_clean":"2024-09-21T01:40:10.060703+0000","last_became_active":"2024-09-21T01:39:44.287455+0000","last_became_peered":"2024-09-21T01:39:44.287455+0000","last_unstale":"2024-09-21T01:40:10.060703+0000","last_undegraded":"2024-09-21T01:40:10.060703+0000","last_fullsized":"2024-09-21T01:40:10.060703+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:12:07.036882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:09.828037+0000","last_change":"2024-09-21T01:39:44.294594+0000","last_active":"2024-09-21T01:40:09.828037+0000","last_peered":"2024-09-21T01:40:09.828037+0000","last_clean":"2024-09-21T01:40:09.828037+0000","last_became_active":"2024-09-21T01:39:44.294218+0000","last_became_peered":"2024-09-21T01:39:44.294218+0000","last_unstale":"2024-09-21T01:40:09.828037+0000","last_undegraded":"2024-09-21T01:40:09.828037+0000","last_fullsized":"2024-09-21T01:40:09.828037+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:45:54.875131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:09.832554+0000","last_change":"2024-09-21T01:39:44.285172+0000","last_active":"2024-09-21T01:40:09.832554+0000","last_peered":"2024-09-21T01:40:09.832554+0000","last_clean":"2024-09-21T01:40:09.832554+0000","last_became_active":"2024-09-21T01:39:44.284799+0000","last_became_peered":"2024-09-21T01:39:44.284799+0000","last_unstale":"2024-09-21T01:40:09.832554+0000","last_undegraded":"2024-09-21T01:40:09.832554+0000","last_fullsized":"2024-09-21T01:40:09.832554+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:06:30.562297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:09.835339+0000","last_change":"2024-09-21T01:39:44.295990+0000","last_active":"2024-09-21T01:40:09.835339+0000","last_peered":"2024-09-21T01:40:09.835339+0000","last_clean":"2024-09-21T01:40:09.835339+0000","last_became_active":"2024-09-21T01:39:44.295601+0000","last_became_peered":"2024-09-21T01:39:44.295601+0000","last_unstale":"2024-09-21T01:40:09.835339+0000","last_undegraded":"2024-09-21T01:40:09.835339+0000","last_fullsized":"2024-09-21T01:40:09.835339+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:37:08.300911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:10.061899+0000","last_change":"2024-09-21T01:39:44.300104+0000","last_active":"2024-09-21T01:40:10.061899+0000","last_peered":"2024-09-21T01:40:10.061899+0000","last_clean":"2024-09-21T01:40:10.061899+0000","last_became_active":"2024-09-21T01:39:44.299709+0000","last_became_peered":"2024-09-21T01:39:44.299709+0000","last_unstale":"2024-09-21T01:40:10.061899+0000","last_undegraded":"2024-09-21T01:40:10.061899+0000","last_fullsized":"2024-09-21T01:40:10.061899+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:01:35.013021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:10.061448+0000","last_change":"2024-09-21T01:39:44.295900+0000","last_active":"2024-09-21T01:40:10.061448+0000","last_peered":"2024-09-21T01:40:10.061448+0000","last_clean":"2024-09-21T01:40:10.061448+0000","last_became_active":"2024-09-21T01:39:44.295303+0000","last_became_peered":"2024-09-21T01:39:44.295303+0000","last_unstale":"2024-09-21T01:40:10.061448+0000","last_undegraded":"2024-09-21T01:40:10.061448+0000","last_fullsized":"2024-09-21T01:40:10.061448+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:00:23.097745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:10.061227+0000","last_change":"2024-09-21T01:39:44.303627+0000","last_active":"2024-09-21T01:40:10.061227+0000","last_peered":"2024-09-21T01:40:10.061227+0000","last_clean":"2024-09-21T01:40:10.061227+0000","last_became_active":"2024-09-21T01:39:44.303260+0000","last_became_peered":"2024-09-21T01:39:44.303260+0000","last_unstale":"2024-09-21T01:40:10.061227+0000","last_undegraded":"2024-09-21T01:40:10.061227+0000","last_fullsized":"2024-09-21T01:40:10.061227+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:17:39.630994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:09.830845+0000","last_change":"2024-09-21T01:39:44.306087+0000","last_active":"2024-09-21T01:40:09.830845+0000","last_peered":"2024-09-21T01:40:09.830845+0000","last_clean":"2024-09-21T01:40:09.830845+0000","last_became_active":"2024-09-21T01:39:44.305660+0000","last_became_peered":"2024-09-21T01:39:44.305660+0000","last_unstale":"2024-09-21T01:40:09.830845+0000","last_undegraded":"2024-09-21T01:40:09.830845+0000","last_fullsized":"2024-09-21T01:40:09.830845+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:26:46.911966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":54032,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":37,"num_read_kb":73,"num_write":73,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":245760,"data_stored":162096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":62,"ondisk_log_size":62,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":376832,"data_stored":4132576,"data_compressed":247723,"data_compressed_allocated":315392,"data_compressed_original":4096000,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":68,"seq":292057776152,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":901120,"data_stored":475571,"data_compressed":23550,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939676,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32180,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712972,"statfs":{"total":95995035648,"available":95962083328,"internally_reserved":0,"allocated":1019904,"data_stored":1115271,"data_compressed":59401,"data_compressed_allocated":77824,"data_compressed_original":655360,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":58,"seq":249108103202,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":909312,"data_stored":480249,"data_compressed":23550,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":52,"seq":223338299431,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":909312,"data_stored":476175,"data_compressed":23550,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495659,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32120,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713032,"statfs":{"total":95995035648,"available":95962144768,"internally_reserved":0,"allocated":958464,"data_stored":1070617,"data_compressed":59401,"data_compressed_allocated":77824,"data_compressed_original":655360,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":41,"seq":176093659184,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":897024,"data_stored":471475,"data_compressed":23550,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855414,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32124,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713028,"statfs":{"total":95995035648,"available":95962140672,"internally_reserved":0,"allocated":962560,"data_stored":1066121,"data_compressed":59401,"data_compressed_allocated":77824,"data_compressed_original":655360,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018939,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":905216,"data_stored":475593,"data_compressed":23550,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182464,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32068,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713084,"statfs":{"total":95995035648,"available":95962198016,"internally_reserved":0,"allocated":905216,"data_stored":471579,"data_compressed":23550,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411397,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36284,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708868,"statfs":{"total":95995035648,"available":95957880832,"internally_reserved":0,"allocated":962560,"data_stored":524743,"data_compressed":23550,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574921,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32120,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713032,"statfs":{"total":95995035648,"available":95962144768,"internally_reserved":0,"allocated":958464,"data_stored":524709,"data_compressed":23550,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705743,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":901120,"data_stored":471565,"data_compressed":23550,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34234,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34234,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35851,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35851,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35851,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35851,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35851,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":53234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":53268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":53428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T01:40:42.095 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph pg dump --format=json 2024-09-21T01:40:42.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:40:41 smithi142 ceph-mon[34050]: pgmap v296: 129 pgs: 129 active+clean; 630 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 5.0 KiB/s wr, 5 op/s 2024-09-21T01:40:42.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:40:41 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:40:42.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:40:41 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:40:42.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:40:41 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:40:42.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:40:41 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:40:42.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:40:41 smithi119 ceph-mon[33693]: pgmap v296: 129 pgs: 129 active+clean; 630 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 5.0 KiB/s wr, 5 op/s 2024-09-21T01:40:42.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:40:41 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:40:42.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:40:41 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:40:42.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:40:41 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:40:42.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:40:41 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:40:42.527 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:40:42.906 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:40:42 smithi083 ceph-mon[31370]: from='client.15069 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T01:40:43.002 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:42.991+0000 7ff374982640 1 -- 172.21.15.83:0/2599412588 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff370102ae0 msgr2=0x7ff370102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:40:43.003 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:42.991+0000 7ff374982640 1 --2- 172.21.15.83:0/2599412588 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff370102ae0 0x7ff370102ef0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7ff360009ca0 tx=0x7ff36002a8c0 comp rx=0 tx=0).stop 2024-09-21T01:40:43.003 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:42.991+0000 7ff374982640 1 -- 172.21.15.83:0/2599412588 shutdown_connections 2024-09-21T01:40:43.003 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:42.991+0000 7ff374982640 1 --2- 172.21.15.83:0/2599412588 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff370108d70 0x7ff37010f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:43.003 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:42.991+0000 7ff374982640 1 --2- 172.21.15.83:0/2599412588 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff370108420 0x7ff370108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:43.003 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:42.991+0000 7ff374982640 1 --2- 172.21.15.83:0/2599412588 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff370102ae0 0x7ff370102ef0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:43.003 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:42.991+0000 7ff374982640 1 -- 172.21.15.83:0/2599412588 >> 172.21.15.83:0/2599412588 conn(0x7ff370079770 msgr2=0x7ff370079b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:40:43.003 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:42.991+0000 7ff374982640 1 -- 172.21.15.83:0/2599412588 shutdown_connections 2024-09-21T01:40:43.003 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:42.991+0000 7ff374982640 1 -- 172.21.15.83:0/2599412588 wait complete. 2024-09-21T01:40:43.003 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:42.992+0000 7ff374982640 1 Processor -- start 2024-09-21T01:40:43.003 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:42.992+0000 7ff374982640 1 -- start start 2024-09-21T01:40:43.003 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:42.992+0000 7ff374982640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff370102ae0 0x7ff37019b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:40:43.003 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:42.992+0000 7ff374982640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff370108420 0x7ff37019b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:40:43.003 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:42.992+0000 7ff374982640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff370108d70 0x7ff37019bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:40:43.004 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:42.992+0000 7ff374982640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7ff370112930 con 0x7ff370108420 2024-09-21T01:40:43.004 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:42.992+0000 7ff374982640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7ff3701127b0 con 0x7ff370108d70 2024-09-21T01:40:43.004 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:42.992+0000 7ff374982640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7ff370112ab0 con 0x7ff370102ae0 2024-09-21T01:40:43.004 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:42.992+0000 7ff36dd9b640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff370108420 0x7ff37019b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:40:43.004 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:42.992+0000 7ff36dd9b640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff370108420 0x7ff37019b7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:48798/0 (socket says 172.21.15.83:48798) 2024-09-21T01:40:43.004 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:42.992+0000 7ff36dd9b640 1 -- 172.21.15.83:0/1111348442 learned_addr learned my addr 172.21.15.83:0/1111348442 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:40:43.004 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:42.992+0000 7ff36e59c640 1 --2- 172.21.15.83:0/1111348442 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff370102ae0 0x7ff37019b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:40:43.004 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:42.992+0000 7ff36ed9d640 1 --2- 172.21.15.83:0/1111348442 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff370108d70 0x7ff37019bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:40:43.004 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:42.993+0000 7ff36dd9b640 1 -- 172.21.15.83:0/1111348442 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff370102ae0 msgr2=0x7ff37019b280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:40:43.004 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:42.993+0000 7ff36dd9b640 1 --2- 172.21.15.83:0/1111348442 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff370102ae0 0x7ff37019b280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:43.004 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:42.993+0000 7ff36dd9b640 1 -- 172.21.15.83:0/1111348442 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff370108d70 msgr2=0x7ff37019bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:40:43.004 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:42.993+0000 7ff36dd9b640 1 --2- 172.21.15.83:0/1111348442 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff370108d70 0x7ff37019bd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:43.004 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:42.993+0000 7ff36dd9b640 1 -- 172.21.15.83:0/1111348442 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3701a6510 con 0x7ff370108420 2024-09-21T01:40:43.004 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:42.993+0000 7ff36dd9b640 1 --2- 172.21.15.83:0/1111348442 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff370108420 0x7ff37019b7c0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7ff36400d740 tx=0x7ff36400dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:40:43.005 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:42.993+0000 7ff35f7fe640 1 -- 172.21.15.83:0/1111348442 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff364017070 con 0x7ff370108420 2024-09-21T01:40:43.005 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:42.993+0000 7ff374982640 1 -- 172.21.15.83:0/1111348442 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3701a6800 con 0x7ff370108420 2024-09-21T01:40:43.005 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:42.993+0000 7ff35f7fe640 1 -- 172.21.15.83:0/1111348442 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff36400de50 con 0x7ff370108420 2024-09-21T01:40:43.005 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:42.993+0000 7ff35f7fe640 1 -- 172.21.15.83:0/1111348442 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff36400f620 con 0x7ff370108420 2024-09-21T01:40:43.005 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:42.993+0000 7ff374982640 1 -- 172.21.15.83:0/1111348442 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3701a6d90 con 0x7ff370108420 2024-09-21T01:40:43.005 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:42.994+0000 7ff374982640 1 -- 172.21.15.83:0/1111348442 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff370103d60 con 0x7ff370108420 2024-09-21T01:40:43.005 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:42.995+0000 7ff35f7fe640 1 -- 172.21.15.83:0/1111348442 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7ff36401a070 con 0x7ff370108420 2024-09-21T01:40:43.005 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:42.996+0000 7ff35f7fe640 1 --2- 172.21.15.83:0/1111348442 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7ff3580b6620 0x7ff3580b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:40:43.005 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:42.996+0000 7ff36e59c640 1 --2- 172.21.15.83:0/1111348442 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7ff3580b6620 0x7ff3580b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:40:43.005 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:42.996+0000 7ff35f7fe640 1 -- 172.21.15.83:0/1111348442 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9286+0+0 (secure 0 0 0) 0x7ff3640e7200 con 0x7ff370108420 2024-09-21T01:40:43.005 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:42.997+0000 7ff36e59c640 1 --2- 172.21.15.83:0/1111348442 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7ff3580b6620 0x7ff3580b8b30 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7ff360006010 tx=0x7ff360031000 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:40:43.005 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:43.001+0000 7ff35f7fe640 1 -- 172.21.15.83:0/1111348442 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff3640b18f0 con 0x7ff370108420 2024-09-21T01:40:43.199 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:43.197+0000 7ff374982640 1 -- 172.21.15.83:0/1111348442 --> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff370063800 con 0x7ff3580b6620 2024-09-21T01:40:43.205 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:43.204+0000 7ff35f7fe640 1 -- 172.21.15.83:0/1111348442 <== mgr.14223 v2:172.21.15.83:6800/1748483157 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340513 (secure 0 0 0) 0x7ff370063800 con 0x7ff3580b6620 2024-09-21T01:40:43.209 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T01:40:43.210 INFO:teuthology.orchestra.run.smithi083.stderr:dumped all 2024-09-21T01:40:43.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:43.207+0000 7ff374982640 1 -- 172.21.15.83:0/1111348442 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7ff3580b6620 msgr2=0x7ff3580b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:40:43.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:43.207+0000 7ff374982640 1 --2- 172.21.15.83:0/1111348442 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7ff3580b6620 0x7ff3580b8b30 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7ff360006010 tx=0x7ff360031000 comp rx=0 tx=0).stop 2024-09-21T01:40:43.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:43.207+0000 7ff374982640 1 -- 172.21.15.83:0/1111348442 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff370108420 msgr2=0x7ff37019b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:40:43.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:43.208+0000 7ff374982640 1 --2- 172.21.15.83:0/1111348442 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff370108420 0x7ff37019b7c0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7ff36400d740 tx=0x7ff36400dc00 comp rx=0 tx=0).stop 2024-09-21T01:40:43.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:43.208+0000 7ff374982640 1 -- 172.21.15.83:0/1111348442 shutdown_connections 2024-09-21T01:40:43.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:43.208+0000 7ff374982640 1 --2- 172.21.15.83:0/1111348442 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7ff3580b6620 0x7ff3580b8b30 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:43.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:43.208+0000 7ff374982640 1 --2- 172.21.15.83:0/1111348442 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff370108d70 0x7ff37019bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:43.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:43.208+0000 7ff374982640 1 --2- 172.21.15.83:0/1111348442 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff370108420 0x7ff37019b7c0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:43.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:43.208+0000 7ff374982640 1 --2- 172.21.15.83:0/1111348442 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff370102ae0 0x7ff37019b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:43.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:43.208+0000 7ff374982640 1 -- 172.21.15.83:0/1111348442 >> 172.21.15.83:0/1111348442 conn(0x7ff370079770 msgr2=0x7ff3701064b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:40:43.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:43.208+0000 7ff374982640 1 -- 172.21.15.83:0/1111348442 shutdown_connections 2024-09-21T01:40:43.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:43.208+0000 7ff374982640 1 -- 172.21.15.83:0/1111348442 wait complete. 2024-09-21T01:40:43.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:40:42 smithi142 ceph-mon[34050]: from='client.15069 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T01:40:43.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:40:42 smithi119 ceph-mon[33693]: from='client.15069 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T01:40:43.878 INFO:teuthology.orchestra.run.smithi083.stdout:{"pg_ready":true,"pg_map":{"version":297,"stamp":"2024-09-21T01:40:42.770918+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":644634,"num_objects":26,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":118,"num_read_kb":142,"num_write":198,"num_write_kb":2229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":364372,"kb_used_data":10952,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124577452,"statfs":{"total":1151940427776,"available":1151567310848,"internally_reserved":0,"allocated":11214848,"data_stored":7643964,"data_compressed":390153,"data_compressed_allocated":528384,"data_compressed_original":2555904,"omap_allocated":19139,"internal_metadata":361674045},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":49626,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":24,"num_read_kb":60,"num_write":26,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003784"},"pg_stats":[{"pgid":"2.1f","version":"74'4","reported_seq":40,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:09.831237+0000","last_change":"2024-09-21T01:39:42.267244+0000","last_active":"2024-09-21T01:40:09.831237+0000","last_peered":"2024-09-21T01:40:09.831237+0000","last_clean":"2024-09-21T01:40:09.831237+0000","last_became_active":"2024-09-21T01:39:42.266786+0000","last_became_peered":"2024-09-21T01:39:42.266786+0000","last_unstale":"2024-09-21T01:40:09.831237+0000","last_undegraded":"2024-09-21T01:40:09.831237+0000","last_fullsized":"2024-09-21T01:40:09.831237+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:50:43.594150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:10.061961+0000","last_change":"2024-09-21T01:39:44.292808+0000","last_active":"2024-09-21T01:40:10.061961+0000","last_peered":"2024-09-21T01:40:10.061961+0000","last_clean":"2024-09-21T01:40:10.061961+0000","last_became_active":"2024-09-21T01:39:44.292416+0000","last_became_peered":"2024-09-21T01:39:44.292416+0000","last_unstale":"2024-09-21T01:40:10.061961+0000","last_undegraded":"2024-09-21T01:40:10.061961+0000","last_fullsized":"2024-09-21T01:40:10.061961+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:26:16.332353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:09.830926+0000","last_change":"2024-09-21T01:39:51.339117+0000","last_active":"2024-09-21T01:40:09.830926+0000","last_peered":"2024-09-21T01:40:09.830926+0000","last_clean":"2024-09-21T01:40:09.830926+0000","last_became_active":"2024-09-21T01:39:51.338467+0000","last_became_peered":"2024-09-21T01:39:51.338467+0000","last_unstale":"2024-09-21T01:40:09.830926+0000","last_undegraded":"2024-09-21T01:40:09.830926+0000","last_fullsized":"2024-09-21T01:40:09.830926+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:18:57.119730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"74'1","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:10.062245+0000","last_change":"2024-09-21T01:39:42.550130+0000","last_active":"2024-09-21T01:40:10.062245+0000","last_peered":"2024-09-21T01:40:10.062245+0000","last_clean":"2024-09-21T01:40:10.062245+0000","last_became_active":"2024-09-21T01:39:42.549676+0000","last_became_peered":"2024-09-21T01:39:42.549676+0000","last_unstale":"2024-09-21T01:40:10.062245+0000","last_undegraded":"2024-09-21T01:40:10.062245+0000","last_fullsized":"2024-09-21T01:40:10.062245+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:33:59.954738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:10.061638+0000","last_change":"2024-09-21T01:39:44.293860+0000","last_active":"2024-09-21T01:40:10.061638+0000","last_peered":"2024-09-21T01:40:10.061638+0000","last_clean":"2024-09-21T01:40:10.061638+0000","last_became_active":"2024-09-21T01:39:44.293490+0000","last_became_peered":"2024-09-21T01:39:44.293490+0000","last_unstale":"2024-09-21T01:40:10.061638+0000","last_undegraded":"2024-09-21T01:40:10.061638+0000","last_fullsized":"2024-09-21T01:40:10.061638+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:58:18.325647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:10.061333+0000","last_change":"2024-09-21T01:39:51.335826+0000","last_active":"2024-09-21T01:40:10.061333+0000","last_peered":"2024-09-21T01:40:10.061333+0000","last_clean":"2024-09-21T01:40:10.061333+0000","last_became_active":"2024-09-21T01:39:51.335346+0000","last_became_peered":"2024-09-21T01:39:51.335346+0000","last_unstale":"2024-09-21T01:40:10.061333+0000","last_undegraded":"2024-09-21T01:40:10.061333+0000","last_fullsized":"2024-09-21T01:40:10.061333+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:51:25.921336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"74'2","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:09.836169+0000","last_change":"2024-09-21T01:39:42.270594+0000","last_active":"2024-09-21T01:40:09.836169+0000","last_peered":"2024-09-21T01:40:09.836169+0000","last_clean":"2024-09-21T01:40:09.836169+0000","last_became_active":"2024-09-21T01:39:42.270138+0000","last_became_peered":"2024-09-21T01:39:42.270138+0000","last_unstale":"2024-09-21T01:40:09.836169+0000","last_undegraded":"2024-09-21T01:40:09.836169+0000","last_fullsized":"2024-09-21T01:40:09.836169+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:05:00.604343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:10.061396+0000","last_change":"2024-09-21T01:39:44.294397+0000","last_active":"2024-09-21T01:40:10.061396+0000","last_peered":"2024-09-21T01:40:10.061396+0000","last_clean":"2024-09-21T01:40:10.061396+0000","last_became_active":"2024-09-21T01:39:44.293992+0000","last_became_peered":"2024-09-21T01:39:44.293992+0000","last_unstale":"2024-09-21T01:40:10.061396+0000","last_undegraded":"2024-09-21T01:40:10.061396+0000","last_fullsized":"2024-09-21T01:40:10.061396+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:52:09.459167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:10.061567+0000","last_change":"2024-09-21T01:39:51.338546+0000","last_active":"2024-09-21T01:40:10.061567+0000","last_peered":"2024-09-21T01:40:10.061567+0000","last_clean":"2024-09-21T01:40:10.061567+0000","last_became_active":"2024-09-21T01:39:51.337850+0000","last_became_peered":"2024-09-21T01:39:51.337850+0000","last_unstale":"2024-09-21T01:40:10.061567+0000","last_undegraded":"2024-09-21T01:40:10.061567+0000","last_fullsized":"2024-09-21T01:40:10.061567+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:33:49.497520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"74'2","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:09.835874+0000","last_change":"2024-09-21T01:39:42.264214+0000","last_active":"2024-09-21T01:40:09.835874+0000","last_peered":"2024-09-21T01:40:09.835874+0000","last_clean":"2024-09-21T01:40:09.835874+0000","last_became_active":"2024-09-21T01:39:42.263782+0000","last_became_peered":"2024-09-21T01:39:42.263782+0000","last_unstale":"2024-09-21T01:40:09.835874+0000","last_undegraded":"2024-09-21T01:40:09.835874+0000","last_fullsized":"2024-09-21T01:40:09.835874+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:44:24.965078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:09.839708+0000","last_change":"2024-09-21T01:39:44.296579+0000","last_active":"2024-09-21T01:40:09.839708+0000","last_peered":"2024-09-21T01:40:09.839708+0000","last_clean":"2024-09-21T01:40:09.839708+0000","last_became_active":"2024-09-21T01:39:44.296175+0000","last_became_peered":"2024-09-21T01:39:44.296175+0000","last_unstale":"2024-09-21T01:40:09.839708+0000","last_undegraded":"2024-09-21T01:40:09.839708+0000","last_fullsized":"2024-09-21T01:40:09.839708+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:11:13.920000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:10.061215+0000","last_change":"2024-09-21T01:39:51.339046+0000","last_active":"2024-09-21T01:40:10.061215+0000","last_peered":"2024-09-21T01:40:10.061215+0000","last_clean":"2024-09-21T01:40:10.061215+0000","last_became_active":"2024-09-21T01:39:51.337379+0000","last_became_peered":"2024-09-21T01:39:51.337379+0000","last_unstale":"2024-09-21T01:40:10.061215+0000","last_undegraded":"2024-09-21T01:40:10.061215+0000","last_fullsized":"2024-09-21T01:40:10.061215+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:50:34.321615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:09.828303+0000","last_change":"2024-09-21T01:39:44.296849+0000","last_active":"2024-09-21T01:40:09.828303+0000","last_peered":"2024-09-21T01:40:09.828303+0000","last_clean":"2024-09-21T01:40:09.828303+0000","last_became_active":"2024-09-21T01:39:44.296460+0000","last_became_peered":"2024-09-21T01:39:44.296460+0000","last_unstale":"2024-09-21T01:40:09.828303+0000","last_undegraded":"2024-09-21T01:40:09.828303+0000","last_fullsized":"2024-09-21T01:40:09.828303+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:46:51.258576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"74'2","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:09.842964+0000","last_change":"2024-09-21T01:40:09.842127+0000","last_active":"2024-09-21T01:40:09.842964+0000","last_peered":"2024-09-21T01:40:09.842964+0000","last_clean":"2024-09-21T01:40:09.842964+0000","last_became_active":"2024-09-21T01:40:09.835330+0000","last_became_peered":"2024-09-21T01:40:09.835330+0000","last_unstale":"2024-09-21T01:40:09.842964+0000","last_undegraded":"2024-09-21T01:40:09.842964+0000","last_fullsized":"2024-09-21T01:40:09.842964+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:54:07.455805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:10.061393+0000","last_change":"2024-09-21T01:39:51.459595+0000","last_active":"2024-09-21T01:40:10.061393+0000","last_peered":"2024-09-21T01:40:10.061393+0000","last_clean":"2024-09-21T01:40:10.061393+0000","last_became_active":"2024-09-21T01:39:51.459137+0000","last_became_peered":"2024-09-21T01:39:51.459137+0000","last_unstale":"2024-09-21T01:40:10.061393+0000","last_undegraded":"2024-09-21T01:40:10.061393+0000","last_fullsized":"2024-09-21T01:40:10.061393+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:55:53.800615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:10.061365+0000","last_change":"2024-09-21T01:39:44.288328+0000","last_active":"2024-09-21T01:40:10.061365+0000","last_peered":"2024-09-21T01:40:10.061365+0000","last_clean":"2024-09-21T01:40:10.061365+0000","last_became_active":"2024-09-21T01:39:44.287994+0000","last_became_peered":"2024-09-21T01:39:44.287994+0000","last_unstale":"2024-09-21T01:40:10.061365+0000","last_undegraded":"2024-09-21T01:40:10.061365+0000","last_fullsized":"2024-09-21T01:40:10.061365+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:44:55.075693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":35,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:09.829785+0000","last_change":"2024-09-21T01:39:42.266271+0000","last_active":"2024-09-21T01:40:09.829785+0000","last_peered":"2024-09-21T01:40:09.829785+0000","last_clean":"2024-09-21T01:40:09.829785+0000","last_became_active":"2024-09-21T01:39:42.265904+0000","last_became_peered":"2024-09-21T01:39:42.265904+0000","last_unstale":"2024-09-21T01:40:09.829785+0000","last_undegraded":"2024-09-21T01:40:09.829785+0000","last_fullsized":"2024-09-21T01:40:09.829785+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:43:37.456263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"82'1","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:10.062111+0000","last_change":"2024-09-21T01:39:51.336649+0000","last_active":"2024-09-21T01:40:10.062111+0000","last_peered":"2024-09-21T01:40:10.062111+0000","last_clean":"2024-09-21T01:40:10.062111+0000","last_became_active":"2024-09-21T01:39:51.336153+0000","last_became_peered":"2024-09-21T01:39:51.336153+0000","last_unstale":"2024-09-21T01:40:10.062111+0000","last_undegraded":"2024-09-21T01:40:10.062111+0000","last_fullsized":"2024-09-21T01:40:10.062111+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:56:58.699051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:09.829396+0000","last_change":"2024-09-21T01:39:44.304919+0000","last_active":"2024-09-21T01:40:09.829396+0000","last_peered":"2024-09-21T01:40:09.829396+0000","last_clean":"2024-09-21T01:40:09.829396+0000","last_became_active":"2024-09-21T01:39:44.304509+0000","last_became_peered":"2024-09-21T01:39:44.304509+0000","last_unstale":"2024-09-21T01:40:09.829396+0000","last_undegraded":"2024-09-21T01:40:09.829396+0000","last_fullsized":"2024-09-21T01:40:09.829396+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:57:04.413151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":35,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:10.061112+0000","last_change":"2024-09-21T01:39:42.262536+0000","last_active":"2024-09-21T01:40:10.061112+0000","last_peered":"2024-09-21T01:40:10.061112+0000","last_clean":"2024-09-21T01:40:10.061112+0000","last_became_active":"2024-09-21T01:39:42.262179+0000","last_became_peered":"2024-09-21T01:39:42.262179+0000","last_unstale":"2024-09-21T01:40:10.061112+0000","last_undegraded":"2024-09-21T01:40:10.061112+0000","last_fullsized":"2024-09-21T01:40:10.061112+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:35:14.022839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:09.830860+0000","last_change":"2024-09-21T01:39:51.339664+0000","last_active":"2024-09-21T01:40:09.830860+0000","last_peered":"2024-09-21T01:40:09.830860+0000","last_clean":"2024-09-21T01:40:09.830860+0000","last_became_active":"2024-09-21T01:39:51.339140+0000","last_became_peered":"2024-09-21T01:39:51.339140+0000","last_unstale":"2024-09-21T01:40:09.830860+0000","last_undegraded":"2024-09-21T01:40:09.830860+0000","last_fullsized":"2024-09-21T01:40:09.830860+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:46:49.443937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:09.833458+0000","last_change":"2024-09-21T01:39:44.299174+0000","last_active":"2024-09-21T01:40:09.833458+0000","last_peered":"2024-09-21T01:40:09.833458+0000","last_clean":"2024-09-21T01:40:09.833458+0000","last_became_active":"2024-09-21T01:39:44.298778+0000","last_became_peered":"2024-09-21T01:39:44.298778+0000","last_unstale":"2024-09-21T01:40:09.833458+0000","last_undegraded":"2024-09-21T01:40:09.833458+0000","last_fullsized":"2024-09-21T01:40:09.833458+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:59:17.298726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":34,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:10.061619+0000","last_change":"2024-09-21T01:39:42.550521+0000","last_active":"2024-09-21T01:40:10.061619+0000","last_peered":"2024-09-21T01:40:10.061619+0000","last_clean":"2024-09-21T01:40:10.061619+0000","last_became_active":"2024-09-21T01:39:42.550210+0000","last_became_peered":"2024-09-21T01:39:42.550210+0000","last_unstale":"2024-09-21T01:40:10.061619+0000","last_undegraded":"2024-09-21T01:40:10.061619+0000","last_fullsized":"2024-09-21T01:40:10.061619+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:07:07.234815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:10.062390+0000","last_change":"2024-09-21T01:39:51.461448+0000","last_active":"2024-09-21T01:40:10.062390+0000","last_peered":"2024-09-21T01:40:10.062390+0000","last_clean":"2024-09-21T01:40:10.062390+0000","last_became_active":"2024-09-21T01:39:51.460790+0000","last_became_peered":"2024-09-21T01:39:51.460790+0000","last_unstale":"2024-09-21T01:40:10.062390+0000","last_undegraded":"2024-09-21T01:40:10.062390+0000","last_fullsized":"2024-09-21T01:40:10.062390+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:30:35.032588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:10.061323+0000","last_change":"2024-09-21T01:39:44.298697+0000","last_active":"2024-09-21T01:40:10.061323+0000","last_peered":"2024-09-21T01:40:10.061323+0000","last_clean":"2024-09-21T01:40:10.061323+0000","last_became_active":"2024-09-21T01:39:44.298333+0000","last_became_peered":"2024-09-21T01:39:44.298333+0000","last_unstale":"2024-09-21T01:40:10.061323+0000","last_undegraded":"2024-09-21T01:40:10.061323+0000","last_fullsized":"2024-09-21T01:40:10.061323+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:36:01.932630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"74'2","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:10.062169+0000","last_change":"2024-09-21T01:39:42.257383+0000","last_active":"2024-09-21T01:40:10.062169+0000","last_peered":"2024-09-21T01:40:10.062169+0000","last_clean":"2024-09-21T01:40:10.062169+0000","last_became_active":"2024-09-21T01:39:42.256896+0000","last_became_peered":"2024-09-21T01:39:42.256896+0000","last_unstale":"2024-09-21T01:40:10.062169+0000","last_undegraded":"2024-09-21T01:40:10.062169+0000","last_fullsized":"2024-09-21T01:40:10.062169+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:03:29.350623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:09.831118+0000","last_change":"2024-09-21T01:39:51.342055+0000","last_active":"2024-09-21T01:40:09.831118+0000","last_peered":"2024-09-21T01:40:09.831118+0000","last_clean":"2024-09-21T01:40:09.831118+0000","last_became_active":"2024-09-21T01:39:51.341602+0000","last_became_peered":"2024-09-21T01:39:51.341602+0000","last_unstale":"2024-09-21T01:40:09.831118+0000","last_undegraded":"2024-09-21T01:40:09.831118+0000","last_fullsized":"2024-09-21T01:40:09.831118+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:30:58.290018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:10.062041+0000","last_change":"2024-09-21T01:39:44.296725+0000","last_active":"2024-09-21T01:40:10.062041+0000","last_peered":"2024-09-21T01:40:10.062041+0000","last_clean":"2024-09-21T01:40:10.062041+0000","last_became_active":"2024-09-21T01:39:44.296411+0000","last_became_peered":"2024-09-21T01:39:44.296411+0000","last_unstale":"2024-09-21T01:40:10.062041+0000","last_undegraded":"2024-09-21T01:40:10.062041+0000","last_fullsized":"2024-09-21T01:40:10.062041+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:58:05.357486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"82'6","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:37.293830+0000","last_change":"2024-09-21T01:39:42.262831+0000","last_active":"2024-09-21T01:40:37.293830+0000","last_peered":"2024-09-21T01:40:37.293830+0000","last_clean":"2024-09-21T01:40:37.293830+0000","last_became_active":"2024-09-21T01:39:42.262462+0000","last_became_peered":"2024-09-21T01:39:42.262462+0000","last_unstale":"2024-09-21T01:40:37.293830+0000","last_undegraded":"2024-09-21T01:40:37.293830+0000","last_fullsized":"2024-09-21T01:40:37.293830+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:01:24.950607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:10.060603+0000","last_change":"2024-09-21T01:39:51.460620+0000","last_active":"2024-09-21T01:40:10.060603+0000","last_peered":"2024-09-21T01:40:10.060603+0000","last_clean":"2024-09-21T01:40:10.060603+0000","last_became_active":"2024-09-21T01:39:51.460052+0000","last_became_peered":"2024-09-21T01:39:51.460052+0000","last_unstale":"2024-09-21T01:40:10.060603+0000","last_undegraded":"2024-09-21T01:40:10.060603+0000","last_fullsized":"2024-09-21T01:40:10.060603+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:23:23.284102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:09.827751+0000","last_change":"2024-09-21T01:39:44.293129+0000","last_active":"2024-09-21T01:40:09.827751+0000","last_peered":"2024-09-21T01:40:09.827751+0000","last_clean":"2024-09-21T01:40:09.827751+0000","last_became_active":"2024-09-21T01:39:44.292799+0000","last_became_peered":"2024-09-21T01:39:44.292799+0000","last_unstale":"2024-09-21T01:40:09.827751+0000","last_undegraded":"2024-09-21T01:40:09.827751+0000","last_fullsized":"2024-09-21T01:40:09.827751+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:05:22.484632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":35,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:09.836090+0000","last_change":"2024-09-21T01:39:42.550724+0000","last_active":"2024-09-21T01:40:09.836090+0000","last_peered":"2024-09-21T01:40:09.836090+0000","last_clean":"2024-09-21T01:40:09.836090+0000","last_became_active":"2024-09-21T01:39:42.550334+0000","last_became_peered":"2024-09-21T01:39:42.550334+0000","last_unstale":"2024-09-21T01:40:09.836090+0000","last_undegraded":"2024-09-21T01:40:09.836090+0000","last_fullsized":"2024-09-21T01:40:09.836090+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:15:49.484663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:09.838421+0000","last_change":"2024-09-21T01:40:09.838305+0000","last_active":"2024-09-21T01:40:09.838421+0000","last_peered":"2024-09-21T01:40:09.838421+0000","last_clean":"2024-09-21T01:40:09.838421+0000","last_became_active":"2024-09-21T01:40:09.837734+0000","last_became_peered":"2024-09-21T01:40:09.837734+0000","last_unstale":"2024-09-21T01:40:09.838421+0000","last_undegraded":"2024-09-21T01:40:09.838421+0000","last_fullsized":"2024-09-21T01:40:09.838421+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:38:44.066723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,7,6],"acting":[11,8,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:09.832203+0000","last_change":"2024-09-21T01:39:44.292039+0000","last_active":"2024-09-21T01:40:09.832203+0000","last_peered":"2024-09-21T01:40:09.832203+0000","last_clean":"2024-09-21T01:40:09.832203+0000","last_became_active":"2024-09-21T01:39:44.291640+0000","last_became_peered":"2024-09-21T01:39:44.291640+0000","last_unstale":"2024-09-21T01:40:09.832203+0000","last_undegraded":"2024-09-21T01:40:09.832203+0000","last_fullsized":"2024-09-21T01:40:09.832203+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:24:59.891664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":42,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:10.063271+0000","last_change":"2024-09-21T01:40:10.063162+0000","last_active":"2024-09-21T01:40:10.063271+0000","last_peered":"2024-09-21T01:40:10.063271+0000","last_clean":"2024-09-21T01:40:10.063271+0000","last_became_active":"2024-09-21T01:40:10.062703+0000","last_became_peered":"2024-09-21T01:40:10.062703+0000","last_unstale":"2024-09-21T01:40:10.063271+0000","last_undegraded":"2024-09-21T01:40:10.063271+0000","last_fullsized":"2024-09-21T01:40:10.063271+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:32:04.933701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:09.833481+0000","last_change":"2024-09-21T01:39:51.460023+0000","last_active":"2024-09-21T01:40:09.833481+0000","last_peered":"2024-09-21T01:40:09.833481+0000","last_clean":"2024-09-21T01:40:09.833481+0000","last_became_active":"2024-09-21T01:39:51.459417+0000","last_became_peered":"2024-09-21T01:39:51.459417+0000","last_unstale":"2024-09-21T01:40:09.833481+0000","last_undegraded":"2024-09-21T01:40:09.833481+0000","last_fullsized":"2024-09-21T01:40:09.833481+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:54:24.301176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:09.832029+0000","last_change":"2024-09-21T01:39:44.295559+0000","last_active":"2024-09-21T01:40:09.832029+0000","last_peered":"2024-09-21T01:40:09.832029+0000","last_clean":"2024-09-21T01:40:09.832029+0000","last_became_active":"2024-09-21T01:39:44.294970+0000","last_became_peered":"2024-09-21T01:39:44.294970+0000","last_unstale":"2024-09-21T01:40:09.832029+0000","last_undegraded":"2024-09-21T01:40:09.832029+0000","last_fullsized":"2024-09-21T01:40:09.832029+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:46:16.582188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":35,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:09.828380+0000","last_change":"2024-09-21T01:39:42.269453+0000","last_active":"2024-09-21T01:40:09.828380+0000","last_peered":"2024-09-21T01:40:09.828380+0000","last_clean":"2024-09-21T01:40:09.828380+0000","last_became_active":"2024-09-21T01:39:42.269039+0000","last_became_peered":"2024-09-21T01:39:42.269039+0000","last_unstale":"2024-09-21T01:40:09.828380+0000","last_undegraded":"2024-09-21T01:40:09.828380+0000","last_fullsized":"2024-09-21T01:40:09.828380+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:47:29.053966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:09.827374+0000","last_change":"2024-09-21T01:39:51.337305+0000","last_active":"2024-09-21T01:40:09.827374+0000","last_peered":"2024-09-21T01:40:09.827374+0000","last_clean":"2024-09-21T01:40:09.827374+0000","last_became_active":"2024-09-21T01:39:51.336710+0000","last_became_peered":"2024-09-21T01:39:51.336710+0000","last_unstale":"2024-09-21T01:40:09.827374+0000","last_undegraded":"2024-09-21T01:40:09.827374+0000","last_fullsized":"2024-09-21T01:40:09.827374+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:13:42.333881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:09.839627+0000","last_change":"2024-09-21T01:39:44.297004+0000","last_active":"2024-09-21T01:40:09.839627+0000","last_peered":"2024-09-21T01:40:09.839627+0000","last_clean":"2024-09-21T01:40:09.839627+0000","last_became_active":"2024-09-21T01:39:44.296596+0000","last_became_peered":"2024-09-21T01:39:44.296596+0000","last_unstale":"2024-09-21T01:40:09.839627+0000","last_undegraded":"2024-09-21T01:40:09.839627+0000","last_fullsized":"2024-09-21T01:40:09.839627+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:14:32.542823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":35,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:09.827092+0000","last_change":"2024-09-21T01:39:42.550024+0000","last_active":"2024-09-21T01:40:09.827092+0000","last_peered":"2024-09-21T01:40:09.827092+0000","last_clean":"2024-09-21T01:40:09.827092+0000","last_became_active":"2024-09-21T01:39:42.549638+0000","last_became_peered":"2024-09-21T01:39:42.549638+0000","last_unstale":"2024-09-21T01:40:09.827092+0000","last_undegraded":"2024-09-21T01:40:09.827092+0000","last_fullsized":"2024-09-21T01:40:09.827092+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:23:39.210460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:09.827259+0000","last_change":"2024-09-21T01:39:51.459459+0000","last_active":"2024-09-21T01:40:09.827259+0000","last_peered":"2024-09-21T01:40:09.827259+0000","last_clean":"2024-09-21T01:40:09.827259+0000","last_became_active":"2024-09-21T01:39:51.459020+0000","last_became_peered":"2024-09-21T01:39:51.459020+0000","last_unstale":"2024-09-21T01:40:09.827259+0000","last_undegraded":"2024-09-21T01:40:09.827259+0000","last_fullsized":"2024-09-21T01:40:09.827259+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:50:08.337949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:09.834015+0000","last_change":"2024-09-21T01:40:09.833943+0000","last_active":"2024-09-21T01:40:09.834015+0000","last_peered":"2024-09-21T01:40:09.834015+0000","last_clean":"2024-09-21T01:40:09.834015+0000","last_became_active":"2024-09-21T01:40:09.833486+0000","last_became_peered":"2024-09-21T01:40:09.833486+0000","last_unstale":"2024-09-21T01:40:09.834015+0000","last_undegraded":"2024-09-21T01:40:09.834015+0000","last_fullsized":"2024-09-21T01:40:09.834015+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:26:52.751330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,2],"acting":[6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":35,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:09.828081+0000","last_change":"2024-09-21T01:39:42.267329+0000","last_active":"2024-09-21T01:40:09.828081+0000","last_peered":"2024-09-21T01:40:09.828081+0000","last_clean":"2024-09-21T01:40:09.828081+0000","last_became_active":"2024-09-21T01:39:42.266386+0000","last_became_peered":"2024-09-21T01:39:42.266386+0000","last_unstale":"2024-09-21T01:40:09.828081+0000","last_undegraded":"2024-09-21T01:40:09.828081+0000","last_fullsized":"2024-09-21T01:40:09.828081+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:31:20.877627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:09.840136+0000","last_change":"2024-09-21T01:39:51.461494+0000","last_active":"2024-09-21T01:40:09.840136+0000","last_peered":"2024-09-21T01:40:09.840136+0000","last_clean":"2024-09-21T01:40:09.840136+0000","last_became_active":"2024-09-21T01:39:51.460973+0000","last_became_peered":"2024-09-21T01:39:51.460973+0000","last_unstale":"2024-09-21T01:40:09.840136+0000","last_undegraded":"2024-09-21T01:40:09.840136+0000","last_fullsized":"2024-09-21T01:40:09.840136+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:09:50.319546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:10.061223+0000","last_change":"2024-09-21T01:39:44.300773+0000","last_active":"2024-09-21T01:40:10.061223+0000","last_peered":"2024-09-21T01:40:10.061223+0000","last_clean":"2024-09-21T01:40:10.061223+0000","last_became_active":"2024-09-21T01:39:44.300437+0000","last_became_peered":"2024-09-21T01:39:44.300437+0000","last_unstale":"2024-09-21T01:40:10.061223+0000","last_undegraded":"2024-09-21T01:40:10.061223+0000","last_fullsized":"2024-09-21T01:40:10.061223+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:06:34.171621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":35,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:10.062157+0000","last_change":"2024-09-21T01:39:42.262675+0000","last_active":"2024-09-21T01:40:10.062157+0000","last_peered":"2024-09-21T01:40:10.062157+0000","last_clean":"2024-09-21T01:40:10.062157+0000","last_became_active":"2024-09-21T01:39:42.262282+0000","last_became_peered":"2024-09-21T01:39:42.262282+0000","last_unstale":"2024-09-21T01:40:10.062157+0000","last_undegraded":"2024-09-21T01:40:10.062157+0000","last_fullsized":"2024-09-21T01:40:10.062157+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:26:01.595797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":109,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:09.828212+0000","last_change":"2024-09-21T01:38:31.172876+0000","last_active":"2024-09-21T01:40:09.828212+0000","last_peered":"2024-09-21T01:40:09.828212+0000","last_clean":"2024-09-21T01:40:09.828212+0000","last_became_active":"2024-09-21T01:38:31.167071+0000","last_became_peered":"2024-09-21T01:38:31.167071+0000","last_unstale":"2024-09-21T01:40:09.828212+0000","last_undegraded":"2024-09-21T01:40:09.828212+0000","last_fullsized":"2024-09-21T01:40:09.828212+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:35:07.475056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:35:07.475056+0000","last_clean_scrub_stamp":"2024-09-21T01:35:07.475056+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:56:01.878445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"82'1","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:09.828806+0000","last_change":"2024-09-21T01:39:51.338198+0000","last_active":"2024-09-21T01:40:09.828806+0000","last_peered":"2024-09-21T01:40:09.828806+0000","last_clean":"2024-09-21T01:40:09.828806+0000","last_became_active":"2024-09-21T01:39:51.337743+0000","last_became_peered":"2024-09-21T01:39:51.337743+0000","last_unstale":"2024-09-21T01:40:09.828806+0000","last_undegraded":"2024-09-21T01:40:09.828806+0000","last_fullsized":"2024-09-21T01:40:09.828806+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:19:45.552819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:09.828882+0000","last_change":"2024-09-21T01:39:44.298920+0000","last_active":"2024-09-21T01:40:09.828882+0000","last_peered":"2024-09-21T01:40:09.828882+0000","last_clean":"2024-09-21T01:40:09.828882+0000","last_became_active":"2024-09-21T01:39:44.298381+0000","last_became_peered":"2024-09-21T01:39:44.298381+0000","last_unstale":"2024-09-21T01:40:09.828882+0000","last_undegraded":"2024-09-21T01:40:09.828882+0000","last_fullsized":"2024-09-21T01:40:09.828882+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:12:53.681514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":35,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:09.830882+0000","last_change":"2024-09-21T01:39:42.550808+0000","last_active":"2024-09-21T01:40:09.830882+0000","last_peered":"2024-09-21T01:40:09.830882+0000","last_clean":"2024-09-21T01:40:09.830882+0000","last_became_active":"2024-09-21T01:39:42.550447+0000","last_became_peered":"2024-09-21T01:39:42.550447+0000","last_unstale":"2024-09-21T01:40:09.830882+0000","last_undegraded":"2024-09-21T01:40:09.830882+0000","last_fullsized":"2024-09-21T01:40:09.830882+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:20:56.996378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:10.061009+0000","last_change":"2024-09-21T01:39:51.338490+0000","last_active":"2024-09-21T01:40:10.061009+0000","last_peered":"2024-09-21T01:40:10.061009+0000","last_clean":"2024-09-21T01:40:10.061009+0000","last_became_active":"2024-09-21T01:39:51.338050+0000","last_became_peered":"2024-09-21T01:39:51.338050+0000","last_unstale":"2024-09-21T01:40:10.061009+0000","last_undegraded":"2024-09-21T01:40:10.061009+0000","last_fullsized":"2024-09-21T01:40:10.061009+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:49:56.705893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:09.828540+0000","last_change":"2024-09-21T01:39:44.293976+0000","last_active":"2024-09-21T01:40:09.828540+0000","last_peered":"2024-09-21T01:40:09.828540+0000","last_clean":"2024-09-21T01:40:09.828540+0000","last_became_active":"2024-09-21T01:39:44.293547+0000","last_became_peered":"2024-09-21T01:39:44.293547+0000","last_unstale":"2024-09-21T01:40:09.828540+0000","last_undegraded":"2024-09-21T01:40:09.828540+0000","last_fullsized":"2024-09-21T01:40:09.828540+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:05:07.209936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"74'1","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:09.840219+0000","last_change":"2024-09-21T01:39:42.270124+0000","last_active":"2024-09-21T01:40:09.840219+0000","last_peered":"2024-09-21T01:40:09.840219+0000","last_clean":"2024-09-21T01:40:09.840219+0000","last_became_active":"2024-09-21T01:39:42.269435+0000","last_became_peered":"2024-09-21T01:39:42.269435+0000","last_unstale":"2024-09-21T01:40:09.840219+0000","last_undegraded":"2024-09-21T01:40:09.840219+0000","last_fullsized":"2024-09-21T01:40:09.840219+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:12:08.374394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:10.061183+0000","last_change":"2024-09-21T01:39:51.334459+0000","last_active":"2024-09-21T01:40:10.061183+0000","last_peered":"2024-09-21T01:40:10.061183+0000","last_clean":"2024-09-21T01:40:10.061183+0000","last_became_active":"2024-09-21T01:39:51.334039+0000","last_became_peered":"2024-09-21T01:39:51.334039+0000","last_unstale":"2024-09-21T01:40:10.061183+0000","last_undegraded":"2024-09-21T01:40:10.061183+0000","last_fullsized":"2024-09-21T01:40:10.061183+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:04:44.906648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:09.828864+0000","last_change":"2024-09-21T01:39:44.298467+0000","last_active":"2024-09-21T01:40:09.828864+0000","last_peered":"2024-09-21T01:40:09.828864+0000","last_clean":"2024-09-21T01:40:09.828864+0000","last_became_active":"2024-09-21T01:39:44.298128+0000","last_became_peered":"2024-09-21T01:39:44.298128+0000","last_unstale":"2024-09-21T01:40:09.828864+0000","last_undegraded":"2024-09-21T01:40:09.828864+0000","last_fullsized":"2024-09-21T01:40:09.828864+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:54:11.096417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"74'2","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:09.827654+0000","last_change":"2024-09-21T01:39:42.262761+0000","last_active":"2024-09-21T01:40:09.827654+0000","last_peered":"2024-09-21T01:40:09.827654+0000","last_clean":"2024-09-21T01:40:09.827654+0000","last_became_active":"2024-09-21T01:39:42.262428+0000","last_became_peered":"2024-09-21T01:39:42.262428+0000","last_unstale":"2024-09-21T01:40:09.827654+0000","last_undegraded":"2024-09-21T01:40:09.827654+0000","last_fullsized":"2024-09-21T01:40:09.827654+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:11:50.326638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:09.839102+0000","last_change":"2024-09-21T01:39:51.344320+0000","last_active":"2024-09-21T01:40:09.839102+0000","last_peered":"2024-09-21T01:40:09.839102+0000","last_clean":"2024-09-21T01:40:09.839102+0000","last_became_active":"2024-09-21T01:39:51.343902+0000","last_became_peered":"2024-09-21T01:39:51.343902+0000","last_unstale":"2024-09-21T01:40:09.839102+0000","last_undegraded":"2024-09-21T01:40:09.839102+0000","last_fullsized":"2024-09-21T01:40:09.839102+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:13:36.139159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:09.837909+0000","last_change":"2024-09-21T01:40:09.837769+0000","last_active":"2024-09-21T01:40:09.837909+0000","last_peered":"2024-09-21T01:40:09.837909+0000","last_clean":"2024-09-21T01:40:09.837909+0000","last_became_active":"2024-09-21T01:40:09.837296+0000","last_became_peered":"2024-09-21T01:40:09.837296+0000","last_unstale":"2024-09-21T01:40:09.837909+0000","last_undegraded":"2024-09-21T01:40:09.837909+0000","last_fullsized":"2024-09-21T01:40:09.837909+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:37:20.360076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"74'1","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:09.835689+0000","last_change":"2024-09-21T01:39:42.264955+0000","last_active":"2024-09-21T01:40:09.835689+0000","last_peered":"2024-09-21T01:40:09.835689+0000","last_clean":"2024-09-21T01:40:09.835689+0000","last_became_active":"2024-09-21T01:39:42.264492+0000","last_became_peered":"2024-09-21T01:39:42.264492+0000","last_unstale":"2024-09-21T01:40:09.835689+0000","last_undegraded":"2024-09-21T01:40:09.835689+0000","last_fullsized":"2024-09-21T01:40:09.835689+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:17:38.631521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:09.839331+0000","last_change":"2024-09-21T01:39:51.337908+0000","last_active":"2024-09-21T01:40:09.839331+0000","last_peered":"2024-09-21T01:40:09.839331+0000","last_clean":"2024-09-21T01:40:09.839331+0000","last_became_active":"2024-09-21T01:39:51.337200+0000","last_became_peered":"2024-09-21T01:39:51.337200+0000","last_unstale":"2024-09-21T01:40:09.839331+0000","last_undegraded":"2024-09-21T01:40:09.839331+0000","last_fullsized":"2024-09-21T01:40:09.839331+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:07:18.505959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:10.063647+0000","last_change":"2024-09-21T01:40:10.063539+0000","last_active":"2024-09-21T01:40:10.063647+0000","last_peered":"2024-09-21T01:40:10.063647+0000","last_clean":"2024-09-21T01:40:10.063647+0000","last_became_active":"2024-09-21T01:40:10.062966+0000","last_became_peered":"2024-09-21T01:40:10.062966+0000","last_unstale":"2024-09-21T01:40:10.063647+0000","last_undegraded":"2024-09-21T01:40:10.063647+0000","last_fullsized":"2024-09-21T01:40:10.063647+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:53:20.747493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,1],"acting":[5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"74'8","reported_seq":43,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:09.834143+0000","last_change":"2024-09-21T01:39:42.550795+0000","last_active":"2024-09-21T01:40:09.834143+0000","last_peered":"2024-09-21T01:40:09.834143+0000","last_clean":"2024-09-21T01:40:09.834143+0000","last_became_active":"2024-09-21T01:39:42.550424+0000","last_became_peered":"2024-09-21T01:39:42.550424+0000","last_unstale":"2024-09-21T01:40:09.834143+0000","last_undegraded":"2024-09-21T01:40:09.834143+0000","last_fullsized":"2024-09-21T01:40:09.834143+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:50:53.421080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:09.827620+0000","last_change":"2024-09-21T01:39:51.335239+0000","last_active":"2024-09-21T01:40:09.827620+0000","last_peered":"2024-09-21T01:40:09.827620+0000","last_clean":"2024-09-21T01:40:09.827620+0000","last_became_active":"2024-09-21T01:39:51.334846+0000","last_became_peered":"2024-09-21T01:39:51.334846+0000","last_unstale":"2024-09-21T01:40:09.827620+0000","last_undegraded":"2024-09-21T01:40:09.827620+0000","last_fullsized":"2024-09-21T01:40:09.827620+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:47:30.820219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:09.827932+0000","last_change":"2024-09-21T01:39:44.296080+0000","last_active":"2024-09-21T01:40:09.827932+0000","last_peered":"2024-09-21T01:40:09.827932+0000","last_clean":"2024-09-21T01:40:09.827932+0000","last_became_active":"2024-09-21T01:39:44.295724+0000","last_became_peered":"2024-09-21T01:39:44.295724+0000","last_unstale":"2024-09-21T01:40:09.827932+0000","last_undegraded":"2024-09-21T01:40:09.827932+0000","last_fullsized":"2024-09-21T01:40:09.827932+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:20:56.366350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":35,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:10.062713+0000","last_change":"2024-09-21T01:39:42.264499+0000","last_active":"2024-09-21T01:40:10.062713+0000","last_peered":"2024-09-21T01:40:10.062713+0000","last_clean":"2024-09-21T01:40:10.062713+0000","last_became_active":"2024-09-21T01:39:42.264059+0000","last_became_peered":"2024-09-21T01:39:42.264059+0000","last_unstale":"2024-09-21T01:40:10.062713+0000","last_undegraded":"2024-09-21T01:40:10.062713+0000","last_fullsized":"2024-09-21T01:40:10.062713+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:27:42.970693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:09.831000+0000","last_change":"2024-09-21T01:39:51.329357+0000","last_active":"2024-09-21T01:40:09.831000+0000","last_peered":"2024-09-21T01:40:09.831000+0000","last_clean":"2024-09-21T01:40:09.831000+0000","last_became_active":"2024-09-21T01:39:51.328761+0000","last_became_peered":"2024-09-21T01:39:51.328761+0000","last_unstale":"2024-09-21T01:40:09.831000+0000","last_undegraded":"2024-09-21T01:40:09.831000+0000","last_fullsized":"2024-09-21T01:40:09.831000+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:48:04.089765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:09.828303+0000","last_change":"2024-09-21T01:39:44.295799+0000","last_active":"2024-09-21T01:40:09.828303+0000","last_peered":"2024-09-21T01:40:09.828303+0000","last_clean":"2024-09-21T01:40:09.828303+0000","last_became_active":"2024-09-21T01:39:44.295432+0000","last_became_peered":"2024-09-21T01:39:44.295432+0000","last_unstale":"2024-09-21T01:40:09.828303+0000","last_undegraded":"2024-09-21T01:40:09.828303+0000","last_fullsized":"2024-09-21T01:40:09.828303+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:18:10.702545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":35,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:09.840236+0000","last_change":"2024-09-21T01:39:42.270552+0000","last_active":"2024-09-21T01:40:09.840236+0000","last_peered":"2024-09-21T01:40:09.840236+0000","last_clean":"2024-09-21T01:40:09.840236+0000","last_became_active":"2024-09-21T01:39:42.270158+0000","last_became_peered":"2024-09-21T01:39:42.270158+0000","last_unstale":"2024-09-21T01:40:09.840236+0000","last_undegraded":"2024-09-21T01:40:09.840236+0000","last_fullsized":"2024-09-21T01:40:09.840236+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:19:52.229598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:09.829757+0000","last_change":"2024-09-21T01:39:51.335823+0000","last_active":"2024-09-21T01:40:09.829757+0000","last_peered":"2024-09-21T01:40:09.829757+0000","last_clean":"2024-09-21T01:40:09.829757+0000","last_became_active":"2024-09-21T01:39:51.335363+0000","last_became_peered":"2024-09-21T01:39:51.335363+0000","last_unstale":"2024-09-21T01:40:09.829757+0000","last_undegraded":"2024-09-21T01:40:09.829757+0000","last_fullsized":"2024-09-21T01:40:09.829757+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:33:01.418708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:09.827109+0000","last_change":"2024-09-21T01:39:44.288963+0000","last_active":"2024-09-21T01:40:09.827109+0000","last_peered":"2024-09-21T01:40:09.827109+0000","last_clean":"2024-09-21T01:40:09.827109+0000","last_became_active":"2024-09-21T01:39:44.286967+0000","last_became_peered":"2024-09-21T01:39:44.286967+0000","last_unstale":"2024-09-21T01:40:09.827109+0000","last_undegraded":"2024-09-21T01:40:09.827109+0000","last_fullsized":"2024-09-21T01:40:09.827109+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:02:32.653351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"74'2","reported_seq":38,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:09.830335+0000","last_change":"2024-09-21T01:39:42.268553+0000","last_active":"2024-09-21T01:40:09.830335+0000","last_peered":"2024-09-21T01:40:09.830335+0000","last_clean":"2024-09-21T01:40:09.830335+0000","last_became_active":"2024-09-21T01:39:42.268154+0000","last_became_peered":"2024-09-21T01:39:42.268154+0000","last_unstale":"2024-09-21T01:40:09.830335+0000","last_undegraded":"2024-09-21T01:40:09.830335+0000","last_fullsized":"2024-09-21T01:40:09.830335+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:22:54.223718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:09.839584+0000","last_change":"2024-09-21T01:39:51.342268+0000","last_active":"2024-09-21T01:40:09.839584+0000","last_peered":"2024-09-21T01:40:09.839584+0000","last_clean":"2024-09-21T01:40:09.839584+0000","last_became_active":"2024-09-21T01:39:51.341221+0000","last_became_peered":"2024-09-21T01:39:51.341221+0000","last_unstale":"2024-09-21T01:40:09.839584+0000","last_undegraded":"2024-09-21T01:40:09.839584+0000","last_fullsized":"2024-09-21T01:40:09.839584+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:46:16.297124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:09.835851+0000","last_change":"2024-09-21T01:39:44.300338+0000","last_active":"2024-09-21T01:40:09.835851+0000","last_peered":"2024-09-21T01:40:09.835851+0000","last_clean":"2024-09-21T01:40:09.835851+0000","last_became_active":"2024-09-21T01:39:44.299920+0000","last_became_peered":"2024-09-21T01:39:44.299920+0000","last_unstale":"2024-09-21T01:40:09.835851+0000","last_undegraded":"2024-09-21T01:40:09.835851+0000","last_fullsized":"2024-09-21T01:40:09.835851+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:23:47.631867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"82'24","reported_seq":90,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:37.980153+0000","last_change":"2024-09-21T01:39:42.266883+0000","last_active":"2024-09-21T01:40:37.980153+0000","last_peered":"2024-09-21T01:40:37.980153+0000","last_clean":"2024-09-21T01:40:37.980153+0000","last_became_active":"2024-09-21T01:39:42.266494+0000","last_became_peered":"2024-09-21T01:39:42.266494+0000","last_unstale":"2024-09-21T01:40:37.980153+0000","last_undegraded":"2024-09-21T01:40:37.980153+0000","last_fullsized":"2024-09-21T01:40:37.980153+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:56:46.777522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53234,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":31,"num_read_kb":67,"num_write":24,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:09.842133+0000","last_change":"2024-09-21T01:40:09.842036+0000","last_active":"2024-09-21T01:40:09.842133+0000","last_peered":"2024-09-21T01:40:09.842133+0000","last_clean":"2024-09-21T01:40:09.842133+0000","last_became_active":"2024-09-21T01:40:09.841680+0000","last_became_peered":"2024-09-21T01:40:09.841680+0000","last_unstale":"2024-09-21T01:40:09.842133+0000","last_undegraded":"2024-09-21T01:40:09.842133+0000","last_fullsized":"2024-09-21T01:40:09.842133+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:01:58.366511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,11,5],"acting":[10,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:10.061533+0000","last_change":"2024-09-21T01:39:44.296958+0000","last_active":"2024-09-21T01:40:10.061533+0000","last_peered":"2024-09-21T01:40:10.061533+0000","last_clean":"2024-09-21T01:40:10.061533+0000","last_became_active":"2024-09-21T01:39:44.296588+0000","last_became_peered":"2024-09-21T01:39:44.296588+0000","last_unstale":"2024-09-21T01:40:10.061533+0000","last_undegraded":"2024-09-21T01:40:10.061533+0000","last_fullsized":"2024-09-21T01:40:10.061533+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:04:25.222279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"74'3","reported_seq":38,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:09.839831+0000","last_change":"2024-09-21T01:39:42.550770+0000","last_active":"2024-09-21T01:40:09.839831+0000","last_peered":"2024-09-21T01:40:09.839831+0000","last_clean":"2024-09-21T01:40:09.839831+0000","last_became_active":"2024-09-21T01:39:42.550317+0000","last_became_peered":"2024-09-21T01:39:42.550317+0000","last_unstale":"2024-09-21T01:40:09.839831+0000","last_undegraded":"2024-09-21T01:40:09.839831+0000","last_fullsized":"2024-09-21T01:40:09.839831+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:11:05.269317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:10.061785+0000","last_change":"2024-09-21T01:39:51.342166+0000","last_active":"2024-09-21T01:40:10.061785+0000","last_peered":"2024-09-21T01:40:10.061785+0000","last_clean":"2024-09-21T01:40:10.061785+0000","last_became_active":"2024-09-21T01:39:51.341633+0000","last_became_peered":"2024-09-21T01:39:51.341633+0000","last_unstale":"2024-09-21T01:40:10.061785+0000","last_undegraded":"2024-09-21T01:40:10.061785+0000","last_fullsized":"2024-09-21T01:40:10.061785+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:47:13.524123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:10.061759+0000","last_change":"2024-09-21T01:39:44.297652+0000","last_active":"2024-09-21T01:40:10.061759+0000","last_peered":"2024-09-21T01:40:10.061759+0000","last_clean":"2024-09-21T01:40:10.061759+0000","last_became_active":"2024-09-21T01:39:44.297289+0000","last_became_peered":"2024-09-21T01:39:44.297289+0000","last_unstale":"2024-09-21T01:40:10.061759+0000","last_undegraded":"2024-09-21T01:40:10.061759+0000","last_fullsized":"2024-09-21T01:40:10.061759+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:14:52.834492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":35,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:09.828808+0000","last_change":"2024-09-21T01:39:42.269881+0000","last_active":"2024-09-21T01:40:09.828808+0000","last_peered":"2024-09-21T01:40:09.828808+0000","last_clean":"2024-09-21T01:40:09.828808+0000","last_became_active":"2024-09-21T01:39:42.269498+0000","last_became_peered":"2024-09-21T01:39:42.269498+0000","last_unstale":"2024-09-21T01:40:09.828808+0000","last_undegraded":"2024-09-21T01:40:09.828808+0000","last_fullsized":"2024-09-21T01:40:09.828808+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:10:31.750792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:10.064534+0000","last_change":"2024-09-21T01:40:10.063827+0000","last_active":"2024-09-21T01:40:10.064534+0000","last_peered":"2024-09-21T01:40:10.064534+0000","last_clean":"2024-09-21T01:40:10.064534+0000","last_became_active":"2024-09-21T01:40:10.063206+0000","last_became_peered":"2024-09-21T01:40:10.063206+0000","last_unstale":"2024-09-21T01:40:10.064534+0000","last_undegraded":"2024-09-21T01:40:10.064534+0000","last_fullsized":"2024-09-21T01:40:10.064534+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:33:28.905812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2,4],"acting":[8,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:10.061870+0000","last_change":"2024-09-21T01:39:44.292241+0000","last_active":"2024-09-21T01:40:10.061870+0000","last_peered":"2024-09-21T01:40:10.061870+0000","last_clean":"2024-09-21T01:40:10.061870+0000","last_became_active":"2024-09-21T01:39:44.291808+0000","last_became_peered":"2024-09-21T01:39:44.291808+0000","last_unstale":"2024-09-21T01:40:10.061870+0000","last_undegraded":"2024-09-21T01:40:10.061870+0000","last_fullsized":"2024-09-21T01:40:10.061870+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:47:24.761137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":35,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:09.832583+0000","last_change":"2024-09-21T01:39:42.272047+0000","last_active":"2024-09-21T01:40:09.832583+0000","last_peered":"2024-09-21T01:40:09.832583+0000","last_clean":"2024-09-21T01:40:09.832583+0000","last_became_active":"2024-09-21T01:39:42.271668+0000","last_became_peered":"2024-09-21T01:39:42.271668+0000","last_unstale":"2024-09-21T01:40:09.832583+0000","last_undegraded":"2024-09-21T01:40:09.832583+0000","last_fullsized":"2024-09-21T01:40:09.832583+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:44:09.702328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:10.060992+0000","last_change":"2024-09-21T01:39:51.337760+0000","last_active":"2024-09-21T01:40:10.060992+0000","last_peered":"2024-09-21T01:40:10.060992+0000","last_clean":"2024-09-21T01:40:10.060992+0000","last_became_active":"2024-09-21T01:39:51.337337+0000","last_became_peered":"2024-09-21T01:39:51.337337+0000","last_unstale":"2024-09-21T01:40:10.060992+0000","last_undegraded":"2024-09-21T01:40:10.060992+0000","last_fullsized":"2024-09-21T01:40:10.060992+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:33:49.316833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:10.061110+0000","last_change":"2024-09-21T01:39:51.334722+0000","last_active":"2024-09-21T01:40:10.061110+0000","last_peered":"2024-09-21T01:40:10.061110+0000","last_clean":"2024-09-21T01:40:10.061110+0000","last_became_active":"2024-09-21T01:39:51.334318+0000","last_became_peered":"2024-09-21T01:39:51.334318+0000","last_unstale":"2024-09-21T01:40:10.061110+0000","last_undegraded":"2024-09-21T01:40:10.061110+0000","last_fullsized":"2024-09-21T01:40:10.061110+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:29:17.625223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:09.830956+0000","last_change":"2024-09-21T01:39:44.283183+0000","last_active":"2024-09-21T01:40:09.830956+0000","last_peered":"2024-09-21T01:40:09.830956+0000","last_clean":"2024-09-21T01:40:09.830956+0000","last_became_active":"2024-09-21T01:39:44.282829+0000","last_became_peered":"2024-09-21T01:39:44.282829+0000","last_unstale":"2024-09-21T01:40:09.830956+0000","last_undegraded":"2024-09-21T01:40:09.830956+0000","last_fullsized":"2024-09-21T01:40:09.830956+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:31:43.602584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":35,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:09.839892+0000","last_change":"2024-09-21T01:39:42.267465+0000","last_active":"2024-09-21T01:40:09.839892+0000","last_peered":"2024-09-21T01:40:09.839892+0000","last_clean":"2024-09-21T01:40:09.839892+0000","last_became_active":"2024-09-21T01:39:42.267051+0000","last_became_peered":"2024-09-21T01:39:42.267051+0000","last_unstale":"2024-09-21T01:40:09.839892+0000","last_undegraded":"2024-09-21T01:40:09.839892+0000","last_fullsized":"2024-09-21T01:40:09.839892+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:17:30.917284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:09.830341+0000","last_change":"2024-09-21T01:39:51.338907+0000","last_active":"2024-09-21T01:40:09.830341+0000","last_peered":"2024-09-21T01:40:09.830341+0000","last_clean":"2024-09-21T01:40:09.830341+0000","last_became_active":"2024-09-21T01:39:51.338444+0000","last_became_peered":"2024-09-21T01:39:51.338444+0000","last_unstale":"2024-09-21T01:40:09.830341+0000","last_undegraded":"2024-09-21T01:40:09.830341+0000","last_fullsized":"2024-09-21T01:40:09.830341+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:35:44.819976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:10.060746+0000","last_change":"2024-09-21T01:39:44.293735+0000","last_active":"2024-09-21T01:40:10.060746+0000","last_peered":"2024-09-21T01:40:10.060746+0000","last_clean":"2024-09-21T01:40:10.060746+0000","last_became_active":"2024-09-21T01:39:44.293371+0000","last_became_peered":"2024-09-21T01:39:44.293371+0000","last_unstale":"2024-09-21T01:40:10.060746+0000","last_undegraded":"2024-09-21T01:40:10.060746+0000","last_fullsized":"2024-09-21T01:40:10.060746+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:50:50.404018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":35,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:09.826967+0000","last_change":"2024-09-21T01:39:42.259012+0000","last_active":"2024-09-21T01:40:09.826967+0000","last_peered":"2024-09-21T01:40:09.826967+0000","last_clean":"2024-09-21T01:40:09.826967+0000","last_became_active":"2024-09-21T01:39:42.258665+0000","last_became_peered":"2024-09-21T01:39:42.258665+0000","last_unstale":"2024-09-21T01:40:09.826967+0000","last_undegraded":"2024-09-21T01:40:09.826967+0000","last_fullsized":"2024-09-21T01:40:09.826967+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:25:24.797505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"74'1","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:09.832588+0000","last_change":"2024-09-21T01:39:42.270969+0000","last_active":"2024-09-21T01:40:09.832588+0000","last_peered":"2024-09-21T01:40:09.832588+0000","last_clean":"2024-09-21T01:40:09.832588+0000","last_became_active":"2024-09-21T01:39:42.270629+0000","last_became_peered":"2024-09-21T01:39:42.270629+0000","last_unstale":"2024-09-21T01:40:09.832588+0000","last_undegraded":"2024-09-21T01:40:09.832588+0000","last_fullsized":"2024-09-21T01:40:09.832588+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:30:06.321196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:09.839565+0000","last_change":"2024-09-21T01:39:44.297656+0000","last_active":"2024-09-21T01:40:09.839565+0000","last_peered":"2024-09-21T01:40:09.839565+0000","last_clean":"2024-09-21T01:40:09.839565+0000","last_became_active":"2024-09-21T01:39:44.297273+0000","last_became_peered":"2024-09-21T01:39:44.297273+0000","last_unstale":"2024-09-21T01:40:09.839565+0000","last_undegraded":"2024-09-21T01:40:09.839565+0000","last_fullsized":"2024-09-21T01:40:09.839565+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:35:24.645472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:09.842500+0000","last_change":"2024-09-21T01:40:09.842397+0000","last_active":"2024-09-21T01:40:09.842500+0000","last_peered":"2024-09-21T01:40:09.842500+0000","last_clean":"2024-09-21T01:40:09.842500+0000","last_became_active":"2024-09-21T01:40:09.841934+0000","last_became_peered":"2024-09-21T01:40:09.841934+0000","last_unstale":"2024-09-21T01:40:09.842500+0000","last_undegraded":"2024-09-21T01:40:09.842500+0000","last_fullsized":"2024-09-21T01:40:09.842500+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:06:36.189594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,8,5],"acting":[2,6,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"74'1","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:09.839648+0000","last_change":"2024-09-21T01:39:42.267207+0000","last_active":"2024-09-21T01:40:09.839648+0000","last_peered":"2024-09-21T01:40:09.839648+0000","last_clean":"2024-09-21T01:40:09.839648+0000","last_became_active":"2024-09-21T01:39:42.266829+0000","last_became_peered":"2024-09-21T01:39:42.266829+0000","last_unstale":"2024-09-21T01:40:09.839648+0000","last_undegraded":"2024-09-21T01:40:09.839648+0000","last_fullsized":"2024-09-21T01:40:09.839648+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:03:18.047546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:09.835253+0000","last_change":"2024-09-21T01:39:44.305545+0000","last_active":"2024-09-21T01:40:09.835253+0000","last_peered":"2024-09-21T01:40:09.835253+0000","last_clean":"2024-09-21T01:40:09.835253+0000","last_became_active":"2024-09-21T01:39:44.305195+0000","last_became_peered":"2024-09-21T01:39:44.305195+0000","last_unstale":"2024-09-21T01:40:09.835253+0000","last_undegraded":"2024-09-21T01:40:09.835253+0000","last_fullsized":"2024-09-21T01:40:09.835253+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:26:50.011622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:09.829821+0000","last_change":"2024-09-21T01:39:51.342132+0000","last_active":"2024-09-21T01:40:09.829821+0000","last_peered":"2024-09-21T01:40:09.829821+0000","last_clean":"2024-09-21T01:40:09.829821+0000","last_became_active":"2024-09-21T01:39:51.341668+0000","last_became_peered":"2024-09-21T01:39:51.341668+0000","last_unstale":"2024-09-21T01:40:09.829821+0000","last_undegraded":"2024-09-21T01:40:09.829821+0000","last_fullsized":"2024-09-21T01:40:09.829821+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:28:18.119259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:09.829307+0000","last_change":"2024-09-21T01:39:44.300226+0000","last_active":"2024-09-21T01:40:09.829307+0000","last_peered":"2024-09-21T01:40:09.829307+0000","last_clean":"2024-09-21T01:40:09.829307+0000","last_became_active":"2024-09-21T01:39:44.298740+0000","last_became_peered":"2024-09-21T01:39:44.298740+0000","last_unstale":"2024-09-21T01:40:09.829307+0000","last_undegraded":"2024-09-21T01:40:09.829307+0000","last_fullsized":"2024-09-21T01:40:09.829307+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:05:33.288070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:09.831481+0000","last_change":"2024-09-21T01:39:44.301379+0000","last_active":"2024-09-21T01:40:09.831481+0000","last_peered":"2024-09-21T01:40:09.831481+0000","last_clean":"2024-09-21T01:40:09.831481+0000","last_became_active":"2024-09-21T01:39:44.301011+0000","last_became_peered":"2024-09-21T01:39:44.301011+0000","last_unstale":"2024-09-21T01:40:09.831481+0000","last_undegraded":"2024-09-21T01:40:09.831481+0000","last_fullsized":"2024-09-21T01:40:09.831481+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:16:47.672736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:09.829652+0000","last_change":"2024-09-21T01:39:44.294318+0000","last_active":"2024-09-21T01:40:09.829652+0000","last_peered":"2024-09-21T01:40:09.829652+0000","last_clean":"2024-09-21T01:40:09.829652+0000","last_became_active":"2024-09-21T01:39:44.293941+0000","last_became_peered":"2024-09-21T01:39:44.293941+0000","last_unstale":"2024-09-21T01:40:09.829652+0000","last_undegraded":"2024-09-21T01:40:09.829652+0000","last_fullsized":"2024-09-21T01:40:09.829652+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:27:34.776088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:10.061284+0000","last_change":"2024-09-21T01:39:44.287815+0000","last_active":"2024-09-21T01:40:10.061284+0000","last_peered":"2024-09-21T01:40:10.061284+0000","last_clean":"2024-09-21T01:40:10.061284+0000","last_became_active":"2024-09-21T01:39:44.287471+0000","last_became_peered":"2024-09-21T01:39:44.287471+0000","last_unstale":"2024-09-21T01:40:10.061284+0000","last_undegraded":"2024-09-21T01:40:10.061284+0000","last_fullsized":"2024-09-21T01:40:10.061284+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:13:59.661464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:09.827475+0000","last_change":"2024-09-21T01:39:44.285591+0000","last_active":"2024-09-21T01:40:09.827475+0000","last_peered":"2024-09-21T01:40:09.827475+0000","last_clean":"2024-09-21T01:40:09.827475+0000","last_became_active":"2024-09-21T01:39:44.285253+0000","last_became_peered":"2024-09-21T01:39:44.285253+0000","last_unstale":"2024-09-21T01:40:09.827475+0000","last_undegraded":"2024-09-21T01:40:09.827475+0000","last_fullsized":"2024-09-21T01:40:09.827475+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:58:02.890685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:09.830098+0000","last_change":"2024-09-21T01:39:44.306547+0000","last_active":"2024-09-21T01:40:09.830098+0000","last_peered":"2024-09-21T01:40:09.830098+0000","last_clean":"2024-09-21T01:40:09.830098+0000","last_became_active":"2024-09-21T01:39:44.306116+0000","last_became_peered":"2024-09-21T01:39:44.306116+0000","last_unstale":"2024-09-21T01:40:09.830098+0000","last_undegraded":"2024-09-21T01:40:09.830098+0000","last_fullsized":"2024-09-21T01:40:09.830098+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:58:40.654784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:09.830420+0000","last_change":"2024-09-21T01:39:44.295317+0000","last_active":"2024-09-21T01:40:09.830420+0000","last_peered":"2024-09-21T01:40:09.830420+0000","last_clean":"2024-09-21T01:40:09.830420+0000","last_became_active":"2024-09-21T01:39:44.294936+0000","last_became_peered":"2024-09-21T01:39:44.294936+0000","last_unstale":"2024-09-21T01:40:09.830420+0000","last_undegraded":"2024-09-21T01:40:09.830420+0000","last_fullsized":"2024-09-21T01:40:09.830420+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:32:24.112588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:10.062190+0000","last_change":"2024-09-21T01:39:44.297242+0000","last_active":"2024-09-21T01:40:10.062190+0000","last_peered":"2024-09-21T01:40:10.062190+0000","last_clean":"2024-09-21T01:40:10.062190+0000","last_became_active":"2024-09-21T01:39:44.296072+0000","last_became_peered":"2024-09-21T01:39:44.296072+0000","last_unstale":"2024-09-21T01:40:10.062190+0000","last_undegraded":"2024-09-21T01:40:10.062190+0000","last_fullsized":"2024-09-21T01:40:10.062190+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:22:23.449535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:09.839349+0000","last_change":"2024-09-21T01:39:44.293899+0000","last_active":"2024-09-21T01:40:09.839349+0000","last_peered":"2024-09-21T01:40:09.839349+0000","last_clean":"2024-09-21T01:40:09.839349+0000","last_became_active":"2024-09-21T01:39:44.293502+0000","last_became_peered":"2024-09-21T01:39:44.293502+0000","last_unstale":"2024-09-21T01:40:09.839349+0000","last_undegraded":"2024-09-21T01:40:09.839349+0000","last_fullsized":"2024-09-21T01:40:09.839349+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:07:39.549931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:10.061041+0000","last_change":"2024-09-21T01:39:44.298192+0000","last_active":"2024-09-21T01:40:10.061041+0000","last_peered":"2024-09-21T01:40:10.061041+0000","last_clean":"2024-09-21T01:40:10.061041+0000","last_became_active":"2024-09-21T01:39:44.297834+0000","last_became_peered":"2024-09-21T01:39:44.297834+0000","last_unstale":"2024-09-21T01:40:10.061041+0000","last_undegraded":"2024-09-21T01:40:10.061041+0000","last_fullsized":"2024-09-21T01:40:10.061041+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:41:21.759972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:10.061259+0000","last_change":"2024-09-21T01:39:44.300125+0000","last_active":"2024-09-21T01:40:10.061259+0000","last_peered":"2024-09-21T01:40:10.061259+0000","last_clean":"2024-09-21T01:40:10.061259+0000","last_became_active":"2024-09-21T01:39:44.298047+0000","last_became_peered":"2024-09-21T01:39:44.298047+0000","last_unstale":"2024-09-21T01:40:10.061259+0000","last_undegraded":"2024-09-21T01:40:10.061259+0000","last_fullsized":"2024-09-21T01:40:10.061259+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:31:58.719520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:09.827359+0000","last_change":"2024-09-21T01:39:44.287346+0000","last_active":"2024-09-21T01:40:09.827359+0000","last_peered":"2024-09-21T01:40:09.827359+0000","last_clean":"2024-09-21T01:40:09.827359+0000","last_became_active":"2024-09-21T01:39:44.286999+0000","last_became_peered":"2024-09-21T01:39:44.286999+0000","last_unstale":"2024-09-21T01:40:09.827359+0000","last_undegraded":"2024-09-21T01:40:09.827359+0000","last_fullsized":"2024-09-21T01:40:09.827359+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:42:26.732516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:09.829908+0000","last_change":"2024-09-21T01:39:44.299083+0000","last_active":"2024-09-21T01:40:09.829908+0000","last_peered":"2024-09-21T01:40:09.829908+0000","last_clean":"2024-09-21T01:40:09.829908+0000","last_became_active":"2024-09-21T01:39:44.298194+0000","last_became_peered":"2024-09-21T01:39:44.298194+0000","last_unstale":"2024-09-21T01:40:09.829908+0000","last_undegraded":"2024-09-21T01:40:09.829908+0000","last_fullsized":"2024-09-21T01:40:09.829908+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:22:23.360519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:09.830016+0000","last_change":"2024-09-21T01:39:44.292985+0000","last_active":"2024-09-21T01:40:09.830016+0000","last_peered":"2024-09-21T01:40:09.830016+0000","last_clean":"2024-09-21T01:40:09.830016+0000","last_became_active":"2024-09-21T01:39:44.292565+0000","last_became_peered":"2024-09-21T01:39:44.292565+0000","last_unstale":"2024-09-21T01:40:09.830016+0000","last_undegraded":"2024-09-21T01:40:09.830016+0000","last_fullsized":"2024-09-21T01:40:09.830016+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:03:33.563458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:09.830968+0000","last_change":"2024-09-21T01:39:44.291522+0000","last_active":"2024-09-21T01:40:09.830968+0000","last_peered":"2024-09-21T01:40:09.830968+0000","last_clean":"2024-09-21T01:40:09.830968+0000","last_became_active":"2024-09-21T01:39:44.291173+0000","last_became_peered":"2024-09-21T01:39:44.291173+0000","last_unstale":"2024-09-21T01:40:09.830968+0000","last_undegraded":"2024-09-21T01:40:09.830968+0000","last_fullsized":"2024-09-21T01:40:09.830968+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:41:54.562004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:09.830994+0000","last_change":"2024-09-21T01:39:44.305053+0000","last_active":"2024-09-21T01:40:09.830994+0000","last_peered":"2024-09-21T01:40:09.830994+0000","last_clean":"2024-09-21T01:40:09.830994+0000","last_became_active":"2024-09-21T01:39:44.304651+0000","last_became_peered":"2024-09-21T01:39:44.304651+0000","last_unstale":"2024-09-21T01:40:09.830994+0000","last_undegraded":"2024-09-21T01:40:09.830994+0000","last_fullsized":"2024-09-21T01:40:09.830994+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:15:42.819633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:10.060809+0000","last_change":"2024-09-21T01:39:44.298405+0000","last_active":"2024-09-21T01:40:10.060809+0000","last_peered":"2024-09-21T01:40:10.060809+0000","last_clean":"2024-09-21T01:40:10.060809+0000","last_became_active":"2024-09-21T01:39:44.298010+0000","last_became_peered":"2024-09-21T01:39:44.298010+0000","last_unstale":"2024-09-21T01:40:10.060809+0000","last_undegraded":"2024-09-21T01:40:10.060809+0000","last_fullsized":"2024-09-21T01:40:10.060809+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:09:15.321530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:10.061608+0000","last_change":"2024-09-21T01:39:44.290593+0000","last_active":"2024-09-21T01:40:10.061608+0000","last_peered":"2024-09-21T01:40:10.061608+0000","last_clean":"2024-09-21T01:40:10.061608+0000","last_became_active":"2024-09-21T01:39:44.290235+0000","last_became_peered":"2024-09-21T01:39:44.290235+0000","last_unstale":"2024-09-21T01:40:10.061608+0000","last_undegraded":"2024-09-21T01:40:10.061608+0000","last_fullsized":"2024-09-21T01:40:10.061608+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:52:20.359493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:10.060892+0000","last_change":"2024-09-21T01:39:44.301902+0000","last_active":"2024-09-21T01:40:10.060892+0000","last_peered":"2024-09-21T01:40:10.060892+0000","last_clean":"2024-09-21T01:40:10.060892+0000","last_became_active":"2024-09-21T01:39:44.301494+0000","last_became_peered":"2024-09-21T01:39:44.301494+0000","last_unstale":"2024-09-21T01:40:10.060892+0000","last_undegraded":"2024-09-21T01:40:10.060892+0000","last_fullsized":"2024-09-21T01:40:10.060892+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:06:16.162987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:09.827305+0000","last_change":"2024-09-21T01:39:44.292360+0000","last_active":"2024-09-21T01:40:09.827305+0000","last_peered":"2024-09-21T01:40:09.827305+0000","last_clean":"2024-09-21T01:40:09.827305+0000","last_became_active":"2024-09-21T01:39:44.291995+0000","last_became_peered":"2024-09-21T01:39:44.291995+0000","last_unstale":"2024-09-21T01:40:09.827305+0000","last_undegraded":"2024-09-21T01:40:09.827305+0000","last_fullsized":"2024-09-21T01:40:09.827305+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:29:10.511082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:10.062033+0000","last_change":"2024-09-21T01:39:44.291836+0000","last_active":"2024-09-21T01:40:10.062033+0000","last_peered":"2024-09-21T01:40:10.062033+0000","last_clean":"2024-09-21T01:40:10.062033+0000","last_became_active":"2024-09-21T01:39:44.291459+0000","last_became_peered":"2024-09-21T01:39:44.291459+0000","last_unstale":"2024-09-21T01:40:10.062033+0000","last_undegraded":"2024-09-21T01:40:10.062033+0000","last_fullsized":"2024-09-21T01:40:10.062033+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:11:53.296520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:09.828871+0000","last_change":"2024-09-21T01:39:44.298572+0000","last_active":"2024-09-21T01:40:09.828871+0000","last_peered":"2024-09-21T01:40:09.828871+0000","last_clean":"2024-09-21T01:40:09.828871+0000","last_became_active":"2024-09-21T01:39:44.297903+0000","last_became_peered":"2024-09-21T01:39:44.297903+0000","last_unstale":"2024-09-21T01:40:09.828871+0000","last_undegraded":"2024-09-21T01:40:09.828871+0000","last_fullsized":"2024-09-21T01:40:09.828871+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:25:06.327202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:09.832637+0000","last_change":"2024-09-21T01:39:44.292648+0000","last_active":"2024-09-21T01:40:09.832637+0000","last_peered":"2024-09-21T01:40:09.832637+0000","last_clean":"2024-09-21T01:40:09.832637+0000","last_became_active":"2024-09-21T01:39:44.292215+0000","last_became_peered":"2024-09-21T01:39:44.292215+0000","last_unstale":"2024-09-21T01:40:09.832637+0000","last_undegraded":"2024-09-21T01:40:09.832637+0000","last_fullsized":"2024-09-21T01:40:09.832637+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:43:02.265276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:10.061804+0000","last_change":"2024-09-21T01:39:44.303330+0000","last_active":"2024-09-21T01:40:10.061804+0000","last_peered":"2024-09-21T01:40:10.061804+0000","last_clean":"2024-09-21T01:40:10.061804+0000","last_became_active":"2024-09-21T01:39:44.302862+0000","last_became_peered":"2024-09-21T01:39:44.302862+0000","last_unstale":"2024-09-21T01:40:10.061804+0000","last_undegraded":"2024-09-21T01:40:10.061804+0000","last_fullsized":"2024-09-21T01:40:10.061804+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:58:12.296150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:10.060703+0000","last_change":"2024-09-21T01:39:44.288015+0000","last_active":"2024-09-21T01:40:10.060703+0000","last_peered":"2024-09-21T01:40:10.060703+0000","last_clean":"2024-09-21T01:40:10.060703+0000","last_became_active":"2024-09-21T01:39:44.287455+0000","last_became_peered":"2024-09-21T01:39:44.287455+0000","last_unstale":"2024-09-21T01:40:10.060703+0000","last_undegraded":"2024-09-21T01:40:10.060703+0000","last_fullsized":"2024-09-21T01:40:10.060703+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:12:07.036882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:09.828037+0000","last_change":"2024-09-21T01:39:44.294594+0000","last_active":"2024-09-21T01:40:09.828037+0000","last_peered":"2024-09-21T01:40:09.828037+0000","last_clean":"2024-09-21T01:40:09.828037+0000","last_became_active":"2024-09-21T01:39:44.294218+0000","last_became_peered":"2024-09-21T01:39:44.294218+0000","last_unstale":"2024-09-21T01:40:09.828037+0000","last_undegraded":"2024-09-21T01:40:09.828037+0000","last_fullsized":"2024-09-21T01:40:09.828037+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:45:54.875131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:09.832554+0000","last_change":"2024-09-21T01:39:44.285172+0000","last_active":"2024-09-21T01:40:09.832554+0000","last_peered":"2024-09-21T01:40:09.832554+0000","last_clean":"2024-09-21T01:40:09.832554+0000","last_became_active":"2024-09-21T01:39:44.284799+0000","last_became_peered":"2024-09-21T01:39:44.284799+0000","last_unstale":"2024-09-21T01:40:09.832554+0000","last_undegraded":"2024-09-21T01:40:09.832554+0000","last_fullsized":"2024-09-21T01:40:09.832554+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:06:30.562297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:09.835339+0000","last_change":"2024-09-21T01:39:44.295990+0000","last_active":"2024-09-21T01:40:09.835339+0000","last_peered":"2024-09-21T01:40:09.835339+0000","last_clean":"2024-09-21T01:40:09.835339+0000","last_became_active":"2024-09-21T01:39:44.295601+0000","last_became_peered":"2024-09-21T01:39:44.295601+0000","last_unstale":"2024-09-21T01:40:09.835339+0000","last_undegraded":"2024-09-21T01:40:09.835339+0000","last_fullsized":"2024-09-21T01:40:09.835339+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:37:08.300911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:10.061899+0000","last_change":"2024-09-21T01:39:44.300104+0000","last_active":"2024-09-21T01:40:10.061899+0000","last_peered":"2024-09-21T01:40:10.061899+0000","last_clean":"2024-09-21T01:40:10.061899+0000","last_became_active":"2024-09-21T01:39:44.299709+0000","last_became_peered":"2024-09-21T01:39:44.299709+0000","last_unstale":"2024-09-21T01:40:10.061899+0000","last_undegraded":"2024-09-21T01:40:10.061899+0000","last_fullsized":"2024-09-21T01:40:10.061899+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:01:35.013021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:10.061448+0000","last_change":"2024-09-21T01:39:44.295900+0000","last_active":"2024-09-21T01:40:10.061448+0000","last_peered":"2024-09-21T01:40:10.061448+0000","last_clean":"2024-09-21T01:40:10.061448+0000","last_became_active":"2024-09-21T01:39:44.295303+0000","last_became_peered":"2024-09-21T01:39:44.295303+0000","last_unstale":"2024-09-21T01:40:10.061448+0000","last_undegraded":"2024-09-21T01:40:10.061448+0000","last_fullsized":"2024-09-21T01:40:10.061448+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:00:23.097745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:10.061227+0000","last_change":"2024-09-21T01:39:44.303627+0000","last_active":"2024-09-21T01:40:10.061227+0000","last_peered":"2024-09-21T01:40:10.061227+0000","last_clean":"2024-09-21T01:40:10.061227+0000","last_became_active":"2024-09-21T01:39:44.303260+0000","last_became_peered":"2024-09-21T01:39:44.303260+0000","last_unstale":"2024-09-21T01:40:10.061227+0000","last_undegraded":"2024-09-21T01:40:10.061227+0000","last_fullsized":"2024-09-21T01:40:10.061227+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:17:39.630994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-21T01:40:09.830845+0000","last_change":"2024-09-21T01:39:44.306087+0000","last_active":"2024-09-21T01:40:09.830845+0000","last_peered":"2024-09-21T01:40:09.830845+0000","last_clean":"2024-09-21T01:40:09.830845+0000","last_became_active":"2024-09-21T01:39:44.305660+0000","last_became_peered":"2024-09-21T01:39:44.305660+0000","last_unstale":"2024-09-21T01:40:09.830845+0000","last_undegraded":"2024-09-21T01:40:09.830845+0000","last_fullsized":"2024-09-21T01:40:09.830845+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:26:46.911966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":54032,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":37,"num_read_kb":73,"num_write":73,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":270336,"data_stored":182392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":62,"ondisk_log_size":62,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":376832,"data_stored":4132576,"data_compressed":247723,"data_compressed_allocated":315392,"data_compressed_original":4096000,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":68,"seq":292057776152,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":901120,"data_stored":475571,"data_compressed":23550,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939676,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32180,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712972,"statfs":{"total":95995035648,"available":95962083328,"internally_reserved":0,"allocated":1019904,"data_stored":1115271,"data_compressed":59401,"data_compressed_allocated":77824,"data_compressed_original":655360,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":58,"seq":249108103202,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":909312,"data_stored":480249,"data_compressed":23550,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":52,"seq":223338299431,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":909312,"data_stored":476175,"data_compressed":23550,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495659,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32120,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713032,"statfs":{"total":95995035648,"available":95962144768,"internally_reserved":0,"allocated":958464,"data_stored":1070617,"data_compressed":59401,"data_compressed_allocated":77824,"data_compressed_original":655360,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":41,"seq":176093659184,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":897024,"data_stored":471475,"data_compressed":23550,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855415,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32124,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713028,"statfs":{"total":95995035648,"available":95962140672,"internally_reserved":0,"allocated":962560,"data_stored":1066121,"data_compressed":59401,"data_compressed_allocated":77824,"data_compressed_original":655360,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018940,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":905216,"data_stored":475593,"data_compressed":23550,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182465,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32068,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713084,"statfs":{"total":95995035648,"available":95962198016,"internally_reserved":0,"allocated":905216,"data_stored":471579,"data_compressed":23550,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411398,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36296,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708856,"statfs":{"total":95995035648,"available":95957868544,"internally_reserved":0,"allocated":974848,"data_stored":534891,"data_compressed":23550,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574922,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32132,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713020,"statfs":{"total":95995035648,"available":95962132480,"internally_reserved":0,"allocated":970752,"data_stored":534857,"data_compressed":23550,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705743,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":901120,"data_stored":471565,"data_compressed":23550,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34234,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34234,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35851,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35851,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35851,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35851,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35851,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":63382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":63416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":53428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T01:40:43.883 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-21T01:40:43.884 INFO:tasks.cephadm:Setting up client nodes... 2024-09-21T01:40:43.884 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-21T01:40:44.144 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:40:44.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:40:43 smithi142 ceph-mon[34050]: pgmap v297: 129 pgs: 129 active+clean; 630 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 5.0 KiB/s wr, 4 op/s 2024-09-21T01:40:44.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:40:43 smithi119 ceph-mon[33693]: pgmap v297: 129 pgs: 129 active+clean; 630 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 5.0 KiB/s wr, 4 op/s 2024-09-21T01:40:44.265 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:40:43 smithi083 ceph-mon[31370]: pgmap v297: 129 pgs: 129 active+clean; 630 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 5.0 KiB/s wr, 4 op/s 2024-09-21T01:40:44.638 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:44.633+0000 7ff0a9c31640 1 -- 172.21.15.83:0/2865902658 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff0a4102a80 msgr2=0x7ff0a4102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:40:44.638 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:44.633+0000 7ff0a9c31640 1 --2- 172.21.15.83:0/2865902658 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff0a4102a80 0x7ff0a4102e90 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7ff094009900 tx=0x7ff09402a3f0 comp rx=0 tx=0).stop 2024-09-21T01:40:44.638 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:44.634+0000 7ff0a9c31640 1 -- 172.21.15.83:0/2865902658 shutdown_connections 2024-09-21T01:40:44.638 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:44.634+0000 7ff0a9c31640 1 --2- 172.21.15.83:0/2865902658 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff0a4108d10 0x7ff0a410f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:44.638 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:44.634+0000 7ff0a9c31640 1 --2- 172.21.15.83:0/2865902658 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff0a41083c0 0x7ff0a41087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:44.638 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:44.634+0000 7ff0a9c31640 1 --2- 172.21.15.83:0/2865902658 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff0a4102a80 0x7ff0a4102e90 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:44.638 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:44.634+0000 7ff0a9c31640 1 -- 172.21.15.83:0/2865902658 >> 172.21.15.83:0/2865902658 conn(0x7ff0a4079760 msgr2=0x7ff0a4079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:40:44.638 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:44.634+0000 7ff0a9c31640 1 -- 172.21.15.83:0/2865902658 shutdown_connections 2024-09-21T01:40:44.639 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:44.634+0000 7ff0a9c31640 1 -- 172.21.15.83:0/2865902658 wait complete. 2024-09-21T01:40:44.639 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:44.634+0000 7ff0a9c31640 1 Processor -- start 2024-09-21T01:40:44.639 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:44.634+0000 7ff0a9c31640 1 -- start start 2024-09-21T01:40:44.639 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:44.635+0000 7ff0a9c31640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff0a4102a80 0x7ff0a419b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:40:44.639 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:44.635+0000 7ff0a9c31640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff0a41083c0 0x7ff0a419b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:40:44.639 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:44.635+0000 7ff0a9c31640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff0a4108d10 0x7ff0a419bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:40:44.639 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:44.635+0000 7ff0a9c31640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7ff0a4112830 con 0x7ff0a41083c0 2024-09-21T01:40:44.639 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:44.635+0000 7ff0a9c31640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7ff0a41126b0 con 0x7ff0a4102a80 2024-09-21T01:40:44.639 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:44.635+0000 7ff0a9c31640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7ff0a41129b0 con 0x7ff0a4108d10 2024-09-21T01:40:44.639 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:44.635+0000 7ff0a2ffd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff0a41083c0 0x7ff0a419b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:40:44.639 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:44.635+0000 7ff0a2ffd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff0a41083c0 0x7ff0a419b680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:48810/0 (socket says 172.21.15.83:48810) 2024-09-21T01:40:44.639 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:44.635+0000 7ff0a2ffd640 1 -- 172.21.15.83:0/2170840019 learned_addr learned my addr 172.21.15.83:0/2170840019 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:40:44.639 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:44.635+0000 7ff0a3fff640 1 --2- 172.21.15.83:0/2170840019 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff0a4108d10 0x7ff0a419bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:40:44.639 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:44.635+0000 7ff0a37fe640 1 --2- 172.21.15.83:0/2170840019 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff0a4102a80 0x7ff0a419b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:40:44.640 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:44.635+0000 7ff0a2ffd640 1 -- 172.21.15.83:0/2170840019 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff0a4108d10 msgr2=0x7ff0a419bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:40:44.640 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:44.635+0000 7ff0a2ffd640 1 --2- 172.21.15.83:0/2170840019 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff0a4108d10 0x7ff0a419bbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:44.640 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:44.635+0000 7ff0a2ffd640 1 -- 172.21.15.83:0/2170840019 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff0a4102a80 msgr2=0x7ff0a419b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:40:44.640 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:44.635+0000 7ff0a2ffd640 1 --2- 172.21.15.83:0/2170840019 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff0a4102a80 0x7ff0a419b140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:44.640 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:44.635+0000 7ff0a2ffd640 1 -- 172.21.15.83:0/2170840019 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0a41a6370 con 0x7ff0a41083c0 2024-09-21T01:40:44.640 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:44.635+0000 7ff0a2ffd640 1 --2- 172.21.15.83:0/2170840019 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff0a41083c0 0x7ff0a419b680 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7ff09800c970 tx=0x7ff09800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:40:44.640 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:44.636+0000 7ff0a0ff9640 1 -- 172.21.15.83:0/2170840019 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff098014070 con 0x7ff0a41083c0 2024-09-21T01:40:44.640 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:44.636+0000 7ff0a9c31640 1 -- 172.21.15.83:0/2170840019 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0a41a6660 con 0x7ff0a41083c0 2024-09-21T01:40:44.640 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:44.636+0000 7ff0a0ff9640 1 -- 172.21.15.83:0/2170840019 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff098004440 con 0x7ff0a41083c0 2024-09-21T01:40:44.640 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:44.636+0000 7ff0a0ff9640 1 -- 172.21.15.83:0/2170840019 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff098003d40 con 0x7ff0a41083c0 2024-09-21T01:40:44.640 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:44.636+0000 7ff0a9c31640 1 -- 172.21.15.83:0/2170840019 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0a41a6bf0 con 0x7ff0a41083c0 2024-09-21T01:40:44.641 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:44.637+0000 7ff0a9c31640 1 -- 172.21.15.83:0/2170840019 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0a4102e90 con 0x7ff0a41083c0 2024-09-21T01:40:44.641 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:44.639+0000 7ff0a0ff9640 1 -- 172.21.15.83:0/2170840019 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7ff098017070 con 0x7ff0a41083c0 2024-09-21T01:40:44.641 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:44.640+0000 7ff0a0ff9640 1 --2- 172.21.15.83:0/2170840019 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7ff08c0b6670 0x7ff08c0b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:40:44.641 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:44.640+0000 7ff0a37fe640 1 --2- 172.21.15.83:0/2170840019 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7ff08c0b6670 0x7ff08c0b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:40:44.641 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:44.640+0000 7ff0a0ff9640 1 -- 172.21.15.83:0/2170840019 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9286+0+0 (secure 0 0 0) 0x7ff0980e7ac0 con 0x7ff0a41083c0 2024-09-21T01:40:44.642 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:44.641+0000 7ff0a37fe640 1 --2- 172.21.15.83:0/2170840019 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7ff08c0b6670 0x7ff08c0b8b80 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ff0a406b9e0 tx=0x7ff0940058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:40:44.644 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:44.643+0000 7ff0a0ff9640 1 -- 172.21.15.83:0/2170840019 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff09801e020 con 0x7ff0a41083c0 2024-09-21T01:40:44.895 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:44.894+0000 7ff0a9c31640 1 -- 172.21.15.83:0/2170840019 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7ff0a406b290 con 0x7ff0a41083c0 2024-09-21T01:40:44.902 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:44.899+0000 7ff0a0ff9640 1 -- 172.21.15.83:0/2170840019 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v32) ==== 170+0+59 (secure 0 0 0) 0x7ff0980ade50 con 0x7ff0a41083c0 2024-09-21T01:40:44.902 INFO:teuthology.orchestra.run.smithi083.stdout:[client.0] 2024-09-21T01:40:44.902 INFO:teuthology.orchestra.run.smithi083.stdout: key = AQAcJO5m60luNRAAnH3M6gRdKGQGGRD7ziqWxA== 2024-09-21T01:40:44.903 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:44.901+0000 7ff0a9c31640 1 -- 172.21.15.83:0/2170840019 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7ff08c0b6670 msgr2=0x7ff08c0b8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:40:44.903 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:44.901+0000 7ff0a9c31640 1 --2- 172.21.15.83:0/2170840019 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7ff08c0b6670 0x7ff08c0b8b80 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ff0a406b9e0 tx=0x7ff0940058d0 comp rx=0 tx=0).stop 2024-09-21T01:40:44.903 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:44.901+0000 7ff0a9c31640 1 -- 172.21.15.83:0/2170840019 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff0a41083c0 msgr2=0x7ff0a419b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:40:44.903 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:44.901+0000 7ff0a9c31640 1 --2- 172.21.15.83:0/2170840019 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff0a41083c0 0x7ff0a419b680 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7ff09800c970 tx=0x7ff09800ce30 comp rx=0 tx=0).stop 2024-09-21T01:40:44.903 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:44.901+0000 7ff0a9c31640 1 -- 172.21.15.83:0/2170840019 shutdown_connections 2024-09-21T01:40:44.903 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:44.901+0000 7ff0a9c31640 1 --2- 172.21.15.83:0/2170840019 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7ff08c0b6670 0x7ff08c0b8b80 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:44.903 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:44.901+0000 7ff0a9c31640 1 --2- 172.21.15.83:0/2170840019 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff0a4108d10 0x7ff0a419bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:44.903 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:44.901+0000 7ff0a9c31640 1 --2- 172.21.15.83:0/2170840019 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff0a41083c0 0x7ff0a419b680 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:44.903 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:44.901+0000 7ff0a9c31640 1 --2- 172.21.15.83:0/2170840019 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff0a4102a80 0x7ff0a419b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:44.903 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:44.901+0000 7ff0a9c31640 1 -- 172.21.15.83:0/2170840019 >> 172.21.15.83:0/2170840019 conn(0x7ff0a4079760 msgr2=0x7ff0a4101480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:40:44.903 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:44.901+0000 7ff0a9c31640 1 -- 172.21.15.83:0/2170840019 shutdown_connections 2024-09-21T01:40:44.903 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:44.901+0000 7ff0a9c31640 1 -- 172.21.15.83:0/2170840019 wait complete. 2024-09-21T01:40:45.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:40:44 smithi142 ceph-mon[34050]: from='client.15075 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T01:40:45.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:40:44 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:40:45.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:40:44 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:40:45.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:40:44 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:40:45.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:40:44 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:40:45.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:40:44 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:40:45.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:40:44 smithi119 ceph-mon[33693]: from='client.15075 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T01:40:45.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:40:44 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:40:45.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:40:44 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:40:45.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:40:44 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:40:45.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:40:44 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:40:45.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:40:44 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:40:45.267 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:40:44 smithi083 ceph-mon[31370]: from='client.15075 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T01:40:45.267 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:40:44 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:40:45.267 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:40:44 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:40:45.267 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:40:44 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:40:45.267 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:40:44 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:40:45.267 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:40:44 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:40:45.581 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-09-21T01:40:45.581 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-09-21T01:40:45.581 DEBUG:teuthology.orchestra.run.smithi083:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-21T01:40:45.618 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph config log 1 --format=json 2024-09-21T01:40:45.904 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:40:46.177 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:40:45 smithi083 ceph-mon[31370]: pgmap v298: 129 pgs: 129 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 6.0 KiB/s wr, 5 op/s 2024-09-21T01:40:46.177 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:40:45 smithi083 ceph-mon[31370]: from='client.? 172.21.15.83:0/2170840019' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-09-21T01:40:46.177 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:40:45 smithi083 ceph-mon[31370]: from='client.? 172.21.15.83:0/2170840019' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-21T01:40:46.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:40:45 smithi142 ceph-mon[34050]: pgmap v298: 129 pgs: 129 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 6.0 KiB/s wr, 5 op/s 2024-09-21T01:40:46.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:40:45 smithi142 ceph-mon[34050]: from='client.? 172.21.15.83:0/2170840019' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-09-21T01:40:46.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:40:45 smithi142 ceph-mon[34050]: from='client.? 172.21.15.83:0/2170840019' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-21T01:40:46.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:40:45 smithi119 ceph-mon[33693]: pgmap v298: 129 pgs: 129 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 6.0 KiB/s wr, 5 op/s 2024-09-21T01:40:46.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:40:45 smithi119 ceph-mon[33693]: from='client.? 172.21.15.83:0/2170840019' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-09-21T01:40:46.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:40:45 smithi119 ceph-mon[33693]: from='client.? 172.21.15.83:0/2170840019' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-21T01:40:46.414 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:46.411+0000 7fdb9b5bb640 1 -- 172.21.15.83:0/1484014521 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdb94108d20 msgr2=0x7fdb9410f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:40:46.415 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:46.411+0000 7fdb9b5bb640 1 --2- 172.21.15.83:0/1484014521 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdb94108d20 0x7fdb9410f550 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fdb8c009ca0 tx=0x7fdb8c02a8c0 comp rx=0 tx=0).stop 2024-09-21T01:40:46.415 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:46.411+0000 7fdb9b5bb640 1 -- 172.21.15.83:0/1484014521 shutdown_connections 2024-09-21T01:40:46.415 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:46.411+0000 7fdb9b5bb640 1 --2- 172.21.15.83:0/1484014521 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdb94108d20 0x7fdb9410f550 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:46.415 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:46.411+0000 7fdb9b5bb640 1 --2- 172.21.15.83:0/1484014521 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdb941083d0 0x7fdb941087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:46.415 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:46.411+0000 7fdb9b5bb640 1 --2- 172.21.15.83:0/1484014521 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdb94102a90 0x7fdb94102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:46.415 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:46.411+0000 7fdb9b5bb640 1 -- 172.21.15.83:0/1484014521 >> 172.21.15.83:0/1484014521 conn(0x7fdb94079750 msgr2=0x7fdb94079b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:40:46.415 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:46.411+0000 7fdb9b5bb640 1 -- 172.21.15.83:0/1484014521 shutdown_connections 2024-09-21T01:40:46.415 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:46.411+0000 7fdb9b5bb640 1 -- 172.21.15.83:0/1484014521 wait complete. 2024-09-21T01:40:46.415 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:46.412+0000 7fdb9b5bb640 1 Processor -- start 2024-09-21T01:40:46.415 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:46.412+0000 7fdb9b5bb640 1 -- start start 2024-09-21T01:40:46.415 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:46.412+0000 7fdb9b5bb640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdb94102a90 0x7fdb9419a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:40:46.415 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:46.412+0000 7fdb9b5bb640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdb941083d0 0x7fdb9419a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:40:46.415 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:46.412+0000 7fdb9b5bb640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdb94108d20 0x7fdb9419fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:40:46.415 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:46.412+0000 7fdb9b5bb640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fdb941128f0 con 0x7fdb94102a90 2024-09-21T01:40:46.416 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:46.412+0000 7fdb9b5bb640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fdb94112770 con 0x7fdb941083d0 2024-09-21T01:40:46.416 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:46.412+0000 7fdb9b5bb640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fdb94112a70 con 0x7fdb94108d20 2024-09-21T01:40:46.416 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:46.412+0000 7fdb99357640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdb94102a90 0x7fdb9419a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:40:46.416 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:46.412+0000 7fdb99357640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdb94102a90 0x7fdb9419a3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:48822/0 (socket says 172.21.15.83:48822) 2024-09-21T01:40:46.416 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:46.412+0000 7fdb99357640 1 -- 172.21.15.83:0/3707114442 learned_addr learned my addr 172.21.15.83:0/3707114442 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:40:46.416 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:46.412+0000 7fdb98b56640 1 --2- 172.21.15.83:0/3707114442 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdb941083d0 0x7fdb9419a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:40:46.416 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:46.412+0000 7fdb99b58640 1 --2- 172.21.15.83:0/3707114442 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdb94108d20 0x7fdb9419fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:40:46.416 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:46.412+0000 7fdb99357640 1 -- 172.21.15.83:0/3707114442 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdb94108d20 msgr2=0x7fdb9419fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:40:46.416 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:46.412+0000 7fdb99357640 1 --2- 172.21.15.83:0/3707114442 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdb94108d20 0x7fdb9419fc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:46.416 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:46.412+0000 7fdb99357640 1 -- 172.21.15.83:0/3707114442 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdb941083d0 msgr2=0x7fdb9419a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:40:46.416 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:46.412+0000 7fdb99357640 1 --2- 172.21.15.83:0/3707114442 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdb941083d0 0x7fdb9419a970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:46.416 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:46.412+0000 7fdb99357640 1 -- 172.21.15.83:0/3707114442 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb941a0340 con 0x7fdb94102a90 2024-09-21T01:40:46.417 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:46.412+0000 7fdb98b56640 1 --2- 172.21.15.83:0/3707114442 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdb941083d0 0x7fdb9419a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:40:46.417 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:46.413+0000 7fdb99357640 1 --2- 172.21.15.83:0/3707114442 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdb94102a90 0x7fdb9419a3d0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fdb9000b4a0 tx=0x7fdb9000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:40:46.417 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:46.413+0000 7fdb8a7fc640 1 -- 172.21.15.83:0/3707114442 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb90014070 con 0x7fdb94102a90 2024-09-21T01:40:46.417 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:46.413+0000 7fdb8a7fc640 1 -- 172.21.15.83:0/3707114442 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdb90010aa0 con 0x7fdb94102a90 2024-09-21T01:40:46.417 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:46.413+0000 7fdb9b5bb640 1 -- 172.21.15.83:0/3707114442 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb941a0630 con 0x7fdb94102a90 2024-09-21T01:40:46.417 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:46.413+0000 7fdb8a7fc640 1 -- 172.21.15.83:0/3707114442 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb90017b70 con 0x7fdb94102a90 2024-09-21T01:40:46.417 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:46.413+0000 7fdb9b5bb640 1 -- 172.21.15.83:0/3707114442 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb941a6d90 con 0x7fdb94102a90 2024-09-21T01:40:46.418 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:46.414+0000 7fdb9b5bb640 1 -- 172.21.15.83:0/3707114442 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb94103d10 con 0x7fdb94102a90 2024-09-21T01:40:46.418 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:46.415+0000 7fdb8a7fc640 1 -- 172.21.15.83:0/3707114442 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7fdb90017070 con 0x7fdb94102a90 2024-09-21T01:40:46.418 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:46.416+0000 7fdb8a7fc640 1 --2- 172.21.15.83:0/3707114442 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fdb800b6670 0x7fdb800b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:40:46.418 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:46.416+0000 7fdb98b56640 1 --2- 172.21.15.83:0/3707114442 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fdb800b6670 0x7fdb800b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:40:46.418 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:46.416+0000 7fdb8a7fc640 1 -- 172.21.15.83:0/3707114442 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9286+0+0 (secure 0 0 0) 0x7fdb900e6ee0 con 0x7fdb94102a90 2024-09-21T01:40:46.418 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:46.417+0000 7fdb98b56640 1 --2- 172.21.15.83:0/3707114442 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fdb800b6670 0x7fdb800b8b80 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fdb94107aa0 tx=0x7fdb84005ec0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:40:46.420 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:46.419+0000 7fdb8a7fc640 1 -- 172.21.15.83:0/3707114442 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fdb900ad1f0 con 0x7fdb94102a90 2024-09-21T01:40:46.599 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:46.598+0000 7fdb9b5bb640 1 -- 172.21.15.83:0/3707114442 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) -- 0x7fdb94102ea0 con 0x7fdb94102a90 2024-09-21T01:40:46.600 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:46.599+0000 7fdb8a7fc640 1 -- 172.21.15.83:0/3707114442 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v56) ==== 86+0+133 (secure 0 0 0) 0x7fdb900b15d0 con 0x7fdb94102a90 2024-09-21T01:40:46.600 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T01:40:46.602 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:46.601+0000 7fdb9b5bb640 1 -- 172.21.15.83:0/3707114442 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fdb800b6670 msgr2=0x7fdb800b8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:40:46.602 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:46.601+0000 7fdb9b5bb640 1 --2- 172.21.15.83:0/3707114442 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fdb800b6670 0x7fdb800b8b80 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fdb94107aa0 tx=0x7fdb84005ec0 comp rx=0 tx=0).stop 2024-09-21T01:40:46.602 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:46.601+0000 7fdb9b5bb640 1 -- 172.21.15.83:0/3707114442 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdb94102a90 msgr2=0x7fdb9419a3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:40:46.603 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:46.601+0000 7fdb9b5bb640 1 --2- 172.21.15.83:0/3707114442 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdb94102a90 0x7fdb9419a3d0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fdb9000b4a0 tx=0x7fdb9000b960 comp rx=0 tx=0).stop 2024-09-21T01:40:46.603 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:46.601+0000 7fdb9b5bb640 1 -- 172.21.15.83:0/3707114442 shutdown_connections 2024-09-21T01:40:46.603 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:46.601+0000 7fdb9b5bb640 1 --2- 172.21.15.83:0/3707114442 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fdb800b6670 0x7fdb800b8b80 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:46.603 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:46.601+0000 7fdb9b5bb640 1 --2- 172.21.15.83:0/3707114442 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdb94108d20 0x7fdb9419fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:46.603 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:46.601+0000 7fdb9b5bb640 1 --2- 172.21.15.83:0/3707114442 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdb941083d0 0x7fdb9419a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:46.603 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:46.601+0000 7fdb9b5bb640 1 --2- 172.21.15.83:0/3707114442 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdb94102a90 0x7fdb9419a3d0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:46.603 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:46.601+0000 7fdb9b5bb640 1 -- 172.21.15.83:0/3707114442 >> 172.21.15.83:0/3707114442 conn(0x7fdb94079750 msgr2=0x7fdb9406bed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:40:46.603 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:46.601+0000 7fdb9b5bb640 1 -- 172.21.15.83:0/3707114442 shutdown_connections 2024-09-21T01:40:46.603 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:46.601+0000 7fdb9b5bb640 1 -- 172.21.15.83:0/3707114442 wait complete. 2024-09-21T01:40:47.194 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:40:46 smithi083 ceph-mon[31370]: from='client.? 172.21.15.83:0/3707114442' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2024-09-21T01:40:47.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:40:46 smithi142 ceph-mon[34050]: from='client.? 172.21.15.83:0/3707114442' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2024-09-21T01:40:47.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:40:46 smithi119 ceph-mon[33693]: from='client.? 172.21.15.83:0/3707114442' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2024-09-21T01:40:47.221 INFO:teuthology.orchestra.run.smithi083.stdout:[{"version":56,"timestamp":"2024-09-21T01:39:35.019641+0000","name":"","changes":[{"name":"mds.all/mds_join_fs","new_value":"all"}]}] 2024-09-21T01:40:47.221 INFO:tasks.ceph_manager:config epoch is 56 2024-09-21T01:40:47.222 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-21T01:40:47.222 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-09-21T01:40:47.222 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph mgr dump --format=json 2024-09-21T01:40:47.468 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:40:47.973 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:47.935+0000 7f990e0d8640 1 -- 172.21.15.83:0/1852544303 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f99081083d0 msgr2=0x7f99081087e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:40:47.973 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:47.935+0000 7f990e0d8640 1 --2- 172.21.15.83:0/1852544303 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f99081083d0 0x7f99081087e0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f98fc009900 tx=0x7f98fc02a410 comp rx=0 tx=0).stop 2024-09-21T01:40:47.973 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:47.935+0000 7f990e0d8640 1 -- 172.21.15.83:0/1852544303 shutdown_connections 2024-09-21T01:40:47.973 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:47.935+0000 7f990e0d8640 1 --2- 172.21.15.83:0/1852544303 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9908108d20 0x7f990810f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:47.973 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:47.935+0000 7f990e0d8640 1 --2- 172.21.15.83:0/1852544303 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f99081083d0 0x7f99081087e0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:47.973 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:47.935+0000 7f990e0d8640 1 --2- 172.21.15.83:0/1852544303 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9908102ae0 0x7f9908102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:47.973 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:47.935+0000 7f990e0d8640 1 -- 172.21.15.83:0/1852544303 >> 172.21.15.83:0/1852544303 conn(0x7f9908079760 msgr2=0x7f9908079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:40:47.973 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:47.935+0000 7f990e0d8640 1 -- 172.21.15.83:0/1852544303 shutdown_connections 2024-09-21T01:40:47.973 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:47.935+0000 7f990e0d8640 1 -- 172.21.15.83:0/1852544303 wait complete. 2024-09-21T01:40:47.973 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:47.936+0000 7f990e0d8640 1 Processor -- start 2024-09-21T01:40:47.973 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:47.936+0000 7f990e0d8640 1 -- start start 2024-09-21T01:40:47.973 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:47.937+0000 7f990e0d8640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9908102ae0 0x7f990819a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:40:47.973 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:47.937+0000 7f990e0d8640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f99081083d0 0x7f990819a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:40:47.974 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:47.937+0000 7f990e0d8640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9908108d20 0x7f990819fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:40:47.974 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:47.937+0000 7f990e0d8640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f9908113980 con 0x7f9908108d20 2024-09-21T01:40:47.974 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:47.937+0000 7f990e0d8640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f9908113800 con 0x7f99081083d0 2024-09-21T01:40:47.974 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:47.937+0000 7f990e0d8640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f9908113b00 con 0x7f9908102ae0 2024-09-21T01:40:47.974 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:47.937+0000 7f9907fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9908108d20 0x7f990819fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:40:47.974 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:47.937+0000 7f9907fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9908108d20 0x7f990819fc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:48836/0 (socket says 172.21.15.83:48836) 2024-09-21T01:40:47.974 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:47.937+0000 7f9907fff640 1 -- 172.21.15.83:0/795457483 learned_addr learned my addr 172.21.15.83:0/795457483 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:40:47.974 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:47.937+0000 7f99077fe640 1 --2- 172.21.15.83:0/795457483 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9908102ae0 0x7f990819a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:40:47.974 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:47.937+0000 7f9906ffd640 1 --2- 172.21.15.83:0/795457483 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f99081083d0 0x7f990819a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:40:47.974 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:47.937+0000 7f9907fff640 1 -- 172.21.15.83:0/795457483 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9908102ae0 msgr2=0x7f990819a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:40:47.974 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:47.937+0000 7f9907fff640 1 --2- 172.21.15.83:0/795457483 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9908102ae0 0x7f990819a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:47.974 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:47.937+0000 7f9907fff640 1 -- 172.21.15.83:0/795457483 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f99081083d0 msgr2=0x7f990819a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:40:47.974 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:47.937+0000 7f9907fff640 1 --2- 172.21.15.83:0/795457483 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f99081083d0 0x7f990819a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:47.974 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:47.937+0000 7f9907fff640 1 -- 172.21.15.83:0/795457483 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99081a02c0 con 0x7f9908108d20 2024-09-21T01:40:47.974 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:47.937+0000 7f9907fff640 1 --2- 172.21.15.83:0/795457483 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9908108d20 0x7f990819fc50 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f990000cce0 tx=0x7f990000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:40:47.974 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:47.937+0000 7f9904ff9640 1 -- 172.21.15.83:0/795457483 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f990000f450 con 0x7f9908108d20 2024-09-21T01:40:47.975 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:47.937+0000 7f9904ff9640 1 -- 172.21.15.83:0/795457483 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f990000fa80 con 0x7f9908108d20 2024-09-21T01:40:47.975 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:47.937+0000 7f990e0d8640 1 -- 172.21.15.83:0/795457483 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99081a05b0 con 0x7f9908108d20 2024-09-21T01:40:47.975 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:47.937+0000 7f9904ff9640 1 -- 172.21.15.83:0/795457483 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9900018ad0 con 0x7f9908108d20 2024-09-21T01:40:47.975 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:47.938+0000 7f990e0d8640 1 -- 172.21.15.83:0/795457483 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99081a6dd0 con 0x7f9908108d20 2024-09-21T01:40:47.975 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:47.939+0000 7f990e0d8640 1 -- 172.21.15.83:0/795457483 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9908103d10 con 0x7f9908108d20 2024-09-21T01:40:47.975 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:47.941+0000 7f9904ff9640 1 -- 172.21.15.83:0/795457483 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7f990000f5f0 con 0x7f9908108d20 2024-09-21T01:40:47.975 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:47.942+0000 7f9904ff9640 1 --2- 172.21.15.83:0/795457483 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f98f00b6620 0x7f98f00b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:40:47.975 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:47.942+0000 7f99077fe640 1 --2- 172.21.15.83:0/795457483 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f98f00b6620 0x7f98f00b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:40:47.975 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:47.942+0000 7f9904ff9640 1 -- 172.21.15.83:0/795457483 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9286+0+0 (secure 0 0 0) 0x7f99000e8200 con 0x7f9908108d20 2024-09-21T01:40:47.975 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:47.942+0000 7f99077fe640 1 --2- 172.21.15.83:0/795457483 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f98f00b6620 0x7f98f00b8b30 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f98f8009890 tx=0x7f98f8008040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:40:47.975 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:47.945+0000 7f9904ff9640 1 -- 172.21.15.83:0/795457483 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f9900014030 con 0x7f9908108d20 2024-09-21T01:40:48.171 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:48.170+0000 7f990e0d8640 1 -- 172.21.15.83:0/795457483 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f9908102ef0 con 0x7f9908108d20 2024-09-21T01:40:48.172 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:40:47 smithi083 ceph-mon[31370]: pgmap v299: 129 pgs: 129 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 3.7 KiB/s wr, 3 op/s 2024-09-21T01:40:48.176 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:48.175+0000 7f9904ff9640 1 -- 172.21.15.83:0/795457483 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v21) ==== 74+0+296454 (secure 0 0 0) 0x7f9908102ef0 con 0x7f9908108d20 2024-09-21T01:40:48.179 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T01:40:48.181 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:48.178+0000 7f990e0d8640 1 -- 172.21.15.83:0/795457483 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f98f00b6620 msgr2=0x7f98f00b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:40:48.181 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:48.178+0000 7f990e0d8640 1 --2- 172.21.15.83:0/795457483 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f98f00b6620 0x7f98f00b8b30 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f98f8009890 tx=0x7f98f8008040 comp rx=0 tx=0).stop 2024-09-21T01:40:48.182 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:48.178+0000 7f990e0d8640 1 -- 172.21.15.83:0/795457483 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9908108d20 msgr2=0x7f990819fc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:40:48.182 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:48.178+0000 7f990e0d8640 1 --2- 172.21.15.83:0/795457483 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9908108d20 0x7f990819fc50 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f990000cce0 tx=0x7f990000a620 comp rx=0 tx=0).stop 2024-09-21T01:40:48.182 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:48.178+0000 7f990e0d8640 1 -- 172.21.15.83:0/795457483 shutdown_connections 2024-09-21T01:40:48.182 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:48.178+0000 7f990e0d8640 1 --2- 172.21.15.83:0/795457483 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f98f00b6620 0x7f98f00b8b30 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:48.182 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:48.178+0000 7f990e0d8640 1 --2- 172.21.15.83:0/795457483 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9908108d20 0x7f990819fc50 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:48.182 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:48.178+0000 7f990e0d8640 1 --2- 172.21.15.83:0/795457483 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f99081083d0 0x7f990819a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:48.182 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:48.178+0000 7f990e0d8640 1 --2- 172.21.15.83:0/795457483 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9908102ae0 0x7f990819a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:48.182 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:48.178+0000 7f990e0d8640 1 -- 172.21.15.83:0/795457483 >> 172.21.15.83:0/795457483 conn(0x7f9908079760 msgr2=0x7f9908105320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:40:48.182 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:48.178+0000 7f990e0d8640 1 -- 172.21.15.83:0/795457483 shutdown_connections 2024-09-21T01:40:48.182 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:48.178+0000 7f990e0d8640 1 -- 172.21.15.83:0/795457483 wait complete. 2024-09-21T01:40:48.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:40:47 smithi142 ceph-mon[34050]: pgmap v299: 129 pgs: 129 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 3.7 KiB/s wr, 3 op/s 2024-09-21T01:40:48.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:40:47 smithi119 ceph-mon[33693]: pgmap v299: 129 pgs: 129 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 3.7 KiB/s wr, 3 op/s 2024-09-21T01:40:48.891 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":21,"flags":0,"active_gid":14223,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":1748483157},{"type":"v1","addr":"172.21.15.83:6801","nonce":1748483157}]},"active_addr":"172.21.15.83:6801/1748483157","active_change":"2024-09-21T01:33:08.666649+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[{"gid":24133,"name":"z","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.8","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24140,"name":"y","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.8","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful","snap_schedule"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.8","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.83:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":5,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.83:0","nonce":4164563527}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.83:0","nonce":1520876042}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.83:0","nonce":3162415997}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.83:0","nonce":1946793512}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.83:0","nonce":2259221180}]}]} 2024-09-21T01:40:48.896 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-09-21T01:40:48.897 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-09-21T01:40:48.897 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T01:40:49.143 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:40:49.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:40:48 smithi142 ceph-mon[34050]: from='client.? 172.21.15.83:0/795457483' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2024-09-21T01:40:49.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:40:48 smithi119 ceph-mon[33693]: from='client.? 172.21.15.83:0/795457483' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2024-09-21T01:40:49.263 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:40:48 smithi083 ceph-mon[31370]: from='client.? 172.21.15.83:0/795457483' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2024-09-21T01:40:49.642 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:49.611+0000 7f4f8ac10640 1 -- 172.21.15.83:0/1388427057 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4f841094f0 msgr2=0x7f4f84109900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:40:49.643 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:49.611+0000 7f4f8ac10640 1 --2- 172.21.15.83:0/1388427057 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4f841094f0 0x7f4f84109900 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f4f70009900 tx=0x7f4f7002a410 comp rx=0 tx=0).stop 2024-09-21T01:40:49.643 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:49.611+0000 7f4f8ac10640 1 -- 172.21.15.83:0/1388427057 shutdown_connections 2024-09-21T01:40:49.643 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:49.611+0000 7f4f8ac10640 1 --2- 172.21.15.83:0/1388427057 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4f84109e40 0x7f4f84110670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:49.643 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:49.611+0000 7f4f8ac10640 1 --2- 172.21.15.83:0/1388427057 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4f841094f0 0x7f4f84109900 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:49.643 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:49.611+0000 7f4f8ac10640 1 --2- 172.21.15.83:0/1388427057 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4f84103bb0 0x7f4f84103fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:49.643 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:49.611+0000 7f4f8ac10640 1 -- 172.21.15.83:0/1388427057 >> 172.21.15.83:0/1388427057 conn(0x7f4f840ff600 msgr2=0x7f4f84101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:40:49.643 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:49.611+0000 7f4f8ac10640 1 -- 172.21.15.83:0/1388427057 shutdown_connections 2024-09-21T01:40:49.643 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:49.612+0000 7f4f8ac10640 1 -- 172.21.15.83:0/1388427057 wait complete. 2024-09-21T01:40:49.643 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:49.612+0000 7f4f8ac10640 1 Processor -- start 2024-09-21T01:40:49.643 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:49.612+0000 7f4f8ac10640 1 -- start start 2024-09-21T01:40:49.643 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:49.612+0000 7f4f8ac10640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4f84103bb0 0x7f4f8419a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:40:49.643 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:49.612+0000 7f4f8ac10640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4f841094f0 0x7f4f8419a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:40:49.643 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:49.612+0000 7f4f8ac10640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4f84109e40 0x7f4f8419fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:40:49.644 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:49.612+0000 7f4f8ac10640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f4f841139b0 con 0x7f4f841094f0 2024-09-21T01:40:49.644 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:49.612+0000 7f4f8ac10640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f4f84113830 con 0x7f4f84109e40 2024-09-21T01:40:49.644 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:49.612+0000 7f4f8ac10640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f4f84113b30 con 0x7f4f84103bb0 2024-09-21T01:40:49.644 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:49.613+0000 7f4f83fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4f841094f0 0x7f4f8419a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:40:49.644 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:49.613+0000 7f4f83fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4f841094f0 0x7f4f8419a9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:48860/0 (socket says 172.21.15.83:48860) 2024-09-21T01:40:49.644 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:49.613+0000 7f4f83fff640 1 -- 172.21.15.83:0/3086209364 learned_addr learned my addr 172.21.15.83:0/3086209364 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:40:49.644 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:49.613+0000 7f4f889ac640 1 --2- 172.21.15.83:0/3086209364 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4f84103bb0 0x7f4f8419a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:40:49.644 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:49.613+0000 7f4f83fff640 1 -- 172.21.15.83:0/3086209364 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4f84103bb0 msgr2=0x7f4f8419a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:40:49.644 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:49.613+0000 7f4f83fff640 1 --2- 172.21.15.83:0/3086209364 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4f84103bb0 0x7f4f8419a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:49.644 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:49.613+0000 7f4f83fff640 1 -- 172.21.15.83:0/3086209364 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4f84109e40 msgr2=0x7f4f8419fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:40:49.644 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:49.613+0000 7f4f891ad640 1 --2- 172.21.15.83:0/3086209364 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4f84109e40 0x7f4f8419fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:40:49.644 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:49.613+0000 7f4f83fff640 1 --2- 172.21.15.83:0/3086209364 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4f84109e40 0x7f4f8419fc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:49.644 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:49.613+0000 7f4f83fff640 1 -- 172.21.15.83:0/3086209364 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f841a03b0 con 0x7f4f841094f0 2024-09-21T01:40:49.645 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:49.613+0000 7f4f889ac640 1 --2- 172.21.15.83:0/3086209364 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4f84103bb0 0x7f4f8419a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:40:49.645 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:49.613+0000 7f4f83fff640 1 --2- 172.21.15.83:0/3086209364 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4f841094f0 0x7f4f8419a9e0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f4f70005940 tx=0x7f4f700040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:40:49.645 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:49.613+0000 7f4f81ffb640 1 -- 172.21.15.83:0/3086209364 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f7003f030 con 0x7f4f841094f0 2024-09-21T01:40:49.645 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:49.613+0000 7f4f8ac10640 1 -- 172.21.15.83:0/3086209364 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f841a0640 con 0x7f4f841094f0 2024-09-21T01:40:49.645 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:49.613+0000 7f4f81ffb640 1 -- 172.21.15.83:0/3086209364 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4f70003a80 con 0x7f4f841094f0 2024-09-21T01:40:49.645 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:49.613+0000 7f4f81ffb640 1 -- 172.21.15.83:0/3086209364 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f70035070 con 0x7f4f841094f0 2024-09-21T01:40:49.645 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:49.613+0000 7f4f8ac10640 1 -- 172.21.15.83:0/3086209364 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f841a6e00 con 0x7f4f841094f0 2024-09-21T01:40:49.645 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:49.614+0000 7f4f8ac10640 1 -- 172.21.15.83:0/3086209364 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f84103fc0 con 0x7f4f841094f0 2024-09-21T01:40:49.645 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:49.616+0000 7f4f81ffb640 1 -- 172.21.15.83:0/3086209364 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7f4f70042030 con 0x7f4f841094f0 2024-09-21T01:40:49.645 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:49.617+0000 7f4f81ffb640 1 --2- 172.21.15.83:0/3086209364 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f4f740b65f0 0x7f4f740b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:40:49.645 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:49.617+0000 7f4f889ac640 1 --2- 172.21.15.83:0/3086209364 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f4f740b65f0 0x7f4f740b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:40:49.645 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:49.617+0000 7f4f81ffb640 1 -- 172.21.15.83:0/3086209364 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9286+0+0 (secure 0 0 0) 0x7f4f70108350 con 0x7f4f841094f0 2024-09-21T01:40:49.645 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:49.617+0000 7f4f889ac640 1 --2- 172.21.15.83:0/3086209364 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f4f740b65f0 0x7f4f740b8b00 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f4f780058c0 tx=0x7f4f78005850 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:40:49.645 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:49.620+0000 7f4f81ffb640 1 -- 172.21.15.83:0/3086209364 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4f700ce660 con 0x7f4f841094f0 2024-09-21T01:40:49.801 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:49.800+0000 7f4f8ac10640 1 -- 172.21.15.83:0/3086209364 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4f8419b570 con 0x7f4f841094f0 2024-09-21T01:40:49.802 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:49.801+0000 7f4f81ffb640 1 -- 172.21.15.83:0/3086209364 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+25050 (secure 0 0 0) 0x7f4f700d2a40 con 0x7f4f841094f0 2024-09-21T01:40:49.803 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T01:40:49.803 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":82,"fsid":"f7697ecc-77b8-11ef-baf5-efdc52797490","created":"2024-09-21T01:31:22.250342+0000","modified":"2024-09-21T01:40:09.823827+0000","last_up_change":"2024-09-21T01:38:53.501659+0000","last_in_change":"2024-09-21T01:38:30.688516+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T01:35:06.977668+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T01:39:41.041950+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T01:39:42.882272+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T01:39:49.320532+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"66947512-01ee-4bf0-87b0-98a168cf50dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":3563457494},{"type":"v1","addr":"172.21.15.83:6803","nonce":3563457494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":3563457494},{"type":"v1","addr":"172.21.15.83:6805","nonce":3563457494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":3563457494},{"type":"v1","addr":"172.21.15.83:6809","nonce":3563457494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":3563457494},{"type":"v1","addr":"172.21.15.83:6807","nonce":3563457494}]},"public_addr":"172.21.15.83:6803/3563457494","cluster_addr":"172.21.15.83:6805/3563457494","heartbeat_back_addr":"172.21.15.83:6809/3563457494","heartbeat_front_addr":"172.21.15.83:6807/3563457494","state":["exists","up"]},{"osd":1,"uuid":"f7818a08-86a5-412d-a164-cfeb18f8650a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":2066870220},{"type":"v1","addr":"172.21.15.119:6801","nonce":2066870220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":2066870220},{"type":"v1","addr":"172.21.15.119:6803","nonce":2066870220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":2066870220},{"type":"v1","addr":"172.21.15.119:6807","nonce":2066870220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":2066870220},{"type":"v1","addr":"172.21.15.119:6805","nonce":2066870220}]},"public_addr":"172.21.15.119:6801/2066870220","cluster_addr":"172.21.15.119:6803/2066870220","heartbeat_back_addr":"172.21.15.119:6807/2066870220","heartbeat_front_addr":"172.21.15.119:6805/2066870220","state":["exists","up"]},{"osd":2,"uuid":"0d1a3870-c67a-4783-85f9-be2bb36f7722","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":3955936117},{"type":"v1","addr":"172.21.15.142:6801","nonce":3955936117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3955936117},{"type":"v1","addr":"172.21.15.142:6803","nonce":3955936117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":3955936117},{"type":"v1","addr":"172.21.15.142:6807","nonce":3955936117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":3955936117},{"type":"v1","addr":"172.21.15.142:6805","nonce":3955936117}]},"public_addr":"172.21.15.142:6801/3955936117","cluster_addr":"172.21.15.142:6803/3955936117","heartbeat_back_addr":"172.21.15.142:6807/3955936117","heartbeat_front_addr":"172.21.15.142:6805/3955936117","state":["exists","up"]},{"osd":3,"uuid":"a4cb1a36-3495-4d36-92da-ed3b6e852d14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":3746834093},{"type":"v1","addr":"172.21.15.83:6811","nonce":3746834093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":3746834093},{"type":"v1","addr":"172.21.15.83:6813","nonce":3746834093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":3746834093},{"type":"v1","addr":"172.21.15.83:6817","nonce":3746834093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":3746834093},{"type":"v1","addr":"172.21.15.83:6815","nonce":3746834093}]},"public_addr":"172.21.15.83:6811/3746834093","cluster_addr":"172.21.15.83:6813/3746834093","heartbeat_back_addr":"172.21.15.83:6817/3746834093","heartbeat_front_addr":"172.21.15.83:6815/3746834093","state":["exists","up"]},{"osd":4,"uuid":"d6f2ec78-7f08-473b-a96c-e8590f5d2f25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":3083907785},{"type":"v1","addr":"172.21.15.119:6809","nonce":3083907785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":3083907785},{"type":"v1","addr":"172.21.15.119:6811","nonce":3083907785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":3083907785},{"type":"v1","addr":"172.21.15.119:6815","nonce":3083907785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":3083907785},{"type":"v1","addr":"172.21.15.119:6813","nonce":3083907785}]},"public_addr":"172.21.15.119:6809/3083907785","cluster_addr":"172.21.15.119:6811/3083907785","heartbeat_back_addr":"172.21.15.119:6815/3083907785","heartbeat_front_addr":"172.21.15.119:6813/3083907785","state":["exists","up"]},{"osd":5,"uuid":"c571d04d-d3ea-4d74-8867-e4c7816f4e0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":349001002},{"type":"v1","addr":"172.21.15.142:6809","nonce":349001002}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":349001002},{"type":"v1","addr":"172.21.15.142:6811","nonce":349001002}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":349001002},{"type":"v1","addr":"172.21.15.142:6815","nonce":349001002}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":349001002},{"type":"v1","addr":"172.21.15.142:6813","nonce":349001002}]},"public_addr":"172.21.15.142:6809/349001002","cluster_addr":"172.21.15.142:6811/349001002","heartbeat_back_addr":"172.21.15.142:6815/349001002","heartbeat_front_addr":"172.21.15.142:6813/349001002","state":["exists","up"]},{"osd":6,"uuid":"6e1b6fe9-700a-448a-b382-59b97896ea7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":771651063},{"type":"v1","addr":"172.21.15.83:6819","nonce":771651063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":771651063},{"type":"v1","addr":"172.21.15.83:6821","nonce":771651063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":771651063},{"type":"v1","addr":"172.21.15.83:6825","nonce":771651063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":771651063},{"type":"v1","addr":"172.21.15.83:6823","nonce":771651063}]},"public_addr":"172.21.15.83:6819/771651063","cluster_addr":"172.21.15.83:6821/771651063","heartbeat_back_addr":"172.21.15.83:6825/771651063","heartbeat_front_addr":"172.21.15.83:6823/771651063","state":["exists","up"]},{"osd":7,"uuid":"283bfae4-5f50-4f9e-860e-bbfd47e005e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":1556984819},{"type":"v1","addr":"172.21.15.119:6817","nonce":1556984819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":1556984819},{"type":"v1","addr":"172.21.15.119:6819","nonce":1556984819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":1556984819},{"type":"v1","addr":"172.21.15.119:6823","nonce":1556984819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":1556984819},{"type":"v1","addr":"172.21.15.119:6821","nonce":1556984819}]},"public_addr":"172.21.15.119:6817/1556984819","cluster_addr":"172.21.15.119:6819/1556984819","heartbeat_back_addr":"172.21.15.119:6823/1556984819","heartbeat_front_addr":"172.21.15.119:6821/1556984819","state":["exists","up"]},{"osd":8,"uuid":"d46e56d4-ed4e-42c3-a315-66af014bd93a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":1860679473},{"type":"v1","addr":"172.21.15.142:6817","nonce":1860679473}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":1860679473},{"type":"v1","addr":"172.21.15.142:6819","nonce":1860679473}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":1860679473},{"type":"v1","addr":"172.21.15.142:6823","nonce":1860679473}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":1860679473},{"type":"v1","addr":"172.21.15.142:6821","nonce":1860679473}]},"public_addr":"172.21.15.142:6817/1860679473","cluster_addr":"172.21.15.142:6819/1860679473","heartbeat_back_addr":"172.21.15.142:6823/1860679473","heartbeat_front_addr":"172.21.15.142:6821/1860679473","state":["exists","up"]},{"osd":9,"uuid":"18a70ee6-56df-4f5c-868d-5db5e72a1859","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":3636757924},{"type":"v1","addr":"172.21.15.83:6827","nonce":3636757924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":3636757924},{"type":"v1","addr":"172.21.15.83:6829","nonce":3636757924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6832","nonce":3636757924},{"type":"v1","addr":"172.21.15.83:6833","nonce":3636757924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":3636757924},{"type":"v1","addr":"172.21.15.83:6831","nonce":3636757924}]},"public_addr":"172.21.15.83:6827/3636757924","cluster_addr":"172.21.15.83:6829/3636757924","heartbeat_back_addr":"172.21.15.83:6833/3636757924","heartbeat_front_addr":"172.21.15.83:6831/3636757924","state":["exists","up"]},{"osd":10,"uuid":"0d32c3de-db03-42c3-9914-07d675aaa339","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":2561963910},{"type":"v1","addr":"172.21.15.119:6825","nonce":2561963910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":2561963910},{"type":"v1","addr":"172.21.15.119:6827","nonce":2561963910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2561963910},{"type":"v1","addr":"172.21.15.119:6831","nonce":2561963910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2561963910},{"type":"v1","addr":"172.21.15.119:6829","nonce":2561963910}]},"public_addr":"172.21.15.119:6825/2561963910","cluster_addr":"172.21.15.119:6827/2561963910","heartbeat_back_addr":"172.21.15.119:6831/2561963910","heartbeat_front_addr":"172.21.15.119:6829/2561963910","state":["exists","up"]},{"osd":11,"uuid":"3a3b444d-b316-4256-bfad-378db29f0824","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":1174646198},{"type":"v1","addr":"172.21.15.142:6825","nonce":1174646198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":1174646198},{"type":"v1","addr":"172.21.15.142:6827","nonce":1174646198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1174646198},{"type":"v1","addr":"172.21.15.142:6831","nonce":1174646198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1174646198},{"type":"v1","addr":"172.21.15.142:6829","nonce":1174646198}]},"public_addr":"172.21.15.142:6825/1174646198","cluster_addr":"172.21.15.142:6827/1174646198","heartbeat_back_addr":"172.21.15.142:6831/1174646198","heartbeat_front_addr":"172.21.15.142:6829/1174646198","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:34:15.337672+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:34:39.259716+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:35:03.348886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:35:29.465711+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:35:53.744378+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:36:19.488785+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:36:45.708616+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:37:11.501065+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:37:36.027277+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:38:01.903625+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:38:27.215212+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:38:51.891278+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.e","mappings":[{"from":4,"to":8},{"from":5,"to":9}]},{"pgid":"3.11","mappings":[{"from":4,"to":6}]},{"pgid":"4.3","mappings":[{"from":5,"to":8}]},{"pgid":"4.10","mappings":[{"from":9,"to":8}]},{"pgid":"4.12","mappings":[{"from":9,"to":10}]},{"pgid":"4.1c","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.83:0/1619062496":"2024-09-22T01:33:08.666525+0000","172.21.15.83:0/2412709299":"2024-09-22T01:31:45.834450+0000","172.21.15.83:6800/4290325964":"2024-09-22T01:31:45.834450+0000","172.21.15.83:6801/4290325964":"2024-09-22T01:31:45.834450+0000","172.21.15.83:0/1440681183":"2024-09-22T01:31:45.834450+0000","172.21.15.83:0/2745413305":"2024-09-22T01:31:45.834450+0000","172.21.15.83:6800/1393748565":"2024-09-22T01:33:08.666525+0000","172.21.15.83:0/110411274":"2024-09-22T01:32:10.073024+0000","172.21.15.83:0/4267551123":"2024-09-22T01:33:08.666525+0000","172.21.15.83:0/1068434643":"2024-09-22T01:32:10.073024+0000","172.21.15.83:6800/2963261730":"2024-09-22T01:32:10.073024+0000","172.21.15.83:0/3544333975":"2024-09-22T01:32:10.073024+0000","172.21.15.83:6801/1393748565":"2024-09-22T01:33:08.666525+0000","172.21.15.83:6801/2963261730":"2024-09-22T01:32:10.073024+0000","172.21.15.83:0/1915285091":"2024-09-22T01:33:08.666525+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T01:40:49.806 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:49.803+0000 7f4f8ac10640 1 -- 172.21.15.83:0/3086209364 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f4f740b65f0 msgr2=0x7f4f740b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:40:49.806 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:49.803+0000 7f4f8ac10640 1 --2- 172.21.15.83:0/3086209364 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f4f740b65f0 0x7f4f740b8b00 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f4f780058c0 tx=0x7f4f78005850 comp rx=0 tx=0).stop 2024-09-21T01:40:49.806 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:49.803+0000 7f4f8ac10640 1 -- 172.21.15.83:0/3086209364 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4f841094f0 msgr2=0x7f4f8419a9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:40:49.806 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:49.803+0000 7f4f8ac10640 1 --2- 172.21.15.83:0/3086209364 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4f841094f0 0x7f4f8419a9e0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f4f70005940 tx=0x7f4f700040e0 comp rx=0 tx=0).stop 2024-09-21T01:40:49.806 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:49.803+0000 7f4f8ac10640 1 -- 172.21.15.83:0/3086209364 shutdown_connections 2024-09-21T01:40:49.806 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:49.803+0000 7f4f8ac10640 1 --2- 172.21.15.83:0/3086209364 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f4f740b65f0 0x7f4f740b8b00 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:49.806 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:49.803+0000 7f4f8ac10640 1 --2- 172.21.15.83:0/3086209364 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4f84109e40 0x7f4f8419fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:49.806 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:49.803+0000 7f4f8ac10640 1 --2- 172.21.15.83:0/3086209364 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4f841094f0 0x7f4f8419a9e0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:49.806 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:49.803+0000 7f4f8ac10640 1 --2- 172.21.15.83:0/3086209364 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4f84103bb0 0x7f4f8419a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:49.806 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:49.803+0000 7f4f8ac10640 1 -- 172.21.15.83:0/3086209364 >> 172.21.15.83:0/3086209364 conn(0x7f4f840ff600 msgr2=0x7f4f84101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:40:49.806 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:49.803+0000 7f4f8ac10640 1 -- 172.21.15.83:0/3086209364 shutdown_connections 2024-09-21T01:40:49.806 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:49.804+0000 7f4f8ac10640 1 -- 172.21.15.83:0/3086209364 wait complete. 2024-09-21T01:40:50.053 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:40:49 smithi083 ceph-mon[31370]: pgmap v300: 129 pgs: 129 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 3.6 KiB/s wr, 3 op/s 2024-09-21T01:40:50.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:40:49 smithi083 ceph-mon[31370]: from='client.? 172.21.15.83:0/3086209364' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T01:40:50.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:40:49 smithi142 ceph-mon[34050]: pgmap v300: 129 pgs: 129 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 3.6 KiB/s wr, 3 op/s 2024-09-21T01:40:50.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:40:49 smithi142 ceph-mon[34050]: from='client.? 172.21.15.83:0/3086209364' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T01:40:50.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:40:49 smithi119 ceph-mon[33693]: pgmap v300: 129 pgs: 129 active+clean; 639 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 3.6 KiB/s wr, 3 op/s 2024-09-21T01:40:50.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:40:49 smithi119 ceph-mon[33693]: from='client.? 172.21.15.83:0/3086209364' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T01:40:50.626 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-09-21T01:40:50.626 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T01:40:50.872 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:40:51.143 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:40:50 smithi083 ceph-mon[31370]: pgmap v301: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 4.0 KiB/s wr, 4 op/s 2024-09-21T01:40:51.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:40:50 smithi142 ceph-mon[34050]: pgmap v301: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 4.0 KiB/s wr, 4 op/s 2024-09-21T01:40:51.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:40:50 smithi119 ceph-mon[33693]: pgmap v301: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 4.0 KiB/s wr, 4 op/s 2024-09-21T01:40:51.367 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:51.355+0000 7f6604124640 1 -- 172.21.15.83:0/660546346 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f65fc1094f0 msgr2=0x7f65fc109900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:40:51.367 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:51.355+0000 7f6604124640 1 --2- 172.21.15.83:0/660546346 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f65fc1094f0 0x7f65fc109900 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f65ec009900 tx=0x7f65ec02a410 comp rx=0 tx=0).stop 2024-09-21T01:40:51.367 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:51.355+0000 7f6604124640 1 -- 172.21.15.83:0/660546346 shutdown_connections 2024-09-21T01:40:51.367 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:51.355+0000 7f6604124640 1 --2- 172.21.15.83:0/660546346 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f65fc109e40 0x7f65fc110670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:51.367 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:51.355+0000 7f6604124640 1 --2- 172.21.15.83:0/660546346 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f65fc1094f0 0x7f65fc109900 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:51.367 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:51.355+0000 7f6604124640 1 --2- 172.21.15.83:0/660546346 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f65fc103bb0 0x7f65fc103fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:51.367 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:51.355+0000 7f6604124640 1 -- 172.21.15.83:0/660546346 >> 172.21.15.83:0/660546346 conn(0x7f65fc0ff600 msgr2=0x7f65fc101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:40:51.367 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:51.356+0000 7f6604124640 1 -- 172.21.15.83:0/660546346 shutdown_connections 2024-09-21T01:40:51.367 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:51.356+0000 7f6604124640 1 -- 172.21.15.83:0/660546346 wait complete. 2024-09-21T01:40:51.367 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:51.356+0000 7f6604124640 1 Processor -- start 2024-09-21T01:40:51.367 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:51.356+0000 7f6604124640 1 -- start start 2024-09-21T01:40:51.367 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:51.357+0000 7f6604124640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f65fc103bb0 0x7f65fc19a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:40:51.368 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:51.357+0000 7f6604124640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f65fc1094f0 0x7f65fc19a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:40:51.368 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:51.357+0000 7f6604124640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f65fc109e40 0x7f65fc19fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:40:51.368 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:51.357+0000 7f6604124640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f65fc1139b0 con 0x7f65fc103bb0 2024-09-21T01:40:51.368 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:51.357+0000 7f6604124640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f65fc113830 con 0x7f65fc109e40 2024-09-21T01:40:51.368 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:51.357+0000 7f6604124640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f65fc113b30 con 0x7f65fc1094f0 2024-09-21T01:40:51.368 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:51.357+0000 7f6601ec0640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f65fc103bb0 0x7f65fc19a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:40:51.368 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:51.357+0000 7f6601ec0640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f65fc103bb0 0x7f65fc19a440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:48892/0 (socket says 172.21.15.83:48892) 2024-09-21T01:40:51.368 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:51.357+0000 7f6601ec0640 1 -- 172.21.15.83:0/2850281884 learned_addr learned my addr 172.21.15.83:0/2850281884 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:40:51.368 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:51.357+0000 7f66026c1640 1 --2- 172.21.15.83:0/2850281884 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f65fc109e40 0x7f65fc19fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:40:51.368 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:51.357+0000 7f66016bf640 1 --2- 172.21.15.83:0/2850281884 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f65fc1094f0 0x7f65fc19a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:40:51.369 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:51.357+0000 7f6601ec0640 1 -- 172.21.15.83:0/2850281884 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f65fc1094f0 msgr2=0x7f65fc19a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:40:51.369 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:51.357+0000 7f6601ec0640 1 --2- 172.21.15.83:0/2850281884 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f65fc1094f0 0x7f65fc19a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:51.369 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:51.357+0000 7f6601ec0640 1 -- 172.21.15.83:0/2850281884 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f65fc109e40 msgr2=0x7f65fc19fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:40:51.369 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:51.357+0000 7f6601ec0640 1 --2- 172.21.15.83:0/2850281884 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f65fc109e40 0x7f65fc19fc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:51.369 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:51.357+0000 7f6601ec0640 1 -- 172.21.15.83:0/2850281884 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65fc1a02f0 con 0x7f65fc103bb0 2024-09-21T01:40:51.369 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:51.357+0000 7f66016bf640 1 --2- 172.21.15.83:0/2850281884 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f65fc1094f0 0x7f65fc19a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:40:51.369 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:51.357+0000 7f6601ec0640 1 --2- 172.21.15.83:0/2850281884 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f65fc103bb0 0x7f65fc19a440 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f65f800d950 tx=0x7f65f800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:40:51.369 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:51.358+0000 7f65f2ffd640 1 -- 172.21.15.83:0/2850281884 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65f8017070 con 0x7f65fc103bb0 2024-09-21T01:40:51.369 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:51.358+0000 7f65f2ffd640 1 -- 172.21.15.83:0/2850281884 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f65f8009c30 con 0x7f65fc103bb0 2024-09-21T01:40:51.369 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:51.358+0000 7f6604124640 1 -- 172.21.15.83:0/2850281884 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65fc1a05e0 con 0x7f65fc103bb0 2024-09-21T01:40:51.369 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:51.358+0000 7f65f2ffd640 1 -- 172.21.15.83:0/2850281884 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65f800f620 con 0x7f65fc103bb0 2024-09-21T01:40:51.369 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:51.358+0000 7f6604124640 1 -- 172.21.15.83:0/2850281884 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65fc1a6e00 con 0x7f65fc103bb0 2024-09-21T01:40:51.369 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:51.359+0000 7f6604124640 1 -- 172.21.15.83:0/2850281884 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65fc103fc0 con 0x7f65fc103bb0 2024-09-21T01:40:51.369 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:51.360+0000 7f65f2ffd640 1 -- 172.21.15.83:0/2850281884 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7f65f8010460 con 0x7f65fc103bb0 2024-09-21T01:40:51.370 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:51.361+0000 7f65f2ffd640 1 --2- 172.21.15.83:0/2850281884 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f65e80b6620 0x7f65e80b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:40:51.370 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:51.361+0000 7f66016bf640 1 --2- 172.21.15.83:0/2850281884 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f65e80b6620 0x7f65e80b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:40:51.370 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:51.361+0000 7f65f2ffd640 1 -- 172.21.15.83:0/2850281884 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9286+0+0 (secure 0 0 0) 0x7f65f80e7540 con 0x7f65fc103bb0 2024-09-21T01:40:51.370 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:51.361+0000 7f66016bf640 1 --2- 172.21.15.83:0/2850281884 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f65e80b6620 0x7f65e80b8b30 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f65ec0057c0 tx=0x7f65ec009680 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:40:51.370 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:51.365+0000 7f65f2ffd640 1 -- 172.21.15.83:0/2850281884 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f65f80ad850 con 0x7f65fc103bb0 2024-09-21T01:40:51.544 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:51.544+0000 7f6604124640 1 -- 172.21.15.83:0/2850281884 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f65fc10bc40 con 0x7f65fc103bb0 2024-09-21T01:40:51.546 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:51.545+0000 7f65f2ffd640 1 -- 172.21.15.83:0/2850281884 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+25050 (secure 0 0 0) 0x7f65f80b1c30 con 0x7f65fc103bb0 2024-09-21T01:40:51.546 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T01:40:51.546 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":82,"fsid":"f7697ecc-77b8-11ef-baf5-efdc52797490","created":"2024-09-21T01:31:22.250342+0000","modified":"2024-09-21T01:40:09.823827+0000","last_up_change":"2024-09-21T01:38:53.501659+0000","last_in_change":"2024-09-21T01:38:30.688516+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T01:35:06.977668+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T01:39:41.041950+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T01:39:42.882272+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T01:39:49.320532+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"66947512-01ee-4bf0-87b0-98a168cf50dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":3563457494},{"type":"v1","addr":"172.21.15.83:6803","nonce":3563457494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":3563457494},{"type":"v1","addr":"172.21.15.83:6805","nonce":3563457494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":3563457494},{"type":"v1","addr":"172.21.15.83:6809","nonce":3563457494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":3563457494},{"type":"v1","addr":"172.21.15.83:6807","nonce":3563457494}]},"public_addr":"172.21.15.83:6803/3563457494","cluster_addr":"172.21.15.83:6805/3563457494","heartbeat_back_addr":"172.21.15.83:6809/3563457494","heartbeat_front_addr":"172.21.15.83:6807/3563457494","state":["exists","up"]},{"osd":1,"uuid":"f7818a08-86a5-412d-a164-cfeb18f8650a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":2066870220},{"type":"v1","addr":"172.21.15.119:6801","nonce":2066870220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":2066870220},{"type":"v1","addr":"172.21.15.119:6803","nonce":2066870220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":2066870220},{"type":"v1","addr":"172.21.15.119:6807","nonce":2066870220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":2066870220},{"type":"v1","addr":"172.21.15.119:6805","nonce":2066870220}]},"public_addr":"172.21.15.119:6801/2066870220","cluster_addr":"172.21.15.119:6803/2066870220","heartbeat_back_addr":"172.21.15.119:6807/2066870220","heartbeat_front_addr":"172.21.15.119:6805/2066870220","state":["exists","up"]},{"osd":2,"uuid":"0d1a3870-c67a-4783-85f9-be2bb36f7722","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":3955936117},{"type":"v1","addr":"172.21.15.142:6801","nonce":3955936117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3955936117},{"type":"v1","addr":"172.21.15.142:6803","nonce":3955936117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":3955936117},{"type":"v1","addr":"172.21.15.142:6807","nonce":3955936117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":3955936117},{"type":"v1","addr":"172.21.15.142:6805","nonce":3955936117}]},"public_addr":"172.21.15.142:6801/3955936117","cluster_addr":"172.21.15.142:6803/3955936117","heartbeat_back_addr":"172.21.15.142:6807/3955936117","heartbeat_front_addr":"172.21.15.142:6805/3955936117","state":["exists","up"]},{"osd":3,"uuid":"a4cb1a36-3495-4d36-92da-ed3b6e852d14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":3746834093},{"type":"v1","addr":"172.21.15.83:6811","nonce":3746834093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":3746834093},{"type":"v1","addr":"172.21.15.83:6813","nonce":3746834093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":3746834093},{"type":"v1","addr":"172.21.15.83:6817","nonce":3746834093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":3746834093},{"type":"v1","addr":"172.21.15.83:6815","nonce":3746834093}]},"public_addr":"172.21.15.83:6811/3746834093","cluster_addr":"172.21.15.83:6813/3746834093","heartbeat_back_addr":"172.21.15.83:6817/3746834093","heartbeat_front_addr":"172.21.15.83:6815/3746834093","state":["exists","up"]},{"osd":4,"uuid":"d6f2ec78-7f08-473b-a96c-e8590f5d2f25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":3083907785},{"type":"v1","addr":"172.21.15.119:6809","nonce":3083907785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":3083907785},{"type":"v1","addr":"172.21.15.119:6811","nonce":3083907785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":3083907785},{"type":"v1","addr":"172.21.15.119:6815","nonce":3083907785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":3083907785},{"type":"v1","addr":"172.21.15.119:6813","nonce":3083907785}]},"public_addr":"172.21.15.119:6809/3083907785","cluster_addr":"172.21.15.119:6811/3083907785","heartbeat_back_addr":"172.21.15.119:6815/3083907785","heartbeat_front_addr":"172.21.15.119:6813/3083907785","state":["exists","up"]},{"osd":5,"uuid":"c571d04d-d3ea-4d74-8867-e4c7816f4e0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":349001002},{"type":"v1","addr":"172.21.15.142:6809","nonce":349001002}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":349001002},{"type":"v1","addr":"172.21.15.142:6811","nonce":349001002}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":349001002},{"type":"v1","addr":"172.21.15.142:6815","nonce":349001002}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":349001002},{"type":"v1","addr":"172.21.15.142:6813","nonce":349001002}]},"public_addr":"172.21.15.142:6809/349001002","cluster_addr":"172.21.15.142:6811/349001002","heartbeat_back_addr":"172.21.15.142:6815/349001002","heartbeat_front_addr":"172.21.15.142:6813/349001002","state":["exists","up"]},{"osd":6,"uuid":"6e1b6fe9-700a-448a-b382-59b97896ea7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":771651063},{"type":"v1","addr":"172.21.15.83:6819","nonce":771651063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":771651063},{"type":"v1","addr":"172.21.15.83:6821","nonce":771651063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":771651063},{"type":"v1","addr":"172.21.15.83:6825","nonce":771651063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":771651063},{"type":"v1","addr":"172.21.15.83:6823","nonce":771651063}]},"public_addr":"172.21.15.83:6819/771651063","cluster_addr":"172.21.15.83:6821/771651063","heartbeat_back_addr":"172.21.15.83:6825/771651063","heartbeat_front_addr":"172.21.15.83:6823/771651063","state":["exists","up"]},{"osd":7,"uuid":"283bfae4-5f50-4f9e-860e-bbfd47e005e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":1556984819},{"type":"v1","addr":"172.21.15.119:6817","nonce":1556984819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":1556984819},{"type":"v1","addr":"172.21.15.119:6819","nonce":1556984819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":1556984819},{"type":"v1","addr":"172.21.15.119:6823","nonce":1556984819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":1556984819},{"type":"v1","addr":"172.21.15.119:6821","nonce":1556984819}]},"public_addr":"172.21.15.119:6817/1556984819","cluster_addr":"172.21.15.119:6819/1556984819","heartbeat_back_addr":"172.21.15.119:6823/1556984819","heartbeat_front_addr":"172.21.15.119:6821/1556984819","state":["exists","up"]},{"osd":8,"uuid":"d46e56d4-ed4e-42c3-a315-66af014bd93a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":1860679473},{"type":"v1","addr":"172.21.15.142:6817","nonce":1860679473}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":1860679473},{"type":"v1","addr":"172.21.15.142:6819","nonce":1860679473}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":1860679473},{"type":"v1","addr":"172.21.15.142:6823","nonce":1860679473}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":1860679473},{"type":"v1","addr":"172.21.15.142:6821","nonce":1860679473}]},"public_addr":"172.21.15.142:6817/1860679473","cluster_addr":"172.21.15.142:6819/1860679473","heartbeat_back_addr":"172.21.15.142:6823/1860679473","heartbeat_front_addr":"172.21.15.142:6821/1860679473","state":["exists","up"]},{"osd":9,"uuid":"18a70ee6-56df-4f5c-868d-5db5e72a1859","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":3636757924},{"type":"v1","addr":"172.21.15.83:6827","nonce":3636757924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":3636757924},{"type":"v1","addr":"172.21.15.83:6829","nonce":3636757924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6832","nonce":3636757924},{"type":"v1","addr":"172.21.15.83:6833","nonce":3636757924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":3636757924},{"type":"v1","addr":"172.21.15.83:6831","nonce":3636757924}]},"public_addr":"172.21.15.83:6827/3636757924","cluster_addr":"172.21.15.83:6829/3636757924","heartbeat_back_addr":"172.21.15.83:6833/3636757924","heartbeat_front_addr":"172.21.15.83:6831/3636757924","state":["exists","up"]},{"osd":10,"uuid":"0d32c3de-db03-42c3-9914-07d675aaa339","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":2561963910},{"type":"v1","addr":"172.21.15.119:6825","nonce":2561963910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":2561963910},{"type":"v1","addr":"172.21.15.119:6827","nonce":2561963910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2561963910},{"type":"v1","addr":"172.21.15.119:6831","nonce":2561963910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2561963910},{"type":"v1","addr":"172.21.15.119:6829","nonce":2561963910}]},"public_addr":"172.21.15.119:6825/2561963910","cluster_addr":"172.21.15.119:6827/2561963910","heartbeat_back_addr":"172.21.15.119:6831/2561963910","heartbeat_front_addr":"172.21.15.119:6829/2561963910","state":["exists","up"]},{"osd":11,"uuid":"3a3b444d-b316-4256-bfad-378db29f0824","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":1174646198},{"type":"v1","addr":"172.21.15.142:6825","nonce":1174646198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":1174646198},{"type":"v1","addr":"172.21.15.142:6827","nonce":1174646198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1174646198},{"type":"v1","addr":"172.21.15.142:6831","nonce":1174646198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1174646198},{"type":"v1","addr":"172.21.15.142:6829","nonce":1174646198}]},"public_addr":"172.21.15.142:6825/1174646198","cluster_addr":"172.21.15.142:6827/1174646198","heartbeat_back_addr":"172.21.15.142:6831/1174646198","heartbeat_front_addr":"172.21.15.142:6829/1174646198","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:34:15.337672+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:34:39.259716+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:35:03.348886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:35:29.465711+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:35:53.744378+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:36:19.488785+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:36:45.708616+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:37:11.501065+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:37:36.027277+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:38:01.903625+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:38:27.215212+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:38:51.891278+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.e","mappings":[{"from":4,"to":8},{"from":5,"to":9}]},{"pgid":"3.11","mappings":[{"from":4,"to":6}]},{"pgid":"4.3","mappings":[{"from":5,"to":8}]},{"pgid":"4.10","mappings":[{"from":9,"to":8}]},{"pgid":"4.12","mappings":[{"from":9,"to":10}]},{"pgid":"4.1c","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.83:0/1619062496":"2024-09-22T01:33:08.666525+0000","172.21.15.83:0/2412709299":"2024-09-22T01:31:45.834450+0000","172.21.15.83:6800/4290325964":"2024-09-22T01:31:45.834450+0000","172.21.15.83:6801/4290325964":"2024-09-22T01:31:45.834450+0000","172.21.15.83:0/1440681183":"2024-09-22T01:31:45.834450+0000","172.21.15.83:0/2745413305":"2024-09-22T01:31:45.834450+0000","172.21.15.83:6800/1393748565":"2024-09-22T01:33:08.666525+0000","172.21.15.83:0/110411274":"2024-09-22T01:32:10.073024+0000","172.21.15.83:0/4267551123":"2024-09-22T01:33:08.666525+0000","172.21.15.83:0/1068434643":"2024-09-22T01:32:10.073024+0000","172.21.15.83:6800/2963261730":"2024-09-22T01:32:10.073024+0000","172.21.15.83:0/3544333975":"2024-09-22T01:32:10.073024+0000","172.21.15.83:6801/1393748565":"2024-09-22T01:33:08.666525+0000","172.21.15.83:6801/2963261730":"2024-09-22T01:32:10.073024+0000","172.21.15.83:0/1915285091":"2024-09-22T01:33:08.666525+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T01:40:51.548 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:51.548+0000 7f6604124640 1 -- 172.21.15.83:0/2850281884 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f65e80b6620 msgr2=0x7f65e80b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:40:51.548 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:51.548+0000 7f6604124640 1 --2- 172.21.15.83:0/2850281884 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f65e80b6620 0x7f65e80b8b30 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f65ec0057c0 tx=0x7f65ec009680 comp rx=0 tx=0).stop 2024-09-21T01:40:51.548 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:51.548+0000 7f6604124640 1 -- 172.21.15.83:0/2850281884 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f65fc103bb0 msgr2=0x7f65fc19a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:40:51.548 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:51.548+0000 7f6604124640 1 --2- 172.21.15.83:0/2850281884 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f65fc103bb0 0x7f65fc19a440 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f65f800d950 tx=0x7f65f800de10 comp rx=0 tx=0).stop 2024-09-21T01:40:51.549 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:51.548+0000 7f6604124640 1 -- 172.21.15.83:0/2850281884 shutdown_connections 2024-09-21T01:40:51.549 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:51.548+0000 7f6604124640 1 --2- 172.21.15.83:0/2850281884 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f65e80b6620 0x7f65e80b8b30 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:51.549 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:51.548+0000 7f6604124640 1 --2- 172.21.15.83:0/2850281884 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f65fc109e40 0x7f65fc19fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:51.549 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:51.548+0000 7f6604124640 1 --2- 172.21.15.83:0/2850281884 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f65fc1094f0 0x7f65fc19a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:51.549 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:51.548+0000 7f6604124640 1 --2- 172.21.15.83:0/2850281884 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f65fc103bb0 0x7f65fc19a440 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:51.549 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:51.548+0000 7f6604124640 1 -- 172.21.15.83:0/2850281884 >> 172.21.15.83:0/2850281884 conn(0x7f65fc0ff600 msgr2=0x7f65fc101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:40:51.549 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:51.548+0000 7f6604124640 1 -- 172.21.15.83:0/2850281884 shutdown_connections 2024-09-21T01:40:51.549 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:51.548+0000 7f6604124640 1 -- 172.21.15.83:0/2850281884 wait complete. 2024-09-21T01:40:52.205 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:40:51 smithi083 ceph-mon[31370]: from='client.? 172.21.15.83:0/2850281884' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T01:40:52.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:40:51 smithi142 ceph-mon[34050]: from='client.? 172.21.15.83:0/2850281884' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T01:40:52.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:40:51 smithi119 ceph-mon[33693]: from='client.? 172.21.15.83:0/2850281884' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T01:40:52.236 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph tell osd.0 flush_pg_stats 2024-09-21T01:40:52.236 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph tell osd.1 flush_pg_stats 2024-09-21T01:40:52.237 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph tell osd.2 flush_pg_stats 2024-09-21T01:40:52.237 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph tell osd.3 flush_pg_stats 2024-09-21T01:40:52.238 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph tell osd.4 flush_pg_stats 2024-09-21T01:40:52.238 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph tell osd.5 flush_pg_stats 2024-09-21T01:40:52.238 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph tell osd.6 flush_pg_stats 2024-09-21T01:40:52.239 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph tell osd.7 flush_pg_stats 2024-09-21T01:40:52.239 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph tell osd.8 flush_pg_stats 2024-09-21T01:40:52.239 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph tell osd.9 flush_pg_stats 2024-09-21T01:40:52.240 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph tell osd.10 flush_pg_stats 2024-09-21T01:40:52.240 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph tell osd.11 flush_pg_stats 2024-09-21T01:40:52.975 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:40:52.990 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:40:53.138 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:40:52 smithi083 ceph-mon[31370]: pgmap v302: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 1.5 KiB/s wr, 2 op/s 2024-09-21T01:40:53.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:40:52 smithi142 ceph-mon[34050]: pgmap v302: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 1.5 KiB/s wr, 2 op/s 2024-09-21T01:40:53.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:40:52 smithi119 ceph-mon[33693]: pgmap v302: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 1.5 KiB/s wr, 2 op/s 2024-09-21T01:40:53.367 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:40:53.693 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:53.685+0000 7f2b0cb06640 1 -- 172.21.15.83:0/2284749536 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2b08108cf0 msgr2=0x7f2b0810f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:40:53.693 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:53.685+0000 7f2b0cb06640 1 --2- 172.21.15.83:0/2284749536 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2b08108cf0 0x7f2b0810f520 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f2b00009ca0 tx=0x7f2b0002a8c0 comp rx=0 tx=0).stop 2024-09-21T01:40:53.694 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:53.686+0000 7f2b0cb06640 1 -- 172.21.15.83:0/2284749536 shutdown_connections 2024-09-21T01:40:53.694 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:53.686+0000 7f2b0cb06640 1 --2- 172.21.15.83:0/2284749536 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2b08108cf0 0x7f2b0810f520 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:53.694 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:53.686+0000 7f2b0cb06640 1 --2- 172.21.15.83:0/2284749536 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2b081083a0 0x7f2b081087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:53.694 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:53.686+0000 7f2b0cb06640 1 --2- 172.21.15.83:0/2284749536 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2b08102a60 0x7f2b08102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:53.694 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:53.686+0000 7f2b0cb06640 1 -- 172.21.15.83:0/2284749536 >> 172.21.15.83:0/2284749536 conn(0x7f2b08079730 msgr2=0x7f2b08079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:40:53.694 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:53.686+0000 7f2b0cb06640 1 -- 172.21.15.83:0/2284749536 shutdown_connections 2024-09-21T01:40:53.694 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:53.686+0000 7f2b0cb06640 1 -- 172.21.15.83:0/2284749536 wait complete. 2024-09-21T01:40:53.694 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:53.686+0000 7f2b0cb06640 1 Processor -- start 2024-09-21T01:40:53.694 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:53.686+0000 7f2b0cb06640 1 -- start start 2024-09-21T01:40:53.694 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:53.687+0000 7f2b0cb06640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2b08102a60 0x7f2b0819a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:40:53.694 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:53.687+0000 7f2b0cb06640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2b081083a0 0x7f2b0819a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:40:53.694 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:53.687+0000 7f2b0cb06640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2b08108cf0 0x7f2b0819fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:40:53.694 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:53.687+0000 7f2b0cb06640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f2b08113960 con 0x7f2b081083a0 2024-09-21T01:40:53.694 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:53.687+0000 7f2b0cb06640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f2b081137e0 con 0x7f2b08108cf0 2024-09-21T01:40:53.695 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:53.687+0000 7f2b0cb06640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f2b08113ae0 con 0x7f2b08102a60 2024-09-21T01:40:53.695 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:53.687+0000 7f2b05d9b640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2b081083a0 0x7f2b0819a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:40:53.695 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:53.687+0000 7f2b05d9b640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2b081083a0 0x7f2b0819a970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:57964/0 (socket says 172.21.15.83:57964) 2024-09-21T01:40:53.695 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:53.687+0000 7f2b05d9b640 1 -- 172.21.15.83:0/4187921337 learned_addr learned my addr 172.21.15.83:0/4187921337 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:40:53.695 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:53.687+0000 7f2b0659c640 1 --2- 172.21.15.83:0/4187921337 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2b08102a60 0x7f2b0819a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:40:53.695 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:53.687+0000 7f2b06d9d640 1 --2- 172.21.15.83:0/4187921337 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2b08108cf0 0x7f2b0819fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:40:53.695 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:53.687+0000 7f2b05d9b640 1 -- 172.21.15.83:0/4187921337 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2b08102a60 msgr2=0x7f2b0819a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:40:53.695 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:53.687+0000 7f2b05d9b640 1 --2- 172.21.15.83:0/4187921337 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2b08102a60 0x7f2b0819a3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:53.695 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:53.687+0000 7f2b05d9b640 1 -- 172.21.15.83:0/4187921337 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2b08108cf0 msgr2=0x7f2b0819fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:40:53.695 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:53.687+0000 7f2b05d9b640 1 --2- 172.21.15.83:0/4187921337 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2b08108cf0 0x7f2b0819fc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:53.695 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:53.687+0000 7f2b05d9b640 1 -- 172.21.15.83:0/4187921337 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b081a0280 con 0x7f2b081083a0 2024-09-21T01:40:53.695 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:53.687+0000 7f2b06d9d640 1 --2- 172.21.15.83:0/4187921337 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2b08108cf0 0x7f2b0819fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:40:53.695 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:53.687+0000 7f2b0659c640 1 --2- 172.21.15.83:0/4187921337 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2b08102a60 0x7f2b0819a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:40:53.695 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:53.687+0000 7f2b05d9b640 1 --2- 172.21.15.83:0/4187921337 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2b081083a0 0x7f2b0819a970 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f2afc00d770 tx=0x7f2afc00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:40:53.695 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:53.688+0000 7f2af77fe640 1 -- 172.21.15.83:0/4187921337 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2afc017070 con 0x7f2b081083a0 2024-09-21T01:40:53.696 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:53.688+0000 7f2b0cb06640 1 -- 172.21.15.83:0/4187921337 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b081a0570 con 0x7f2b081083a0 2024-09-21T01:40:53.696 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:53.688+0000 7f2af77fe640 1 -- 172.21.15.83:0/4187921337 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2afc009c30 con 0x7f2b081083a0 2024-09-21T01:40:53.696 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:53.688+0000 7f2af77fe640 1 -- 172.21.15.83:0/4187921337 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2afc00f620 con 0x7f2b081083a0 2024-09-21T01:40:53.696 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:53.688+0000 7f2b0cb06640 1 -- 172.21.15.83:0/4187921337 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b081a6d90 con 0x7f2b081083a0 2024-09-21T01:40:53.696 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:53.689+0000 7f2b0cb06640 1 -- 172.21.15.83:0/4187921337 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2b08063ad0 con 0x7f2b081083a0 2024-09-21T01:40:53.696 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:53.690+0000 7f2af77fe640 1 -- 172.21.15.83:0/4187921337 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7f2afc01a070 con 0x7f2b081083a0 2024-09-21T01:40:53.696 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:53.691+0000 7f2af77fe640 1 --2- 172.21.15.83:0/4187921337 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f2af00b6620 0x7f2af00b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:40:53.696 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:53.691+0000 7f2b0659c640 1 --2- 172.21.15.83:0/4187921337 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f2af00b6620 0x7f2af00b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:40:53.696 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:53.691+0000 7f2af77fe640 1 -- 172.21.15.83:0/4187921337 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9286+0+0 (secure 0 0 0) 0x7f2afc0e7820 con 0x7f2b081083a0 2024-09-21T01:40:53.696 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:53.692+0000 7f2af77fe640 1 --2- 172.21.15.83:0/4187921337 >> [v2:172.21.15.142:6800/3955936117,v1:172.21.15.142:6801/3955936117] conn(0x7f2af00c1930 0x7f2af00c3e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:40:53.696 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:53.692+0000 7f2af77fe640 1 -- 172.21.15.83:0/4187921337 --> [v2:172.21.15.142:6800/3955936117,v1:172.21.15.142:6801/3955936117] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2afc01fe50 con 0x7f2af00c1930 2024-09-21T01:40:53.696 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:53.692+0000 7f2af77fe640 1 -- 172.21.15.83:0/4187921337 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f2afc0e7c70 con 0x7f2b081083a0 2024-09-21T01:40:53.696 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:53.692+0000 7f2b0659c640 1 --2- 172.21.15.83:0/4187921337 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f2af00b6620 0x7f2af00b8b30 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f2af800abe0 tx=0x7f2af800a5c0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:40:53.696 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:53.692+0000 7f2b06d9d640 1 --2- 172.21.15.83:0/4187921337 >> [v2:172.21.15.142:6800/3955936117,v1:172.21.15.142:6801/3955936117] conn(0x7f2af00c1930 0x7f2af00c3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:40:53.696 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:53.692+0000 7f2b06d9d640 1 --2- 172.21.15.83:0/4187921337 >> [v2:172.21.15.142:6800/3955936117,v1:172.21.15.142:6801/3955936117] conn(0x7f2af00c1930 0x7f2af00c3e20 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:40:53.697 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:53.693+0000 7f2af77fe640 1 -- 172.21.15.83:0/4187921337 <== osd.2 v2:172.21.15.142:6800/3955936117 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f2afc01fe50 con 0x7f2af00c1930 2024-09-21T01:40:53.711 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:40:53.711 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:40:53.713 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:53.712+0000 7f2b0cb06640 1 -- 172.21.15.83:0/4187921337 --> [v2:172.21.15.142:6800/3955936117,v1:172.21.15.142:6801/3955936117] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f2b08063f50 con 0x7f2af00c1930 2024-09-21T01:40:53.714 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:40:53.716 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:40:53.716 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:40:53.716 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:53.715+0000 7f2af77fe640 1 -- 172.21.15.83:0/4187921337 <== osd.2 v2:172.21.15.142:6800/3955936117 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f2b08063f50 con 0x7f2af00c1930 2024-09-21T01:40:53.719 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:53.718+0000 7f2b0cb06640 1 -- 172.21.15.83:0/4187921337 >> [v2:172.21.15.142:6800/3955936117,v1:172.21.15.142:6801/3955936117] conn(0x7f2af00c1930 msgr2=0x7f2af00c3e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:40:53.719 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:53.718+0000 7f2b0cb06640 1 --2- 172.21.15.83:0/4187921337 >> [v2:172.21.15.142:6800/3955936117,v1:172.21.15.142:6801/3955936117] conn(0x7f2af00c1930 0x7f2af00c3e20 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:53.719 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:53.718+0000 7f2b0cb06640 1 -- 172.21.15.83:0/4187921337 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f2af00b6620 msgr2=0x7f2af00b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:40:53.719 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:53.718+0000 7f2b0cb06640 1 --2- 172.21.15.83:0/4187921337 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f2af00b6620 0x7f2af00b8b30 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f2af800abe0 tx=0x7f2af800a5c0 comp rx=0 tx=0).stop 2024-09-21T01:40:53.719 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:53.718+0000 7f2b0cb06640 1 -- 172.21.15.83:0/4187921337 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2b081083a0 msgr2=0x7f2b0819a970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:40:53.719 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:53.718+0000 7f2b0cb06640 1 --2- 172.21.15.83:0/4187921337 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2b081083a0 0x7f2b0819a970 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f2afc00d770 tx=0x7f2afc00dc30 comp rx=0 tx=0).stop 2024-09-21T01:40:53.719 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:40:53.720 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:53.718+0000 7f2b06d9d640 1 -- 172.21.15.83:0/4187921337 reap_dead start 2024-09-21T01:40:53.720 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:53.719+0000 7f2b0cb06640 1 -- 172.21.15.83:0/4187921337 shutdown_connections 2024-09-21T01:40:53.720 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:53.719+0000 7f2b0cb06640 1 -- 172.21.15.83:0/4187921337 >> 172.21.15.83:0/4187921337 conn(0x7f2b08079730 msgr2=0x7f2b08104410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:40:53.720 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:53.719+0000 7f2b0cb06640 1 -- 172.21.15.83:0/4187921337 shutdown_connections 2024-09-21T01:40:53.720 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:53.719+0000 7f2b0cb06640 1 -- 172.21.15.83:0/4187921337 wait complete. 2024-09-21T01:40:53.729 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:40:54.704 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:54.701+0000 7fdfd1eac640 1 -- 172.21.15.83:0/3421160205 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdfcc109560 msgr2=0x7fdfcc109970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:40:54.704 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:54.701+0000 7fdfd1eac640 1 --2- 172.21.15.83:0/3421160205 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdfcc109560 0x7fdfcc109970 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fdfc0009900 tx=0x7fdfc002a3f0 comp rx=0 tx=0).stop 2024-09-21T01:40:54.704 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:54.701+0000 7fdfd1eac640 1 -- 172.21.15.83:0/3421160205 shutdown_connections 2024-09-21T01:40:54.704 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:54.701+0000 7fdfd1eac640 1 --2- 172.21.15.83:0/3421160205 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdfcc109eb0 0x7fdfcc1106e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:54.705 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:54.701+0000 7fdfd1eac640 1 --2- 172.21.15.83:0/3421160205 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdfcc109560 0x7fdfcc109970 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:54.705 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:54.701+0000 7fdfd1eac640 1 --2- 172.21.15.83:0/3421160205 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdfcc102080 0x7fdfcc102490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:54.705 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:54.701+0000 7fdfd1eac640 1 -- 172.21.15.83:0/3421160205 >> 172.21.15.83:0/3421160205 conn(0x7fdfcc079ec0 msgr2=0x7fdfcc07a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:40:54.705 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:54.701+0000 7fdfd1eac640 1 -- 172.21.15.83:0/3421160205 shutdown_connections 2024-09-21T01:40:54.705 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:54.701+0000 7fdfd1eac640 1 -- 172.21.15.83:0/3421160205 wait complete. 2024-09-21T01:40:54.705 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:54.702+0000 7fdfd1eac640 1 Processor -- start 2024-09-21T01:40:54.705 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:54.702+0000 7fdfd1eac640 1 -- start start 2024-09-21T01:40:54.705 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:54.702+0000 7fdfd1eac640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdfcc102080 0x7fdfcc103020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:40:54.705 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:54.702+0000 7fdfd1eac640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdfcc109560 0x7fdfcc103560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:40:54.705 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:54.703+0000 7fdfd1eac640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdfcc109eb0 0x7fdfcc103aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:40:54.705 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:54.703+0000 7fdfd1eac640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fdfcc113a20 con 0x7fdfcc109560 2024-09-21T01:40:54.705 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:54.703+0000 7fdfd1eac640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fdfcc1138a0 con 0x7fdfcc109eb0 2024-09-21T01:40:54.705 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:54.703+0000 7fdfd1eac640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fdfcc113ba0 con 0x7fdfcc102080 2024-09-21T01:40:54.705 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:54.703+0000 7fdfcaffd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdfcc109560 0x7fdfcc103560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:40:54.706 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:54.703+0000 7fdfcaffd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdfcc109560 0x7fdfcc103560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:57980/0 (socket says 172.21.15.83:57980) 2024-09-21T01:40:54.706 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:54.703+0000 7fdfcaffd640 1 -- 172.21.15.83:0/4203548139 learned_addr learned my addr 172.21.15.83:0/4203548139 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:40:54.706 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:54.703+0000 7fdfcb7fe640 1 --2- 172.21.15.83:0/4203548139 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdfcc102080 0x7fdfcc103020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:40:54.706 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:54.703+0000 7fdfcbfff640 1 --2- 172.21.15.83:0/4203548139 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdfcc109eb0 0x7fdfcc103aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:40:54.706 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:54.703+0000 7fdfcaffd640 1 -- 172.21.15.83:0/4203548139 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdfcc102080 msgr2=0x7fdfcc103020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:40:54.706 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:54.703+0000 7fdfcaffd640 1 --2- 172.21.15.83:0/4203548139 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdfcc102080 0x7fdfcc103020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:54.706 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:54.703+0000 7fdfcaffd640 1 -- 172.21.15.83:0/4203548139 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdfcc109eb0 msgr2=0x7fdfcc103aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:40:54.706 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:54.703+0000 7fdfcaffd640 1 --2- 172.21.15.83:0/4203548139 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdfcc109eb0 0x7fdfcc103aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:54.706 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:54.703+0000 7fdfcaffd640 1 -- 172.21.15.83:0/4203548139 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfcc1a8680 con 0x7fdfcc109560 2024-09-21T01:40:54.706 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:54.703+0000 7fdfcbfff640 1 --2- 172.21.15.83:0/4203548139 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdfcc109eb0 0x7fdfcc103aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:40:54.706 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:54.703+0000 7fdfcaffd640 1 --2- 172.21.15.83:0/4203548139 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdfcc109560 0x7fdfcc103560 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fdfc0005940 tx=0x7fdfc00040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:40:54.706 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:54.703+0000 7fdfc8ff9640 1 -- 172.21.15.83:0/4203548139 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfc003f030 con 0x7fdfcc109560 2024-09-21T01:40:54.706 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:54.703+0000 7fdfd1eac640 1 -- 172.21.15.83:0/4203548139 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdfcc1a8910 con 0x7fdfcc109560 2024-09-21T01:40:54.706 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:54.704+0000 7fdfc8ff9640 1 -- 172.21.15.83:0/4203548139 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdfc0003a80 con 0x7fdfcc109560 2024-09-21T01:40:54.707 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:54.704+0000 7fdfd1eac640 1 -- 172.21.15.83:0/4203548139 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdfcc1a8e40 con 0x7fdfcc109560 2024-09-21T01:40:54.707 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:54.704+0000 7fdfc8ff9640 1 -- 172.21.15.83:0/4203548139 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfc0035070 con 0x7fdfcc109560 2024-09-21T01:40:54.708 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:54.704+0000 7fdfd1eac640 1 -- 172.21.15.83:0/4203548139 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fdfcc063ad0 con 0x7fdfcc109560 2024-09-21T01:40:54.708 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:54.706+0000 7fdfc8ff9640 1 -- 172.21.15.83:0/4203548139 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7fdfc0042030 con 0x7fdfcc109560 2024-09-21T01:40:54.708 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:54.707+0000 7fdfc8ff9640 1 --2- 172.21.15.83:0/4203548139 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fdfb40b65f0 0x7fdfb40b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:40:54.708 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:54.707+0000 7fdfcb7fe640 1 --2- 172.21.15.83:0/4203548139 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fdfb40b65f0 0x7fdfb40b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:40:54.708 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:54.707+0000 7fdfc8ff9640 1 -- 172.21.15.83:0/4203548139 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9286+0+0 (secure 0 0 0) 0x7fdfc01082d0 con 0x7fdfcc109560 2024-09-21T01:40:54.708 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:54.707+0000 7fdfc8ff9640 1 --2- 172.21.15.83:0/4203548139 >> [v2:172.21.15.142:6808/349001002,v1:172.21.15.142:6809/349001002] conn(0x7fdfb40c1900 0x7fdfb40c3df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:40:54.708 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:54.707+0000 7fdfc8ff9640 1 -- 172.21.15.83:0/4203548139 --> [v2:172.21.15.142:6808/349001002,v1:172.21.15.142:6809/349001002] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdfc004fe50 con 0x7fdfb40c1900 2024-09-21T01:40:54.708 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:54.707+0000 7fdfc8ff9640 1 -- 172.21.15.83:0/4203548139 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7fdfc0108720 con 0x7fdfcc109560 2024-09-21T01:40:54.708 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:54.707+0000 7fdfcb7fe640 1 --2- 172.21.15.83:0/4203548139 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fdfb40b65f0 0x7fdfb40b8b00 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fdfcc104a70 tx=0x7fdfbc00b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:40:54.708 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:54.707+0000 7fdfcbfff640 1 --2- 172.21.15.83:0/4203548139 >> [v2:172.21.15.142:6808/349001002,v1:172.21.15.142:6809/349001002] conn(0x7fdfb40c1900 0x7fdfb40c3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:40:54.709 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:54.708+0000 7fdfcbfff640 1 --2- 172.21.15.83:0/4203548139 >> [v2:172.21.15.142:6808/349001002,v1:172.21.15.142:6809/349001002] conn(0x7fdfb40c1900 0x7fdfb40c3df0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:40:54.709 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:54.709+0000 7fdfc8ff9640 1 -- 172.21.15.83:0/4203548139 <== osd.5 v2:172.21.15.142:6808/349001002 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fdfc004fe50 con 0x7fdfb40c1900 2024-09-21T01:40:54.722 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:54.722+0000 7fdfd1eac640 1 -- 172.21.15.83:0/4203548139 --> [v2:172.21.15.142:6808/349001002,v1:172.21.15.142:6809/349001002] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fdfcc063ed0 con 0x7fdfb40c1900 2024-09-21T01:40:54.723 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:54.723+0000 7fdfc8ff9640 1 -- 172.21.15.83:0/4203548139 <== osd.5 v2:172.21.15.142:6808/349001002 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fdfcc063ed0 con 0x7fdfb40c1900 2024-09-21T01:40:54.724 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:54.723+0000 7fdfd1eac640 1 -- 172.21.15.83:0/4203548139 >> [v2:172.21.15.142:6808/349001002,v1:172.21.15.142:6809/349001002] conn(0x7fdfb40c1900 msgr2=0x7fdfb40c3df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:40:54.724 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:54.723+0000 7fdfd1eac640 1 --2- 172.21.15.83:0/4203548139 >> [v2:172.21.15.142:6808/349001002,v1:172.21.15.142:6809/349001002] conn(0x7fdfb40c1900 0x7fdfb40c3df0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:54.724 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:54.723+0000 7fdfd1eac640 1 -- 172.21.15.83:0/4203548139 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fdfb40b65f0 msgr2=0x7fdfb40b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:40:54.724 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:54.723+0000 7fdfd1eac640 1 --2- 172.21.15.83:0/4203548139 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fdfb40b65f0 0x7fdfb40b8b00 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fdfcc104a70 tx=0x7fdfbc00b390 comp rx=0 tx=0).stop 2024-09-21T01:40:54.724 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:54.723+0000 7fdfd1eac640 1 -- 172.21.15.83:0/4203548139 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdfcc109560 msgr2=0x7fdfcc103560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:40:54.724 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:54.723+0000 7fdfd1eac640 1 --2- 172.21.15.83:0/4203548139 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdfcc109560 0x7fdfcc103560 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fdfc0005940 tx=0x7fdfc00040e0 comp rx=0 tx=0).stop 2024-09-21T01:40:54.724 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:54.723+0000 7fdfcbfff640 1 -- 172.21.15.83:0/4203548139 reap_dead start 2024-09-21T01:40:54.724 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:54.723+0000 7fdfd1eac640 1 -- 172.21.15.83:0/4203548139 shutdown_connections 2024-09-21T01:40:54.725 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:54.723+0000 7fdfd1eac640 1 -- 172.21.15.83:0/4203548139 >> 172.21.15.83:0/4203548139 conn(0x7fdfcc079ec0 msgr2=0x7fdfcc105690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:40:54.725 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:54.723+0000 7fdfd1eac640 1 -- 172.21.15.83:0/4203548139 shutdown_connections 2024-09-21T01:40:54.725 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:54.723+0000 7fdfd1eac640 1 -- 172.21.15.83:0/4203548139 wait complete. 2024-09-21T01:40:55.346 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:55.317+0000 7f3833a33640 1 -- 172.21.15.83:0/1256769916 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f382c104840 msgr2=0x7f382c104c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:40:55.346 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:55.317+0000 7f3833a33640 1 --2- 172.21.15.83:0/1256769916 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f382c104840 0x7f382c104c50 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f3828009900 tx=0x7f382802a410 comp rx=0 tx=0).stop 2024-09-21T01:40:55.346 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:55.317+0000 7f3833a33640 1 -- 172.21.15.83:0/1256769916 shutdown_connections 2024-09-21T01:40:55.346 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:55.317+0000 7f3833a33640 1 --2- 172.21.15.83:0/1256769916 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f382c10ddf0 0x7f382c110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:55.346 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:55.317+0000 7f3833a33640 1 --2- 172.21.15.83:0/1256769916 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f382c105270 0x7f382c10d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:55.346 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:55.317+0000 7f3833a33640 1 --2- 172.21.15.83:0/1256769916 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f382c104840 0x7f382c104c50 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:55.346 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:55.317+0000 7f3833a33640 1 -- 172.21.15.83:0/1256769916 >> 172.21.15.83:0/1256769916 conn(0x7f382c079730 msgr2=0x7f382c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:40:55.346 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:55.317+0000 7f3833a33640 1 -- 172.21.15.83:0/1256769916 shutdown_connections 2024-09-21T01:40:55.346 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:55.317+0000 7f3833a33640 1 -- 172.21.15.83:0/1256769916 wait complete. 2024-09-21T01:40:55.346 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:55.317+0000 7f3833a33640 1 Processor -- start 2024-09-21T01:40:55.346 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:55.318+0000 7f3833a33640 1 -- start start 2024-09-21T01:40:55.346 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:55.318+0000 7f3833a33640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f382c104840 0x7f382c19a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:40:55.346 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:55.318+0000 7f3833a33640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f382c105270 0x7f382c19aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:40:55.346 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:55.318+0000 7f3833a33640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f382c10ddf0 0x7f382c19fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:40:55.347 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:55.318+0000 7f3833a33640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f382c1139c0 con 0x7f382c104840 2024-09-21T01:40:55.347 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:55.318+0000 7f3833a33640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f382c113840 con 0x7f382c105270 2024-09-21T01:40:55.347 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:55.318+0000 7f3833a33640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f382c113b40 con 0x7f382c10ddf0 2024-09-21T01:40:55.347 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:55.318+0000 7f38317cf640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f382c104840 0x7f382c19a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:40:55.347 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:55.318+0000 7f38317cf640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f382c104840 0x7f382c19a4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:57994/0 (socket says 172.21.15.83:57994) 2024-09-21T01:40:55.347 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:55.318+0000 7f38317cf640 1 -- 172.21.15.83:0/2227775654 learned_addr learned my addr 172.21.15.83:0/2227775654 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:40:55.347 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:55.318+0000 7f3831fd0640 1 --2- 172.21.15.83:0/2227775654 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f382c10ddf0 0x7f382c19fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:40:55.347 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:55.318+0000 7f3830fce640 1 --2- 172.21.15.83:0/2227775654 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f382c105270 0x7f382c19aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:40:55.347 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:55.318+0000 7f38317cf640 1 -- 172.21.15.83:0/2227775654 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f382c10ddf0 msgr2=0x7f382c19fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:40:55.347 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:55.318+0000 7f38317cf640 1 --2- 172.21.15.83:0/2227775654 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f382c10ddf0 0x7f382c19fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:55.347 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:55.318+0000 7f38317cf640 1 -- 172.21.15.83:0/2227775654 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f382c105270 msgr2=0x7f382c19aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:40:55.347 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:55.318+0000 7f38317cf640 1 --2- 172.21.15.83:0/2227775654 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f382c105270 0x7f382c19aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:55.348 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:55.318+0000 7f38317cf640 1 -- 172.21.15.83:0/2227775654 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f382c1a0420 con 0x7f382c104840 2024-09-21T01:40:55.348 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:55.318+0000 7f3830fce640 1 --2- 172.21.15.83:0/2227775654 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f382c105270 0x7f382c19aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:40:55.348 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:55.319+0000 7f38317cf640 1 --2- 172.21.15.83:0/2227775654 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f382c104840 0x7f382c19a4b0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f3828005940 tx=0x7f38280042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:40:55.348 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:55.319+0000 7f38227fc640 1 -- 172.21.15.83:0/2227775654 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f382803f030 con 0x7f382c104840 2024-09-21T01:40:55.348 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:55.319+0000 7f3833a33640 1 -- 172.21.15.83:0/2227775654 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f382c1a06b0 con 0x7f382c104840 2024-09-21T01:40:55.348 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:55.319+0000 7f38227fc640 1 -- 172.21.15.83:0/2227775654 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3828003c90 con 0x7f382c104840 2024-09-21T01:40:55.348 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:55.319+0000 7f38227fc640 1 -- 172.21.15.83:0/2227775654 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3828035070 con 0x7f382c104840 2024-09-21T01:40:55.348 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:55.319+0000 7f3833a33640 1 -- 172.21.15.83:0/2227775654 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f382c1a6e70 con 0x7f382c104840 2024-09-21T01:40:55.348 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:55.319+0000 7f3833a33640 1 -- 172.21.15.83:0/2227775654 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f382c063ad0 con 0x7f382c104840 2024-09-21T01:40:55.348 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:55.321+0000 7f38227fc640 1 -- 172.21.15.83:0/2227775654 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7f3828042030 con 0x7f382c104840 2024-09-21T01:40:55.348 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:55.322+0000 7f38227fc640 1 --2- 172.21.15.83:0/2227775654 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f38180b65f0 0x7f38180b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:40:55.348 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:55.322+0000 7f3830fce640 1 --2- 172.21.15.83:0/2227775654 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f38180b65f0 0x7f38180b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:40:55.348 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:55.322+0000 7f38227fc640 1 -- 172.21.15.83:0/2227775654 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9286+0+0 (secure 0 0 0) 0x7f38281083e0 con 0x7f382c104840 2024-09-21T01:40:55.348 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:55.323+0000 7f38227fc640 1 --2- 172.21.15.83:0/2227775654 >> [v2:172.21.15.119:6824/2561963910,v1:172.21.15.119:6825/2561963910] conn(0x7f38180c1900 0x7f38180c3df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:40:55.349 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:55.323+0000 7f38227fc640 1 -- 172.21.15.83:0/2227775654 --> [v2:172.21.15.119:6824/2561963910,v1:172.21.15.119:6825/2561963910] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f38180c44c0 con 0x7f38180c1900 2024-09-21T01:40:55.349 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:55.323+0000 7f38227fc640 1 -- 172.21.15.83:0/2227775654 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f3828108830 con 0x7f382c104840 2024-09-21T01:40:55.349 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:55.323+0000 7f3830fce640 1 --2- 172.21.15.83:0/2227775654 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f38180b65f0 0x7f38180b8b00 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f382c07a0b0 tx=0x7f381c005d30 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:40:55.349 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:55.323+0000 7f3831fd0640 1 --2- 172.21.15.83:0/2227775654 >> [v2:172.21.15.119:6824/2561963910,v1:172.21.15.119:6825/2561963910] conn(0x7f38180c1900 0x7f38180c3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:40:55.349 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:55.323+0000 7f3831fd0640 1 --2- 172.21.15.83:0/2227775654 >> [v2:172.21.15.119:6824/2561963910,v1:172.21.15.119:6825/2561963910] conn(0x7f38180c1900 0x7f38180c3df0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:40:55.349 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:55.324+0000 7f38227fc640 1 -- 172.21.15.83:0/2227775654 <== osd.10 v2:172.21.15.119:6824/2561963910 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f38180c44c0 con 0x7f38180c1900 2024-09-21T01:40:55.349 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:55.339+0000 7f3833a33640 1 -- 172.21.15.83:0/2227775654 --> [v2:172.21.15.119:6824/2561963910,v1:172.21.15.119:6825/2561963910] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f382c063f00 con 0x7f38180c1900 2024-09-21T01:40:55.349 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:55.339+0000 7f38227fc640 1 -- 172.21.15.83:0/2227775654 <== osd.10 v2:172.21.15.119:6824/2561963910 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f382c063f00 con 0x7f38180c1900 2024-09-21T01:40:55.349 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:55.340+0000 7f3833a33640 1 -- 172.21.15.83:0/2227775654 >> [v2:172.21.15.119:6824/2561963910,v1:172.21.15.119:6825/2561963910] conn(0x7f38180c1900 msgr2=0x7f38180c3df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:40:55.349 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:55.340+0000 7f3833a33640 1 --2- 172.21.15.83:0/2227775654 >> [v2:172.21.15.119:6824/2561963910,v1:172.21.15.119:6825/2561963910] conn(0x7f38180c1900 0x7f38180c3df0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:55.349 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:55.340+0000 7f3833a33640 1 -- 172.21.15.83:0/2227775654 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f38180b65f0 msgr2=0x7f38180b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:40:55.349 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:55.340+0000 7f3833a33640 1 --2- 172.21.15.83:0/2227775654 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f38180b65f0 0x7f38180b8b00 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f382c07a0b0 tx=0x7f381c005d30 comp rx=0 tx=0).stop 2024-09-21T01:40:55.349 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:55.340+0000 7f3833a33640 1 -- 172.21.15.83:0/2227775654 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f382c104840 msgr2=0x7f382c19a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:40:55.349 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:55.340+0000 7f3833a33640 1 --2- 172.21.15.83:0/2227775654 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f382c104840 0x7f382c19a4b0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f3828005940 tx=0x7f38280042f0 comp rx=0 tx=0).stop 2024-09-21T01:40:55.349 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:55.340+0000 7f3831fd0640 1 -- 172.21.15.83:0/2227775654 reap_dead start 2024-09-21T01:40:55.350 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:55.340+0000 7f3833a33640 1 -- 172.21.15.83:0/2227775654 shutdown_connections 2024-09-21T01:40:55.350 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:55.340+0000 7f3833a33640 1 -- 172.21.15.83:0/2227775654 >> 172.21.15.83:0/2227775654 conn(0x7f382c079730 msgr2=0x7f382c0ff790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:40:55.350 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:55.340+0000 7f3833a33640 1 -- 172.21.15.83:0/2227775654 shutdown_connections 2024-09-21T01:40:55.350 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:55.340+0000 7f3833a33640 1 -- 172.21.15.83:0/2227775654 wait complete. 2024-09-21T01:40:55.958 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:40:55 smithi083 ceph-mon[31370]: pgmap v303: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 1.5 KiB/s wr, 3 op/s 2024-09-21T01:40:56.058 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:56.046+0000 7f06cc83c640 1 -- 172.21.15.83:0/240141610 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f06c8108d70 msgr2=0x7f06c810f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:40:56.058 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:56.046+0000 7f06cc83c640 1 --2- 172.21.15.83:0/240141610 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f06c8108d70 0x7f06c810f5a0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f06c0009ca0 tx=0x7f06c002a8c0 comp rx=0 tx=0).stop 2024-09-21T01:40:56.058 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:56.046+0000 7f06cc83c640 1 -- 172.21.15.83:0/240141610 shutdown_connections 2024-09-21T01:40:56.058 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:56.046+0000 7f06cc83c640 1 --2- 172.21.15.83:0/240141610 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f06c8108d70 0x7f06c810f5a0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:56.059 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:56.046+0000 7f06cc83c640 1 --2- 172.21.15.83:0/240141610 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f06c8108420 0x7f06c8108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:56.059 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:56.046+0000 7f06cc83c640 1 --2- 172.21.15.83:0/240141610 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f06c8102ae0 0x7f06c8102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:56.059 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:56.046+0000 7f06cc83c640 1 -- 172.21.15.83:0/240141610 >> 172.21.15.83:0/240141610 conn(0x7f06c80796b0 msgr2=0x7f06c8079ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:40:56.059 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:56.046+0000 7f06cc83c640 1 -- 172.21.15.83:0/240141610 shutdown_connections 2024-09-21T01:40:56.059 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:56.046+0000 7f06cc83c640 1 -- 172.21.15.83:0/240141610 wait complete. 2024-09-21T01:40:56.059 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:56.047+0000 7f06cc83c640 1 Processor -- start 2024-09-21T01:40:56.059 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:56.047+0000 7f06cc83c640 1 -- start start 2024-09-21T01:40:56.059 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:56.048+0000 7f06cc83c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f06c8102ae0 0x7f06c819a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:40:56.059 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:56.048+0000 7f06cc83c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f06c8108420 0x7f06c819a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:40:56.059 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:56.048+0000 7f06cc83c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f06c8108d70 0x7f06c819fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:40:56.059 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:56.048+0000 7f06cc83c640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f06c8112930 con 0x7f06c8108d70 2024-09-21T01:40:56.059 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:56.048+0000 7f06cc83c640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f06c81127b0 con 0x7f06c8108420 2024-09-21T01:40:56.059 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:56.048+0000 7f06cc83c640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f06c8112ab0 con 0x7f06c8102ae0 2024-09-21T01:40:56.060 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:56.048+0000 7f06c6d9d640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f06c8108d70 0x7f06c819fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:40:56.060 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:56.048+0000 7f06c6d9d640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f06c8108d70 0x7f06c819fc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:58014/0 (socket says 172.21.15.83:58014) 2024-09-21T01:40:56.060 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:56.048+0000 7f06c6d9d640 1 -- 172.21.15.83:0/183123175 learned_addr learned my addr 172.21.15.83:0/183123175 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:40:56.060 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:56.048+0000 7f06c659c640 1 --2- 172.21.15.83:0/183123175 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f06c8102ae0 0x7f06c819a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:40:56.060 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:56.048+0000 7f06c5d9b640 1 --2- 172.21.15.83:0/183123175 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f06c8108420 0x7f06c819a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:40:56.060 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:56.048+0000 7f06c6d9d640 1 -- 172.21.15.83:0/183123175 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f06c8102ae0 msgr2=0x7f06c819a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:40:56.060 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:56.048+0000 7f06c6d9d640 1 --2- 172.21.15.83:0/183123175 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f06c8102ae0 0x7f06c819a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:56.060 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:56.048+0000 7f06c6d9d640 1 -- 172.21.15.83:0/183123175 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f06c8108420 msgr2=0x7f06c819a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:40:56.060 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:56.048+0000 7f06c6d9d640 1 --2- 172.21.15.83:0/183123175 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f06c8108420 0x7f06c819a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:56.060 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:56.048+0000 7f06c6d9d640 1 -- 172.21.15.83:0/183123175 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06c81a02e0 con 0x7f06c8108d70 2024-09-21T01:40:56.060 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:56.048+0000 7f06c6d9d640 1 --2- 172.21.15.83:0/183123175 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f06c8108d70 0x7f06c819fc70 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f06c0005cc0 tx=0x7f06c0032c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:40:56.060 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:56.049+0000 7f06bf7fe640 1 -- 172.21.15.83:0/183123175 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06c0004040 con 0x7f06c8108d70 2024-09-21T01:40:56.060 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:56.049+0000 7f06bf7fe640 1 -- 172.21.15.83:0/183123175 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f06c0004670 con 0x7f06c8108d70 2024-09-21T01:40:56.060 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:56.049+0000 7f06cc83c640 1 -- 172.21.15.83:0/183123175 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06c81a0570 con 0x7f06c8108d70 2024-09-21T01:40:56.060 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:56.049+0000 7f06bf7fe640 1 -- 172.21.15.83:0/183123175 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06c0030cc0 con 0x7f06c8108d70 2024-09-21T01:40:56.061 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:56.049+0000 7f06cc83c640 1 -- 172.21.15.83:0/183123175 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06c81a0ab0 con 0x7f06c8108d70 2024-09-21T01:40:56.061 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:56.049+0000 7f06cc83c640 1 -- 172.21.15.83:0/183123175 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f06c8063ad0 con 0x7f06c8108d70 2024-09-21T01:40:56.061 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:56.051+0000 7f06bf7fe640 1 -- 172.21.15.83:0/183123175 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7f06c00041e0 con 0x7f06c8108d70 2024-09-21T01:40:56.061 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:56.052+0000 7f06bf7fe640 1 --2- 172.21.15.83:0/183123175 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f06b40b6620 0x7f06b40b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:40:56.061 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:56.052+0000 7f06c659c640 1 --2- 172.21.15.83:0/183123175 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f06b40b6620 0x7f06b40b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:40:56.061 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:56.052+0000 7f06bf7fe640 1 -- 172.21.15.83:0/183123175 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9286+0+0 (secure 0 0 0) 0x7f06c0108fe0 con 0x7f06c8108d70 2024-09-21T01:40:56.061 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:56.052+0000 7f06bf7fe640 1 --2- 172.21.15.83:0/183123175 >> [v2:172.21.15.83:6826/3636757924,v1:172.21.15.83:6827/3636757924] conn(0x7f06b40c1930 0x7f06b40c3e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:40:56.061 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:56.052+0000 7f06bf7fe640 1 -- 172.21.15.83:0/183123175 --> [v2:172.21.15.83:6826/3636757924,v1:172.21.15.83:6827/3636757924] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f06b40c44f0 con 0x7f06b40c1930 2024-09-21T01:40:56.061 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:56.052+0000 7f06bf7fe640 1 -- 172.21.15.83:0/183123175 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f06c0109430 con 0x7f06c8108d70 2024-09-21T01:40:56.061 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:56.052+0000 7f06c5d9b640 1 --2- 172.21.15.83:0/183123175 >> [v2:172.21.15.83:6826/3636757924,v1:172.21.15.83:6827/3636757924] conn(0x7f06b40c1930 0x7f06b40c3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:40:56.061 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:56.052+0000 7f06c659c640 1 --2- 172.21.15.83:0/183123175 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f06b40b6620 0x7f06b40b8b30 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f06b800abe0 tx=0x7f06b800a2d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:40:56.061 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:56.053+0000 7f06c5d9b640 1 --2- 172.21.15.83:0/183123175 >> [v2:172.21.15.83:6826/3636757924,v1:172.21.15.83:6827/3636757924] conn(0x7f06b40c1930 0x7f06b40c3e20 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:40:56.061 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:56.053+0000 7f06bf7fe640 1 -- 172.21.15.83:0/183123175 <== osd.9 v2:172.21.15.83:6826/3636757924 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f06b40c44f0 con 0x7f06b40c1930 2024-09-21T01:40:56.067 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:56.067+0000 7f06cc83c640 1 -- 172.21.15.83:0/183123175 --> [v2:172.21.15.83:6826/3636757924,v1:172.21.15.83:6827/3636757924] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f06c8063f50 con 0x7f06b40c1930 2024-09-21T01:40:56.067 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:56.067+0000 7f06bf7fe640 1 -- 172.21.15.83:0/183123175 <== osd.9 v2:172.21.15.83:6826/3636757924 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f06c8063f50 con 0x7f06b40c1930 2024-09-21T01:40:56.068 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:56.067+0000 7f06cc83c640 1 -- 172.21.15.83:0/183123175 >> [v2:172.21.15.83:6826/3636757924,v1:172.21.15.83:6827/3636757924] conn(0x7f06b40c1930 msgr2=0x7f06b40c3e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:40:56.068 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:56.067+0000 7f06cc83c640 1 --2- 172.21.15.83:0/183123175 >> [v2:172.21.15.83:6826/3636757924,v1:172.21.15.83:6827/3636757924] conn(0x7f06b40c1930 0x7f06b40c3e20 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:56.068 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:56.067+0000 7f06cc83c640 1 -- 172.21.15.83:0/183123175 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f06b40b6620 msgr2=0x7f06b40b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:40:56.068 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:56.067+0000 7f06cc83c640 1 --2- 172.21.15.83:0/183123175 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f06b40b6620 0x7f06b40b8b30 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f06b800abe0 tx=0x7f06b800a2d0 comp rx=0 tx=0).stop 2024-09-21T01:40:56.069 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:56.067+0000 7f06cc83c640 1 -- 172.21.15.83:0/183123175 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f06c8108d70 msgr2=0x7f06c819fc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:40:56.069 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:56.067+0000 7f06cc83c640 1 --2- 172.21.15.83:0/183123175 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f06c8108d70 0x7f06c819fc70 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f06c0005cc0 tx=0x7f06c0032c40 comp rx=0 tx=0).stop 2024-09-21T01:40:56.069 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:56.067+0000 7f06c6d9d640 1 -- 172.21.15.83:0/183123175 reap_dead start 2024-09-21T01:40:56.069 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:56.068+0000 7f06cc83c640 1 -- 172.21.15.83:0/183123175 shutdown_connections 2024-09-21T01:40:56.069 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:56.068+0000 7f06cc83c640 1 -- 172.21.15.83:0/183123175 >> 172.21.15.83:0/183123175 conn(0x7f06c80796b0 msgr2=0x7f06c8101ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:40:56.069 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:56.068+0000 7f06cc83c640 1 -- 172.21.15.83:0/183123175 shutdown_connections 2024-09-21T01:40:56.069 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:56.068+0000 7f06cc83c640 1 -- 172.21.15.83:0/183123175 wait complete. 2024-09-21T01:40:56.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:40:55 smithi142 ceph-mon[34050]: pgmap v303: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 1.5 KiB/s wr, 3 op/s 2024-09-21T01:40:56.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:40:55 smithi119 ceph-mon[33693]: pgmap v303: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 1.5 KiB/s wr, 3 op/s 2024-09-21T01:40:57.162 INFO:teuthology.orchestra.run.smithi083.stdout:249108103206 2024-09-21T01:40:57.163 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.9 2024-09-21T01:40:57.236 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:56.805+0000 7f384cb37640 1 -- 172.21.15.83:0/3034452487 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3848109e30 msgr2=0x7f3848110660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:40:57.236 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:56.805+0000 7f384cb37640 1 --2- 172.21.15.83:0/3034452487 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3848109e30 0x7f3848110660 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f3838009900 tx=0x7f383802a410 comp rx=0 tx=0).stop 2024-09-21T01:40:57.236 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:56.805+0000 7f384cb37640 1 -- 172.21.15.83:0/3034452487 shutdown_connections 2024-09-21T01:40:57.236 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:56.805+0000 7f384cb37640 1 --2- 172.21.15.83:0/3034452487 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3848109e30 0x7f3848110660 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:57.237 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:56.805+0000 7f384cb37640 1 --2- 172.21.15.83:0/3034452487 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f38481094e0 0x7f38481098f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:57.237 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:56.805+0000 7f384cb37640 1 --2- 172.21.15.83:0/3034452487 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3848103ba0 0x7f3848103fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:57.237 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:56.805+0000 7f384cb37640 1 -- 172.21.15.83:0/3034452487 >> 172.21.15.83:0/3034452487 conn(0x7f38480ff630 msgr2=0x7f3848101a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:40:57.237 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:56.805+0000 7f384cb37640 1 -- 172.21.15.83:0/3034452487 shutdown_connections 2024-09-21T01:40:57.237 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:56.805+0000 7f384cb37640 1 -- 172.21.15.83:0/3034452487 wait complete. 2024-09-21T01:40:57.237 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:56.806+0000 7f384cb37640 1 Processor -- start 2024-09-21T01:40:57.237 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:56.806+0000 7f384cb37640 1 -- start start 2024-09-21T01:40:57.237 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:56.806+0000 7f384cb37640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3848103ba0 0x7f384819c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:40:57.237 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:56.806+0000 7f384cb37640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f38481094e0 0x7f384819cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:40:57.237 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:56.806+0000 7f384cb37640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3848109e30 0x7f38481a1df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:40:57.237 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:56.806+0000 7f384cb37640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f38481139a0 con 0x7f3848109e30 2024-09-21T01:40:57.237 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:56.806+0000 7f384cb37640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f3848113820 con 0x7f38481094e0 2024-09-21T01:40:57.237 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:56.806+0000 7f384cb37640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f3848113b20 con 0x7f3848103ba0 2024-09-21T01:40:57.237 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:56.806+0000 7f3846d9d640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3848109e30 0x7f38481a1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:40:57.237 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:56.806+0000 7f3846d9d640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3848109e30 0x7f38481a1df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:58024/0 (socket says 172.21.15.83:58024) 2024-09-21T01:40:57.238 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:56.806+0000 7f3846d9d640 1 -- 172.21.15.83:0/634234465 learned_addr learned my addr 172.21.15.83:0/634234465 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:40:57.238 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:56.806+0000 7f3845d9b640 1 --2- 172.21.15.83:0/634234465 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f38481094e0 0x7f384819cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:40:57.238 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:56.806+0000 7f384659c640 1 --2- 172.21.15.83:0/634234465 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3848103ba0 0x7f384819c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:40:57.238 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:56.807+0000 7f3846d9d640 1 -- 172.21.15.83:0/634234465 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3848103ba0 msgr2=0x7f384819c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:40:57.238 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:56.807+0000 7f3846d9d640 1 --2- 172.21.15.83:0/634234465 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3848103ba0 0x7f384819c5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:57.238 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:56.807+0000 7f3846d9d640 1 -- 172.21.15.83:0/634234465 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f38481094e0 msgr2=0x7f384819cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:40:57.238 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:56.807+0000 7f3846d9d640 1 --2- 172.21.15.83:0/634234465 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f38481094e0 0x7f384819cb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:57.238 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:56.807+0000 7f3846d9d640 1 -- 172.21.15.83:0/634234465 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38481a2520 con 0x7f3848109e30 2024-09-21T01:40:57.238 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:56.807+0000 7f3846d9d640 1 --2- 172.21.15.83:0/634234465 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3848109e30 0x7f38481a1df0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f3838005ab0 tx=0x7f38380040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:40:57.239 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:56.807+0000 7f383f7fe640 1 -- 172.21.15.83:0/634234465 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f383803f030 con 0x7f3848109e30 2024-09-21T01:40:57.239 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:56.807+0000 7f384cb37640 1 -- 172.21.15.83:0/634234465 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38481a27b0 con 0x7f3848109e30 2024-09-21T01:40:57.239 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:56.807+0000 7f383f7fe640 1 -- 172.21.15.83:0/634234465 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3838003a80 con 0x7f3848109e30 2024-09-21T01:40:57.239 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:56.807+0000 7f383f7fe640 1 -- 172.21.15.83:0/634234465 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3838035070 con 0x7f3848109e30 2024-09-21T01:40:57.239 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:56.807+0000 7f384cb37640 1 -- 172.21.15.83:0/634234465 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38481a8f70 con 0x7f3848109e30 2024-09-21T01:40:57.239 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:56.808+0000 7f384cb37640 1 -- 172.21.15.83:0/634234465 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f384810fc80 con 0x7f3848109e30 2024-09-21T01:40:57.239 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:56.810+0000 7f383f7fe640 1 -- 172.21.15.83:0/634234465 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7f3838042030 con 0x7f3848109e30 2024-09-21T01:40:57.239 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:56.810+0000 7f383f7fe640 1 --2- 172.21.15.83:0/634234465 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f38340b65f0 0x7f38340b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:40:57.239 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:56.810+0000 7f384659c640 1 --2- 172.21.15.83:0/634234465 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f38340b65f0 0x7f38340b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:40:57.239 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:56.810+0000 7f383f7fe640 1 -- 172.21.15.83:0/634234465 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9286+0+0 (secure 0 0 0) 0x7f3838108200 con 0x7f3848109e30 2024-09-21T01:40:57.239 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:56.811+0000 7f383f7fe640 1 --2- 172.21.15.83:0/634234465 >> [v2:172.21.15.83:6810/3746834093,v1:172.21.15.83:6811/3746834093] conn(0x7f38340c1900 0x7f38340c3df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:40:57.239 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:56.811+0000 7f383f7fe640 1 -- 172.21.15.83:0/634234465 --> [v2:172.21.15.83:6810/3746834093,v1:172.21.15.83:6811/3746834093] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f38340c44c0 con 0x7f38340c1900 2024-09-21T01:40:57.239 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:56.811+0000 7f383f7fe640 1 -- 172.21.15.83:0/634234465 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f3838108640 con 0x7f3848109e30 2024-09-21T01:40:57.240 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:56.811+0000 7f3845d9b640 1 --2- 172.21.15.83:0/634234465 >> [v2:172.21.15.83:6810/3746834093,v1:172.21.15.83:6811/3746834093] conn(0x7f38340c1900 0x7f38340c3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:40:57.240 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:56.811+0000 7f384659c640 1 --2- 172.21.15.83:0/634234465 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f38340b65f0 0x7f38340b8b00 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f3840005fd0 tx=0x7f3840009680 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:40:57.240 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:56.811+0000 7f3845d9b640 1 --2- 172.21.15.83:0/634234465 >> [v2:172.21.15.83:6810/3746834093,v1:172.21.15.83:6811/3746834093] conn(0x7f38340c1900 0x7f38340c3df0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:40:57.240 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:56.812+0000 7f383f7fe640 1 -- 172.21.15.83:0/634234465 <== osd.3 v2:172.21.15.83:6810/3746834093 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f38340c44c0 con 0x7f38340c1900 2024-09-21T01:40:57.240 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:56.825+0000 7f384cb37640 1 -- 172.21.15.83:0/634234465 --> [v2:172.21.15.83:6810/3746834093,v1:172.21.15.83:6811/3746834093] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3848104e20 con 0x7f38340c1900 2024-09-21T01:40:57.240 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:56.825+0000 7f383f7fe640 1 -- 172.21.15.83:0/634234465 <== osd.3 v2:172.21.15.83:6810/3746834093 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f3848104e20 con 0x7f38340c1900 2024-09-21T01:40:57.240 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:56.826+0000 7f384cb37640 1 -- 172.21.15.83:0/634234465 >> [v2:172.21.15.83:6810/3746834093,v1:172.21.15.83:6811/3746834093] conn(0x7f38340c1900 msgr2=0x7f38340c3df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:40:57.240 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:56.826+0000 7f384cb37640 1 --2- 172.21.15.83:0/634234465 >> [v2:172.21.15.83:6810/3746834093,v1:172.21.15.83:6811/3746834093] conn(0x7f38340c1900 0x7f38340c3df0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:57.240 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:56.826+0000 7f384cb37640 1 -- 172.21.15.83:0/634234465 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f38340b65f0 msgr2=0x7f38340b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:40:57.240 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:56.826+0000 7f384cb37640 1 --2- 172.21.15.83:0/634234465 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f38340b65f0 0x7f38340b8b00 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f3840005fd0 tx=0x7f3840009680 comp rx=0 tx=0).stop 2024-09-21T01:40:57.240 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:56.826+0000 7f384cb37640 1 -- 172.21.15.83:0/634234465 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3848109e30 msgr2=0x7f38481a1df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:40:57.240 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:56.826+0000 7f384cb37640 1 --2- 172.21.15.83:0/634234465 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3848109e30 0x7f38481a1df0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f3838005ab0 tx=0x7f38380040e0 comp rx=0 tx=0).stop 2024-09-21T01:40:57.240 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:56.826+0000 7f3846d9d640 1 -- 172.21.15.83:0/634234465 reap_dead start 2024-09-21T01:40:57.240 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:56.826+0000 7f384cb37640 1 -- 172.21.15.83:0/634234465 shutdown_connections 2024-09-21T01:40:57.240 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:56.826+0000 7f384cb37640 1 -- 172.21.15.83:0/634234465 >> 172.21.15.83:0/634234465 conn(0x7f38480ff630 msgr2=0x7f3848108b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:40:57.241 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:56.826+0000 7f384cb37640 1 -- 172.21.15.83:0/634234465 shutdown_connections 2024-09-21T01:40:57.241 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:56.826+0000 7f384cb37640 1 -- 172.21.15.83:0/634234465 wait complete. 2024-09-21T01:40:58.079 INFO:teuthology.orchestra.run.smithi083.stdout:270582939680 2024-09-21T01:40:58.080 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.10 2024-09-21T01:40:58.101 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:40:57 smithi083 ceph-mon[31370]: pgmap v304: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 511 B/s wr, 2 op/s 2024-09-21T01:40:58.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:40:57 smithi142 ceph-mon[34050]: pgmap v304: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 511 B/s wr, 2 op/s 2024-09-21T01:40:58.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:40:57 smithi119 ceph-mon[33693]: pgmap v304: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 511 B/s wr, 2 op/s 2024-09-21T01:40:58.246 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:58.245+0000 7f2ee5c64640 1 -- 172.21.15.83:0/2363987112 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2ee0108d00 msgr2=0x7f2ee010f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:40:58.246 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:58.245+0000 7f2ee5c64640 1 --2- 172.21.15.83:0/2363987112 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2ee0108d00 0x7f2ee010f530 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f2ed8009ca0 tx=0x7f2ed802a8c0 comp rx=0 tx=0).stop 2024-09-21T01:40:58.246 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:58.245+0000 7f2ee5c64640 1 -- 172.21.15.83:0/2363987112 shutdown_connections 2024-09-21T01:40:58.246 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:58.245+0000 7f2ee5c64640 1 --2- 172.21.15.83:0/2363987112 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2ee0108d00 0x7f2ee010f530 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:58.246 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:58.245+0000 7f2ee5c64640 1 --2- 172.21.15.83:0/2363987112 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2ee01083b0 0x7f2ee01087c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:58.246 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:58.245+0000 7f2ee5c64640 1 --2- 172.21.15.83:0/2363987112 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2ee0103140 0x7f2ee0103550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:58.246 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:58.245+0000 7f2ee5c64640 1 -- 172.21.15.83:0/2363987112 >> 172.21.15.83:0/2363987112 conn(0x7f2ee0077c60 msgr2=0x7f2ee00780a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:40:58.246 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:58.245+0000 7f2ee5c64640 1 -- 172.21.15.83:0/2363987112 shutdown_connections 2024-09-21T01:40:58.246 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:58.245+0000 7f2ee5c64640 1 -- 172.21.15.83:0/2363987112 wait complete. 2024-09-21T01:40:58.247 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:58.246+0000 7f2ee5c64640 1 Processor -- start 2024-09-21T01:40:58.247 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:58.247+0000 7f2ee5c64640 1 -- start start 2024-09-21T01:40:58.248 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:58.247+0000 7f2ee5c64640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2ee0103140 0x7f2ee019b110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:40:58.248 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:58.247+0000 7f2ee5c64640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2ee01083b0 0x7f2ee019b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:40:58.248 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:58.247+0000 7f2ee5c64640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2ee0108d00 0x7f2ee019bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:40:58.248 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:58.247+0000 7f2ee5c64640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f2ee01128c0 con 0x7f2ee01083b0 2024-09-21T01:40:58.249 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:58.247+0000 7f2ee5c64640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f2ee0112740 con 0x7f2ee0103140 2024-09-21T01:40:58.249 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:58.247+0000 7f2ee5c64640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f2ee0112a40 con 0x7f2ee0108d00 2024-09-21T01:40:58.249 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:58.247+0000 7f2edeffd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2ee01083b0 0x7f2ee019b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:40:58.249 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:58.247+0000 7f2edeffd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2ee01083b0 0x7f2ee019b650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:58050/0 (socket says 172.21.15.83:58050) 2024-09-21T01:40:58.249 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:58.247+0000 7f2edeffd640 1 -- 172.21.15.83:0/1968073106 learned_addr learned my addr 172.21.15.83:0/1968073106 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:40:58.249 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:58.247+0000 7f2edffff640 1 --2- 172.21.15.83:0/1968073106 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2ee0108d00 0x7f2ee019bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:40:58.249 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:58.247+0000 7f2edf7fe640 1 --2- 172.21.15.83:0/1968073106 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2ee0103140 0x7f2ee019b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:40:58.249 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:58.248+0000 7f2edeffd640 1 -- 172.21.15.83:0/1968073106 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2ee0108d00 msgr2=0x7f2ee019bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:40:58.249 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:58.248+0000 7f2edeffd640 1 --2- 172.21.15.83:0/1968073106 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2ee0108d00 0x7f2ee019bb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:58.249 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:58.248+0000 7f2edeffd640 1 -- 172.21.15.83:0/1968073106 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2ee0103140 msgr2=0x7f2ee019b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:40:58.249 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:58.248+0000 7f2edeffd640 1 --2- 172.21.15.83:0/1968073106 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2ee0103140 0x7f2ee019b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:58.249 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:58.248+0000 7f2edeffd640 1 -- 172.21.15.83:0/1968073106 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ee01a6340 con 0x7f2ee01083b0 2024-09-21T01:40:58.249 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:58.248+0000 7f2edeffd640 1 --2- 172.21.15.83:0/1968073106 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2ee01083b0 0x7f2ee019b650 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f2ed400c8c0 tx=0x7f2ed400cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:40:58.250 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:58.248+0000 7f2edcff9640 1 -- 172.21.15.83:0/1968073106 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ed4007bb0 con 0x7f2ee01083b0 2024-09-21T01:40:58.250 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:58.248+0000 7f2edcff9640 1 -- 172.21.15.83:0/1968073106 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2ed4007d50 con 0x7f2ee01083b0 2024-09-21T01:40:58.250 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:58.248+0000 7f2edcff9640 1 -- 172.21.15.83:0/1968073106 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ed40186a0 con 0x7f2ee01083b0 2024-09-21T01:40:58.250 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:58.248+0000 7f2ee5c64640 1 -- 172.21.15.83:0/1968073106 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ee01a6630 con 0x7f2ee01083b0 2024-09-21T01:40:58.250 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:58.248+0000 7f2ee5c64640 1 -- 172.21.15.83:0/1968073106 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ee01a6b70 con 0x7f2ee01083b0 2024-09-21T01:40:58.250 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:58.249+0000 7f2ee5c64640 1 -- 172.21.15.83:0/1968073106 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2ee0063b50 con 0x7f2ee01083b0 2024-09-21T01:40:58.251 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:58.251+0000 7f2edcff9640 1 -- 172.21.15.83:0/1968073106 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7f2ed400fa00 con 0x7f2ee01083b0 2024-09-21T01:40:58.252 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:58.252+0000 7f2edcff9640 1 --2- 172.21.15.83:0/1968073106 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f2ec80b65f0 0x7f2ec80b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:40:58.252 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:58.252+0000 7f2edcff9640 1 -- 172.21.15.83:0/1968073106 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9286+0+0 (secure 0 0 0) 0x7f2ed40e7d30 con 0x7f2ee01083b0 2024-09-21T01:40:58.253 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:58.252+0000 7f2edf7fe640 1 --2- 172.21.15.83:0/1968073106 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f2ec80b65f0 0x7f2ec80b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:40:58.253 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:58.252+0000 7f2edcff9640 1 --2- 172.21.15.83:0/1968073106 >> [v2:172.21.15.142:6816/1860679473,v1:172.21.15.142:6817/1860679473] conn(0x7f2ec80c1900 0x7f2ec80c3df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:40:58.253 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:58.252+0000 7f2edcff9640 1 -- 172.21.15.83:0/1968073106 --> [v2:172.21.15.142:6816/1860679473,v1:172.21.15.142:6817/1860679473] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2ed401ee50 con 0x7f2ec80c1900 2024-09-21T01:40:58.253 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:58.252+0000 7f2edcff9640 1 -- 172.21.15.83:0/1968073106 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f2ed40e8180 con 0x7f2ee01083b0 2024-09-21T01:40:58.253 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:58.252+0000 7f2edffff640 1 --2- 172.21.15.83:0/1968073106 >> [v2:172.21.15.142:6816/1860679473,v1:172.21.15.142:6817/1860679473] conn(0x7f2ec80c1900 0x7f2ec80c3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:40:58.253 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:58.252+0000 7f2edf7fe640 1 --2- 172.21.15.83:0/1968073106 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f2ec80b65f0 0x7f2ec80b8b00 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f2ee0102920 tx=0x7f2ed000b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:40:58.253 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:58.253+0000 7f2edffff640 1 --2- 172.21.15.83:0/1968073106 >> [v2:172.21.15.142:6816/1860679473,v1:172.21.15.142:6817/1860679473] conn(0x7f2ec80c1900 0x7f2ec80c3df0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:40:58.254 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:58.254+0000 7f2edcff9640 1 -- 172.21.15.83:0/1968073106 <== osd.8 v2:172.21.15.142:6816/1860679473 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f2ed401ee50 con 0x7f2ec80c1900 2024-09-21T01:40:58.268 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:58.267+0000 7f2ee5c64640 1 -- 172.21.15.83:0/1968073106 --> [v2:172.21.15.142:6816/1860679473,v1:172.21.15.142:6817/1860679473] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f2ee0063f50 con 0x7f2ec80c1900 2024-09-21T01:40:58.268 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:58.268+0000 7f2edcff9640 1 -- 172.21.15.83:0/1968073106 <== osd.8 v2:172.21.15.142:6816/1860679473 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f2ee0063f50 con 0x7f2ec80c1900 2024-09-21T01:40:58.269 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:58.269+0000 7f2ee5c64640 1 -- 172.21.15.83:0/1968073106 >> [v2:172.21.15.142:6816/1860679473,v1:172.21.15.142:6817/1860679473] conn(0x7f2ec80c1900 msgr2=0x7f2ec80c3df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:40:58.269 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:58.269+0000 7f2ee5c64640 1 --2- 172.21.15.83:0/1968073106 >> [v2:172.21.15.142:6816/1860679473,v1:172.21.15.142:6817/1860679473] conn(0x7f2ec80c1900 0x7f2ec80c3df0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:58.270 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:58.269+0000 7f2ee5c64640 1 -- 172.21.15.83:0/1968073106 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f2ec80b65f0 msgr2=0x7f2ec80b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:40:58.270 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:58.269+0000 7f2ee5c64640 1 --2- 172.21.15.83:0/1968073106 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f2ec80b65f0 0x7f2ec80b8b00 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f2ee0102920 tx=0x7f2ed000b390 comp rx=0 tx=0).stop 2024-09-21T01:40:58.270 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:58.269+0000 7f2ee5c64640 1 -- 172.21.15.83:0/1968073106 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2ee01083b0 msgr2=0x7f2ee019b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:40:58.270 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:58.269+0000 7f2ee5c64640 1 --2- 172.21.15.83:0/1968073106 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2ee01083b0 0x7f2ee019b650 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f2ed400c8c0 tx=0x7f2ed400cd80 comp rx=0 tx=0).stop 2024-09-21T01:40:58.270 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:58.269+0000 7f2edffff640 1 -- 172.21.15.83:0/1968073106 reap_dead start 2024-09-21T01:40:58.270 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:58.269+0000 7f2ee5c64640 1 -- 172.21.15.83:0/1968073106 shutdown_connections 2024-09-21T01:40:58.270 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:58.269+0000 7f2ee5c64640 1 -- 172.21.15.83:0/1968073106 >> 172.21.15.83:0/1968073106 conn(0x7f2ee0077c60 msgr2=0x7f2ee0104320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:40:58.270 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:58.269+0000 7f2ee5c64640 1 -- 172.21.15.83:0/1968073106 shutdown_connections 2024-09-21T01:40:58.270 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:58.269+0000 7f2ee5c64640 1 -- 172.21.15.83:0/1968073106 wait complete. 2024-09-21T01:40:59.019 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:59.016+0000 7fb5171b0640 1 -- 172.21.15.83:0/1648494223 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb510102ae0 msgr2=0x7fb510102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:40:59.019 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:59.016+0000 7fb5171b0640 1 --2- 172.21.15.83:0/1648494223 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb510102ae0 0x7fb510102ef0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fb4f8009900 tx=0x7fb4f802a410 comp rx=0 tx=0).stop 2024-09-21T01:40:59.019 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:59.016+0000 7fb5171b0640 1 -- 172.21.15.83:0/1648494223 shutdown_connections 2024-09-21T01:40:59.019 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:59.016+0000 7fb5171b0640 1 --2- 172.21.15.83:0/1648494223 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb510108d70 0x7fb51010f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:59.019 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:59.016+0000 7fb5171b0640 1 --2- 172.21.15.83:0/1648494223 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb510108420 0x7fb510108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:59.019 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:59.016+0000 7fb5171b0640 1 --2- 172.21.15.83:0/1648494223 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb510102ae0 0x7fb510102ef0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:59.020 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:59.016+0000 7fb5171b0640 1 -- 172.21.15.83:0/1648494223 >> 172.21.15.83:0/1648494223 conn(0x7fb510079770 msgr2=0x7fb510079b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:40:59.020 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:59.016+0000 7fb5171b0640 1 -- 172.21.15.83:0/1648494223 shutdown_connections 2024-09-21T01:40:59.020 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:59.016+0000 7fb5171b0640 1 -- 172.21.15.83:0/1648494223 wait complete. 2024-09-21T01:40:59.020 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:59.017+0000 7fb5171b0640 1 Processor -- start 2024-09-21T01:40:59.020 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:59.017+0000 7fb5171b0640 1 -- start start 2024-09-21T01:40:59.020 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:59.017+0000 7fb5171b0640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb510102ae0 0x7fb51019c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:40:59.020 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:59.017+0000 7fb5171b0640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb510108420 0x7fb51019cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:40:59.020 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:59.017+0000 7fb5171b0640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb510108d70 0x7fb5101a1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:40:59.020 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:59.017+0000 7fb5171b0640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fb510113a00 con 0x7fb510108d70 2024-09-21T01:40:59.020 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:59.017+0000 7fb5171b0640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fb510113880 con 0x7fb510108420 2024-09-21T01:40:59.020 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:59.017+0000 7fb5171b0640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fb510113b80 con 0x7fb510102ae0 2024-09-21T01:40:59.020 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:59.017+0000 7fb51574d640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb510108d70 0x7fb5101a1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:40:59.020 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:59.017+0000 7fb51574d640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb510108d70 0x7fb5101a1ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:58062/0 (socket says 172.21.15.83:58062) 2024-09-21T01:40:59.020 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:59.017+0000 7fb51574d640 1 -- 172.21.15.83:0/4284992902 learned_addr learned my addr 172.21.15.83:0/4284992902 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:40:59.021 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:59.018+0000 7fb50ffff640 1 --2- 172.21.15.83:0/4284992902 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb510108420 0x7fb51019cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:40:59.021 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:59.018+0000 7fb514f4c640 1 --2- 172.21.15.83:0/4284992902 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb510102ae0 0x7fb51019c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:40:59.021 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:59.018+0000 7fb51574d640 1 -- 172.21.15.83:0/4284992902 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb510102ae0 msgr2=0x7fb51019c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:40:59.021 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:59.018+0000 7fb51574d640 1 --2- 172.21.15.83:0/4284992902 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb510102ae0 0x7fb51019c6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:59.021 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:59.018+0000 7fb51574d640 1 -- 172.21.15.83:0/4284992902 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb510108420 msgr2=0x7fb51019cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:40:59.021 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:59.018+0000 7fb51574d640 1 --2- 172.21.15.83:0/4284992902 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb510108420 0x7fb51019cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:59.021 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:59.018+0000 7fb51574d640 1 -- 172.21.15.83:0/4284992902 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5101a2620 con 0x7fb510108d70 2024-09-21T01:40:59.021 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:59.018+0000 7fb50ffff640 1 --2- 172.21.15.83:0/4284992902 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb510108420 0x7fb51019cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:40:59.021 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:59.018+0000 7fb51574d640 1 --2- 172.21.15.83:0/4284992902 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb510108d70 0x7fb5101a1ef0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fb50800d750 tx=0x7fb50800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:40:59.021 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:59.018+0000 7fb50dffb640 1 -- 172.21.15.83:0/4284992902 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb508017070 con 0x7fb510108d70 2024-09-21T01:40:59.021 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:59.018+0000 7fb5171b0640 1 -- 172.21.15.83:0/4284992902 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5101a2910 con 0x7fb510108d70 2024-09-21T01:40:59.021 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:59.018+0000 7fb50dffb640 1 -- 172.21.15.83:0/4284992902 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb5080054b0 con 0x7fb510108d70 2024-09-21T01:40:59.021 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:59.018+0000 7fb50dffb640 1 -- 172.21.15.83:0/4284992902 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb508004b90 con 0x7fb510108d70 2024-09-21T01:40:59.021 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:59.019+0000 7fb5171b0640 1 -- 172.21.15.83:0/4284992902 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5101a9070 con 0x7fb510108d70 2024-09-21T01:40:59.023 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:59.019+0000 7fb5171b0640 1 -- 172.21.15.83:0/4284992902 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb510106d50 con 0x7fb510108d70 2024-09-21T01:40:59.023 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:59.021+0000 7fb50dffb640 1 -- 172.21.15.83:0/4284992902 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7fb508004d30 con 0x7fb510108d70 2024-09-21T01:40:59.023 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:59.022+0000 7fb50dffb640 1 --2- 172.21.15.83:0/4284992902 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fb4fc0b65f0 0x7fb4fc0b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:40:59.023 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:59.022+0000 7fb514f4c640 1 --2- 172.21.15.83:0/4284992902 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fb4fc0b65f0 0x7fb4fc0b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:40:59.023 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:59.022+0000 7fb50dffb640 1 -- 172.21.15.83:0/4284992902 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9286+0+0 (secure 0 0 0) 0x7fb5080e78d0 con 0x7fb510108d70 2024-09-21T01:40:59.023 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:59.022+0000 7fb50dffb640 1 --2- 172.21.15.83:0/4284992902 >> [v2:172.21.15.83:6802/3563457494,v1:172.21.15.83:6803/3563457494] conn(0x7fb4fc0c1900 0x7fb4fc0c3df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:40:59.023 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:59.022+0000 7fb50dffb640 1 -- 172.21.15.83:0/4284992902 --> [v2:172.21.15.83:6802/3563457494,v1:172.21.15.83:6803/3563457494] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb508021e50 con 0x7fb4fc0c1900 2024-09-21T01:40:59.023 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:59.022+0000 7fb50dffb640 1 -- 172.21.15.83:0/4284992902 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7fb5080e7c80 con 0x7fb510108d70 2024-09-21T01:40:59.023 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:59.022+0000 7fb50ffff640 1 --2- 172.21.15.83:0/4284992902 >> [v2:172.21.15.83:6802/3563457494,v1:172.21.15.83:6803/3563457494] conn(0x7fb4fc0c1900 0x7fb4fc0c3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:40:59.023 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:59.023+0000 7fb514f4c640 1 --2- 172.21.15.83:0/4284992902 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fb4fc0b65f0 0x7fb4fc0b8b00 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fb4f8000c00 tx=0x7fb4f8009680 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:40:59.024 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:59.023+0000 7fb50ffff640 1 --2- 172.21.15.83:0/4284992902 >> [v2:172.21.15.83:6802/3563457494,v1:172.21.15.83:6803/3563457494] conn(0x7fb4fc0c1900 0x7fb4fc0c3df0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:40:59.024 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:59.024+0000 7fb50dffb640 1 -- 172.21.15.83:0/4284992902 <== osd.0 v2:172.21.15.83:6802/3563457494 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb508021e50 con 0x7fb4fc0c1900 2024-09-21T01:40:59.038 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:59.037+0000 7fb5171b0640 1 -- 172.21.15.83:0/4284992902 --> [v2:172.21.15.83:6802/3563457494,v1:172.21.15.83:6803/3563457494] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fb51006b390 con 0x7fb4fc0c1900 2024-09-21T01:40:59.038 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:59.038+0000 7fb50dffb640 1 -- 172.21.15.83:0/4284992902 <== osd.0 v2:172.21.15.83:6802/3563457494 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fb51006b390 con 0x7fb4fc0c1900 2024-09-21T01:40:59.039 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:59.038+0000 7fb5171b0640 1 -- 172.21.15.83:0/4284992902 >> [v2:172.21.15.83:6802/3563457494,v1:172.21.15.83:6803/3563457494] conn(0x7fb4fc0c1900 msgr2=0x7fb4fc0c3df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:40:59.039 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:59.038+0000 7fb5171b0640 1 --2- 172.21.15.83:0/4284992902 >> [v2:172.21.15.83:6802/3563457494,v1:172.21.15.83:6803/3563457494] conn(0x7fb4fc0c1900 0x7fb4fc0c3df0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:40:59.039 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:59.038+0000 7fb5171b0640 1 -- 172.21.15.83:0/4284992902 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fb4fc0b65f0 msgr2=0x7fb4fc0b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:40:59.039 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:59.038+0000 7fb5171b0640 1 --2- 172.21.15.83:0/4284992902 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fb4fc0b65f0 0x7fb4fc0b8b00 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fb4f8000c00 tx=0x7fb4f8009680 comp rx=0 tx=0).stop 2024-09-21T01:40:59.039 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:59.038+0000 7fb5171b0640 1 -- 172.21.15.83:0/4284992902 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb510108d70 msgr2=0x7fb5101a1ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:40:59.039 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:59.038+0000 7fb5171b0640 1 --2- 172.21.15.83:0/4284992902 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb510108d70 0x7fb5101a1ef0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fb50800d750 tx=0x7fb50800dc10 comp rx=0 tx=0).stop 2024-09-21T01:40:59.039 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:59.038+0000 7fb51574d640 1 -- 172.21.15.83:0/4284992902 reap_dead start 2024-09-21T01:40:59.040 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:59.038+0000 7fb5171b0640 1 -- 172.21.15.83:0/4284992902 shutdown_connections 2024-09-21T01:40:59.040 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:59.038+0000 7fb5171b0640 1 -- 172.21.15.83:0/4284992902 >> 172.21.15.83:0/4284992902 conn(0x7fb510079770 msgr2=0x7fb510106370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:40:59.040 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:59.038+0000 7fb5171b0640 1 -- 172.21.15.83:0/4284992902 shutdown_connections 2024-09-21T01:40:59.040 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:40:59.038+0000 7fb5171b0640 1 -- 172.21.15.83:0/4284992902 wait complete. 2024-09-21T01:40:59.449 INFO:teuthology.orchestra.run.smithi083.stdout:150323855418 2024-09-21T01:40:59.449 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.5 2024-09-21T01:40:59.872 INFO:teuthology.orchestra.run.smithi083.stdout:223338299436 2024-09-21T01:40:59.873 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.8 2024-09-21T01:41:00.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:40:59 smithi142 ceph-mon[34050]: pgmap v305: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 511 B/s wr, 2 op/s 2024-09-21T01:41:00.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:40:59 smithi119 ceph-mon[33693]: pgmap v305: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 511 B/s wr, 2 op/s 2024-09-21T01:41:00.287 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:40:59 smithi083 ceph-mon[31370]: pgmap v305: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 511 B/s wr, 2 op/s 2024-09-21T01:41:00.626 INFO:teuthology.orchestra.run.smithi083.stdout:77309411401 2024-09-21T01:41:00.626 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.2 2024-09-21T01:41:00.790 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:00.771+0000 7f214e1a9640 1 -- 172.21.15.83:0/1292909701 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f21481031c0 msgr2=0x7f21481035d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:00.790 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:00.771+0000 7f214e1a9640 1 --2- 172.21.15.83:0/1292909701 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f21481031c0 0x7f21481035d0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f2138009900 tx=0x7f213802a410 comp rx=0 tx=0).stop 2024-09-21T01:41:00.790 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:00.771+0000 7f214e1a9640 1 -- 172.21.15.83:0/1292909701 shutdown_connections 2024-09-21T01:41:00.790 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:00.771+0000 7f214e1a9640 1 --2- 172.21.15.83:0/1292909701 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2148108d40 0x7f214810f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:00.790 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:00.771+0000 7f214e1a9640 1 --2- 172.21.15.83:0/1292909701 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f21481083f0 0x7f2148108800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:00.790 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:00.771+0000 7f214e1a9640 1 --2- 172.21.15.83:0/1292909701 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f21481031c0 0x7f21481035d0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:00.790 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:00.771+0000 7f214e1a9640 1 -- 172.21.15.83:0/1292909701 >> 172.21.15.83:0/1292909701 conn(0x7f2148079e10 msgr2=0x7f214807a220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:41:00.790 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:00.771+0000 7f214e1a9640 1 -- 172.21.15.83:0/1292909701 shutdown_connections 2024-09-21T01:41:00.790 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:00.771+0000 7f214e1a9640 1 -- 172.21.15.83:0/1292909701 wait complete. 2024-09-21T01:41:00.790 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:00.772+0000 7f214e1a9640 1 Processor -- start 2024-09-21T01:41:00.790 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:00.772+0000 7f214e1a9640 1 -- start start 2024-09-21T01:41:00.790 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:00.772+0000 7f214e1a9640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f21481031c0 0x7f21480fee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:00.791 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:00.772+0000 7f214e1a9640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f21481083f0 0x7f21480ff380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:00.791 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:00.772+0000 7f214e1a9640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2148108d40 0x7f21480ff8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:00.791 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:00.772+0000 7f214e1a9640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f21481128b0 con 0x7f21481031c0 2024-09-21T01:41:00.791 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:00.772+0000 7f214e1a9640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f2148112730 con 0x7f21481083f0 2024-09-21T01:41:00.791 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:00.772+0000 7f214e1a9640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f2148112a30 con 0x7f2148108d40 2024-09-21T01:41:00.791 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:00.772+0000 7f21477fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f21481031c0 0x7f21480fee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:00.791 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:00.772+0000 7f21477fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f21481031c0 0x7f21480fee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:58094/0 (socket says 172.21.15.83:58094) 2024-09-21T01:41:00.791 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:00.772+0000 7f21477fe640 1 -- 172.21.15.83:0/891554612 learned_addr learned my addr 172.21.15.83:0/891554612 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:41:00.791 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:00.772+0000 7f2146ffd640 1 --2- 172.21.15.83:0/891554612 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f21481083f0 0x7f21480ff380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:00.791 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:00.773+0000 7f2147fff640 1 --2- 172.21.15.83:0/891554612 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2148108d40 0x7f21480ff8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:00.791 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:00.773+0000 7f21477fe640 1 -- 172.21.15.83:0/891554612 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2148108d40 msgr2=0x7f21480ff8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:00.791 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:00.773+0000 7f21477fe640 1 --2- 172.21.15.83:0/891554612 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2148108d40 0x7f21480ff8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:00.791 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:00.773+0000 7f21477fe640 1 -- 172.21.15.83:0/891554612 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f21481083f0 msgr2=0x7f21480ff380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:00.791 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:00.773+0000 7f21477fe640 1 --2- 172.21.15.83:0/891554612 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f21481083f0 0x7f21480ff380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:00.792 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:00.773+0000 7f21477fe640 1 -- 172.21.15.83:0/891554612 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21481a86e0 con 0x7f21481031c0 2024-09-21T01:41:00.792 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:00.773+0000 7f21477fe640 1 --2- 172.21.15.83:0/891554612 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f21481031c0 0x7f21480fee40 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f2138009a20 tx=0x7f2138004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:41:00.792 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:00.773+0000 7f2144ff9640 1 -- 172.21.15.83:0/891554612 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f213803f030 con 0x7f21481031c0 2024-09-21T01:41:00.792 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:00.773+0000 7f214e1a9640 1 -- 172.21.15.83:0/891554612 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21481a8970 con 0x7f21481031c0 2024-09-21T01:41:00.792 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:00.773+0000 7f2144ff9640 1 -- 172.21.15.83:0/891554612 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f21380035f0 con 0x7f21481031c0 2024-09-21T01:41:00.792 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:00.773+0000 7f2144ff9640 1 -- 172.21.15.83:0/891554612 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2138035070 con 0x7f21481031c0 2024-09-21T01:41:00.792 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:00.773+0000 7f214e1a9640 1 -- 172.21.15.83:0/891554612 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21481a8ea0 con 0x7f21481031c0 2024-09-21T01:41:00.792 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:00.774+0000 7f214e1a9640 1 -- 172.21.15.83:0/891554612 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2148063b10 con 0x7f21481031c0 2024-09-21T01:41:00.792 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:00.776+0000 7f2144ff9640 1 -- 172.21.15.83:0/891554612 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7f2138003aa0 con 0x7f21481031c0 2024-09-21T01:41:00.792 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:00.777+0000 7f2144ff9640 1 --2- 172.21.15.83:0/891554612 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f21300b65f0 0x7f21300b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:00.792 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:00.777+0000 7f2146ffd640 1 --2- 172.21.15.83:0/891554612 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f21300b65f0 0x7f21300b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:00.792 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:00.777+0000 7f2144ff9640 1 -- 172.21.15.83:0/891554612 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9286+0+0 (secure 0 0 0) 0x7f2138108ad0 con 0x7f21481031c0 2024-09-21T01:41:00.792 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:00.778+0000 7f2144ff9640 1 --2- 172.21.15.83:0/891554612 >> [v2:172.21.15.142:6824/1174646198,v1:172.21.15.142:6825/1174646198] conn(0x7f21300c1900 0x7f21300c3df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:00.792 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:00.778+0000 7f2144ff9640 1 -- 172.21.15.83:0/891554612 --> [v2:172.21.15.142:6824/1174646198,v1:172.21.15.142:6825/1174646198] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f21300c44c0 con 0x7f21300c1900 2024-09-21T01:41:00.792 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:00.778+0000 7f2144ff9640 1 -- 172.21.15.83:0/891554612 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f2138108e80 con 0x7f21481031c0 2024-09-21T01:41:00.792 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:00.778+0000 7f2146ffd640 1 --2- 172.21.15.83:0/891554612 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f21300b65f0 0x7f21300b8b00 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f214807a2a0 tx=0x7f213c00a2d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:41:00.793 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:00.778+0000 7f2147fff640 1 --2- 172.21.15.83:0/891554612 >> [v2:172.21.15.142:6824/1174646198,v1:172.21.15.142:6825/1174646198] conn(0x7f21300c1900 0x7f21300c3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:00.793 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:00.778+0000 7f2147fff640 1 --2- 172.21.15.83:0/891554612 >> [v2:172.21.15.142:6824/1174646198,v1:172.21.15.142:6825/1174646198] conn(0x7f21300c1900 0x7f21300c3df0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:41:00.793 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:00.779+0000 7f2144ff9640 1 -- 172.21.15.83:0/891554612 <== osd.11 v2:172.21.15.142:6824/1174646198 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f21300c44c0 con 0x7f21300c1900 2024-09-21T01:41:00.793 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:00.793+0000 7f214e1a9640 1 -- 172.21.15.83:0/891554612 --> [v2:172.21.15.142:6824/1174646198,v1:172.21.15.142:6825/1174646198] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f2148063f10 con 0x7f21300c1900 2024-09-21T01:41:00.793 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:00.793+0000 7f2144ff9640 1 -- 172.21.15.83:0/891554612 <== osd.11 v2:172.21.15.142:6824/1174646198 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f2148063f10 con 0x7f21300c1900 2024-09-21T01:41:00.794 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:00.794+0000 7f214e1a9640 1 -- 172.21.15.83:0/891554612 >> [v2:172.21.15.142:6824/1174646198,v1:172.21.15.142:6825/1174646198] conn(0x7f21300c1900 msgr2=0x7f21300c3df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:00.794 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:00.794+0000 7f214e1a9640 1 --2- 172.21.15.83:0/891554612 >> [v2:172.21.15.142:6824/1174646198,v1:172.21.15.142:6825/1174646198] conn(0x7f21300c1900 0x7f21300c3df0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:00.794 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:00.794+0000 7f214e1a9640 1 -- 172.21.15.83:0/891554612 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f21300b65f0 msgr2=0x7f21300b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:00.794 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:00.794+0000 7f214e1a9640 1 --2- 172.21.15.83:0/891554612 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f21300b65f0 0x7f21300b8b00 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f214807a2a0 tx=0x7f213c00a2d0 comp rx=0 tx=0).stop 2024-09-21T01:41:00.795 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:00.794+0000 7f214e1a9640 1 -- 172.21.15.83:0/891554612 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f21481031c0 msgr2=0x7f21480fee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:00.795 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:00.794+0000 7f214e1a9640 1 --2- 172.21.15.83:0/891554612 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f21481031c0 0x7f21480fee40 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f2138009a20 tx=0x7f2138004270 comp rx=0 tx=0).stop 2024-09-21T01:41:00.795 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:00.794+0000 7f2147fff640 1 -- 172.21.15.83:0/891554612 reap_dead start 2024-09-21T01:41:00.795 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:00.794+0000 7f214e1a9640 1 -- 172.21.15.83:0/891554612 shutdown_connections 2024-09-21T01:41:00.795 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:00.794+0000 7f214e1a9640 1 -- 172.21.15.83:0/891554612 >> 172.21.15.83:0/891554612 conn(0x7f2148079e10 msgr2=0x7f2148101400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:41:00.795 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:00.794+0000 7f214e1a9640 1 -- 172.21.15.83:0/891554612 shutdown_connections 2024-09-21T01:41:00.795 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:00.794+0000 7f214e1a9640 1 -- 172.21.15.83:0/891554612 wait complete. 2024-09-21T01:41:01.016 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:00.988+0000 7fe1abe7f640 1 -- 172.21.15.83:0/3294889836 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe1a4103b60 msgr2=0x7fe1a4103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:01.017 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:00.988+0000 7fe1abe7f640 1 --2- 172.21.15.83:0/3294889836 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe1a4103b60 0x7fe1a4103f70 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fe1a0009900 tx=0x7fe1a002a410 comp rx=0 tx=0).stop 2024-09-21T01:41:01.017 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:00.988+0000 7fe1abe7f640 1 -- 172.21.15.83:0/3294889836 shutdown_connections 2024-09-21T01:41:01.017 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:00.988+0000 7fe1abe7f640 1 --2- 172.21.15.83:0/3294889836 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe1a4109df0 0x7fe1a4110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:01.017 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:00.988+0000 7fe1abe7f640 1 --2- 172.21.15.83:0/3294889836 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe1a41094a0 0x7fe1a41098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:01.017 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:00.988+0000 7fe1abe7f640 1 --2- 172.21.15.83:0/3294889836 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe1a4103b60 0x7fe1a4103f70 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:01.017 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:00.988+0000 7fe1abe7f640 1 -- 172.21.15.83:0/3294889836 >> 172.21.15.83:0/3294889836 conn(0x7fe1a407b850 msgr2=0x7fe1a407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:41:01.017 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:00.988+0000 7fe1abe7f640 1 -- 172.21.15.83:0/3294889836 shutdown_connections 2024-09-21T01:41:01.017 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:00.989+0000 7fe1abe7f640 1 -- 172.21.15.83:0/3294889836 wait complete. 2024-09-21T01:41:01.017 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:00.989+0000 7fe1abe7f640 1 Processor -- start 2024-09-21T01:41:01.017 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:00.989+0000 7fe1abe7f640 1 -- start start 2024-09-21T01:41:01.017 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:00.989+0000 7fe1abe7f640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe1a4103b60 0x7fe1a419a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:01.017 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:00.989+0000 7fe1abe7f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe1a41094a0 0x7fe1a419a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:01.017 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:00.989+0000 7fe1abe7f640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe1a4109df0 0x7fe1a419fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:01.018 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:00.989+0000 7fe1abe7f640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fe1a4113960 con 0x7fe1a4109df0 2024-09-21T01:41:01.018 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:00.989+0000 7fe1abe7f640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fe1a41137e0 con 0x7fe1a41094a0 2024-09-21T01:41:01.018 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:00.989+0000 7fe1abe7f640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fe1a4113ae0 con 0x7fe1a4103b60 2024-09-21T01:41:01.018 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:00.990+0000 7fe1aa41c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe1a4109df0 0x7fe1a419fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:01.018 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:00.990+0000 7fe1aa41c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe1a4109df0 0x7fe1a419fc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:58114/0 (socket says 172.21.15.83:58114) 2024-09-21T01:41:01.018 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:00.990+0000 7fe1aa41c640 1 -- 172.21.15.83:0/3852242843 learned_addr learned my addr 172.21.15.83:0/3852242843 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:41:01.018 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:00.990+0000 7fe1a9c1b640 1 --2- 172.21.15.83:0/3852242843 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe1a4103b60 0x7fe1a419a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:01.018 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:00.990+0000 7fe1a941a640 1 --2- 172.21.15.83:0/3852242843 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe1a41094a0 0x7fe1a419a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:01.018 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:00.990+0000 7fe1aa41c640 1 -- 172.21.15.83:0/3852242843 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe1a4103b60 msgr2=0x7fe1a419a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:01.018 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:00.990+0000 7fe1aa41c640 1 --2- 172.21.15.83:0/3852242843 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe1a4103b60 0x7fe1a419a3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:01.018 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:00.990+0000 7fe1aa41c640 1 -- 172.21.15.83:0/3852242843 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe1a41094a0 msgr2=0x7fe1a419a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:01.018 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:00.990+0000 7fe1aa41c640 1 --2- 172.21.15.83:0/3852242843 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe1a41094a0 0x7fe1a419a970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:01.018 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:00.990+0000 7fe1aa41c640 1 -- 172.21.15.83:0/3852242843 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1a41a0340 con 0x7fe1a4109df0 2024-09-21T01:41:01.019 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:00.990+0000 7fe1aa41c640 1 --2- 172.21.15.83:0/3852242843 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe1a4109df0 0x7fe1a419fc10 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fe19c00eaa0 tx=0x7fe19c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:41:01.019 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:00.990+0000 7fe19affd640 1 -- 172.21.15.83:0/3852242843 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe19c00cdb0 con 0x7fe1a4109df0 2024-09-21T01:41:01.019 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:00.990+0000 7fe19affd640 1 -- 172.21.15.83:0/3852242843 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe19c005020 con 0x7fe1a4109df0 2024-09-21T01:41:01.019 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:00.990+0000 7fe1abe7f640 1 -- 172.21.15.83:0/3852242843 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1a41a0630 con 0x7fe1a4109df0 2024-09-21T01:41:01.019 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:00.990+0000 7fe19affd640 1 -- 172.21.15.83:0/3852242843 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe19c0116d0 con 0x7fe1a4109df0 2024-09-21T01:41:01.019 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:00.990+0000 7fe1abe7f640 1 -- 172.21.15.83:0/3852242843 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1a41a6d90 con 0x7fe1a4109df0 2024-09-21T01:41:01.019 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:00.991+0000 7fe1abe7f640 1 -- 172.21.15.83:0/3852242843 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe1a4063b10 con 0x7fe1a4109df0 2024-09-21T01:41:01.019 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:00.993+0000 7fe19affd640 1 -- 172.21.15.83:0/3852242843 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7fe19c0051d0 con 0x7fe1a4109df0 2024-09-21T01:41:01.019 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:00.994+0000 7fe19affd640 1 --2- 172.21.15.83:0/3852242843 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fe1900b65f0 0x7fe1900b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:01.019 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:00.994+0000 7fe1a9c1b640 1 --2- 172.21.15.83:0/3852242843 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fe1900b65f0 0x7fe1900b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:01.019 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:00.994+0000 7fe19affd640 1 -- 172.21.15.83:0/3852242843 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9286+0+0 (secure 0 0 0) 0x7fe19c0e7fe0 con 0x7fe1a4109df0 2024-09-21T01:41:01.020 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:00.994+0000 7fe19affd640 1 --2- 172.21.15.83:0/3852242843 >> [v2:172.21.15.119:6808/3083907785,v1:172.21.15.119:6809/3083907785] conn(0x7fe1900c1900 0x7fe1900c3df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:01.020 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:00.994+0000 7fe19affd640 1 -- 172.21.15.83:0/3852242843 --> [v2:172.21.15.119:6808/3083907785,v1:172.21.15.119:6809/3083907785] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe19c014ec0 con 0x7fe1900c1900 2024-09-21T01:41:01.020 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:00.994+0000 7fe19affd640 1 -- 172.21.15.83:0/3852242843 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7fe19c0e8430 con 0x7fe1a4109df0 2024-09-21T01:41:01.020 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:00.994+0000 7fe1a9c1b640 1 --2- 172.21.15.83:0/3852242843 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fe1900b65f0 0x7fe1900b8b00 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fe1a00057c0 tx=0x7fe1a00058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:41:01.020 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:00.994+0000 7fe1a941a640 1 --2- 172.21.15.83:0/3852242843 >> [v2:172.21.15.119:6808/3083907785,v1:172.21.15.119:6809/3083907785] conn(0x7fe1900c1900 0x7fe1900c3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:01.020 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:00.995+0000 7fe1a941a640 1 --2- 172.21.15.83:0/3852242843 >> [v2:172.21.15.119:6808/3083907785,v1:172.21.15.119:6809/3083907785] conn(0x7fe1900c1900 0x7fe1900c3df0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:41:01.020 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:00.996+0000 7fe19affd640 1 -- 172.21.15.83:0/3852242843 <== osd.4 v2:172.21.15.119:6808/3083907785 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe19c014ec0 con 0x7fe1900c1900 2024-09-21T01:41:01.020 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:01.009+0000 7fe1abe7f640 1 -- 172.21.15.83:0/3852242843 --> [v2:172.21.15.119:6808/3083907785,v1:172.21.15.119:6809/3083907785] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fe1a4063f10 con 0x7fe1900c1900 2024-09-21T01:41:01.020 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:01.010+0000 7fe19affd640 1 -- 172.21.15.83:0/3852242843 <== osd.4 v2:172.21.15.119:6808/3083907785 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fe1a4063f10 con 0x7fe1900c1900 2024-09-21T01:41:01.020 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:01.010+0000 7fe1abe7f640 1 -- 172.21.15.83:0/3852242843 >> [v2:172.21.15.119:6808/3083907785,v1:172.21.15.119:6809/3083907785] conn(0x7fe1900c1900 msgr2=0x7fe1900c3df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:01.020 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:01.010+0000 7fe1abe7f640 1 --2- 172.21.15.83:0/3852242843 >> [v2:172.21.15.119:6808/3083907785,v1:172.21.15.119:6809/3083907785] conn(0x7fe1900c1900 0x7fe1900c3df0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:01.020 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:01.010+0000 7fe1abe7f640 1 -- 172.21.15.83:0/3852242843 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fe1900b65f0 msgr2=0x7fe1900b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:01.020 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:01.010+0000 7fe1abe7f640 1 --2- 172.21.15.83:0/3852242843 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fe1900b65f0 0x7fe1900b8b00 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fe1a00057c0 tx=0x7fe1a00058d0 comp rx=0 tx=0).stop 2024-09-21T01:41:01.021 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:01.010+0000 7fe1abe7f640 1 -- 172.21.15.83:0/3852242843 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe1a4109df0 msgr2=0x7fe1a419fc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:01.021 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:01.010+0000 7fe1abe7f640 1 --2- 172.21.15.83:0/3852242843 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe1a4109df0 0x7fe1a419fc10 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fe19c00eaa0 tx=0x7fe19c00ef60 comp rx=0 tx=0).stop 2024-09-21T01:41:01.021 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:01.010+0000 7fe1aa41c640 1 -- 172.21.15.83:0/3852242843 reap_dead start 2024-09-21T01:41:01.021 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:01.010+0000 7fe1abe7f640 1 -- 172.21.15.83:0/3852242843 shutdown_connections 2024-09-21T01:41:01.021 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:01.010+0000 7fe1abe7f640 1 -- 172.21.15.83:0/3852242843 >> 172.21.15.83:0/3852242843 conn(0x7fe1a407b850 msgr2=0x7fe1a41075e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:41:01.021 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:01.010+0000 7fe1abe7f640 1 -- 172.21.15.83:0/3852242843 shutdown_connections 2024-09-21T01:41:01.021 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:01.011+0000 7fe1abe7f640 1 -- 172.21.15.83:0/3852242843 wait complete. 2024-09-21T01:41:01.667 INFO:teuthology.orchestra.run.smithi083.stdout:128849018944 2024-09-21T01:41:01.667 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.4 2024-09-21T01:41:01.937 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:41:01 smithi083 ceph-mon[31370]: pgmap v306: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 511 B/s wr, 2 op/s 2024-09-21T01:41:02.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:41:01 smithi142 ceph-mon[34050]: pgmap v306: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 511 B/s wr, 2 op/s 2024-09-21T01:41:02.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:41:01 smithi119 ceph-mon[33693]: pgmap v306: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 511 B/s wr, 2 op/s 2024-09-21T01:41:02.630 INFO:teuthology.orchestra.run.smithi083.stdout:292057776157 2024-09-21T01:41:02.630 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.11 2024-09-21T01:41:02.806 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:02.798+0000 7f3023325640 1 -- 172.21.15.83:0/3719342967 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f301c1083a0 msgr2=0x7f301c1087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:02.806 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:02.798+0000 7f3023325640 1 --2- 172.21.15.83:0/3719342967 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f301c1083a0 0x7f301c1087b0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f300c009900 tx=0x7f300c02a410 comp rx=0 tx=0).stop 2024-09-21T01:41:02.807 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:02.798+0000 7f3023325640 1 -- 172.21.15.83:0/3719342967 shutdown_connections 2024-09-21T01:41:02.807 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:02.798+0000 7f3023325640 1 --2- 172.21.15.83:0/3719342967 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f301c108cf0 0x7f301c10f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:02.807 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:02.798+0000 7f3023325640 1 --2- 172.21.15.83:0/3719342967 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f301c1083a0 0x7f301c1087b0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:02.807 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:02.798+0000 7f3023325640 1 --2- 172.21.15.83:0/3719342967 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f301c102a60 0x7f301c102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:02.807 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:02.798+0000 7f3023325640 1 -- 172.21.15.83:0/3719342967 >> 172.21.15.83:0/3719342967 conn(0x7f301c079730 msgr2=0x7f301c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:41:02.807 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:02.798+0000 7f3023325640 1 -- 172.21.15.83:0/3719342967 shutdown_connections 2024-09-21T01:41:02.807 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:02.798+0000 7f3023325640 1 -- 172.21.15.83:0/3719342967 wait complete. 2024-09-21T01:41:02.807 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:02.799+0000 7f3023325640 1 Processor -- start 2024-09-21T01:41:02.807 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:02.799+0000 7f3023325640 1 -- start start 2024-09-21T01:41:02.807 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:02.799+0000 7f3023325640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f301c102a60 0x7f301c0ff670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:02.807 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:02.799+0000 7f3023325640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f301c1083a0 0x7f301c0ffbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:02.807 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:02.799+0000 7f3023325640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f301c108cf0 0x7f301c1000f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:02.807 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:02.799+0000 7f3023325640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f301c112850 con 0x7f301c108cf0 2024-09-21T01:41:02.808 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:02.799+0000 7f3023325640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f301c1126d0 con 0x7f301c1083a0 2024-09-21T01:41:02.808 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:02.799+0000 7f3023325640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f301c1129d0 con 0x7f301c102a60 2024-09-21T01:41:02.808 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:02.799+0000 7f30210c1640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f301c102a60 0x7f301c0ff670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:02.808 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:02.799+0000 7f30210c1640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f301c102a60 0x7f301c0ff670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.83:52940/0 (socket says 172.21.15.83:52940) 2024-09-21T01:41:02.808 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:02.799+0000 7f30210c1640 1 -- 172.21.15.83:0/3960347862 learned_addr learned my addr 172.21.15.83:0/3960347862 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:41:02.808 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:02.799+0000 7f30218c2640 1 --2- 172.21.15.83:0/3960347862 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f301c108cf0 0x7f301c1000f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:02.808 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:02.799+0000 7f30208c0640 1 --2- 172.21.15.83:0/3960347862 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f301c1083a0 0x7f301c0ffbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:02.808 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:02.800+0000 7f30218c2640 1 -- 172.21.15.83:0/3960347862 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f301c102a60 msgr2=0x7f301c0ff670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:02.808 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:02.800+0000 7f30218c2640 1 --2- 172.21.15.83:0/3960347862 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f301c102a60 0x7f301c0ff670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:02.808 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:02.800+0000 7f30218c2640 1 -- 172.21.15.83:0/3960347862 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f301c1083a0 msgr2=0x7f301c0ffbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:02.808 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:02.800+0000 7f30218c2640 1 --2- 172.21.15.83:0/3960347862 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f301c1083a0 0x7f301c0ffbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:02.808 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:02.800+0000 7f30218c2640 1 -- 172.21.15.83:0/3960347862 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f301c1a8750 con 0x7f301c108cf0 2024-09-21T01:41:02.808 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:02.800+0000 7f30218c2640 1 --2- 172.21.15.83:0/3960347862 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f301c108cf0 0x7f301c1000f0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f301400be20 tx=0x7f301400bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:41:02.808 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:02.800+0000 7f30127fc640 1 -- 172.21.15.83:0/3960347862 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3014019070 con 0x7f301c108cf0 2024-09-21T01:41:02.809 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:02.800+0000 7f3023325640 1 -- 172.21.15.83:0/3960347862 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f301c1a8a40 con 0x7f301c108cf0 2024-09-21T01:41:02.809 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:02.800+0000 7f30127fc640 1 -- 172.21.15.83:0/3960347862 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f30140148d0 con 0x7f301c108cf0 2024-09-21T01:41:02.809 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:02.800+0000 7f30127fc640 1 -- 172.21.15.83:0/3960347862 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30140127e0 con 0x7f301c108cf0 2024-09-21T01:41:02.809 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:02.800+0000 7f3023325640 1 -- 172.21.15.83:0/3960347862 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f301c1a8f00 con 0x7f301c108cf0 2024-09-21T01:41:02.809 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:02.801+0000 7f3023325640 1 -- 172.21.15.83:0/3960347862 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f301c063b50 con 0x7f301c108cf0 2024-09-21T01:41:02.809 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:02.804+0000 7f30127fc640 1 -- 172.21.15.83:0/3960347862 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7f301401c070 con 0x7f301c108cf0 2024-09-21T01:41:02.809 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:02.804+0000 7f30127fc640 1 --2- 172.21.15.83:0/3960347862 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f30080b65f0 0x7f30080b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:02.809 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:02.804+0000 7f30210c1640 1 --2- 172.21.15.83:0/3960347862 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f30080b65f0 0x7f30080b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:02.809 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:02.804+0000 7f30127fc640 1 -- 172.21.15.83:0/3960347862 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9286+0+0 (secure 0 0 0) 0x7f30140e7890 con 0x7f301c108cf0 2024-09-21T01:41:02.809 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:02.805+0000 7f30127fc640 1 --2- 172.21.15.83:0/3960347862 >> [v2:172.21.15.119:6800/2066870220,v1:172.21.15.119:6801/2066870220] conn(0x7f30080c1900 0x7f30080c3df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:02.809 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:02.805+0000 7f30127fc640 1 -- 172.21.15.83:0/3960347862 --> [v2:172.21.15.119:6800/2066870220,v1:172.21.15.119:6801/2066870220] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f30080c44c0 con 0x7f30080c1900 2024-09-21T01:41:02.809 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:02.805+0000 7f30127fc640 1 -- 172.21.15.83:0/3960347862 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f30140e7ce0 con 0x7f301c108cf0 2024-09-21T01:41:02.809 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:02.805+0000 7f30210c1640 1 --2- 172.21.15.83:0/3960347862 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f30080b65f0 0x7f30080b8b00 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f3018005fd0 tx=0x7f301800b480 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:41:02.809 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:02.805+0000 7f30208c0640 1 --2- 172.21.15.83:0/3960347862 >> [v2:172.21.15.119:6800/2066870220,v1:172.21.15.119:6801/2066870220] conn(0x7f30080c1900 0x7f30080c3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:02.809 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:02.806+0000 7f30208c0640 1 --2- 172.21.15.83:0/3960347862 >> [v2:172.21.15.119:6800/2066870220,v1:172.21.15.119:6801/2066870220] conn(0x7f30080c1900 0x7f30080c3df0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:41:02.810 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:02.806+0000 7f30127fc640 1 -- 172.21.15.83:0/3960347862 <== osd.1 v2:172.21.15.119:6800/2066870220 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f30080c44c0 con 0x7f30080c1900 2024-09-21T01:41:02.823 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:02.823+0000 7f3023325640 1 -- 172.21.15.83:0/3960347862 --> [v2:172.21.15.119:6800/2066870220,v1:172.21.15.119:6801/2066870220] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f301c063f50 con 0x7f30080c1900 2024-09-21T01:41:02.824 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:02.823+0000 7f30127fc640 1 -- 172.21.15.83:0/3960347862 <== osd.1 v2:172.21.15.119:6800/2066870220 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f301c063f50 con 0x7f30080c1900 2024-09-21T01:41:02.824 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:02.824+0000 7f3023325640 1 -- 172.21.15.83:0/3960347862 >> [v2:172.21.15.119:6800/2066870220,v1:172.21.15.119:6801/2066870220] conn(0x7f30080c1900 msgr2=0x7f30080c3df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:02.824 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:02.824+0000 7f3023325640 1 --2- 172.21.15.83:0/3960347862 >> [v2:172.21.15.119:6800/2066870220,v1:172.21.15.119:6801/2066870220] conn(0x7f30080c1900 0x7f30080c3df0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:02.824 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:02.824+0000 7f3023325640 1 -- 172.21.15.83:0/3960347862 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f30080b65f0 msgr2=0x7f30080b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:02.825 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:02.824+0000 7f3023325640 1 --2- 172.21.15.83:0/3960347862 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f30080b65f0 0x7f30080b8b00 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f3018005fd0 tx=0x7f301800b480 comp rx=0 tx=0).stop 2024-09-21T01:41:02.825 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:02.824+0000 7f3023325640 1 -- 172.21.15.83:0/3960347862 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f301c108cf0 msgr2=0x7f301c1000f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:02.825 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:02.824+0000 7f3023325640 1 --2- 172.21.15.83:0/3960347862 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f301c108cf0 0x7f301c1000f0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f301400be20 tx=0x7f301400bf10 comp rx=0 tx=0).stop 2024-09-21T01:41:02.825 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:02.824+0000 7f30218c2640 1 -- 172.21.15.83:0/3960347862 reap_dead start 2024-09-21T01:41:02.825 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:02.824+0000 7f3023325640 1 -- 172.21.15.83:0/3960347862 shutdown_connections 2024-09-21T01:41:02.825 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:02.824+0000 7f3023325640 1 -- 172.21.15.83:0/3960347862 >> 172.21.15.83:0/3960347862 conn(0x7f301c079730 msgr2=0x7f301c06b300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:41:02.825 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:02.824+0000 7f3023325640 1 -- 172.21.15.83:0/3960347862 shutdown_connections 2024-09-21T01:41:02.825 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:02.824+0000 7f3023325640 1 -- 172.21.15.83:0/3960347862 wait complete. 2024-09-21T01:41:03.509 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:41:03.523 INFO:teuthology.orchestra.run.smithi083.stdout:55834574927 2024-09-21T01:41:03.524 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.1 2024-09-21T01:41:03.962 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:41:03.966 INFO:teuthology.orchestra.run.smithi083.stdout:107374182469 2024-09-21T01:41:03.967 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.3 2024-09-21T01:41:04.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:41:03 smithi142 ceph-mon[34050]: pgmap v307: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:41:04.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:41:03 smithi119 ceph-mon[33693]: pgmap v307: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:41:04.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:41:03 smithi083 ceph-mon[31370]: pgmap v307: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:41:04.381 INFO:teuthology.orchestra.run.smithi083.stdout:38654705748 2024-09-21T01:41:04.382 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.0 2024-09-21T01:41:04.839 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:04.823+0000 7fcf57c02640 1 -- 172.21.15.83:0/3085858899 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcf50102240 msgr2=0x7fcf50102650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:04.840 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:04.823+0000 7fcf57c02640 1 --2- 172.21.15.83:0/3085858899 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcf50102240 0x7fcf50102650 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fcf4c009900 tx=0x7fcf4c02a410 comp rx=0 tx=0).stop 2024-09-21T01:41:04.840 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:04.823+0000 7fcf57c02640 1 -- 172.21.15.83:0/3085858899 shutdown_connections 2024-09-21T01:41:04.840 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:04.823+0000 7fcf57c02640 1 --2- 172.21.15.83:0/3085858899 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcf501084d0 0x7fcf5010ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:04.840 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:04.823+0000 7fcf57c02640 1 --2- 172.21.15.83:0/3085858899 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcf50107b80 0x7fcf50107f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:04.840 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:04.823+0000 7fcf57c02640 1 --2- 172.21.15.83:0/3085858899 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcf50102240 0x7fcf50102650 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:04.840 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:04.823+0000 7fcf57c02640 1 -- 172.21.15.83:0/3085858899 >> 172.21.15.83:0/3085858899 conn(0x7fcf50079f90 msgr2=0x7fcf5007a3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:41:04.840 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:04.823+0000 7fcf57c02640 1 -- 172.21.15.83:0/3085858899 shutdown_connections 2024-09-21T01:41:04.840 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:04.823+0000 7fcf57c02640 1 -- 172.21.15.83:0/3085858899 wait complete. 2024-09-21T01:41:04.840 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:04.824+0000 7fcf57c02640 1 Processor -- start 2024-09-21T01:41:04.840 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:04.824+0000 7fcf57c02640 1 -- start start 2024-09-21T01:41:04.840 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:04.824+0000 7fcf57c02640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcf50102240 0x7fcf5019a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:04.840 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:04.824+0000 7fcf57c02640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcf50107b80 0x7fcf5019a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:04.840 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:04.824+0000 7fcf57c02640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcf501084d0 0x7fcf5019fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:04.840 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:04.824+0000 7fcf57c02640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fcf501117c0 con 0x7fcf50102240 2024-09-21T01:41:04.840 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:04.824+0000 7fcf57c02640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fcf50111640 con 0x7fcf50107b80 2024-09-21T01:41:04.840 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:04.824+0000 7fcf57c02640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fcf50111940 con 0x7fcf501084d0 2024-09-21T01:41:04.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:04.824+0000 7fcf5599e640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcf50102240 0x7fcf5019a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:04.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:04.824+0000 7fcf5599e640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcf50102240 0x7fcf5019a430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:34494/0 (socket says 172.21.15.83:34494) 2024-09-21T01:41:04.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:04.824+0000 7fcf5599e640 1 -- 172.21.15.83:0/629697326 learned_addr learned my addr 172.21.15.83:0/629697326 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:41:04.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:04.824+0000 7fcf5519d640 1 --2- 172.21.15.83:0/629697326 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcf50107b80 0x7fcf5019a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:04.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:04.824+0000 7fcf5619f640 1 --2- 172.21.15.83:0/629697326 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcf501084d0 0x7fcf5019fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:04.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:04.824+0000 7fcf5599e640 1 -- 172.21.15.83:0/629697326 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcf501084d0 msgr2=0x7fcf5019fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:04.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:04.824+0000 7fcf5599e640 1 --2- 172.21.15.83:0/629697326 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcf501084d0 0x7fcf5019fc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:04.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:04.824+0000 7fcf5599e640 1 -- 172.21.15.83:0/629697326 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcf50107b80 msgr2=0x7fcf5019a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:04.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:04.824+0000 7fcf5599e640 1 --2- 172.21.15.83:0/629697326 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcf50107b80 0x7fcf5019a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:04.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:04.824+0000 7fcf5599e640 1 -- 172.21.15.83:0/629697326 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf501a02e0 con 0x7fcf50102240 2024-09-21T01:41:04.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:04.825+0000 7fcf5599e640 1 --2- 172.21.15.83:0/629697326 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcf50102240 0x7fcf5019a430 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fcf4c009230 tx=0x7fcf4c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:41:04.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:04.825+0000 7fcf46ffd640 1 -- 172.21.15.83:0/629697326 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf4c03f030 con 0x7fcf50102240 2024-09-21T01:41:04.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:04.825+0000 7fcf57c02640 1 -- 172.21.15.83:0/629697326 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf501a0570 con 0x7fcf50102240 2024-09-21T01:41:04.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:04.825+0000 7fcf46ffd640 1 -- 172.21.15.83:0/629697326 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcf4c003a80 con 0x7fcf50102240 2024-09-21T01:41:04.842 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:04.825+0000 7fcf46ffd640 1 -- 172.21.15.83:0/629697326 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf4c035070 con 0x7fcf50102240 2024-09-21T01:41:04.842 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:04.825+0000 7fcf57c02640 1 -- 172.21.15.83:0/629697326 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf501a0aa0 con 0x7fcf50102240 2024-09-21T01:41:04.842 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:04.826+0000 7fcf57c02640 1 -- 172.21.15.83:0/629697326 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fcf50063b50 con 0x7fcf50102240 2024-09-21T01:41:04.842 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:04.828+0000 7fcf46ffd640 1 -- 172.21.15.83:0/629697326 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7fcf4c042030 con 0x7fcf50102240 2024-09-21T01:41:04.842 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:04.828+0000 7fcf46ffd640 1 --2- 172.21.15.83:0/629697326 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fcf3c0b6620 0x7fcf3c0b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:04.842 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:04.828+0000 7fcf5519d640 1 --2- 172.21.15.83:0/629697326 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fcf3c0b6620 0x7fcf3c0b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:04.842 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:04.829+0000 7fcf46ffd640 1 -- 172.21.15.83:0/629697326 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9286+0+0 (secure 0 0 0) 0x7fcf4c108530 con 0x7fcf50102240 2024-09-21T01:41:04.842 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:04.829+0000 7fcf46ffd640 1 --2- 172.21.15.83:0/629697326 >> [v2:172.21.15.119:6816/1556984819,v1:172.21.15.119:6817/1556984819] conn(0x7fcf3c0c1930 0x7fcf3c0c3e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:04.842 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:04.829+0000 7fcf46ffd640 1 -- 172.21.15.83:0/629697326 --> [v2:172.21.15.119:6816/1556984819,v1:172.21.15.119:6817/1556984819] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fcf4c03ce50 con 0x7fcf3c0c1930 2024-09-21T01:41:04.842 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:04.829+0000 7fcf46ffd640 1 -- 172.21.15.83:0/629697326 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7fcf4c108980 con 0x7fcf50102240 2024-09-21T01:41:04.842 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:04.829+0000 7fcf5519d640 1 --2- 172.21.15.83:0/629697326 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fcf3c0b6620 0x7fcf3c0b8b30 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fcf5007a3e0 tx=0x7fcf4000a2d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:41:04.842 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:04.829+0000 7fcf5619f640 1 --2- 172.21.15.83:0/629697326 >> [v2:172.21.15.119:6816/1556984819,v1:172.21.15.119:6817/1556984819] conn(0x7fcf3c0c1930 0x7fcf3c0c3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:04.842 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:04.830+0000 7fcf5619f640 1 --2- 172.21.15.83:0/629697326 >> [v2:172.21.15.119:6816/1556984819,v1:172.21.15.119:6817/1556984819] conn(0x7fcf3c0c1930 0x7fcf3c0c3e20 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:41:04.842 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:04.830+0000 7fcf46ffd640 1 -- 172.21.15.83:0/629697326 <== osd.7 v2:172.21.15.119:6816/1556984819 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fcf4c03ce50 con 0x7fcf3c0c1930 2024-09-21T01:41:04.844 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:04.844+0000 7fcf57c02640 1 -- 172.21.15.83:0/629697326 --> [v2:172.21.15.119:6816/1556984819,v1:172.21.15.119:6817/1556984819] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fcf50063f50 con 0x7fcf3c0c1930 2024-09-21T01:41:04.845 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:04.845+0000 7fcf46ffd640 1 -- 172.21.15.83:0/629697326 <== osd.7 v2:172.21.15.119:6816/1556984819 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fcf50063f50 con 0x7fcf3c0c1930 2024-09-21T01:41:04.846 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:04.845+0000 7fcf57c02640 1 -- 172.21.15.83:0/629697326 >> [v2:172.21.15.119:6816/1556984819,v1:172.21.15.119:6817/1556984819] conn(0x7fcf3c0c1930 msgr2=0x7fcf3c0c3e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:04.846 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:04.845+0000 7fcf57c02640 1 --2- 172.21.15.83:0/629697326 >> [v2:172.21.15.119:6816/1556984819,v1:172.21.15.119:6817/1556984819] conn(0x7fcf3c0c1930 0x7fcf3c0c3e20 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:04.846 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:04.845+0000 7fcf57c02640 1 -- 172.21.15.83:0/629697326 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fcf3c0b6620 msgr2=0x7fcf3c0b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:04.846 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:04.845+0000 7fcf57c02640 1 --2- 172.21.15.83:0/629697326 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fcf3c0b6620 0x7fcf3c0b8b30 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fcf5007a3e0 tx=0x7fcf4000a2d0 comp rx=0 tx=0).stop 2024-09-21T01:41:04.846 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:04.845+0000 7fcf57c02640 1 -- 172.21.15.83:0/629697326 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcf50102240 msgr2=0x7fcf5019a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:04.846 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:04.845+0000 7fcf57c02640 1 --2- 172.21.15.83:0/629697326 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcf50102240 0x7fcf5019a430 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fcf4c009230 tx=0x7fcf4c004270 comp rx=0 tx=0).stop 2024-09-21T01:41:04.846 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:04.845+0000 7fcf5619f640 1 -- 172.21.15.83:0/629697326 reap_dead start 2024-09-21T01:41:04.846 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:04.845+0000 7fcf57c02640 1 -- 172.21.15.83:0/629697326 shutdown_connections 2024-09-21T01:41:04.846 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:04.845+0000 7fcf57c02640 1 -- 172.21.15.83:0/629697326 >> 172.21.15.83:0/629697326 conn(0x7fcf50079f90 msgr2=0x7fcf50101420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:41:04.846 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:04.845+0000 7fcf57c02640 1 -- 172.21.15.83:0/629697326 shutdown_connections 2024-09-21T01:41:04.846 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:04.845+0000 7fcf57c02640 1 -- 172.21.15.83:0/629697326 wait complete. 2024-09-21T01:41:05.463 INFO:teuthology.orchestra.run.smithi083.stdout:197568495665 2024-09-21T01:41:05.463 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.7 2024-09-21T01:41:05.481 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:41:05.706 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:41:05.710 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:41:05.713 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:41:05.974 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:41:05 smithi083 ceph-mon[31370]: pgmap v308: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T01:41:06.185 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:05.955+0000 7f8c6aefd640 1 -- 172.21.15.83:0/371272358 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8c64103230 msgr2=0x7f8c64103640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:06.186 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:05.955+0000 7f8c6aefd640 1 --2- 172.21.15.83:0/371272358 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8c64103230 0x7f8c64103640 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f8c58009900 tx=0x7f8c5802a410 comp rx=0 tx=0).stop 2024-09-21T01:41:06.186 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:05.955+0000 7f8c6aefd640 1 -- 172.21.15.83:0/371272358 shutdown_connections 2024-09-21T01:41:06.186 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:05.955+0000 7f8c6aefd640 1 --2- 172.21.15.83:0/371272358 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8c64108fc0 0x7f8c6410f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:06.186 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:05.955+0000 7f8c6aefd640 1 --2- 172.21.15.83:0/371272358 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8c64108670 0x7f8c64108a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:06.186 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:05.955+0000 7f8c6aefd640 1 --2- 172.21.15.83:0/371272358 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8c64103230 0x7f8c64103640 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:06.186 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:05.955+0000 7f8c6aefd640 1 -- 172.21.15.83:0/371272358 >> 172.21.15.83:0/371272358 conn(0x7f8c64079ea0 msgr2=0x7f8c6407a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:41:06.186 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:05.955+0000 7f8c6aefd640 1 -- 172.21.15.83:0/371272358 shutdown_connections 2024-09-21T01:41:06.186 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:05.955+0000 7f8c6aefd640 1 -- 172.21.15.83:0/371272358 wait complete. 2024-09-21T01:41:06.186 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:05.956+0000 7f8c6aefd640 1 Processor -- start 2024-09-21T01:41:06.186 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:05.956+0000 7f8c6aefd640 1 -- start start 2024-09-21T01:41:06.186 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:05.956+0000 7f8c6aefd640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8c64103230 0x7f8c6419a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:06.187 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:05.956+0000 7f8c6aefd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8c64108670 0x7f8c6419acd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:06.187 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:05.956+0000 7f8c6aefd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8c64108fc0 0x7f8c6419ff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:06.187 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:05.956+0000 7f8c6aefd640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f8c64112b30 con 0x7f8c64108fc0 2024-09-21T01:41:06.187 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:05.956+0000 7f8c6aefd640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f8c641129b0 con 0x7f8c64108670 2024-09-21T01:41:06.187 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:05.956+0000 7f8c6aefd640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f8c64112cb0 con 0x7f8c64103230 2024-09-21T01:41:06.187 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:05.956+0000 7f8c6949a640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8c64108fc0 0x7f8c6419ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:06.187 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:05.956+0000 7f8c6949a640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8c64108fc0 0x7f8c6419ff70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:34504/0 (socket says 172.21.15.83:34504) 2024-09-21T01:41:06.187 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:05.956+0000 7f8c6949a640 1 -- 172.21.15.83:0/2384190490 learned_addr learned my addr 172.21.15.83:0/2384190490 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:41:06.187 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:05.957+0000 7f8c68c99640 1 --2- 172.21.15.83:0/2384190490 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8c64103230 0x7f8c6419a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:06.187 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:05.957+0000 7f8c63fff640 1 --2- 172.21.15.83:0/2384190490 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8c64108670 0x7f8c6419acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:06.187 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:05.957+0000 7f8c6949a640 1 -- 172.21.15.83:0/2384190490 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8c64103230 msgr2=0x7f8c6419a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:06.187 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:05.957+0000 7f8c6949a640 1 --2- 172.21.15.83:0/2384190490 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8c64103230 0x7f8c6419a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:06.187 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:05.957+0000 7f8c6949a640 1 -- 172.21.15.83:0/2384190490 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8c64108670 msgr2=0x7f8c6419acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:06.187 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:05.957+0000 7f8c6949a640 1 --2- 172.21.15.83:0/2384190490 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8c64108670 0x7f8c6419acd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:06.188 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:05.957+0000 7f8c6949a640 1 -- 172.21.15.83:0/2384190490 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c641a06a0 con 0x7f8c64108fc0 2024-09-21T01:41:06.188 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:05.957+0000 7f8c63fff640 1 --2- 172.21.15.83:0/2384190490 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8c64108670 0x7f8c6419acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:41:06.188 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:05.957+0000 7f8c6949a640 1 --2- 172.21.15.83:0/2384190490 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8c64108fc0 0x7f8c6419ff70 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f8c5c00eaa0 tx=0x7f8c5c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:41:06.188 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:05.957+0000 7f8c61ffb640 1 -- 172.21.15.83:0/2384190490 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c5c00cdb0 con 0x7f8c64108fc0 2024-09-21T01:41:06.188 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:05.957+0000 7f8c61ffb640 1 -- 172.21.15.83:0/2384190490 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8c5c005020 con 0x7f8c64108fc0 2024-09-21T01:41:06.188 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:05.957+0000 7f8c6aefd640 1 -- 172.21.15.83:0/2384190490 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c641a0990 con 0x7f8c64108fc0 2024-09-21T01:41:06.188 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:05.957+0000 7f8c61ffb640 1 -- 172.21.15.83:0/2384190490 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c5c0116d0 con 0x7f8c64108fc0 2024-09-21T01:41:06.188 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:05.957+0000 7f8c6aefd640 1 -- 172.21.15.83:0/2384190490 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c641a70f0 con 0x7f8c64108fc0 2024-09-21T01:41:06.188 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:05.958+0000 7f8c6aefd640 1 -- 172.21.15.83:0/2384190490 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8c64063a90 con 0x7f8c64108fc0 2024-09-21T01:41:06.188 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:05.960+0000 7f8c61ffb640 1 -- 172.21.15.83:0/2384190490 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7f8c5c0051d0 con 0x7f8c64108fc0 2024-09-21T01:41:06.188 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:05.960+0000 7f8c61ffb640 1 --2- 172.21.15.83:0/2384190490 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f8c540b65f0 0x7f8c540b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:06.188 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:05.961+0000 7f8c68c99640 1 --2- 172.21.15.83:0/2384190490 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f8c540b65f0 0x7f8c540b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:06.189 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:05.961+0000 7f8c61ffb640 1 -- 172.21.15.83:0/2384190490 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9286+0+0 (secure 0 0 0) 0x7f8c5c0e7f50 con 0x7f8c64108fc0 2024-09-21T01:41:06.189 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:05.961+0000 7f8c61ffb640 1 --2- 172.21.15.83:0/2384190490 >> [v2:172.21.15.83:6818/771651063,v1:172.21.15.83:6819/771651063] conn(0x7f8c540c1900 0x7f8c540c3df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:06.189 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:05.961+0000 7f8c61ffb640 1 -- 172.21.15.83:0/2384190490 --> [v2:172.21.15.83:6818/771651063,v1:172.21.15.83:6819/771651063] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8c5c018ec0 con 0x7f8c540c1900 2024-09-21T01:41:06.189 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:05.961+0000 7f8c61ffb640 1 -- 172.21.15.83:0/2384190490 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f8c5c0e83a0 con 0x7f8c64108fc0 2024-09-21T01:41:06.189 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:05.961+0000 7f8c63fff640 1 --2- 172.21.15.83:0/2384190490 >> [v2:172.21.15.83:6818/771651063,v1:172.21.15.83:6819/771651063] conn(0x7f8c540c1900 0x7f8c540c3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:06.189 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:05.961+0000 7f8c68c99640 1 --2- 172.21.15.83:0/2384190490 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f8c540b65f0 0x7f8c540b8b00 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f8c58000c00 tx=0x7f8c58009680 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:41:06.189 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:05.961+0000 7f8c63fff640 1 --2- 172.21.15.83:0/2384190490 >> [v2:172.21.15.83:6818/771651063,v1:172.21.15.83:6819/771651063] conn(0x7f8c540c1900 0x7f8c540c3df0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:41:06.189 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:05.962+0000 7f8c61ffb640 1 -- 172.21.15.83:0/2384190490 <== osd.6 v2:172.21.15.83:6818/771651063 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8c5c018ec0 con 0x7f8c540c1900 2024-09-21T01:41:06.189 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:05.976+0000 7f8c6aefd640 1 -- 172.21.15.83:0/2384190490 --> [v2:172.21.15.83:6818/771651063,v1:172.21.15.83:6819/771651063] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f8c64063f10 con 0x7f8c540c1900 2024-09-21T01:41:06.189 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:05.977+0000 7f8c61ffb640 1 -- 172.21.15.83:0/2384190490 <== osd.6 v2:172.21.15.83:6818/771651063 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f8c64063f10 con 0x7f8c540c1900 2024-09-21T01:41:06.189 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:05.977+0000 7f8c6aefd640 1 -- 172.21.15.83:0/2384190490 >> [v2:172.21.15.83:6818/771651063,v1:172.21.15.83:6819/771651063] conn(0x7f8c540c1900 msgr2=0x7f8c540c3df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:06.190 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:05.977+0000 7f8c6aefd640 1 --2- 172.21.15.83:0/2384190490 >> [v2:172.21.15.83:6818/771651063,v1:172.21.15.83:6819/771651063] conn(0x7f8c540c1900 0x7f8c540c3df0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:06.190 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:05.977+0000 7f8c6aefd640 1 -- 172.21.15.83:0/2384190490 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f8c540b65f0 msgr2=0x7f8c540b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:06.190 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:05.977+0000 7f8c6aefd640 1 --2- 172.21.15.83:0/2384190490 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f8c540b65f0 0x7f8c540b8b00 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f8c58000c00 tx=0x7f8c58009680 comp rx=0 tx=0).stop 2024-09-21T01:41:06.190 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:05.977+0000 7f8c6aefd640 1 -- 172.21.15.83:0/2384190490 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8c64108fc0 msgr2=0x7f8c6419ff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:06.190 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:05.977+0000 7f8c6aefd640 1 --2- 172.21.15.83:0/2384190490 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8c64108fc0 0x7f8c6419ff70 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f8c5c00eaa0 tx=0x7f8c5c00ef60 comp rx=0 tx=0).stop 2024-09-21T01:41:06.190 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:05.977+0000 7f8c6949a640 1 -- 172.21.15.83:0/2384190490 reap_dead start 2024-09-21T01:41:06.190 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:05.977+0000 7f8c6aefd640 1 -- 172.21.15.83:0/2384190490 shutdown_connections 2024-09-21T01:41:06.190 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:05.977+0000 7f8c6aefd640 1 -- 172.21.15.83:0/2384190490 >> 172.21.15.83:0/2384190490 conn(0x7f8c64079ea0 msgr2=0x7f8c64101440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:41:06.190 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:05.978+0000 7f8c6aefd640 1 -- 172.21.15.83:0/2384190490 shutdown_connections 2024-09-21T01:41:06.190 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:05.978+0000 7f8c6aefd640 1 -- 172.21.15.83:0/2384190490 wait complete. 2024-09-21T01:41:06.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:41:05 smithi142 ceph-mon[34050]: pgmap v308: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T01:41:06.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:41:05 smithi119 ceph-mon[33693]: pgmap v308: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T01:41:06.817 INFO:teuthology.orchestra.run.smithi083.stdout:176093659190 2024-09-21T01:41:06.818 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.6 2024-09-21T01:41:07.037 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:41:07.037 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:41:07.041 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:41:07.267 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:41:07.598 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:07.595+0000 7f3ba2fbe640 1 -- 172.21.15.83:0/128337035 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3b9c1083d0 msgr2=0x7f3b9c1087e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:07.598 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:07.595+0000 7f3ba2fbe640 1 --2- 172.21.15.83:0/128337035 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3b9c1083d0 0x7f3b9c1087e0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f3b88009900 tx=0x7f3b8802a410 comp rx=0 tx=0).stop 2024-09-21T01:41:07.599 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:07.595+0000 7f3ba2fbe640 1 -- 172.21.15.83:0/128337035 shutdown_connections 2024-09-21T01:41:07.599 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:07.595+0000 7f3ba2fbe640 1 --2- 172.21.15.83:0/128337035 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3b9c108d20 0x7f3b9c10f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:07.599 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:07.595+0000 7f3ba2fbe640 1 --2- 172.21.15.83:0/128337035 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3b9c1083d0 0x7f3b9c1087e0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:07.599 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:07.595+0000 7f3ba2fbe640 1 --2- 172.21.15.83:0/128337035 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3b9c102ae0 0x7f3b9c102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:07.599 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:07.595+0000 7f3ba2fbe640 1 -- 172.21.15.83:0/128337035 >> 172.21.15.83:0/128337035 conn(0x7f3b9c079790 msgr2=0x7f3b9c079ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:41:07.599 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:07.595+0000 7f3ba2fbe640 1 -- 172.21.15.83:0/128337035 shutdown_connections 2024-09-21T01:41:07.599 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:07.595+0000 7f3ba2fbe640 1 -- 172.21.15.83:0/128337035 wait complete. 2024-09-21T01:41:07.599 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:07.596+0000 7f3ba2fbe640 1 Processor -- start 2024-09-21T01:41:07.599 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:07.596+0000 7f3ba2fbe640 1 -- start start 2024-09-21T01:41:07.599 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:07.596+0000 7f3ba2fbe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3b9c102ae0 0x7f3b9c198fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:07.599 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:07.596+0000 7f3ba2fbe640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3b9c1083d0 0x7f3b9c1994f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:07.599 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:07.596+0000 7f3ba2fbe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3b9c108d20 0x7f3b9c199a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:07.600 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:07.596+0000 7f3ba2fbe640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f3b9c112890 con 0x7f3b9c108d20 2024-09-21T01:41:07.600 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:07.596+0000 7f3ba2fbe640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f3b9c112710 con 0x7f3b9c102ae0 2024-09-21T01:41:07.600 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:07.596+0000 7f3ba2fbe640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f3b9c112a10 con 0x7f3b9c1083d0 2024-09-21T01:41:07.600 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:07.596+0000 7f3ba155b640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3b9c108d20 0x7f3b9c199a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:07.600 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:07.596+0000 7f3ba155b640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3b9c108d20 0x7f3b9c199a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:34550/0 (socket says 172.21.15.83:34550) 2024-09-21T01:41:07.600 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:07.596+0000 7f3ba155b640 1 -- 172.21.15.83:0/4037875626 learned_addr learned my addr 172.21.15.83:0/4037875626 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:41:07.600 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:07.597+0000 7f3b9bfff640 1 --2- 172.21.15.83:0/4037875626 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3b9c1083d0 0x7f3b9c1994f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:07.600 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:07.597+0000 7f3ba0d5a640 1 --2- 172.21.15.83:0/4037875626 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3b9c102ae0 0x7f3b9c198fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:07.601 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:07.597+0000 7f3ba155b640 1 -- 172.21.15.83:0/4037875626 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3b9c1083d0 msgr2=0x7f3b9c1994f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:07.601 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:07.597+0000 7f3ba155b640 1 --2- 172.21.15.83:0/4037875626 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3b9c1083d0 0x7f3b9c1994f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:07.601 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:07.597+0000 7f3ba155b640 1 -- 172.21.15.83:0/4037875626 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3b9c102ae0 msgr2=0x7f3b9c198fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:07.602 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:07.597+0000 7f3ba155b640 1 --2- 172.21.15.83:0/4037875626 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3b9c102ae0 0x7f3b9c198fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:07.602 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:07.597+0000 7f3ba155b640 1 -- 172.21.15.83:0/4037875626 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b9c1a8660 con 0x7f3b9c108d20 2024-09-21T01:41:07.602 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:07.597+0000 7f3b9bfff640 1 --2- 172.21.15.83:0/4037875626 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3b9c1083d0 0x7f3b9c1994f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:41:07.602 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:07.597+0000 7f3ba0d5a640 1 --2- 172.21.15.83:0/4037875626 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3b9c102ae0 0x7f3b9c198fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:41:07.602 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:07.597+0000 7f3ba155b640 1 --2- 172.21.15.83:0/4037875626 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3b9c108d20 0x7f3b9c199a30 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f3b9400eaa0 tx=0x7f3b9400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:41:07.602 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:07.597+0000 7f3b99ffb640 1 -- 172.21.15.83:0/4037875626 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b9400cdb0 con 0x7f3b9c108d20 2024-09-21T01:41:07.602 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:07.597+0000 7f3ba2fbe640 1 -- 172.21.15.83:0/4037875626 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b9c1a8950 con 0x7f3b9c108d20 2024-09-21T01:41:07.602 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:07.597+0000 7f3b99ffb640 1 -- 172.21.15.83:0/4037875626 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3b94005020 con 0x7f3b9c108d20 2024-09-21T01:41:07.602 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:07.598+0000 7f3b99ffb640 1 -- 172.21.15.83:0/4037875626 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b940116d0 con 0x7f3b9c108d20 2024-09-21T01:41:07.602 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:07.598+0000 7f3ba2fbe640 1 -- 172.21.15.83:0/4037875626 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b9c1a8eb0 con 0x7f3b9c108d20 2024-09-21T01:41:07.602 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:07.600+0000 7f3ba2fbe640 1 -- 172.21.15.83:0/4037875626 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b9c102ef0 con 0x7f3b9c108d20 2024-09-21T01:41:07.602 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:07.600+0000 7f3b99ffb640 1 -- 172.21.15.83:0/4037875626 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7f3b94004b20 con 0x7f3b9c108d20 2024-09-21T01:41:07.602 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:07.601+0000 7f3b99ffb640 1 --2- 172.21.15.83:0/4037875626 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f3b8c0b6670 0x7f3b8c0b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:07.603 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:07.601+0000 7f3ba0d5a640 1 --2- 172.21.15.83:0/4037875626 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f3b8c0b6670 0x7f3b8c0b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:07.603 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:07.601+0000 7f3b99ffb640 1 -- 172.21.15.83:0/4037875626 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9286+0+0 (secure 0 0 0) 0x7f3b940e7a50 con 0x7f3b9c108d20 2024-09-21T01:41:07.603 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:07.602+0000 7f3ba0d5a640 1 --2- 172.21.15.83:0/4037875626 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f3b8c0b6670 0x7f3b8c0b8b80 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f3b90005d00 tx=0x7f3b90005ef0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:41:07.606 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:07.606+0000 7f3b99ffb640 1 -- 172.21.15.83:0/4037875626 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3b94016030 con 0x7f3b9c108d20 2024-09-21T01:41:07.724 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:07.489+0000 7f6f3b660640 1 -- 172.21.15.83:0/1397522571 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6f341094a0 msgr2=0x7f6f341098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:07.724 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:07.489+0000 7f6f3b660640 1 --2- 172.21.15.83:0/1397522571 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6f341094a0 0x7f6f341098b0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f6f24009900 tx=0x7f6f2402a410 comp rx=0 tx=0).stop 2024-09-21T01:41:07.724 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:07.489+0000 7f6f3b660640 1 -- 172.21.15.83:0/1397522571 shutdown_connections 2024-09-21T01:41:07.724 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:07.489+0000 7f6f3b660640 1 --2- 172.21.15.83:0/1397522571 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f34109df0 0x7f6f34110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:07.724 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:07.489+0000 7f6f3b660640 1 --2- 172.21.15.83:0/1397522571 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6f341094a0 0x7f6f341098b0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:07.724 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:07.489+0000 7f6f3b660640 1 --2- 172.21.15.83:0/1397522571 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6f34103b60 0x7f6f34103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:07.724 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:07.489+0000 7f6f3b660640 1 -- 172.21.15.83:0/1397522571 >> 172.21.15.83:0/1397522571 conn(0x7f6f3407b850 msgr2=0x7f6f3407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:41:07.724 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:07.490+0000 7f6f3b660640 1 -- 172.21.15.83:0/1397522571 shutdown_connections 2024-09-21T01:41:07.724 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:07.490+0000 7f6f3b660640 1 -- 172.21.15.83:0/1397522571 wait complete. 2024-09-21T01:41:07.724 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:07.490+0000 7f6f3b660640 1 Processor -- start 2024-09-21T01:41:07.724 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:07.490+0000 7f6f3b660640 1 -- start start 2024-09-21T01:41:07.725 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:07.490+0000 7f6f3b660640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6f34103b60 0x7f6f3419a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:07.725 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:07.491+0000 7f6f3b660640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6f341094a0 0x7f6f3419a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:07.725 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:07.491+0000 7f6f3b660640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f34109df0 0x7f6f3419fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:07.725 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:07.491+0000 7f6f3b660640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f6f34113960 con 0x7f6f341094a0 2024-09-21T01:41:07.725 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:07.491+0000 7f6f3b660640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f6f341137e0 con 0x7f6f34103b60 2024-09-21T01:41:07.725 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:07.491+0000 7f6f3b660640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f6f34113ae0 con 0x7f6f34109df0 2024-09-21T01:41:07.725 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:07.491+0000 7f6f38bfb640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6f341094a0 0x7f6f3419a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:07.725 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:07.491+0000 7f6f38bfb640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6f341094a0 0x7f6f3419a9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:34526/0 (socket says 172.21.15.83:34526) 2024-09-21T01:41:07.725 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:07.491+0000 7f6f38bfb640 1 -- 172.21.15.83:0/3773686232 learned_addr learned my addr 172.21.15.83:0/3773686232 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:41:07.725 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:07.491+0000 7f6f39bfd640 1 --2- 172.21.15.83:0/3773686232 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f34109df0 0x7f6f3419fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:07.725 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:07.491+0000 7f6f393fc640 1 --2- 172.21.15.83:0/3773686232 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6f34103b60 0x7f6f3419a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:07.726 INFO:teuthology.orchestra.run.smithi083.stdout:55834574928 2024-09-21T01:41:07.726 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:07.491+0000 7f6f38bfb640 1 -- 172.21.15.83:0/3773686232 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f34109df0 msgr2=0x7f6f3419fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:07.726 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:07.491+0000 7f6f38bfb640 1 --2- 172.21.15.83:0/3773686232 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f34109df0 0x7f6f3419fc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:07.726 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:07.491+0000 7f6f38bfb640 1 -- 172.21.15.83:0/3773686232 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6f34103b60 msgr2=0x7f6f3419a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:07.726 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:07.491+0000 7f6f38bfb640 1 --2- 172.21.15.83:0/3773686232 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6f34103b60 0x7f6f3419a410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:07.726 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:07.491+0000 7f6f38bfb640 1 -- 172.21.15.83:0/3773686232 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f341a0380 con 0x7f6f341094a0 2024-09-21T01:41:07.726 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:07.491+0000 7f6f39bfd640 1 --2- 172.21.15.83:0/3773686232 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f34109df0 0x7f6f3419fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:41:07.726 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:07.491+0000 7f6f38bfb640 1 --2- 172.21.15.83:0/3773686232 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6f341094a0 0x7f6f3419a9b0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f6f24005940 tx=0x7f6f240040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:41:07.727 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:07.491+0000 7f6f2a7fc640 1 -- 172.21.15.83:0/3773686232 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f2403f030 con 0x7f6f341094a0 2024-09-21T01:41:07.727 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:07.491+0000 7f6f2a7fc640 1 -- 172.21.15.83:0/3773686232 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6f24003a80 con 0x7f6f341094a0 2024-09-21T01:41:07.727 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:07.491+0000 7f6f3b660640 1 -- 172.21.15.83:0/3773686232 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f341a0610 con 0x7f6f341094a0 2024-09-21T01:41:07.727 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:07.491+0000 7f6f2a7fc640 1 -- 172.21.15.83:0/3773686232 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f24035070 con 0x7f6f341094a0 2024-09-21T01:41:07.727 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:07.491+0000 7f6f3b660640 1 -- 172.21.15.83:0/3773686232 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f341a6dd0 con 0x7f6f341094a0 2024-09-21T01:41:07.727 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:07.492+0000 7f6f3b660640 1 -- 172.21.15.83:0/3773686232 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f34104de0 con 0x7f6f341094a0 2024-09-21T01:41:07.727 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:07.494+0000 7f6f2a7fc640 1 -- 172.21.15.83:0/3773686232 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7f6f24042030 con 0x7f6f341094a0 2024-09-21T01:41:07.727 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:07.495+0000 7f6f2a7fc640 1 --2- 172.21.15.83:0/3773686232 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f6f200b65f0 0x7f6f200b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:07.727 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:07.495+0000 7f6f2a7fc640 1 -- 172.21.15.83:0/3773686232 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9286+0+0 (secure 0 0 0) 0x7f6f24108350 con 0x7f6f341094a0 2024-09-21T01:41:07.727 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:07.495+0000 7f6f393fc640 1 --2- 172.21.15.83:0/3773686232 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f6f200b65f0 0x7f6f200b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:07.727 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:07.495+0000 7f6f393fc640 1 --2- 172.21.15.83:0/3773686232 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f6f200b65f0 0x7f6f200b8b00 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f6f30005fd0 tx=0x7f6f30005850 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:41:07.727 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:07.498+0000 7f6f2a7fc640 1 -- 172.21.15.83:0/3773686232 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6f240ce660 con 0x7f6f341094a0 2024-09-21T01:41:07.728 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:07.694+0000 7f6f3b660640 1 -- 172.21.15.83:0/3773686232 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f6f3410bbe0 con 0x7f6f341094a0 2024-09-21T01:41:07.728 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:07.694+0000 7f6f2a7fc640 1 -- 172.21.15.83:0/3773686232 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f6f240d2a40 con 0x7f6f341094a0 2024-09-21T01:41:07.728 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:07.696+0000 7f6f3b660640 1 -- 172.21.15.83:0/3773686232 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f6f200b65f0 msgr2=0x7f6f200b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:07.728 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:07.696+0000 7f6f3b660640 1 --2- 172.21.15.83:0/3773686232 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f6f200b65f0 0x7f6f200b8b00 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f6f30005fd0 tx=0x7f6f30005850 comp rx=0 tx=0).stop 2024-09-21T01:41:07.728 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:07.696+0000 7f6f3b660640 1 -- 172.21.15.83:0/3773686232 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6f341094a0 msgr2=0x7f6f3419a9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:07.728 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:07.696+0000 7f6f3b660640 1 --2- 172.21.15.83:0/3773686232 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6f341094a0 0x7f6f3419a9b0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f6f24005940 tx=0x7f6f240040e0 comp rx=0 tx=0).stop 2024-09-21T01:41:07.728 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:07.697+0000 7f6f3b660640 1 -- 172.21.15.83:0/3773686232 shutdown_connections 2024-09-21T01:41:07.728 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:07.697+0000 7f6f3b660640 1 --2- 172.21.15.83:0/3773686232 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f6f200b65f0 0x7f6f200b8b00 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:07.728 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:07.697+0000 7f6f3b660640 1 --2- 172.21.15.83:0/3773686232 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f34109df0 0x7f6f3419fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:07.728 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:07.697+0000 7f6f3b660640 1 --2- 172.21.15.83:0/3773686232 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6f341094a0 0x7f6f3419a9b0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:07.728 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:07.697+0000 7f6f3b660640 1 --2- 172.21.15.83:0/3773686232 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6f34103b60 0x7f6f3419a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:07.728 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:07.697+0000 7f6f3b660640 1 -- 172.21.15.83:0/3773686232 >> 172.21.15.83:0/3773686232 conn(0x7f6f3407b850 msgr2=0x7f6f34105560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:41:07.729 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:07.697+0000 7f6f3b660640 1 -- 172.21.15.83:0/3773686232 shutdown_connections 2024-09-21T01:41:07.729 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:07.697+0000 7f6f3b660640 1 -- 172.21.15.83:0/3773686232 wait complete. 2024-09-21T01:41:07.793 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:07.792+0000 7f3ba2fbe640 1 -- 172.21.15.83:0/4037875626 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7f3b9c10a580 con 0x7f3b9c108d20 2024-09-21T01:41:07.793 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:07.793+0000 7f3b99ffb640 1 -- 172.21.15.83:0/4037875626 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f3b940add60 con 0x7f3b9c108d20 2024-09-21T01:41:07.793 INFO:teuthology.orchestra.run.smithi083.stdout:292057776158 2024-09-21T01:41:07.796 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:07.795+0000 7f3ba2fbe640 1 -- 172.21.15.83:0/4037875626 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f3b8c0b6670 msgr2=0x7f3b8c0b8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:07.796 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:07.795+0000 7f3ba2fbe640 1 --2- 172.21.15.83:0/4037875626 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f3b8c0b6670 0x7f3b8c0b8b80 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f3b90005d00 tx=0x7f3b90005ef0 comp rx=0 tx=0).stop 2024-09-21T01:41:07.797 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:07.795+0000 7f3ba2fbe640 1 -- 172.21.15.83:0/4037875626 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3b9c108d20 msgr2=0x7f3b9c199a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:07.797 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:07.795+0000 7f3ba2fbe640 1 --2- 172.21.15.83:0/4037875626 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3b9c108d20 0x7f3b9c199a30 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f3b9400eaa0 tx=0x7f3b9400ef60 comp rx=0 tx=0).stop 2024-09-21T01:41:07.797 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:07.795+0000 7f3ba2fbe640 1 -- 172.21.15.83:0/4037875626 shutdown_connections 2024-09-21T01:41:07.797 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:07.795+0000 7f3ba2fbe640 1 --2- 172.21.15.83:0/4037875626 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f3b8c0b6670 0x7f3b8c0b8b80 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:07.797 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:07.795+0000 7f3ba2fbe640 1 --2- 172.21.15.83:0/4037875626 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3b9c108d20 0x7f3b9c199a30 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:07.797 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:07.795+0000 7f3ba2fbe640 1 --2- 172.21.15.83:0/4037875626 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3b9c1083d0 0x7f3b9c1994f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:07.797 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:07.795+0000 7f3ba2fbe640 1 --2- 172.21.15.83:0/4037875626 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3b9c102ae0 0x7f3b9c198fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:07.797 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:07.795+0000 7f3ba2fbe640 1 -- 172.21.15.83:0/4037875626 >> 172.21.15.83:0/4037875626 conn(0x7f3b9c079790 msgr2=0x7f3b9c1064c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:41:07.797 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:07.795+0000 7f3ba2fbe640 1 -- 172.21.15.83:0/4037875626 shutdown_connections 2024-09-21T01:41:07.797 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:07.795+0000 7f3ba2fbe640 1 -- 172.21.15.83:0/4037875626 wait complete. 2024-09-21T01:41:08.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:41:07 smithi142 ceph-mon[34050]: pgmap v309: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:41:08.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:41:07 smithi142 ceph-mon[34050]: from='client.? 172.21.15.83:0/3773686232' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2024-09-21T01:41:08.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:41:07 smithi142 ceph-mon[34050]: from='client.? 172.21.15.83:0/4037875626' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2024-09-21T01:41:08.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:41:07 smithi119 ceph-mon[33693]: pgmap v309: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:41:08.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:41:07 smithi119 ceph-mon[33693]: from='client.? 172.21.15.83:0/3773686232' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2024-09-21T01:41:08.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:41:07 smithi119 ceph-mon[33693]: from='client.? 172.21.15.83:0/4037875626' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2024-09-21T01:41:08.264 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:41:07 smithi083 ceph-mon[31370]: pgmap v309: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:41:08.264 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:41:07 smithi083 ceph-mon[31370]: from='client.? 172.21.15.83:0/3773686232' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2024-09-21T01:41:08.264 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:41:07 smithi083 ceph-mon[31370]: from='client.? 172.21.15.83:0/4037875626' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2024-09-21T01:41:08.657 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:08.641+0000 7f0af617f640 1 -- 172.21.15.83:0/3408374693 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0af0102080 msgr2=0x7f0af0102490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:08.658 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:08.641+0000 7f0af617f640 1 --2- 172.21.15.83:0/3408374693 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0af0102080 0x7f0af0102490 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f0ae0009900 tx=0x7f0ae002a410 comp rx=0 tx=0).stop 2024-09-21T01:41:08.658 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:08.641+0000 7f0af617f640 1 -- 172.21.15.83:0/3408374693 shutdown_connections 2024-09-21T01:41:08.658 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:08.641+0000 7f0af617f640 1 --2- 172.21.15.83:0/3408374693 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0af0109eb0 0x7f0af01106e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:08.658 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:08.641+0000 7f0af617f640 1 --2- 172.21.15.83:0/3408374693 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0af0109560 0x7f0af0109970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:08.658 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:08.641+0000 7f0af617f640 1 --2- 172.21.15.83:0/3408374693 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0af0102080 0x7f0af0102490 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:08.658 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:08.641+0000 7f0af617f640 1 -- 172.21.15.83:0/3408374693 >> 172.21.15.83:0/3408374693 conn(0x7f0af0079ec0 msgr2=0x7f0af007a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:41:08.658 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:08.641+0000 7f0af617f640 1 -- 172.21.15.83:0/3408374693 shutdown_connections 2024-09-21T01:41:08.658 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:08.641+0000 7f0af617f640 1 -- 172.21.15.83:0/3408374693 wait complete. 2024-09-21T01:41:08.658 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:08.641+0000 7f0af617f640 1 Processor -- start 2024-09-21T01:41:08.658 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:08.642+0000 7f0af617f640 1 -- start start 2024-09-21T01:41:08.658 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:08.642+0000 7f0af617f640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0af0102080 0x7f0af019a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:08.659 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:08.642+0000 7f0af617f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0af0109560 0x7f0af019aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:08.659 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:08.642+0000 7f0af617f640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0af0109eb0 0x7f0af019fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:08.659 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:08.642+0000 7f0af617f640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f0af0113a20 con 0x7f0af0109eb0 2024-09-21T01:41:08.659 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:08.642+0000 7f0af617f640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f0af01138a0 con 0x7f0af0109560 2024-09-21T01:41:08.659 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:08.642+0000 7f0af617f640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f0af0113ba0 con 0x7f0af0102080 2024-09-21T01:41:08.659 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:08.642+0000 7f0aeffff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0af0109eb0 0x7f0af019fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:08.659 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:08.642+0000 7f0aeffff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0af0109eb0 0x7f0af019fcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:34560/0 (socket says 172.21.15.83:34560) 2024-09-21T01:41:08.659 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:08.642+0000 7f0aeffff640 1 -- 172.21.15.83:0/1190676225 learned_addr learned my addr 172.21.15.83:0/1190676225 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:41:08.659 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:08.642+0000 7f0aef7fe640 1 --2- 172.21.15.83:0/1190676225 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0af0102080 0x7f0af019a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:08.659 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:08.642+0000 7f0aeeffd640 1 --2- 172.21.15.83:0/1190676225 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0af0109560 0x7f0af019aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:08.660 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:08.642+0000 7f0aeffff640 1 -- 172.21.15.83:0/1190676225 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0af0102080 msgr2=0x7f0af019a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:08.660 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:08.642+0000 7f0aeffff640 1 --2- 172.21.15.83:0/1190676225 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0af0102080 0x7f0af019a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:08.660 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:08.642+0000 7f0aeffff640 1 -- 172.21.15.83:0/1190676225 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0af0109560 msgr2=0x7f0af019aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:08.660 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:08.642+0000 7f0aeffff640 1 --2- 172.21.15.83:0/1190676225 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0af0109560 0x7f0af019aa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:08.660 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:08.642+0000 7f0aeffff640 1 -- 172.21.15.83:0/1190676225 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0af01a03e0 con 0x7f0af0109eb0 2024-09-21T01:41:08.660 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:08.642+0000 7f0aef7fe640 1 --2- 172.21.15.83:0/1190676225 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0af0102080 0x7f0af019a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:41:08.660 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:08.642+0000 7f0aeffff640 1 --2- 172.21.15.83:0/1190676225 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0af0109eb0 0x7f0af019fcb0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f0ae800cad0 tx=0x7f0ae800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:41:08.660 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:08.643+0000 7f0aecff9640 1 -- 172.21.15.83:0/1190676225 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ae800ae20 con 0x7f0af0109eb0 2024-09-21T01:41:08.660 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:08.643+0000 7f0aecff9640 1 -- 172.21.15.83:0/1190676225 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0ae8005020 con 0x7f0af0109eb0 2024-09-21T01:41:08.660 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:08.643+0000 7f0af617f640 1 -- 172.21.15.83:0/1190676225 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0af01a06d0 con 0x7f0af0109eb0 2024-09-21T01:41:08.660 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:08.643+0000 7f0aecff9640 1 -- 172.21.15.83:0/1190676225 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ae800f6b0 con 0x7f0af0109eb0 2024-09-21T01:41:08.660 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:08.643+0000 7f0af617f640 1 -- 172.21.15.83:0/1190676225 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0af01a6e30 con 0x7f0af0109eb0 2024-09-21T01:41:08.660 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:08.644+0000 7f0af617f640 1 -- 172.21.15.83:0/1190676225 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0af0102490 con 0x7f0af0109eb0 2024-09-21T01:41:08.661 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:08.645+0000 7f0aecff9640 1 -- 172.21.15.83:0/1190676225 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7f0ae80051d0 con 0x7f0af0109eb0 2024-09-21T01:41:08.661 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:08.646+0000 7f0aecff9640 1 --2- 172.21.15.83:0/1190676225 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f0ad80b6670 0x7f0ad80b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:08.661 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:08.646+0000 7f0aef7fe640 1 --2- 172.21.15.83:0/1190676225 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f0ad80b6670 0x7f0ad80b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:08.661 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:08.646+0000 7f0aecff9640 1 -- 172.21.15.83:0/1190676225 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 9286+0+0 (secure 0 0 0) 0x7f0ae80e7cd0 con 0x7f0af0109eb0 2024-09-21T01:41:08.661 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:08.647+0000 7f0aef7fe640 1 --2- 172.21.15.83:0/1190676225 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f0ad80b6670 0x7f0ad80b8b80 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f0ae0000c00 tx=0x7f0ae0005a20 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:41:08.661 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:08.650+0000 7f0aecff9640 1 -- 172.21.15.83:0/1190676225 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f0ae8014030 con 0x7f0af0109eb0 2024-09-21T01:41:08.662 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:41:08.815 INFO:tasks.cephadm.ceph_manager.ceph:need seq 292057776157 got 292057776158 for osd.11 2024-09-21T01:41:08.815 DEBUG:teuthology.parallel:result is None 2024-09-21T01:41:08.843 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:08.842+0000 7f0af617f640 1 -- 172.21.15.83:0/1190676225 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7f0af019b5a0 con 0x7f0af0109eb0 2024-09-21T01:41:08.843 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:08.842+0000 7f0aecff9640 1 -- 172.21.15.83:0/1190676225 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f0ae80ae060 con 0x7f0af0109eb0 2024-09-21T01:41:08.843 INFO:teuthology.orchestra.run.smithi083.stdout:270582939682 2024-09-21T01:41:08.845 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:08.844+0000 7f0af617f640 1 -- 172.21.15.83:0/1190676225 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f0ad80b6670 msgr2=0x7f0ad80b8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:08.845 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:08.844+0000 7f0af617f640 1 --2- 172.21.15.83:0/1190676225 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f0ad80b6670 0x7f0ad80b8b80 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f0ae0000c00 tx=0x7f0ae0005a20 comp rx=0 tx=0).stop 2024-09-21T01:41:08.845 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:08.844+0000 7f0af617f640 1 -- 172.21.15.83:0/1190676225 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0af0109eb0 msgr2=0x7f0af019fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:08.845 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:08.844+0000 7f0af617f640 1 --2- 172.21.15.83:0/1190676225 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0af0109eb0 0x7f0af019fcb0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f0ae800cad0 tx=0x7f0ae800cf90 comp rx=0 tx=0).stop 2024-09-21T01:41:08.845 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:08.845+0000 7f0af617f640 1 -- 172.21.15.83:0/1190676225 shutdown_connections 2024-09-21T01:41:08.846 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:08.845+0000 7f0af617f640 1 --2- 172.21.15.83:0/1190676225 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f0ad80b6670 0x7f0ad80b8b80 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:08.846 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:08.845+0000 7f0af617f640 1 --2- 172.21.15.83:0/1190676225 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0af0109eb0 0x7f0af019fcb0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:08.846 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:08.845+0000 7f0af617f640 1 --2- 172.21.15.83:0/1190676225 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0af0109560 0x7f0af019aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:08.846 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:08.845+0000 7f0af617f640 1 --2- 172.21.15.83:0/1190676225 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0af0102080 0x7f0af019a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:08.846 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:08.845+0000 7f0af617f640 1 -- 172.21.15.83:0/1190676225 >> 172.21.15.83:0/1190676225 conn(0x7f0af0079ec0 msgr2=0x7f0af0107650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:41:08.846 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:08.845+0000 7f0af617f640 1 -- 172.21.15.83:0/1190676225 shutdown_connections 2024-09-21T01:41:08.846 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:08.845+0000 7f0af617f640 1 -- 172.21.15.83:0/1190676225 wait complete. 2024-09-21T01:41:09.073 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:41:08 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [3, 9]} : dispatch 2024-09-21T01:41:09.073 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:41:08 smithi083 ceph-mon[31370]: from='client.? 172.21.15.83:0/1190676225' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2024-09-21T01:41:09.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:41:08 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [3, 9]} : dispatch 2024-09-21T01:41:09.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:41:08 smithi142 ceph-mon[34050]: from='client.? 172.21.15.83:0/1190676225' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2024-09-21T01:41:09.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:41:08 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [3, 9]} : dispatch 2024-09-21T01:41:09.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:41:08 smithi119 ceph-mon[33693]: from='client.? 172.21.15.83:0/1190676225' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2024-09-21T01:41:10.104 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:41:09 smithi083 ceph-mon[31370]: pgmap v310: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 682 B/s rd, 1 op/s 2024-09-21T01:41:10.104 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:41:09 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [3, 9]}]': finished 2024-09-21T01:41:10.104 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:41:09 smithi083 ceph-mon[31370]: osdmap e83: 12 total, 12 up, 12 in 2024-09-21T01:41:10.204 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:10.204+0000 7f72e524f640 1 -- 172.21.15.83:0/3658353142 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f72e0108cf0 msgr2=0x7f72e010f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:10.205 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:10.204+0000 7f72e524f640 1 --2- 172.21.15.83:0/3658353142 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f72e0108cf0 0x7f72e010f520 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f72d8009ca0 tx=0x7f72d802a8c0 comp rx=0 tx=0).stop 2024-09-21T01:41:10.205 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:10.204+0000 7f72e524f640 1 -- 172.21.15.83:0/3658353142 shutdown_connections 2024-09-21T01:41:10.205 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:10.204+0000 7f72e524f640 1 --2- 172.21.15.83:0/3658353142 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f72e0108cf0 0x7f72e010f520 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:10.205 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:10.204+0000 7f72e524f640 1 --2- 172.21.15.83:0/3658353142 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f72e01083a0 0x7f72e01087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:10.205 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:10.204+0000 7f72e524f640 1 --2- 172.21.15.83:0/3658353142 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f72e0102a60 0x7f72e0102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:10.205 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:10.204+0000 7f72e524f640 1 -- 172.21.15.83:0/3658353142 >> 172.21.15.83:0/3658353142 conn(0x7f72e0079730 msgr2=0x7f72e0079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:41:10.205 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:10.204+0000 7f72e524f640 1 -- 172.21.15.83:0/3658353142 shutdown_connections 2024-09-21T01:41:10.205 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:10.204+0000 7f72e524f640 1 -- 172.21.15.83:0/3658353142 wait complete. 2024-09-21T01:41:10.207 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:10.205+0000 7f72e524f640 1 Processor -- start 2024-09-21T01:41:10.207 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:10.205+0000 7f72e524f640 1 -- start start 2024-09-21T01:41:10.207 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:10.206+0000 7f72e524f640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f72e0102a60 0x7f72e019a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:10.207 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:10.206+0000 7f72e524f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f72e01083a0 0x7f72e019a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:10.207 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:10.206+0000 7f72e524f640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f72e0108cf0 0x7f72e019fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:10.207 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:10.206+0000 7f72e524f640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f72e0112860 con 0x7f72e0102a60 2024-09-21T01:41:10.208 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:10.206+0000 7f72e524f640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f72e01126e0 con 0x7f72e01083a0 2024-09-21T01:41:10.208 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:10.206+0000 7f72e524f640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f72e01129e0 con 0x7f72e0108cf0 2024-09-21T01:41:10.208 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:10.206+0000 7f72ded9d640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f72e0102a60 0x7f72e019a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:10.208 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:10.206+0000 7f72ded9d640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f72e0102a60 0x7f72e019a320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:34592/0 (socket says 172.21.15.83:34592) 2024-09-21T01:41:10.208 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:10.206+0000 7f72ded9d640 1 -- 172.21.15.83:0/494012113 learned_addr learned my addr 172.21.15.83:0/494012113 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:41:10.208 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:10.206+0000 7f72d7fff640 1 --2- 172.21.15.83:0/494012113 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f72e01083a0 0x7f72e019a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:10.208 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:10.206+0000 7f72df59e640 1 --2- 172.21.15.83:0/494012113 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f72e0108cf0 0x7f72e019fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:10.208 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:10.206+0000 7f72ded9d640 1 -- 172.21.15.83:0/494012113 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f72e0108cf0 msgr2=0x7f72e019fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:10.208 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:10.206+0000 7f72ded9d640 1 --2- 172.21.15.83:0/494012113 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f72e0108cf0 0x7f72e019fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:10.208 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:10.206+0000 7f72ded9d640 1 -- 172.21.15.83:0/494012113 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f72e01083a0 msgr2=0x7f72e019a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:10.208 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:10.206+0000 7f72ded9d640 1 --2- 172.21.15.83:0/494012113 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f72e01083a0 0x7f72e019a8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:10.208 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:10.206+0000 7f72ded9d640 1 -- 172.21.15.83:0/494012113 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72e01a0290 con 0x7f72e0102a60 2024-09-21T01:41:10.208 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:10.206+0000 7f72df59e640 1 --2- 172.21.15.83:0/494012113 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f72e0108cf0 0x7f72e019fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:41:10.208 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:10.206+0000 7f72ded9d640 1 --2- 172.21.15.83:0/494012113 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f72e0102a60 0x7f72e019a320 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f72d000d950 tx=0x7f72d000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:41:10.209 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:10.207+0000 7f72dcd99640 1 -- 172.21.15.83:0/494012113 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72d0017070 con 0x7f72e0102a60 2024-09-21T01:41:10.209 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:10.207+0000 7f72dcd99640 1 -- 172.21.15.83:0/494012113 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f72d0009c30 con 0x7f72e0102a60 2024-09-21T01:41:10.209 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:10.207+0000 7f72e524f640 1 -- 172.21.15.83:0/494012113 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72e01a0580 con 0x7f72e0102a60 2024-09-21T01:41:10.209 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:10.207+0000 7f72d7fff640 1 --2- 172.21.15.83:0/494012113 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f72e01083a0 0x7f72e019a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:41:10.209 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:10.207+0000 7f72dcd99640 1 -- 172.21.15.83:0/494012113 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72d000f620 con 0x7f72e0102a60 2024-09-21T01:41:10.209 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:10.207+0000 7f72e524f640 1 -- 172.21.15.83:0/494012113 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72e01a6ce0 con 0x7f72e0102a60 2024-09-21T01:41:10.209 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:10.208+0000 7f72e524f640 1 -- 172.21.15.83:0/494012113 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72e0102e70 con 0x7f72e0102a60 2024-09-21T01:41:10.210 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:10.210+0000 7f72dcd99640 1 -- 172.21.15.83:0/494012113 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7f72d0010460 con 0x7f72e0102a60 2024-09-21T01:41:10.211 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:10.210+0000 7f72dcd99640 1 --2- 172.21.15.83:0/494012113 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f72cc0b6670 0x7f72cc0b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:10.211 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:10.210+0000 7f72d7fff640 1 --2- 172.21.15.83:0/494012113 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f72cc0b6670 0x7f72cc0b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:10.211 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:10.210+0000 7f72dcd99640 1 -- 172.21.15.83:0/494012113 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9315+0+0 (secure 0 0 0) 0x7f72d00e75c0 con 0x7f72e0102a60 2024-09-21T01:41:10.211 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:10.211+0000 7f72d7fff640 1 --2- 172.21.15.83:0/494012113 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f72cc0b6670 0x7f72cc0b8b80 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f72c80058c0 tx=0x7f72c8005850 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:41:10.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:41:09 smithi142 ceph-mon[34050]: pgmap v310: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 682 B/s rd, 1 op/s 2024-09-21T01:41:10.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:41:09 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [3, 9]}]': finished 2024-09-21T01:41:10.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:41:09 smithi142 ceph-mon[34050]: osdmap e83: 12 total, 12 up, 12 in 2024-09-21T01:41:10.215 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:10.215+0000 7f72dcd99640 1 -- 172.21.15.83:0/494012113 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f72d00ad8b0 con 0x7f72e0102a60 2024-09-21T01:41:10.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:41:09 smithi119 ceph-mon[33693]: pgmap v310: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 682 B/s rd, 1 op/s 2024-09-21T01:41:10.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:41:09 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [3, 9]}]': finished 2024-09-21T01:41:10.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:41:09 smithi119 ceph-mon[33693]: osdmap e83: 12 total, 12 up, 12 in 2024-09-21T01:41:10.412 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:10.411+0000 7f72e524f640 1 -- 172.21.15.83:0/494012113 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f72e010b560 con 0x7f72e0102a60 2024-09-21T01:41:10.413 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:10.412+0000 7f72dcd99640 1 -- 172.21.15.83:0/494012113 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f72d00b1c90 con 0x7f72e0102a60 2024-09-21T01:41:10.413 INFO:teuthology.orchestra.run.smithi083.stdout:38654705750 2024-09-21T01:41:10.415 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:10.414+0000 7f72e524f640 1 -- 172.21.15.83:0/494012113 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f72cc0b6670 msgr2=0x7f72cc0b8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:10.415 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:10.414+0000 7f72e524f640 1 --2- 172.21.15.83:0/494012113 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f72cc0b6670 0x7f72cc0b8b80 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f72c80058c0 tx=0x7f72c8005850 comp rx=0 tx=0).stop 2024-09-21T01:41:10.415 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:10.414+0000 7f72e524f640 1 -- 172.21.15.83:0/494012113 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f72e0102a60 msgr2=0x7f72e019a320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:10.415 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:10.414+0000 7f72e524f640 1 --2- 172.21.15.83:0/494012113 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f72e0102a60 0x7f72e019a320 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f72d000d950 tx=0x7f72d000de10 comp rx=0 tx=0).stop 2024-09-21T01:41:10.415 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:10.414+0000 7f72e524f640 1 -- 172.21.15.83:0/494012113 shutdown_connections 2024-09-21T01:41:10.415 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:10.414+0000 7f72e524f640 1 --2- 172.21.15.83:0/494012113 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f72cc0b6670 0x7f72cc0b8b80 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:10.416 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:10.414+0000 7f72e524f640 1 --2- 172.21.15.83:0/494012113 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f72e0108cf0 0x7f72e019fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:10.416 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:10.414+0000 7f72e524f640 1 --2- 172.21.15.83:0/494012113 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f72e01083a0 0x7f72e019a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:10.416 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:10.414+0000 7f72e524f640 1 --2- 172.21.15.83:0/494012113 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f72e0102a60 0x7f72e019a320 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:10.416 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:10.414+0000 7f72e524f640 1 -- 172.21.15.83:0/494012113 >> 172.21.15.83:0/494012113 conn(0x7f72e0079730 msgr2=0x7f72e006b1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:41:10.416 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:10.414+0000 7f72e524f640 1 -- 172.21.15.83:0/494012113 shutdown_connections 2024-09-21T01:41:10.416 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:10.414+0000 7f72e524f640 1 -- 172.21.15.83:0/494012113 wait complete. 2024-09-21T01:41:10.665 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574927 got 55834574928 for osd.1 2024-09-21T01:41:10.665 DEBUG:teuthology.parallel:result is None 2024-09-21T01:41:10.750 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:10.103+0000 7fc0ea2d5640 1 -- 172.21.15.83:0/1515708798 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc0e4109df0 msgr2=0x7fc0e4110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:10.751 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:10.103+0000 7fc0ea2d5640 1 --2- 172.21.15.83:0/1515708798 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc0e4109df0 0x7fc0e4110620 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fc0dc009ca0 tx=0x7fc0dc02a8c0 comp rx=0 tx=0).stop 2024-09-21T01:41:10.751 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:10.103+0000 7fc0ea2d5640 1 -- 172.21.15.83:0/1515708798 shutdown_connections 2024-09-21T01:41:10.751 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:10.103+0000 7fc0ea2d5640 1 --2- 172.21.15.83:0/1515708798 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc0e4109df0 0x7fc0e4110620 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:10.751 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:10.103+0000 7fc0ea2d5640 1 --2- 172.21.15.83:0/1515708798 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc0e41094a0 0x7fc0e41098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:10.751 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:10.103+0000 7fc0ea2d5640 1 --2- 172.21.15.83:0/1515708798 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc0e4103b60 0x7fc0e4103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:10.751 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:10.103+0000 7fc0ea2d5640 1 -- 172.21.15.83:0/1515708798 >> 172.21.15.83:0/1515708798 conn(0x7fc0e407b850 msgr2=0x7fc0e407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:41:10.751 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:10.103+0000 7fc0ea2d5640 1 -- 172.21.15.83:0/1515708798 shutdown_connections 2024-09-21T01:41:10.751 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:10.103+0000 7fc0ea2d5640 1 -- 172.21.15.83:0/1515708798 wait complete. 2024-09-21T01:41:10.751 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:10.104+0000 7fc0ea2d5640 1 Processor -- start 2024-09-21T01:41:10.751 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:10.104+0000 7fc0ea2d5640 1 -- start start 2024-09-21T01:41:10.751 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:10.105+0000 7fc0ea2d5640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc0e4103b60 0x7fc0e419a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:10.751 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:10.105+0000 7fc0ea2d5640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc0e41094a0 0x7fc0e419a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:10.752 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:10.105+0000 7fc0ea2d5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc0e4109df0 0x7fc0e419fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:10.752 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:10.105+0000 7fc0ea2d5640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fc0e41139b0 con 0x7fc0e41094a0 2024-09-21T01:41:10.752 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:10.105+0000 7fc0ea2d5640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fc0e4113830 con 0x7fc0e4103b60 2024-09-21T01:41:10.752 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:10.105+0000 7fc0ea2d5640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fc0e4113b30 con 0x7fc0e4109df0 2024-09-21T01:41:10.752 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:10.105+0000 7fc0e37fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc0e41094a0 0x7fc0e419a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:10.752 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:10.105+0000 7fc0e37fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc0e41094a0 0x7fc0e419a920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:34572/0 (socket says 172.21.15.83:34572) 2024-09-21T01:41:10.752 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:10.105+0000 7fc0e37fe640 1 -- 172.21.15.83:0/714160091 learned_addr learned my addr 172.21.15.83:0/714160091 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:41:10.752 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:10.105+0000 7fc0e3fff640 1 --2- 172.21.15.83:0/714160091 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc0e4103b60 0x7fc0e419a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:10.752 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:10.105+0000 7fc0e8872640 1 --2- 172.21.15.83:0/714160091 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc0e4109df0 0x7fc0e419fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:10.752 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:10.105+0000 7fc0e37fe640 1 -- 172.21.15.83:0/714160091 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc0e4109df0 msgr2=0x7fc0e419fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:10.752 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:10.105+0000 7fc0e37fe640 1 --2- 172.21.15.83:0/714160091 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc0e4109df0 0x7fc0e419fbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:10.752 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:10.105+0000 7fc0e37fe640 1 -- 172.21.15.83:0/714160091 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc0e4103b60 msgr2=0x7fc0e419a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:10.752 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:10.105+0000 7fc0e37fe640 1 --2- 172.21.15.83:0/714160091 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc0e4103b60 0x7fc0e419a380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:10.752 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:10.105+0000 7fc0e37fe640 1 -- 172.21.15.83:0/714160091 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0e41a02f0 con 0x7fc0e41094a0 2024-09-21T01:41:10.753 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:10.106+0000 7fc0e37fe640 1 --2- 172.21.15.83:0/714160091 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc0e41094a0 0x7fc0e419a920 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fc0d800d740 tx=0x7fc0d800dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:41:10.753 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:10.106+0000 7fc0e17fa640 1 -- 172.21.15.83:0/714160091 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0d8017070 con 0x7fc0e41094a0 2024-09-21T01:41:10.753 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:10.106+0000 7fc0e17fa640 1 -- 172.21.15.83:0/714160091 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc0d800de50 con 0x7fc0e41094a0 2024-09-21T01:41:10.753 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:10.106+0000 7fc0ea2d5640 1 -- 172.21.15.83:0/714160091 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0e41a05e0 con 0x7fc0e41094a0 2024-09-21T01:41:10.753 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:10.106+0000 7fc0e17fa640 1 -- 172.21.15.83:0/714160091 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0d800f620 con 0x7fc0e41094a0 2024-09-21T01:41:10.753 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:10.106+0000 7fc0ea2d5640 1 -- 172.21.15.83:0/714160091 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0e41a6d40 con 0x7fc0e41094a0 2024-09-21T01:41:10.753 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:10.107+0000 7fc0ea2d5640 1 -- 172.21.15.83:0/714160091 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0e4103f70 con 0x7fc0e41094a0 2024-09-21T01:41:10.753 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:10.108+0000 7fc0e17fa640 1 -- 172.21.15.83:0/714160091 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7fc0d801a070 con 0x7fc0e41094a0 2024-09-21T01:41:10.753 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:10.109+0000 7fc0e17fa640 1 --2- 172.21.15.83:0/714160091 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fc0cc0b65f0 0x7fc0cc0b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:10.753 INFO:teuthology.orchestra.run.smithi083.stdout:223338299438 2024-09-21T01:41:10.754 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:10.110+0000 7fc0e3fff640 1 --2- 172.21.15.83:0/714160091 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fc0cc0b65f0 0x7fc0cc0b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:10.754 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:10.110+0000 7fc0e17fa640 1 -- 172.21.15.83:0/714160091 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9315+0+0 (secure 0 0 0) 0x7fc0d80e7230 con 0x7fc0e41094a0 2024-09-21T01:41:10.754 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:10.110+0000 7fc0e3fff640 1 --2- 172.21.15.83:0/714160091 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fc0cc0b65f0 0x7fc0cc0b8b00 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fc0d4005d00 tx=0x7fc0d400b410 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:41:10.754 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:10.113+0000 7fc0e17fa640 1 -- 172.21.15.83:0/714160091 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc0d80b18e0 con 0x7fc0e41094a0 2024-09-21T01:41:10.754 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:10.305+0000 7fc0ea2d5640 1 -- 172.21.15.83:0/714160091 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7fc0e419b4b0 con 0x7fc0e41094a0 2024-09-21T01:41:10.754 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:10.306+0000 7fc0e17fa640 1 -- 172.21.15.83:0/714160091 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fc0e419b4b0 con 0x7fc0e41094a0 2024-09-21T01:41:10.754 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:10.308+0000 7fc0ea2d5640 1 -- 172.21.15.83:0/714160091 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fc0cc0b65f0 msgr2=0x7fc0cc0b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:10.754 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:10.308+0000 7fc0ea2d5640 1 --2- 172.21.15.83:0/714160091 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fc0cc0b65f0 0x7fc0cc0b8b00 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fc0d4005d00 tx=0x7fc0d400b410 comp rx=0 tx=0).stop 2024-09-21T01:41:10.754 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:10.308+0000 7fc0ea2d5640 1 -- 172.21.15.83:0/714160091 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc0e41094a0 msgr2=0x7fc0e419a920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:10.754 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:10.308+0000 7fc0ea2d5640 1 --2- 172.21.15.83:0/714160091 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc0e41094a0 0x7fc0e419a920 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fc0d800d740 tx=0x7fc0d800dc00 comp rx=0 tx=0).stop 2024-09-21T01:41:10.755 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:10.308+0000 7fc0ea2d5640 1 -- 172.21.15.83:0/714160091 shutdown_connections 2024-09-21T01:41:10.755 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:10.308+0000 7fc0ea2d5640 1 --2- 172.21.15.83:0/714160091 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fc0cc0b65f0 0x7fc0cc0b8b00 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:10.755 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:10.308+0000 7fc0ea2d5640 1 --2- 172.21.15.83:0/714160091 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc0e4109df0 0x7fc0e419fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:10.755 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:10.308+0000 7fc0ea2d5640 1 --2- 172.21.15.83:0/714160091 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc0e41094a0 0x7fc0e419a920 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:10.755 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:10.308+0000 7fc0ea2d5640 1 --2- 172.21.15.83:0/714160091 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc0e4103b60 0x7fc0e419a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:10.755 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:10.308+0000 7fc0ea2d5640 1 -- 172.21.15.83:0/714160091 >> 172.21.15.83:0/714160091 conn(0x7fc0e407b850 msgr2=0x7fc0e4107530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:41:10.755 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:10.308+0000 7fc0ea2d5640 1 -- 172.21.15.83:0/714160091 shutdown_connections 2024-09-21T01:41:10.755 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:10.308+0000 7fc0ea2d5640 1 -- 172.21.15.83:0/714160091 wait complete. 2024-09-21T01:41:10.956 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:41:10 smithi083 ceph-mon[31370]: osdmap e84: 12 total, 12 up, 12 in 2024-09-21T01:41:10.956 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:41:10 smithi083 ceph-mon[31370]: from='client.? 172.21.15.83:0/714160091' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2024-09-21T01:41:10.956 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:41:10 smithi083 ceph-mon[31370]: from='client.? 172.21.15.83:0/494012113' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2024-09-21T01:41:10.956 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:41:10 smithi083 ceph-mon[31370]: pgmap v313: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T01:41:11.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:41:10 smithi142 ceph-mon[34050]: osdmap e84: 12 total, 12 up, 12 in 2024-09-21T01:41:11.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:41:10 smithi142 ceph-mon[34050]: from='client.? 172.21.15.83:0/714160091' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2024-09-21T01:41:11.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:41:10 smithi142 ceph-mon[34050]: from='client.? 172.21.15.83:0/494012113' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2024-09-21T01:41:11.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:41:10 smithi142 ceph-mon[34050]: pgmap v313: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T01:41:11.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:41:10 smithi119 ceph-mon[33693]: osdmap e84: 12 total, 12 up, 12 in 2024-09-21T01:41:11.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:41:10 smithi119 ceph-mon[33693]: from='client.? 172.21.15.83:0/714160091' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2024-09-21T01:41:11.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:41:10 smithi119 ceph-mon[33693]: from='client.? 172.21.15.83:0/494012113' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2024-09-21T01:41:11.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:41:10 smithi119 ceph-mon[33693]: pgmap v313: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T01:41:11.389 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:41:11.832 INFO:tasks.cephadm.ceph_manager.ceph:need seq 223338299436 got 223338299438 for osd.8 2024-09-21T01:41:11.833 DEBUG:teuthology.parallel:result is None 2024-09-21T01:41:12.033 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:41:12.132 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:12.131+0000 7f3e3d570640 1 -- 172.21.15.83:0/1840816052 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3e38108d10 msgr2=0x7f3e3810f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:12.132 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:12.131+0000 7f3e3d570640 1 --2- 172.21.15.83:0/1840816052 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3e38108d10 0x7f3e3810f540 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f3e30009ca0 tx=0x7f3e3002a8c0 comp rx=0 tx=0).stop 2024-09-21T01:41:12.132 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:12.131+0000 7f3e3d570640 1 -- 172.21.15.83:0/1840816052 shutdown_connections 2024-09-21T01:41:12.132 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:12.131+0000 7f3e3d570640 1 --2- 172.21.15.83:0/1840816052 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3e38108d10 0x7f3e3810f540 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:12.132 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:12.131+0000 7f3e3d570640 1 --2- 172.21.15.83:0/1840816052 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3e381083c0 0x7f3e381087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:12.132 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:12.131+0000 7f3e3d570640 1 --2- 172.21.15.83:0/1840816052 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3e38102a80 0x7f3e38102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:12.132 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:12.131+0000 7f3e3d570640 1 -- 172.21.15.83:0/1840816052 >> 172.21.15.83:0/1840816052 conn(0x7f3e38079740 msgr2=0x7f3e38079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:41:12.132 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:12.132+0000 7f3e3d570640 1 -- 172.21.15.83:0/1840816052 shutdown_connections 2024-09-21T01:41:12.132 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:12.132+0000 7f3e3d570640 1 -- 172.21.15.83:0/1840816052 wait complete. 2024-09-21T01:41:12.134 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:12.132+0000 7f3e3d570640 1 Processor -- start 2024-09-21T01:41:12.134 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:12.132+0000 7f3e3d570640 1 -- start start 2024-09-21T01:41:12.134 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:12.132+0000 7f3e3d570640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3e38102a80 0x7f3e3819a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:12.134 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:12.132+0000 7f3e3d570640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3e381083c0 0x7f3e3819a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:12.134 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:12.132+0000 7f3e3d570640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3e38108d10 0x7f3e3819fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:12.134 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:12.132+0000 7f3e3d570640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f3e38112880 con 0x7f3e38108d10 2024-09-21T01:41:12.134 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:12.132+0000 7f3e3d570640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f3e38112700 con 0x7f3e38102a80 2024-09-21T01:41:12.134 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:12.132+0000 7f3e3d570640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f3e38112a00 con 0x7f3e381083c0 2024-09-21T01:41:12.135 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:12.133+0000 7f3e377fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3e38108d10 0x7f3e3819fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:12.135 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:12.133+0000 7f3e377fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3e38108d10 0x7f3e3819fb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:34612/0 (socket says 172.21.15.83:34612) 2024-09-21T01:41:12.135 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:12.133+0000 7f3e377fe640 1 -- 172.21.15.83:0/1731801841 learned_addr learned my addr 172.21.15.83:0/1731801841 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:41:12.135 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:12.133+0000 7f3e36ffd640 1 --2- 172.21.15.83:0/1731801841 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3e38102a80 0x7f3e3819a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:12.135 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:12.133+0000 7f3e2ffff640 1 --2- 172.21.15.83:0/1731801841 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3e381083c0 0x7f3e3819a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:12.135 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:12.133+0000 7f3e377fe640 1 -- 172.21.15.83:0/1731801841 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3e381083c0 msgr2=0x7f3e3819a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:12.135 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:12.133+0000 7f3e377fe640 1 --2- 172.21.15.83:0/1731801841 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3e381083c0 0x7f3e3819a8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:12.135 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:12.133+0000 7f3e377fe640 1 -- 172.21.15.83:0/1731801841 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3e38102a80 msgr2=0x7f3e3819a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:12.135 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:12.133+0000 7f3e377fe640 1 --2- 172.21.15.83:0/1731801841 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3e38102a80 0x7f3e3819a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:12.135 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:12.133+0000 7f3e377fe640 1 -- 172.21.15.83:0/1731801841 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e381a02b0 con 0x7f3e38108d10 2024-09-21T01:41:12.135 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:12.133+0000 7f3e377fe640 1 --2- 172.21.15.83:0/1731801841 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3e38108d10 0x7f3e3819fb80 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f3e30005e30 tx=0x7f3e300093d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:41:12.135 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:12.133+0000 7f3e34ff9640 1 -- 172.21.15.83:0/1731801841 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e30032d10 con 0x7f3e38108d10 2024-09-21T01:41:12.135 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:12.134+0000 7f3e3d570640 1 -- 172.21.15.83:0/1731801841 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e381a0540 con 0x7f3e38108d10 2024-09-21T01:41:12.135 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:12.134+0000 7f3e34ff9640 1 -- 172.21.15.83:0/1731801841 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3e30032eb0 con 0x7f3e38108d10 2024-09-21T01:41:12.136 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:12.134+0000 7f3e34ff9640 1 -- 172.21.15.83:0/1731801841 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e30030b20 con 0x7f3e38108d10 2024-09-21T01:41:12.136 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:12.134+0000 7f3e3d570640 1 -- 172.21.15.83:0/1731801841 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e381a6d00 con 0x7f3e38108d10 2024-09-21T01:41:12.136 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:12.135+0000 7f3e3d570640 1 -- 172.21.15.83:0/1731801841 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e38102e90 con 0x7f3e38108d10 2024-09-21T01:41:12.137 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:12.136+0000 7f3e34ff9640 1 -- 172.21.15.83:0/1731801841 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7f3e30030cc0 con 0x7f3e38108d10 2024-09-21T01:41:12.137 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:12.137+0000 7f3e34ff9640 1 --2- 172.21.15.83:0/1731801841 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f3e240b65f0 0x7f3e240b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:12.138 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:12.137+0000 7f3e36ffd640 1 --2- 172.21.15.83:0/1731801841 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f3e240b65f0 0x7f3e240b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:12.138 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:12.137+0000 7f3e34ff9640 1 -- 172.21.15.83:0/1731801841 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9315+0+0 (secure 0 0 0) 0x7f3e30108bf0 con 0x7f3e38108d10 2024-09-21T01:41:12.138 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:12.138+0000 7f3e36ffd640 1 --2- 172.21.15.83:0/1731801841 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f3e240b65f0 0x7f3e240b8b00 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f3e2800bbe0 tx=0x7f3e2800b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:41:12.141 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:12.141+0000 7f3e34ff9640 1 -- 172.21.15.83:0/1731801841 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3e300ceee0 con 0x7f3e38108d10 2024-09-21T01:41:12.335 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:12.334+0000 7f3e3d570640 1 -- 172.21.15.83:0/1731801841 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f3e3810bb70 con 0x7f3e38108d10 2024-09-21T01:41:12.335 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:12.334+0000 7f3e34ff9640 1 -- 172.21.15.83:0/1731801841 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f3e300d32c0 con 0x7f3e38108d10 2024-09-21T01:41:12.335 INFO:teuthology.orchestra.run.smithi083.stdout:77309411404 2024-09-21T01:41:12.337 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:12.337+0000 7f3e3d570640 1 -- 172.21.15.83:0/1731801841 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f3e240b65f0 msgr2=0x7f3e240b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:12.337 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:12.337+0000 7f3e3d570640 1 --2- 172.21.15.83:0/1731801841 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f3e240b65f0 0x7f3e240b8b00 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f3e2800bbe0 tx=0x7f3e2800b390 comp rx=0 tx=0).stop 2024-09-21T01:41:12.337 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:12.337+0000 7f3e3d570640 1 -- 172.21.15.83:0/1731801841 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3e38108d10 msgr2=0x7f3e3819fb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:12.338 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:12.337+0000 7f3e3d570640 1 --2- 172.21.15.83:0/1731801841 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3e38108d10 0x7f3e3819fb80 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f3e30005e30 tx=0x7f3e300093d0 comp rx=0 tx=0).stop 2024-09-21T01:41:12.338 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:12.337+0000 7f3e3d570640 1 -- 172.21.15.83:0/1731801841 shutdown_connections 2024-09-21T01:41:12.338 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:12.337+0000 7f3e3d570640 1 --2- 172.21.15.83:0/1731801841 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f3e240b65f0 0x7f3e240b8b00 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:12.338 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:12.337+0000 7f3e3d570640 1 --2- 172.21.15.83:0/1731801841 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3e38108d10 0x7f3e3819fb80 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:12.338 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:12.337+0000 7f3e3d570640 1 --2- 172.21.15.83:0/1731801841 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3e381083c0 0x7f3e3819a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:12.338 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:12.337+0000 7f3e3d570640 1 --2- 172.21.15.83:0/1731801841 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3e38102a80 0x7f3e3819a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:12.338 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:12.337+0000 7f3e3d570640 1 -- 172.21.15.83:0/1731801841 >> 172.21.15.83:0/1731801841 conn(0x7f3e38079740 msgr2=0x7f3e3806bbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:41:12.338 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:12.337+0000 7f3e3d570640 1 -- 172.21.15.83:0/1731801841 shutdown_connections 2024-09-21T01:41:12.338 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:12.337+0000 7f3e3d570640 1 -- 172.21.15.83:0/1731801841 wait complete. 2024-09-21T01:41:12.599 INFO:tasks.cephadm.ceph_manager.ceph:need seq 38654705748 got 38654705750 for osd.0 2024-09-21T01:41:12.599 DEBUG:teuthology.parallel:result is None 2024-09-21T01:41:12.714 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:41:12 smithi142 ceph-mon[34050]: from='client.? 172.21.15.83:0/1731801841' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2024-09-21T01:41:12.717 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:41:12 smithi119 ceph-mon[33693]: from='client.? 172.21.15.83:0/1731801841' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2024-09-21T01:41:12.803 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:41:12 smithi083 ceph-mon[31370]: from='client.? 172.21.15.83:0/1731801841' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2024-09-21T01:41:13.442 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411401 got 77309411404 for osd.2 2024-09-21T01:41:13.442 DEBUG:teuthology.parallel:result is None 2024-09-21T01:41:13.626 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:13.623+0000 7fa6af336640 1 -- 172.21.15.83:0/3195866817 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa6a8105240 msgr2=0x7fa6a8105650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:13.626 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:13.623+0000 7fa6af336640 1 --2- 172.21.15.83:0/3195866817 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa6a8105240 0x7fa6a8105650 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fa698009900 tx=0x7fa69802a410 comp rx=0 tx=0).stop 2024-09-21T01:41:13.627 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:13.623+0000 7fa6af336640 1 -- 172.21.15.83:0/3195866817 shutdown_connections 2024-09-21T01:41:13.627 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:13.623+0000 7fa6af336640 1 --2- 172.21.15.83:0/3195866817 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa6a8105b90 0x7fa6a810f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:13.627 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:13.623+0000 7fa6af336640 1 --2- 172.21.15.83:0/3195866817 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa6a8105240 0x7fa6a8105650 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:13.627 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:13.623+0000 7fa6af336640 1 --2- 172.21.15.83:0/3195866817 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa6a8103270 0x7fa6a8103680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:13.627 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:13.623+0000 7fa6af336640 1 -- 172.21.15.83:0/3195866817 >> 172.21.15.83:0/3195866817 conn(0x7fa6a8079ec0 msgr2=0x7fa6a807a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:41:13.627 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:13.623+0000 7fa6af336640 1 -- 172.21.15.83:0/3195866817 shutdown_connections 2024-09-21T01:41:13.627 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:13.623+0000 7fa6af336640 1 -- 172.21.15.83:0/3195866817 wait complete. 2024-09-21T01:41:13.627 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:13.624+0000 7fa6af336640 1 Processor -- start 2024-09-21T01:41:13.627 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:13.624+0000 7fa6af336640 1 -- start start 2024-09-21T01:41:13.627 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:13.624+0000 7fa6af336640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa6a8103270 0x7fa6a819a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:13.627 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:13.624+0000 7fa6af336640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa6a8105240 0x7fa6a819aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:13.628 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:13.624+0000 7fa6af336640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa6a8105b90 0x7fa6a819fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:13.628 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:13.624+0000 7fa6af336640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fa6a8112920 con 0x7fa6a8105b90 2024-09-21T01:41:13.628 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:13.624+0000 7fa6af336640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fa6a81127a0 con 0x7fa6a8105240 2024-09-21T01:41:13.628 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:13.624+0000 7fa6af336640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fa6a8112aa0 con 0x7fa6a8103270 2024-09-21T01:41:13.628 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:13.624+0000 7fa6ad8d3640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa6a8105b90 0x7fa6a819fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:13.628 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:13.625+0000 7fa6ad8d3640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa6a8105b90 0x7fa6a819fd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:58804/0 (socket says 172.21.15.83:58804) 2024-09-21T01:41:13.628 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:13.625+0000 7fa6ad8d3640 1 -- 172.21.15.83:0/1470777900 learned_addr learned my addr 172.21.15.83:0/1470777900 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:41:13.628 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:13.625+0000 7fa6ac8d1640 1 --2- 172.21.15.83:0/1470777900 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa6a8105240 0x7fa6a819aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:13.628 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:13.625+0000 7fa6ad0d2640 1 --2- 172.21.15.83:0/1470777900 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa6a8103270 0x7fa6a819a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:13.628 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:13.625+0000 7fa6ad8d3640 1 -- 172.21.15.83:0/1470777900 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa6a8103270 msgr2=0x7fa6a819a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:13.628 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:13.625+0000 7fa6ad8d3640 1 --2- 172.21.15.83:0/1470777900 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa6a8103270 0x7fa6a819a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:13.628 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:13.625+0000 7fa6ad8d3640 1 -- 172.21.15.83:0/1470777900 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa6a8105240 msgr2=0x7fa6a819aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:13.629 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:13.625+0000 7fa6ad8d3640 1 --2- 172.21.15.83:0/1470777900 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa6a8105240 0x7fa6a819aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:13.629 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:13.625+0000 7fa6ad8d3640 1 -- 172.21.15.83:0/1470777900 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6a81a0430 con 0x7fa6a8105b90 2024-09-21T01:41:13.629 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:13.625+0000 7fa6ad0d2640 1 --2- 172.21.15.83:0/1470777900 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa6a8103270 0x7fa6a819a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:41:13.629 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:13.625+0000 7fa6ad8d3640 1 --2- 172.21.15.83:0/1470777900 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa6a8105b90 0x7fa6a819fd00 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fa6a000b970 tx=0x7fa6a000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:41:13.629 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:13.625+0000 7fa69e7fc640 1 -- 172.21.15.83:0/1470777900 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6a0019070 con 0x7fa6a8105b90 2024-09-21T01:41:13.629 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:13.625+0000 7fa69e7fc640 1 -- 172.21.15.83:0/1470777900 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa6a0014440 con 0x7fa6a8105b90 2024-09-21T01:41:13.629 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:13.625+0000 7fa6af336640 1 -- 172.21.15.83:0/1470777900 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6a81a0720 con 0x7fa6a8105b90 2024-09-21T01:41:13.629 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:13.625+0000 7fa69e7fc640 1 -- 172.21.15.83:0/1470777900 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6a00075d0 con 0x7fa6a8105b90 2024-09-21T01:41:13.629 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:13.625+0000 7fa6af336640 1 -- 172.21.15.83:0/1470777900 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6a81a6e80 con 0x7fa6a8105b90 2024-09-21T01:41:13.630 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:13.626+0000 7fa6af336640 1 -- 172.21.15.83:0/1470777900 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6a8103680 con 0x7fa6a8105b90 2024-09-21T01:41:13.630 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:13.628+0000 7fa69e7fc640 1 -- 172.21.15.83:0/1470777900 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7fa6a001c070 con 0x7fa6a8105b90 2024-09-21T01:41:13.630 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:13.629+0000 7fa69e7fc640 1 --2- 172.21.15.83:0/1470777900 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fa6940b6670 0x7fa6940b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:13.630 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:13.629+0000 7fa6ad0d2640 1 --2- 172.21.15.83:0/1470777900 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fa6940b6670 0x7fa6940b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:13.631 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:13.629+0000 7fa69e7fc640 1 -- 172.21.15.83:0/1470777900 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9315+0+0 (secure 0 0 0) 0x7fa6a00e7200 con 0x7fa6a8105b90 2024-09-21T01:41:13.631 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:13.630+0000 7fa6ad0d2640 1 --2- 172.21.15.83:0/1470777900 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fa6940b6670 0x7fa6940b8b80 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fa6a40058c0 tx=0x7fa6a4005850 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:41:13.633 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:13.633+0000 7fa69e7fc640 1 -- 172.21.15.83:0/1470777900 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa6a00b18d0 con 0x7fa6a8105b90 2024-09-21T01:41:13.714 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:41:13 smithi142 ceph-mon[34050]: pgmap v314: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 639 B/s rd, 1 op/s 2024-09-21T01:41:13.717 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:41:13 smithi119 ceph-mon[33693]: pgmap v314: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 639 B/s rd, 1 op/s 2024-09-21T01:41:13.744 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:41:13 smithi083 ceph-mon[31370]: pgmap v314: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 639 B/s rd, 1 op/s 2024-09-21T01:41:13.820 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:13.820+0000 7fa6af336640 1 -- 172.21.15.83:0/1470777900 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7fa6a81a7120 con 0x7fa6a8105b90 2024-09-21T01:41:13.820 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:13.820+0000 7fa69e7fc640 1 -- 172.21.15.83:0/1470777900 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fa6a00b6810 con 0x7fa6a8105b90 2024-09-21T01:41:13.821 INFO:teuthology.orchestra.run.smithi083.stdout:249108103209 2024-09-21T01:41:13.823 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:13.822+0000 7fa6af336640 1 -- 172.21.15.83:0/1470777900 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fa6940b6670 msgr2=0x7fa6940b8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:13.823 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:13.822+0000 7fa6af336640 1 --2- 172.21.15.83:0/1470777900 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fa6940b6670 0x7fa6940b8b80 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fa6a40058c0 tx=0x7fa6a4005850 comp rx=0 tx=0).stop 2024-09-21T01:41:13.823 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:13.822+0000 7fa6af336640 1 -- 172.21.15.83:0/1470777900 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa6a8105b90 msgr2=0x7fa6a819fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:13.823 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:13.822+0000 7fa6af336640 1 --2- 172.21.15.83:0/1470777900 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa6a8105b90 0x7fa6a819fd00 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fa6a000b970 tx=0x7fa6a000be30 comp rx=0 tx=0).stop 2024-09-21T01:41:13.823 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:13.822+0000 7fa6af336640 1 -- 172.21.15.83:0/1470777900 shutdown_connections 2024-09-21T01:41:13.823 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:13.822+0000 7fa6af336640 1 --2- 172.21.15.83:0/1470777900 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fa6940b6670 0x7fa6940b8b80 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:13.823 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:13.822+0000 7fa6af336640 1 --2- 172.21.15.83:0/1470777900 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa6a8105b90 0x7fa6a819fd00 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:13.823 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:13.822+0000 7fa6af336640 1 --2- 172.21.15.83:0/1470777900 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa6a8105240 0x7fa6a819aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:13.823 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:13.822+0000 7fa6af336640 1 --2- 172.21.15.83:0/1470777900 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa6a8103270 0x7fa6a819a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:13.823 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:13.822+0000 7fa6af336640 1 -- 172.21.15.83:0/1470777900 >> 172.21.15.83:0/1470777900 conn(0x7fa6a8079ec0 msgr2=0x7fa6a8106660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:41:13.824 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:13.823+0000 7fa6af336640 1 -- 172.21.15.83:0/1470777900 shutdown_connections 2024-09-21T01:41:13.824 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:13.823+0000 7fa6af336640 1 -- 172.21.15.83:0/1470777900 wait complete. 2024-09-21T01:41:13.837 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:13.837+0000 7f9a87559640 1 -- 172.21.15.83:0/750770896 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9a80102a60 msgr2=0x7f9a80102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:13.838 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:13.837+0000 7f9a87559640 1 --2- 172.21.15.83:0/750770896 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9a80102a60 0x7f9a80102e70 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f9a7c009900 tx=0x7f9a7c02a410 comp rx=0 tx=0).stop 2024-09-21T01:41:13.838 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:13.837+0000 7f9a87559640 1 -- 172.21.15.83:0/750770896 shutdown_connections 2024-09-21T01:41:13.838 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:13.837+0000 7f9a87559640 1 --2- 172.21.15.83:0/750770896 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9a80108cf0 0x7f9a8010f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:13.838 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:13.837+0000 7f9a87559640 1 --2- 172.21.15.83:0/750770896 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9a801083a0 0x7f9a801087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:13.838 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:13.837+0000 7f9a87559640 1 --2- 172.21.15.83:0/750770896 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9a80102a60 0x7f9a80102e70 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:13.838 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:13.837+0000 7f9a87559640 1 -- 172.21.15.83:0/750770896 >> 172.21.15.83:0/750770896 conn(0x7f9a80079730 msgr2=0x7f9a80079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:41:13.838 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:13.837+0000 7f9a87559640 1 -- 172.21.15.83:0/750770896 shutdown_connections 2024-09-21T01:41:13.838 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:13.837+0000 7f9a87559640 1 -- 172.21.15.83:0/750770896 wait complete. 2024-09-21T01:41:13.839 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:13.838+0000 7f9a87559640 1 Processor -- start 2024-09-21T01:41:13.839 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:13.838+0000 7f9a87559640 1 -- start start 2024-09-21T01:41:13.840 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:13.839+0000 7f9a87559640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9a80102a60 0x7f9a8019b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:13.840 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:13.839+0000 7f9a87559640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9a801083a0 0x7f9a8019b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:13.840 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:13.839+0000 7f9a87559640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9a80108cf0 0x7f9a8019bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:13.840 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:13.839+0000 7f9a87559640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f9a80112810 con 0x7f9a801083a0 2024-09-21T01:41:13.840 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:13.839+0000 7f9a87559640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f9a80112690 con 0x7f9a80108cf0 2024-09-21T01:41:13.840 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:13.839+0000 7f9a87559640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f9a80112990 con 0x7f9a80102a60 2024-09-21T01:41:13.840 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:13.839+0000 7f9a84af4640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9a801083a0 0x7f9a8019b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:13.840 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:13.839+0000 7f9a84af4640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9a801083a0 0x7f9a8019b6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:58820/0 (socket says 172.21.15.83:58820) 2024-09-21T01:41:13.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:13.839+0000 7f9a852f5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9a80102a60 0x7f9a8019b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:13.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:13.839+0000 7f9a84af4640 1 -- 172.21.15.83:0/452433062 learned_addr learned my addr 172.21.15.83:0/452433062 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:41:13.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:13.839+0000 7f9a85af6640 1 --2- 172.21.15.83:0/452433062 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9a80108cf0 0x7f9a8019bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:13.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:13.839+0000 7f9a84af4640 1 -- 172.21.15.83:0/452433062 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9a80102a60 msgr2=0x7f9a8019b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:13.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:13.839+0000 7f9a84af4640 1 --2- 172.21.15.83:0/452433062 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9a80102a60 0x7f9a8019b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:13.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:13.839+0000 7f9a84af4640 1 -- 172.21.15.83:0/452433062 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9a80108cf0 msgr2=0x7f9a8019bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:13.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:13.839+0000 7f9a84af4640 1 --2- 172.21.15.83:0/452433062 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9a80108cf0 0x7f9a8019bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:13.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:13.839+0000 7f9a84af4640 1 -- 172.21.15.83:0/452433062 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a801a6430 con 0x7f9a801083a0 2024-09-21T01:41:13.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:13.839+0000 7f9a852f5640 1 --2- 172.21.15.83:0/452433062 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9a80102a60 0x7f9a8019b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:41:13.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:13.839+0000 7f9a84af4640 1 --2- 172.21.15.83:0/452433062 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9a801083a0 0x7f9a8019b6e0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f9a7000e9c0 tx=0x7f9a7000ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:41:13.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:13.840+0000 7f9a767fc640 1 -- 172.21.15.83:0/452433062 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a7000cd80 con 0x7f9a801083a0 2024-09-21T01:41:13.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:13.840+0000 7f9a87559640 1 -- 172.21.15.83:0/452433062 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a801a6720 con 0x7f9a801083a0 2024-09-21T01:41:13.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:13.840+0000 7f9a767fc640 1 -- 172.21.15.83:0/452433062 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9a700054b0 con 0x7f9a801083a0 2024-09-21T01:41:13.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:13.840+0000 7f9a767fc640 1 -- 172.21.15.83:0/452433062 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a70010430 con 0x7f9a801083a0 2024-09-21T01:41:13.842 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:13.840+0000 7f9a87559640 1 -- 172.21.15.83:0/452433062 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a801a6c60 con 0x7f9a801083a0 2024-09-21T01:41:13.842 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:13.841+0000 7f9a87559640 1 -- 172.21.15.83:0/452433062 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a80102e70 con 0x7f9a801083a0 2024-09-21T01:41:13.843 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:13.843+0000 7f9a767fc640 1 -- 172.21.15.83:0/452433062 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7f9a70004f20 con 0x7f9a801083a0 2024-09-21T01:41:13.843 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:13.843+0000 7f9a767fc640 1 --2- 172.21.15.83:0/452433062 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f9a6c0b6620 0x7f9a6c0b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:13.844 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:13.844+0000 7f9a852f5640 1 --2- 172.21.15.83:0/452433062 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f9a6c0b6620 0x7f9a6c0b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:13.844 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:13.844+0000 7f9a767fc640 1 -- 172.21.15.83:0/452433062 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9315+0+0 (secure 0 0 0) 0x7f9a700e7ef0 con 0x7f9a801083a0 2024-09-21T01:41:13.844 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:13.844+0000 7f9a852f5640 1 --2- 172.21.15.83:0/452433062 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f9a6c0b6620 0x7f9a6c0b8b30 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f9a8006b9c0 tx=0x7f9a7c0058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:41:13.851 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:13.850+0000 7f9a767fc640 1 -- 172.21.15.83:0/452433062 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f9a70056710 con 0x7f9a801083a0 2024-09-21T01:41:14.035 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:14.035+0000 7f9a87559640 1 -- 172.21.15.83:0/452433062 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f9a8002e640 con 0x7f9a801083a0 2024-09-21T01:41:14.036 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:14.035+0000 7f9a767fc640 1 -- 172.21.15.83:0/452433062 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f9a700ae1e0 con 0x7f9a801083a0 2024-09-21T01:41:14.036 INFO:teuthology.orchestra.run.smithi083.stdout:107374182472 2024-09-21T01:41:14.039 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:14.038+0000 7f9a87559640 1 -- 172.21.15.83:0/452433062 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f9a6c0b6620 msgr2=0x7f9a6c0b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:14.039 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:14.038+0000 7f9a87559640 1 --2- 172.21.15.83:0/452433062 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f9a6c0b6620 0x7f9a6c0b8b30 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f9a8006b9c0 tx=0x7f9a7c0058d0 comp rx=0 tx=0).stop 2024-09-21T01:41:14.039 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:14.038+0000 7f9a87559640 1 -- 172.21.15.83:0/452433062 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9a801083a0 msgr2=0x7f9a8019b6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:14.039 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:14.038+0000 7f9a87559640 1 --2- 172.21.15.83:0/452433062 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9a801083a0 0x7f9a8019b6e0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f9a7000e9c0 tx=0x7f9a7000ee80 comp rx=0 tx=0).stop 2024-09-21T01:41:14.039 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:14.038+0000 7f9a87559640 1 -- 172.21.15.83:0/452433062 shutdown_connections 2024-09-21T01:41:14.039 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:14.038+0000 7f9a87559640 1 --2- 172.21.15.83:0/452433062 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f9a6c0b6620 0x7f9a6c0b8b30 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:14.039 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:14.038+0000 7f9a87559640 1 --2- 172.21.15.83:0/452433062 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9a80108cf0 0x7f9a8019bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:14.039 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:14.038+0000 7f9a87559640 1 --2- 172.21.15.83:0/452433062 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9a801083a0 0x7f9a8019b6e0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:14.039 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:14.038+0000 7f9a87559640 1 --2- 172.21.15.83:0/452433062 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9a80102a60 0x7f9a8019b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:14.039 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:14.038+0000 7f9a87559640 1 -- 172.21.15.83:0/452433062 >> 172.21.15.83:0/452433062 conn(0x7f9a80079730 msgr2=0x7f9a80101440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:41:14.040 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:14.038+0000 7f9a87559640 1 -- 172.21.15.83:0/452433062 shutdown_connections 2024-09-21T01:41:14.040 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:14.039+0000 7f9a87559640 1 -- 172.21.15.83:0/452433062 wait complete. 2024-09-21T01:41:14.468 INFO:tasks.cephadm.ceph_manager.ceph:need seq 249108103206 got 249108103209 for osd.9 2024-09-21T01:41:14.469 DEBUG:teuthology.parallel:result is None 2024-09-21T01:41:14.659 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:41:14 smithi083 ceph-mon[31370]: from='client.? 172.21.15.83:0/1470777900' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2024-09-21T01:41:14.659 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:41:14 smithi083 ceph-mon[31370]: from='client.? 172.21.15.83:0/452433062' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2024-09-21T01:41:14.660 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:14.658+0000 7f0d8a97b640 1 -- 172.21.15.83:0/1044625963 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0d84108d00 msgr2=0x7f0d8410f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:14.661 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:14.658+0000 7f0d8a97b640 1 --2- 172.21.15.83:0/1044625963 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0d84108d00 0x7f0d8410f530 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f0d7c009ca0 tx=0x7f0d7c02a8c0 comp rx=0 tx=0).stop 2024-09-21T01:41:14.661 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:14.658+0000 7f0d8a97b640 1 -- 172.21.15.83:0/1044625963 shutdown_connections 2024-09-21T01:41:14.661 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:14.658+0000 7f0d8a97b640 1 --2- 172.21.15.83:0/1044625963 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0d84108d00 0x7f0d8410f530 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:14.661 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:14.658+0000 7f0d8a97b640 1 --2- 172.21.15.83:0/1044625963 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0d841083b0 0x7f0d841087c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:14.661 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:14.658+0000 7f0d8a97b640 1 --2- 172.21.15.83:0/1044625963 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0d84103140 0x7f0d84103550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:14.661 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:14.658+0000 7f0d8a97b640 1 -- 172.21.15.83:0/1044625963 >> 172.21.15.83:0/1044625963 conn(0x7f0d84077c60 msgr2=0x7f0d840780a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:41:14.661 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:14.658+0000 7f0d8a97b640 1 -- 172.21.15.83:0/1044625963 shutdown_connections 2024-09-21T01:41:14.661 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:14.658+0000 7f0d8a97b640 1 -- 172.21.15.83:0/1044625963 wait complete. 2024-09-21T01:41:14.661 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:14.659+0000 7f0d8a97b640 1 Processor -- start 2024-09-21T01:41:14.661 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:14.659+0000 7f0d8a97b640 1 -- start start 2024-09-21T01:41:14.661 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:14.659+0000 7f0d8a97b640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0d84103140 0x7f0d8419a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:14.661 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:14.659+0000 7f0d8a97b640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0d841083b0 0x7f0d8419a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:14.661 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:14.659+0000 7f0d8a97b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0d84108d00 0x7f0d8419fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:14.662 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:14.659+0000 7f0d8a97b640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f0d841139d0 con 0x7f0d841083b0 2024-09-21T01:41:14.662 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:14.659+0000 7f0d8a97b640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f0d84113850 con 0x7f0d84108d00 2024-09-21T01:41:14.662 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:14.659+0000 7f0d8a97b640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f0d84113b50 con 0x7f0d84103140 2024-09-21T01:41:14.662 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:14.659+0000 7f0d7bfff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0d841083b0 0x7f0d8419a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:14.662 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:14.659+0000 7f0d7bfff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0d841083b0 0x7f0d8419a940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:58826/0 (socket says 172.21.15.83:58826) 2024-09-21T01:41:14.662 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:14.659+0000 7f0d7bfff640 1 -- 172.21.15.83:0/2944205299 learned_addr learned my addr 172.21.15.83:0/2944205299 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:41:14.662 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:14.660+0000 7f0d83fff640 1 --2- 172.21.15.83:0/2944205299 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0d84103140 0x7f0d8419a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:14.662 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:14.660+0000 7f0d7bfff640 1 -- 172.21.15.83:0/2944205299 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0d84103140 msgr2=0x7f0d8419a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:14.662 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:14.660+0000 7f0d7bfff640 1 --2- 172.21.15.83:0/2944205299 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0d84103140 0x7f0d8419a3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:14.662 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:14.660+0000 7f0d7bfff640 1 -- 172.21.15.83:0/2944205299 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0d84108d00 msgr2=0x7f0d8419fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:14.662 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:14.660+0000 7f0d7bfff640 1 --2- 172.21.15.83:0/2944205299 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0d84108d00 0x7f0d8419fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:14.662 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:14.660+0000 7f0d7bfff640 1 -- 172.21.15.83:0/2944205299 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d841a0250 con 0x7f0d841083b0 2024-09-21T01:41:14.662 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:14.660+0000 7f0d7bfff640 1 --2- 172.21.15.83:0/2944205299 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0d841083b0 0x7f0d8419a940 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f0d6c00c8c0 tx=0x7f0d6c00cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:41:14.663 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:14.660+0000 7f0d81ffb640 1 -- 172.21.15.83:0/2944205299 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d6c007bb0 con 0x7f0d841083b0 2024-09-21T01:41:14.663 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:14.660+0000 7f0d81ffb640 1 -- 172.21.15.83:0/2944205299 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0d6c007d50 con 0x7f0d841083b0 2024-09-21T01:41:14.663 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:14.660+0000 7f0d81ffb640 1 -- 172.21.15.83:0/2944205299 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d6c018730 con 0x7f0d841083b0 2024-09-21T01:41:14.663 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:14.660+0000 7f0d8a97b640 1 -- 172.21.15.83:0/2944205299 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d841a0540 con 0x7f0d841083b0 2024-09-21T01:41:14.663 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:14.660+0000 7f0d8a97b640 1 -- 172.21.15.83:0/2944205299 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d8410fd70 con 0x7f0d841083b0 2024-09-21T01:41:14.663 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:14.661+0000 7f0d8a97b640 1 -- 172.21.15.83:0/2944205299 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d84103ec0 con 0x7f0d841083b0 2024-09-21T01:41:14.663 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:14.663+0000 7f0d81ffb640 1 -- 172.21.15.83:0/2944205299 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7f0d6c00fa90 con 0x7f0d841083b0 2024-09-21T01:41:14.664 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:14.664+0000 7f0d81ffb640 1 --2- 172.21.15.83:0/2944205299 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f0d700b66a0 0x7f0d700b8bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:14.664 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:14.664+0000 7f0d83fff640 1 --2- 172.21.15.83:0/2944205299 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f0d700b66a0 0x7f0d700b8bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:14.664 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:14.664+0000 7f0d81ffb640 1 -- 172.21.15.83:0/2944205299 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9315+0+0 (secure 0 0 0) 0x7f0d6c0e7be0 con 0x7f0d841083b0 2024-09-21T01:41:14.664 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:14.664+0000 7f0d83fff640 1 --2- 172.21.15.83:0/2944205299 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f0d700b66a0 0x7f0d700b8bb0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f0d74009bd0 tx=0x7f0d74005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:41:14.667 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:14.667+0000 7f0d81ffb640 1 -- 172.21.15.83:0/2944205299 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f0d6c014030 con 0x7f0d841083b0 2024-09-21T01:41:14.714 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:41:14 smithi142 ceph-mon[34050]: from='client.? 172.21.15.83:0/1470777900' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2024-09-21T01:41:14.715 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:41:14 smithi142 ceph-mon[34050]: from='client.? 172.21.15.83:0/452433062' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2024-09-21T01:41:14.717 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:41:14 smithi119 ceph-mon[33693]: from='client.? 172.21.15.83:0/1470777900' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2024-09-21T01:41:14.717 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:41:14 smithi119 ceph-mon[33693]: from='client.? 172.21.15.83:0/452433062' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2024-09-21T01:41:14.855 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:14.854+0000 7f0d8a97b640 1 -- 172.21.15.83:0/2944205299 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f0d8410ab50 con 0x7f0d841083b0 2024-09-21T01:41:14.855 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:14.854+0000 7f0d81ffb640 1 -- 172.21.15.83:0/2944205299 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f0d6c0adfe0 con 0x7f0d841083b0 2024-09-21T01:41:14.855 INFO:teuthology.orchestra.run.smithi083.stdout:197568495666 2024-09-21T01:41:14.857 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:14.857+0000 7f0d8a97b640 1 -- 172.21.15.83:0/2944205299 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f0d700b66a0 msgr2=0x7f0d700b8bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:14.857 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:14.857+0000 7f0d8a97b640 1 --2- 172.21.15.83:0/2944205299 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f0d700b66a0 0x7f0d700b8bb0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f0d74009bd0 tx=0x7f0d74005f90 comp rx=0 tx=0).stop 2024-09-21T01:41:14.857 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:14.857+0000 7f0d8a97b640 1 -- 172.21.15.83:0/2944205299 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0d841083b0 msgr2=0x7f0d8419a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:14.857 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:14.857+0000 7f0d8a97b640 1 --2- 172.21.15.83:0/2944205299 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0d841083b0 0x7f0d8419a940 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f0d6c00c8c0 tx=0x7f0d6c00cd80 comp rx=0 tx=0).stop 2024-09-21T01:41:14.858 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:14.857+0000 7f0d8a97b640 1 -- 172.21.15.83:0/2944205299 shutdown_connections 2024-09-21T01:41:14.858 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:14.857+0000 7f0d8a97b640 1 --2- 172.21.15.83:0/2944205299 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f0d700b66a0 0x7f0d700b8bb0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:14.858 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:14.857+0000 7f0d8a97b640 1 --2- 172.21.15.83:0/2944205299 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0d84108d00 0x7f0d8419fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:14.858 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:14.857+0000 7f0d8a97b640 1 --2- 172.21.15.83:0/2944205299 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0d841083b0 0x7f0d8419a940 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:14.858 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:14.857+0000 7f0d8a97b640 1 --2- 172.21.15.83:0/2944205299 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0d84103140 0x7f0d8419a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:14.858 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:14.857+0000 7f0d8a97b640 1 -- 172.21.15.83:0/2944205299 >> 172.21.15.83:0/2944205299 conn(0x7f0d84077c60 msgr2=0x7f0d84104380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:41:14.858 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:14.857+0000 7f0d8a97b640 1 -- 172.21.15.83:0/2944205299 shutdown_connections 2024-09-21T01:41:14.858 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:14.857+0000 7f0d8a97b640 1 -- 172.21.15.83:0/2944205299 wait complete. 2024-09-21T01:41:15.514 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:41:15.525 INFO:tasks.cephadm.ceph_manager.ceph:need seq 270582939680 got 270582939682 for osd.10 2024-09-21T01:41:15.525 DEBUG:teuthology.parallel:result is None 2024-09-21T01:41:15.714 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:41:15 smithi142 ceph-mon[34050]: pgmap v315: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T01:41:15.714 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:41:15 smithi142 ceph-mon[34050]: from='client.? 172.21.15.83:0/2944205299' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2024-09-21T01:41:15.717 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:41:15 smithi119 ceph-mon[33693]: pgmap v315: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T01:41:15.717 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:41:15 smithi119 ceph-mon[33693]: from='client.? 172.21.15.83:0/2944205299' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2024-09-21T01:41:15.804 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:41:15 smithi083 ceph-mon[31370]: pgmap v315: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T01:41:15.804 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:41:15 smithi083 ceph-mon[31370]: from='client.? 172.21.15.83:0/2944205299' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2024-09-21T01:41:15.961 INFO:tasks.cephadm.ceph_manager.ceph:need seq 107374182469 got 107374182472 for osd.3 2024-09-21T01:41:15.962 DEBUG:teuthology.parallel:result is None 2024-09-21T01:41:16.383 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:16.365+0000 7f6e42fcc640 1 -- 172.21.15.83:0/816764852 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6e3c108420 msgr2=0x7f6e3c108830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:16.384 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:16.365+0000 7f6e42fcc640 1 --2- 172.21.15.83:0/816764852 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6e3c108420 0x7f6e3c108830 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f6e2c009900 tx=0x7f6e2c02a410 comp rx=0 tx=0).stop 2024-09-21T01:41:16.384 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:16.365+0000 7f6e42fcc640 1 -- 172.21.15.83:0/816764852 shutdown_connections 2024-09-21T01:41:16.384 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:16.365+0000 7f6e42fcc640 1 --2- 172.21.15.83:0/816764852 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6e3c108d70 0x7f6e3c10f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:16.384 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:16.365+0000 7f6e42fcc640 1 --2- 172.21.15.83:0/816764852 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6e3c108420 0x7f6e3c108830 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:16.384 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:16.365+0000 7f6e42fcc640 1 --2- 172.21.15.83:0/816764852 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6e3c102ae0 0x7f6e3c102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:16.384 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:16.365+0000 7f6e42fcc640 1 -- 172.21.15.83:0/816764852 >> 172.21.15.83:0/816764852 conn(0x7f6e3c079770 msgr2=0x7f6e3c079b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:41:16.384 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:16.365+0000 7f6e42fcc640 1 -- 172.21.15.83:0/816764852 shutdown_connections 2024-09-21T01:41:16.384 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:16.365+0000 7f6e42fcc640 1 -- 172.21.15.83:0/816764852 wait complete. 2024-09-21T01:41:16.384 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:16.366+0000 7f6e42fcc640 1 Processor -- start 2024-09-21T01:41:16.384 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:16.366+0000 7f6e42fcc640 1 -- start start 2024-09-21T01:41:16.384 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:16.366+0000 7f6e42fcc640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6e3c102ae0 0x7f6e3c19a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:16.384 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:16.366+0000 7f6e42fcc640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6e3c108420 0x7f6e3c19aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:16.384 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:16.366+0000 7f6e42fcc640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6e3c108d70 0x7f6e3c19fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:16.385 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:16.366+0000 7f6e42fcc640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f6e3c1128e0 con 0x7f6e3c102ae0 2024-09-21T01:41:16.385 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:16.366+0000 7f6e42fcc640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f6e3c112760 con 0x7f6e3c108d70 2024-09-21T01:41:16.385 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:16.366+0000 7f6e42fcc640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f6e3c112a60 con 0x7f6e3c108420 2024-09-21T01:41:16.385 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:16.366+0000 7f6e40d68640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6e3c102ae0 0x7f6e3c19a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:16.385 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:16.366+0000 7f6e40d68640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6e3c102ae0 0x7f6e3c19a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:58836/0 (socket says 172.21.15.83:58836) 2024-09-21T01:41:16.385 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:16.366+0000 7f6e40d68640 1 -- 172.21.15.83:0/1378315111 learned_addr learned my addr 172.21.15.83:0/1378315111 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:41:16.385 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:16.366+0000 7f6e3bfff640 1 --2- 172.21.15.83:0/1378315111 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6e3c108420 0x7f6e3c19aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:16.385 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:16.366+0000 7f6e41569640 1 --2- 172.21.15.83:0/1378315111 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6e3c108d70 0x7f6e3c19fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:16.385 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:16.366+0000 7f6e40d68640 1 -- 172.21.15.83:0/1378315111 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6e3c108420 msgr2=0x7f6e3c19aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:16.385 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:16.366+0000 7f6e40d68640 1 --2- 172.21.15.83:0/1378315111 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6e3c108420 0x7f6e3c19aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:16.385 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:16.366+0000 7f6e40d68640 1 -- 172.21.15.83:0/1378315111 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6e3c108d70 msgr2=0x7f6e3c19fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:16.385 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:16.366+0000 7f6e40d68640 1 --2- 172.21.15.83:0/1378315111 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6e3c108d70 0x7f6e3c19fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:16.385 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:16.366+0000 7f6e40d68640 1 -- 172.21.15.83:0/1378315111 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e3c1a0410 con 0x7f6e3c102ae0 2024-09-21T01:41:16.385 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:16.367+0000 7f6e40d68640 1 --2- 172.21.15.83:0/1378315111 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6e3c102ae0 0x7f6e3c19a4a0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f6e2400c970 tx=0x7f6e2400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:41:16.386 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:16.367+0000 7f6e39ffb640 1 -- 172.21.15.83:0/1378315111 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e24007bb0 con 0x7f6e3c102ae0 2024-09-21T01:41:16.386 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:16.367+0000 7f6e39ffb640 1 -- 172.21.15.83:0/1378315111 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6e24007d50 con 0x7f6e3c102ae0 2024-09-21T01:41:16.386 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:16.367+0000 7f6e42fcc640 1 -- 172.21.15.83:0/1378315111 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e3c1a0700 con 0x7f6e3c102ae0 2024-09-21T01:41:16.386 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:16.367+0000 7f6e39ffb640 1 -- 172.21.15.83:0/1378315111 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e24004e40 con 0x7f6e3c102ae0 2024-09-21T01:41:16.386 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:16.367+0000 7f6e42fcc640 1 -- 172.21.15.83:0/1378315111 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e3c1a6e60 con 0x7f6e3c102ae0 2024-09-21T01:41:16.386 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:16.368+0000 7f6e42fcc640 1 -- 172.21.15.83:0/1378315111 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e3c103d60 con 0x7f6e3c102ae0 2024-09-21T01:41:16.386 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:16.369+0000 7f6e39ffb640 1 -- 172.21.15.83:0/1378315111 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7f6e24005020 con 0x7f6e3c102ae0 2024-09-21T01:41:16.386 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:16.370+0000 7f6e39ffb640 1 --2- 172.21.15.83:0/1378315111 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f6e280b65f0 0x7f6e280b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:16.386 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:16.370+0000 7f6e3bfff640 1 --2- 172.21.15.83:0/1378315111 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f6e280b65f0 0x7f6e280b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:16.386 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:16.370+0000 7f6e39ffb640 1 -- 172.21.15.83:0/1378315111 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9315+0+0 (secure 0 0 0) 0x7f6e240e7670 con 0x7f6e3c102ae0 2024-09-21T01:41:16.386 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:16.371+0000 7f6e3bfff640 1 --2- 172.21.15.83:0/1378315111 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f6e280b65f0 0x7f6e280b8b00 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f6e2c005940 tx=0x7f6e2c0058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:41:16.386 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:16.374+0000 7f6e39ffb640 1 -- 172.21.15.83:0/1378315111 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6e24014030 con 0x7f6e3c102ae0 2024-09-21T01:41:16.556 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:16.556+0000 7f6e42fcc640 1 -- 172.21.15.83:0/1378315111 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f6e3c10bba0 con 0x7f6e3c102ae0 2024-09-21T01:41:16.556 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:16.556+0000 7f6e39ffb640 1 -- 172.21.15.83:0/1378315111 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f6e3c10bba0 con 0x7f6e3c102ae0 2024-09-21T01:41:16.557 INFO:teuthology.orchestra.run.smithi083.stdout:128849018947 2024-09-21T01:41:16.559 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:16.558+0000 7f6e42fcc640 1 -- 172.21.15.83:0/1378315111 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f6e280b65f0 msgr2=0x7f6e280b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:16.559 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:16.558+0000 7f6e42fcc640 1 --2- 172.21.15.83:0/1378315111 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f6e280b65f0 0x7f6e280b8b00 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f6e2c005940 tx=0x7f6e2c0058d0 comp rx=0 tx=0).stop 2024-09-21T01:41:16.559 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:16.559+0000 7f6e42fcc640 1 -- 172.21.15.83:0/1378315111 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6e3c102ae0 msgr2=0x7f6e3c19a4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:16.559 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:16.559+0000 7f6e42fcc640 1 --2- 172.21.15.83:0/1378315111 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6e3c102ae0 0x7f6e3c19a4a0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f6e2400c970 tx=0x7f6e2400ce30 comp rx=0 tx=0).stop 2024-09-21T01:41:16.559 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:16.559+0000 7f6e42fcc640 1 -- 172.21.15.83:0/1378315111 shutdown_connections 2024-09-21T01:41:16.559 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:16.559+0000 7f6e42fcc640 1 --2- 172.21.15.83:0/1378315111 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f6e280b65f0 0x7f6e280b8b00 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:16.559 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:16.559+0000 7f6e42fcc640 1 --2- 172.21.15.83:0/1378315111 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6e3c108d70 0x7f6e3c19fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:16.560 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:16.559+0000 7f6e42fcc640 1 --2- 172.21.15.83:0/1378315111 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6e3c108420 0x7f6e3c19aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:16.560 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:16.559+0000 7f6e42fcc640 1 --2- 172.21.15.83:0/1378315111 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6e3c102ae0 0x7f6e3c19a4a0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:16.560 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:16.559+0000 7f6e42fcc640 1 -- 172.21.15.83:0/1378315111 >> 172.21.15.83:0/1378315111 conn(0x7f6e3c079770 msgr2=0x7f6e3c101be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:41:16.560 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:16.559+0000 7f6e42fcc640 1 -- 172.21.15.83:0/1378315111 shutdown_connections 2024-09-21T01:41:16.560 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:16.559+0000 7f6e42fcc640 1 -- 172.21.15.83:0/1378315111 wait complete. 2024-09-21T01:41:16.964 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:41:16 smithi142 ceph-mon[34050]: from='client.? 172.21.15.83:0/1378315111' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2024-09-21T01:41:16.967 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:41:16 smithi119 ceph-mon[33693]: from='client.? 172.21.15.83:0/1378315111' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2024-09-21T01:41:16.989 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:41:16 smithi083 ceph-mon[31370]: from='client.? 172.21.15.83:0/1378315111' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2024-09-21T01:41:17.589 INFO:tasks.cephadm.ceph_manager.ceph:need seq 128849018944 got 128849018947 for osd.4 2024-09-21T01:41:17.589 DEBUG:teuthology.parallel:result is None 2024-09-21T01:41:17.803 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:41:17 smithi083 ceph-mon[31370]: pgmap v316: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T01:41:17.847 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:17.785+0000 7ff714b25640 1 -- 172.21.15.83:0/148390162 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff710076080 msgr2=0x7ff71010fc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:17.847 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:17.785+0000 7ff714b25640 1 --2- 172.21.15.83:0/148390162 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff710076080 0x7ff71010fc20 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7ff704009900 tx=0x7ff70402a410 comp rx=0 tx=0).stop 2024-09-21T01:41:17.847 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:17.785+0000 7ff714b25640 1 -- 172.21.15.83:0/148390162 shutdown_connections 2024-09-21T01:41:17.847 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:17.785+0000 7ff714b25640 1 --2- 172.21.15.83:0/148390162 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff710110160 0x7ff710112580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:17.847 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:17.785+0000 7ff714b25640 1 --2- 172.21.15.83:0/148390162 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff710076080 0x7ff71010fc20 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:17.847 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:17.785+0000 7ff714b25640 1 --2- 172.21.15.83:0/148390162 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff710075730 0x7ff710075b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:17.847 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:17.785+0000 7ff714b25640 1 -- 172.21.15.83:0/148390162 >> 172.21.15.83:0/148390162 conn(0x7ff7100ff5b0 msgr2=0x7ff710101a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:41:17.847 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:17.785+0000 7ff714b25640 1 -- 172.21.15.83:0/148390162 shutdown_connections 2024-09-21T01:41:17.847 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:17.785+0000 7ff714b25640 1 -- 172.21.15.83:0/148390162 wait complete. 2024-09-21T01:41:17.847 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:17.786+0000 7ff714b25640 1 Processor -- start 2024-09-21T01:41:17.848 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:17.786+0000 7ff714b25640 1 -- start start 2024-09-21T01:41:17.848 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:17.786+0000 7ff714b25640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff710075730 0x7ff71019c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:17.848 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:17.786+0000 7ff714b25640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff710076080 0x7ff71019cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:17.848 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:17.786+0000 7ff714b25640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff710110160 0x7ff7101a1e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:17.848 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:17.786+0000 7ff714b25640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7ff710115b50 con 0x7ff710075730 2024-09-21T01:41:17.848 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:17.786+0000 7ff714b25640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7ff7101159d0 con 0x7ff710110160 2024-09-21T01:41:17.848 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:17.786+0000 7ff714b25640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7ff710115cd0 con 0x7ff710076080 2024-09-21T01:41:17.848 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:17.786+0000 7ff70e59c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff710075730 0x7ff71019c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:17.848 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:17.786+0000 7ff70e59c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff710075730 0x7ff71019c5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:58860/0 (socket says 172.21.15.83:58860) 2024-09-21T01:41:17.848 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:17.786+0000 7ff70e59c640 1 -- 172.21.15.83:0/3414732371 learned_addr learned my addr 172.21.15.83:0/3414732371 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:41:17.848 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:17.786+0000 7ff70dd9b640 1 --2- 172.21.15.83:0/3414732371 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff710076080 0x7ff71019cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:17.848 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:17.787+0000 7ff70ed9d640 1 --2- 172.21.15.83:0/3414732371 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff710110160 0x7ff7101a1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:17.848 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:17.787+0000 7ff70e59c640 1 -- 172.21.15.83:0/3414732371 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff710076080 msgr2=0x7ff71019cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:17.848 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:17.787+0000 7ff70e59c640 1 --2- 172.21.15.83:0/3414732371 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff710076080 0x7ff71019cb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:17.849 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:17.787+0000 7ff70e59c640 1 -- 172.21.15.83:0/3414732371 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff710110160 msgr2=0x7ff7101a1e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:17.849 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:17.787+0000 7ff70e59c640 1 --2- 172.21.15.83:0/3414732371 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff710110160 0x7ff7101a1e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:17.849 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:17.787+0000 7ff70e59c640 1 -- 172.21.15.83:0/3414732371 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7101a2530 con 0x7ff710075730 2024-09-21T01:41:17.849 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:17.787+0000 7ff70e59c640 1 --2- 172.21.15.83:0/3414732371 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff710075730 0x7ff71019c5c0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7ff70000d950 tx=0x7ff70000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:41:17.849 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:17.787+0000 7ff6ff7fe640 1 -- 172.21.15.83:0/3414732371 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff700017070 con 0x7ff710075730 2024-09-21T01:41:17.849 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:17.787+0000 7ff6ff7fe640 1 -- 172.21.15.83:0/3414732371 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff700009c30 con 0x7ff710075730 2024-09-21T01:41:17.849 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:17.787+0000 7ff714b25640 1 -- 172.21.15.83:0/3414732371 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7101a2820 con 0x7ff710075730 2024-09-21T01:41:17.849 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:17.787+0000 7ff6ff7fe640 1 -- 172.21.15.83:0/3414732371 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff70000f620 con 0x7ff710075730 2024-09-21T01:41:17.849 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:17.787+0000 7ff714b25640 1 -- 172.21.15.83:0/3414732371 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7101a8f80 con 0x7ff710075730 2024-09-21T01:41:17.849 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:17.788+0000 7ff714b25640 1 -- 172.21.15.83:0/3414732371 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff710076c40 con 0x7ff710075730 2024-09-21T01:41:17.849 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:17.790+0000 7ff6ff7fe640 1 -- 172.21.15.83:0/3414732371 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7ff700005030 con 0x7ff710075730 2024-09-21T01:41:17.849 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:17.790+0000 7ff6ff7fe640 1 --2- 172.21.15.83:0/3414732371 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7ff6f80b65f0 0x7ff6f80b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:17.849 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:17.791+0000 7ff70dd9b640 1 --2- 172.21.15.83:0/3414732371 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7ff6f80b65f0 0x7ff6f80b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:17.849 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:17.791+0000 7ff6ff7fe640 1 -- 172.21.15.83:0/3414732371 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9315+0+0 (secure 0 0 0) 0x7ff7000e7520 con 0x7ff710075730 2024-09-21T01:41:17.850 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:17.791+0000 7ff70dd9b640 1 --2- 172.21.15.83:0/3414732371 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7ff6f80b65f0 0x7ff6f80b8b00 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7ff704005940 tx=0x7ff7040058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:41:17.850 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:17.794+0000 7ff6ff7fe640 1 -- 172.21.15.83:0/3414732371 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff7000ad810 con 0x7ff710075730 2024-09-21T01:41:17.964 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:41:17 smithi142 ceph-mon[34050]: pgmap v316: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T01:41:17.967 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:41:17 smithi119 ceph-mon[33693]: pgmap v316: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T01:41:17.976 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:17.976+0000 7ff714b25640 1 -- 172.21.15.83:0/3414732371 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7ff71010b340 con 0x7ff710075730 2024-09-21T01:41:17.977 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:17.976+0000 7ff6ff7fe640 1 -- 172.21.15.83:0/3414732371 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7ff700009de0 con 0x7ff710075730 2024-09-21T01:41:17.977 INFO:teuthology.orchestra.run.smithi083.stdout:176093659192 2024-09-21T01:41:17.979 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:17.978+0000 7ff714b25640 1 -- 172.21.15.83:0/3414732371 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7ff6f80b65f0 msgr2=0x7ff6f80b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:17.979 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:17.978+0000 7ff714b25640 1 --2- 172.21.15.83:0/3414732371 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7ff6f80b65f0 0x7ff6f80b8b00 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7ff704005940 tx=0x7ff7040058d0 comp rx=0 tx=0).stop 2024-09-21T01:41:17.979 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:17.978+0000 7ff714b25640 1 -- 172.21.15.83:0/3414732371 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff710075730 msgr2=0x7ff71019c5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:17.979 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:17.978+0000 7ff714b25640 1 --2- 172.21.15.83:0/3414732371 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff710075730 0x7ff71019c5c0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7ff70000d950 tx=0x7ff70000de10 comp rx=0 tx=0).stop 2024-09-21T01:41:17.979 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:17.978+0000 7ff714b25640 1 -- 172.21.15.83:0/3414732371 shutdown_connections 2024-09-21T01:41:17.979 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:17.978+0000 7ff714b25640 1 --2- 172.21.15.83:0/3414732371 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7ff6f80b65f0 0x7ff6f80b8b00 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:17.979 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:17.978+0000 7ff714b25640 1 --2- 172.21.15.83:0/3414732371 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff710110160 0x7ff7101a1e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:17.979 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:17.978+0000 7ff714b25640 1 --2- 172.21.15.83:0/3414732371 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff710076080 0x7ff71019cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:17.980 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:17.978+0000 7ff714b25640 1 --2- 172.21.15.83:0/3414732371 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff710075730 0x7ff71019c5c0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:17.980 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:17.978+0000 7ff714b25640 1 -- 172.21.15.83:0/3414732371 >> 172.21.15.83:0/3414732371 conn(0x7ff7100ff5b0 msgr2=0x7ff710101360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:41:17.980 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:17.979+0000 7ff714b25640 1 -- 172.21.15.83:0/3414732371 shutdown_connections 2024-09-21T01:41:17.980 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:17.979+0000 7ff714b25640 1 -- 172.21.15.83:0/3414732371 wait complete. 2024-09-21T01:41:18.043 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:18.043+0000 7f6b819d6640 1 -- 172.21.15.83:0/648068629 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6b7c102a60 msgr2=0x7f6b7c102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:18.044 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:18.043+0000 7f6b819d6640 1 --2- 172.21.15.83:0/648068629 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6b7c102a60 0x7f6b7c102e70 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f6b64009900 tx=0x7f6b6402a410 comp rx=0 tx=0).stop 2024-09-21T01:41:18.044 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:18.043+0000 7f6b819d6640 1 -- 172.21.15.83:0/648068629 shutdown_connections 2024-09-21T01:41:18.044 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:18.043+0000 7f6b819d6640 1 --2- 172.21.15.83:0/648068629 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6b7c108cf0 0x7f6b7c10f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:18.044 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:18.043+0000 7f6b819d6640 1 --2- 172.21.15.83:0/648068629 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6b7c1083a0 0x7f6b7c1087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:18.044 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:18.043+0000 7f6b819d6640 1 --2- 172.21.15.83:0/648068629 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6b7c102a60 0x7f6b7c102e70 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:18.044 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:18.043+0000 7f6b819d6640 1 -- 172.21.15.83:0/648068629 >> 172.21.15.83:0/648068629 conn(0x7f6b7c079730 msgr2=0x7f6b7c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:41:18.044 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:18.043+0000 7f6b819d6640 1 -- 172.21.15.83:0/648068629 shutdown_connections 2024-09-21T01:41:18.044 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:18.043+0000 7f6b819d6640 1 -- 172.21.15.83:0/648068629 wait complete. 2024-09-21T01:41:18.046 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:18.044+0000 7f6b819d6640 1 Processor -- start 2024-09-21T01:41:18.046 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:18.044+0000 7f6b819d6640 1 -- start start 2024-09-21T01:41:18.046 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:18.044+0000 7f6b819d6640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6b7c102a60 0x7f6b7c19c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:18.046 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:18.044+0000 7f6b819d6640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6b7c1083a0 0x7f6b7c19cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:18.046 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:18.044+0000 7f6b819d6640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6b7c108cf0 0x7f6b7c1a1df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:18.046 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:18.044+0000 7f6b819d6640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f6b7c112860 con 0x7f6b7c102a60 2024-09-21T01:41:18.046 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:18.044+0000 7f6b819d6640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f6b7c1126e0 con 0x7f6b7c108cf0 2024-09-21T01:41:18.046 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:18.044+0000 7f6b819d6640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f6b7c1129e0 con 0x7f6b7c1083a0 2024-09-21T01:41:18.046 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:18.044+0000 7f6b7affd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6b7c102a60 0x7f6b7c19c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:18.046 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:18.044+0000 7f6b7affd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6b7c102a60 0x7f6b7c19c5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:58878/0 (socket says 172.21.15.83:58878) 2024-09-21T01:41:18.047 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:18.044+0000 7f6b7affd640 1 -- 172.21.15.83:0/2047029714 learned_addr learned my addr 172.21.15.83:0/2047029714 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:41:18.047 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:18.044+0000 7f6b7b7fe640 1 --2- 172.21.15.83:0/2047029714 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6b7c108cf0 0x7f6b7c1a1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:18.047 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:18.044+0000 7f6b7a7fc640 1 --2- 172.21.15.83:0/2047029714 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6b7c1083a0 0x7f6b7c19cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:18.047 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:18.045+0000 7f6b7affd640 1 -- 172.21.15.83:0/2047029714 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6b7c1083a0 msgr2=0x7f6b7c19cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:18.047 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:18.045+0000 7f6b7affd640 1 --2- 172.21.15.83:0/2047029714 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6b7c1083a0 0x7f6b7c19cb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:18.047 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:18.045+0000 7f6b7affd640 1 -- 172.21.15.83:0/2047029714 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6b7c108cf0 msgr2=0x7f6b7c1a1df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:18.047 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:18.045+0000 7f6b7affd640 1 --2- 172.21.15.83:0/2047029714 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6b7c108cf0 0x7f6b7c1a1df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:18.047 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:18.045+0000 7f6b7affd640 1 -- 172.21.15.83:0/2047029714 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b7c1a2460 con 0x7f6b7c102a60 2024-09-21T01:41:18.047 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:18.045+0000 7f6b7affd640 1 --2- 172.21.15.83:0/2047029714 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6b7c102a60 0x7f6b7c19c5b0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f6b6402a930 tx=0x7f6b64003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:41:18.047 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:18.045+0000 7f6b809d4640 1 -- 172.21.15.83:0/2047029714 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b6403f070 con 0x7f6b7c102a60 2024-09-21T01:41:18.047 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:18.045+0000 7f6b819d6640 1 -- 172.21.15.83:0/2047029714 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b7c1a26f0 con 0x7f6b7c102a60 2024-09-21T01:41:18.048 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:18.045+0000 7f6b809d4640 1 -- 172.21.15.83:0/2047029714 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6b64003e40 con 0x7f6b7c102a60 2024-09-21T01:41:18.048 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:18.045+0000 7f6b809d4640 1 -- 172.21.15.83:0/2047029714 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b64035030 con 0x7f6b7c102a60 2024-09-21T01:41:18.048 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:18.045+0000 7f6b819d6640 1 -- 172.21.15.83:0/2047029714 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b7c1a2bd0 con 0x7f6b7c102a60 2024-09-21T01:41:18.048 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:18.046+0000 7f6b819d6640 1 -- 172.21.15.83:0/2047029714 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b7c102e70 con 0x7f6b7c102a60 2024-09-21T01:41:18.048 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:18.048+0000 7f6b809d4640 1 -- 172.21.15.83:0/2047029714 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7f6b64042070 con 0x7f6b7c102a60 2024-09-21T01:41:18.049 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:18.049+0000 7f6b809d4640 1 --2- 172.21.15.83:0/2047029714 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f6b680b6620 0x7f6b680b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:18.049 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:18.049+0000 7f6b7a7fc640 1 --2- 172.21.15.83:0/2047029714 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f6b680b6620 0x7f6b680b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:18.050 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:18.049+0000 7f6b809d4640 1 -- 172.21.15.83:0/2047029714 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9315+0+0 (secure 0 0 0) 0x7f6b641084c0 con 0x7f6b7c102a60 2024-09-21T01:41:18.050 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:18.050+0000 7f6b7a7fc640 1 --2- 172.21.15.83:0/2047029714 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f6b680b6620 0x7f6b680b8b30 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f6b7c100f10 tx=0x7f6b6c00a2d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:41:18.053 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:18.053+0000 7f6b809d4640 1 -- 172.21.15.83:0/2047029714 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6b640ce750 con 0x7f6b7c102a60 2024-09-21T01:41:18.234 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:18.234+0000 7f6b819d6640 1 -- 172.21.15.83:0/2047029714 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f6b7c1a90a0 con 0x7f6b7c102a60 2024-09-21T01:41:18.235 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:18.234+0000 7f6b809d4640 1 -- 172.21.15.83:0/2047029714 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f6b640d2b30 con 0x7f6b7c102a60 2024-09-21T01:41:18.235 INFO:teuthology.orchestra.run.smithi083.stdout:150323855423 2024-09-21T01:41:18.237 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:18.237+0000 7f6b819d6640 1 -- 172.21.15.83:0/2047029714 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f6b680b6620 msgr2=0x7f6b680b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:18.237 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:18.237+0000 7f6b819d6640 1 --2- 172.21.15.83:0/2047029714 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f6b680b6620 0x7f6b680b8b30 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f6b7c100f10 tx=0x7f6b6c00a2d0 comp rx=0 tx=0).stop 2024-09-21T01:41:18.237 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:18.237+0000 7f6b819d6640 1 -- 172.21.15.83:0/2047029714 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6b7c102a60 msgr2=0x7f6b7c19c5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:18.237 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:18.237+0000 7f6b819d6640 1 --2- 172.21.15.83:0/2047029714 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6b7c102a60 0x7f6b7c19c5b0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f6b6402a930 tx=0x7f6b64003c20 comp rx=0 tx=0).stop 2024-09-21T01:41:18.237 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:18.237+0000 7f6b819d6640 1 -- 172.21.15.83:0/2047029714 shutdown_connections 2024-09-21T01:41:18.238 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:18.237+0000 7f6b819d6640 1 --2- 172.21.15.83:0/2047029714 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f6b680b6620 0x7f6b680b8b30 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:18.238 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:18.237+0000 7f6b819d6640 1 --2- 172.21.15.83:0/2047029714 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6b7c108cf0 0x7f6b7c1a1df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:18.238 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:18.237+0000 7f6b819d6640 1 --2- 172.21.15.83:0/2047029714 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6b7c1083a0 0x7f6b7c19cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:18.238 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:18.237+0000 7f6b819d6640 1 --2- 172.21.15.83:0/2047029714 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6b7c102a60 0x7f6b7c19c5b0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:18.238 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:18.237+0000 7f6b819d6640 1 -- 172.21.15.83:0/2047029714 >> 172.21.15.83:0/2047029714 conn(0x7f6b7c079730 msgr2=0x7f6b7c06ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:41:18.238 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:18.237+0000 7f6b819d6640 1 -- 172.21.15.83:0/2047029714 shutdown_connections 2024-09-21T01:41:18.238 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:18.237+0000 7f6b819d6640 1 -- 172.21.15.83:0/2047029714 wait complete. 2024-09-21T01:41:18.964 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:41:18 smithi142 ceph-mon[34050]: from='client.? 172.21.15.83:0/3414732371' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2024-09-21T01:41:18.964 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:41:18 smithi142 ceph-mon[34050]: from='client.? 172.21.15.83:0/2047029714' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2024-09-21T01:41:18.967 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:41:18 smithi119 ceph-mon[33693]: from='client.? 172.21.15.83:0/3414732371' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2024-09-21T01:41:18.967 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:41:18 smithi119 ceph-mon[33693]: from='client.? 172.21.15.83:0/2047029714' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2024-09-21T01:41:19.053 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:41:18 smithi083 ceph-mon[31370]: from='client.? 172.21.15.83:0/3414732371' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2024-09-21T01:41:19.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:41:18 smithi083 ceph-mon[31370]: from='client.? 172.21.15.83:0/2047029714' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2024-09-21T01:41:19.113 INFO:tasks.cephadm.ceph_manager.ceph:need seq 150323855418 got 150323855423 for osd.5 2024-09-21T01:41:19.113 DEBUG:teuthology.parallel:result is None 2024-09-21T01:41:19.412 INFO:tasks.cephadm.ceph_manager.ceph:need seq 176093659190 got 176093659192 for osd.6 2024-09-21T01:41:19.413 DEBUG:teuthology.parallel:result is None 2024-09-21T01:41:19.803 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:41:19 smithi083 ceph-mon[31370]: pgmap v317: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 516 B/s rd, 1 op/s 2024-09-21T01:41:19.832 INFO:tasks.cephadm.ceph_manager.ceph:need seq 197568495665 got 197568495666 for osd.7 2024-09-21T01:41:19.832 DEBUG:teuthology.parallel:result is None 2024-09-21T01:41:19.833 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-21T01:41:19.833 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph pg dump --format=json 2024-09-21T01:41:19.964 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:41:19 smithi142 ceph-mon[34050]: pgmap v317: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 516 B/s rd, 1 op/s 2024-09-21T01:41:19.967 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:41:19 smithi119 ceph-mon[33693]: pgmap v317: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 516 B/s rd, 1 op/s 2024-09-21T01:41:20.078 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:41:20.550 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:20.547+0000 7fa63b9b9640 1 -- 172.21.15.83:0/3124523084 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa634103b60 msgr2=0x7fa634103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:20.551 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:20.547+0000 7fa63b9b9640 1 --2- 172.21.15.83:0/3124523084 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa634103b60 0x7fa634103f70 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fa630009900 tx=0x7fa63002a410 comp rx=0 tx=0).stop 2024-09-21T01:41:20.551 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:20.547+0000 7fa63b9b9640 1 -- 172.21.15.83:0/3124523084 shutdown_connections 2024-09-21T01:41:20.551 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:20.547+0000 7fa63b9b9640 1 --2- 172.21.15.83:0/3124523084 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa634109df0 0x7fa634110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:20.551 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:20.547+0000 7fa63b9b9640 1 --2- 172.21.15.83:0/3124523084 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa6341094a0 0x7fa6341098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:20.551 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:20.547+0000 7fa63b9b9640 1 --2- 172.21.15.83:0/3124523084 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa634103b60 0x7fa634103f70 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:20.551 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:20.547+0000 7fa63b9b9640 1 -- 172.21.15.83:0/3124523084 >> 172.21.15.83:0/3124523084 conn(0x7fa63407b850 msgr2=0x7fa63407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:41:20.551 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:20.547+0000 7fa63b9b9640 1 -- 172.21.15.83:0/3124523084 shutdown_connections 2024-09-21T01:41:20.551 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:20.547+0000 7fa63b9b9640 1 -- 172.21.15.83:0/3124523084 wait complete. 2024-09-21T01:41:20.551 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:20.548+0000 7fa63b9b9640 1 Processor -- start 2024-09-21T01:41:20.551 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:20.548+0000 7fa63b9b9640 1 -- start start 2024-09-21T01:41:20.551 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:20.548+0000 7fa63b9b9640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa634103b60 0x7fa63419a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:20.552 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:20.548+0000 7fa63b9b9640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa6341094a0 0x7fa63419a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:20.552 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:20.548+0000 7fa63b9b9640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa634109df0 0x7fa63419fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:20.552 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:20.548+0000 7fa63b9b9640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fa634113960 con 0x7fa6341094a0 2024-09-21T01:41:20.552 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:20.548+0000 7fa63b9b9640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fa6341137e0 con 0x7fa634103b60 2024-09-21T01:41:20.552 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:20.548+0000 7fa63b9b9640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fa634113ae0 con 0x7fa634109df0 2024-09-21T01:41:20.552 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:20.549+0000 7fa638f54640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa6341094a0 0x7fa63419a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:20.552 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:20.549+0000 7fa638f54640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa6341094a0 0x7fa63419a9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:58900/0 (socket says 172.21.15.83:58900) 2024-09-21T01:41:20.552 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:20.549+0000 7fa638f54640 1 -- 172.21.15.83:0/649402522 learned_addr learned my addr 172.21.15.83:0/649402522 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:41:20.552 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:20.549+0000 7fa639f56640 1 --2- 172.21.15.83:0/649402522 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa634109df0 0x7fa63419fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:20.552 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:20.549+0000 7fa639755640 1 --2- 172.21.15.83:0/649402522 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa634103b60 0x7fa63419a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:20.552 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:20.549+0000 7fa638f54640 1 -- 172.21.15.83:0/649402522 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa634109df0 msgr2=0x7fa63419fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:20.552 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:20.549+0000 7fa638f54640 1 --2- 172.21.15.83:0/649402522 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa634109df0 0x7fa63419fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:20.552 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:20.549+0000 7fa638f54640 1 -- 172.21.15.83:0/649402522 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa634103b60 msgr2=0x7fa63419a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:20.552 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:20.549+0000 7fa638f54640 1 --2- 172.21.15.83:0/649402522 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa634103b60 0x7fa63419a430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:20.553 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:20.549+0000 7fa638f54640 1 -- 172.21.15.83:0/649402522 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6341a03a0 con 0x7fa6341094a0 2024-09-21T01:41:20.553 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:20.549+0000 7fa638f54640 1 --2- 172.21.15.83:0/649402522 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa6341094a0 0x7fa63419a9d0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fa62400d750 tx=0x7fa62400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:41:20.553 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:20.549+0000 7fa62a7fc640 1 -- 172.21.15.83:0/649402522 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa624017070 con 0x7fa6341094a0 2024-09-21T01:41:20.553 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:20.549+0000 7fa63b9b9640 1 -- 172.21.15.83:0/649402522 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6341a0690 con 0x7fa6341094a0 2024-09-21T01:41:20.553 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:20.549+0000 7fa62a7fc640 1 -- 172.21.15.83:0/649402522 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa6240054b0 con 0x7fa6341094a0 2024-09-21T01:41:20.553 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:20.549+0000 7fa62a7fc640 1 -- 172.21.15.83:0/649402522 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa624004bc0 con 0x7fa6341094a0 2024-09-21T01:41:20.553 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:20.549+0000 7fa63b9b9640 1 -- 172.21.15.83:0/649402522 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6341a6df0 con 0x7fa6341094a0 2024-09-21T01:41:20.554 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:20.550+0000 7fa63b9b9640 1 -- 172.21.15.83:0/649402522 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa634103f70 con 0x7fa6341094a0 2024-09-21T01:41:20.554 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:20.552+0000 7fa62a7fc640 1 -- 172.21.15.83:0/649402522 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7fa624009c30 con 0x7fa6341094a0 2024-09-21T01:41:20.554 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:20.553+0000 7fa62a7fc640 1 --2- 172.21.15.83:0/649402522 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fa6200b65f0 0x7fa6200b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:20.554 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:20.553+0000 7fa62a7fc640 1 -- 172.21.15.83:0/649402522 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9315+0+0 (secure 0 0 0) 0x7fa6240e7800 con 0x7fa6341094a0 2024-09-21T01:41:20.554 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:20.553+0000 7fa639755640 1 --2- 172.21.15.83:0/649402522 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fa6200b65f0 0x7fa6200b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:20.554 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:20.554+0000 7fa639755640 1 --2- 172.21.15.83:0/649402522 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fa6200b65f0 0x7fa6200b8b00 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fa630005f70 tx=0x7fa630000bc0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:41:20.556 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:20.556+0000 7fa62a7fc640 1 -- 172.21.15.83:0/649402522 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa6240adaf0 con 0x7fa6341094a0 2024-09-21T01:41:20.731 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:20.731+0000 7fa63b9b9640 1 -- 172.21.15.83:0/649402522 --> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa634063800 con 0x7fa6200b65f0 2024-09-21T01:41:20.737 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:20.736+0000 7fa62a7fc640 1 -- 172.21.15.83:0/649402522 <== mgr.14223 v2:172.21.15.83:6800/1748483157 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340512 (secure 0 0 0) 0x7fa634063800 con 0x7fa6200b65f0 2024-09-21T01:41:20.742 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T01:41:20.745 INFO:teuthology.orchestra.run.smithi083.stderr:dumped all 2024-09-21T01:41:20.747 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:20.740+0000 7fa63b9b9640 1 -- 172.21.15.83:0/649402522 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fa6200b65f0 msgr2=0x7fa6200b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:20.747 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:20.740+0000 7fa63b9b9640 1 --2- 172.21.15.83:0/649402522 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fa6200b65f0 0x7fa6200b8b00 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fa630005f70 tx=0x7fa630000bc0 comp rx=0 tx=0).stop 2024-09-21T01:41:20.747 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:20.740+0000 7fa63b9b9640 1 -- 172.21.15.83:0/649402522 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa6341094a0 msgr2=0x7fa63419a9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:20.747 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:20.740+0000 7fa63b9b9640 1 --2- 172.21.15.83:0/649402522 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa6341094a0 0x7fa63419a9d0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fa62400d750 tx=0x7fa62400dc10 comp rx=0 tx=0).stop 2024-09-21T01:41:20.748 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:20.740+0000 7fa63b9b9640 1 -- 172.21.15.83:0/649402522 shutdown_connections 2024-09-21T01:41:20.748 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:20.740+0000 7fa63b9b9640 1 --2- 172.21.15.83:0/649402522 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fa6200b65f0 0x7fa6200b8b00 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:20.748 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:20.740+0000 7fa63b9b9640 1 --2- 172.21.15.83:0/649402522 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa634109df0 0x7fa63419fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:20.748 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:20.740+0000 7fa63b9b9640 1 --2- 172.21.15.83:0/649402522 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa6341094a0 0x7fa63419a9d0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:20.748 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:20.740+0000 7fa63b9b9640 1 --2- 172.21.15.83:0/649402522 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa634103b60 0x7fa63419a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:20.748 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:20.740+0000 7fa63b9b9640 1 -- 172.21.15.83:0/649402522 >> 172.21.15.83:0/649402522 conn(0x7fa63407b850 msgr2=0x7fa634107640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:41:20.748 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:20.740+0000 7fa63b9b9640 1 -- 172.21.15.83:0/649402522 shutdown_connections 2024-09-21T01:41:20.748 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:20.740+0000 7fa63b9b9640 1 -- 172.21.15.83:0/649402522 wait complete. 2024-09-21T01:41:21.592 INFO:teuthology.orchestra.run.smithi083.stdout:{"pg_ready":true,"pg_map":{"version":317,"stamp":"2024-09-21T01:41:18.781526+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":659047,"num_objects":26,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":190,"num_read_kb":192,"num_write":208,"num_write_kb":2247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":164,"ondisk_log_size":164,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":364752,"kb_used_data":11264,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124577072,"statfs":{"total":1151940427776,"available":1151566921728,"internally_reserved":0,"allocated":11534336,"data_stored":7895711,"data_compressed":461493,"data_compressed_allocated":626688,"data_compressed_original":2752512,"omap_allocated":19139,"internal_metadata":361674045},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":5,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.904971"},"pg_stats":[{"pgid":"2.1f","version":"74'4","reported_seq":44,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:09.877454+0000","last_change":"2024-09-21T01:39:42.267244+0000","last_active":"2024-09-21T01:41:09.877454+0000","last_peered":"2024-09-21T01:41:09.877454+0000","last_clean":"2024-09-21T01:41:09.877454+0000","last_became_active":"2024-09-21T01:39:42.266786+0000","last_became_peered":"2024-09-21T01:39:42.266786+0000","last_unstale":"2024-09-21T01:41:09.877454+0000","last_undegraded":"2024-09-21T01:41:09.877454+0000","last_fullsized":"2024-09-21T01:41:09.877454+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:50:43.594150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.504960+0000","last_change":"2024-09-21T01:39:44.292808+0000","last_active":"2024-09-21T01:41:10.504960+0000","last_peered":"2024-09-21T01:41:10.504960+0000","last_clean":"2024-09-21T01:41:10.504960+0000","last_became_active":"2024-09-21T01:39:44.292416+0000","last_became_peered":"2024-09-21T01:39:44.292416+0000","last_unstale":"2024-09-21T01:41:10.504960+0000","last_undegraded":"2024-09-21T01:41:10.504960+0000","last_fullsized":"2024-09-21T01:41:10.504960+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:26:16.332353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:09.880685+0000","last_change":"2024-09-21T01:39:51.339117+0000","last_active":"2024-09-21T01:41:09.880685+0000","last_peered":"2024-09-21T01:41:09.880685+0000","last_clean":"2024-09-21T01:41:09.880685+0000","last_became_active":"2024-09-21T01:39:51.338467+0000","last_became_peered":"2024-09-21T01:39:51.338467+0000","last_unstale":"2024-09-21T01:41:09.880685+0000","last_undegraded":"2024-09-21T01:41:09.880685+0000","last_fullsized":"2024-09-21T01:41:09.880685+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:18:57.119730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"74'1","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.505232+0000","last_change":"2024-09-21T01:39:42.550130+0000","last_active":"2024-09-21T01:41:10.505232+0000","last_peered":"2024-09-21T01:41:10.505232+0000","last_clean":"2024-09-21T01:41:10.505232+0000","last_became_active":"2024-09-21T01:39:42.549676+0000","last_became_peered":"2024-09-21T01:39:42.549676+0000","last_unstale":"2024-09-21T01:41:10.505232+0000","last_undegraded":"2024-09-21T01:41:10.505232+0000","last_fullsized":"2024-09-21T01:41:10.505232+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:33:59.954738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.506097+0000","last_change":"2024-09-21T01:39:44.293860+0000","last_active":"2024-09-21T01:41:10.506097+0000","last_peered":"2024-09-21T01:41:10.506097+0000","last_clean":"2024-09-21T01:41:10.506097+0000","last_became_active":"2024-09-21T01:39:44.293490+0000","last_became_peered":"2024-09-21T01:39:44.293490+0000","last_unstale":"2024-09-21T01:41:10.506097+0000","last_undegraded":"2024-09-21T01:41:10.506097+0000","last_fullsized":"2024-09-21T01:41:10.506097+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:58:18.325647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.504013+0000","last_change":"2024-09-21T01:39:51.335826+0000","last_active":"2024-09-21T01:41:10.504013+0000","last_peered":"2024-09-21T01:41:10.504013+0000","last_clean":"2024-09-21T01:41:10.504013+0000","last_became_active":"2024-09-21T01:39:51.335346+0000","last_became_peered":"2024-09-21T01:39:51.335346+0000","last_unstale":"2024-09-21T01:41:10.504013+0000","last_undegraded":"2024-09-21T01:41:10.504013+0000","last_fullsized":"2024-09-21T01:41:10.504013+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:51:25.921336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"74'2","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.503563+0000","last_change":"2024-09-21T01:39:42.270594+0000","last_active":"2024-09-21T01:41:10.503563+0000","last_peered":"2024-09-21T01:41:10.503563+0000","last_clean":"2024-09-21T01:41:10.503563+0000","last_became_active":"2024-09-21T01:39:42.270138+0000","last_became_peered":"2024-09-21T01:39:42.270138+0000","last_unstale":"2024-09-21T01:41:10.503563+0000","last_undegraded":"2024-09-21T01:41:10.503563+0000","last_fullsized":"2024-09-21T01:41:10.503563+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:05:00.604343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:09.971835+0000","last_change":"2024-09-21T01:39:44.294397+0000","last_active":"2024-09-21T01:41:09.971835+0000","last_peered":"2024-09-21T01:41:09.971835+0000","last_clean":"2024-09-21T01:41:09.971835+0000","last_became_active":"2024-09-21T01:39:44.293992+0000","last_became_peered":"2024-09-21T01:39:44.293992+0000","last_unstale":"2024-09-21T01:41:09.971835+0000","last_undegraded":"2024-09-21T01:41:09.971835+0000","last_fullsized":"2024-09-21T01:41:09.971835+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:52:09.459167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.504060+0000","last_change":"2024-09-21T01:39:51.338546+0000","last_active":"2024-09-21T01:41:10.504060+0000","last_peered":"2024-09-21T01:41:10.504060+0000","last_clean":"2024-09-21T01:41:10.504060+0000","last_became_active":"2024-09-21T01:39:51.337850+0000","last_became_peered":"2024-09-21T01:39:51.337850+0000","last_unstale":"2024-09-21T01:41:10.504060+0000","last_undegraded":"2024-09-21T01:41:10.504060+0000","last_fullsized":"2024-09-21T01:41:10.504060+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:33:49.497520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"74'2","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.503562+0000","last_change":"2024-09-21T01:39:42.264214+0000","last_active":"2024-09-21T01:41:10.503562+0000","last_peered":"2024-09-21T01:41:10.503562+0000","last_clean":"2024-09-21T01:41:10.503562+0000","last_became_active":"2024-09-21T01:39:42.263782+0000","last_became_peered":"2024-09-21T01:39:42.263782+0000","last_unstale":"2024-09-21T01:41:10.503562+0000","last_undegraded":"2024-09-21T01:41:10.503562+0000","last_fullsized":"2024-09-21T01:41:10.503562+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:44:24.965078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.044623+0000","last_change":"2024-09-21T01:39:44.296579+0000","last_active":"2024-09-21T01:41:10.044623+0000","last_peered":"2024-09-21T01:41:10.044623+0000","last_clean":"2024-09-21T01:41:10.044623+0000","last_became_active":"2024-09-21T01:39:44.296175+0000","last_became_peered":"2024-09-21T01:39:44.296175+0000","last_unstale":"2024-09-21T01:41:10.044623+0000","last_undegraded":"2024-09-21T01:41:10.044623+0000","last_fullsized":"2024-09-21T01:41:10.044623+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:11:13.920000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.504011+0000","last_change":"2024-09-21T01:39:51.339046+0000","last_active":"2024-09-21T01:41:10.504011+0000","last_peered":"2024-09-21T01:41:10.504011+0000","last_clean":"2024-09-21T01:41:10.504011+0000","last_became_active":"2024-09-21T01:39:51.337379+0000","last_became_peered":"2024-09-21T01:39:51.337379+0000","last_unstale":"2024-09-21T01:41:10.504011+0000","last_undegraded":"2024-09-21T01:41:10.504011+0000","last_fullsized":"2024-09-21T01:41:10.504011+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:50:34.321615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:09.878400+0000","last_change":"2024-09-21T01:39:44.296849+0000","last_active":"2024-09-21T01:41:09.878400+0000","last_peered":"2024-09-21T01:41:09.878400+0000","last_clean":"2024-09-21T01:41:09.878400+0000","last_became_active":"2024-09-21T01:39:44.296460+0000","last_became_peered":"2024-09-21T01:39:44.296460+0000","last_unstale":"2024-09-21T01:41:09.878400+0000","last_undegraded":"2024-09-21T01:41:09.878400+0000","last_fullsized":"2024-09-21T01:41:09.878400+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:46:51.258576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"74'2","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.947238+0000","last_change":"2024-09-21T01:40:09.842127+0000","last_active":"2024-09-21T01:41:10.947238+0000","last_peered":"2024-09-21T01:41:10.947238+0000","last_clean":"2024-09-21T01:41:10.947238+0000","last_became_active":"2024-09-21T01:40:09.835330+0000","last_became_peered":"2024-09-21T01:40:09.835330+0000","last_unstale":"2024-09-21T01:41:10.947238+0000","last_undegraded":"2024-09-21T01:41:10.947238+0000","last_fullsized":"2024-09-21T01:41:10.947238+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:54:07.455805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.504140+0000","last_change":"2024-09-21T01:39:51.459595+0000","last_active":"2024-09-21T01:41:10.504140+0000","last_peered":"2024-09-21T01:41:10.504140+0000","last_clean":"2024-09-21T01:41:10.504140+0000","last_became_active":"2024-09-21T01:39:51.459137+0000","last_became_peered":"2024-09-21T01:39:51.459137+0000","last_unstale":"2024-09-21T01:41:10.504140+0000","last_undegraded":"2024-09-21T01:41:10.504140+0000","last_fullsized":"2024-09-21T01:41:10.504140+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:55:53.800615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.505743+0000","last_change":"2024-09-21T01:39:44.288328+0000","last_active":"2024-09-21T01:41:10.505743+0000","last_peered":"2024-09-21T01:41:10.505743+0000","last_clean":"2024-09-21T01:41:10.505743+0000","last_became_active":"2024-09-21T01:39:44.287994+0000","last_became_peered":"2024-09-21T01:39:44.287994+0000","last_unstale":"2024-09-21T01:41:10.505743+0000","last_undegraded":"2024-09-21T01:41:10.505743+0000","last_fullsized":"2024-09-21T01:41:10.505743+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:44:55.075693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:09.880786+0000","last_change":"2024-09-21T01:39:42.266271+0000","last_active":"2024-09-21T01:41:09.880786+0000","last_peered":"2024-09-21T01:41:09.880786+0000","last_clean":"2024-09-21T01:41:09.880786+0000","last_became_active":"2024-09-21T01:39:42.265904+0000","last_became_peered":"2024-09-21T01:39:42.265904+0000","last_unstale":"2024-09-21T01:41:09.880786+0000","last_undegraded":"2024-09-21T01:41:09.880786+0000","last_fullsized":"2024-09-21T01:41:09.880786+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:43:37.456263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"82'1","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.504229+0000","last_change":"2024-09-21T01:39:51.336649+0000","last_active":"2024-09-21T01:41:10.504229+0000","last_peered":"2024-09-21T01:41:10.504229+0000","last_clean":"2024-09-21T01:41:10.504229+0000","last_became_active":"2024-09-21T01:39:51.336153+0000","last_became_peered":"2024-09-21T01:39:51.336153+0000","last_unstale":"2024-09-21T01:41:10.504229+0000","last_undegraded":"2024-09-21T01:41:10.504229+0000","last_fullsized":"2024-09-21T01:41:10.504229+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:56:58.699051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.947388+0000","last_change":"2024-09-21T01:39:44.304919+0000","last_active":"2024-09-21T01:41:10.947388+0000","last_peered":"2024-09-21T01:41:10.947388+0000","last_clean":"2024-09-21T01:41:10.947388+0000","last_became_active":"2024-09-21T01:39:44.304509+0000","last_became_peered":"2024-09-21T01:39:44.304509+0000","last_unstale":"2024-09-21T01:41:10.947388+0000","last_undegraded":"2024-09-21T01:41:10.947388+0000","last_fullsized":"2024-09-21T01:41:10.947388+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:57:04.413151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.505524+0000","last_change":"2024-09-21T01:39:42.262536+0000","last_active":"2024-09-21T01:41:10.505524+0000","last_peered":"2024-09-21T01:41:10.505524+0000","last_clean":"2024-09-21T01:41:10.505524+0000","last_became_active":"2024-09-21T01:39:42.262179+0000","last_became_peered":"2024-09-21T01:39:42.262179+0000","last_unstale":"2024-09-21T01:41:10.505524+0000","last_undegraded":"2024-09-21T01:41:10.505524+0000","last_fullsized":"2024-09-21T01:41:10.505524+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:35:14.022839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:09.877283+0000","last_change":"2024-09-21T01:39:51.339664+0000","last_active":"2024-09-21T01:41:09.877283+0000","last_peered":"2024-09-21T01:41:09.877283+0000","last_clean":"2024-09-21T01:41:09.877283+0000","last_became_active":"2024-09-21T01:39:51.339140+0000","last_became_peered":"2024-09-21T01:39:51.339140+0000","last_unstale":"2024-09-21T01:41:09.877283+0000","last_undegraded":"2024-09-21T01:41:09.877283+0000","last_fullsized":"2024-09-21T01:41:09.877283+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:46:49.443937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.503941+0000","last_change":"2024-09-21T01:39:44.299174+0000","last_active":"2024-09-21T01:41:10.503941+0000","last_peered":"2024-09-21T01:41:10.503941+0000","last_clean":"2024-09-21T01:41:10.503941+0000","last_became_active":"2024-09-21T01:39:44.298778+0000","last_became_peered":"2024-09-21T01:39:44.298778+0000","last_unstale":"2024-09-21T01:41:10.503941+0000","last_undegraded":"2024-09-21T01:41:10.503941+0000","last_fullsized":"2024-09-21T01:41:10.503941+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:59:17.298726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":38,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:09.971615+0000","last_change":"2024-09-21T01:39:42.550521+0000","last_active":"2024-09-21T01:41:09.971615+0000","last_peered":"2024-09-21T01:41:09.971615+0000","last_clean":"2024-09-21T01:41:09.971615+0000","last_became_active":"2024-09-21T01:39:42.550210+0000","last_became_peered":"2024-09-21T01:39:42.550210+0000","last_unstale":"2024-09-21T01:41:09.971615+0000","last_undegraded":"2024-09-21T01:41:09.971615+0000","last_fullsized":"2024-09-21T01:41:09.971615+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:07:07.234815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.504302+0000","last_change":"2024-09-21T01:39:51.461448+0000","last_active":"2024-09-21T01:41:10.504302+0000","last_peered":"2024-09-21T01:41:10.504302+0000","last_clean":"2024-09-21T01:41:10.504302+0000","last_became_active":"2024-09-21T01:39:51.460790+0000","last_became_peered":"2024-09-21T01:39:51.460790+0000","last_unstale":"2024-09-21T01:41:10.504302+0000","last_undegraded":"2024-09-21T01:41:10.504302+0000","last_fullsized":"2024-09-21T01:41:10.504302+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:30:35.032588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.506005+0000","last_change":"2024-09-21T01:39:44.298697+0000","last_active":"2024-09-21T01:41:10.506005+0000","last_peered":"2024-09-21T01:41:10.506005+0000","last_clean":"2024-09-21T01:41:10.506005+0000","last_became_active":"2024-09-21T01:39:44.298333+0000","last_became_peered":"2024-09-21T01:39:44.298333+0000","last_unstale":"2024-09-21T01:41:10.506005+0000","last_undegraded":"2024-09-21T01:41:10.506005+0000","last_fullsized":"2024-09-21T01:41:10.506005+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:36:01.932630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"74'2","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.504671+0000","last_change":"2024-09-21T01:39:42.257383+0000","last_active":"2024-09-21T01:41:10.504671+0000","last_peered":"2024-09-21T01:41:10.504671+0000","last_clean":"2024-09-21T01:41:10.504671+0000","last_became_active":"2024-09-21T01:39:42.256896+0000","last_became_peered":"2024-09-21T01:39:42.256896+0000","last_unstale":"2024-09-21T01:41:10.504671+0000","last_undegraded":"2024-09-21T01:41:10.504671+0000","last_fullsized":"2024-09-21T01:41:10.504671+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:03:29.350623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:09.880821+0000","last_change":"2024-09-21T01:39:51.342055+0000","last_active":"2024-09-21T01:41:09.880821+0000","last_peered":"2024-09-21T01:41:09.880821+0000","last_clean":"2024-09-21T01:41:09.880821+0000","last_became_active":"2024-09-21T01:39:51.341602+0000","last_became_peered":"2024-09-21T01:39:51.341602+0000","last_unstale":"2024-09-21T01:41:09.880821+0000","last_undegraded":"2024-09-21T01:41:09.880821+0000","last_fullsized":"2024-09-21T01:41:09.880821+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:30:58.290018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.505600+0000","last_change":"2024-09-21T01:39:44.296725+0000","last_active":"2024-09-21T01:41:10.505600+0000","last_peered":"2024-09-21T01:41:10.505600+0000","last_clean":"2024-09-21T01:41:10.505600+0000","last_became_active":"2024-09-21T01:39:44.296411+0000","last_became_peered":"2024-09-21T01:39:44.296411+0000","last_unstale":"2024-09-21T01:41:10.505600+0000","last_undegraded":"2024-09-21T01:41:10.505600+0000","last_fullsized":"2024-09-21T01:41:10.505600+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:58:05.357486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"82'8","reported_seq":47,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:09.877361+0000","last_change":"2024-09-21T01:39:42.262831+0000","last_active":"2024-09-21T01:41:09.877361+0000","last_peered":"2024-09-21T01:41:09.877361+0000","last_clean":"2024-09-21T01:41:09.877361+0000","last_became_active":"2024-09-21T01:39:42.262462+0000","last_became_peered":"2024-09-21T01:39:42.262462+0000","last_unstale":"2024-09-21T01:41:09.877361+0000","last_undegraded":"2024-09-21T01:41:09.877361+0000","last_fullsized":"2024-09-21T01:41:09.877361+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:01:24.950607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.505213+0000","last_change":"2024-09-21T01:39:51.460620+0000","last_active":"2024-09-21T01:41:10.505213+0000","last_peered":"2024-09-21T01:41:10.505213+0000","last_clean":"2024-09-21T01:41:10.505213+0000","last_became_active":"2024-09-21T01:39:51.460052+0000","last_became_peered":"2024-09-21T01:39:51.460052+0000","last_unstale":"2024-09-21T01:41:10.505213+0000","last_undegraded":"2024-09-21T01:41:10.505213+0000","last_fullsized":"2024-09-21T01:41:10.505213+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:23:23.284102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.504691+0000","last_change":"2024-09-21T01:39:44.293129+0000","last_active":"2024-09-21T01:41:10.504691+0000","last_peered":"2024-09-21T01:41:10.504691+0000","last_clean":"2024-09-21T01:41:10.504691+0000","last_became_active":"2024-09-21T01:39:44.292799+0000","last_became_peered":"2024-09-21T01:39:44.292799+0000","last_unstale":"2024-09-21T01:41:10.504691+0000","last_undegraded":"2024-09-21T01:41:10.504691+0000","last_fullsized":"2024-09-21T01:41:10.504691+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:05:22.484632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.504403+0000","last_change":"2024-09-21T01:39:42.550724+0000","last_active":"2024-09-21T01:41:10.504403+0000","last_peered":"2024-09-21T01:41:10.504403+0000","last_clean":"2024-09-21T01:41:10.504403+0000","last_became_active":"2024-09-21T01:39:42.550334+0000","last_became_peered":"2024-09-21T01:39:42.550334+0000","last_unstale":"2024-09-21T01:41:10.504403+0000","last_undegraded":"2024-09-21T01:41:10.504403+0000","last_fullsized":"2024-09-21T01:41:10.504403+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:15:49.484663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.947380+0000","last_change":"2024-09-21T01:40:09.838305+0000","last_active":"2024-09-21T01:41:10.947380+0000","last_peered":"2024-09-21T01:41:10.947380+0000","last_clean":"2024-09-21T01:41:10.947380+0000","last_became_active":"2024-09-21T01:40:09.837734+0000","last_became_peered":"2024-09-21T01:40:09.837734+0000","last_unstale":"2024-09-21T01:41:10.947380+0000","last_undegraded":"2024-09-21T01:41:10.947380+0000","last_fullsized":"2024-09-21T01:41:10.947380+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:38:44.066723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,7,6],"acting":[11,8,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.040973+0000","last_change":"2024-09-21T01:39:44.292039+0000","last_active":"2024-09-21T01:41:10.040973+0000","last_peered":"2024-09-21T01:41:10.040973+0000","last_clean":"2024-09-21T01:41:10.040973+0000","last_became_active":"2024-09-21T01:39:44.291640+0000","last_became_peered":"2024-09-21T01:39:44.291640+0000","last_unstale":"2024-09-21T01:41:10.040973+0000","last_undegraded":"2024-09-21T01:41:10.040973+0000","last_fullsized":"2024-09-21T01:41:10.040973+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:24:59.891664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":46,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:09.877144+0000","last_change":"2024-09-21T01:40:10.063162+0000","last_active":"2024-09-21T01:41:09.877144+0000","last_peered":"2024-09-21T01:41:09.877144+0000","last_clean":"2024-09-21T01:41:09.877144+0000","last_became_active":"2024-09-21T01:40:10.062703+0000","last_became_peered":"2024-09-21T01:40:10.062703+0000","last_unstale":"2024-09-21T01:41:09.877144+0000","last_undegraded":"2024-09-21T01:41:09.877144+0000","last_fullsized":"2024-09-21T01:41:09.877144+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:32:04.933701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.504070+0000","last_change":"2024-09-21T01:39:51.460023+0000","last_active":"2024-09-21T01:41:10.504070+0000","last_peered":"2024-09-21T01:41:10.504070+0000","last_clean":"2024-09-21T01:41:10.504070+0000","last_became_active":"2024-09-21T01:39:51.459417+0000","last_became_peered":"2024-09-21T01:39:51.459417+0000","last_unstale":"2024-09-21T01:41:10.504070+0000","last_undegraded":"2024-09-21T01:41:10.504070+0000","last_fullsized":"2024-09-21T01:41:10.504070+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:54:24.301176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.040859+0000","last_change":"2024-09-21T01:39:44.295559+0000","last_active":"2024-09-21T01:41:10.040859+0000","last_peered":"2024-09-21T01:41:10.040859+0000","last_clean":"2024-09-21T01:41:10.040859+0000","last_became_active":"2024-09-21T01:39:44.294970+0000","last_became_peered":"2024-09-21T01:39:44.294970+0000","last_unstale":"2024-09-21T01:41:10.040859+0000","last_undegraded":"2024-09-21T01:41:10.040859+0000","last_fullsized":"2024-09-21T01:41:10.040859+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:46:16.582188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:09.878542+0000","last_change":"2024-09-21T01:39:42.269453+0000","last_active":"2024-09-21T01:41:09.878542+0000","last_peered":"2024-09-21T01:41:09.878542+0000","last_clean":"2024-09-21T01:41:09.878542+0000","last_became_active":"2024-09-21T01:39:42.269039+0000","last_became_peered":"2024-09-21T01:39:42.269039+0000","last_unstale":"2024-09-21T01:41:09.878542+0000","last_undegraded":"2024-09-21T01:41:09.878542+0000","last_fullsized":"2024-09-21T01:41:09.878542+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:47:29.053966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.504426+0000","last_change":"2024-09-21T01:39:51.337305+0000","last_active":"2024-09-21T01:41:10.504426+0000","last_peered":"2024-09-21T01:41:10.504426+0000","last_clean":"2024-09-21T01:41:10.504426+0000","last_became_active":"2024-09-21T01:39:51.336710+0000","last_became_peered":"2024-09-21T01:39:51.336710+0000","last_unstale":"2024-09-21T01:41:10.504426+0000","last_undegraded":"2024-09-21T01:41:10.504426+0000","last_fullsized":"2024-09-21T01:41:10.504426+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:13:42.333881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.044018+0000","last_change":"2024-09-21T01:39:44.297004+0000","last_active":"2024-09-21T01:41:10.044018+0000","last_peered":"2024-09-21T01:41:10.044018+0000","last_clean":"2024-09-21T01:41:10.044018+0000","last_became_active":"2024-09-21T01:39:44.296596+0000","last_became_peered":"2024-09-21T01:39:44.296596+0000","last_unstale":"2024-09-21T01:41:10.044018+0000","last_undegraded":"2024-09-21T01:41:10.044018+0000","last_fullsized":"2024-09-21T01:41:10.044018+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:14:32.542823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.503854+0000","last_change":"2024-09-21T01:39:42.550024+0000","last_active":"2024-09-21T01:41:10.503854+0000","last_peered":"2024-09-21T01:41:10.503854+0000","last_clean":"2024-09-21T01:41:10.503854+0000","last_became_active":"2024-09-21T01:39:42.549638+0000","last_became_peered":"2024-09-21T01:39:42.549638+0000","last_unstale":"2024-09-21T01:41:10.503854+0000","last_undegraded":"2024-09-21T01:41:10.503854+0000","last_fullsized":"2024-09-21T01:41:10.503854+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:23:39.210460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.505020+0000","last_change":"2024-09-21T01:39:51.459459+0000","last_active":"2024-09-21T01:41:10.505020+0000","last_peered":"2024-09-21T01:41:10.505020+0000","last_clean":"2024-09-21T01:41:10.505020+0000","last_became_active":"2024-09-21T01:39:51.459020+0000","last_became_peered":"2024-09-21T01:39:51.459020+0000","last_unstale":"2024-09-21T01:41:10.505020+0000","last_undegraded":"2024-09-21T01:41:10.505020+0000","last_fullsized":"2024-09-21T01:41:10.505020+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:50:08.337949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.504101+0000","last_change":"2024-09-21T01:40:09.833943+0000","last_active":"2024-09-21T01:41:10.504101+0000","last_peered":"2024-09-21T01:41:10.504101+0000","last_clean":"2024-09-21T01:41:10.504101+0000","last_became_active":"2024-09-21T01:40:09.833486+0000","last_became_peered":"2024-09-21T01:40:09.833486+0000","last_unstale":"2024-09-21T01:41:10.504101+0000","last_undegraded":"2024-09-21T01:41:10.504101+0000","last_fullsized":"2024-09-21T01:41:10.504101+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:26:52.751330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,2],"acting":[6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:09.878244+0000","last_change":"2024-09-21T01:39:42.267329+0000","last_active":"2024-09-21T01:41:09.878244+0000","last_peered":"2024-09-21T01:41:09.878244+0000","last_clean":"2024-09-21T01:41:09.878244+0000","last_became_active":"2024-09-21T01:39:42.266386+0000","last_became_peered":"2024-09-21T01:39:42.266386+0000","last_unstale":"2024-09-21T01:41:09.878244+0000","last_undegraded":"2024-09-21T01:41:09.878244+0000","last_fullsized":"2024-09-21T01:41:09.878244+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:31:20.877627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.044656+0000","last_change":"2024-09-21T01:39:51.461494+0000","last_active":"2024-09-21T01:41:10.044656+0000","last_peered":"2024-09-21T01:41:10.044656+0000","last_clean":"2024-09-21T01:41:10.044656+0000","last_became_active":"2024-09-21T01:39:51.460973+0000","last_became_peered":"2024-09-21T01:39:51.460973+0000","last_unstale":"2024-09-21T01:41:10.044656+0000","last_undegraded":"2024-09-21T01:41:10.044656+0000","last_fullsized":"2024-09-21T01:41:10.044656+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:09:50.319546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.504229+0000","last_change":"2024-09-21T01:39:44.300773+0000","last_active":"2024-09-21T01:41:10.504229+0000","last_peered":"2024-09-21T01:41:10.504229+0000","last_clean":"2024-09-21T01:41:10.504229+0000","last_became_active":"2024-09-21T01:39:44.300437+0000","last_became_peered":"2024-09-21T01:39:44.300437+0000","last_unstale":"2024-09-21T01:41:10.504229+0000","last_undegraded":"2024-09-21T01:41:10.504229+0000","last_fullsized":"2024-09-21T01:41:10.504229+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:06:34.171621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.503820+0000","last_change":"2024-09-21T01:39:42.262675+0000","last_active":"2024-09-21T01:41:10.503820+0000","last_peered":"2024-09-21T01:41:10.503820+0000","last_clean":"2024-09-21T01:41:10.503820+0000","last_became_active":"2024-09-21T01:39:42.262282+0000","last_became_peered":"2024-09-21T01:39:42.262282+0000","last_unstale":"2024-09-21T01:41:10.503820+0000","last_undegraded":"2024-09-21T01:41:10.503820+0000","last_fullsized":"2024-09-21T01:41:10.503820+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:26:01.595797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":114,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:09.878450+0000","last_change":"2024-09-21T01:38:31.172876+0000","last_active":"2024-09-21T01:41:09.878450+0000","last_peered":"2024-09-21T01:41:09.878450+0000","last_clean":"2024-09-21T01:41:09.878450+0000","last_became_active":"2024-09-21T01:38:31.167071+0000","last_became_peered":"2024-09-21T01:38:31.167071+0000","last_unstale":"2024-09-21T01:41:09.878450+0000","last_undegraded":"2024-09-21T01:41:09.878450+0000","last_fullsized":"2024-09-21T01:41:09.878450+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:35:07.475056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:35:07.475056+0000","last_clean_scrub_stamp":"2024-09-21T01:35:07.475056+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:56:01.878445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"82'1","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:09.878719+0000","last_change":"2024-09-21T01:39:51.338198+0000","last_active":"2024-09-21T01:41:09.878719+0000","last_peered":"2024-09-21T01:41:09.878719+0000","last_clean":"2024-09-21T01:41:09.878719+0000","last_became_active":"2024-09-21T01:39:51.337743+0000","last_became_peered":"2024-09-21T01:39:51.337743+0000","last_unstale":"2024-09-21T01:41:09.878719+0000","last_undegraded":"2024-09-21T01:41:09.878719+0000","last_fullsized":"2024-09-21T01:41:09.878719+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:19:45.552819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:09.878937+0000","last_change":"2024-09-21T01:39:44.298920+0000","last_active":"2024-09-21T01:41:09.878937+0000","last_peered":"2024-09-21T01:41:09.878937+0000","last_clean":"2024-09-21T01:41:09.878937+0000","last_became_active":"2024-09-21T01:39:44.298381+0000","last_became_peered":"2024-09-21T01:39:44.298381+0000","last_unstale":"2024-09-21T01:41:09.878937+0000","last_undegraded":"2024-09-21T01:41:09.878937+0000","last_fullsized":"2024-09-21T01:41:09.878937+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:12:53.681514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:09.881301+0000","last_change":"2024-09-21T01:39:42.550808+0000","last_active":"2024-09-21T01:41:09.881301+0000","last_peered":"2024-09-21T01:41:09.881301+0000","last_clean":"2024-09-21T01:41:09.881301+0000","last_became_active":"2024-09-21T01:39:42.550447+0000","last_became_peered":"2024-09-21T01:39:42.550447+0000","last_unstale":"2024-09-21T01:41:09.881301+0000","last_undegraded":"2024-09-21T01:41:09.881301+0000","last_fullsized":"2024-09-21T01:41:09.881301+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:20:56.996378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:09.971547+0000","last_change":"2024-09-21T01:39:51.338490+0000","last_active":"2024-09-21T01:41:09.971547+0000","last_peered":"2024-09-21T01:41:09.971547+0000","last_clean":"2024-09-21T01:41:09.971547+0000","last_became_active":"2024-09-21T01:39:51.338050+0000","last_became_peered":"2024-09-21T01:39:51.338050+0000","last_unstale":"2024-09-21T01:41:09.971547+0000","last_undegraded":"2024-09-21T01:41:09.971547+0000","last_fullsized":"2024-09-21T01:41:09.971547+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:49:56.705893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.045927+0000","last_change":"2024-09-21T01:41:10.045808+0000","last_active":"2024-09-21T01:41:10.045927+0000","last_peered":"2024-09-21T01:41:10.045927+0000","last_clean":"2024-09-21T01:41:10.045927+0000","last_became_active":"2024-09-21T01:41:10.045403+0000","last_became_peered":"2024-09-21T01:41:10.045403+0000","last_unstale":"2024-09-21T01:41:10.045927+0000","last_undegraded":"2024-09-21T01:41:10.045927+0000","last_fullsized":"2024-09-21T01:41:10.045927+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:15:46.067941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"74'1","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.044786+0000","last_change":"2024-09-21T01:39:42.270124+0000","last_active":"2024-09-21T01:41:10.044786+0000","last_peered":"2024-09-21T01:41:10.044786+0000","last_clean":"2024-09-21T01:41:10.044786+0000","last_became_active":"2024-09-21T01:39:42.269435+0000","last_became_peered":"2024-09-21T01:39:42.269435+0000","last_unstale":"2024-09-21T01:41:10.044786+0000","last_undegraded":"2024-09-21T01:41:10.044786+0000","last_fullsized":"2024-09-21T01:41:10.044786+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:12:08.374394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.504493+0000","last_change":"2024-09-21T01:39:51.334459+0000","last_active":"2024-09-21T01:41:10.504493+0000","last_peered":"2024-09-21T01:41:10.504493+0000","last_clean":"2024-09-21T01:41:10.504493+0000","last_became_active":"2024-09-21T01:39:51.334039+0000","last_became_peered":"2024-09-21T01:39:51.334039+0000","last_unstale":"2024-09-21T01:41:10.504493+0000","last_undegraded":"2024-09-21T01:41:10.504493+0000","last_fullsized":"2024-09-21T01:41:10.504493+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:04:44.906648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:09.878858+0000","last_change":"2024-09-21T01:39:44.298467+0000","last_active":"2024-09-21T01:41:09.878858+0000","last_peered":"2024-09-21T01:41:09.878858+0000","last_clean":"2024-09-21T01:41:09.878858+0000","last_became_active":"2024-09-21T01:39:44.298128+0000","last_became_peered":"2024-09-21T01:39:44.298128+0000","last_unstale":"2024-09-21T01:41:09.878858+0000","last_undegraded":"2024-09-21T01:41:09.878858+0000","last_fullsized":"2024-09-21T01:41:09.878858+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:54:11.096417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"74'2","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.503716+0000","last_change":"2024-09-21T01:39:42.262761+0000","last_active":"2024-09-21T01:41:10.503716+0000","last_peered":"2024-09-21T01:41:10.503716+0000","last_clean":"2024-09-21T01:41:10.503716+0000","last_became_active":"2024-09-21T01:39:42.262428+0000","last_became_peered":"2024-09-21T01:39:42.262428+0000","last_unstale":"2024-09-21T01:41:10.503716+0000","last_undegraded":"2024-09-21T01:41:10.503716+0000","last_fullsized":"2024-09-21T01:41:10.503716+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:11:50.326638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.043807+0000","last_change":"2024-09-21T01:39:51.344320+0000","last_active":"2024-09-21T01:41:10.043807+0000","last_peered":"2024-09-21T01:41:10.043807+0000","last_clean":"2024-09-21T01:41:10.043807+0000","last_became_active":"2024-09-21T01:39:51.343902+0000","last_became_peered":"2024-09-21T01:39:51.343902+0000","last_unstale":"2024-09-21T01:41:10.043807+0000","last_undegraded":"2024-09-21T01:41:10.043807+0000","last_fullsized":"2024-09-21T01:41:10.043807+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:13:36.139159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.947491+0000","last_change":"2024-09-21T01:40:09.837769+0000","last_active":"2024-09-21T01:41:10.947491+0000","last_peered":"2024-09-21T01:41:10.947491+0000","last_clean":"2024-09-21T01:41:10.947491+0000","last_became_active":"2024-09-21T01:40:09.837296+0000","last_became_peered":"2024-09-21T01:40:09.837296+0000","last_unstale":"2024-09-21T01:41:10.947491+0000","last_undegraded":"2024-09-21T01:41:10.947491+0000","last_fullsized":"2024-09-21T01:41:10.947491+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:37:20.360076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"74'1","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.503693+0000","last_change":"2024-09-21T01:39:42.264955+0000","last_active":"2024-09-21T01:41:10.503693+0000","last_peered":"2024-09-21T01:41:10.503693+0000","last_clean":"2024-09-21T01:41:10.503693+0000","last_became_active":"2024-09-21T01:39:42.264492+0000","last_became_peered":"2024-09-21T01:39:42.264492+0000","last_unstale":"2024-09-21T01:41:10.503693+0000","last_undegraded":"2024-09-21T01:41:10.503693+0000","last_fullsized":"2024-09-21T01:41:10.503693+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:17:38.631521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.044021+0000","last_change":"2024-09-21T01:39:51.337908+0000","last_active":"2024-09-21T01:41:10.044021+0000","last_peered":"2024-09-21T01:41:10.044021+0000","last_clean":"2024-09-21T01:41:10.044021+0000","last_became_active":"2024-09-21T01:39:51.337200+0000","last_became_peered":"2024-09-21T01:39:51.337200+0000","last_unstale":"2024-09-21T01:41:10.044021+0000","last_undegraded":"2024-09-21T01:41:10.044021+0000","last_fullsized":"2024-09-21T01:41:10.044021+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:07:18.505959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.044300+0000","last_change":"2024-09-21T01:40:10.063539+0000","last_active":"2024-09-21T01:41:10.044300+0000","last_peered":"2024-09-21T01:41:10.044300+0000","last_clean":"2024-09-21T01:41:10.044300+0000","last_became_active":"2024-09-21T01:40:10.062966+0000","last_became_peered":"2024-09-21T01:40:10.062966+0000","last_unstale":"2024-09-21T01:41:10.044300+0000","last_undegraded":"2024-09-21T01:41:10.044300+0000","last_fullsized":"2024-09-21T01:41:10.044300+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:53:20.747493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,1],"acting":[5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"74'8","reported_seq":47,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.503907+0000","last_change":"2024-09-21T01:39:42.550795+0000","last_active":"2024-09-21T01:41:10.503907+0000","last_peered":"2024-09-21T01:41:10.503907+0000","last_clean":"2024-09-21T01:41:10.503907+0000","last_became_active":"2024-09-21T01:39:42.550424+0000","last_became_peered":"2024-09-21T01:39:42.550424+0000","last_unstale":"2024-09-21T01:41:10.503907+0000","last_undegraded":"2024-09-21T01:41:10.503907+0000","last_fullsized":"2024-09-21T01:41:10.503907+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:50:53.421080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.504489+0000","last_change":"2024-09-21T01:39:51.335239+0000","last_active":"2024-09-21T01:41:10.504489+0000","last_peered":"2024-09-21T01:41:10.504489+0000","last_clean":"2024-09-21T01:41:10.504489+0000","last_became_active":"2024-09-21T01:39:51.334846+0000","last_became_peered":"2024-09-21T01:39:51.334846+0000","last_unstale":"2024-09-21T01:41:10.504489+0000","last_undegraded":"2024-09-21T01:41:10.504489+0000","last_fullsized":"2024-09-21T01:41:10.504489+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:47:30.820219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:09.878150+0000","last_change":"2024-09-21T01:39:44.296080+0000","last_active":"2024-09-21T01:41:09.878150+0000","last_peered":"2024-09-21T01:41:09.878150+0000","last_clean":"2024-09-21T01:41:09.878150+0000","last_became_active":"2024-09-21T01:39:44.295724+0000","last_became_peered":"2024-09-21T01:39:44.295724+0000","last_unstale":"2024-09-21T01:41:09.878150+0000","last_undegraded":"2024-09-21T01:41:09.878150+0000","last_fullsized":"2024-09-21T01:41:09.878150+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:20:56.366350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.503820+0000","last_change":"2024-09-21T01:39:42.264499+0000","last_active":"2024-09-21T01:41:10.503820+0000","last_peered":"2024-09-21T01:41:10.503820+0000","last_clean":"2024-09-21T01:41:10.503820+0000","last_became_active":"2024-09-21T01:39:42.264059+0000","last_became_peered":"2024-09-21T01:39:42.264059+0000","last_unstale":"2024-09-21T01:41:10.503820+0000","last_undegraded":"2024-09-21T01:41:10.503820+0000","last_fullsized":"2024-09-21T01:41:10.503820+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:27:42.970693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:09.877344+0000","last_change":"2024-09-21T01:39:51.329357+0000","last_active":"2024-09-21T01:41:09.877344+0000","last_peered":"2024-09-21T01:41:09.877344+0000","last_clean":"2024-09-21T01:41:09.877344+0000","last_became_active":"2024-09-21T01:39:51.328761+0000","last_became_peered":"2024-09-21T01:39:51.328761+0000","last_unstale":"2024-09-21T01:41:09.877344+0000","last_undegraded":"2024-09-21T01:41:09.877344+0000","last_fullsized":"2024-09-21T01:41:09.877344+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:48:04.089765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:09.878573+0000","last_change":"2024-09-21T01:39:44.295799+0000","last_active":"2024-09-21T01:41:09.878573+0000","last_peered":"2024-09-21T01:41:09.878573+0000","last_clean":"2024-09-21T01:41:09.878573+0000","last_became_active":"2024-09-21T01:39:44.295432+0000","last_became_peered":"2024-09-21T01:39:44.295432+0000","last_unstale":"2024-09-21T01:41:09.878573+0000","last_undegraded":"2024-09-21T01:41:09.878573+0000","last_fullsized":"2024-09-21T01:41:09.878573+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:18:10.702545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.044394+0000","last_change":"2024-09-21T01:39:42.270552+0000","last_active":"2024-09-21T01:41:10.044394+0000","last_peered":"2024-09-21T01:41:10.044394+0000","last_clean":"2024-09-21T01:41:10.044394+0000","last_became_active":"2024-09-21T01:39:42.270158+0000","last_became_peered":"2024-09-21T01:39:42.270158+0000","last_unstale":"2024-09-21T01:41:10.044394+0000","last_undegraded":"2024-09-21T01:41:10.044394+0000","last_fullsized":"2024-09-21T01:41:10.044394+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:19:52.229598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.947461+0000","last_change":"2024-09-21T01:39:51.335823+0000","last_active":"2024-09-21T01:41:10.947461+0000","last_peered":"2024-09-21T01:41:10.947461+0000","last_clean":"2024-09-21T01:41:10.947461+0000","last_became_active":"2024-09-21T01:39:51.335363+0000","last_became_peered":"2024-09-21T01:39:51.335363+0000","last_unstale":"2024-09-21T01:41:10.947461+0000","last_undegraded":"2024-09-21T01:41:10.947461+0000","last_fullsized":"2024-09-21T01:41:10.947461+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:33:01.418708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.504360+0000","last_change":"2024-09-21T01:39:44.288963+0000","last_active":"2024-09-21T01:41:10.504360+0000","last_peered":"2024-09-21T01:41:10.504360+0000","last_clean":"2024-09-21T01:41:10.504360+0000","last_became_active":"2024-09-21T01:39:44.286967+0000","last_became_peered":"2024-09-21T01:39:44.286967+0000","last_unstale":"2024-09-21T01:41:10.504360+0000","last_undegraded":"2024-09-21T01:41:10.504360+0000","last_fullsized":"2024-09-21T01:41:10.504360+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:02:32.653351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"74'2","reported_seq":42,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:09.881149+0000","last_change":"2024-09-21T01:39:42.268553+0000","last_active":"2024-09-21T01:41:09.881149+0000","last_peered":"2024-09-21T01:41:09.881149+0000","last_clean":"2024-09-21T01:41:09.881149+0000","last_became_active":"2024-09-21T01:39:42.268154+0000","last_became_peered":"2024-09-21T01:39:42.268154+0000","last_unstale":"2024-09-21T01:41:09.881149+0000","last_undegraded":"2024-09-21T01:41:09.881149+0000","last_fullsized":"2024-09-21T01:41:09.881149+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:22:54.223718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.044472+0000","last_change":"2024-09-21T01:39:51.342268+0000","last_active":"2024-09-21T01:41:10.044472+0000","last_peered":"2024-09-21T01:41:10.044472+0000","last_clean":"2024-09-21T01:41:10.044472+0000","last_became_active":"2024-09-21T01:39:51.341221+0000","last_became_peered":"2024-09-21T01:39:51.341221+0000","last_unstale":"2024-09-21T01:41:10.044472+0000","last_undegraded":"2024-09-21T01:41:10.044472+0000","last_fullsized":"2024-09-21T01:41:10.044472+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:46:16.297124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.504240+0000","last_change":"2024-09-21T01:39:44.300338+0000","last_active":"2024-09-21T01:41:10.504240+0000","last_peered":"2024-09-21T01:41:10.504240+0000","last_clean":"2024-09-21T01:41:10.504240+0000","last_became_active":"2024-09-21T01:39:44.299920+0000","last_became_peered":"2024-09-21T01:39:44.299920+0000","last_unstale":"2024-09-21T01:41:10.504240+0000","last_undegraded":"2024-09-21T01:41:10.504240+0000","last_fullsized":"2024-09-21T01:41:10.504240+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:23:47.631867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"82'30","reported_seq":172,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:13.049317+0000","last_change":"2024-09-21T01:39:42.266883+0000","last_active":"2024-09-21T01:41:13.049317+0000","last_peered":"2024-09-21T01:41:13.049317+0000","last_clean":"2024-09-21T01:41:13.049317+0000","last_became_active":"2024-09-21T01:39:42.266494+0000","last_became_peered":"2024-09-21T01:39:42.266494+0000","last_unstale":"2024-09-21T01:41:13.049317+0000","last_undegraded":"2024-09-21T01:41:13.049317+0000","last_fullsized":"2024-09-21T01:41:13.049317+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:56:46.777522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67647,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":103,"num_read_kb":117,"num_write":30,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.040673+0000","last_change":"2024-09-21T01:40:09.842036+0000","last_active":"2024-09-21T01:41:10.040673+0000","last_peered":"2024-09-21T01:41:10.040673+0000","last_clean":"2024-09-21T01:41:10.040673+0000","last_became_active":"2024-09-21T01:40:09.841680+0000","last_became_peered":"2024-09-21T01:40:09.841680+0000","last_unstale":"2024-09-21T01:41:10.040673+0000","last_undegraded":"2024-09-21T01:41:10.040673+0000","last_fullsized":"2024-09-21T01:41:10.040673+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:01:58.366511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,11,5],"acting":[10,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:09.971835+0000","last_change":"2024-09-21T01:39:44.296958+0000","last_active":"2024-09-21T01:41:09.971835+0000","last_peered":"2024-09-21T01:41:09.971835+0000","last_clean":"2024-09-21T01:41:09.971835+0000","last_became_active":"2024-09-21T01:39:44.296588+0000","last_became_peered":"2024-09-21T01:39:44.296588+0000","last_unstale":"2024-09-21T01:41:09.971835+0000","last_undegraded":"2024-09-21T01:41:09.971835+0000","last_fullsized":"2024-09-21T01:41:09.971835+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:04:25.222279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"74'3","reported_seq":42,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.044764+0000","last_change":"2024-09-21T01:39:42.550770+0000","last_active":"2024-09-21T01:41:10.044764+0000","last_peered":"2024-09-21T01:41:10.044764+0000","last_clean":"2024-09-21T01:41:10.044764+0000","last_became_active":"2024-09-21T01:39:42.550317+0000","last_became_peered":"2024-09-21T01:39:42.550317+0000","last_unstale":"2024-09-21T01:41:10.044764+0000","last_undegraded":"2024-09-21T01:41:10.044764+0000","last_fullsized":"2024-09-21T01:41:10.044764+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:11:05.269317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.504279+0000","last_change":"2024-09-21T01:39:51.342166+0000","last_active":"2024-09-21T01:41:10.504279+0000","last_peered":"2024-09-21T01:41:10.504279+0000","last_clean":"2024-09-21T01:41:10.504279+0000","last_became_active":"2024-09-21T01:39:51.341633+0000","last_became_peered":"2024-09-21T01:39:51.341633+0000","last_unstale":"2024-09-21T01:41:10.504279+0000","last_undegraded":"2024-09-21T01:41:10.504279+0000","last_fullsized":"2024-09-21T01:41:10.504279+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:47:13.524123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.506120+0000","last_change":"2024-09-21T01:39:44.297652+0000","last_active":"2024-09-21T01:41:10.506120+0000","last_peered":"2024-09-21T01:41:10.506120+0000","last_clean":"2024-09-21T01:41:10.506120+0000","last_became_active":"2024-09-21T01:39:44.297289+0000","last_became_peered":"2024-09-21T01:39:44.297289+0000","last_unstale":"2024-09-21T01:41:10.506120+0000","last_undegraded":"2024-09-21T01:41:10.506120+0000","last_fullsized":"2024-09-21T01:41:10.506120+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:14:52.834492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:09.878796+0000","last_change":"2024-09-21T01:39:42.269881+0000","last_active":"2024-09-21T01:41:09.878796+0000","last_peered":"2024-09-21T01:41:09.878796+0000","last_clean":"2024-09-21T01:41:09.878796+0000","last_became_active":"2024-09-21T01:39:42.269498+0000","last_became_peered":"2024-09-21T01:39:42.269498+0000","last_unstale":"2024-09-21T01:41:09.878796+0000","last_undegraded":"2024-09-21T01:41:09.878796+0000","last_fullsized":"2024-09-21T01:41:09.878796+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:10:31.750792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.503690+0000","last_change":"2024-09-21T01:40:10.063827+0000","last_active":"2024-09-21T01:41:10.503690+0000","last_peered":"2024-09-21T01:41:10.503690+0000","last_clean":"2024-09-21T01:41:10.503690+0000","last_became_active":"2024-09-21T01:40:10.063206+0000","last_became_peered":"2024-09-21T01:40:10.063206+0000","last_unstale":"2024-09-21T01:41:10.503690+0000","last_undegraded":"2024-09-21T01:41:10.503690+0000","last_fullsized":"2024-09-21T01:41:10.503690+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:33:28.905812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2,4],"acting":[8,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:09.972076+0000","last_change":"2024-09-21T01:39:44.292241+0000","last_active":"2024-09-21T01:41:09.972076+0000","last_peered":"2024-09-21T01:41:09.972076+0000","last_clean":"2024-09-21T01:41:09.972076+0000","last_became_active":"2024-09-21T01:39:44.291808+0000","last_became_peered":"2024-09-21T01:39:44.291808+0000","last_unstale":"2024-09-21T01:41:09.972076+0000","last_undegraded":"2024-09-21T01:41:09.972076+0000","last_fullsized":"2024-09-21T01:41:09.972076+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:47:24.761137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.041221+0000","last_change":"2024-09-21T01:39:42.272047+0000","last_active":"2024-09-21T01:41:10.041221+0000","last_peered":"2024-09-21T01:41:10.041221+0000","last_clean":"2024-09-21T01:41:10.041221+0000","last_became_active":"2024-09-21T01:39:42.271668+0000","last_became_peered":"2024-09-21T01:39:42.271668+0000","last_unstale":"2024-09-21T01:41:10.041221+0000","last_undegraded":"2024-09-21T01:41:10.041221+0000","last_fullsized":"2024-09-21T01:41:10.041221+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:44:09.702328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.505772+0000","last_change":"2024-09-21T01:39:51.337760+0000","last_active":"2024-09-21T01:41:10.505772+0000","last_peered":"2024-09-21T01:41:10.505772+0000","last_clean":"2024-09-21T01:41:10.505772+0000","last_became_active":"2024-09-21T01:39:51.337337+0000","last_became_peered":"2024-09-21T01:39:51.337337+0000","last_unstale":"2024-09-21T01:41:10.505772+0000","last_undegraded":"2024-09-21T01:41:10.505772+0000","last_fullsized":"2024-09-21T01:41:10.505772+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:33:49.316833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.503723+0000","last_change":"2024-09-21T01:39:51.334722+0000","last_active":"2024-09-21T01:41:10.503723+0000","last_peered":"2024-09-21T01:41:10.503723+0000","last_clean":"2024-09-21T01:41:10.503723+0000","last_became_active":"2024-09-21T01:39:51.334318+0000","last_became_peered":"2024-09-21T01:39:51.334318+0000","last_unstale":"2024-09-21T01:41:10.503723+0000","last_undegraded":"2024-09-21T01:41:10.503723+0000","last_fullsized":"2024-09-21T01:41:10.503723+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:29:17.625223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:09.876947+0000","last_change":"2024-09-21T01:39:44.283183+0000","last_active":"2024-09-21T01:41:09.876947+0000","last_peered":"2024-09-21T01:41:09.876947+0000","last_clean":"2024-09-21T01:41:09.876947+0000","last_became_active":"2024-09-21T01:39:44.282829+0000","last_became_peered":"2024-09-21T01:39:44.282829+0000","last_unstale":"2024-09-21T01:41:09.876947+0000","last_undegraded":"2024-09-21T01:41:09.876947+0000","last_fullsized":"2024-09-21T01:41:09.876947+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:31:43.602584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.044143+0000","last_change":"2024-09-21T01:39:42.267465+0000","last_active":"2024-09-21T01:41:10.044143+0000","last_peered":"2024-09-21T01:41:10.044143+0000","last_clean":"2024-09-21T01:41:10.044143+0000","last_became_active":"2024-09-21T01:39:42.267051+0000","last_became_peered":"2024-09-21T01:39:42.267051+0000","last_unstale":"2024-09-21T01:41:10.044143+0000","last_undegraded":"2024-09-21T01:41:10.044143+0000","last_fullsized":"2024-09-21T01:41:10.044143+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:17:30.917284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.947577+0000","last_change":"2024-09-21T01:39:51.338907+0000","last_active":"2024-09-21T01:41:10.947577+0000","last_peered":"2024-09-21T01:41:10.947577+0000","last_clean":"2024-09-21T01:41:10.947577+0000","last_became_active":"2024-09-21T01:39:51.338444+0000","last_became_peered":"2024-09-21T01:39:51.338444+0000","last_unstale":"2024-09-21T01:41:10.947577+0000","last_undegraded":"2024-09-21T01:41:10.947577+0000","last_fullsized":"2024-09-21T01:41:10.947577+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:35:44.819976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.505371+0000","last_change":"2024-09-21T01:39:44.293735+0000","last_active":"2024-09-21T01:41:10.505371+0000","last_peered":"2024-09-21T01:41:10.505371+0000","last_clean":"2024-09-21T01:41:10.505371+0000","last_became_active":"2024-09-21T01:39:44.293371+0000","last_became_peered":"2024-09-21T01:39:44.293371+0000","last_unstale":"2024-09-21T01:41:10.505371+0000","last_undegraded":"2024-09-21T01:41:10.505371+0000","last_fullsized":"2024-09-21T01:41:10.505371+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:50:50.404018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.503564+0000","last_change":"2024-09-21T01:39:42.259012+0000","last_active":"2024-09-21T01:41:10.503564+0000","last_peered":"2024-09-21T01:41:10.503564+0000","last_clean":"2024-09-21T01:41:10.503564+0000","last_became_active":"2024-09-21T01:39:42.258665+0000","last_became_peered":"2024-09-21T01:39:42.258665+0000","last_unstale":"2024-09-21T01:41:10.503564+0000","last_undegraded":"2024-09-21T01:41:10.503564+0000","last_fullsized":"2024-09-21T01:41:10.503564+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:25:24.797505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"74'1","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.040907+0000","last_change":"2024-09-21T01:39:42.270969+0000","last_active":"2024-09-21T01:41:10.040907+0000","last_peered":"2024-09-21T01:41:10.040907+0000","last_clean":"2024-09-21T01:41:10.040907+0000","last_became_active":"2024-09-21T01:39:42.270629+0000","last_became_peered":"2024-09-21T01:39:42.270629+0000","last_unstale":"2024-09-21T01:41:10.040907+0000","last_undegraded":"2024-09-21T01:41:10.040907+0000","last_fullsized":"2024-09-21T01:41:10.040907+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:30:06.321196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.044186+0000","last_change":"2024-09-21T01:39:44.297656+0000","last_active":"2024-09-21T01:41:10.044186+0000","last_peered":"2024-09-21T01:41:10.044186+0000","last_clean":"2024-09-21T01:41:10.044186+0000","last_became_active":"2024-09-21T01:39:44.297273+0000","last_became_peered":"2024-09-21T01:39:44.297273+0000","last_unstale":"2024-09-21T01:41:10.044186+0000","last_undegraded":"2024-09-21T01:41:10.044186+0000","last_fullsized":"2024-09-21T01:41:10.044186+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:35:24.645472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:09.881207+0000","last_change":"2024-09-21T01:40:09.842397+0000","last_active":"2024-09-21T01:41:09.881207+0000","last_peered":"2024-09-21T01:41:09.881207+0000","last_clean":"2024-09-21T01:41:09.881207+0000","last_became_active":"2024-09-21T01:40:09.841934+0000","last_became_peered":"2024-09-21T01:40:09.841934+0000","last_unstale":"2024-09-21T01:41:09.881207+0000","last_undegraded":"2024-09-21T01:41:09.881207+0000","last_fullsized":"2024-09-21T01:41:09.881207+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:06:36.189594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,8,5],"acting":[2,6,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"74'1","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.044389+0000","last_change":"2024-09-21T01:39:42.267207+0000","last_active":"2024-09-21T01:41:10.044389+0000","last_peered":"2024-09-21T01:41:10.044389+0000","last_clean":"2024-09-21T01:41:10.044389+0000","last_became_active":"2024-09-21T01:39:42.266829+0000","last_became_peered":"2024-09-21T01:39:42.266829+0000","last_unstale":"2024-09-21T01:41:10.044389+0000","last_undegraded":"2024-09-21T01:41:10.044389+0000","last_fullsized":"2024-09-21T01:41:10.044389+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:03:18.047546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.504295+0000","last_change":"2024-09-21T01:39:44.305545+0000","last_active":"2024-09-21T01:41:10.504295+0000","last_peered":"2024-09-21T01:41:10.504295+0000","last_clean":"2024-09-21T01:41:10.504295+0000","last_became_active":"2024-09-21T01:39:44.305195+0000","last_became_peered":"2024-09-21T01:39:44.305195+0000","last_unstale":"2024-09-21T01:41:10.504295+0000","last_undegraded":"2024-09-21T01:41:10.504295+0000","last_fullsized":"2024-09-21T01:41:10.504295+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:26:50.011622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:09.881130+0000","last_change":"2024-09-21T01:39:51.342132+0000","last_active":"2024-09-21T01:41:09.881130+0000","last_peered":"2024-09-21T01:41:09.881130+0000","last_clean":"2024-09-21T01:41:09.881130+0000","last_became_active":"2024-09-21T01:39:51.341668+0000","last_became_peered":"2024-09-21T01:39:51.341668+0000","last_unstale":"2024-09-21T01:41:09.881130+0000","last_undegraded":"2024-09-21T01:41:09.881130+0000","last_fullsized":"2024-09-21T01:41:09.881130+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:28:18.119259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.947171+0000","last_change":"2024-09-21T01:39:44.300226+0000","last_active":"2024-09-21T01:41:10.947171+0000","last_peered":"2024-09-21T01:41:10.947171+0000","last_clean":"2024-09-21T01:41:10.947171+0000","last_became_active":"2024-09-21T01:39:44.298740+0000","last_became_peered":"2024-09-21T01:39:44.298740+0000","last_unstale":"2024-09-21T01:41:10.947171+0000","last_undegraded":"2024-09-21T01:41:10.947171+0000","last_fullsized":"2024-09-21T01:41:10.947171+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:05:33.288070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:09.881091+0000","last_change":"2024-09-21T01:39:44.301379+0000","last_active":"2024-09-21T01:41:09.881091+0000","last_peered":"2024-09-21T01:41:09.881091+0000","last_clean":"2024-09-21T01:41:09.881091+0000","last_became_active":"2024-09-21T01:39:44.301011+0000","last_became_peered":"2024-09-21T01:39:44.301011+0000","last_unstale":"2024-09-21T01:41:09.881091+0000","last_undegraded":"2024-09-21T01:41:09.881091+0000","last_fullsized":"2024-09-21T01:41:09.881091+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:16:47.672736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:09.880818+0000","last_change":"2024-09-21T01:39:44.294318+0000","last_active":"2024-09-21T01:41:09.880818+0000","last_peered":"2024-09-21T01:41:09.880818+0000","last_clean":"2024-09-21T01:41:09.880818+0000","last_became_active":"2024-09-21T01:39:44.293941+0000","last_became_peered":"2024-09-21T01:39:44.293941+0000","last_unstale":"2024-09-21T01:41:09.880818+0000","last_undegraded":"2024-09-21T01:41:09.880818+0000","last_fullsized":"2024-09-21T01:41:09.880818+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:27:34.776088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.504604+0000","last_change":"2024-09-21T01:39:44.287815+0000","last_active":"2024-09-21T01:41:10.504604+0000","last_peered":"2024-09-21T01:41:10.504604+0000","last_clean":"2024-09-21T01:41:10.504604+0000","last_became_active":"2024-09-21T01:39:44.287471+0000","last_became_peered":"2024-09-21T01:39:44.287471+0000","last_unstale":"2024-09-21T01:41:10.504604+0000","last_undegraded":"2024-09-21T01:41:10.504604+0000","last_fullsized":"2024-09-21T01:41:10.504604+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:13:59.661464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.504593+0000","last_change":"2024-09-21T01:39:44.285591+0000","last_active":"2024-09-21T01:41:10.504593+0000","last_peered":"2024-09-21T01:41:10.504593+0000","last_clean":"2024-09-21T01:41:10.504593+0000","last_became_active":"2024-09-21T01:39:44.285253+0000","last_became_peered":"2024-09-21T01:39:44.285253+0000","last_unstale":"2024-09-21T01:41:10.504593+0000","last_undegraded":"2024-09-21T01:41:10.504593+0000","last_fullsized":"2024-09-21T01:41:10.504593+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:58:02.890685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.947611+0000","last_change":"2024-09-21T01:39:44.306547+0000","last_active":"2024-09-21T01:41:10.947611+0000","last_peered":"2024-09-21T01:41:10.947611+0000","last_clean":"2024-09-21T01:41:10.947611+0000","last_became_active":"2024-09-21T01:39:44.306116+0000","last_became_peered":"2024-09-21T01:39:44.306116+0000","last_unstale":"2024-09-21T01:41:10.947611+0000","last_undegraded":"2024-09-21T01:41:10.947611+0000","last_fullsized":"2024-09-21T01:41:10.947611+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:58:40.654784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:09.881337+0000","last_change":"2024-09-21T01:39:44.295317+0000","last_active":"2024-09-21T01:41:09.881337+0000","last_peered":"2024-09-21T01:41:09.881337+0000","last_clean":"2024-09-21T01:41:09.881337+0000","last_became_active":"2024-09-21T01:39:44.294936+0000","last_became_peered":"2024-09-21T01:39:44.294936+0000","last_unstale":"2024-09-21T01:41:09.881337+0000","last_undegraded":"2024-09-21T01:41:09.881337+0000","last_fullsized":"2024-09-21T01:41:09.881337+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:32:24.112588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.505546+0000","last_change":"2024-09-21T01:39:44.297242+0000","last_active":"2024-09-21T01:41:10.505546+0000","last_peered":"2024-09-21T01:41:10.505546+0000","last_clean":"2024-09-21T01:41:10.505546+0000","last_became_active":"2024-09-21T01:39:44.296072+0000","last_became_peered":"2024-09-21T01:39:44.296072+0000","last_unstale":"2024-09-21T01:41:10.505546+0000","last_undegraded":"2024-09-21T01:41:10.505546+0000","last_fullsized":"2024-09-21T01:41:10.505546+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:22:23.449535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.043987+0000","last_change":"2024-09-21T01:39:44.293899+0000","last_active":"2024-09-21T01:41:10.043987+0000","last_peered":"2024-09-21T01:41:10.043987+0000","last_clean":"2024-09-21T01:41:10.043987+0000","last_became_active":"2024-09-21T01:39:44.293502+0000","last_became_peered":"2024-09-21T01:39:44.293502+0000","last_unstale":"2024-09-21T01:41:10.043987+0000","last_undegraded":"2024-09-21T01:41:10.043987+0000","last_fullsized":"2024-09-21T01:41:10.043987+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:07:39.549931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.505885+0000","last_change":"2024-09-21T01:39:44.298192+0000","last_active":"2024-09-21T01:41:10.505885+0000","last_peered":"2024-09-21T01:41:10.505885+0000","last_clean":"2024-09-21T01:41:10.505885+0000","last_became_active":"2024-09-21T01:39:44.297834+0000","last_became_peered":"2024-09-21T01:39:44.297834+0000","last_unstale":"2024-09-21T01:41:10.505885+0000","last_undegraded":"2024-09-21T01:41:10.505885+0000","last_fullsized":"2024-09-21T01:41:10.505885+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:41:21.759972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:09.971694+0000","last_change":"2024-09-21T01:39:44.300125+0000","last_active":"2024-09-21T01:41:09.971694+0000","last_peered":"2024-09-21T01:41:09.971694+0000","last_clean":"2024-09-21T01:41:09.971694+0000","last_became_active":"2024-09-21T01:39:44.298047+0000","last_became_peered":"2024-09-21T01:39:44.298047+0000","last_unstale":"2024-09-21T01:41:09.971694+0000","last_undegraded":"2024-09-21T01:41:09.971694+0000","last_fullsized":"2024-09-21T01:41:09.971694+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:31:58.719520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.505329+0000","last_change":"2024-09-21T01:39:44.287346+0000","last_active":"2024-09-21T01:41:10.505329+0000","last_peered":"2024-09-21T01:41:10.505329+0000","last_clean":"2024-09-21T01:41:10.505329+0000","last_became_active":"2024-09-21T01:39:44.286999+0000","last_became_peered":"2024-09-21T01:39:44.286999+0000","last_unstale":"2024-09-21T01:41:10.505329+0000","last_undegraded":"2024-09-21T01:41:10.505329+0000","last_fullsized":"2024-09-21T01:41:10.505329+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:42:26.732516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.947673+0000","last_change":"2024-09-21T01:39:44.299083+0000","last_active":"2024-09-21T01:41:10.947673+0000","last_peered":"2024-09-21T01:41:10.947673+0000","last_clean":"2024-09-21T01:41:10.947673+0000","last_became_active":"2024-09-21T01:39:44.298194+0000","last_became_peered":"2024-09-21T01:39:44.298194+0000","last_unstale":"2024-09-21T01:41:10.947673+0000","last_undegraded":"2024-09-21T01:41:10.947673+0000","last_fullsized":"2024-09-21T01:41:10.947673+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:22:23.360519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:09.881279+0000","last_change":"2024-09-21T01:39:44.292985+0000","last_active":"2024-09-21T01:41:09.881279+0000","last_peered":"2024-09-21T01:41:09.881279+0000","last_clean":"2024-09-21T01:41:09.881279+0000","last_became_active":"2024-09-21T01:39:44.292565+0000","last_became_peered":"2024-09-21T01:39:44.292565+0000","last_unstale":"2024-09-21T01:41:09.881279+0000","last_undegraded":"2024-09-21T01:41:09.881279+0000","last_fullsized":"2024-09-21T01:41:09.881279+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:03:33.563458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:09.877354+0000","last_change":"2024-09-21T01:39:44.291522+0000","last_active":"2024-09-21T01:41:09.877354+0000","last_peered":"2024-09-21T01:41:09.877354+0000","last_clean":"2024-09-21T01:41:09.877354+0000","last_became_active":"2024-09-21T01:39:44.291173+0000","last_became_peered":"2024-09-21T01:39:44.291173+0000","last_unstale":"2024-09-21T01:41:09.877354+0000","last_undegraded":"2024-09-21T01:41:09.877354+0000","last_fullsized":"2024-09-21T01:41:09.877354+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:41:54.562004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.947793+0000","last_change":"2024-09-21T01:39:44.305053+0000","last_active":"2024-09-21T01:41:10.947793+0000","last_peered":"2024-09-21T01:41:10.947793+0000","last_clean":"2024-09-21T01:41:10.947793+0000","last_became_active":"2024-09-21T01:39:44.304651+0000","last_became_peered":"2024-09-21T01:39:44.304651+0000","last_unstale":"2024-09-21T01:41:10.947793+0000","last_undegraded":"2024-09-21T01:41:10.947793+0000","last_fullsized":"2024-09-21T01:41:10.947793+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:15:42.819633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:09.971441+0000","last_change":"2024-09-21T01:39:44.298405+0000","last_active":"2024-09-21T01:41:09.971441+0000","last_peered":"2024-09-21T01:41:09.971441+0000","last_clean":"2024-09-21T01:41:09.971441+0000","last_became_active":"2024-09-21T01:39:44.298010+0000","last_became_peered":"2024-09-21T01:39:44.298010+0000","last_unstale":"2024-09-21T01:41:09.971441+0000","last_undegraded":"2024-09-21T01:41:09.971441+0000","last_fullsized":"2024-09-21T01:41:09.971441+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:09:15.321530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.503947+0000","last_change":"2024-09-21T01:39:44.290593+0000","last_active":"2024-09-21T01:41:10.503947+0000","last_peered":"2024-09-21T01:41:10.503947+0000","last_clean":"2024-09-21T01:41:10.503947+0000","last_became_active":"2024-09-21T01:39:44.290235+0000","last_became_peered":"2024-09-21T01:39:44.290235+0000","last_unstale":"2024-09-21T01:41:10.503947+0000","last_undegraded":"2024-09-21T01:41:10.503947+0000","last_fullsized":"2024-09-21T01:41:10.503947+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:52:20.359493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.504199+0000","last_change":"2024-09-21T01:39:44.301902+0000","last_active":"2024-09-21T01:41:10.504199+0000","last_peered":"2024-09-21T01:41:10.504199+0000","last_clean":"2024-09-21T01:41:10.504199+0000","last_became_active":"2024-09-21T01:39:44.301494+0000","last_became_peered":"2024-09-21T01:39:44.301494+0000","last_unstale":"2024-09-21T01:41:10.504199+0000","last_undegraded":"2024-09-21T01:41:10.504199+0000","last_fullsized":"2024-09-21T01:41:10.504199+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:06:16.162987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.505325+0000","last_change":"2024-09-21T01:39:44.292360+0000","last_active":"2024-09-21T01:41:10.505325+0000","last_peered":"2024-09-21T01:41:10.505325+0000","last_clean":"2024-09-21T01:41:10.505325+0000","last_became_active":"2024-09-21T01:39:44.291995+0000","last_became_peered":"2024-09-21T01:39:44.291995+0000","last_unstale":"2024-09-21T01:41:10.505325+0000","last_undegraded":"2024-09-21T01:41:10.505325+0000","last_fullsized":"2024-09-21T01:41:10.505325+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:29:10.511082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.504500+0000","last_change":"2024-09-21T01:39:44.291836+0000","last_active":"2024-09-21T01:41:10.504500+0000","last_peered":"2024-09-21T01:41:10.504500+0000","last_clean":"2024-09-21T01:41:10.504500+0000","last_became_active":"2024-09-21T01:39:44.291459+0000","last_became_peered":"2024-09-21T01:39:44.291459+0000","last_unstale":"2024-09-21T01:41:10.504500+0000","last_undegraded":"2024-09-21T01:41:10.504500+0000","last_fullsized":"2024-09-21T01:41:10.504500+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:11:53.296520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:09.878862+0000","last_change":"2024-09-21T01:39:44.298572+0000","last_active":"2024-09-21T01:41:09.878862+0000","last_peered":"2024-09-21T01:41:09.878862+0000","last_clean":"2024-09-21T01:41:09.878862+0000","last_became_active":"2024-09-21T01:39:44.297903+0000","last_became_peered":"2024-09-21T01:39:44.297903+0000","last_unstale":"2024-09-21T01:41:09.878862+0000","last_undegraded":"2024-09-21T01:41:09.878862+0000","last_fullsized":"2024-09-21T01:41:09.878862+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:25:06.327202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.041285+0000","last_change":"2024-09-21T01:39:44.292648+0000","last_active":"2024-09-21T01:41:10.041285+0000","last_peered":"2024-09-21T01:41:10.041285+0000","last_clean":"2024-09-21T01:41:10.041285+0000","last_became_active":"2024-09-21T01:39:44.292215+0000","last_became_peered":"2024-09-21T01:39:44.292215+0000","last_unstale":"2024-09-21T01:41:10.041285+0000","last_undegraded":"2024-09-21T01:41:10.041285+0000","last_fullsized":"2024-09-21T01:41:10.041285+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:43:02.265276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:09.972172+0000","last_change":"2024-09-21T01:39:44.303330+0000","last_active":"2024-09-21T01:41:09.972172+0000","last_peered":"2024-09-21T01:41:09.972172+0000","last_clean":"2024-09-21T01:41:09.972172+0000","last_became_active":"2024-09-21T01:39:44.302862+0000","last_became_peered":"2024-09-21T01:39:44.302862+0000","last_unstale":"2024-09-21T01:41:09.972172+0000","last_undegraded":"2024-09-21T01:41:09.972172+0000","last_fullsized":"2024-09-21T01:41:09.972172+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:58:12.296150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.505356+0000","last_change":"2024-09-21T01:39:44.288015+0000","last_active":"2024-09-21T01:41:10.505356+0000","last_peered":"2024-09-21T01:41:10.505356+0000","last_clean":"2024-09-21T01:41:10.505356+0000","last_became_active":"2024-09-21T01:39:44.287455+0000","last_became_peered":"2024-09-21T01:39:44.287455+0000","last_unstale":"2024-09-21T01:41:10.505356+0000","last_undegraded":"2024-09-21T01:41:10.505356+0000","last_fullsized":"2024-09-21T01:41:10.505356+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:12:07.036882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:09.878229+0000","last_change":"2024-09-21T01:39:44.294594+0000","last_active":"2024-09-21T01:41:09.878229+0000","last_peered":"2024-09-21T01:41:09.878229+0000","last_clean":"2024-09-21T01:41:09.878229+0000","last_became_active":"2024-09-21T01:39:44.294218+0000","last_became_peered":"2024-09-21T01:39:44.294218+0000","last_unstale":"2024-09-21T01:41:09.878229+0000","last_undegraded":"2024-09-21T01:41:09.878229+0000","last_fullsized":"2024-09-21T01:41:09.878229+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:45:54.875131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.040849+0000","last_change":"2024-09-21T01:39:44.285172+0000","last_active":"2024-09-21T01:41:10.040849+0000","last_peered":"2024-09-21T01:41:10.040849+0000","last_clean":"2024-09-21T01:41:10.040849+0000","last_became_active":"2024-09-21T01:39:44.284799+0000","last_became_peered":"2024-09-21T01:39:44.284799+0000","last_unstale":"2024-09-21T01:41:10.040849+0000","last_undegraded":"2024-09-21T01:41:10.040849+0000","last_fullsized":"2024-09-21T01:41:10.040849+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:06:30.562297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.503985+0000","last_change":"2024-09-21T01:39:44.295990+0000","last_active":"2024-09-21T01:41:10.503985+0000","last_peered":"2024-09-21T01:41:10.503985+0000","last_clean":"2024-09-21T01:41:10.503985+0000","last_became_active":"2024-09-21T01:39:44.295601+0000","last_became_peered":"2024-09-21T01:39:44.295601+0000","last_unstale":"2024-09-21T01:41:10.503985+0000","last_undegraded":"2024-09-21T01:41:10.503985+0000","last_fullsized":"2024-09-21T01:41:10.503985+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:37:08.300911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.504510+0000","last_change":"2024-09-21T01:39:44.300104+0000","last_active":"2024-09-21T01:41:10.504510+0000","last_peered":"2024-09-21T01:41:10.504510+0000","last_clean":"2024-09-21T01:41:10.504510+0000","last_became_active":"2024-09-21T01:39:44.299709+0000","last_became_peered":"2024-09-21T01:39:44.299709+0000","last_unstale":"2024-09-21T01:41:10.504510+0000","last_undegraded":"2024-09-21T01:41:10.504510+0000","last_fullsized":"2024-09-21T01:41:10.504510+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:01:35.013021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.505080+0000","last_change":"2024-09-21T01:39:44.295900+0000","last_active":"2024-09-21T01:41:10.505080+0000","last_peered":"2024-09-21T01:41:10.505080+0000","last_clean":"2024-09-21T01:41:10.505080+0000","last_became_active":"2024-09-21T01:39:44.295303+0000","last_became_peered":"2024-09-21T01:39:44.295303+0000","last_unstale":"2024-09-21T01:41:10.505080+0000","last_undegraded":"2024-09-21T01:41:10.505080+0000","last_fullsized":"2024-09-21T01:41:10.505080+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:00:23.097745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.505528+0000","last_change":"2024-09-21T01:39:44.303627+0000","last_active":"2024-09-21T01:41:10.505528+0000","last_peered":"2024-09-21T01:41:10.505528+0000","last_clean":"2024-09-21T01:41:10.505528+0000","last_became_active":"2024-09-21T01:39:44.303260+0000","last_became_peered":"2024-09-21T01:39:44.303260+0000","last_unstale":"2024-09-21T01:41:10.505528+0000","last_undegraded":"2024-09-21T01:41:10.505528+0000","last_fullsized":"2024-09-21T01:41:10.505528+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:17:39.630994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.947741+0000","last_change":"2024-09-21T01:39:44.306087+0000","last_active":"2024-09-21T01:41:10.947741+0000","last_peered":"2024-09-21T01:41:10.947741+0000","last_clean":"2024-09-21T01:41:10.947741+0000","last_became_active":"2024-09-21T01:39:44.305660+0000","last_became_peered":"2024-09-21T01:39:44.305660+0000","last_unstale":"2024-09-21T01:41:10.947741+0000","last_undegraded":"2024-09-21T01:41:10.947741+0000","last_fullsized":"2024-09-21T01:41:10.947741+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:26:46.911966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":68445,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":109,"num_read_kb":123,"num_write":83,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":294912,"data_stored":205335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":70,"ondisk_log_size":70,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":376832,"data_stored":4132576,"data_compressed":247723,"data_compressed_allocated":315392,"data_compressed_original":4096000,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":68,"seq":292057776160,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27932,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717220,"statfs":{"total":95995035648,"available":95966433280,"internally_reserved":0,"allocated":925696,"data_stored":494638,"data_compressed":29495,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939684,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32228,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712924,"statfs":{"total":95995035648,"available":95962034176,"internally_reserved":0,"allocated":1060864,"data_stored":1148751,"data_compressed":65346,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":58,"seq":249108103210,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":933888,"data_stored":499316,"data_compressed":29495,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":52,"seq":223338299440,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":933888,"data_stored":495242,"data_compressed":29495,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495668,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32152,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713000,"statfs":{"total":95995035648,"available":95962112000,"internally_reserved":0,"allocated":983040,"data_stored":1089684,"data_compressed":65346,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":41,"seq":176093659193,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":921600,"data_stored":490542,"data_compressed":29495,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855423,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32152,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713000,"statfs":{"total":95995035648,"available":95962112000,"internally_reserved":0,"allocated":987136,"data_stored":1085188,"data_compressed":65346,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018948,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27940,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717212,"statfs":{"total":95995035648,"available":95966425088,"internally_reserved":0,"allocated":929792,"data_stored":494660,"data_compressed":29495,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182473,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32096,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713056,"statfs":{"total":95995035648,"available":95962169344,"internally_reserved":0,"allocated":929792,"data_stored":490646,"data_compressed":29495,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411406,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36332,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708820,"statfs":{"total":95995035648,"available":95957831680,"internally_reserved":0,"allocated":1003520,"data_stored":558223,"data_compressed":29495,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574930,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32168,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712984,"statfs":{"total":95995035648,"available":95962095616,"internally_reserved":0,"allocated":999424,"data_stored":558189,"data_compressed":29495,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705752,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":925696,"data_stored":490632,"data_compressed":29495,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34234,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34234,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35851,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35851,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35851,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35851,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35851,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":67647,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":67681,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":67841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T01:41:21.597 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph pg dump --format=json 2024-09-21T01:41:21.844 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:41:22.089 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:41:21 smithi083 ceph-mon[31370]: from='client.15255 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T01:41:22.089 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:41:21 smithi083 ceph-mon[31370]: pgmap v318: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 1 op/s 2024-09-21T01:41:22.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:41:21 smithi142 ceph-mon[34050]: from='client.15255 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T01:41:22.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:41:21 smithi142 ceph-mon[34050]: pgmap v318: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 1 op/s 2024-09-21T01:41:22.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:41:21 smithi119 ceph-mon[33693]: from='client.15255 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T01:41:22.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:41:21 smithi119 ceph-mon[33693]: pgmap v318: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 1 op/s 2024-09-21T01:41:22.285 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:22.283+0000 7f700fcd7640 1 -- 172.21.15.83:0/3723334624 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7008114450 msgr2=0x7f7008116920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:22.285 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:22.283+0000 7f700fcd7640 1 --2- 172.21.15.83:0/3723334624 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7008114450 0x7f7008116920 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f7000009900 tx=0x7f700002a410 comp rx=0 tx=0).stop 2024-09-21T01:41:22.285 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:22.283+0000 7f700fcd7640 1 -- 172.21.15.83:0/3723334624 shutdown_connections 2024-09-21T01:41:22.285 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:22.283+0000 7f700fcd7640 1 --2- 172.21.15.83:0/3723334624 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7008114450 0x7f7008116920 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:22.285 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:22.283+0000 7f700fcd7640 1 --2- 172.21.15.83:0/3723334624 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7008075dd0 0x7f70080761e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:22.286 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:22.283+0000 7f700fcd7640 1 --2- 172.21.15.83:0/3723334624 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7008077380 0x7f70080757b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:22.286 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:22.283+0000 7f700fcd7640 1 -- 172.21.15.83:0/3723334624 >> 172.21.15.83:0/3723334624 conn(0x7f70080ff5d0 msgr2=0x7f7008101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:41:22.286 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:22.283+0000 7f700fcd7640 1 -- 172.21.15.83:0/3723334624 shutdown_connections 2024-09-21T01:41:22.286 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:22.283+0000 7f700fcd7640 1 -- 172.21.15.83:0/3723334624 wait complete. 2024-09-21T01:41:22.286 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:22.283+0000 7f700fcd7640 1 Processor -- start 2024-09-21T01:41:22.286 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:22.283+0000 7f700fcd7640 1 -- start start 2024-09-21T01:41:22.286 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:22.284+0000 7f700fcd7640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7008075dd0 0x7f70081a09b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:22.286 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:22.284+0000 7f700fcd7640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7008077380 0x7f70081a0f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:22.286 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:22.284+0000 7f700fcd7640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7008114450 0x7f70081a61f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:22.286 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:22.284+0000 7f700fcd7640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f7008119f40 con 0x7f7008077380 2024-09-21T01:41:22.286 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:22.284+0000 7f700fcd7640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f7008119dc0 con 0x7f7008114450 2024-09-21T01:41:22.286 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:22.284+0000 7f700fcd7640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f700811a0c0 con 0x7f7008075dd0 2024-09-21T01:41:22.286 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:22.284+0000 7f700d272640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7008077380 0x7f70081a0f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:22.287 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:22.284+0000 7f700d272640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7008077380 0x7f70081a0f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:58912/0 (socket says 172.21.15.83:58912) 2024-09-21T01:41:22.287 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:22.284+0000 7f700d272640 1 -- 172.21.15.83:0/2448515823 learned_addr learned my addr 172.21.15.83:0/2448515823 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:41:22.287 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:22.284+0000 7f700da73640 1 --2- 172.21.15.83:0/2448515823 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7008075dd0 0x7f70081a09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:22.287 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:22.284+0000 7f700e274640 1 --2- 172.21.15.83:0/2448515823 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7008114450 0x7f70081a61f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:22.287 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:22.284+0000 7f700d272640 1 -- 172.21.15.83:0/2448515823 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7008075dd0 msgr2=0x7f70081a09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:22.287 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:22.284+0000 7f700d272640 1 --2- 172.21.15.83:0/2448515823 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7008075dd0 0x7f70081a09b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:22.287 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:22.284+0000 7f700d272640 1 -- 172.21.15.83:0/2448515823 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7008114450 msgr2=0x7f70081a61f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:22.287 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:22.284+0000 7f700d272640 1 --2- 172.21.15.83:0/2448515823 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7008114450 0x7f70081a61f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:22.287 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:22.284+0000 7f700d272640 1 -- 172.21.15.83:0/2448515823 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70081a6920 con 0x7f7008077380 2024-09-21T01:41:22.287 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:22.284+0000 7f700d272640 1 --2- 172.21.15.83:0/2448515823 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7008077380 0x7f70081a0f50 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f6ffc00c970 tx=0x7f6ffc00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:41:22.287 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:22.285+0000 7f7006ffd640 1 -- 172.21.15.83:0/2448515823 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ffc007bb0 con 0x7f7008077380 2024-09-21T01:41:22.287 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:22.285+0000 7f700fcd7640 1 -- 172.21.15.83:0/2448515823 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70081a6c10 con 0x7f7008077380 2024-09-21T01:41:22.288 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:22.285+0000 7f7006ffd640 1 -- 172.21.15.83:0/2448515823 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6ffc007d50 con 0x7f7008077380 2024-09-21T01:41:22.288 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:22.285+0000 7f700fcd7640 1 -- 172.21.15.83:0/2448515823 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70081ad370 con 0x7f7008077380 2024-09-21T01:41:22.288 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:22.285+0000 7f7006ffd640 1 -- 172.21.15.83:0/2448515823 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ffc004db0 con 0x7f7008077380 2024-09-21T01:41:22.288 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:22.286+0000 7f700fcd7640 1 -- 172.21.15.83:0/2448515823 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70080761e0 con 0x7f7008077380 2024-09-21T01:41:22.288 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:22.287+0000 7f7006ffd640 1 -- 172.21.15.83:0/2448515823 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7f6ffc005000 con 0x7f7008077380 2024-09-21T01:41:22.288 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:22.288+0000 7f7006ffd640 1 --2- 172.21.15.83:0/2448515823 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f6ff00b65f0 0x7f6ff00b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:22.289 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:22.288+0000 7f7006ffd640 1 -- 172.21.15.83:0/2448515823 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9315+0+0 (secure 0 0 0) 0x7f6ffc0e79e0 con 0x7f7008077380 2024-09-21T01:41:22.289 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:22.288+0000 7f700da73640 1 --2- 172.21.15.83:0/2448515823 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f6ff00b65f0 0x7f6ff00b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:22.289 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:22.288+0000 7f700da73640 1 --2- 172.21.15.83:0/2448515823 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f6ff00b65f0 0x7f6ff00b8b00 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f6ff8005fd0 tx=0x7f6ff8009680 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:41:22.291 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:22.291+0000 7f7006ffd640 1 -- 172.21.15.83:0/2448515823 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6ffc014030 con 0x7f7008077380 2024-09-21T01:41:22.467 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:22.465+0000 7f700fcd7640 1 -- 172.21.15.83:0/2448515823 --> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7008063800 con 0x7f6ff00b65f0 2024-09-21T01:41:22.472 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:22.471+0000 7f7006ffd640 1 -- 172.21.15.83:0/2448515823 <== mgr.14223 v2:172.21.15.83:6800/1748483157 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340514 (secure 0 0 0) 0x7f7008063800 con 0x7f6ff00b65f0 2024-09-21T01:41:22.476 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T01:41:22.477 INFO:teuthology.orchestra.run.smithi083.stderr:dumped all 2024-09-21T01:41:22.482 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:22.474+0000 7f700fcd7640 1 -- 172.21.15.83:0/2448515823 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f6ff00b65f0 msgr2=0x7f6ff00b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:22.482 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:22.474+0000 7f700fcd7640 1 --2- 172.21.15.83:0/2448515823 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f6ff00b65f0 0x7f6ff00b8b00 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f6ff8005fd0 tx=0x7f6ff8009680 comp rx=0 tx=0).stop 2024-09-21T01:41:22.483 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:22.474+0000 7f700fcd7640 1 -- 172.21.15.83:0/2448515823 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7008077380 msgr2=0x7f70081a0f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:22.483 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:22.474+0000 7f700fcd7640 1 --2- 172.21.15.83:0/2448515823 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7008077380 0x7f70081a0f50 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f6ffc00c970 tx=0x7f6ffc00ce30 comp rx=0 tx=0).stop 2024-09-21T01:41:22.483 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:22.474+0000 7f700fcd7640 1 -- 172.21.15.83:0/2448515823 shutdown_connections 2024-09-21T01:41:22.483 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:22.474+0000 7f700fcd7640 1 --2- 172.21.15.83:0/2448515823 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f6ff00b65f0 0x7f6ff00b8b00 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:22.483 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:22.474+0000 7f700fcd7640 1 --2- 172.21.15.83:0/2448515823 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7008114450 0x7f70081a61f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:22.483 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:22.474+0000 7f700fcd7640 1 --2- 172.21.15.83:0/2448515823 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7008077380 0x7f70081a0f50 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:22.483 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:22.474+0000 7f700fcd7640 1 --2- 172.21.15.83:0/2448515823 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7008075dd0 0x7f70081a09b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:22.483 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:22.474+0000 7f700fcd7640 1 -- 172.21.15.83:0/2448515823 >> 172.21.15.83:0/2448515823 conn(0x7f70080ff5d0 msgr2=0x7f7008110350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:41:22.483 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:22.474+0000 7f700fcd7640 1 -- 172.21.15.83:0/2448515823 shutdown_connections 2024-09-21T01:41:22.483 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:22.474+0000 7f700fcd7640 1 -- 172.21.15.83:0/2448515823 wait complete. 2024-09-21T01:41:23.204 INFO:teuthology.orchestra.run.smithi083.stdout:{"pg_ready":true,"pg_map":{"version":318,"stamp":"2024-09-21T01:41:20.782134+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":659047,"num_objects":26,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":200,"num_read_kb":197,"num_write":208,"num_write_kb":2247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":164,"ondisk_log_size":164,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":364752,"kb_used_data":11264,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124577072,"statfs":{"total":1151940427776,"available":1151566921728,"internally_reserved":0,"allocated":11534336,"data_stored":7895711,"data_compressed":461493,"data_compressed_allocated":626688,"data_compressed_original":2752512,"omap_allocated":19139,"internal_metadata":361674045},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":10,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.906279"},"pg_stats":[{"pgid":"2.1f","version":"74'4","reported_seq":44,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:09.877454+0000","last_change":"2024-09-21T01:39:42.267244+0000","last_active":"2024-09-21T01:41:09.877454+0000","last_peered":"2024-09-21T01:41:09.877454+0000","last_clean":"2024-09-21T01:41:09.877454+0000","last_became_active":"2024-09-21T01:39:42.266786+0000","last_became_peered":"2024-09-21T01:39:42.266786+0000","last_unstale":"2024-09-21T01:41:09.877454+0000","last_undegraded":"2024-09-21T01:41:09.877454+0000","last_fullsized":"2024-09-21T01:41:09.877454+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:50:43.594150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.504960+0000","last_change":"2024-09-21T01:39:44.292808+0000","last_active":"2024-09-21T01:41:10.504960+0000","last_peered":"2024-09-21T01:41:10.504960+0000","last_clean":"2024-09-21T01:41:10.504960+0000","last_became_active":"2024-09-21T01:39:44.292416+0000","last_became_peered":"2024-09-21T01:39:44.292416+0000","last_unstale":"2024-09-21T01:41:10.504960+0000","last_undegraded":"2024-09-21T01:41:10.504960+0000","last_fullsized":"2024-09-21T01:41:10.504960+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:26:16.332353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:09.880685+0000","last_change":"2024-09-21T01:39:51.339117+0000","last_active":"2024-09-21T01:41:09.880685+0000","last_peered":"2024-09-21T01:41:09.880685+0000","last_clean":"2024-09-21T01:41:09.880685+0000","last_became_active":"2024-09-21T01:39:51.338467+0000","last_became_peered":"2024-09-21T01:39:51.338467+0000","last_unstale":"2024-09-21T01:41:09.880685+0000","last_undegraded":"2024-09-21T01:41:09.880685+0000","last_fullsized":"2024-09-21T01:41:09.880685+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:18:57.119730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"74'1","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.505232+0000","last_change":"2024-09-21T01:39:42.550130+0000","last_active":"2024-09-21T01:41:10.505232+0000","last_peered":"2024-09-21T01:41:10.505232+0000","last_clean":"2024-09-21T01:41:10.505232+0000","last_became_active":"2024-09-21T01:39:42.549676+0000","last_became_peered":"2024-09-21T01:39:42.549676+0000","last_unstale":"2024-09-21T01:41:10.505232+0000","last_undegraded":"2024-09-21T01:41:10.505232+0000","last_fullsized":"2024-09-21T01:41:10.505232+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:33:59.954738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.506097+0000","last_change":"2024-09-21T01:39:44.293860+0000","last_active":"2024-09-21T01:41:10.506097+0000","last_peered":"2024-09-21T01:41:10.506097+0000","last_clean":"2024-09-21T01:41:10.506097+0000","last_became_active":"2024-09-21T01:39:44.293490+0000","last_became_peered":"2024-09-21T01:39:44.293490+0000","last_unstale":"2024-09-21T01:41:10.506097+0000","last_undegraded":"2024-09-21T01:41:10.506097+0000","last_fullsized":"2024-09-21T01:41:10.506097+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:58:18.325647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.504013+0000","last_change":"2024-09-21T01:39:51.335826+0000","last_active":"2024-09-21T01:41:10.504013+0000","last_peered":"2024-09-21T01:41:10.504013+0000","last_clean":"2024-09-21T01:41:10.504013+0000","last_became_active":"2024-09-21T01:39:51.335346+0000","last_became_peered":"2024-09-21T01:39:51.335346+0000","last_unstale":"2024-09-21T01:41:10.504013+0000","last_undegraded":"2024-09-21T01:41:10.504013+0000","last_fullsized":"2024-09-21T01:41:10.504013+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:51:25.921336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"74'2","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.503563+0000","last_change":"2024-09-21T01:39:42.270594+0000","last_active":"2024-09-21T01:41:10.503563+0000","last_peered":"2024-09-21T01:41:10.503563+0000","last_clean":"2024-09-21T01:41:10.503563+0000","last_became_active":"2024-09-21T01:39:42.270138+0000","last_became_peered":"2024-09-21T01:39:42.270138+0000","last_unstale":"2024-09-21T01:41:10.503563+0000","last_undegraded":"2024-09-21T01:41:10.503563+0000","last_fullsized":"2024-09-21T01:41:10.503563+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:05:00.604343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:09.971835+0000","last_change":"2024-09-21T01:39:44.294397+0000","last_active":"2024-09-21T01:41:09.971835+0000","last_peered":"2024-09-21T01:41:09.971835+0000","last_clean":"2024-09-21T01:41:09.971835+0000","last_became_active":"2024-09-21T01:39:44.293992+0000","last_became_peered":"2024-09-21T01:39:44.293992+0000","last_unstale":"2024-09-21T01:41:09.971835+0000","last_undegraded":"2024-09-21T01:41:09.971835+0000","last_fullsized":"2024-09-21T01:41:09.971835+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:52:09.459167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.504060+0000","last_change":"2024-09-21T01:39:51.338546+0000","last_active":"2024-09-21T01:41:10.504060+0000","last_peered":"2024-09-21T01:41:10.504060+0000","last_clean":"2024-09-21T01:41:10.504060+0000","last_became_active":"2024-09-21T01:39:51.337850+0000","last_became_peered":"2024-09-21T01:39:51.337850+0000","last_unstale":"2024-09-21T01:41:10.504060+0000","last_undegraded":"2024-09-21T01:41:10.504060+0000","last_fullsized":"2024-09-21T01:41:10.504060+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:33:49.497520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"74'2","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.503562+0000","last_change":"2024-09-21T01:39:42.264214+0000","last_active":"2024-09-21T01:41:10.503562+0000","last_peered":"2024-09-21T01:41:10.503562+0000","last_clean":"2024-09-21T01:41:10.503562+0000","last_became_active":"2024-09-21T01:39:42.263782+0000","last_became_peered":"2024-09-21T01:39:42.263782+0000","last_unstale":"2024-09-21T01:41:10.503562+0000","last_undegraded":"2024-09-21T01:41:10.503562+0000","last_fullsized":"2024-09-21T01:41:10.503562+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:44:24.965078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.044623+0000","last_change":"2024-09-21T01:39:44.296579+0000","last_active":"2024-09-21T01:41:10.044623+0000","last_peered":"2024-09-21T01:41:10.044623+0000","last_clean":"2024-09-21T01:41:10.044623+0000","last_became_active":"2024-09-21T01:39:44.296175+0000","last_became_peered":"2024-09-21T01:39:44.296175+0000","last_unstale":"2024-09-21T01:41:10.044623+0000","last_undegraded":"2024-09-21T01:41:10.044623+0000","last_fullsized":"2024-09-21T01:41:10.044623+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:11:13.920000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.504011+0000","last_change":"2024-09-21T01:39:51.339046+0000","last_active":"2024-09-21T01:41:10.504011+0000","last_peered":"2024-09-21T01:41:10.504011+0000","last_clean":"2024-09-21T01:41:10.504011+0000","last_became_active":"2024-09-21T01:39:51.337379+0000","last_became_peered":"2024-09-21T01:39:51.337379+0000","last_unstale":"2024-09-21T01:41:10.504011+0000","last_undegraded":"2024-09-21T01:41:10.504011+0000","last_fullsized":"2024-09-21T01:41:10.504011+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:50:34.321615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:09.878400+0000","last_change":"2024-09-21T01:39:44.296849+0000","last_active":"2024-09-21T01:41:09.878400+0000","last_peered":"2024-09-21T01:41:09.878400+0000","last_clean":"2024-09-21T01:41:09.878400+0000","last_became_active":"2024-09-21T01:39:44.296460+0000","last_became_peered":"2024-09-21T01:39:44.296460+0000","last_unstale":"2024-09-21T01:41:09.878400+0000","last_undegraded":"2024-09-21T01:41:09.878400+0000","last_fullsized":"2024-09-21T01:41:09.878400+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:46:51.258576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"74'2","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.947238+0000","last_change":"2024-09-21T01:40:09.842127+0000","last_active":"2024-09-21T01:41:10.947238+0000","last_peered":"2024-09-21T01:41:10.947238+0000","last_clean":"2024-09-21T01:41:10.947238+0000","last_became_active":"2024-09-21T01:40:09.835330+0000","last_became_peered":"2024-09-21T01:40:09.835330+0000","last_unstale":"2024-09-21T01:41:10.947238+0000","last_undegraded":"2024-09-21T01:41:10.947238+0000","last_fullsized":"2024-09-21T01:41:10.947238+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:54:07.455805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.504140+0000","last_change":"2024-09-21T01:39:51.459595+0000","last_active":"2024-09-21T01:41:10.504140+0000","last_peered":"2024-09-21T01:41:10.504140+0000","last_clean":"2024-09-21T01:41:10.504140+0000","last_became_active":"2024-09-21T01:39:51.459137+0000","last_became_peered":"2024-09-21T01:39:51.459137+0000","last_unstale":"2024-09-21T01:41:10.504140+0000","last_undegraded":"2024-09-21T01:41:10.504140+0000","last_fullsized":"2024-09-21T01:41:10.504140+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:55:53.800615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.505743+0000","last_change":"2024-09-21T01:39:44.288328+0000","last_active":"2024-09-21T01:41:10.505743+0000","last_peered":"2024-09-21T01:41:10.505743+0000","last_clean":"2024-09-21T01:41:10.505743+0000","last_became_active":"2024-09-21T01:39:44.287994+0000","last_became_peered":"2024-09-21T01:39:44.287994+0000","last_unstale":"2024-09-21T01:41:10.505743+0000","last_undegraded":"2024-09-21T01:41:10.505743+0000","last_fullsized":"2024-09-21T01:41:10.505743+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:44:55.075693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:09.880786+0000","last_change":"2024-09-21T01:39:42.266271+0000","last_active":"2024-09-21T01:41:09.880786+0000","last_peered":"2024-09-21T01:41:09.880786+0000","last_clean":"2024-09-21T01:41:09.880786+0000","last_became_active":"2024-09-21T01:39:42.265904+0000","last_became_peered":"2024-09-21T01:39:42.265904+0000","last_unstale":"2024-09-21T01:41:09.880786+0000","last_undegraded":"2024-09-21T01:41:09.880786+0000","last_fullsized":"2024-09-21T01:41:09.880786+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:43:37.456263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"82'1","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.504229+0000","last_change":"2024-09-21T01:39:51.336649+0000","last_active":"2024-09-21T01:41:10.504229+0000","last_peered":"2024-09-21T01:41:10.504229+0000","last_clean":"2024-09-21T01:41:10.504229+0000","last_became_active":"2024-09-21T01:39:51.336153+0000","last_became_peered":"2024-09-21T01:39:51.336153+0000","last_unstale":"2024-09-21T01:41:10.504229+0000","last_undegraded":"2024-09-21T01:41:10.504229+0000","last_fullsized":"2024-09-21T01:41:10.504229+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:56:58.699051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.947388+0000","last_change":"2024-09-21T01:39:44.304919+0000","last_active":"2024-09-21T01:41:10.947388+0000","last_peered":"2024-09-21T01:41:10.947388+0000","last_clean":"2024-09-21T01:41:10.947388+0000","last_became_active":"2024-09-21T01:39:44.304509+0000","last_became_peered":"2024-09-21T01:39:44.304509+0000","last_unstale":"2024-09-21T01:41:10.947388+0000","last_undegraded":"2024-09-21T01:41:10.947388+0000","last_fullsized":"2024-09-21T01:41:10.947388+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:57:04.413151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.505524+0000","last_change":"2024-09-21T01:39:42.262536+0000","last_active":"2024-09-21T01:41:10.505524+0000","last_peered":"2024-09-21T01:41:10.505524+0000","last_clean":"2024-09-21T01:41:10.505524+0000","last_became_active":"2024-09-21T01:39:42.262179+0000","last_became_peered":"2024-09-21T01:39:42.262179+0000","last_unstale":"2024-09-21T01:41:10.505524+0000","last_undegraded":"2024-09-21T01:41:10.505524+0000","last_fullsized":"2024-09-21T01:41:10.505524+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:35:14.022839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:09.877283+0000","last_change":"2024-09-21T01:39:51.339664+0000","last_active":"2024-09-21T01:41:09.877283+0000","last_peered":"2024-09-21T01:41:09.877283+0000","last_clean":"2024-09-21T01:41:09.877283+0000","last_became_active":"2024-09-21T01:39:51.339140+0000","last_became_peered":"2024-09-21T01:39:51.339140+0000","last_unstale":"2024-09-21T01:41:09.877283+0000","last_undegraded":"2024-09-21T01:41:09.877283+0000","last_fullsized":"2024-09-21T01:41:09.877283+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:46:49.443937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.503941+0000","last_change":"2024-09-21T01:39:44.299174+0000","last_active":"2024-09-21T01:41:10.503941+0000","last_peered":"2024-09-21T01:41:10.503941+0000","last_clean":"2024-09-21T01:41:10.503941+0000","last_became_active":"2024-09-21T01:39:44.298778+0000","last_became_peered":"2024-09-21T01:39:44.298778+0000","last_unstale":"2024-09-21T01:41:10.503941+0000","last_undegraded":"2024-09-21T01:41:10.503941+0000","last_fullsized":"2024-09-21T01:41:10.503941+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:59:17.298726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":38,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:09.971615+0000","last_change":"2024-09-21T01:39:42.550521+0000","last_active":"2024-09-21T01:41:09.971615+0000","last_peered":"2024-09-21T01:41:09.971615+0000","last_clean":"2024-09-21T01:41:09.971615+0000","last_became_active":"2024-09-21T01:39:42.550210+0000","last_became_peered":"2024-09-21T01:39:42.550210+0000","last_unstale":"2024-09-21T01:41:09.971615+0000","last_undegraded":"2024-09-21T01:41:09.971615+0000","last_fullsized":"2024-09-21T01:41:09.971615+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:07:07.234815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.504302+0000","last_change":"2024-09-21T01:39:51.461448+0000","last_active":"2024-09-21T01:41:10.504302+0000","last_peered":"2024-09-21T01:41:10.504302+0000","last_clean":"2024-09-21T01:41:10.504302+0000","last_became_active":"2024-09-21T01:39:51.460790+0000","last_became_peered":"2024-09-21T01:39:51.460790+0000","last_unstale":"2024-09-21T01:41:10.504302+0000","last_undegraded":"2024-09-21T01:41:10.504302+0000","last_fullsized":"2024-09-21T01:41:10.504302+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:30:35.032588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.506005+0000","last_change":"2024-09-21T01:39:44.298697+0000","last_active":"2024-09-21T01:41:10.506005+0000","last_peered":"2024-09-21T01:41:10.506005+0000","last_clean":"2024-09-21T01:41:10.506005+0000","last_became_active":"2024-09-21T01:39:44.298333+0000","last_became_peered":"2024-09-21T01:39:44.298333+0000","last_unstale":"2024-09-21T01:41:10.506005+0000","last_undegraded":"2024-09-21T01:41:10.506005+0000","last_fullsized":"2024-09-21T01:41:10.506005+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:36:01.932630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"74'2","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.504671+0000","last_change":"2024-09-21T01:39:42.257383+0000","last_active":"2024-09-21T01:41:10.504671+0000","last_peered":"2024-09-21T01:41:10.504671+0000","last_clean":"2024-09-21T01:41:10.504671+0000","last_became_active":"2024-09-21T01:39:42.256896+0000","last_became_peered":"2024-09-21T01:39:42.256896+0000","last_unstale":"2024-09-21T01:41:10.504671+0000","last_undegraded":"2024-09-21T01:41:10.504671+0000","last_fullsized":"2024-09-21T01:41:10.504671+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:03:29.350623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:09.880821+0000","last_change":"2024-09-21T01:39:51.342055+0000","last_active":"2024-09-21T01:41:09.880821+0000","last_peered":"2024-09-21T01:41:09.880821+0000","last_clean":"2024-09-21T01:41:09.880821+0000","last_became_active":"2024-09-21T01:39:51.341602+0000","last_became_peered":"2024-09-21T01:39:51.341602+0000","last_unstale":"2024-09-21T01:41:09.880821+0000","last_undegraded":"2024-09-21T01:41:09.880821+0000","last_fullsized":"2024-09-21T01:41:09.880821+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:30:58.290018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.505600+0000","last_change":"2024-09-21T01:39:44.296725+0000","last_active":"2024-09-21T01:41:10.505600+0000","last_peered":"2024-09-21T01:41:10.505600+0000","last_clean":"2024-09-21T01:41:10.505600+0000","last_became_active":"2024-09-21T01:39:44.296411+0000","last_became_peered":"2024-09-21T01:39:44.296411+0000","last_unstale":"2024-09-21T01:41:10.505600+0000","last_undegraded":"2024-09-21T01:41:10.505600+0000","last_fullsized":"2024-09-21T01:41:10.505600+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:58:05.357486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"82'8","reported_seq":47,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:09.877361+0000","last_change":"2024-09-21T01:39:42.262831+0000","last_active":"2024-09-21T01:41:09.877361+0000","last_peered":"2024-09-21T01:41:09.877361+0000","last_clean":"2024-09-21T01:41:09.877361+0000","last_became_active":"2024-09-21T01:39:42.262462+0000","last_became_peered":"2024-09-21T01:39:42.262462+0000","last_unstale":"2024-09-21T01:41:09.877361+0000","last_undegraded":"2024-09-21T01:41:09.877361+0000","last_fullsized":"2024-09-21T01:41:09.877361+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:01:24.950607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.505213+0000","last_change":"2024-09-21T01:39:51.460620+0000","last_active":"2024-09-21T01:41:10.505213+0000","last_peered":"2024-09-21T01:41:10.505213+0000","last_clean":"2024-09-21T01:41:10.505213+0000","last_became_active":"2024-09-21T01:39:51.460052+0000","last_became_peered":"2024-09-21T01:39:51.460052+0000","last_unstale":"2024-09-21T01:41:10.505213+0000","last_undegraded":"2024-09-21T01:41:10.505213+0000","last_fullsized":"2024-09-21T01:41:10.505213+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:23:23.284102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.504691+0000","last_change":"2024-09-21T01:39:44.293129+0000","last_active":"2024-09-21T01:41:10.504691+0000","last_peered":"2024-09-21T01:41:10.504691+0000","last_clean":"2024-09-21T01:41:10.504691+0000","last_became_active":"2024-09-21T01:39:44.292799+0000","last_became_peered":"2024-09-21T01:39:44.292799+0000","last_unstale":"2024-09-21T01:41:10.504691+0000","last_undegraded":"2024-09-21T01:41:10.504691+0000","last_fullsized":"2024-09-21T01:41:10.504691+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:05:22.484632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.504403+0000","last_change":"2024-09-21T01:39:42.550724+0000","last_active":"2024-09-21T01:41:10.504403+0000","last_peered":"2024-09-21T01:41:10.504403+0000","last_clean":"2024-09-21T01:41:10.504403+0000","last_became_active":"2024-09-21T01:39:42.550334+0000","last_became_peered":"2024-09-21T01:39:42.550334+0000","last_unstale":"2024-09-21T01:41:10.504403+0000","last_undegraded":"2024-09-21T01:41:10.504403+0000","last_fullsized":"2024-09-21T01:41:10.504403+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:15:49.484663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.947380+0000","last_change":"2024-09-21T01:40:09.838305+0000","last_active":"2024-09-21T01:41:10.947380+0000","last_peered":"2024-09-21T01:41:10.947380+0000","last_clean":"2024-09-21T01:41:10.947380+0000","last_became_active":"2024-09-21T01:40:09.837734+0000","last_became_peered":"2024-09-21T01:40:09.837734+0000","last_unstale":"2024-09-21T01:41:10.947380+0000","last_undegraded":"2024-09-21T01:41:10.947380+0000","last_fullsized":"2024-09-21T01:41:10.947380+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:38:44.066723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,7,6],"acting":[11,8,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.040973+0000","last_change":"2024-09-21T01:39:44.292039+0000","last_active":"2024-09-21T01:41:10.040973+0000","last_peered":"2024-09-21T01:41:10.040973+0000","last_clean":"2024-09-21T01:41:10.040973+0000","last_became_active":"2024-09-21T01:39:44.291640+0000","last_became_peered":"2024-09-21T01:39:44.291640+0000","last_unstale":"2024-09-21T01:41:10.040973+0000","last_undegraded":"2024-09-21T01:41:10.040973+0000","last_fullsized":"2024-09-21T01:41:10.040973+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:24:59.891664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":46,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:09.877144+0000","last_change":"2024-09-21T01:40:10.063162+0000","last_active":"2024-09-21T01:41:09.877144+0000","last_peered":"2024-09-21T01:41:09.877144+0000","last_clean":"2024-09-21T01:41:09.877144+0000","last_became_active":"2024-09-21T01:40:10.062703+0000","last_became_peered":"2024-09-21T01:40:10.062703+0000","last_unstale":"2024-09-21T01:41:09.877144+0000","last_undegraded":"2024-09-21T01:41:09.877144+0000","last_fullsized":"2024-09-21T01:41:09.877144+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:32:04.933701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.504070+0000","last_change":"2024-09-21T01:39:51.460023+0000","last_active":"2024-09-21T01:41:10.504070+0000","last_peered":"2024-09-21T01:41:10.504070+0000","last_clean":"2024-09-21T01:41:10.504070+0000","last_became_active":"2024-09-21T01:39:51.459417+0000","last_became_peered":"2024-09-21T01:39:51.459417+0000","last_unstale":"2024-09-21T01:41:10.504070+0000","last_undegraded":"2024-09-21T01:41:10.504070+0000","last_fullsized":"2024-09-21T01:41:10.504070+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:54:24.301176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.040859+0000","last_change":"2024-09-21T01:39:44.295559+0000","last_active":"2024-09-21T01:41:10.040859+0000","last_peered":"2024-09-21T01:41:10.040859+0000","last_clean":"2024-09-21T01:41:10.040859+0000","last_became_active":"2024-09-21T01:39:44.294970+0000","last_became_peered":"2024-09-21T01:39:44.294970+0000","last_unstale":"2024-09-21T01:41:10.040859+0000","last_undegraded":"2024-09-21T01:41:10.040859+0000","last_fullsized":"2024-09-21T01:41:10.040859+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:46:16.582188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:09.878542+0000","last_change":"2024-09-21T01:39:42.269453+0000","last_active":"2024-09-21T01:41:09.878542+0000","last_peered":"2024-09-21T01:41:09.878542+0000","last_clean":"2024-09-21T01:41:09.878542+0000","last_became_active":"2024-09-21T01:39:42.269039+0000","last_became_peered":"2024-09-21T01:39:42.269039+0000","last_unstale":"2024-09-21T01:41:09.878542+0000","last_undegraded":"2024-09-21T01:41:09.878542+0000","last_fullsized":"2024-09-21T01:41:09.878542+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:47:29.053966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.504426+0000","last_change":"2024-09-21T01:39:51.337305+0000","last_active":"2024-09-21T01:41:10.504426+0000","last_peered":"2024-09-21T01:41:10.504426+0000","last_clean":"2024-09-21T01:41:10.504426+0000","last_became_active":"2024-09-21T01:39:51.336710+0000","last_became_peered":"2024-09-21T01:39:51.336710+0000","last_unstale":"2024-09-21T01:41:10.504426+0000","last_undegraded":"2024-09-21T01:41:10.504426+0000","last_fullsized":"2024-09-21T01:41:10.504426+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:13:42.333881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.044018+0000","last_change":"2024-09-21T01:39:44.297004+0000","last_active":"2024-09-21T01:41:10.044018+0000","last_peered":"2024-09-21T01:41:10.044018+0000","last_clean":"2024-09-21T01:41:10.044018+0000","last_became_active":"2024-09-21T01:39:44.296596+0000","last_became_peered":"2024-09-21T01:39:44.296596+0000","last_unstale":"2024-09-21T01:41:10.044018+0000","last_undegraded":"2024-09-21T01:41:10.044018+0000","last_fullsized":"2024-09-21T01:41:10.044018+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:14:32.542823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.503854+0000","last_change":"2024-09-21T01:39:42.550024+0000","last_active":"2024-09-21T01:41:10.503854+0000","last_peered":"2024-09-21T01:41:10.503854+0000","last_clean":"2024-09-21T01:41:10.503854+0000","last_became_active":"2024-09-21T01:39:42.549638+0000","last_became_peered":"2024-09-21T01:39:42.549638+0000","last_unstale":"2024-09-21T01:41:10.503854+0000","last_undegraded":"2024-09-21T01:41:10.503854+0000","last_fullsized":"2024-09-21T01:41:10.503854+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:23:39.210460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.505020+0000","last_change":"2024-09-21T01:39:51.459459+0000","last_active":"2024-09-21T01:41:10.505020+0000","last_peered":"2024-09-21T01:41:10.505020+0000","last_clean":"2024-09-21T01:41:10.505020+0000","last_became_active":"2024-09-21T01:39:51.459020+0000","last_became_peered":"2024-09-21T01:39:51.459020+0000","last_unstale":"2024-09-21T01:41:10.505020+0000","last_undegraded":"2024-09-21T01:41:10.505020+0000","last_fullsized":"2024-09-21T01:41:10.505020+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:50:08.337949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.504101+0000","last_change":"2024-09-21T01:40:09.833943+0000","last_active":"2024-09-21T01:41:10.504101+0000","last_peered":"2024-09-21T01:41:10.504101+0000","last_clean":"2024-09-21T01:41:10.504101+0000","last_became_active":"2024-09-21T01:40:09.833486+0000","last_became_peered":"2024-09-21T01:40:09.833486+0000","last_unstale":"2024-09-21T01:41:10.504101+0000","last_undegraded":"2024-09-21T01:41:10.504101+0000","last_fullsized":"2024-09-21T01:41:10.504101+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:26:52.751330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,2],"acting":[6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:09.878244+0000","last_change":"2024-09-21T01:39:42.267329+0000","last_active":"2024-09-21T01:41:09.878244+0000","last_peered":"2024-09-21T01:41:09.878244+0000","last_clean":"2024-09-21T01:41:09.878244+0000","last_became_active":"2024-09-21T01:39:42.266386+0000","last_became_peered":"2024-09-21T01:39:42.266386+0000","last_unstale":"2024-09-21T01:41:09.878244+0000","last_undegraded":"2024-09-21T01:41:09.878244+0000","last_fullsized":"2024-09-21T01:41:09.878244+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:31:20.877627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.044656+0000","last_change":"2024-09-21T01:39:51.461494+0000","last_active":"2024-09-21T01:41:10.044656+0000","last_peered":"2024-09-21T01:41:10.044656+0000","last_clean":"2024-09-21T01:41:10.044656+0000","last_became_active":"2024-09-21T01:39:51.460973+0000","last_became_peered":"2024-09-21T01:39:51.460973+0000","last_unstale":"2024-09-21T01:41:10.044656+0000","last_undegraded":"2024-09-21T01:41:10.044656+0000","last_fullsized":"2024-09-21T01:41:10.044656+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:09:50.319546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.504229+0000","last_change":"2024-09-21T01:39:44.300773+0000","last_active":"2024-09-21T01:41:10.504229+0000","last_peered":"2024-09-21T01:41:10.504229+0000","last_clean":"2024-09-21T01:41:10.504229+0000","last_became_active":"2024-09-21T01:39:44.300437+0000","last_became_peered":"2024-09-21T01:39:44.300437+0000","last_unstale":"2024-09-21T01:41:10.504229+0000","last_undegraded":"2024-09-21T01:41:10.504229+0000","last_fullsized":"2024-09-21T01:41:10.504229+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:06:34.171621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.503820+0000","last_change":"2024-09-21T01:39:42.262675+0000","last_active":"2024-09-21T01:41:10.503820+0000","last_peered":"2024-09-21T01:41:10.503820+0000","last_clean":"2024-09-21T01:41:10.503820+0000","last_became_active":"2024-09-21T01:39:42.262282+0000","last_became_peered":"2024-09-21T01:39:42.262282+0000","last_unstale":"2024-09-21T01:41:10.503820+0000","last_undegraded":"2024-09-21T01:41:10.503820+0000","last_fullsized":"2024-09-21T01:41:10.503820+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:26:01.595797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":114,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:09.878450+0000","last_change":"2024-09-21T01:38:31.172876+0000","last_active":"2024-09-21T01:41:09.878450+0000","last_peered":"2024-09-21T01:41:09.878450+0000","last_clean":"2024-09-21T01:41:09.878450+0000","last_became_active":"2024-09-21T01:38:31.167071+0000","last_became_peered":"2024-09-21T01:38:31.167071+0000","last_unstale":"2024-09-21T01:41:09.878450+0000","last_undegraded":"2024-09-21T01:41:09.878450+0000","last_fullsized":"2024-09-21T01:41:09.878450+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:35:07.475056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:35:07.475056+0000","last_clean_scrub_stamp":"2024-09-21T01:35:07.475056+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:56:01.878445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"82'1","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:09.878719+0000","last_change":"2024-09-21T01:39:51.338198+0000","last_active":"2024-09-21T01:41:09.878719+0000","last_peered":"2024-09-21T01:41:09.878719+0000","last_clean":"2024-09-21T01:41:09.878719+0000","last_became_active":"2024-09-21T01:39:51.337743+0000","last_became_peered":"2024-09-21T01:39:51.337743+0000","last_unstale":"2024-09-21T01:41:09.878719+0000","last_undegraded":"2024-09-21T01:41:09.878719+0000","last_fullsized":"2024-09-21T01:41:09.878719+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:19:45.552819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:09.878937+0000","last_change":"2024-09-21T01:39:44.298920+0000","last_active":"2024-09-21T01:41:09.878937+0000","last_peered":"2024-09-21T01:41:09.878937+0000","last_clean":"2024-09-21T01:41:09.878937+0000","last_became_active":"2024-09-21T01:39:44.298381+0000","last_became_peered":"2024-09-21T01:39:44.298381+0000","last_unstale":"2024-09-21T01:41:09.878937+0000","last_undegraded":"2024-09-21T01:41:09.878937+0000","last_fullsized":"2024-09-21T01:41:09.878937+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:12:53.681514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:09.881301+0000","last_change":"2024-09-21T01:39:42.550808+0000","last_active":"2024-09-21T01:41:09.881301+0000","last_peered":"2024-09-21T01:41:09.881301+0000","last_clean":"2024-09-21T01:41:09.881301+0000","last_became_active":"2024-09-21T01:39:42.550447+0000","last_became_peered":"2024-09-21T01:39:42.550447+0000","last_unstale":"2024-09-21T01:41:09.881301+0000","last_undegraded":"2024-09-21T01:41:09.881301+0000","last_fullsized":"2024-09-21T01:41:09.881301+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:20:56.996378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:09.971547+0000","last_change":"2024-09-21T01:39:51.338490+0000","last_active":"2024-09-21T01:41:09.971547+0000","last_peered":"2024-09-21T01:41:09.971547+0000","last_clean":"2024-09-21T01:41:09.971547+0000","last_became_active":"2024-09-21T01:39:51.338050+0000","last_became_peered":"2024-09-21T01:39:51.338050+0000","last_unstale":"2024-09-21T01:41:09.971547+0000","last_undegraded":"2024-09-21T01:41:09.971547+0000","last_fullsized":"2024-09-21T01:41:09.971547+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:49:56.705893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.045927+0000","last_change":"2024-09-21T01:41:10.045808+0000","last_active":"2024-09-21T01:41:10.045927+0000","last_peered":"2024-09-21T01:41:10.045927+0000","last_clean":"2024-09-21T01:41:10.045927+0000","last_became_active":"2024-09-21T01:41:10.045403+0000","last_became_peered":"2024-09-21T01:41:10.045403+0000","last_unstale":"2024-09-21T01:41:10.045927+0000","last_undegraded":"2024-09-21T01:41:10.045927+0000","last_fullsized":"2024-09-21T01:41:10.045927+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:15:46.067941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"74'1","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.044786+0000","last_change":"2024-09-21T01:39:42.270124+0000","last_active":"2024-09-21T01:41:10.044786+0000","last_peered":"2024-09-21T01:41:10.044786+0000","last_clean":"2024-09-21T01:41:10.044786+0000","last_became_active":"2024-09-21T01:39:42.269435+0000","last_became_peered":"2024-09-21T01:39:42.269435+0000","last_unstale":"2024-09-21T01:41:10.044786+0000","last_undegraded":"2024-09-21T01:41:10.044786+0000","last_fullsized":"2024-09-21T01:41:10.044786+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:12:08.374394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.504493+0000","last_change":"2024-09-21T01:39:51.334459+0000","last_active":"2024-09-21T01:41:10.504493+0000","last_peered":"2024-09-21T01:41:10.504493+0000","last_clean":"2024-09-21T01:41:10.504493+0000","last_became_active":"2024-09-21T01:39:51.334039+0000","last_became_peered":"2024-09-21T01:39:51.334039+0000","last_unstale":"2024-09-21T01:41:10.504493+0000","last_undegraded":"2024-09-21T01:41:10.504493+0000","last_fullsized":"2024-09-21T01:41:10.504493+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:04:44.906648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:09.878858+0000","last_change":"2024-09-21T01:39:44.298467+0000","last_active":"2024-09-21T01:41:09.878858+0000","last_peered":"2024-09-21T01:41:09.878858+0000","last_clean":"2024-09-21T01:41:09.878858+0000","last_became_active":"2024-09-21T01:39:44.298128+0000","last_became_peered":"2024-09-21T01:39:44.298128+0000","last_unstale":"2024-09-21T01:41:09.878858+0000","last_undegraded":"2024-09-21T01:41:09.878858+0000","last_fullsized":"2024-09-21T01:41:09.878858+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:54:11.096417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"74'2","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.503716+0000","last_change":"2024-09-21T01:39:42.262761+0000","last_active":"2024-09-21T01:41:10.503716+0000","last_peered":"2024-09-21T01:41:10.503716+0000","last_clean":"2024-09-21T01:41:10.503716+0000","last_became_active":"2024-09-21T01:39:42.262428+0000","last_became_peered":"2024-09-21T01:39:42.262428+0000","last_unstale":"2024-09-21T01:41:10.503716+0000","last_undegraded":"2024-09-21T01:41:10.503716+0000","last_fullsized":"2024-09-21T01:41:10.503716+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:11:50.326638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.043807+0000","last_change":"2024-09-21T01:39:51.344320+0000","last_active":"2024-09-21T01:41:10.043807+0000","last_peered":"2024-09-21T01:41:10.043807+0000","last_clean":"2024-09-21T01:41:10.043807+0000","last_became_active":"2024-09-21T01:39:51.343902+0000","last_became_peered":"2024-09-21T01:39:51.343902+0000","last_unstale":"2024-09-21T01:41:10.043807+0000","last_undegraded":"2024-09-21T01:41:10.043807+0000","last_fullsized":"2024-09-21T01:41:10.043807+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:13:36.139159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.947491+0000","last_change":"2024-09-21T01:40:09.837769+0000","last_active":"2024-09-21T01:41:10.947491+0000","last_peered":"2024-09-21T01:41:10.947491+0000","last_clean":"2024-09-21T01:41:10.947491+0000","last_became_active":"2024-09-21T01:40:09.837296+0000","last_became_peered":"2024-09-21T01:40:09.837296+0000","last_unstale":"2024-09-21T01:41:10.947491+0000","last_undegraded":"2024-09-21T01:41:10.947491+0000","last_fullsized":"2024-09-21T01:41:10.947491+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:37:20.360076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"74'1","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.503693+0000","last_change":"2024-09-21T01:39:42.264955+0000","last_active":"2024-09-21T01:41:10.503693+0000","last_peered":"2024-09-21T01:41:10.503693+0000","last_clean":"2024-09-21T01:41:10.503693+0000","last_became_active":"2024-09-21T01:39:42.264492+0000","last_became_peered":"2024-09-21T01:39:42.264492+0000","last_unstale":"2024-09-21T01:41:10.503693+0000","last_undegraded":"2024-09-21T01:41:10.503693+0000","last_fullsized":"2024-09-21T01:41:10.503693+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:17:38.631521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.044021+0000","last_change":"2024-09-21T01:39:51.337908+0000","last_active":"2024-09-21T01:41:10.044021+0000","last_peered":"2024-09-21T01:41:10.044021+0000","last_clean":"2024-09-21T01:41:10.044021+0000","last_became_active":"2024-09-21T01:39:51.337200+0000","last_became_peered":"2024-09-21T01:39:51.337200+0000","last_unstale":"2024-09-21T01:41:10.044021+0000","last_undegraded":"2024-09-21T01:41:10.044021+0000","last_fullsized":"2024-09-21T01:41:10.044021+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:07:18.505959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.044300+0000","last_change":"2024-09-21T01:40:10.063539+0000","last_active":"2024-09-21T01:41:10.044300+0000","last_peered":"2024-09-21T01:41:10.044300+0000","last_clean":"2024-09-21T01:41:10.044300+0000","last_became_active":"2024-09-21T01:40:10.062966+0000","last_became_peered":"2024-09-21T01:40:10.062966+0000","last_unstale":"2024-09-21T01:41:10.044300+0000","last_undegraded":"2024-09-21T01:41:10.044300+0000","last_fullsized":"2024-09-21T01:41:10.044300+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:53:20.747493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,1],"acting":[5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"74'8","reported_seq":47,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.503907+0000","last_change":"2024-09-21T01:39:42.550795+0000","last_active":"2024-09-21T01:41:10.503907+0000","last_peered":"2024-09-21T01:41:10.503907+0000","last_clean":"2024-09-21T01:41:10.503907+0000","last_became_active":"2024-09-21T01:39:42.550424+0000","last_became_peered":"2024-09-21T01:39:42.550424+0000","last_unstale":"2024-09-21T01:41:10.503907+0000","last_undegraded":"2024-09-21T01:41:10.503907+0000","last_fullsized":"2024-09-21T01:41:10.503907+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:50:53.421080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.504489+0000","last_change":"2024-09-21T01:39:51.335239+0000","last_active":"2024-09-21T01:41:10.504489+0000","last_peered":"2024-09-21T01:41:10.504489+0000","last_clean":"2024-09-21T01:41:10.504489+0000","last_became_active":"2024-09-21T01:39:51.334846+0000","last_became_peered":"2024-09-21T01:39:51.334846+0000","last_unstale":"2024-09-21T01:41:10.504489+0000","last_undegraded":"2024-09-21T01:41:10.504489+0000","last_fullsized":"2024-09-21T01:41:10.504489+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:47:30.820219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:09.878150+0000","last_change":"2024-09-21T01:39:44.296080+0000","last_active":"2024-09-21T01:41:09.878150+0000","last_peered":"2024-09-21T01:41:09.878150+0000","last_clean":"2024-09-21T01:41:09.878150+0000","last_became_active":"2024-09-21T01:39:44.295724+0000","last_became_peered":"2024-09-21T01:39:44.295724+0000","last_unstale":"2024-09-21T01:41:09.878150+0000","last_undegraded":"2024-09-21T01:41:09.878150+0000","last_fullsized":"2024-09-21T01:41:09.878150+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:20:56.366350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.503820+0000","last_change":"2024-09-21T01:39:42.264499+0000","last_active":"2024-09-21T01:41:10.503820+0000","last_peered":"2024-09-21T01:41:10.503820+0000","last_clean":"2024-09-21T01:41:10.503820+0000","last_became_active":"2024-09-21T01:39:42.264059+0000","last_became_peered":"2024-09-21T01:39:42.264059+0000","last_unstale":"2024-09-21T01:41:10.503820+0000","last_undegraded":"2024-09-21T01:41:10.503820+0000","last_fullsized":"2024-09-21T01:41:10.503820+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:27:42.970693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:09.877344+0000","last_change":"2024-09-21T01:39:51.329357+0000","last_active":"2024-09-21T01:41:09.877344+0000","last_peered":"2024-09-21T01:41:09.877344+0000","last_clean":"2024-09-21T01:41:09.877344+0000","last_became_active":"2024-09-21T01:39:51.328761+0000","last_became_peered":"2024-09-21T01:39:51.328761+0000","last_unstale":"2024-09-21T01:41:09.877344+0000","last_undegraded":"2024-09-21T01:41:09.877344+0000","last_fullsized":"2024-09-21T01:41:09.877344+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:48:04.089765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:09.878573+0000","last_change":"2024-09-21T01:39:44.295799+0000","last_active":"2024-09-21T01:41:09.878573+0000","last_peered":"2024-09-21T01:41:09.878573+0000","last_clean":"2024-09-21T01:41:09.878573+0000","last_became_active":"2024-09-21T01:39:44.295432+0000","last_became_peered":"2024-09-21T01:39:44.295432+0000","last_unstale":"2024-09-21T01:41:09.878573+0000","last_undegraded":"2024-09-21T01:41:09.878573+0000","last_fullsized":"2024-09-21T01:41:09.878573+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:18:10.702545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.044394+0000","last_change":"2024-09-21T01:39:42.270552+0000","last_active":"2024-09-21T01:41:10.044394+0000","last_peered":"2024-09-21T01:41:10.044394+0000","last_clean":"2024-09-21T01:41:10.044394+0000","last_became_active":"2024-09-21T01:39:42.270158+0000","last_became_peered":"2024-09-21T01:39:42.270158+0000","last_unstale":"2024-09-21T01:41:10.044394+0000","last_undegraded":"2024-09-21T01:41:10.044394+0000","last_fullsized":"2024-09-21T01:41:10.044394+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:19:52.229598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.947461+0000","last_change":"2024-09-21T01:39:51.335823+0000","last_active":"2024-09-21T01:41:10.947461+0000","last_peered":"2024-09-21T01:41:10.947461+0000","last_clean":"2024-09-21T01:41:10.947461+0000","last_became_active":"2024-09-21T01:39:51.335363+0000","last_became_peered":"2024-09-21T01:39:51.335363+0000","last_unstale":"2024-09-21T01:41:10.947461+0000","last_undegraded":"2024-09-21T01:41:10.947461+0000","last_fullsized":"2024-09-21T01:41:10.947461+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:33:01.418708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.504360+0000","last_change":"2024-09-21T01:39:44.288963+0000","last_active":"2024-09-21T01:41:10.504360+0000","last_peered":"2024-09-21T01:41:10.504360+0000","last_clean":"2024-09-21T01:41:10.504360+0000","last_became_active":"2024-09-21T01:39:44.286967+0000","last_became_peered":"2024-09-21T01:39:44.286967+0000","last_unstale":"2024-09-21T01:41:10.504360+0000","last_undegraded":"2024-09-21T01:41:10.504360+0000","last_fullsized":"2024-09-21T01:41:10.504360+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:02:32.653351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"74'2","reported_seq":42,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:09.881149+0000","last_change":"2024-09-21T01:39:42.268553+0000","last_active":"2024-09-21T01:41:09.881149+0000","last_peered":"2024-09-21T01:41:09.881149+0000","last_clean":"2024-09-21T01:41:09.881149+0000","last_became_active":"2024-09-21T01:39:42.268154+0000","last_became_peered":"2024-09-21T01:39:42.268154+0000","last_unstale":"2024-09-21T01:41:09.881149+0000","last_undegraded":"2024-09-21T01:41:09.881149+0000","last_fullsized":"2024-09-21T01:41:09.881149+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:22:54.223718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.044472+0000","last_change":"2024-09-21T01:39:51.342268+0000","last_active":"2024-09-21T01:41:10.044472+0000","last_peered":"2024-09-21T01:41:10.044472+0000","last_clean":"2024-09-21T01:41:10.044472+0000","last_became_active":"2024-09-21T01:39:51.341221+0000","last_became_peered":"2024-09-21T01:39:51.341221+0000","last_unstale":"2024-09-21T01:41:10.044472+0000","last_undegraded":"2024-09-21T01:41:10.044472+0000","last_fullsized":"2024-09-21T01:41:10.044472+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:46:16.297124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.504240+0000","last_change":"2024-09-21T01:39:44.300338+0000","last_active":"2024-09-21T01:41:10.504240+0000","last_peered":"2024-09-21T01:41:10.504240+0000","last_clean":"2024-09-21T01:41:10.504240+0000","last_became_active":"2024-09-21T01:39:44.299920+0000","last_became_peered":"2024-09-21T01:39:44.299920+0000","last_unstale":"2024-09-21T01:41:10.504240+0000","last_undegraded":"2024-09-21T01:41:10.504240+0000","last_fullsized":"2024-09-21T01:41:10.504240+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:23:47.631867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"82'30","reported_seq":182,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:18.057708+0000","last_change":"2024-09-21T01:39:42.266883+0000","last_active":"2024-09-21T01:41:18.057708+0000","last_peered":"2024-09-21T01:41:18.057708+0000","last_clean":"2024-09-21T01:41:18.057708+0000","last_became_active":"2024-09-21T01:39:42.266494+0000","last_became_peered":"2024-09-21T01:39:42.266494+0000","last_unstale":"2024-09-21T01:41:18.057708+0000","last_undegraded":"2024-09-21T01:41:18.057708+0000","last_fullsized":"2024-09-21T01:41:18.057708+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:56:46.777522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67647,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":113,"num_read_kb":122,"num_write":30,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.040673+0000","last_change":"2024-09-21T01:40:09.842036+0000","last_active":"2024-09-21T01:41:10.040673+0000","last_peered":"2024-09-21T01:41:10.040673+0000","last_clean":"2024-09-21T01:41:10.040673+0000","last_became_active":"2024-09-21T01:40:09.841680+0000","last_became_peered":"2024-09-21T01:40:09.841680+0000","last_unstale":"2024-09-21T01:41:10.040673+0000","last_undegraded":"2024-09-21T01:41:10.040673+0000","last_fullsized":"2024-09-21T01:41:10.040673+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:01:58.366511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,11,5],"acting":[10,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:09.971835+0000","last_change":"2024-09-21T01:39:44.296958+0000","last_active":"2024-09-21T01:41:09.971835+0000","last_peered":"2024-09-21T01:41:09.971835+0000","last_clean":"2024-09-21T01:41:09.971835+0000","last_became_active":"2024-09-21T01:39:44.296588+0000","last_became_peered":"2024-09-21T01:39:44.296588+0000","last_unstale":"2024-09-21T01:41:09.971835+0000","last_undegraded":"2024-09-21T01:41:09.971835+0000","last_fullsized":"2024-09-21T01:41:09.971835+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:04:25.222279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"74'3","reported_seq":42,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.044764+0000","last_change":"2024-09-21T01:39:42.550770+0000","last_active":"2024-09-21T01:41:10.044764+0000","last_peered":"2024-09-21T01:41:10.044764+0000","last_clean":"2024-09-21T01:41:10.044764+0000","last_became_active":"2024-09-21T01:39:42.550317+0000","last_became_peered":"2024-09-21T01:39:42.550317+0000","last_unstale":"2024-09-21T01:41:10.044764+0000","last_undegraded":"2024-09-21T01:41:10.044764+0000","last_fullsized":"2024-09-21T01:41:10.044764+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:11:05.269317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.504279+0000","last_change":"2024-09-21T01:39:51.342166+0000","last_active":"2024-09-21T01:41:10.504279+0000","last_peered":"2024-09-21T01:41:10.504279+0000","last_clean":"2024-09-21T01:41:10.504279+0000","last_became_active":"2024-09-21T01:39:51.341633+0000","last_became_peered":"2024-09-21T01:39:51.341633+0000","last_unstale":"2024-09-21T01:41:10.504279+0000","last_undegraded":"2024-09-21T01:41:10.504279+0000","last_fullsized":"2024-09-21T01:41:10.504279+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:47:13.524123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.506120+0000","last_change":"2024-09-21T01:39:44.297652+0000","last_active":"2024-09-21T01:41:10.506120+0000","last_peered":"2024-09-21T01:41:10.506120+0000","last_clean":"2024-09-21T01:41:10.506120+0000","last_became_active":"2024-09-21T01:39:44.297289+0000","last_became_peered":"2024-09-21T01:39:44.297289+0000","last_unstale":"2024-09-21T01:41:10.506120+0000","last_undegraded":"2024-09-21T01:41:10.506120+0000","last_fullsized":"2024-09-21T01:41:10.506120+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:14:52.834492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:09.878796+0000","last_change":"2024-09-21T01:39:42.269881+0000","last_active":"2024-09-21T01:41:09.878796+0000","last_peered":"2024-09-21T01:41:09.878796+0000","last_clean":"2024-09-21T01:41:09.878796+0000","last_became_active":"2024-09-21T01:39:42.269498+0000","last_became_peered":"2024-09-21T01:39:42.269498+0000","last_unstale":"2024-09-21T01:41:09.878796+0000","last_undegraded":"2024-09-21T01:41:09.878796+0000","last_fullsized":"2024-09-21T01:41:09.878796+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:10:31.750792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.503690+0000","last_change":"2024-09-21T01:40:10.063827+0000","last_active":"2024-09-21T01:41:10.503690+0000","last_peered":"2024-09-21T01:41:10.503690+0000","last_clean":"2024-09-21T01:41:10.503690+0000","last_became_active":"2024-09-21T01:40:10.063206+0000","last_became_peered":"2024-09-21T01:40:10.063206+0000","last_unstale":"2024-09-21T01:41:10.503690+0000","last_undegraded":"2024-09-21T01:41:10.503690+0000","last_fullsized":"2024-09-21T01:41:10.503690+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:33:28.905812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2,4],"acting":[8,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:09.972076+0000","last_change":"2024-09-21T01:39:44.292241+0000","last_active":"2024-09-21T01:41:09.972076+0000","last_peered":"2024-09-21T01:41:09.972076+0000","last_clean":"2024-09-21T01:41:09.972076+0000","last_became_active":"2024-09-21T01:39:44.291808+0000","last_became_peered":"2024-09-21T01:39:44.291808+0000","last_unstale":"2024-09-21T01:41:09.972076+0000","last_undegraded":"2024-09-21T01:41:09.972076+0000","last_fullsized":"2024-09-21T01:41:09.972076+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:47:24.761137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.041221+0000","last_change":"2024-09-21T01:39:42.272047+0000","last_active":"2024-09-21T01:41:10.041221+0000","last_peered":"2024-09-21T01:41:10.041221+0000","last_clean":"2024-09-21T01:41:10.041221+0000","last_became_active":"2024-09-21T01:39:42.271668+0000","last_became_peered":"2024-09-21T01:39:42.271668+0000","last_unstale":"2024-09-21T01:41:10.041221+0000","last_undegraded":"2024-09-21T01:41:10.041221+0000","last_fullsized":"2024-09-21T01:41:10.041221+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:44:09.702328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.505772+0000","last_change":"2024-09-21T01:39:51.337760+0000","last_active":"2024-09-21T01:41:10.505772+0000","last_peered":"2024-09-21T01:41:10.505772+0000","last_clean":"2024-09-21T01:41:10.505772+0000","last_became_active":"2024-09-21T01:39:51.337337+0000","last_became_peered":"2024-09-21T01:39:51.337337+0000","last_unstale":"2024-09-21T01:41:10.505772+0000","last_undegraded":"2024-09-21T01:41:10.505772+0000","last_fullsized":"2024-09-21T01:41:10.505772+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:33:49.316833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.503723+0000","last_change":"2024-09-21T01:39:51.334722+0000","last_active":"2024-09-21T01:41:10.503723+0000","last_peered":"2024-09-21T01:41:10.503723+0000","last_clean":"2024-09-21T01:41:10.503723+0000","last_became_active":"2024-09-21T01:39:51.334318+0000","last_became_peered":"2024-09-21T01:39:51.334318+0000","last_unstale":"2024-09-21T01:41:10.503723+0000","last_undegraded":"2024-09-21T01:41:10.503723+0000","last_fullsized":"2024-09-21T01:41:10.503723+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:29:17.625223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:09.876947+0000","last_change":"2024-09-21T01:39:44.283183+0000","last_active":"2024-09-21T01:41:09.876947+0000","last_peered":"2024-09-21T01:41:09.876947+0000","last_clean":"2024-09-21T01:41:09.876947+0000","last_became_active":"2024-09-21T01:39:44.282829+0000","last_became_peered":"2024-09-21T01:39:44.282829+0000","last_unstale":"2024-09-21T01:41:09.876947+0000","last_undegraded":"2024-09-21T01:41:09.876947+0000","last_fullsized":"2024-09-21T01:41:09.876947+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:31:43.602584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.044143+0000","last_change":"2024-09-21T01:39:42.267465+0000","last_active":"2024-09-21T01:41:10.044143+0000","last_peered":"2024-09-21T01:41:10.044143+0000","last_clean":"2024-09-21T01:41:10.044143+0000","last_became_active":"2024-09-21T01:39:42.267051+0000","last_became_peered":"2024-09-21T01:39:42.267051+0000","last_unstale":"2024-09-21T01:41:10.044143+0000","last_undegraded":"2024-09-21T01:41:10.044143+0000","last_fullsized":"2024-09-21T01:41:10.044143+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:17:30.917284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.947577+0000","last_change":"2024-09-21T01:39:51.338907+0000","last_active":"2024-09-21T01:41:10.947577+0000","last_peered":"2024-09-21T01:41:10.947577+0000","last_clean":"2024-09-21T01:41:10.947577+0000","last_became_active":"2024-09-21T01:39:51.338444+0000","last_became_peered":"2024-09-21T01:39:51.338444+0000","last_unstale":"2024-09-21T01:41:10.947577+0000","last_undegraded":"2024-09-21T01:41:10.947577+0000","last_fullsized":"2024-09-21T01:41:10.947577+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:35:44.819976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.505371+0000","last_change":"2024-09-21T01:39:44.293735+0000","last_active":"2024-09-21T01:41:10.505371+0000","last_peered":"2024-09-21T01:41:10.505371+0000","last_clean":"2024-09-21T01:41:10.505371+0000","last_became_active":"2024-09-21T01:39:44.293371+0000","last_became_peered":"2024-09-21T01:39:44.293371+0000","last_unstale":"2024-09-21T01:41:10.505371+0000","last_undegraded":"2024-09-21T01:41:10.505371+0000","last_fullsized":"2024-09-21T01:41:10.505371+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:50:50.404018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.503564+0000","last_change":"2024-09-21T01:39:42.259012+0000","last_active":"2024-09-21T01:41:10.503564+0000","last_peered":"2024-09-21T01:41:10.503564+0000","last_clean":"2024-09-21T01:41:10.503564+0000","last_became_active":"2024-09-21T01:39:42.258665+0000","last_became_peered":"2024-09-21T01:39:42.258665+0000","last_unstale":"2024-09-21T01:41:10.503564+0000","last_undegraded":"2024-09-21T01:41:10.503564+0000","last_fullsized":"2024-09-21T01:41:10.503564+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:25:24.797505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"74'1","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.040907+0000","last_change":"2024-09-21T01:39:42.270969+0000","last_active":"2024-09-21T01:41:10.040907+0000","last_peered":"2024-09-21T01:41:10.040907+0000","last_clean":"2024-09-21T01:41:10.040907+0000","last_became_active":"2024-09-21T01:39:42.270629+0000","last_became_peered":"2024-09-21T01:39:42.270629+0000","last_unstale":"2024-09-21T01:41:10.040907+0000","last_undegraded":"2024-09-21T01:41:10.040907+0000","last_fullsized":"2024-09-21T01:41:10.040907+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:30:06.321196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.044186+0000","last_change":"2024-09-21T01:39:44.297656+0000","last_active":"2024-09-21T01:41:10.044186+0000","last_peered":"2024-09-21T01:41:10.044186+0000","last_clean":"2024-09-21T01:41:10.044186+0000","last_became_active":"2024-09-21T01:39:44.297273+0000","last_became_peered":"2024-09-21T01:39:44.297273+0000","last_unstale":"2024-09-21T01:41:10.044186+0000","last_undegraded":"2024-09-21T01:41:10.044186+0000","last_fullsized":"2024-09-21T01:41:10.044186+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:35:24.645472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:09.881207+0000","last_change":"2024-09-21T01:40:09.842397+0000","last_active":"2024-09-21T01:41:09.881207+0000","last_peered":"2024-09-21T01:41:09.881207+0000","last_clean":"2024-09-21T01:41:09.881207+0000","last_became_active":"2024-09-21T01:40:09.841934+0000","last_became_peered":"2024-09-21T01:40:09.841934+0000","last_unstale":"2024-09-21T01:41:09.881207+0000","last_undegraded":"2024-09-21T01:41:09.881207+0000","last_fullsized":"2024-09-21T01:41:09.881207+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:06:36.189594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,8,5],"acting":[2,6,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"74'1","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.044389+0000","last_change":"2024-09-21T01:39:42.267207+0000","last_active":"2024-09-21T01:41:10.044389+0000","last_peered":"2024-09-21T01:41:10.044389+0000","last_clean":"2024-09-21T01:41:10.044389+0000","last_became_active":"2024-09-21T01:39:42.266829+0000","last_became_peered":"2024-09-21T01:39:42.266829+0000","last_unstale":"2024-09-21T01:41:10.044389+0000","last_undegraded":"2024-09-21T01:41:10.044389+0000","last_fullsized":"2024-09-21T01:41:10.044389+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:03:18.047546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.504295+0000","last_change":"2024-09-21T01:39:44.305545+0000","last_active":"2024-09-21T01:41:10.504295+0000","last_peered":"2024-09-21T01:41:10.504295+0000","last_clean":"2024-09-21T01:41:10.504295+0000","last_became_active":"2024-09-21T01:39:44.305195+0000","last_became_peered":"2024-09-21T01:39:44.305195+0000","last_unstale":"2024-09-21T01:41:10.504295+0000","last_undegraded":"2024-09-21T01:41:10.504295+0000","last_fullsized":"2024-09-21T01:41:10.504295+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:26:50.011622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:09.881130+0000","last_change":"2024-09-21T01:39:51.342132+0000","last_active":"2024-09-21T01:41:09.881130+0000","last_peered":"2024-09-21T01:41:09.881130+0000","last_clean":"2024-09-21T01:41:09.881130+0000","last_became_active":"2024-09-21T01:39:51.341668+0000","last_became_peered":"2024-09-21T01:39:51.341668+0000","last_unstale":"2024-09-21T01:41:09.881130+0000","last_undegraded":"2024-09-21T01:41:09.881130+0000","last_fullsized":"2024-09-21T01:41:09.881130+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:28:18.119259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.947171+0000","last_change":"2024-09-21T01:39:44.300226+0000","last_active":"2024-09-21T01:41:10.947171+0000","last_peered":"2024-09-21T01:41:10.947171+0000","last_clean":"2024-09-21T01:41:10.947171+0000","last_became_active":"2024-09-21T01:39:44.298740+0000","last_became_peered":"2024-09-21T01:39:44.298740+0000","last_unstale":"2024-09-21T01:41:10.947171+0000","last_undegraded":"2024-09-21T01:41:10.947171+0000","last_fullsized":"2024-09-21T01:41:10.947171+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:05:33.288070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:09.881091+0000","last_change":"2024-09-21T01:39:44.301379+0000","last_active":"2024-09-21T01:41:09.881091+0000","last_peered":"2024-09-21T01:41:09.881091+0000","last_clean":"2024-09-21T01:41:09.881091+0000","last_became_active":"2024-09-21T01:39:44.301011+0000","last_became_peered":"2024-09-21T01:39:44.301011+0000","last_unstale":"2024-09-21T01:41:09.881091+0000","last_undegraded":"2024-09-21T01:41:09.881091+0000","last_fullsized":"2024-09-21T01:41:09.881091+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:16:47.672736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:09.880818+0000","last_change":"2024-09-21T01:39:44.294318+0000","last_active":"2024-09-21T01:41:09.880818+0000","last_peered":"2024-09-21T01:41:09.880818+0000","last_clean":"2024-09-21T01:41:09.880818+0000","last_became_active":"2024-09-21T01:39:44.293941+0000","last_became_peered":"2024-09-21T01:39:44.293941+0000","last_unstale":"2024-09-21T01:41:09.880818+0000","last_undegraded":"2024-09-21T01:41:09.880818+0000","last_fullsized":"2024-09-21T01:41:09.880818+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:27:34.776088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.504604+0000","last_change":"2024-09-21T01:39:44.287815+0000","last_active":"2024-09-21T01:41:10.504604+0000","last_peered":"2024-09-21T01:41:10.504604+0000","last_clean":"2024-09-21T01:41:10.504604+0000","last_became_active":"2024-09-21T01:39:44.287471+0000","last_became_peered":"2024-09-21T01:39:44.287471+0000","last_unstale":"2024-09-21T01:41:10.504604+0000","last_undegraded":"2024-09-21T01:41:10.504604+0000","last_fullsized":"2024-09-21T01:41:10.504604+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:13:59.661464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.504593+0000","last_change":"2024-09-21T01:39:44.285591+0000","last_active":"2024-09-21T01:41:10.504593+0000","last_peered":"2024-09-21T01:41:10.504593+0000","last_clean":"2024-09-21T01:41:10.504593+0000","last_became_active":"2024-09-21T01:39:44.285253+0000","last_became_peered":"2024-09-21T01:39:44.285253+0000","last_unstale":"2024-09-21T01:41:10.504593+0000","last_undegraded":"2024-09-21T01:41:10.504593+0000","last_fullsized":"2024-09-21T01:41:10.504593+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:58:02.890685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.947611+0000","last_change":"2024-09-21T01:39:44.306547+0000","last_active":"2024-09-21T01:41:10.947611+0000","last_peered":"2024-09-21T01:41:10.947611+0000","last_clean":"2024-09-21T01:41:10.947611+0000","last_became_active":"2024-09-21T01:39:44.306116+0000","last_became_peered":"2024-09-21T01:39:44.306116+0000","last_unstale":"2024-09-21T01:41:10.947611+0000","last_undegraded":"2024-09-21T01:41:10.947611+0000","last_fullsized":"2024-09-21T01:41:10.947611+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:58:40.654784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:09.881337+0000","last_change":"2024-09-21T01:39:44.295317+0000","last_active":"2024-09-21T01:41:09.881337+0000","last_peered":"2024-09-21T01:41:09.881337+0000","last_clean":"2024-09-21T01:41:09.881337+0000","last_became_active":"2024-09-21T01:39:44.294936+0000","last_became_peered":"2024-09-21T01:39:44.294936+0000","last_unstale":"2024-09-21T01:41:09.881337+0000","last_undegraded":"2024-09-21T01:41:09.881337+0000","last_fullsized":"2024-09-21T01:41:09.881337+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:32:24.112588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.505546+0000","last_change":"2024-09-21T01:39:44.297242+0000","last_active":"2024-09-21T01:41:10.505546+0000","last_peered":"2024-09-21T01:41:10.505546+0000","last_clean":"2024-09-21T01:41:10.505546+0000","last_became_active":"2024-09-21T01:39:44.296072+0000","last_became_peered":"2024-09-21T01:39:44.296072+0000","last_unstale":"2024-09-21T01:41:10.505546+0000","last_undegraded":"2024-09-21T01:41:10.505546+0000","last_fullsized":"2024-09-21T01:41:10.505546+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:22:23.449535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.043987+0000","last_change":"2024-09-21T01:39:44.293899+0000","last_active":"2024-09-21T01:41:10.043987+0000","last_peered":"2024-09-21T01:41:10.043987+0000","last_clean":"2024-09-21T01:41:10.043987+0000","last_became_active":"2024-09-21T01:39:44.293502+0000","last_became_peered":"2024-09-21T01:39:44.293502+0000","last_unstale":"2024-09-21T01:41:10.043987+0000","last_undegraded":"2024-09-21T01:41:10.043987+0000","last_fullsized":"2024-09-21T01:41:10.043987+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:07:39.549931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.505885+0000","last_change":"2024-09-21T01:39:44.298192+0000","last_active":"2024-09-21T01:41:10.505885+0000","last_peered":"2024-09-21T01:41:10.505885+0000","last_clean":"2024-09-21T01:41:10.505885+0000","last_became_active":"2024-09-21T01:39:44.297834+0000","last_became_peered":"2024-09-21T01:39:44.297834+0000","last_unstale":"2024-09-21T01:41:10.505885+0000","last_undegraded":"2024-09-21T01:41:10.505885+0000","last_fullsized":"2024-09-21T01:41:10.505885+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:41:21.759972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:09.971694+0000","last_change":"2024-09-21T01:39:44.300125+0000","last_active":"2024-09-21T01:41:09.971694+0000","last_peered":"2024-09-21T01:41:09.971694+0000","last_clean":"2024-09-21T01:41:09.971694+0000","last_became_active":"2024-09-21T01:39:44.298047+0000","last_became_peered":"2024-09-21T01:39:44.298047+0000","last_unstale":"2024-09-21T01:41:09.971694+0000","last_undegraded":"2024-09-21T01:41:09.971694+0000","last_fullsized":"2024-09-21T01:41:09.971694+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:31:58.719520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.505329+0000","last_change":"2024-09-21T01:39:44.287346+0000","last_active":"2024-09-21T01:41:10.505329+0000","last_peered":"2024-09-21T01:41:10.505329+0000","last_clean":"2024-09-21T01:41:10.505329+0000","last_became_active":"2024-09-21T01:39:44.286999+0000","last_became_peered":"2024-09-21T01:39:44.286999+0000","last_unstale":"2024-09-21T01:41:10.505329+0000","last_undegraded":"2024-09-21T01:41:10.505329+0000","last_fullsized":"2024-09-21T01:41:10.505329+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:42:26.732516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.947673+0000","last_change":"2024-09-21T01:39:44.299083+0000","last_active":"2024-09-21T01:41:10.947673+0000","last_peered":"2024-09-21T01:41:10.947673+0000","last_clean":"2024-09-21T01:41:10.947673+0000","last_became_active":"2024-09-21T01:39:44.298194+0000","last_became_peered":"2024-09-21T01:39:44.298194+0000","last_unstale":"2024-09-21T01:41:10.947673+0000","last_undegraded":"2024-09-21T01:41:10.947673+0000","last_fullsized":"2024-09-21T01:41:10.947673+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:22:23.360519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:09.881279+0000","last_change":"2024-09-21T01:39:44.292985+0000","last_active":"2024-09-21T01:41:09.881279+0000","last_peered":"2024-09-21T01:41:09.881279+0000","last_clean":"2024-09-21T01:41:09.881279+0000","last_became_active":"2024-09-21T01:39:44.292565+0000","last_became_peered":"2024-09-21T01:39:44.292565+0000","last_unstale":"2024-09-21T01:41:09.881279+0000","last_undegraded":"2024-09-21T01:41:09.881279+0000","last_fullsized":"2024-09-21T01:41:09.881279+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:03:33.563458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:09.877354+0000","last_change":"2024-09-21T01:39:44.291522+0000","last_active":"2024-09-21T01:41:09.877354+0000","last_peered":"2024-09-21T01:41:09.877354+0000","last_clean":"2024-09-21T01:41:09.877354+0000","last_became_active":"2024-09-21T01:39:44.291173+0000","last_became_peered":"2024-09-21T01:39:44.291173+0000","last_unstale":"2024-09-21T01:41:09.877354+0000","last_undegraded":"2024-09-21T01:41:09.877354+0000","last_fullsized":"2024-09-21T01:41:09.877354+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:41:54.562004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.947793+0000","last_change":"2024-09-21T01:39:44.305053+0000","last_active":"2024-09-21T01:41:10.947793+0000","last_peered":"2024-09-21T01:41:10.947793+0000","last_clean":"2024-09-21T01:41:10.947793+0000","last_became_active":"2024-09-21T01:39:44.304651+0000","last_became_peered":"2024-09-21T01:39:44.304651+0000","last_unstale":"2024-09-21T01:41:10.947793+0000","last_undegraded":"2024-09-21T01:41:10.947793+0000","last_fullsized":"2024-09-21T01:41:10.947793+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:15:42.819633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:09.971441+0000","last_change":"2024-09-21T01:39:44.298405+0000","last_active":"2024-09-21T01:41:09.971441+0000","last_peered":"2024-09-21T01:41:09.971441+0000","last_clean":"2024-09-21T01:41:09.971441+0000","last_became_active":"2024-09-21T01:39:44.298010+0000","last_became_peered":"2024-09-21T01:39:44.298010+0000","last_unstale":"2024-09-21T01:41:09.971441+0000","last_undegraded":"2024-09-21T01:41:09.971441+0000","last_fullsized":"2024-09-21T01:41:09.971441+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:09:15.321530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.503947+0000","last_change":"2024-09-21T01:39:44.290593+0000","last_active":"2024-09-21T01:41:10.503947+0000","last_peered":"2024-09-21T01:41:10.503947+0000","last_clean":"2024-09-21T01:41:10.503947+0000","last_became_active":"2024-09-21T01:39:44.290235+0000","last_became_peered":"2024-09-21T01:39:44.290235+0000","last_unstale":"2024-09-21T01:41:10.503947+0000","last_undegraded":"2024-09-21T01:41:10.503947+0000","last_fullsized":"2024-09-21T01:41:10.503947+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:52:20.359493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.504199+0000","last_change":"2024-09-21T01:39:44.301902+0000","last_active":"2024-09-21T01:41:10.504199+0000","last_peered":"2024-09-21T01:41:10.504199+0000","last_clean":"2024-09-21T01:41:10.504199+0000","last_became_active":"2024-09-21T01:39:44.301494+0000","last_became_peered":"2024-09-21T01:39:44.301494+0000","last_unstale":"2024-09-21T01:41:10.504199+0000","last_undegraded":"2024-09-21T01:41:10.504199+0000","last_fullsized":"2024-09-21T01:41:10.504199+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:06:16.162987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.505325+0000","last_change":"2024-09-21T01:39:44.292360+0000","last_active":"2024-09-21T01:41:10.505325+0000","last_peered":"2024-09-21T01:41:10.505325+0000","last_clean":"2024-09-21T01:41:10.505325+0000","last_became_active":"2024-09-21T01:39:44.291995+0000","last_became_peered":"2024-09-21T01:39:44.291995+0000","last_unstale":"2024-09-21T01:41:10.505325+0000","last_undegraded":"2024-09-21T01:41:10.505325+0000","last_fullsized":"2024-09-21T01:41:10.505325+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:29:10.511082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.504500+0000","last_change":"2024-09-21T01:39:44.291836+0000","last_active":"2024-09-21T01:41:10.504500+0000","last_peered":"2024-09-21T01:41:10.504500+0000","last_clean":"2024-09-21T01:41:10.504500+0000","last_became_active":"2024-09-21T01:39:44.291459+0000","last_became_peered":"2024-09-21T01:39:44.291459+0000","last_unstale":"2024-09-21T01:41:10.504500+0000","last_undegraded":"2024-09-21T01:41:10.504500+0000","last_fullsized":"2024-09-21T01:41:10.504500+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:11:53.296520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:09.878862+0000","last_change":"2024-09-21T01:39:44.298572+0000","last_active":"2024-09-21T01:41:09.878862+0000","last_peered":"2024-09-21T01:41:09.878862+0000","last_clean":"2024-09-21T01:41:09.878862+0000","last_became_active":"2024-09-21T01:39:44.297903+0000","last_became_peered":"2024-09-21T01:39:44.297903+0000","last_unstale":"2024-09-21T01:41:09.878862+0000","last_undegraded":"2024-09-21T01:41:09.878862+0000","last_fullsized":"2024-09-21T01:41:09.878862+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:25:06.327202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.041285+0000","last_change":"2024-09-21T01:39:44.292648+0000","last_active":"2024-09-21T01:41:10.041285+0000","last_peered":"2024-09-21T01:41:10.041285+0000","last_clean":"2024-09-21T01:41:10.041285+0000","last_became_active":"2024-09-21T01:39:44.292215+0000","last_became_peered":"2024-09-21T01:39:44.292215+0000","last_unstale":"2024-09-21T01:41:10.041285+0000","last_undegraded":"2024-09-21T01:41:10.041285+0000","last_fullsized":"2024-09-21T01:41:10.041285+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:43:02.265276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:09.972172+0000","last_change":"2024-09-21T01:39:44.303330+0000","last_active":"2024-09-21T01:41:09.972172+0000","last_peered":"2024-09-21T01:41:09.972172+0000","last_clean":"2024-09-21T01:41:09.972172+0000","last_became_active":"2024-09-21T01:39:44.302862+0000","last_became_peered":"2024-09-21T01:39:44.302862+0000","last_unstale":"2024-09-21T01:41:09.972172+0000","last_undegraded":"2024-09-21T01:41:09.972172+0000","last_fullsized":"2024-09-21T01:41:09.972172+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:58:12.296150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.505356+0000","last_change":"2024-09-21T01:39:44.288015+0000","last_active":"2024-09-21T01:41:10.505356+0000","last_peered":"2024-09-21T01:41:10.505356+0000","last_clean":"2024-09-21T01:41:10.505356+0000","last_became_active":"2024-09-21T01:39:44.287455+0000","last_became_peered":"2024-09-21T01:39:44.287455+0000","last_unstale":"2024-09-21T01:41:10.505356+0000","last_undegraded":"2024-09-21T01:41:10.505356+0000","last_fullsized":"2024-09-21T01:41:10.505356+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:12:07.036882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:09.878229+0000","last_change":"2024-09-21T01:39:44.294594+0000","last_active":"2024-09-21T01:41:09.878229+0000","last_peered":"2024-09-21T01:41:09.878229+0000","last_clean":"2024-09-21T01:41:09.878229+0000","last_became_active":"2024-09-21T01:39:44.294218+0000","last_became_peered":"2024-09-21T01:39:44.294218+0000","last_unstale":"2024-09-21T01:41:09.878229+0000","last_undegraded":"2024-09-21T01:41:09.878229+0000","last_fullsized":"2024-09-21T01:41:09.878229+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:45:54.875131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.040849+0000","last_change":"2024-09-21T01:39:44.285172+0000","last_active":"2024-09-21T01:41:10.040849+0000","last_peered":"2024-09-21T01:41:10.040849+0000","last_clean":"2024-09-21T01:41:10.040849+0000","last_became_active":"2024-09-21T01:39:44.284799+0000","last_became_peered":"2024-09-21T01:39:44.284799+0000","last_unstale":"2024-09-21T01:41:10.040849+0000","last_undegraded":"2024-09-21T01:41:10.040849+0000","last_fullsized":"2024-09-21T01:41:10.040849+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:06:30.562297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.503985+0000","last_change":"2024-09-21T01:39:44.295990+0000","last_active":"2024-09-21T01:41:10.503985+0000","last_peered":"2024-09-21T01:41:10.503985+0000","last_clean":"2024-09-21T01:41:10.503985+0000","last_became_active":"2024-09-21T01:39:44.295601+0000","last_became_peered":"2024-09-21T01:39:44.295601+0000","last_unstale":"2024-09-21T01:41:10.503985+0000","last_undegraded":"2024-09-21T01:41:10.503985+0000","last_fullsized":"2024-09-21T01:41:10.503985+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:37:08.300911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.504510+0000","last_change":"2024-09-21T01:39:44.300104+0000","last_active":"2024-09-21T01:41:10.504510+0000","last_peered":"2024-09-21T01:41:10.504510+0000","last_clean":"2024-09-21T01:41:10.504510+0000","last_became_active":"2024-09-21T01:39:44.299709+0000","last_became_peered":"2024-09-21T01:39:44.299709+0000","last_unstale":"2024-09-21T01:41:10.504510+0000","last_undegraded":"2024-09-21T01:41:10.504510+0000","last_fullsized":"2024-09-21T01:41:10.504510+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:01:35.013021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.505080+0000","last_change":"2024-09-21T01:39:44.295900+0000","last_active":"2024-09-21T01:41:10.505080+0000","last_peered":"2024-09-21T01:41:10.505080+0000","last_clean":"2024-09-21T01:41:10.505080+0000","last_became_active":"2024-09-21T01:39:44.295303+0000","last_became_peered":"2024-09-21T01:39:44.295303+0000","last_unstale":"2024-09-21T01:41:10.505080+0000","last_undegraded":"2024-09-21T01:41:10.505080+0000","last_fullsized":"2024-09-21T01:41:10.505080+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:00:23.097745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.505528+0000","last_change":"2024-09-21T01:39:44.303627+0000","last_active":"2024-09-21T01:41:10.505528+0000","last_peered":"2024-09-21T01:41:10.505528+0000","last_clean":"2024-09-21T01:41:10.505528+0000","last_became_active":"2024-09-21T01:39:44.303260+0000","last_became_peered":"2024-09-21T01:39:44.303260+0000","last_unstale":"2024-09-21T01:41:10.505528+0000","last_undegraded":"2024-09-21T01:41:10.505528+0000","last_fullsized":"2024-09-21T01:41:10.505528+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:17:39.630994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.947741+0000","last_change":"2024-09-21T01:39:44.306087+0000","last_active":"2024-09-21T01:41:10.947741+0000","last_peered":"2024-09-21T01:41:10.947741+0000","last_clean":"2024-09-21T01:41:10.947741+0000","last_became_active":"2024-09-21T01:39:44.305660+0000","last_became_peered":"2024-09-21T01:39:44.305660+0000","last_unstale":"2024-09-21T01:41:10.947741+0000","last_undegraded":"2024-09-21T01:41:10.947741+0000","last_fullsized":"2024-09-21T01:41:10.947741+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:26:46.911966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":68445,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":119,"num_read_kb":128,"num_write":83,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":294912,"data_stored":205335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":70,"ondisk_log_size":70,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":376832,"data_stored":4132576,"data_compressed":247723,"data_compressed_allocated":315392,"data_compressed_original":4096000,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":68,"seq":292057776161,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27932,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717220,"statfs":{"total":95995035648,"available":95966433280,"internally_reserved":0,"allocated":925696,"data_stored":494638,"data_compressed":29495,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939685,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32228,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712924,"statfs":{"total":95995035648,"available":95962034176,"internally_reserved":0,"allocated":1060864,"data_stored":1148751,"data_compressed":65346,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":58,"seq":249108103211,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":933888,"data_stored":499316,"data_compressed":29495,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":52,"seq":223338299440,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":933888,"data_stored":495242,"data_compressed":29495,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495668,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32152,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713000,"statfs":{"total":95995035648,"available":95962112000,"internally_reserved":0,"allocated":983040,"data_stored":1089684,"data_compressed":65346,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":41,"seq":176093659193,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":921600,"data_stored":490542,"data_compressed":29495,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855423,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32152,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713000,"statfs":{"total":95995035648,"available":95962112000,"internally_reserved":0,"allocated":987136,"data_stored":1085188,"data_compressed":65346,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018948,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27940,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717212,"statfs":{"total":95995035648,"available":95966425088,"internally_reserved":0,"allocated":929792,"data_stored":494660,"data_compressed":29495,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182473,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32096,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713056,"statfs":{"total":95995035648,"available":95962169344,"internally_reserved":0,"allocated":929792,"data_stored":490646,"data_compressed":29495,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411406,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36332,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708820,"statfs":{"total":95995035648,"available":95957831680,"internally_reserved":0,"allocated":1003520,"data_stored":558223,"data_compressed":29495,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574930,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32168,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712984,"statfs":{"total":95995035648,"available":95962095616,"internally_reserved":0,"allocated":999424,"data_stored":558189,"data_compressed":29495,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705752,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":925696,"data_stored":490632,"data_compressed":29495,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34234,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34234,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35851,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35851,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35851,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35851,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35851,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":67647,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":67681,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":67841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T01:41:23.209 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-21T01:41:23.209 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-21T01:41:23.209 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-09-21T01:41:23.210 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph health --format=json 2024-09-21T01:41:23.468 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:41:23.958 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:23.908+0000 7f0342997640 1 -- 172.21.15.83:0/2585643116 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f033c102a60 msgr2=0x7f033c102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:23.959 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:23.908+0000 7f0342997640 1 --2- 172.21.15.83:0/2585643116 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f033c102a60 0x7f033c102e70 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f032c009900 tx=0x7f032c02a410 comp rx=0 tx=0).stop 2024-09-21T01:41:23.959 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:23.908+0000 7f0342997640 1 -- 172.21.15.83:0/2585643116 shutdown_connections 2024-09-21T01:41:23.959 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:23.908+0000 7f0342997640 1 --2- 172.21.15.83:0/2585643116 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f033c108cf0 0x7f033c10f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:23.959 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:23.908+0000 7f0342997640 1 --2- 172.21.15.83:0/2585643116 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f033c1083a0 0x7f033c1087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:23.959 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:23.908+0000 7f0342997640 1 --2- 172.21.15.83:0/2585643116 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f033c102a60 0x7f033c102e70 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:23.959 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:23.908+0000 7f0342997640 1 -- 172.21.15.83:0/2585643116 >> 172.21.15.83:0/2585643116 conn(0x7f033c079730 msgr2=0x7f033c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:41:23.959 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:23.908+0000 7f0342997640 1 -- 172.21.15.83:0/2585643116 shutdown_connections 2024-09-21T01:41:23.959 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:23.908+0000 7f0342997640 1 -- 172.21.15.83:0/2585643116 wait complete. 2024-09-21T01:41:23.959 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:23.909+0000 7f0342997640 1 Processor -- start 2024-09-21T01:41:23.959 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:23.909+0000 7f0342997640 1 -- start start 2024-09-21T01:41:23.959 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:23.909+0000 7f0342997640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f033c102a60 0x7f033c199340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:23.959 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:23.909+0000 7f0342997640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f033c1083a0 0x7f033c1998e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:23.959 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:23.909+0000 7f0342997640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f033c108cf0 0x7f033c19eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:23.959 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:23.909+0000 7f0342997640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f033c112810 con 0x7f033c102a60 2024-09-21T01:41:23.960 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:23.909+0000 7f0342997640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f033c112690 con 0x7f033c108cf0 2024-09-21T01:41:23.960 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:23.909+0000 7f0342997640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f033c112990 con 0x7f033c1083a0 2024-09-21T01:41:23.960 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:23.910+0000 7f033bfff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f033c102a60 0x7f033c199340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:23.960 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:23.910+0000 7f033bfff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f033c102a60 0x7f033c199340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:40390/0 (socket says 172.21.15.83:40390) 2024-09-21T01:41:23.960 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:23.910+0000 7f033bfff640 1 -- 172.21.15.83:0/933921594 learned_addr learned my addr 172.21.15.83:0/933921594 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:41:23.960 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:23.910+0000 7f0333fff640 1 --2- 172.21.15.83:0/933921594 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f033c1083a0 0x7f033c1998e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:23.960 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:23.910+0000 7f033bfff640 1 -- 172.21.15.83:0/933921594 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f033c1083a0 msgr2=0x7f033c1998e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:23.960 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:23.910+0000 7f033bfff640 1 --2- 172.21.15.83:0/933921594 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f033c1083a0 0x7f033c1998e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:23.960 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:23.910+0000 7f033bfff640 1 -- 172.21.15.83:0/933921594 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f033c108cf0 msgr2=0x7f033c19eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:23.960 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:23.910+0000 7f0340f34640 1 --2- 172.21.15.83:0/933921594 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f033c108cf0 0x7f033c19eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:23.960 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:23.910+0000 7f033bfff640 1 --2- 172.21.15.83:0/933921594 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f033c108cf0 0x7f033c19eb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:23.960 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:23.910+0000 7f033bfff640 1 -- 172.21.15.83:0/933921594 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f033c19f1f0 con 0x7f033c102a60 2024-09-21T01:41:23.960 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:23.910+0000 7f0333fff640 1 --2- 172.21.15.83:0/933921594 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f033c1083a0 0x7f033c1998e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:41:23.960 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:23.910+0000 7f033bfff640 1 --2- 172.21.15.83:0/933921594 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f033c102a60 0x7f033c199340 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f032c009a20 tx=0x7f032c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:41:23.961 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:23.910+0000 7f0339ffb640 1 -- 172.21.15.83:0/933921594 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f032c03f030 con 0x7f033c102a60 2024-09-21T01:41:23.961 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:23.910+0000 7f0339ffb640 1 -- 172.21.15.83:0/933921594 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f032c0035f0 con 0x7f033c102a60 2024-09-21T01:41:23.961 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:23.910+0000 7f0339ffb640 1 -- 172.21.15.83:0/933921594 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f032c035070 con 0x7f033c102a60 2024-09-21T01:41:23.961 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:23.910+0000 7f0342997640 1 -- 172.21.15.83:0/933921594 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f033c19f480 con 0x7f033c102a60 2024-09-21T01:41:23.961 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:23.910+0000 7f0342997640 1 -- 172.21.15.83:0/933921594 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f033c19f960 con 0x7f033c102a60 2024-09-21T01:41:23.961 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:23.911+0000 7f0342997640 1 -- 172.21.15.83:0/933921594 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f033c102e70 con 0x7f033c102a60 2024-09-21T01:41:23.961 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:23.913+0000 7f0339ffb640 1 -- 172.21.15.83:0/933921594 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7f032c003aa0 con 0x7f033c102a60 2024-09-21T01:41:23.961 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:23.913+0000 7f0339ffb640 1 --2- 172.21.15.83:0/933921594 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f03280b6620 0x7f03280b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:23.961 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:23.914+0000 7f0333fff640 1 --2- 172.21.15.83:0/933921594 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f03280b6620 0x7f03280b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:23.961 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:23.914+0000 7f0339ffb640 1 -- 172.21.15.83:0/933921594 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9315+0+0 (secure 0 0 0) 0x7f032c108990 con 0x7f033c102a60 2024-09-21T01:41:23.961 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:23.914+0000 7f0333fff640 1 --2- 172.21.15.83:0/933921594 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f03280b6620 0x7f03280b8b30 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f033c100d90 tx=0x7f0324005d30 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:41:23.961 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:23.917+0000 7f0339ffb640 1 -- 172.21.15.83:0/933921594 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f032c0cec80 con 0x7f033c102a60 2024-09-21T01:41:24.133 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:24.131+0000 7f0342997640 1 -- 172.21.15.83:0/933921594 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f033c10a6b0 con 0x7f033c102a60 2024-09-21T01:41:24.133 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:41:23 smithi083 ceph-mon[31370]: from='client.15261 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T01:41:24.133 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:41:23 smithi083 ceph-mon[31370]: pgmap v319: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:41:24.134 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:24.132+0000 7f0339ffb640 1 -- 172.21.15.83:0/933921594 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f032c0d3060 con 0x7f033c102a60 2024-09-21T01:41:24.134 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T01:41:24.134 INFO:teuthology.orchestra.run.smithi083.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-21T01:41:24.135 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:24.134+0000 7f0342997640 1 -- 172.21.15.83:0/933921594 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f03280b6620 msgr2=0x7f03280b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:24.135 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:24.134+0000 7f0342997640 1 --2- 172.21.15.83:0/933921594 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f03280b6620 0x7f03280b8b30 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f033c100d90 tx=0x7f0324005d30 comp rx=0 tx=0).stop 2024-09-21T01:41:24.136 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:24.134+0000 7f0342997640 1 -- 172.21.15.83:0/933921594 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f033c102a60 msgr2=0x7f033c199340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:24.136 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:24.134+0000 7f0342997640 1 --2- 172.21.15.83:0/933921594 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f033c102a60 0x7f033c199340 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f032c009a20 tx=0x7f032c004270 comp rx=0 tx=0).stop 2024-09-21T01:41:24.136 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:24.134+0000 7f0342997640 1 -- 172.21.15.83:0/933921594 shutdown_connections 2024-09-21T01:41:24.136 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:24.134+0000 7f0342997640 1 --2- 172.21.15.83:0/933921594 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f03280b6620 0x7f03280b8b30 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:24.136 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:24.134+0000 7f0342997640 1 --2- 172.21.15.83:0/933921594 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f033c108cf0 0x7f033c19eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:24.136 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:24.134+0000 7f0342997640 1 --2- 172.21.15.83:0/933921594 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f033c1083a0 0x7f033c1998e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:24.136 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:24.134+0000 7f0342997640 1 --2- 172.21.15.83:0/933921594 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f033c102a60 0x7f033c199340 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:24.136 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:24.134+0000 7f0342997640 1 -- 172.21.15.83:0/933921594 >> 172.21.15.83:0/933921594 conn(0x7f033c079730 msgr2=0x7f033c101610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:41:24.136 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:24.134+0000 7f0342997640 1 -- 172.21.15.83:0/933921594 shutdown_connections 2024-09-21T01:41:24.136 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:24.134+0000 7f0342997640 1 -- 172.21.15.83:0/933921594 wait complete. 2024-09-21T01:41:24.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:41:23 smithi142 ceph-mon[34050]: from='client.15261 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T01:41:24.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:41:23 smithi142 ceph-mon[34050]: pgmap v319: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:41:24.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:41:23 smithi119 ceph-mon[33693]: from='client.15261 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T01:41:24.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:41:23 smithi119 ceph-mon[33693]: pgmap v319: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:41:24.771 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-09-21T01:41:24.772 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T01:41:25.019 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:41:25.053 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:41:24 smithi083 ceph-mon[31370]: from='client.? 172.21.15.83:0/933921594' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-21T01:41:25.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:41:24 smithi142 ceph-mon[34050]: from='client.? 172.21.15.83:0/933921594' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-21T01:41:25.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:41:24 smithi119 ceph-mon[33693]: from='client.? 172.21.15.83:0/933921594' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-21T01:41:25.460 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:25.459+0000 7f187d2c4640 1 -- 172.21.15.83:0/4068475303 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1878108cf0 msgr2=0x7f187810f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:25.460 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:25.459+0000 7f187d2c4640 1 --2- 172.21.15.83:0/4068475303 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1878108cf0 0x7f187810f520 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f1870009ca0 tx=0x7f187002a8c0 comp rx=0 tx=0).stop 2024-09-21T01:41:25.460 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:25.459+0000 7f187d2c4640 1 -- 172.21.15.83:0/4068475303 shutdown_connections 2024-09-21T01:41:25.460 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:25.459+0000 7f187d2c4640 1 --2- 172.21.15.83:0/4068475303 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1878108cf0 0x7f187810f520 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:25.460 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:25.459+0000 7f187d2c4640 1 --2- 172.21.15.83:0/4068475303 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f18781083a0 0x7f18781087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:25.460 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:25.459+0000 7f187d2c4640 1 --2- 172.21.15.83:0/4068475303 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1878102a60 0x7f1878102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:25.460 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:25.459+0000 7f187d2c4640 1 -- 172.21.15.83:0/4068475303 >> 172.21.15.83:0/4068475303 conn(0x7f1878079730 msgr2=0x7f1878079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:41:25.461 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:25.459+0000 7f187d2c4640 1 -- 172.21.15.83:0/4068475303 shutdown_connections 2024-09-21T01:41:25.461 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:25.459+0000 7f187d2c4640 1 -- 172.21.15.83:0/4068475303 wait complete. 2024-09-21T01:41:25.461 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:25.460+0000 7f187d2c4640 1 Processor -- start 2024-09-21T01:41:25.461 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:25.460+0000 7f187d2c4640 1 -- start start 2024-09-21T01:41:25.463 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:25.460+0000 7f187d2c4640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1878102a60 0x7f187819a370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:25.463 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:25.460+0000 7f187d2c4640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f18781083a0 0x7f187819a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:25.463 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:25.460+0000 7f187d2c4640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1878108cf0 0x7f187819fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:25.463 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:25.460+0000 7f187d2c4640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f1878113960 con 0x7f18781083a0 2024-09-21T01:41:25.463 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:25.460+0000 7f187d2c4640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f18781137e0 con 0x7f1878102a60 2024-09-21T01:41:25.463 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:25.460+0000 7f187d2c4640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f1878113ae0 con 0x7f1878108cf0 2024-09-21T01:41:25.463 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:25.461+0000 7f18767fc640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f18781083a0 0x7f187819a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:25.463 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:25.461+0000 7f18767fc640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f18781083a0 0x7f187819a910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:40410/0 (socket says 172.21.15.83:40410) 2024-09-21T01:41:25.463 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:25.461+0000 7f18767fc640 1 -- 172.21.15.83:0/4078145475 learned_addr learned my addr 172.21.15.83:0/4078145475 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:41:25.463 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:25.461+0000 7f1876ffd640 1 --2- 172.21.15.83:0/4078145475 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1878102a60 0x7f187819a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:25.463 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:25.461+0000 7f18777fe640 1 --2- 172.21.15.83:0/4078145475 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1878108cf0 0x7f187819fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:25.464 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:25.461+0000 7f18767fc640 1 -- 172.21.15.83:0/4078145475 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1878108cf0 msgr2=0x7f187819fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:25.464 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:25.461+0000 7f18767fc640 1 --2- 172.21.15.83:0/4078145475 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1878108cf0 0x7f187819fbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:25.464 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:25.461+0000 7f18767fc640 1 -- 172.21.15.83:0/4078145475 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1878102a60 msgr2=0x7f187819a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:25.464 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:25.461+0000 7f18767fc640 1 --2- 172.21.15.83:0/4078145475 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1878102a60 0x7f187819a370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:25.464 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:25.461+0000 7f18767fc640 1 -- 172.21.15.83:0/4078145475 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18781a0220 con 0x7f18781083a0 2024-09-21T01:41:25.464 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:25.461+0000 7f18767fc640 1 --2- 172.21.15.83:0/4078145475 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f18781083a0 0x7f187819a910 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f186c00c970 tx=0x7f186c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:41:25.464 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:25.461+0000 7f185ffff640 1 -- 172.21.15.83:0/4078145475 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f186c014070 con 0x7f18781083a0 2024-09-21T01:41:25.464 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:25.461+0000 7f187d2c4640 1 -- 172.21.15.83:0/4078145475 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18781a0510 con 0x7f18781083a0 2024-09-21T01:41:25.464 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:25.461+0000 7f185ffff640 1 -- 172.21.15.83:0/4078145475 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f186c004440 con 0x7f18781083a0 2024-09-21T01:41:25.464 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:25.461+0000 7f185ffff640 1 -- 172.21.15.83:0/4078145475 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f186c003d40 con 0x7f18781083a0 2024-09-21T01:41:25.464 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:25.461+0000 7f187d2c4640 1 -- 172.21.15.83:0/4078145475 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18781a6d30 con 0x7f18781083a0 2024-09-21T01:41:25.465 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:25.462+0000 7f187d2c4640 1 -- 172.21.15.83:0/4078145475 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1878102e70 con 0x7f18781083a0 2024-09-21T01:41:25.465 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:25.464+0000 7f185ffff640 1 -- 172.21.15.83:0/4078145475 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7f186c017070 con 0x7f18781083a0 2024-09-21T01:41:25.467 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:25.465+0000 7f185ffff640 1 --2- 172.21.15.83:0/4078145475 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f18600b6620 0x7f18600b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:25.467 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:25.465+0000 7f1876ffd640 1 --2- 172.21.15.83:0/4078145475 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f18600b6620 0x7f18600b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:25.467 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:25.465+0000 7f185ffff640 1 -- 172.21.15.83:0/4078145475 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9315+0+0 (secure 0 0 0) 0x7f186c0e7c20 con 0x7f18781083a0 2024-09-21T01:41:25.467 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:25.466+0000 7f1876ffd640 1 --2- 172.21.15.83:0/4078145475 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f18600b6620 0x7f18600b8b30 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f1868005e10 tx=0x7f1868005da0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:41:25.470 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:25.469+0000 7f185ffff640 1 -- 172.21.15.83:0/4078145475 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f186c01e030 con 0x7f18781083a0 2024-09-21T01:41:25.683 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:25.682+0000 7f187d2c4640 1 -- 172.21.15.83:0/4078145475 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f187819b4a0 con 0x7f18781083a0 2024-09-21T01:41:25.684 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:25.683+0000 7f185ffff640 1 -- 172.21.15.83:0/4078145475 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11857 (secure 0 0 0) 0x7f186c0adf10 con 0x7f18781083a0 2024-09-21T01:41:25.684 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T01:41:25.684 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":21,"btime":"2024-09-21T01:40:27:947059+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14775,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6835/1105040204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":1105040204},{"type":"v1","addr":"172.21.15.83:6835","nonce":1105040204}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14787,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/2234789563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6836","nonce":2234789563},{"type":"v1","addr":"172.21.15.83:6837","nonce":2234789563}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14838,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6839/136258364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6838","nonce":136258364},{"type":"v1","addr":"172.21.15.83:6839","nonce":136258364}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14850,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6841/129439444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6840","nonce":129439444},{"type":"v1","addr":"172.21.15.83:6841","nonce":129439444}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24569,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/2839502433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":2839502433},{"type":"v1","addr":"172.21.15.119:6833","nonce":2839502433}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24580,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6833/2841606990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":2841606990},{"type":"v1","addr":"172.21.15.142:6833","nonce":2841606990}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24599,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/415902608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":415902608},{"type":"v1","addr":"172.21.15.119:6835","nonce":415902608}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24607,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/3009088510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":3009088510},{"type":"v1","addr":"172.21.15.142:6835","nonce":3009088510}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24613,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/3847200126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6836","nonce":3847200126},{"type":"v1","addr":"172.21.15.142:6837","nonce":3847200126}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24626,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/3619222976","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":3619222976},{"type":"v1","addr":"172.21.15.119:6837","nonce":3619222976}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T01:39:45.145124+0000","modified":"2024-09-21T01:40:27.664151+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24653},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24631":{"gid":24631,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.142:6839/1817880741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6838","nonce":1817880741},{"type":"v1","addr":"172.21.15.142:6839","nonce":1817880741}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24653":{"gid":24653,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.119:6839/3106757092","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":3106757092},{"type":"v1","addr":"172.21.15.119:6839","nonce":3106757092}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24653,"qdb_cluster":[24653]},"id":1}]} 2024-09-21T01:41:25.685 INFO:teuthology.orchestra.run.smithi083.stderr:dumped fsmap epoch 21 2024-09-21T01:41:25.687 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:25.685+0000 7f187d2c4640 1 -- 172.21.15.83:0/4078145475 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f18600b6620 msgr2=0x7f18600b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:25.687 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:25.685+0000 7f187d2c4640 1 --2- 172.21.15.83:0/4078145475 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f18600b6620 0x7f18600b8b30 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f1868005e10 tx=0x7f1868005da0 comp rx=0 tx=0).stop 2024-09-21T01:41:25.687 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:25.685+0000 7f187d2c4640 1 -- 172.21.15.83:0/4078145475 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f18781083a0 msgr2=0x7f187819a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:25.687 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:25.685+0000 7f187d2c4640 1 --2- 172.21.15.83:0/4078145475 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f18781083a0 0x7f187819a910 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f186c00c970 tx=0x7f186c00ce30 comp rx=0 tx=0).stop 2024-09-21T01:41:25.687 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:25.685+0000 7f187d2c4640 1 -- 172.21.15.83:0/4078145475 shutdown_connections 2024-09-21T01:41:25.687 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:25.685+0000 7f187d2c4640 1 --2- 172.21.15.83:0/4078145475 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f18600b6620 0x7f18600b8b30 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:25.687 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:25.685+0000 7f187d2c4640 1 --2- 172.21.15.83:0/4078145475 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1878108cf0 0x7f187819fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:25.687 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:25.685+0000 7f187d2c4640 1 --2- 172.21.15.83:0/4078145475 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f18781083a0 0x7f187819a910 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:25.687 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:25.685+0000 7f187d2c4640 1 --2- 172.21.15.83:0/4078145475 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1878102a60 0x7f187819a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:25.687 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:25.685+0000 7f187d2c4640 1 -- 172.21.15.83:0/4078145475 >> 172.21.15.83:0/4078145475 conn(0x7f1878079730 msgr2=0x7f1878104410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:41:25.687 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:25.685+0000 7f187d2c4640 1 -- 172.21.15.83:0/4078145475 shutdown_connections 2024-09-21T01:41:25.687 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:25.685+0000 7f187d2c4640 1 -- 172.21.15.83:0/4078145475 wait complete. 2024-09-21T01:41:26.053 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:41:25 smithi083 ceph-mon[31370]: pgmap v320: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T01:41:26.053 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:41:25 smithi083 ceph-mon[31370]: from='client.? 172.21.15.83:0/4078145475' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:41:26.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:41:25 smithi142 ceph-mon[34050]: pgmap v320: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T01:41:26.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:41:25 smithi142 ceph-mon[34050]: from='client.? 172.21.15.83:0/4078145475' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:41:26.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:41:25 smithi119 ceph-mon[33693]: pgmap v320: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T01:41:26.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:41:25 smithi119 ceph-mon[33693]: from='client.? 172.21.15.83:0/4078145475' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:41:26.364 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T01:41:26.610 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:41:27.105 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:27.094+0000 7fd8cface640 1 -- 172.21.15.83:0/4207609231 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd8c8105300 msgr2=0x7fd8c810d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:27.106 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:27.094+0000 7fd8cface640 1 --2- 172.21.15.83:0/4207609231 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd8c8105300 0x7fd8c810d850 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fd8bc009900 tx=0x7fd8bc02a410 comp rx=0 tx=0).stop 2024-09-21T01:41:27.106 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:27.094+0000 7fd8cface640 1 -- 172.21.15.83:0/4207609231 shutdown_connections 2024-09-21T01:41:27.106 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:27.094+0000 7fd8cface640 1 --2- 172.21.15.83:0/4207609231 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd8c810de10 0x7fd8c8110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:27.106 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:27.094+0000 7fd8cface640 1 --2- 172.21.15.83:0/4207609231 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd8c8105300 0x7fd8c810d850 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:27.106 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:27.094+0000 7fd8cface640 1 --2- 172.21.15.83:0/4207609231 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd8c81049b0 0x7fd8c8104dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:27.106 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:27.094+0000 7fd8cface640 1 -- 172.21.15.83:0/4207609231 >> 172.21.15.83:0/4207609231 conn(0x7fd8c8079730 msgr2=0x7fd8c8079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:41:27.106 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:27.094+0000 7fd8cface640 1 -- 172.21.15.83:0/4207609231 shutdown_connections 2024-09-21T01:41:27.106 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:27.094+0000 7fd8cface640 1 -- 172.21.15.83:0/4207609231 wait complete. 2024-09-21T01:41:27.106 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:27.095+0000 7fd8cface640 1 Processor -- start 2024-09-21T01:41:27.106 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:27.095+0000 7fd8cface640 1 -- start start 2024-09-21T01:41:27.106 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:27.095+0000 7fd8cface640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd8c81049b0 0x7fd8c819a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:27.107 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:27.095+0000 7fd8cface640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd8c8105300 0x7fd8c819a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:27.107 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:27.095+0000 7fd8cface640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd8c810de10 0x7fd8c819fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:27.107 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:27.095+0000 7fd8cface640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fd8c8113920 con 0x7fd8c810de10 2024-09-21T01:41:27.107 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:27.095+0000 7fd8cface640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fd8c81137a0 con 0x7fd8c8105300 2024-09-21T01:41:27.107 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:27.095+0000 7fd8cface640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fd8c8113aa0 con 0x7fd8c81049b0 2024-09-21T01:41:27.107 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:27.095+0000 7fd8ce06b640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd8c810de10 0x7fd8c819fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:27.107 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:27.095+0000 7fd8ce06b640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd8c810de10 0x7fd8c819fc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:40426/0 (socket says 172.21.15.83:40426) 2024-09-21T01:41:27.107 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:27.095+0000 7fd8ce06b640 1 -- 172.21.15.83:0/3404912564 learned_addr learned my addr 172.21.15.83:0/3404912564 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:41:27.107 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:27.095+0000 7fd8cd069640 1 --2- 172.21.15.83:0/3404912564 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd8c8105300 0x7fd8c819a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:27.107 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:27.095+0000 7fd8cd86a640 1 --2- 172.21.15.83:0/3404912564 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd8c81049b0 0x7fd8c819a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:27.107 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:27.096+0000 7fd8ce06b640 1 -- 172.21.15.83:0/3404912564 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd8c81049b0 msgr2=0x7fd8c819a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:27.107 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:27.096+0000 7fd8ce06b640 1 --2- 172.21.15.83:0/3404912564 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd8c81049b0 0x7fd8c819a450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:27.107 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:27.096+0000 7fd8ce06b640 1 -- 172.21.15.83:0/3404912564 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd8c8105300 msgr2=0x7fd8c819a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:27.107 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:27.096+0000 7fd8ce06b640 1 --2- 172.21.15.83:0/3404912564 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd8c8105300 0x7fd8c819a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:27.108 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:27.096+0000 7fd8ce06b640 1 -- 172.21.15.83:0/3404912564 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8c81a0300 con 0x7fd8c810de10 2024-09-21T01:41:27.108 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:27.096+0000 7fd8cd86a640 1 --2- 172.21.15.83:0/3404912564 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd8c81049b0 0x7fd8c819a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:41:27.108 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:27.096+0000 7fd8ce06b640 1 --2- 172.21.15.83:0/3404912564 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd8c810de10 0x7fd8c819fc90 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fd8c000c970 tx=0x7fd8c000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:41:27.108 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:27.096+0000 7fd8c6ffd640 1 -- 172.21.15.83:0/3404912564 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8c0007bb0 con 0x7fd8c810de10 2024-09-21T01:41:27.108 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:27.096+0000 7fd8cface640 1 -- 172.21.15.83:0/3404912564 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8c81a05f0 con 0x7fd8c810de10 2024-09-21T01:41:27.108 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:27.096+0000 7fd8c6ffd640 1 -- 172.21.15.83:0/3404912564 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd8c0007d50 con 0x7fd8c810de10 2024-09-21T01:41:27.108 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:27.096+0000 7fd8c6ffd640 1 -- 172.21.15.83:0/3404912564 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8c0018660 con 0x7fd8c810de10 2024-09-21T01:41:27.108 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:27.096+0000 7fd8cface640 1 -- 172.21.15.83:0/3404912564 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8c81a6e10 con 0x7fd8c810de10 2024-09-21T01:41:27.108 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:27.097+0000 7fd8cface640 1 -- 172.21.15.83:0/3404912564 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8c8104dc0 con 0x7fd8c810de10 2024-09-21T01:41:27.108 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:27.099+0000 7fd8c6ffd640 1 -- 172.21.15.83:0/3404912564 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7fd8c000f970 con 0x7fd8c810de10 2024-09-21T01:41:27.108 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:27.099+0000 7fd8c6ffd640 1 --2- 172.21.15.83:0/3404912564 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fd8b00b6620 0x7fd8b00b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:27.108 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:27.099+0000 7fd8cd86a640 1 --2- 172.21.15.83:0/3404912564 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fd8b00b6620 0x7fd8b00b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:27.108 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:27.099+0000 7fd8c6ffd640 1 -- 172.21.15.83:0/3404912564 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9315+0+0 (secure 0 0 0) 0x7fd8c00e7b70 con 0x7fd8c810de10 2024-09-21T01:41:27.108 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:27.100+0000 7fd8cd86a640 1 --2- 172.21.15.83:0/3404912564 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fd8b00b6620 0x7fd8b00b8b30 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fd8c806bc60 tx=0x7fd8b800a800 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:41:27.109 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:27.102+0000 7fd8c6ffd640 1 -- 172.21.15.83:0/3404912564 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd8c0056710 con 0x7fd8c810de10 2024-09-21T01:41:27.318 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:27.317+0000 7fd8cface640 1 -- 172.21.15.83:0/3404912564 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd8c8108f70 con 0x7fd8c810de10 2024-09-21T01:41:27.319 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:27.317+0000 7fd8c6ffd640 1 -- 172.21.15.83:0/3404912564 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11857 (secure 0 0 0) 0x7fd8c0014030 con 0x7fd8c810de10 2024-09-21T01:41:27.319 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T01:41:27.319 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":21,"btime":"2024-09-21T01:40:27:947059+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14775,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6835/1105040204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":1105040204},{"type":"v1","addr":"172.21.15.83:6835","nonce":1105040204}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14787,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/2234789563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6836","nonce":2234789563},{"type":"v1","addr":"172.21.15.83:6837","nonce":2234789563}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14838,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6839/136258364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6838","nonce":136258364},{"type":"v1","addr":"172.21.15.83:6839","nonce":136258364}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14850,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6841/129439444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6840","nonce":129439444},{"type":"v1","addr":"172.21.15.83:6841","nonce":129439444}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24569,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/2839502433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":2839502433},{"type":"v1","addr":"172.21.15.119:6833","nonce":2839502433}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24580,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6833/2841606990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":2841606990},{"type":"v1","addr":"172.21.15.142:6833","nonce":2841606990}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24599,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/415902608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":415902608},{"type":"v1","addr":"172.21.15.119:6835","nonce":415902608}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24607,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/3009088510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":3009088510},{"type":"v1","addr":"172.21.15.142:6835","nonce":3009088510}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24613,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/3847200126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6836","nonce":3847200126},{"type":"v1","addr":"172.21.15.142:6837","nonce":3847200126}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24626,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/3619222976","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":3619222976},{"type":"v1","addr":"172.21.15.119:6837","nonce":3619222976}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T01:39:45.145124+0000","modified":"2024-09-21T01:40:27.664151+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24653},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24631":{"gid":24631,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.142:6839/1817880741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6838","nonce":1817880741},{"type":"v1","addr":"172.21.15.142:6839","nonce":1817880741}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24653":{"gid":24653,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.119:6839/3106757092","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":3106757092},{"type":"v1","addr":"172.21.15.119:6839","nonce":3106757092}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24653,"qdb_cluster":[24653]},"id":1}]} 2024-09-21T01:41:27.319 INFO:teuthology.orchestra.run.smithi083.stderr:dumped fsmap epoch 21 2024-09-21T01:41:27.321 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:27.319+0000 7fd8cface640 1 -- 172.21.15.83:0/3404912564 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fd8b00b6620 msgr2=0x7fd8b00b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:27.321 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:27.319+0000 7fd8cface640 1 --2- 172.21.15.83:0/3404912564 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fd8b00b6620 0x7fd8b00b8b30 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fd8c806bc60 tx=0x7fd8b800a800 comp rx=0 tx=0).stop 2024-09-21T01:41:27.321 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:27.319+0000 7fd8cface640 1 -- 172.21.15.83:0/3404912564 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd8c810de10 msgr2=0x7fd8c819fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:27.321 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:27.319+0000 7fd8cface640 1 --2- 172.21.15.83:0/3404912564 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd8c810de10 0x7fd8c819fc90 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fd8c000c970 tx=0x7fd8c000ce30 comp rx=0 tx=0).stop 2024-09-21T01:41:27.321 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:27.320+0000 7fd8cface640 1 -- 172.21.15.83:0/3404912564 shutdown_connections 2024-09-21T01:41:27.321 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:27.320+0000 7fd8cface640 1 --2- 172.21.15.83:0/3404912564 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fd8b00b6620 0x7fd8b00b8b30 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:27.321 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:27.320+0000 7fd8cface640 1 --2- 172.21.15.83:0/3404912564 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd8c810de10 0x7fd8c819fc90 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:27.322 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:27.320+0000 7fd8cface640 1 --2- 172.21.15.83:0/3404912564 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd8c8105300 0x7fd8c819a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:27.322 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:27.320+0000 7fd8cface640 1 --2- 172.21.15.83:0/3404912564 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd8c81049b0 0x7fd8c819a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:27.322 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:27.320+0000 7fd8cface640 1 -- 172.21.15.83:0/3404912564 >> 172.21.15.83:0/3404912564 conn(0x7fd8c8079730 msgr2=0x7fd8c80ff890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:41:27.322 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:27.320+0000 7fd8cface640 1 -- 172.21.15.83:0/3404912564 shutdown_connections 2024-09-21T01:41:27.322 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:27.320+0000 7fd8cface640 1 -- 172.21.15.83:0/3404912564 wait complete. 2024-09-21T01:41:27.902 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:41:27 smithi083 ceph-mon[31370]: pgmap v321: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:41:27.902 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:41:27 smithi083 ceph-mon[31370]: from='client.? 172.21.15.83:0/3404912564' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:41:27.930 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T01:41:28.174 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:41:28.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:41:27 smithi142 ceph-mon[34050]: pgmap v321: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:41:28.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:41:27 smithi142 ceph-mon[34050]: from='client.? 172.21.15.83:0/3404912564' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:41:28.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:41:27 smithi119 ceph-mon[33693]: pgmap v321: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:41:28.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:41:27 smithi119 ceph-mon[33693]: from='client.? 172.21.15.83:0/3404912564' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:41:28.665 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:28.660+0000 7fc649832640 1 -- 172.21.15.83:0/309408965 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc6441083a0 msgr2=0x7fc6441087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:28.666 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:28.660+0000 7fc649832640 1 --2- 172.21.15.83:0/309408965 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc6441083a0 0x7fc6441087b0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fc638009900 tx=0x7fc63802a410 comp rx=0 tx=0).stop 2024-09-21T01:41:28.666 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:28.660+0000 7fc649832640 1 -- 172.21.15.83:0/309408965 shutdown_connections 2024-09-21T01:41:28.666 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:28.660+0000 7fc649832640 1 --2- 172.21.15.83:0/309408965 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc644108cf0 0x7fc64410f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:28.666 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:28.660+0000 7fc649832640 1 --2- 172.21.15.83:0/309408965 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc6441083a0 0x7fc6441087b0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:28.666 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:28.660+0000 7fc649832640 1 --2- 172.21.15.83:0/309408965 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc644102a60 0x7fc644102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:28.666 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:28.660+0000 7fc649832640 1 -- 172.21.15.83:0/309408965 >> 172.21.15.83:0/309408965 conn(0x7fc644079730 msgr2=0x7fc644079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:41:28.666 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:28.660+0000 7fc649832640 1 -- 172.21.15.83:0/309408965 shutdown_connections 2024-09-21T01:41:28.666 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:28.660+0000 7fc649832640 1 -- 172.21.15.83:0/309408965 wait complete. 2024-09-21T01:41:28.666 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:28.661+0000 7fc649832640 1 Processor -- start 2024-09-21T01:41:28.666 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:28.661+0000 7fc649832640 1 -- start start 2024-09-21T01:41:28.666 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:28.661+0000 7fc649832640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc644102a60 0x7fc64419b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:28.666 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:28.661+0000 7fc649832640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc6441083a0 0x7fc64419b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:28.667 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:28.661+0000 7fc649832640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc644108cf0 0x7fc64419bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:28.667 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:28.661+0000 7fc649832640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fc644112810 con 0x7fc644108cf0 2024-09-21T01:41:28.667 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:28.661+0000 7fc649832640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fc644112690 con 0x7fc644102a60 2024-09-21T01:41:28.667 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:28.661+0000 7fc649832640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fc644112990 con 0x7fc6441083a0 2024-09-21T01:41:28.667 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:28.662+0000 7fc6437fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc644108cf0 0x7fc64419bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:28.667 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:28.662+0000 7fc6437fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc644108cf0 0x7fc64419bd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:40450/0 (socket says 172.21.15.83:40450) 2024-09-21T01:41:28.667 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:28.662+0000 7fc6437fe640 1 -- 172.21.15.83:0/2432677082 learned_addr learned my addr 172.21.15.83:0/2432677082 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:41:28.667 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:28.662+0000 7fc6427fc640 1 --2- 172.21.15.83:0/2432677082 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc6441083a0 0x7fc64419b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:28.667 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:28.662+0000 7fc642ffd640 1 --2- 172.21.15.83:0/2432677082 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc644102a60 0x7fc64419b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:28.667 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:28.662+0000 7fc6437fe640 1 -- 172.21.15.83:0/2432677082 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc6441083a0 msgr2=0x7fc64419b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:28.667 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:28.662+0000 7fc6437fe640 1 --2- 172.21.15.83:0/2432677082 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc6441083a0 0x7fc64419b800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:28.667 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:28.662+0000 7fc6437fe640 1 -- 172.21.15.83:0/2432677082 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc644102a60 msgr2=0x7fc64419b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:28.667 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:28.662+0000 7fc6437fe640 1 --2- 172.21.15.83:0/2432677082 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc644102a60 0x7fc64419b2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:28.668 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:28.662+0000 7fc6437fe640 1 -- 172.21.15.83:0/2432677082 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6441a6580 con 0x7fc644108cf0 2024-09-21T01:41:28.668 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:28.662+0000 7fc642ffd640 1 --2- 172.21.15.83:0/2432677082 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc644102a60 0x7fc64419b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:41:28.668 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:28.662+0000 7fc6437fe640 1 --2- 172.21.15.83:0/2432677082 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc644108cf0 0x7fc64419bd40 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fc63c00cad0 tx=0x7fc63c00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:41:28.668 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:28.662+0000 7fc648830640 1 -- 172.21.15.83:0/2432677082 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc63c00ae20 con 0x7fc644108cf0 2024-09-21T01:41:28.668 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:28.662+0000 7fc648830640 1 -- 172.21.15.83:0/2432677082 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc63c005020 con 0x7fc644108cf0 2024-09-21T01:41:28.668 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:28.662+0000 7fc649832640 1 -- 172.21.15.83:0/2432677082 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6441a6870 con 0x7fc644108cf0 2024-09-21T01:41:28.668 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:28.662+0000 7fc648830640 1 -- 172.21.15.83:0/2432677082 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc63c00f6b0 con 0x7fc644108cf0 2024-09-21T01:41:28.668 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:28.662+0000 7fc649832640 1 -- 172.21.15.83:0/2432677082 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6441a6db0 con 0x7fc644108cf0 2024-09-21T01:41:28.668 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:28.663+0000 7fc649832640 1 -- 172.21.15.83:0/2432677082 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc644102e70 con 0x7fc644108cf0 2024-09-21T01:41:28.669 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:28.665+0000 7fc648830640 1 -- 172.21.15.83:0/2432677082 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7fc63c0051d0 con 0x7fc644108cf0 2024-09-21T01:41:28.669 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:28.666+0000 7fc648830640 1 --2- 172.21.15.83:0/2432677082 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fc62c0b65f0 0x7fc62c0b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:28.669 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:28.666+0000 7fc642ffd640 1 --2- 172.21.15.83:0/2432677082 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fc62c0b65f0 0x7fc62c0b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:28.669 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:28.666+0000 7fc648830640 1 -- 172.21.15.83:0/2432677082 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9315+0+0 (secure 0 0 0) 0x7fc63c0e7d20 con 0x7fc644108cf0 2024-09-21T01:41:28.669 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:28.666+0000 7fc642ffd640 1 --2- 172.21.15.83:0/2432677082 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fc62c0b65f0 0x7fc62c0b8b00 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fc64406b9e0 tx=0x7fc634005e70 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:41:28.670 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:28.669+0000 7fc648830640 1 -- 172.21.15.83:0/2432677082 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc63c014030 con 0x7fc644108cf0 2024-09-21T01:41:28.852 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:28.851+0000 7fc649832640 1 -- 172.21.15.83:0/2432677082 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc64406b290 con 0x7fc644108cf0 2024-09-21T01:41:28.854 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:28.853+0000 7fc648830640 1 -- 172.21.15.83:0/2432677082 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) ==== 74+0+25096 (secure 0 0 0) 0x7fc63c0ae010 con 0x7fc644108cf0 2024-09-21T01:41:28.854 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T01:41:28.855 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":84,"fsid":"f7697ecc-77b8-11ef-baf5-efdc52797490","created":"2024-09-21T01:31:22.250342+0000","modified":"2024-09-21T01:41:09.873952+0000","last_up_change":"2024-09-21T01:38:53.501659+0000","last_in_change":"2024-09-21T01:38:30.688516+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T01:35:06.977668+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T01:39:41.041950+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T01:39:42.882272+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T01:39:49.320532+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"66947512-01ee-4bf0-87b0-98a168cf50dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":3563457494},{"type":"v1","addr":"172.21.15.83:6803","nonce":3563457494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":3563457494},{"type":"v1","addr":"172.21.15.83:6805","nonce":3563457494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":3563457494},{"type":"v1","addr":"172.21.15.83:6809","nonce":3563457494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":3563457494},{"type":"v1","addr":"172.21.15.83:6807","nonce":3563457494}]},"public_addr":"172.21.15.83:6803/3563457494","cluster_addr":"172.21.15.83:6805/3563457494","heartbeat_back_addr":"172.21.15.83:6809/3563457494","heartbeat_front_addr":"172.21.15.83:6807/3563457494","state":["exists","up"]},{"osd":1,"uuid":"f7818a08-86a5-412d-a164-cfeb18f8650a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":2066870220},{"type":"v1","addr":"172.21.15.119:6801","nonce":2066870220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":2066870220},{"type":"v1","addr":"172.21.15.119:6803","nonce":2066870220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":2066870220},{"type":"v1","addr":"172.21.15.119:6807","nonce":2066870220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":2066870220},{"type":"v1","addr":"172.21.15.119:6805","nonce":2066870220}]},"public_addr":"172.21.15.119:6801/2066870220","cluster_addr":"172.21.15.119:6803/2066870220","heartbeat_back_addr":"172.21.15.119:6807/2066870220","heartbeat_front_addr":"172.21.15.119:6805/2066870220","state":["exists","up"]},{"osd":2,"uuid":"0d1a3870-c67a-4783-85f9-be2bb36f7722","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":3955936117},{"type":"v1","addr":"172.21.15.142:6801","nonce":3955936117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3955936117},{"type":"v1","addr":"172.21.15.142:6803","nonce":3955936117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":3955936117},{"type":"v1","addr":"172.21.15.142:6807","nonce":3955936117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":3955936117},{"type":"v1","addr":"172.21.15.142:6805","nonce":3955936117}]},"public_addr":"172.21.15.142:6801/3955936117","cluster_addr":"172.21.15.142:6803/3955936117","heartbeat_back_addr":"172.21.15.142:6807/3955936117","heartbeat_front_addr":"172.21.15.142:6805/3955936117","state":["exists","up"]},{"osd":3,"uuid":"a4cb1a36-3495-4d36-92da-ed3b6e852d14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":3746834093},{"type":"v1","addr":"172.21.15.83:6811","nonce":3746834093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":3746834093},{"type":"v1","addr":"172.21.15.83:6813","nonce":3746834093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":3746834093},{"type":"v1","addr":"172.21.15.83:6817","nonce":3746834093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":3746834093},{"type":"v1","addr":"172.21.15.83:6815","nonce":3746834093}]},"public_addr":"172.21.15.83:6811/3746834093","cluster_addr":"172.21.15.83:6813/3746834093","heartbeat_back_addr":"172.21.15.83:6817/3746834093","heartbeat_front_addr":"172.21.15.83:6815/3746834093","state":["exists","up"]},{"osd":4,"uuid":"d6f2ec78-7f08-473b-a96c-e8590f5d2f25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":3083907785},{"type":"v1","addr":"172.21.15.119:6809","nonce":3083907785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":3083907785},{"type":"v1","addr":"172.21.15.119:6811","nonce":3083907785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":3083907785},{"type":"v1","addr":"172.21.15.119:6815","nonce":3083907785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":3083907785},{"type":"v1","addr":"172.21.15.119:6813","nonce":3083907785}]},"public_addr":"172.21.15.119:6809/3083907785","cluster_addr":"172.21.15.119:6811/3083907785","heartbeat_back_addr":"172.21.15.119:6815/3083907785","heartbeat_front_addr":"172.21.15.119:6813/3083907785","state":["exists","up"]},{"osd":5,"uuid":"c571d04d-d3ea-4d74-8867-e4c7816f4e0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":349001002},{"type":"v1","addr":"172.21.15.142:6809","nonce":349001002}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":349001002},{"type":"v1","addr":"172.21.15.142:6811","nonce":349001002}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":349001002},{"type":"v1","addr":"172.21.15.142:6815","nonce":349001002}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":349001002},{"type":"v1","addr":"172.21.15.142:6813","nonce":349001002}]},"public_addr":"172.21.15.142:6809/349001002","cluster_addr":"172.21.15.142:6811/349001002","heartbeat_back_addr":"172.21.15.142:6815/349001002","heartbeat_front_addr":"172.21.15.142:6813/349001002","state":["exists","up"]},{"osd":6,"uuid":"6e1b6fe9-700a-448a-b382-59b97896ea7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":771651063},{"type":"v1","addr":"172.21.15.83:6819","nonce":771651063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":771651063},{"type":"v1","addr":"172.21.15.83:6821","nonce":771651063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":771651063},{"type":"v1","addr":"172.21.15.83:6825","nonce":771651063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":771651063},{"type":"v1","addr":"172.21.15.83:6823","nonce":771651063}]},"public_addr":"172.21.15.83:6819/771651063","cluster_addr":"172.21.15.83:6821/771651063","heartbeat_back_addr":"172.21.15.83:6825/771651063","heartbeat_front_addr":"172.21.15.83:6823/771651063","state":["exists","up"]},{"osd":7,"uuid":"283bfae4-5f50-4f9e-860e-bbfd47e005e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":1556984819},{"type":"v1","addr":"172.21.15.119:6817","nonce":1556984819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":1556984819},{"type":"v1","addr":"172.21.15.119:6819","nonce":1556984819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":1556984819},{"type":"v1","addr":"172.21.15.119:6823","nonce":1556984819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":1556984819},{"type":"v1","addr":"172.21.15.119:6821","nonce":1556984819}]},"public_addr":"172.21.15.119:6817/1556984819","cluster_addr":"172.21.15.119:6819/1556984819","heartbeat_back_addr":"172.21.15.119:6823/1556984819","heartbeat_front_addr":"172.21.15.119:6821/1556984819","state":["exists","up"]},{"osd":8,"uuid":"d46e56d4-ed4e-42c3-a315-66af014bd93a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":1860679473},{"type":"v1","addr":"172.21.15.142:6817","nonce":1860679473}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":1860679473},{"type":"v1","addr":"172.21.15.142:6819","nonce":1860679473}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":1860679473},{"type":"v1","addr":"172.21.15.142:6823","nonce":1860679473}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":1860679473},{"type":"v1","addr":"172.21.15.142:6821","nonce":1860679473}]},"public_addr":"172.21.15.142:6817/1860679473","cluster_addr":"172.21.15.142:6819/1860679473","heartbeat_back_addr":"172.21.15.142:6823/1860679473","heartbeat_front_addr":"172.21.15.142:6821/1860679473","state":["exists","up"]},{"osd":9,"uuid":"18a70ee6-56df-4f5c-868d-5db5e72a1859","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":3636757924},{"type":"v1","addr":"172.21.15.83:6827","nonce":3636757924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":3636757924},{"type":"v1","addr":"172.21.15.83:6829","nonce":3636757924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6832","nonce":3636757924},{"type":"v1","addr":"172.21.15.83:6833","nonce":3636757924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":3636757924},{"type":"v1","addr":"172.21.15.83:6831","nonce":3636757924}]},"public_addr":"172.21.15.83:6827/3636757924","cluster_addr":"172.21.15.83:6829/3636757924","heartbeat_back_addr":"172.21.15.83:6833/3636757924","heartbeat_front_addr":"172.21.15.83:6831/3636757924","state":["exists","up"]},{"osd":10,"uuid":"0d32c3de-db03-42c3-9914-07d675aaa339","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":2561963910},{"type":"v1","addr":"172.21.15.119:6825","nonce":2561963910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":2561963910},{"type":"v1","addr":"172.21.15.119:6827","nonce":2561963910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2561963910},{"type":"v1","addr":"172.21.15.119:6831","nonce":2561963910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2561963910},{"type":"v1","addr":"172.21.15.119:6829","nonce":2561963910}]},"public_addr":"172.21.15.119:6825/2561963910","cluster_addr":"172.21.15.119:6827/2561963910","heartbeat_back_addr":"172.21.15.119:6831/2561963910","heartbeat_front_addr":"172.21.15.119:6829/2561963910","state":["exists","up"]},{"osd":11,"uuid":"3a3b444d-b316-4256-bfad-378db29f0824","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":1174646198},{"type":"v1","addr":"172.21.15.142:6825","nonce":1174646198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":1174646198},{"type":"v1","addr":"172.21.15.142:6827","nonce":1174646198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1174646198},{"type":"v1","addr":"172.21.15.142:6831","nonce":1174646198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1174646198},{"type":"v1","addr":"172.21.15.142:6829","nonce":1174646198}]},"public_addr":"172.21.15.142:6825/1174646198","cluster_addr":"172.21.15.142:6827/1174646198","heartbeat_back_addr":"172.21.15.142:6831/1174646198","heartbeat_front_addr":"172.21.15.142:6829/1174646198","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:34:15.337672+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:34:39.259716+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:35:03.348886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:35:29.465711+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:35:53.744378+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:36:19.488785+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:36:45.708616+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:37:11.501065+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:37:36.027277+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:38:01.903625+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:38:27.215212+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:38:51.891278+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.e","mappings":[{"from":4,"to":8},{"from":5,"to":9}]},{"pgid":"3.11","mappings":[{"from":4,"to":6}]},{"pgid":"4.3","mappings":[{"from":5,"to":8}]},{"pgid":"4.10","mappings":[{"from":9,"to":8}]},{"pgid":"4.12","mappings":[{"from":9,"to":10}]},{"pgid":"4.1c","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.83:0/1619062496":"2024-09-22T01:33:08.666525+0000","172.21.15.83:0/2412709299":"2024-09-22T01:31:45.834450+0000","172.21.15.83:6800/4290325964":"2024-09-22T01:31:45.834450+0000","172.21.15.83:6801/4290325964":"2024-09-22T01:31:45.834450+0000","172.21.15.83:0/1440681183":"2024-09-22T01:31:45.834450+0000","172.21.15.83:0/2745413305":"2024-09-22T01:31:45.834450+0000","172.21.15.83:6800/1393748565":"2024-09-22T01:33:08.666525+0000","172.21.15.83:0/110411274":"2024-09-22T01:32:10.073024+0000","172.21.15.83:0/4267551123":"2024-09-22T01:33:08.666525+0000","172.21.15.83:0/1068434643":"2024-09-22T01:32:10.073024+0000","172.21.15.83:6800/2963261730":"2024-09-22T01:32:10.073024+0000","172.21.15.83:0/3544333975":"2024-09-22T01:32:10.073024+0000","172.21.15.83:6801/1393748565":"2024-09-22T01:33:08.666525+0000","172.21.15.83:6801/2963261730":"2024-09-22T01:32:10.073024+0000","172.21.15.83:0/1915285091":"2024-09-22T01:33:08.666525+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T01:41:28.858 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:28.855+0000 7fc649832640 1 -- 172.21.15.83:0/2432677082 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fc62c0b65f0 msgr2=0x7fc62c0b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:28.858 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:28.855+0000 7fc649832640 1 --2- 172.21.15.83:0/2432677082 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fc62c0b65f0 0x7fc62c0b8b00 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fc64406b9e0 tx=0x7fc634005e70 comp rx=0 tx=0).stop 2024-09-21T01:41:28.858 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:28.855+0000 7fc649832640 1 -- 172.21.15.83:0/2432677082 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc644108cf0 msgr2=0x7fc64419bd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:28.858 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:28.855+0000 7fc649832640 1 --2- 172.21.15.83:0/2432677082 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc644108cf0 0x7fc64419bd40 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fc63c00cad0 tx=0x7fc63c00cf90 comp rx=0 tx=0).stop 2024-09-21T01:41:28.858 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:28.855+0000 7fc649832640 1 -- 172.21.15.83:0/2432677082 shutdown_connections 2024-09-21T01:41:28.858 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:28.855+0000 7fc649832640 1 --2- 172.21.15.83:0/2432677082 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fc62c0b65f0 0x7fc62c0b8b00 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:28.858 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:28.855+0000 7fc649832640 1 --2- 172.21.15.83:0/2432677082 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc644108cf0 0x7fc64419bd40 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:28.858 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:28.855+0000 7fc649832640 1 --2- 172.21.15.83:0/2432677082 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc6441083a0 0x7fc64419b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:28.858 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:28.855+0000 7fc649832640 1 --2- 172.21.15.83:0/2432677082 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc644102a60 0x7fc64419b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:28.858 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:28.855+0000 7fc649832640 1 -- 172.21.15.83:0/2432677082 >> 172.21.15.83:0/2432677082 conn(0x7fc644079730 msgr2=0x7fc6441045b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:41:28.858 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:28.855+0000 7fc649832640 1 -- 172.21.15.83:0/2432677082 shutdown_connections 2024-09-21T01:41:28.858 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:28.855+0000 7fc649832640 1 -- 172.21.15.83:0/2432677082 wait complete. 2024-09-21T01:41:29.626 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T01:41:29.875 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:41:30.137 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:41:29 smithi083 ceph-mon[31370]: pgmap v322: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:41:30.137 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:41:29 smithi083 ceph-mon[31370]: from='client.? 172.21.15.83:0/2432677082' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T01:41:30.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:41:29 smithi142 ceph-mon[34050]: pgmap v322: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:41:30.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:41:29 smithi142 ceph-mon[34050]: from='client.? 172.21.15.83:0/2432677082' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T01:41:30.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:41:29 smithi119 ceph-mon[33693]: pgmap v322: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:41:30.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:41:29 smithi119 ceph-mon[33693]: from='client.? 172.21.15.83:0/2432677082' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T01:41:30.342 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:30.337+0000 7f3da2e88640 1 -- 172.21.15.83:0/4092858643 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3d9c1022a0 msgr2=0x7f3d9c1026b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:30.342 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:30.337+0000 7f3da2e88640 1 --2- 172.21.15.83:0/4092858643 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3d9c1022a0 0x7f3d9c1026b0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f3d90009900 tx=0x7f3d9002a410 comp rx=0 tx=0).stop 2024-09-21T01:41:30.342 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:30.337+0000 7f3da2e88640 1 -- 172.21.15.83:0/4092858643 shutdown_connections 2024-09-21T01:41:30.342 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:30.337+0000 7f3da2e88640 1 --2- 172.21.15.83:0/4092858643 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3d9c108530 0x7f3d9c10ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:30.342 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:30.337+0000 7f3da2e88640 1 --2- 172.21.15.83:0/4092858643 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3d9c107be0 0x7f3d9c107ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:30.343 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:30.337+0000 7f3da2e88640 1 --2- 172.21.15.83:0/4092858643 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3d9c1022a0 0x7f3d9c1026b0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:30.343 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:30.337+0000 7f3da2e88640 1 -- 172.21.15.83:0/4092858643 >> 172.21.15.83:0/4092858643 conn(0x7f3d9c079ec0 msgr2=0x7f3d9c07a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:41:30.343 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:30.337+0000 7f3da2e88640 1 -- 172.21.15.83:0/4092858643 shutdown_connections 2024-09-21T01:41:30.343 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:30.337+0000 7f3da2e88640 1 -- 172.21.15.83:0/4092858643 wait complete. 2024-09-21T01:41:30.343 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:30.337+0000 7f3da2e88640 1 Processor -- start 2024-09-21T01:41:30.343 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:30.337+0000 7f3da2e88640 1 -- start start 2024-09-21T01:41:30.343 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:30.338+0000 7f3da2e88640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3d9c1022a0 0x7f3d9c19b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:30.343 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:30.338+0000 7f3da2e88640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3d9c107be0 0x7f3d9c19b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:30.343 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:30.338+0000 7f3da2e88640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3d9c108530 0x7f3d9c19bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:30.343 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:30.338+0000 7f3da2e88640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f3d9c112920 con 0x7f3d9c108530 2024-09-21T01:41:30.343 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:30.338+0000 7f3da2e88640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f3d9c1127a0 con 0x7f3d9c107be0 2024-09-21T01:41:30.343 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:30.338+0000 7f3da2e88640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f3d9c112aa0 con 0x7f3d9c1022a0 2024-09-21T01:41:30.343 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:30.338+0000 7f3da1425640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3d9c108530 0x7f3d9c19bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:30.344 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:30.338+0000 7f3da1425640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3d9c108530 0x7f3d9c19bd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:40462/0 (socket says 172.21.15.83:40462) 2024-09-21T01:41:30.344 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:30.338+0000 7f3da1425640 1 -- 172.21.15.83:0/469355742 learned_addr learned my addr 172.21.15.83:0/469355742 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:41:30.344 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:30.338+0000 7f3d9bfff640 1 --2- 172.21.15.83:0/469355742 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3d9c107be0 0x7f3d9c19b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:30.344 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:30.338+0000 7f3da0c24640 1 --2- 172.21.15.83:0/469355742 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3d9c1022a0 0x7f3d9c19b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:30.344 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:30.338+0000 7f3da1425640 1 -- 172.21.15.83:0/469355742 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3d9c1022a0 msgr2=0x7f3d9c19b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:30.344 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:30.338+0000 7f3da1425640 1 --2- 172.21.15.83:0/469355742 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3d9c1022a0 0x7f3d9c19b2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:30.344 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:30.338+0000 7f3da1425640 1 -- 172.21.15.83:0/469355742 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3d9c107be0 msgr2=0x7f3d9c19b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:30.344 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:30.338+0000 7f3da1425640 1 --2- 172.21.15.83:0/469355742 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3d9c107be0 0x7f3d9c19b7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:30.344 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:30.338+0000 7f3da1425640 1 -- 172.21.15.83:0/469355742 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d9c1a6570 con 0x7f3d9c108530 2024-09-21T01:41:30.344 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:30.338+0000 7f3da0c24640 1 --2- 172.21.15.83:0/469355742 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3d9c1022a0 0x7f3d9c19b2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:41:30.344 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:30.338+0000 7f3da1425640 1 --2- 172.21.15.83:0/469355742 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3d9c108530 0x7f3d9c19bd30 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f3d9400eaa0 tx=0x7f3d9400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:41:30.344 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:30.338+0000 7f3d99ffb640 1 -- 172.21.15.83:0/469355742 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d9400cdb0 con 0x7f3d9c108530 2024-09-21T01:41:30.344 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:30.339+0000 7f3d99ffb640 1 -- 172.21.15.83:0/469355742 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3d94005020 con 0x7f3d9c108530 2024-09-21T01:41:30.344 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:30.339+0000 7f3d99ffb640 1 -- 172.21.15.83:0/469355742 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d940116d0 con 0x7f3d9c108530 2024-09-21T01:41:30.344 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:30.339+0000 7f3da2e88640 1 -- 172.21.15.83:0/469355742 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d9c1a6860 con 0x7f3d9c108530 2024-09-21T01:41:30.345 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:30.339+0000 7f3da2e88640 1 -- 172.21.15.83:0/469355742 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d9c1a6da0 con 0x7f3d9c108530 2024-09-21T01:41:30.345 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:30.340+0000 7f3da2e88640 1 -- 172.21.15.83:0/469355742 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d9c1026b0 con 0x7f3d9c108530 2024-09-21T01:41:30.345 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:30.341+0000 7f3d99ffb640 1 -- 172.21.15.83:0/469355742 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7f3d940051d0 con 0x7f3d9c108530 2024-09-21T01:41:30.345 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:30.342+0000 7f3d99ffb640 1 --2- 172.21.15.83:0/469355742 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f3d8c0b65f0 0x7f3d8c0b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:30.345 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:30.342+0000 7f3d99ffb640 1 -- 172.21.15.83:0/469355742 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9315+0+0 (secure 0 0 0) 0x7f3d940e7ad0 con 0x7f3d9c108530 2024-09-21T01:41:30.346 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:30.342+0000 7f3da0c24640 1 --2- 172.21.15.83:0/469355742 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f3d8c0b65f0 0x7f3d8c0b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:30.346 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:30.342+0000 7f3da0c24640 1 --2- 172.21.15.83:0/469355742 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f3d8c0b65f0 0x7f3d8c0b8b00 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f3d90006010 tx=0x7f3d90005a20 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:41:30.347 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:30.346+0000 7f3d99ffb640 1 -- 172.21.15.83:0/469355742 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3d94016030 con 0x7f3d9c108530 2024-09-21T01:41:30.563 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:30.562+0000 7f3da2e88640 1 -- 172.21.15.83:0/469355742 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3d9c02e640 con 0x7f3d9c108530 2024-09-21T01:41:30.564 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:30.562+0000 7f3d99ffb640 1 -- 172.21.15.83:0/469355742 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11857 (secure 0 0 0) 0x7f3d940addc0 con 0x7f3d9c108530 2024-09-21T01:41:30.564 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T01:41:30.564 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":21,"btime":"2024-09-21T01:40:27:947059+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14775,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6835/1105040204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":1105040204},{"type":"v1","addr":"172.21.15.83:6835","nonce":1105040204}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14787,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/2234789563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6836","nonce":2234789563},{"type":"v1","addr":"172.21.15.83:6837","nonce":2234789563}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14838,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6839/136258364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6838","nonce":136258364},{"type":"v1","addr":"172.21.15.83:6839","nonce":136258364}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14850,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6841/129439444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6840","nonce":129439444},{"type":"v1","addr":"172.21.15.83:6841","nonce":129439444}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24569,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/2839502433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":2839502433},{"type":"v1","addr":"172.21.15.119:6833","nonce":2839502433}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24580,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6833/2841606990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":2841606990},{"type":"v1","addr":"172.21.15.142:6833","nonce":2841606990}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24599,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/415902608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":415902608},{"type":"v1","addr":"172.21.15.119:6835","nonce":415902608}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24607,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/3009088510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":3009088510},{"type":"v1","addr":"172.21.15.142:6835","nonce":3009088510}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24613,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/3847200126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6836","nonce":3847200126},{"type":"v1","addr":"172.21.15.142:6837","nonce":3847200126}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24626,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/3619222976","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":3619222976},{"type":"v1","addr":"172.21.15.119:6837","nonce":3619222976}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T01:39:45.145124+0000","modified":"2024-09-21T01:40:27.664151+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24653},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24631":{"gid":24631,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.142:6839/1817880741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6838","nonce":1817880741},{"type":"v1","addr":"172.21.15.142:6839","nonce":1817880741}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24653":{"gid":24653,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.119:6839/3106757092","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":3106757092},{"type":"v1","addr":"172.21.15.119:6839","nonce":3106757092}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24653,"qdb_cluster":[24653]},"id":1}]} 2024-09-21T01:41:30.564 INFO:teuthology.orchestra.run.smithi083.stderr:dumped fsmap epoch 21 2024-09-21T01:41:30.566 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:30.565+0000 7f3da2e88640 1 -- 172.21.15.83:0/469355742 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f3d8c0b65f0 msgr2=0x7f3d8c0b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:30.566 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:30.565+0000 7f3da2e88640 1 --2- 172.21.15.83:0/469355742 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f3d8c0b65f0 0x7f3d8c0b8b00 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f3d90006010 tx=0x7f3d90005a20 comp rx=0 tx=0).stop 2024-09-21T01:41:30.566 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:30.565+0000 7f3da2e88640 1 -- 172.21.15.83:0/469355742 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3d9c108530 msgr2=0x7f3d9c19bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:30.566 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:30.565+0000 7f3da2e88640 1 --2- 172.21.15.83:0/469355742 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3d9c108530 0x7f3d9c19bd30 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f3d9400eaa0 tx=0x7f3d9400ef60 comp rx=0 tx=0).stop 2024-09-21T01:41:30.567 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:30.565+0000 7f3da2e88640 1 -- 172.21.15.83:0/469355742 shutdown_connections 2024-09-21T01:41:30.567 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:30.565+0000 7f3da2e88640 1 --2- 172.21.15.83:0/469355742 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f3d8c0b65f0 0x7f3d8c0b8b00 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:30.567 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:30.565+0000 7f3da2e88640 1 --2- 172.21.15.83:0/469355742 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3d9c108530 0x7f3d9c19bd30 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:30.567 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:30.565+0000 7f3da2e88640 1 --2- 172.21.15.83:0/469355742 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3d9c107be0 0x7f3d9c19b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:30.567 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:30.565+0000 7f3da2e88640 1 --2- 172.21.15.83:0/469355742 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3d9c1022a0 0x7f3d9c19b2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:30.567 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:30.565+0000 7f3da2e88640 1 -- 172.21.15.83:0/469355742 >> 172.21.15.83:0/469355742 conn(0x7f3d9c079ec0 msgr2=0x7f3d9c105d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:41:30.567 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:30.565+0000 7f3da2e88640 1 -- 172.21.15.83:0/469355742 shutdown_connections 2024-09-21T01:41:30.567 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:30.565+0000 7f3da2e88640 1 -- 172.21.15.83:0/469355742 wait complete. 2024-09-21T01:41:31.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:41:30 smithi142 ceph-mon[34050]: from='client.? 172.21.15.83:0/469355742' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:41:31.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:41:30 smithi119 ceph-mon[33693]: from='client.? 172.21.15.83:0/469355742' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:41:31.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:41:30 smithi083 ceph-mon[31370]: from='client.? 172.21.15.83:0/469355742' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:41:31.341 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 21, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-21T01:39:45.145124+0000', 'modified': '2024-09-21T01:40:27.664151+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 24653}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24631': {'gid': 24631, 'name': 'i', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.142:6839/1817880741', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.142:6838', 'nonce': 1817880741}, {'type': 'v1', 'addr': '172.21.15.142:6839', 'nonce': 1817880741}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24653': {'gid': 24653, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.119:6839/3106757092', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.119:6838', 'nonce': 3106757092}, {'type': 'v1', 'addr': '172.21.15.119:6839', 'nonce': 3106757092}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24653, 'qdb_cluster': [24653]} 2024-09-21T01:41:31.341 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-21T01:41:31.341 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph tell mds.b status 2024-09-21T01:41:31.585 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:41:31.985 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:41:31 smithi083 ceph-mon[31370]: pgmap v323: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T01:41:32.077 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.074+0000 7f6cd30cc640 1 -- 172.21.15.83:0/2105264480 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6ccc109e10 msgr2=0x7f6ccc110640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:32.077 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.074+0000 7f6cd30cc640 1 --2- 172.21.15.83:0/2105264480 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6ccc109e10 0x7f6ccc110640 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f6cc4009ca0 tx=0x7f6cc402a8e0 comp rx=0 tx=0).stop 2024-09-21T01:41:32.077 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.074+0000 7f6cd30cc640 1 -- 172.21.15.83:0/2105264480 shutdown_connections 2024-09-21T01:41:32.077 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.074+0000 7f6cd30cc640 1 --2- 172.21.15.83:0/2105264480 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6ccc109e10 0x7f6ccc110640 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:32.077 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.074+0000 7f6cd30cc640 1 --2- 172.21.15.83:0/2105264480 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6ccc1094c0 0x7f6ccc1098d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:32.077 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.074+0000 7f6cd30cc640 1 --2- 172.21.15.83:0/2105264480 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6ccc103b80 0x7f6ccc103f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:32.078 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.074+0000 7f6cd30cc640 1 -- 172.21.15.83:0/2105264480 >> 172.21.15.83:0/2105264480 conn(0x7f6ccc0ff610 msgr2=0x7f6ccc101a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:41:32.078 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.074+0000 7f6cd30cc640 1 -- 172.21.15.83:0/2105264480 shutdown_connections 2024-09-21T01:41:32.078 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.074+0000 7f6cd30cc640 1 -- 172.21.15.83:0/2105264480 wait complete. 2024-09-21T01:41:32.078 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.075+0000 7f6cd30cc640 1 Processor -- start 2024-09-21T01:41:32.078 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.075+0000 7f6cd30cc640 1 -- start start 2024-09-21T01:41:32.078 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.075+0000 7f6cd30cc640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6ccc103b80 0x7f6ccc19a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:32.078 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.075+0000 7f6cd30cc640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6ccc1094c0 0x7f6ccc19a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:32.078 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.075+0000 7f6cd30cc640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6ccc109e10 0x7f6ccc19fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:32.078 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.075+0000 7f6cd30cc640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f6ccc1139c0 con 0x7f6ccc1094c0 2024-09-21T01:41:32.078 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.075+0000 7f6cd30cc640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f6ccc113840 con 0x7f6ccc103b80 2024-09-21T01:41:32.078 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.075+0000 7f6cd30cc640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f6ccc113b40 con 0x7f6ccc109e10 2024-09-21T01:41:32.078 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.075+0000 7f6ccbfff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6ccc1094c0 0x7f6ccc19a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:32.078 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.075+0000 7f6ccbfff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6ccc1094c0 0x7f6ccc19a950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:40470/0 (socket says 172.21.15.83:40470) 2024-09-21T01:41:32.078 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.075+0000 7f6ccbfff640 1 -- 172.21.15.83:0/440123427 learned_addr learned my addr 172.21.15.83:0/440123427 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:41:32.079 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.075+0000 7f6cd0e68640 1 --2- 172.21.15.83:0/440123427 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6ccc103b80 0x7f6ccc19a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:32.079 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.075+0000 7f6cd1669640 1 --2- 172.21.15.83:0/440123427 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6ccc109e10 0x7f6ccc19fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:32.079 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.076+0000 7f6ccbfff640 1 -- 172.21.15.83:0/440123427 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6ccc109e10 msgr2=0x7f6ccc19fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:32.079 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.076+0000 7f6ccbfff640 1 --2- 172.21.15.83:0/440123427 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6ccc109e10 0x7f6ccc19fbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:32.079 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.076+0000 7f6ccbfff640 1 -- 172.21.15.83:0/440123427 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6ccc103b80 msgr2=0x7f6ccc19a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:32.079 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.076+0000 7f6ccbfff640 1 --2- 172.21.15.83:0/440123427 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6ccc103b80 0x7f6ccc19a3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:32.079 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.076+0000 7f6ccbfff640 1 -- 172.21.15.83:0/440123427 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ccc1a0260 con 0x7f6ccc1094c0 2024-09-21T01:41:32.079 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.076+0000 7f6ccbfff640 1 --2- 172.21.15.83:0/440123427 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6ccc1094c0 0x7f6ccc19a950 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f6cb4006fd0 tx=0x7f6cb400b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:41:32.079 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.076+0000 7f6cc9ffb640 1 -- 172.21.15.83:0/440123427 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cb4015020 con 0x7f6ccc1094c0 2024-09-21T01:41:32.079 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.076+0000 7f6cc9ffb640 1 -- 172.21.15.83:0/440123427 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6cb4011cc0 con 0x7f6ccc1094c0 2024-09-21T01:41:32.079 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.076+0000 7f6cd30cc640 1 -- 172.21.15.83:0/440123427 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ccc1a0550 con 0x7f6ccc1094c0 2024-09-21T01:41:32.079 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.076+0000 7f6cc9ffb640 1 -- 172.21.15.83:0/440123427 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cb4010cd0 con 0x7f6ccc1094c0 2024-09-21T01:41:32.079 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.076+0000 7f6cd30cc640 1 -- 172.21.15.83:0/440123427 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ccc1a6d70 con 0x7f6ccc1094c0 2024-09-21T01:41:32.082 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.079+0000 7f6cd9640740 1 Processor -- start 2024-09-21T01:41:32.082 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.079+0000 7f6cd9640740 1 -- start start 2024-09-21T01:41:32.082 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.079+0000 7f6cc9ffb640 1 -- 172.21.15.83:0/440123427 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7f6cb4018020 con 0x7f6ccc1094c0 2024-09-21T01:41:32.082 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.079+0000 7f6cd9640740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f1404c5f60 0x55f14086bf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:32.082 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.079+0000 7f6cd9640740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f14049d0a0 0x55f14086c440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:32.082 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.079+0000 7f6cd9640740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f1404a5280 0x55f14086c980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:32.082 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.079+0000 7f6cd9640740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55f1407e3c10 con 0x55f14049d0a0 2024-09-21T01:41:32.082 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.079+0000 7f6cd9640740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55f1407d3040 con 0x55f1404a5280 2024-09-21T01:41:32.082 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.079+0000 7f6cd9640740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55f1407d6e50 con 0x55f1404c5f60 2024-09-21T01:41:32.082 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.080+0000 7f6cd0e68640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f14049d0a0 0x55f14086c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:32.082 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.080+0000 7f6cd0e68640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f14049d0a0 0x55f14086c440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:40472/0 (socket says 172.21.15.83:40472) 2024-09-21T01:41:32.082 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.080+0000 7f6cd0e68640 1 -- 172.21.15.83:0/975730167 learned_addr learned my addr 172.21.15.83:0/975730167 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:41:32.083 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.080+0000 7f6cd1669640 1 --2- 172.21.15.83:0/975730167 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f1404c5f60 0x55f14086bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:32.083 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.080+0000 7f6ccbfff640 1 --2- 172.21.15.83:0/975730167 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f1404a5280 0x55f14086c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:32.083 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.080+0000 7f6cd0e68640 1 -- 172.21.15.83:0/975730167 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f1404c5f60 msgr2=0x55f14086bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:41:32.083 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.080+0000 7f6cd0e68640 1 --2- 172.21.15.83:0/975730167 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f1404c5f60 0x55f14086bf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:32.083 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.080+0000 7f6cd0e68640 1 -- 172.21.15.83:0/975730167 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f1404a5280 msgr2=0x55f14086c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:41:32.083 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.080+0000 7f6cd0e68640 1 --2- 172.21.15.83:0/975730167 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f1404a5280 0x55f14086c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:32.083 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.080+0000 7f6cd0e68640 1 -- 172.21.15.83:0/975730167 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f140531540 con 0x55f14049d0a0 2024-09-21T01:41:32.083 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.080+0000 7f6cc9ffb640 1 --2- 172.21.15.83:0/440123427 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f6cb80b66a0 0x7f6cb80b8bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:32.083 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.080+0000 7f6cd0e68640 1 --2- 172.21.15.83:0/975730167 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f14049d0a0 0x55f14086c440 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f6cbc00ad00 tx=0x7f6cbc00f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8737bf9e9d2dd58f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:41:32.083 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.080+0000 7f6cd1669640 1 --2- 172.21.15.83:0/440123427 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f6cb80b66a0 0x7f6cb80b8bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:32.083 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.080+0000 7f6cc9ffb640 1 -- 172.21.15.83:0/440123427 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9315+0+0 (secure 0 0 0) 0x7f6cb40e7060 con 0x7f6ccc1094c0 2024-09-21T01:41:32.083 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.080+0000 7f6cc2ffd640 1 -- 172.21.15.83:0/975730167 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cbc01d070 con 0x55f14049d0a0 2024-09-21T01:41:32.083 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.081+0000 7f6cc2ffd640 1 -- 172.21.15.83:0/975730167 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6cbc018ad0 con 0x55f14049d0a0 2024-09-21T01:41:32.083 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.081+0000 7f6cc2ffd640 1 -- 172.21.15.83:0/975730167 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cbc0109d0 con 0x55f14049d0a0 2024-09-21T01:41:32.084 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.081+0000 7f6cd9640740 1 -- 172.21.15.83:0/975730167 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f14049d0a0 msgr2=0x55f14086c440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:32.084 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.081+0000 7f6cd9640740 1 --2- 172.21.15.83:0/975730167 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f14049d0a0 0x55f14086c440 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f6cbc00ad00 tx=0x7f6cbc00f790 comp rx=0 tx=0).stop 2024-09-21T01:41:32.084 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.081+0000 7f6cd1669640 1 --2- 172.21.15.83:0/440123427 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f6cb80b66a0 0x7f6cb80b8bb0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f6cc4031fd0 tx=0x7f6cc40098a0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:41:32.084 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.081+0000 7f6cd9640740 1 -- 172.21.15.83:0/975730167 shutdown_connections 2024-09-21T01:41:32.084 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.081+0000 7f6cd9640740 1 --2- 172.21.15.83:0/975730167 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f1404a5280 0x55f14086c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:32.084 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.081+0000 7f6cd9640740 1 --2- 172.21.15.83:0/975730167 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f14049d0a0 0x55f14086c440 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:32.084 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.081+0000 7f6cd9640740 1 --2- 172.21.15.83:0/975730167 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f1404c5f60 0x55f14086bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:32.084 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.081+0000 7f6cd9640740 1 -- 172.21.15.83:0/975730167 >> 172.21.15.83:0/975730167 conn(0x55f1404ba350 msgr2=0x55f140869df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:41:32.084 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.081+0000 7f6cd9640740 1 -- 172.21.15.83:0/975730167 shutdown_connections 2024-09-21T01:41:32.084 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.081+0000 7f6cd9640740 1 -- 172.21.15.83:0/975730167 wait complete. 2024-09-21T01:41:32.087 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.082+0000 7f6cd9640740 1 -- start start 2024-09-21T01:41:32.087 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.082+0000 7f6cd9640740 1 Processor -- start 2024-09-21T01:41:32.087 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.082+0000 7f6cd9640740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f14049d0a0 0x55f1408779d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:32.087 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.082+0000 7f6cd9640740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f1404a5280 0x55f140877f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:32.087 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.082+0000 7f6cd9640740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f1404c5f60 0x55f140883a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:32.088 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.082+0000 7f6cd9640740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55f1406345f0 con 0x55f1404c5f60 2024-09-21T01:41:32.088 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.082+0000 7f6cd9640740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55f14076e010 con 0x55f1404a5280 2024-09-21T01:41:32.088 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.082+0000 7f6cd9640740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55f14087a6e0 con 0x55f14049d0a0 2024-09-21T01:41:32.088 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.083+0000 7f6cd9640740 10 client.0 _ll_register_callbacks cb 0x55f1407cd340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:41:32.088 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.083+0000 7f6cd1669640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f1404c5f60 0x55f140883a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:32.088 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.083+0000 7f6cd1669640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f1404c5f60 0x55f140883a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:40480/0 (socket says 172.21.15.83:40480) 2024-09-21T01:41:32.088 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.083+0000 7f6cd1669640 1 -- 172.21.15.83:0/882617235 learned_addr learned my addr 172.21.15.83:0/882617235 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:41:32.088 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.083+0000 7f6cd0e68640 1 --2- 172.21.15.83:0/882617235 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f14049d0a0 0x55f1408779d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:32.088 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.083+0000 7f6ccbfff640 1 --2- 172.21.15.83:0/882617235 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f1404a5280 0x55f140877f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:32.088 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.083+0000 7f6cd1669640 1 -- 172.21.15.83:0/882617235 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f14049d0a0 msgr2=0x55f1408779d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:41:32.088 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.083+0000 7f6cd1669640 1 --2- 172.21.15.83:0/882617235 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f14049d0a0 0x55f1408779d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:32.088 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.083+0000 7f6cd1669640 1 -- 172.21.15.83:0/882617235 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f1404a5280 msgr2=0x55f140877f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:41:32.088 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.083+0000 7f6cd1669640 1 --2- 172.21.15.83:0/882617235 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f1404a5280 0x55f140877f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:32.089 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.083+0000 7f6cd1669640 1 -- 172.21.15.83:0/882617235 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f14079ba00 con 0x55f1404c5f60 2024-09-21T01:41:32.089 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.083+0000 7f6cd1669640 1 --2- 172.21.15.83:0/882617235 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f1404c5f60 0x55f140883a00 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f6cc4031d80 tx=0x7f6cc402a8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e27ab45641d695b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:41:32.089 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.083+0000 7f6cabfff640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-09-21T01:41:32.089 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.083+0000 7f6cabfff640 1 -- 172.21.15.83:0/882617235 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cc40047d0 con 0x55f1404c5f60 2024-09-21T01:41:32.089 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.083+0000 7f6cabfff640 1 -- 172.21.15.83:0/882617235 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9315+0+0 (secure 0 0 0) 0x7f6cc40305e0 con 0x55f1404c5f60 2024-09-21T01:41:32.089 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.083+0000 7f6cd9640740 1 -- 172.21.15.83:0/882617235 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6cbc018ad0 con 0x55f1404c5f60 2024-09-21T01:41:32.089 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.084+0000 7f6cabfff640 1 -- 172.21.15.83:0/882617235 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f6cc40307e0 con 0x55f1404c5f60 2024-09-21T01:41:32.089 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.084+0000 7f6cd9640740 10 client.15303 fetch_fsmap learned FSMap version 21 2024-09-21T01:41:32.089 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.084+0000 7f6cd9640740 1 -- 172.21.15.83:0/882617235 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55f140886600 con 0x55f1404c5f60 2024-09-21T01:41:32.089 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.084+0000 7f6cabfff640 1 -- 172.21.15.83:0/882617235 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6cbc018ad0 con 0x55f1404c5f60 2024-09-21T01:41:32.089 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.084+0000 7f6cabfff640 1 -- 172.21.15.83:0/882617235 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f6cc4050070 con 0x55f1404c5f60 2024-09-21T01:41:32.089 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.084+0000 7f6cd9640740 10 client.15303 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T01:41:32.089 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.084+0000 7f6cd9640740 10 client.15303 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-21T01:41:32.089 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.084+0000 7f6cd9640740 20 client.15303 populate_metadata read hostname 'smithi083' 2024-09-21T01:41:32.090 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.084+0000 7f6cd9640740 1 --2- 172.21.15.83:0/882617235 >> [v2:172.21.15.119:6838/3106757092,v1:172.21.15.119:6839/3106757092] conn(0x55f1404848e0 0x55f14088a130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:32.090 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.084+0000 7f6cd9640740 4 client.15303 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:41:32.090 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.084+0000 7f6cd9640740 1 -- 172.21.15.83:0/882617235 --> [v2:172.21.15.119:6838/3106757092,v1:172.21.15.119:6839/3106757092] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f1407e5b60 con 0x55f1404848e0 2024-09-21T01:41:32.090 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.084+0000 7f6cd0e68640 1 --2- 172.21.15.83:0/882617235 >> [v2:172.21.15.119:6838/3106757092,v1:172.21.15.119:6839/3106757092] conn(0x55f1404848e0 0x55f14088a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:32.090 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.085+0000 7f6cabfff640 10 client.15303 ms_handle_connect on v2:172.21.15.119:6838/3106757092 2024-09-21T01:41:32.090 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.085+0000 7f6cd0e68640 1 --2- 172.21.15.83:0/882617235 >> [v2:172.21.15.119:6838/3106757092,v1:172.21.15.119:6839/3106757092] conn(0x55f1404848e0 0x55f14088a130 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=30251a356723a8a6 server_cookie=b0aeba9f7c045307 in_seq=0 out_seq=0 2024-09-21T01:41:32.090 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.086+0000 7f6cabfff640 1 -- 172.21.15.83:0/882617235 <== mds.0 v2:172.21.15.119:6838/3106757092 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f1407e5b60 con 0x55f1404848e0 2024-09-21T01:41:32.090 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.086+0000 7f6cabfff640 10 client.15303 handle_command_reply: tid=0 2024-09-21T01:41:32.090 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.086+0000 7f6cd9640740 1 client.15303 shutdown 2024-09-21T01:41:32.090 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.086+0000 7f6cd9640740 1 -- 172.21.15.83:0/882617235 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f1404c5f60 msgr2=0x55f140883a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:32.090 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.086+0000 7f6cd9640740 1 --2- 172.21.15.83:0/882617235 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f1404c5f60 0x55f140883a00 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f6cc4031d80 tx=0x7f6cc402a8e0 comp rx=0 tx=0).stop 2024-09-21T01:41:32.090 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.086+0000 7f6cd9640740 1 -- 172.21.15.83:0/882617235 shutdown_connections 2024-09-21T01:41:32.090 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.086+0000 7f6cd9640740 1 --2- 172.21.15.83:0/882617235 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f1404c5f60 0x55f140883a00 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:32.090 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.086+0000 7f6cd9640740 1 --2- 172.21.15.83:0/882617235 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f1404a5280 0x55f140877f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:32.091 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.086+0000 7f6cd9640740 1 --2- 172.21.15.83:0/882617235 >> [v2:172.21.15.119:6838/3106757092,v1:172.21.15.119:6839/3106757092] conn(0x55f1404848e0 0x55f14088a130 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:32.091 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.086+0000 7f6cd9640740 1 --2- 172.21.15.83:0/882617235 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f14049d0a0 0x55f1408779d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:32.091 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.086+0000 7f6cd9640740 1 -- 172.21.15.83:0/882617235 >> 172.21.15.83:0/882617235 conn(0x55f1404ba350 msgr2=0x55f14086f090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:41:32.091 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.086+0000 7f6cabfff640 0 client.15303 ms_handle_reset on v2:172.21.15.119:6838/3106757092 2024-09-21T01:41:32.091 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.086+0000 7f6cd9640740 1 -- 172.21.15.83:0/882617235 shutdown_connections 2024-09-21T01:41:32.091 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.086+0000 7f6cd9640740 1 -- 172.21.15.83:0/882617235 wait complete. 2024-09-21T01:41:32.091 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.086+0000 7f6cd9640740 20 client.15303 trim_cache size 0 max 16384 2024-09-21T01:41:32.105 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.104+0000 7f6cd9640740 1 Processor -- start 2024-09-21T01:41:32.105 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.104+0000 7f6cd9640740 1 -- start start 2024-09-21T01:41:32.105 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.104+0000 7f6cd9640740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f14049d0a0 0x55f140872020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:32.106 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.104+0000 7f6cd9640740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f1404a5280 0x55f140883970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:32.106 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.104+0000 7f6cd9640740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f1404c5f60 0x55f140883eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:32.106 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.104+0000 7f6cd9640740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55f140888470 con 0x55f1404a5280 2024-09-21T01:41:32.106 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.104+0000 7f6cd9640740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55f140888b40 con 0x55f1404c5f60 2024-09-21T01:41:32.106 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.104+0000 7f6cd9640740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55f140889210 con 0x55f14049d0a0 2024-09-21T01:41:32.106 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.104+0000 7f6ccbfff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f1404a5280 0x55f140883970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:32.106 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.104+0000 7f6ccbfff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f1404a5280 0x55f140883970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:40496/0 (socket says 172.21.15.83:40496) 2024-09-21T01:41:32.106 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.104+0000 7f6ccbfff640 1 -- 172.21.15.83:0/1012450580 learned_addr learned my addr 172.21.15.83:0/1012450580 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:41:32.106 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.105+0000 7f6cd0e68640 1 --2- 172.21.15.83:0/1012450580 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f14049d0a0 0x55f140872020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:32.106 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.105+0000 7f6cd1669640 1 --2- 172.21.15.83:0/1012450580 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f1404c5f60 0x55f140883eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:32.106 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.105+0000 7f6ccbfff640 1 -- 172.21.15.83:0/1012450580 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f14049d0a0 msgr2=0x55f140872020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:41:32.106 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.105+0000 7f6ccbfff640 1 --2- 172.21.15.83:0/1012450580 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f14049d0a0 0x55f140872020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:32.106 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.105+0000 7f6ccbfff640 1 -- 172.21.15.83:0/1012450580 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f1404c5f60 msgr2=0x55f140883eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:41:32.107 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.105+0000 7f6ccbfff640 1 --2- 172.21.15.83:0/1012450580 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f1404c5f60 0x55f140883eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:32.107 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.105+0000 7f6ccbfff640 1 -- 172.21.15.83:0/1012450580 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f14086ed60 con 0x55f1404a5280 2024-09-21T01:41:32.107 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.105+0000 7f6ccbfff640 1 --2- 172.21.15.83:0/1012450580 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f1404a5280 0x55f140883970 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f6cb40a9ec0 tx=0x7f6cb40047d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95d16b0d78533f9f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:41:32.107 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.105+0000 7f6cc27fc640 1 -- 172.21.15.83:0/1012450580 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cb40a83c0 con 0x55f1404a5280 2024-09-21T01:41:32.107 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.105+0000 7f6cc27fc640 1 -- 172.21.15.83:0/1012450580 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6cb40940b0 con 0x55f1404a5280 2024-09-21T01:41:32.107 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.105+0000 7f6cc27fc640 1 -- 172.21.15.83:0/1012450580 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cb40a8ec0 con 0x55f1404a5280 2024-09-21T01:41:32.111 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.106+0000 7f6cd9640740 1 -- 172.21.15.83:0/1012450580 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f1404a5280 msgr2=0x55f140883970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:32.111 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.106+0000 7f6cd9640740 1 --2- 172.21.15.83:0/1012450580 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f1404a5280 0x55f140883970 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f6cb40a9ec0 tx=0x7f6cb40047d0 comp rx=0 tx=0).stop 2024-09-21T01:41:32.111 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.106+0000 7f6cd9640740 1 -- 172.21.15.83:0/1012450580 shutdown_connections 2024-09-21T01:41:32.111 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.106+0000 7f6cd9640740 1 --2- 172.21.15.83:0/1012450580 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f1404c5f60 0x55f140883eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:32.111 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.106+0000 7f6cd9640740 1 --2- 172.21.15.83:0/1012450580 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f1404a5280 0x55f140883970 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:32.111 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.106+0000 7f6cd9640740 1 --2- 172.21.15.83:0/1012450580 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f14049d0a0 0x55f140872020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:32.111 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.106+0000 7f6cd9640740 1 -- 172.21.15.83:0/1012450580 >> 172.21.15.83:0/1012450580 conn(0x55f1404ba350 msgr2=0x55f140864ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:41:32.111 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.106+0000 7f6cd9640740 1 -- 172.21.15.83:0/1012450580 shutdown_connections 2024-09-21T01:41:32.111 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.106+0000 7f6cd9640740 1 -- 172.21.15.83:0/1012450580 wait complete. 2024-09-21T01:41:32.111 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.106+0000 7f6cd9640740 1 -- start start 2024-09-21T01:41:32.111 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.106+0000 7f6cd9640740 1 Processor -- start 2024-09-21T01:41:32.111 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.107+0000 7f6cd9640740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f14049d0a0 0x55f140892a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:32.112 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.107+0000 7f6cd9640740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f1404a5280 0x55f14088bf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:32.112 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.107+0000 7f6cd9640740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f1404c5f60 0x55f14088c450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:32.112 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.107+0000 7f6cd9640740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55f140889fb0 con 0x55f14049d0a0 2024-09-21T01:41:32.112 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.107+0000 7f6cd9640740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55f1408898e0 con 0x55f1404a5280 2024-09-21T01:41:32.112 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.107+0000 7f6cd9640740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55f14088a680 con 0x55f1404c5f60 2024-09-21T01:41:32.112 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.107+0000 7f6cd9640740 10 client.0 _ll_register_callbacks cb 0x7f6cc4031470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:41:32.112 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.107+0000 7f6cd0e68640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f14049d0a0 0x55f140892a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:32.112 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.107+0000 7f6cd0e68640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f14049d0a0 0x55f140892a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:40502/0 (socket says 172.21.15.83:40502) 2024-09-21T01:41:32.112 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.107+0000 7f6cd0e68640 1 -- 172.21.15.83:0/976553381 learned_addr learned my addr 172.21.15.83:0/976553381 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:41:32.112 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.107+0000 7f6ccbfff640 1 --2- 172.21.15.83:0/976553381 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f1404a5280 0x55f14088bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:32.112 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.107+0000 7f6cd1669640 1 --2- 172.21.15.83:0/976553381 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f1404c5f60 0x55f14088c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:32.112 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.107+0000 7f6cd0e68640 1 -- 172.21.15.83:0/976553381 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f1404c5f60 msgr2=0x55f14088c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:41:32.112 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.107+0000 7f6cd0e68640 1 --2- 172.21.15.83:0/976553381 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f1404c5f60 0x55f14088c450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:32.112 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.107+0000 7f6cd0e68640 1 -- 172.21.15.83:0/976553381 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f1404a5280 msgr2=0x55f14088bf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:41:32.112 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.107+0000 7f6cd0e68640 1 --2- 172.21.15.83:0/976553381 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f1404a5280 0x55f14088bf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:32.113 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.107+0000 7f6cd0e68640 1 -- 172.21.15.83:0/976553381 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f14088ca90 con 0x55f14049d0a0 2024-09-21T01:41:32.113 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.107+0000 7f6ccbfff640 1 --2- 172.21.15.83:0/976553381 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f1404a5280 0x55f14088bf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:41:32.113 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.108+0000 7f6cd0e68640 1 --2- 172.21.15.83:0/976553381 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f14049d0a0 0x55f140892a60 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f6cbc000c00 tx=0x7f6cbc010450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f3da02590c62bdf server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:41:32.113 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.108+0000 7f6cabfff640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-09-21T01:41:32.113 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.108+0000 7f6cabfff640 1 -- 172.21.15.83:0/976553381 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cbc01d040 con 0x55f14049d0a0 2024-09-21T01:41:32.113 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.108+0000 7f6cabfff640 1 -- 172.21.15.83:0/976553381 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9315+0+0 (secure 0 0 0) 0x7f6cbc018800 con 0x55f14049d0a0 2024-09-21T01:41:32.113 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.108+0000 7f6cd9640740 1 -- 172.21.15.83:0/976553381 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55f1407e1610 con 0x55f14049d0a0 2024-09-21T01:41:32.113 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.108+0000 7f6cabfff640 1 -- 172.21.15.83:0/976553381 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f6cbc018a00 con 0x55f14049d0a0 2024-09-21T01:41:32.113 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.108+0000 7f6cd9640740 10 client.15309 fetch_fsmap learned FSMap version 21 2024-09-21T01:41:32.113 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.108+0000 7f6cd9640740 1 -- 172.21.15.83:0/976553381 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55f1408924c0 con 0x55f14049d0a0 2024-09-21T01:41:32.113 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.108+0000 7f6cabfff640 1 -- 172.21.15.83:0/976553381 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55f1407e1610 con 0x55f14049d0a0 2024-09-21T01:41:32.113 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.108+0000 7f6cabfff640 1 -- 172.21.15.83:0/976553381 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f6cbc004780 con 0x55f14049d0a0 2024-09-21T01:41:32.113 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.108+0000 7f6cd9640740 10 client.15309 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T01:41:32.113 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.108+0000 7f6cd9640740 10 client.15309 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-21T01:41:32.113 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.108+0000 7f6cd9640740 20 client.15309 populate_metadata read hostname 'smithi083' 2024-09-21T01:41:32.114 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.108+0000 7f6cd9640740 1 --2- 172.21.15.83:0/976553381 >> [v2:172.21.15.119:6838/3106757092,v1:172.21.15.119:6839/3106757092] conn(0x55f140459c90 0x55f1408f8bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:32.114 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.109+0000 7f6cd9640740 4 client.15309 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T01:41:32.114 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.109+0000 7f6cd9640740 1 -- 172.21.15.83:0/976553381 --> [v2:172.21.15.119:6838/3106757092,v1:172.21.15.119:6839/3106757092] -- command(tid 0: {"prefix": "status"}) -- 0x55f1407dea40 con 0x55f140459c90 2024-09-21T01:41:32.114 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.109+0000 7f6ccbfff640 1 --2- 172.21.15.83:0/976553381 >> [v2:172.21.15.119:6838/3106757092,v1:172.21.15.119:6839/3106757092] conn(0x55f140459c90 0x55f1408f8bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:32.114 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.109+0000 7f6cabfff640 10 client.15309 ms_handle_connect on v2:172.21.15.119:6838/3106757092 2024-09-21T01:41:32.114 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.109+0000 7f6ccbfff640 1 --2- 172.21.15.83:0/976553381 >> [v2:172.21.15.119:6838/3106757092,v1:172.21.15.119:6839/3106757092] conn(0x55f140459c90 0x55f1408f8bf0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9ffbf492acfe5b24 server_cookie=20366fa32add5275 in_seq=0 out_seq=0 2024-09-21T01:41:32.114 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.109+0000 7f6cabfff640 1 -- 172.21.15.83:0/976553381 <== mds.0 v2:172.21.15.119:6838/3106757092 1 ==== command_reply(tid 0: 0 ) ==== 8+0+322 (crc 0 0 0) 0x55f1407dea40 con 0x55f140459c90 2024-09-21T01:41:32.114 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.109+0000 7f6cabfff640 10 client.15309 handle_command_reply: tid=0 2024-09-21T01:41:32.114 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.109+0000 7f6cd9640740 1 client.15309 shutdown 2024-09-21T01:41:32.114 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.110+0000 7f6cd9640740 1 -- 172.21.15.83:0/976553381 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f14049d0a0 msgr2=0x55f140892a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:32.114 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.110+0000 7f6cd9640740 1 --2- 172.21.15.83:0/976553381 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f14049d0a0 0x55f140892a60 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f6cbc000c00 tx=0x7f6cbc010450 comp rx=0 tx=0).stop 2024-09-21T01:41:32.114 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.110+0000 7f6cd9640740 1 -- 172.21.15.83:0/976553381 shutdown_connections 2024-09-21T01:41:32.114 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.110+0000 7f6cd9640740 1 --2- 172.21.15.83:0/976553381 >> [v2:172.21.15.119:6838/3106757092,v1:172.21.15.119:6839/3106757092] conn(0x55f140459c90 0x55f1408f8bf0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:32.115 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.110+0000 7f6cd9640740 1 --2- 172.21.15.83:0/976553381 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f1404c5f60 0x55f14088c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:32.115 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.110+0000 7f6cd9640740 1 --2- 172.21.15.83:0/976553381 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f1404a5280 0x55f14088bf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:32.115 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.110+0000 7f6cd9640740 1 --2- 172.21.15.83:0/976553381 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55f14049d0a0 0x55f140892a60 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:32.115 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.110+0000 7f6cd9640740 1 -- 172.21.15.83:0/976553381 >> 172.21.15.83:0/976553381 conn(0x55f1404ba350 msgr2=0x55f140864ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:41:32.115 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.110+0000 7f6cabfff640 0 client.15309 ms_handle_reset on v2:172.21.15.119:6838/3106757092 2024-09-21T01:41:32.115 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.110+0000 7f6cd9640740 1 -- 172.21.15.83:0/976553381 shutdown_connections 2024-09-21T01:41:32.115 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.110+0000 7f6cd9640740 1 -- 172.21.15.83:0/976553381 wait complete. 2024-09-21T01:41:32.115 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.110+0000 7f6cd9640740 20 client.15309 trim_cache size 0 max 16384 2024-09-21T01:41:32.115 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-09-21T01:41:32.115 INFO:teuthology.orchestra.run.smithi083.stdout: "cluster_fsid": "f7697ecc-77b8-11ef-baf5-efdc52797490", 2024-09-21T01:41:32.116 INFO:teuthology.orchestra.run.smithi083.stdout: "whoami": 0, 2024-09-21T01:41:32.116 INFO:teuthology.orchestra.run.smithi083.stdout: "id": 24653, 2024-09-21T01:41:32.116 INFO:teuthology.orchestra.run.smithi083.stdout: "want_state": "up:active", 2024-09-21T01:41:32.116 INFO:teuthology.orchestra.run.smithi083.stdout: "state": "up:active", 2024-09-21T01:41:32.116 INFO:teuthology.orchestra.run.smithi083.stdout: "fs_name": "cephfs", 2024-09-21T01:41:32.116 INFO:teuthology.orchestra.run.smithi083.stdout: "rank_uptime": 106.829388081, 2024-09-21T01:41:32.116 INFO:teuthology.orchestra.run.smithi083.stdout: "mdsmap_epoch": 21, 2024-09-21T01:41:32.116 INFO:teuthology.orchestra.run.smithi083.stdout: "osdmap_epoch": 84, 2024-09-21T01:41:32.116 INFO:teuthology.orchestra.run.smithi083.stdout: "osdmap_epoch_barrier": 82, 2024-09-21T01:41:32.116 INFO:teuthology.orchestra.run.smithi083.stdout: "uptime": 117.198455615 2024-09-21T01:41:32.116 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-09-21T01:41:32.117 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.110+0000 7f6cd30cc640 1 -- 172.21.15.83:0/440123427 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f6cb80b66a0 msgr2=0x7f6cb80b8bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:32.117 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.110+0000 7f6cd30cc640 1 --2- 172.21.15.83:0/440123427 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f6cb80b66a0 0x7f6cb80b8bb0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f6cc4031fd0 tx=0x7f6cc40098a0 comp rx=0 tx=0).stop 2024-09-21T01:41:32.117 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.110+0000 7f6cd30cc640 1 -- 172.21.15.83:0/440123427 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6ccc1094c0 msgr2=0x7f6ccc19a950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:32.117 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.110+0000 7f6cd30cc640 1 --2- 172.21.15.83:0/440123427 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6ccc1094c0 0x7f6ccc19a950 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f6cb4006fd0 tx=0x7f6cb400b820 comp rx=0 tx=0).stop 2024-09-21T01:41:32.117 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.111+0000 7f6cd30cc640 1 -- 172.21.15.83:0/440123427 shutdown_connections 2024-09-21T01:41:32.117 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.111+0000 7f6cd30cc640 1 --2- 172.21.15.83:0/440123427 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f6cb80b66a0 0x7f6cb80b8bb0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:32.117 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.111+0000 7f6cd30cc640 1 --2- 172.21.15.83:0/440123427 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6ccc109e10 0x7f6ccc19fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:32.117 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.111+0000 7f6cd30cc640 1 --2- 172.21.15.83:0/440123427 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6ccc1094c0 0x7f6ccc19a950 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:32.117 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.111+0000 7f6cd30cc640 1 --2- 172.21.15.83:0/440123427 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6ccc103b80 0x7f6ccc19a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:32.117 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.111+0000 7f6cd30cc640 1 -- 172.21.15.83:0/440123427 >> 172.21.15.83:0/440123427 conn(0x7f6ccc0ff610 msgr2=0x7f6ccc108b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:41:32.117 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.111+0000 7f6cd30cc640 1 -- 172.21.15.83:0/440123427 shutdown_connections 2024-09-21T01:41:32.117 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:32.111+0000 7f6cd30cc640 1 -- 172.21.15.83:0/440123427 wait complete. 2024-09-21T01:41:32.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:41:31 smithi142 ceph-mon[34050]: pgmap v323: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T01:41:32.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:41:31 smithi119 ceph-mon[33693]: pgmap v323: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T01:41:32.846 INFO:tasks.cephadm:Setup complete, yielding 2024-09-21T01:41:32.846 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-21T01:41:32.855 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi083.front.sepia.ceph.com 2024-09-21T01:41:32.856 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- bash -c 'ceph orch status' 2024-09-21T01:41:33.102 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:41:33.595 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:33.594+0000 7fd7337c8640 1 -- 172.21.15.83:0/3855490897 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd72c103b80 msgr2=0x7fd72c103f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:33.595 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:33.594+0000 7fd7337c8640 1 --2- 172.21.15.83:0/3855490897 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd72c103b80 0x7fd72c103f90 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fd728009900 tx=0x7fd72802a410 comp rx=0 tx=0).stop 2024-09-21T01:41:33.595 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:33.594+0000 7fd7337c8640 1 -- 172.21.15.83:0/3855490897 shutdown_connections 2024-09-21T01:41:33.595 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:33.594+0000 7fd7337c8640 1 --2- 172.21.15.83:0/3855490897 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd72c109e10 0x7fd72c110640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:33.595 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:33.594+0000 7fd7337c8640 1 --2- 172.21.15.83:0/3855490897 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd72c1094c0 0x7fd72c1098d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:33.595 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:33.594+0000 7fd7337c8640 1 --2- 172.21.15.83:0/3855490897 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd72c103b80 0x7fd72c103f90 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:33.595 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:33.594+0000 7fd7337c8640 1 -- 172.21.15.83:0/3855490897 >> 172.21.15.83:0/3855490897 conn(0x7fd72c0ff5d0 msgr2=0x7fd72c101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:41:33.595 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:33.594+0000 7fd7337c8640 1 -- 172.21.15.83:0/3855490897 shutdown_connections 2024-09-21T01:41:33.595 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:33.594+0000 7fd7337c8640 1 -- 172.21.15.83:0/3855490897 wait complete. 2024-09-21T01:41:33.595 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:33.594+0000 7fd7337c8640 1 Processor -- start 2024-09-21T01:41:33.596 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:33.594+0000 7fd7337c8640 1 -- start start 2024-09-21T01:41:33.596 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:33.595+0000 7fd7337c8640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd72c103b80 0x7fd72c19a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:33.596 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:33.595+0000 7fd7337c8640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd72c1094c0 0x7fd72c19aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:33.596 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:33.595+0000 7fd7337c8640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd72c109e10 0x7fd72c19fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:33.596 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:33.595+0000 7fd7337c8640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fd72c113a40 con 0x7fd72c103b80 2024-09-21T01:41:33.596 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:33.595+0000 7fd7337c8640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fd72c1138c0 con 0x7fd72c1094c0 2024-09-21T01:41:33.596 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:33.595+0000 7fd7337c8640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fd72c113bc0 con 0x7fd72c109e10 2024-09-21T01:41:33.597 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:33.595+0000 7fd731564640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd72c103b80 0x7fd72c19a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:33.597 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:33.595+0000 7fd731564640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd72c103b80 0x7fd72c19a530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:38998/0 (socket says 172.21.15.83:38998) 2024-09-21T01:41:33.597 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:33.595+0000 7fd731564640 1 -- 172.21.15.83:0/388451231 learned_addr learned my addr 172.21.15.83:0/388451231 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:41:33.598 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:33.595+0000 7fd731d65640 1 --2- 172.21.15.83:0/388451231 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd72c109e10 0x7fd72c19fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:33.598 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:33.595+0000 7fd730d63640 1 --2- 172.21.15.83:0/388451231 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd72c1094c0 0x7fd72c19aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:33.598 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:33.595+0000 7fd731564640 1 -- 172.21.15.83:0/388451231 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd72c109e10 msgr2=0x7fd72c19fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:33.598 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:33.595+0000 7fd731564640 1 --2- 172.21.15.83:0/388451231 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd72c109e10 0x7fd72c19fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:33.598 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:33.595+0000 7fd731564640 1 -- 172.21.15.83:0/388451231 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd72c1094c0 msgr2=0x7fd72c19aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:33.598 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:33.595+0000 7fd731564640 1 --2- 172.21.15.83:0/388451231 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd72c1094c0 0x7fd72c19aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:33.598 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:33.595+0000 7fd731564640 1 -- 172.21.15.83:0/388451231 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd72c1a04a0 con 0x7fd72c103b80 2024-09-21T01:41:33.598 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:33.595+0000 7fd731d65640 1 --2- 172.21.15.83:0/388451231 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd72c109e10 0x7fd72c19fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:41:33.598 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:33.595+0000 7fd731564640 1 --2- 172.21.15.83:0/388451231 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd72c103b80 0x7fd72c19a530 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fd728009a20 tx=0x7fd728004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:41:33.598 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:33.595+0000 7fd7227fc640 1 -- 172.21.15.83:0/388451231 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd72803f030 con 0x7fd72c103b80 2024-09-21T01:41:33.598 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:33.596+0000 7fd7337c8640 1 -- 172.21.15.83:0/388451231 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd72c1a0730 con 0x7fd72c103b80 2024-09-21T01:41:33.598 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:33.596+0000 7fd7227fc640 1 -- 172.21.15.83:0/388451231 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd7280035f0 con 0x7fd72c103b80 2024-09-21T01:41:33.598 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:33.596+0000 7fd7227fc640 1 -- 172.21.15.83:0/388451231 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd728035070 con 0x7fd72c103b80 2024-09-21T01:41:33.598 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:33.596+0000 7fd7337c8640 1 -- 172.21.15.83:0/388451231 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd72c1a6ef0 con 0x7fd72c103b80 2024-09-21T01:41:33.599 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:33.597+0000 7fd7337c8640 1 -- 172.21.15.83:0/388451231 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd72c104010 con 0x7fd72c103b80 2024-09-21T01:41:33.599 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:33.598+0000 7fd7227fc640 1 -- 172.21.15.83:0/388451231 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7fd728003aa0 con 0x7fd72c103b80 2024-09-21T01:41:33.599 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:33.599+0000 7fd7227fc640 1 --2- 172.21.15.83:0/388451231 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fd7180b65f0 0x7fd7180b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:33.599 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:33.599+0000 7fd730d63640 1 --2- 172.21.15.83:0/388451231 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fd7180b65f0 0x7fd7180b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:33.599 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:33.599+0000 7fd7227fc640 1 -- 172.21.15.83:0/388451231 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9315+0+0 (secure 0 0 0) 0x7fd7281089a0 con 0x7fd72c103b80 2024-09-21T01:41:33.600 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:33.600+0000 7fd730d63640 1 --2- 172.21.15.83:0/388451231 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fd7180b65f0 0x7fd7180b8b00 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fd72c109140 tx=0x7fd71c008040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:41:33.602 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:33.602+0000 7fd7227fc640 1 -- 172.21.15.83:0/388451231 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd7280cec90 con 0x7fd72c103b80 2024-09-21T01:41:33.797 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:33.796+0000 7fd7337c8640 1 -- 172.21.15.83:0/388451231 --> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7fd72c063800 con 0x7fd7180b65f0 2024-09-21T01:41:33.798 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:33.798+0000 7fd7227fc640 1 -- 172.21.15.83:0/388451231 <== mgr.14223 v2:172.21.15.83:6800/1748483157 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7fd72c063800 con 0x7fd7180b65f0 2024-09-21T01:41:33.798 INFO:teuthology.orchestra.run.smithi083.stdout:Backend: cephadm 2024-09-21T01:41:33.798 INFO:teuthology.orchestra.run.smithi083.stdout:Available: Yes 2024-09-21T01:41:33.798 INFO:teuthology.orchestra.run.smithi083.stdout:Paused: No 2024-09-21T01:41:33.801 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:33.800+0000 7fd7337c8640 1 -- 172.21.15.83:0/388451231 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fd7180b65f0 msgr2=0x7fd7180b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:33.801 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:33.800+0000 7fd7337c8640 1 --2- 172.21.15.83:0/388451231 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fd7180b65f0 0x7fd7180b8b00 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fd72c109140 tx=0x7fd71c008040 comp rx=0 tx=0).stop 2024-09-21T01:41:33.801 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:33.800+0000 7fd7337c8640 1 -- 172.21.15.83:0/388451231 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd72c103b80 msgr2=0x7fd72c19a530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:33.801 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:33.800+0000 7fd7337c8640 1 --2- 172.21.15.83:0/388451231 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd72c103b80 0x7fd72c19a530 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fd728009a20 tx=0x7fd728004270 comp rx=0 tx=0).stop 2024-09-21T01:41:33.801 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:33.800+0000 7fd7337c8640 1 -- 172.21.15.83:0/388451231 shutdown_connections 2024-09-21T01:41:33.801 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:33.800+0000 7fd7337c8640 1 --2- 172.21.15.83:0/388451231 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fd7180b65f0 0x7fd7180b8b00 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:33.801 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:33.800+0000 7fd7337c8640 1 --2- 172.21.15.83:0/388451231 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd72c109e10 0x7fd72c19fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:33.801 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:33.800+0000 7fd7337c8640 1 --2- 172.21.15.83:0/388451231 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd72c1094c0 0x7fd72c19aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:33.801 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:33.800+0000 7fd7337c8640 1 --2- 172.21.15.83:0/388451231 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd72c103b80 0x7fd72c19a530 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:33.801 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:33.800+0000 7fd7337c8640 1 -- 172.21.15.83:0/388451231 >> 172.21.15.83:0/388451231 conn(0x7fd72c0ff5d0 msgr2=0x7fd72c1019f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:41:33.801 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:33.800+0000 7fd7337c8640 1 -- 172.21.15.83:0/388451231 shutdown_connections 2024-09-21T01:41:33.801 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:33.800+0000 7fd7337c8640 1 -- 172.21.15.83:0/388451231 wait complete. 2024-09-21T01:41:34.053 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:41:33 smithi083 ceph-mon[31370]: pgmap v324: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:41:34.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:41:33 smithi142 ceph-mon[34050]: pgmap v324: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:41:34.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:41:33 smithi119 ceph-mon[33693]: pgmap v324: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:41:34.588 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- bash -c 'ceph orch ps' 2024-09-21T01:41:34.836 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:41:35.118 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:41:34 smithi083 ceph-mon[31370]: from='client.15315 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:41:35.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:41:34 smithi142 ceph-mon[34050]: from='client.15315 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:41:35.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:41:34 smithi119 ceph-mon[33693]: from='client.15315 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:41:35.324 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:35.321+0000 7fb263850640 1 -- 172.21.15.83:0/2983789486 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb25c103bb0 msgr2=0x7fb25c103fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:35.324 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:35.321+0000 7fb263850640 1 --2- 172.21.15.83:0/2983789486 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb25c103bb0 0x7fb25c103fc0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fb258009900 tx=0x7fb25802a410 comp rx=0 tx=0).stop 2024-09-21T01:41:35.324 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:35.321+0000 7fb263850640 1 -- 172.21.15.83:0/2983789486 shutdown_connections 2024-09-21T01:41:35.324 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:35.321+0000 7fb263850640 1 --2- 172.21.15.83:0/2983789486 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb25c109e40 0x7fb25c110670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:35.324 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:35.321+0000 7fb263850640 1 --2- 172.21.15.83:0/2983789486 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb25c1094f0 0x7fb25c109900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:35.324 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:35.321+0000 7fb263850640 1 --2- 172.21.15.83:0/2983789486 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb25c103bb0 0x7fb25c103fc0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:35.325 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:35.321+0000 7fb263850640 1 -- 172.21.15.83:0/2983789486 >> 172.21.15.83:0/2983789486 conn(0x7fb25c0ff600 msgr2=0x7fb25c101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:41:35.325 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:35.321+0000 7fb263850640 1 -- 172.21.15.83:0/2983789486 shutdown_connections 2024-09-21T01:41:35.325 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:35.321+0000 7fb263850640 1 -- 172.21.15.83:0/2983789486 wait complete. 2024-09-21T01:41:35.325 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:35.321+0000 7fb263850640 1 Processor -- start 2024-09-21T01:41:35.325 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:35.321+0000 7fb263850640 1 -- start start 2024-09-21T01:41:35.325 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:35.322+0000 7fb263850640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb25c103bb0 0x7fb25c19a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:35.325 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:35.322+0000 7fb263850640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb25c1094f0 0x7fb25c19a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:35.325 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:35.322+0000 7fb263850640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb25c109e40 0x7fb25c19fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:35.325 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:35.322+0000 7fb263850640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fb25c1139b0 con 0x7fb25c109e40 2024-09-21T01:41:35.325 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:35.322+0000 7fb263850640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fb25c113830 con 0x7fb25c1094f0 2024-09-21T01:41:35.325 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:35.322+0000 7fb263850640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fb25c113b30 con 0x7fb25c103bb0 2024-09-21T01:41:35.325 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:35.322+0000 7fb261ded640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb25c109e40 0x7fb25c19fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:35.325 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:35.322+0000 7fb261ded640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb25c109e40 0x7fb25c19fc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:39016/0 (socket says 172.21.15.83:39016) 2024-09-21T01:41:35.325 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:35.322+0000 7fb261ded640 1 -- 172.21.15.83:0/3477901397 learned_addr learned my addr 172.21.15.83:0/3477901397 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:41:35.326 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:35.322+0000 7fb2615ec640 1 --2- 172.21.15.83:0/3477901397 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb25c103bb0 0x7fb25c19a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:35.326 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:35.322+0000 7fb260deb640 1 --2- 172.21.15.83:0/3477901397 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb25c1094f0 0x7fb25c19a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:35.326 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:35.322+0000 7fb261ded640 1 -- 172.21.15.83:0/3477901397 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb25c103bb0 msgr2=0x7fb25c19a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:35.326 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:35.322+0000 7fb261ded640 1 --2- 172.21.15.83:0/3477901397 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb25c103bb0 0x7fb25c19a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:35.326 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:35.322+0000 7fb261ded640 1 -- 172.21.15.83:0/3477901397 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb25c1094f0 msgr2=0x7fb25c19a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:35.326 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:35.322+0000 7fb261ded640 1 --2- 172.21.15.83:0/3477901397 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb25c1094f0 0x7fb25c19a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:35.326 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:35.322+0000 7fb261ded640 1 -- 172.21.15.83:0/3477901397 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb25c1a0390 con 0x7fb25c109e40 2024-09-21T01:41:35.326 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:35.322+0000 7fb260deb640 1 --2- 172.21.15.83:0/3477901397 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb25c1094f0 0x7fb25c19a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:41:35.326 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:35.322+0000 7fb261ded640 1 --2- 172.21.15.83:0/3477901397 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb25c109e40 0x7fb25c19fc60 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fb25400cad0 tx=0x7fb25400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:41:35.326 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:35.322+0000 7fb2527fc640 1 -- 172.21.15.83:0/3477901397 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb25400ae20 con 0x7fb25c109e40 2024-09-21T01:41:35.326 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:35.323+0000 7fb2527fc640 1 -- 172.21.15.83:0/3477901397 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb254005020 con 0x7fb25c109e40 2024-09-21T01:41:35.326 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:35.323+0000 7fb263850640 1 -- 172.21.15.83:0/3477901397 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb25c1a0680 con 0x7fb25c109e40 2024-09-21T01:41:35.326 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:35.323+0000 7fb2527fc640 1 -- 172.21.15.83:0/3477901397 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb25400f6b0 con 0x7fb25c109e40 2024-09-21T01:41:35.326 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:35.323+0000 7fb263850640 1 -- 172.21.15.83:0/3477901397 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb25c1a6de0 con 0x7fb25c109e40 2024-09-21T01:41:35.327 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:35.324+0000 7fb263850640 1 -- 172.21.15.83:0/3477901397 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb25c103fc0 con 0x7fb25c109e40 2024-09-21T01:41:35.327 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:35.325+0000 7fb2527fc640 1 -- 172.21.15.83:0/3477901397 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7fb2540051d0 con 0x7fb25c109e40 2024-09-21T01:41:35.327 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:35.326+0000 7fb2527fc640 1 --2- 172.21.15.83:0/3477901397 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fb2480b65f0 0x7fb2480b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:35.327 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:35.326+0000 7fb2615ec640 1 --2- 172.21.15.83:0/3477901397 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fb2480b65f0 0x7fb2480b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:35.327 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:35.326+0000 7fb2527fc640 1 -- 172.21.15.83:0/3477901397 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9315+0+0 (secure 0 0 0) 0x7fb2540e7da0 con 0x7fb25c109e40 2024-09-21T01:41:35.328 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:35.327+0000 7fb2615ec640 1 --2- 172.21.15.83:0/3477901397 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fb2480b65f0 0x7fb2480b8b00 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fb258000c00 tx=0x7fb258009680 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:41:35.331 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:35.331+0000 7fb2527fc640 1 -- 172.21.15.83:0/3477901397 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb254014030 con 0x7fb25c109e40 2024-09-21T01:41:35.521 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:35.521+0000 7fb263850640 1 -- 172.21.15.83:0/3477901397 --> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fb25c063800 con 0x7fb2480b65f0 2024-09-21T01:41:35.533 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:35.533+0000 7fb2527fc640 1 -- 172.21.15.83:0/3477901397 <== mgr.14223 v2:172.21.15.83:6800/1748483157 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+4123 (secure 0 0 0) 0x7fb25c063800 con 0x7fb2480b65f0 2024-09-21T01:41:35.534 INFO:teuthology.orchestra.run.smithi083.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T01:41:35.534 INFO:teuthology.orchestra.run.smithi083.stdout:mds.a smithi083 running (2m) 51s ago 2m 84.3M - 19.3.0-5120-g18432218 ddce307e1f32 7a0c36cd773c 2024-09-21T01:41:35.534 INFO:teuthology.orchestra.run.smithi083.stdout:mds.b smithi119 running (2m) 53s ago 2m 93.1M - 19.3.0-5120-g18432218 ddce307e1f32 13a7f0fdc45c 2024-09-21T01:41:35.534 INFO:teuthology.orchestra.run.smithi083.stdout:mds.c smithi142 running (2m) 53s ago 2m 82.1M - 19.3.0-5120-g18432218 ddce307e1f32 98e7d6abd2f8 2024-09-21T01:41:35.534 INFO:teuthology.orchestra.run.smithi083.stdout:mds.d smithi083 running (2m) 51s ago 2m 82.6M - 19.3.0-5120-g18432218 ddce307e1f32 0362213760c2 2024-09-21T01:41:35.534 INFO:teuthology.orchestra.run.smithi083.stdout:mds.e smithi119 running (2m) 53s ago 2m 83.3M - 19.3.0-5120-g18432218 ddce307e1f32 c478ffa75208 2024-09-21T01:41:35.534 INFO:teuthology.orchestra.run.smithi083.stdout:mds.f smithi142 running (2m) 53s ago 2m 84.5M - 19.3.0-5120-g18432218 ddce307e1f32 fd9589afba7f 2024-09-21T01:41:35.534 INFO:teuthology.orchestra.run.smithi083.stdout:mds.g smithi083 running (2m) 51s ago 2m 82.3M - 19.3.0-5120-g18432218 ddce307e1f32 916c01e0c410 2024-09-21T01:41:35.534 INFO:teuthology.orchestra.run.smithi083.stdout:mds.h smithi119 running (2m) 53s ago 2m 84.5M - 19.3.0-5120-g18432218 ddce307e1f32 774eb2d30891 2024-09-21T01:41:35.535 INFO:teuthology.orchestra.run.smithi083.stdout:mds.i smithi142 running (2m) 53s ago 2m 84.2M - 19.3.0-5120-g18432218 ddce307e1f32 5a605597b7bd 2024-09-21T01:41:35.535 INFO:teuthology.orchestra.run.smithi083.stdout:mds.j smithi083 running (2m) 51s ago 2m 84.4M - 19.3.0-5120-g18432218 ddce307e1f32 d15b41d88073 2024-09-21T01:41:35.535 INFO:teuthology.orchestra.run.smithi083.stdout:mds.k smithi119 running (2m) 53s ago 2m 82.0M - 19.3.0-5120-g18432218 ddce307e1f32 cba2f40bb233 2024-09-21T01:41:35.535 INFO:teuthology.orchestra.run.smithi083.stdout:mds.l smithi142 running (2m) 53s ago 2m 82.0M - 19.3.0-5120-g18432218 ddce307e1f32 884e26929314 2024-09-21T01:41:35.535 INFO:teuthology.orchestra.run.smithi083.stdout:mgr.x smithi083 *:9283,8765 running (10m) 51s ago 10m 583M - 19.3.0-5120-g18432218 ddce307e1f32 8dfd8ae89088 2024-09-21T01:41:35.535 INFO:teuthology.orchestra.run.smithi083.stdout:mgr.y smithi119 *:8443,8765 running (8m) 53s ago 8m 524M - 19.3.0-5120-g18432218 ddce307e1f32 ecc355a207af 2024-09-21T01:41:35.535 INFO:teuthology.orchestra.run.smithi083.stdout:mgr.z smithi142 *:8443,8765 running (8m) 53s ago 8m 526M - 19.3.0-5120-g18432218 ddce307e1f32 430c2f99376b 2024-09-21T01:41:35.535 INFO:teuthology.orchestra.run.smithi083.stdout:mon.a smithi083 running (10m) 51s ago 10m 120M 2048M 19.3.0-5120-g18432218 ddce307e1f32 97cefa149ed9 2024-09-21T01:41:35.535 INFO:teuthology.orchestra.run.smithi083.stdout:mon.b smithi119 running (8m) 53s ago 8m 110M 2048M 19.3.0-5120-g18432218 ddce307e1f32 22c3ca81becc 2024-09-21T01:41:35.535 INFO:teuthology.orchestra.run.smithi083.stdout:mon.c smithi142 running (8m) 53s ago 8m 113M 2048M 19.3.0-5120-g18432218 ddce307e1f32 80dee8574d61 2024-09-21T01:41:35.535 INFO:teuthology.orchestra.run.smithi083.stdout:osd.0 smithi083 running (7m) 51s ago 7m 112M 4272M 19.3.0-5120-g18432218 ddce307e1f32 1f0e0b5d85ff 2024-09-21T01:41:35.535 INFO:teuthology.orchestra.run.smithi083.stdout:osd.1 smithi119 running (7m) 53s ago 7m 124M 4272M 19.3.0-5120-g18432218 ddce307e1f32 b76506a9fc03 2024-09-21T01:41:35.535 INFO:teuthology.orchestra.run.smithi083.stdout:osd.2 smithi142 running (6m) 53s ago 6m 128M 4272M 19.3.0-5120-g18432218 ddce307e1f32 7a8837079d78 2024-09-21T01:41:35.535 INFO:teuthology.orchestra.run.smithi083.stdout:osd.3 smithi083 running (6m) 51s ago 6m 124M 4272M 19.3.0-5120-g18432218 ddce307e1f32 ffdc335f2d64 2024-09-21T01:41:35.535 INFO:teuthology.orchestra.run.smithi083.stdout:osd.4 smithi119 running (5m) 53s ago 5m 109M 4272M 19.3.0-5120-g18432218 ddce307e1f32 4d67c219db6c 2024-09-21T01:41:35.536 INFO:teuthology.orchestra.run.smithi083.stdout:osd.5 smithi142 running (5m) 53s ago 5m 123M 4272M 19.3.0-5120-g18432218 ddce307e1f32 94f494fdcca8 2024-09-21T01:41:35.536 INFO:teuthology.orchestra.run.smithi083.stdout:osd.6 smithi083 running (4m) 51s ago 4m 109M 4272M 19.3.0-5120-g18432218 ddce307e1f32 a4300509e210 2024-09-21T01:41:35.536 INFO:teuthology.orchestra.run.smithi083.stdout:osd.7 smithi119 running (4m) 53s ago 4m 121M 4272M 19.3.0-5120-g18432218 ddce307e1f32 dd93db1d3dd9 2024-09-21T01:41:35.536 INFO:teuthology.orchestra.run.smithi083.stdout:osd.8 smithi142 running (4m) 53s ago 4m 109M 4272M 19.3.0-5120-g18432218 ddce307e1f32 fcc540731cbc 2024-09-21T01:41:35.536 INFO:teuthology.orchestra.run.smithi083.stdout:osd.9 smithi083 running (3m) 51s ago 3m 110M 4272M 19.3.0-5120-g18432218 ddce307e1f32 580e0b3cd949 2024-09-21T01:41:35.536 INFO:teuthology.orchestra.run.smithi083.stdout:osd.10 smithi119 running (3m) 53s ago 3m 118M 4272M 19.3.0-5120-g18432218 ddce307e1f32 9b4b13535ace 2024-09-21T01:41:35.536 INFO:teuthology.orchestra.run.smithi083.stdout:osd.11 smithi142 running (2m) 53s ago 2m 109M 4272M 19.3.0-5120-g18432218 ddce307e1f32 b4934d3db0c5 2024-09-21T01:41:35.537 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:35.536+0000 7fb263850640 1 -- 172.21.15.83:0/3477901397 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fb2480b65f0 msgr2=0x7fb2480b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:35.537 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:35.536+0000 7fb263850640 1 --2- 172.21.15.83:0/3477901397 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fb2480b65f0 0x7fb2480b8b00 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fb258000c00 tx=0x7fb258009680 comp rx=0 tx=0).stop 2024-09-21T01:41:35.537 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:35.536+0000 7fb263850640 1 -- 172.21.15.83:0/3477901397 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb25c109e40 msgr2=0x7fb25c19fc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:35.537 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:35.536+0000 7fb263850640 1 --2- 172.21.15.83:0/3477901397 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb25c109e40 0x7fb25c19fc60 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fb25400cad0 tx=0x7fb25400cf90 comp rx=0 tx=0).stop 2024-09-21T01:41:35.537 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:35.536+0000 7fb263850640 1 -- 172.21.15.83:0/3477901397 shutdown_connections 2024-09-21T01:41:35.537 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:35.536+0000 7fb263850640 1 --2- 172.21.15.83:0/3477901397 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fb2480b65f0 0x7fb2480b8b00 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:35.537 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:35.536+0000 7fb263850640 1 --2- 172.21.15.83:0/3477901397 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb25c109e40 0x7fb25c19fc60 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:35.537 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:35.536+0000 7fb263850640 1 --2- 172.21.15.83:0/3477901397 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb25c1094f0 0x7fb25c19a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:35.537 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:35.536+0000 7fb263850640 1 --2- 172.21.15.83:0/3477901397 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb25c103bb0 0x7fb25c19a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:35.537 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:35.536+0000 7fb263850640 1 -- 172.21.15.83:0/3477901397 >> 172.21.15.83:0/3477901397 conn(0x7fb25c0ff600 msgr2=0x7fb25c101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:41:35.537 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:35.536+0000 7fb263850640 1 -- 172.21.15.83:0/3477901397 shutdown_connections 2024-09-21T01:41:35.538 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:35.536+0000 7fb263850640 1 -- 172.21.15.83:0/3477901397 wait complete. 2024-09-21T01:41:36.139 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:41:35 smithi083 ceph-mon[31370]: pgmap v325: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T01:41:36.166 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- bash -c 'ceph orch ls' 2024-09-21T01:41:36.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:41:35 smithi142 ceph-mon[34050]: pgmap v325: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T01:41:36.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:41:35 smithi119 ceph-mon[33693]: pgmap v325: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T01:41:36.421 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:41:36.918 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:36.915+0000 7fd98da54640 1 -- 172.21.15.83:0/1689189031 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd988104860 msgr2=0x7fd988104c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:36.918 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:36.915+0000 7fd98da54640 1 --2- 172.21.15.83:0/1689189031 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd988104860 0x7fd988104c70 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fd978009ca0 tx=0x7fd97802a8c0 comp rx=0 tx=0).stop 2024-09-21T01:41:36.918 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:36.915+0000 7fd98da54640 1 -- 172.21.15.83:0/1689189031 shutdown_connections 2024-09-21T01:41:36.918 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:36.915+0000 7fd98da54640 1 --2- 172.21.15.83:0/1689189031 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd98810de10 0x7fd9881102f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:36.919 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:36.915+0000 7fd98da54640 1 --2- 172.21.15.83:0/1689189031 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd988105290 0x7fd98810d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:36.919 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:36.915+0000 7fd98da54640 1 --2- 172.21.15.83:0/1689189031 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd988104860 0x7fd988104c70 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:36.919 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:36.915+0000 7fd98da54640 1 -- 172.21.15.83:0/1689189031 >> 172.21.15.83:0/1689189031 conn(0x7fd988079730 msgr2=0x7fd988079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:41:36.919 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:36.915+0000 7fd98da54640 1 -- 172.21.15.83:0/1689189031 shutdown_connections 2024-09-21T01:41:36.919 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:36.915+0000 7fd98da54640 1 -- 172.21.15.83:0/1689189031 wait complete. 2024-09-21T01:41:36.919 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:36.916+0000 7fd98da54640 1 Processor -- start 2024-09-21T01:41:36.919 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:36.916+0000 7fd98da54640 1 -- start start 2024-09-21T01:41:36.919 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:36.916+0000 7fd98da54640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd988104860 0x7fd988102770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:36.919 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:36.916+0000 7fd98da54640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd988105290 0x7fd988102cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:36.919 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:36.916+0000 7fd98da54640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd98810de10 0x7fd9881031f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:36.919 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:36.916+0000 7fd98da54640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fd9881139e0 con 0x7fd988104860 2024-09-21T01:41:36.920 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:36.916+0000 7fd98da54640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fd988113860 con 0x7fd98810de10 2024-09-21T01:41:36.920 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:36.916+0000 7fd98da54640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fd988113b60 con 0x7fd988105290 2024-09-21T01:41:36.920 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:36.916+0000 7fd986ffd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd988104860 0x7fd988102770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:36.920 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:36.916+0000 7fd986ffd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd988104860 0x7fd988102770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:39048/0 (socket says 172.21.15.83:39048) 2024-09-21T01:41:36.920 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:36.916+0000 7fd986ffd640 1 -- 172.21.15.83:0/3710494655 learned_addr learned my addr 172.21.15.83:0/3710494655 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:41:36.920 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:36.917+0000 7fd9867fc640 1 --2- 172.21.15.83:0/3710494655 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd988105290 0x7fd988102cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:36.920 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:36.917+0000 7fd9877fe640 1 --2- 172.21.15.83:0/3710494655 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd98810de10 0x7fd9881031f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:36.920 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:36.917+0000 7fd986ffd640 1 -- 172.21.15.83:0/3710494655 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd988105290 msgr2=0x7fd988102cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:36.920 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:36.917+0000 7fd986ffd640 1 --2- 172.21.15.83:0/3710494655 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd988105290 0x7fd988102cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:36.920 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:36.917+0000 7fd986ffd640 1 -- 172.21.15.83:0/3710494655 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd98810de10 msgr2=0x7fd9881031f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:36.920 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:36.917+0000 7fd986ffd640 1 --2- 172.21.15.83:0/3710494655 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd98810de10 0x7fd9881031f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:36.920 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:36.917+0000 7fd986ffd640 1 -- 172.21.15.83:0/3710494655 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9881a8690 con 0x7fd988104860 2024-09-21T01:41:36.920 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:36.917+0000 7fd9877fe640 1 --2- 172.21.15.83:0/3710494655 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd98810de10 0x7fd9881031f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:41:36.921 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:36.917+0000 7fd986ffd640 1 --2- 172.21.15.83:0/3710494655 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd988104860 0x7fd988102770 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fd978006010 tx=0x7fd978032bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:41:36.921 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:36.917+0000 7fd98ca52640 1 -- 172.21.15.83:0/3710494655 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd978004040 con 0x7fd988104860 2024-09-21T01:41:36.921 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:36.917+0000 7fd98ca52640 1 -- 172.21.15.83:0/3710494655 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd978004670 con 0x7fd988104860 2024-09-21T01:41:36.921 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:36.917+0000 7fd98ca52640 1 -- 172.21.15.83:0/3710494655 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd978030da0 con 0x7fd988104860 2024-09-21T01:41:36.921 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:36.917+0000 7fd98da54640 1 -- 172.21.15.83:0/3710494655 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9881a8920 con 0x7fd988104860 2024-09-21T01:41:36.921 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:36.917+0000 7fd98da54640 1 -- 172.21.15.83:0/3710494655 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9881a8e10 con 0x7fd988104860 2024-09-21T01:41:36.922 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:36.918+0000 7fd98da54640 1 -- 172.21.15.83:0/3710494655 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd988104c70 con 0x7fd988104860 2024-09-21T01:41:36.922 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:36.921+0000 7fd98ca52640 1 -- 172.21.15.83:0/3710494655 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7fd9780305c0 con 0x7fd988104860 2024-09-21T01:41:36.922 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:36.921+0000 7fd98ca52640 1 --2- 172.21.15.83:0/3710494655 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fd9740b65f0 0x7fd9740b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:36.922 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:36.922+0000 7fd9867fc640 1 --2- 172.21.15.83:0/3710494655 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fd9740b65f0 0x7fd9740b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:36.923 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:36.922+0000 7fd98ca52640 1 -- 172.21.15.83:0/3710494655 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9315+0+0 (secure 0 0 0) 0x7fd978109120 con 0x7fd988104860 2024-09-21T01:41:36.923 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:36.922+0000 7fd9867fc640 1 --2- 172.21.15.83:0/3710494655 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fd9740b65f0 0x7fd9740b8b00 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fd9881024d0 tx=0x7fd97000a4c0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:41:36.925 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:36.925+0000 7fd98ca52640 1 -- 172.21.15.83:0/3710494655 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd978004820 con 0x7fd988104860 2024-09-21T01:41:37.111 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:37.110+0000 7fd98da54640 1 -- 172.21.15.83:0/3710494655 --> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7fd988063800 con 0x7fd9740b65f0 2024-09-21T01:41:37.111 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:41:36 smithi083 ceph-mon[31370]: from='client.15321 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:41:37.116 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:37.116+0000 7fd98ca52640 1 -- 172.21.15.83:0/3710494655 <== mgr.14223 v2:172.21.15.83:6800/1748483157 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+980 (secure 0 0 0) 0x7fd988063800 con 0x7fd9740b65f0 2024-09-21T01:41:37.117 INFO:teuthology.orchestra.run.smithi083.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-09-21T01:41:37.117 INFO:teuthology.orchestra.run.smithi083.stdout:mds.all 12/12 55s ago 2m smithi083=a;smithi083=d;smithi083=g;smithi083=j;smithi119=b;smithi119=e;smithi119=h;smithi119=k;smithi142=c;smithi142=f;smithi142=i;smithi142=l;count:12 2024-09-21T01:41:37.117 INFO:teuthology.orchestra.run.smithi083.stdout:mgr 3/3 55s ago 8m smithi083=x;smithi119=y;smithi142=z;count:3 2024-09-21T01:41:37.117 INFO:teuthology.orchestra.run.smithi083.stdout:mon 3/3 55s ago 8m smithi083:172.21.15.83=a;smithi119:172.21.15.119=b;smithi142:172.21.15.142=c;count:3 2024-09-21T01:41:37.117 INFO:teuthology.orchestra.run.smithi083.stdout:osd 12 55s ago - 2024-09-21T01:41:37.119 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:37.118+0000 7fd98da54640 1 -- 172.21.15.83:0/3710494655 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fd9740b65f0 msgr2=0x7fd9740b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:37.119 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:37.118+0000 7fd98da54640 1 --2- 172.21.15.83:0/3710494655 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fd9740b65f0 0x7fd9740b8b00 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fd9881024d0 tx=0x7fd97000a4c0 comp rx=0 tx=0).stop 2024-09-21T01:41:37.119 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:37.118+0000 7fd98da54640 1 -- 172.21.15.83:0/3710494655 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd988104860 msgr2=0x7fd988102770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:37.119 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:37.118+0000 7fd98da54640 1 --2- 172.21.15.83:0/3710494655 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd988104860 0x7fd988102770 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fd978006010 tx=0x7fd978032bc0 comp rx=0 tx=0).stop 2024-09-21T01:41:37.119 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:37.119+0000 7fd98da54640 1 -- 172.21.15.83:0/3710494655 shutdown_connections 2024-09-21T01:41:37.119 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:37.119+0000 7fd98da54640 1 --2- 172.21.15.83:0/3710494655 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fd9740b65f0 0x7fd9740b8b00 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:37.119 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:37.119+0000 7fd98da54640 1 --2- 172.21.15.83:0/3710494655 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd98810de10 0x7fd9881031f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:37.119 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:37.119+0000 7fd98da54640 1 --2- 172.21.15.83:0/3710494655 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd988105290 0x7fd988102cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:37.120 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:37.119+0000 7fd98da54640 1 --2- 172.21.15.83:0/3710494655 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd988104860 0x7fd988102770 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:37.120 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:37.119+0000 7fd98da54640 1 -- 172.21.15.83:0/3710494655 >> 172.21.15.83:0/3710494655 conn(0x7fd988079730 msgr2=0x7fd988100880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:41:37.120 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:37.119+0000 7fd98da54640 1 -- 172.21.15.83:0/3710494655 shutdown_connections 2024-09-21T01:41:37.120 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:37.119+0000 7fd98da54640 1 -- 172.21.15.83:0/3710494655 wait complete. 2024-09-21T01:41:37.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:41:36 smithi142 ceph-mon[34050]: from='client.15321 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:41:37.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:41:36 smithi119 ceph-mon[33693]: from='client.15321 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:41:37.809 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- bash -c 'ceph orch host ls' 2024-09-21T01:41:38.053 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:41:37 smithi083 ceph-mon[31370]: pgmap v326: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:41:38.054 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:41:38.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:41:37 smithi142 ceph-mon[34050]: pgmap v326: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:41:38.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:41:37 smithi119 ceph-mon[33693]: pgmap v326: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:41:38.534 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:38.533+0000 7f44dfe65640 1 -- 172.21.15.83:0/870860596 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f44d8114430 msgr2=0x7f44d8116900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:38.535 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:38.533+0000 7f44dfe65640 1 --2- 172.21.15.83:0/870860596 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f44d8114430 0x7f44d8116900 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f44d0009ca0 tx=0x7f44d002a8c0 comp rx=0 tx=0).stop 2024-09-21T01:41:38.535 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:38.533+0000 7f44dfe65640 1 -- 172.21.15.83:0/870860596 shutdown_connections 2024-09-21T01:41:38.535 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:38.533+0000 7f44dfe65640 1 --2- 172.21.15.83:0/870860596 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f44d8114430 0x7f44d8116900 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:38.535 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:38.533+0000 7f44dfe65640 1 --2- 172.21.15.83:0/870860596 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f44d8075dd0 0x7f44d80761e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:38.535 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:38.533+0000 7f44dfe65640 1 --2- 172.21.15.83:0/870860596 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f44d8077380 0x7f44d80757b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:38.535 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:38.533+0000 7f44dfe65640 1 -- 172.21.15.83:0/870860596 >> 172.21.15.83:0/870860596 conn(0x7f44d807b850 msgr2=0x7f44d807bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:41:38.535 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:38.533+0000 7f44dfe65640 1 -- 172.21.15.83:0/870860596 shutdown_connections 2024-09-21T01:41:38.535 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:38.533+0000 7f44dfe65640 1 -- 172.21.15.83:0/870860596 wait complete. 2024-09-21T01:41:38.537 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:38.535+0000 7f44dfe65640 1 Processor -- start 2024-09-21T01:41:38.537 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:38.535+0000 7f44dfe65640 1 -- start start 2024-09-21T01:41:38.537 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:38.535+0000 7f44dfe65640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f44d8075dd0 0x7f44d81a0930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:38.537 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:38.535+0000 7f44dfe65640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f44d8077380 0x7f44d81a0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:38.537 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:38.535+0000 7f44dfe65640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f44d8114430 0x7f44d81a6170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:38.538 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:38.535+0000 7f44dfe65640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f44d8119f60 con 0x7f44d8114430 2024-09-21T01:41:38.538 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:38.535+0000 7f44dfe65640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f44d8119de0 con 0x7f44d8077380 2024-09-21T01:41:38.538 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:38.535+0000 7f44dfe65640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f44d811a0e0 con 0x7f44d8075dd0 2024-09-21T01:41:38.538 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:38.535+0000 7f44de402640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f44d8114430 0x7f44d81a6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:38.538 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:38.535+0000 7f44de402640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f44d8114430 0x7f44d81a6170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:39074/0 (socket says 172.21.15.83:39074) 2024-09-21T01:41:38.538 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:38.535+0000 7f44de402640 1 -- 172.21.15.83:0/1918688233 learned_addr learned my addr 172.21.15.83:0/1918688233 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:41:38.538 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:38.535+0000 7f44ddc01640 1 --2- 172.21.15.83:0/1918688233 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f44d8075dd0 0x7f44d81a0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:38.538 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:38.535+0000 7f44dd400640 1 --2- 172.21.15.83:0/1918688233 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f44d8077380 0x7f44d81a0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:38.538 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:38.536+0000 7f44de402640 1 -- 172.21.15.83:0/1918688233 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f44d8075dd0 msgr2=0x7f44d81a0930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:38.538 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:38.536+0000 7f44de402640 1 --2- 172.21.15.83:0/1918688233 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f44d8075dd0 0x7f44d81a0930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:38.538 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:38.536+0000 7f44de402640 1 -- 172.21.15.83:0/1918688233 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f44d8077380 msgr2=0x7f44d81a0ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:38.538 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:38.536+0000 7f44de402640 1 --2- 172.21.15.83:0/1918688233 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f44d8077380 0x7f44d81a0ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:38.538 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:38.536+0000 7f44de402640 1 -- 172.21.15.83:0/1918688233 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44d81a68a0 con 0x7f44d8114430 2024-09-21T01:41:38.538 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:38.536+0000 7f44de402640 1 --2- 172.21.15.83:0/1918688233 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f44d8114430 0x7f44d81a6170 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f44d0005e30 tx=0x7f44d00093d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:41:38.539 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:38.536+0000 7f44ceffd640 1 -- 172.21.15.83:0/1918688233 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44d0032d10 con 0x7f44d8114430 2024-09-21T01:41:38.539 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:38.536+0000 7f44dfe65640 1 -- 172.21.15.83:0/1918688233 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44d81a6b30 con 0x7f44d8114430 2024-09-21T01:41:38.539 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:38.536+0000 7f44ceffd640 1 -- 172.21.15.83:0/1918688233 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f44d0032eb0 con 0x7f44d8114430 2024-09-21T01:41:38.539 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:38.536+0000 7f44ceffd640 1 -- 172.21.15.83:0/1918688233 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44d0030b20 con 0x7f44d8114430 2024-09-21T01:41:38.539 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:38.536+0000 7f44dfe65640 1 -- 172.21.15.83:0/1918688233 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44d81ad2f0 con 0x7f44d8114430 2024-09-21T01:41:38.539 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:38.537+0000 7f44dfe65640 1 -- 172.21.15.83:0/1918688233 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44d80761e0 con 0x7f44d8114430 2024-09-21T01:41:38.540 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:38.539+0000 7f44ceffd640 1 -- 172.21.15.83:0/1918688233 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7f44d0030cc0 con 0x7f44d8114430 2024-09-21T01:41:38.540 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:38.539+0000 7f44ceffd640 1 --2- 172.21.15.83:0/1918688233 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f44c40b6670 0x7f44c40b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:38.540 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:38.539+0000 7f44ddc01640 1 --2- 172.21.15.83:0/1918688233 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f44c40b6670 0x7f44c40b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:38.540 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:38.539+0000 7f44ceffd640 1 -- 172.21.15.83:0/1918688233 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9315+0+0 (secure 0 0 0) 0x7f44d0108b90 con 0x7f44d8114430 2024-09-21T01:41:38.540 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:38.540+0000 7f44ddc01640 1 --2- 172.21.15.83:0/1918688233 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f44c40b6670 0x7f44c40b8b80 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f44d4009b50 tx=0x7f44d4005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:41:38.543 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:38.542+0000 7f44ceffd640 1 -- 172.21.15.83:0/1918688233 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f44d00cee80 con 0x7f44d8114430 2024-09-21T01:41:38.726 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:38.725+0000 7f44dfe65640 1 -- 172.21.15.83:0/1918688233 --> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7f44d8113750 con 0x7f44c40b6670 2024-09-21T01:41:38.727 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:38.727+0000 7f44ceffd640 1 -- 172.21.15.83:0/1918688233 <== mgr.14223 v2:172.21.15.83:6800/1748483157 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+191 (secure 0 0 0) 0x7f44d8113750 con 0x7f44c40b6670 2024-09-21T01:41:38.727 INFO:teuthology.orchestra.run.smithi083.stdout:HOST ADDR LABELS STATUS 2024-09-21T01:41:38.728 INFO:teuthology.orchestra.run.smithi083.stdout:smithi083 172.21.15.83 2024-09-21T01:41:38.728 INFO:teuthology.orchestra.run.smithi083.stdout:smithi119 172.21.15.119 2024-09-21T01:41:38.728 INFO:teuthology.orchestra.run.smithi083.stdout:smithi142 172.21.15.142 2024-09-21T01:41:38.728 INFO:teuthology.orchestra.run.smithi083.stdout:3 hosts in cluster 2024-09-21T01:41:38.730 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:38.729+0000 7f44dfe65640 1 -- 172.21.15.83:0/1918688233 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f44c40b6670 msgr2=0x7f44c40b8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:38.730 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:38.729+0000 7f44dfe65640 1 --2- 172.21.15.83:0/1918688233 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f44c40b6670 0x7f44c40b8b80 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f44d4009b50 tx=0x7f44d4005f90 comp rx=0 tx=0).stop 2024-09-21T01:41:38.730 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:38.729+0000 7f44dfe65640 1 -- 172.21.15.83:0/1918688233 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f44d8114430 msgr2=0x7f44d81a6170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:38.730 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:38.729+0000 7f44dfe65640 1 --2- 172.21.15.83:0/1918688233 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f44d8114430 0x7f44d81a6170 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f44d0005e30 tx=0x7f44d00093d0 comp rx=0 tx=0).stop 2024-09-21T01:41:38.730 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:38.730+0000 7f44dfe65640 1 -- 172.21.15.83:0/1918688233 shutdown_connections 2024-09-21T01:41:38.730 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:38.730+0000 7f44dfe65640 1 --2- 172.21.15.83:0/1918688233 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f44c40b6670 0x7f44c40b8b80 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:38.730 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:38.730+0000 7f44dfe65640 1 --2- 172.21.15.83:0/1918688233 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f44d8114430 0x7f44d81a6170 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:38.731 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:38.730+0000 7f44dfe65640 1 --2- 172.21.15.83:0/1918688233 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f44d8077380 0x7f44d81a0ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:38.731 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:38.730+0000 7f44dfe65640 1 --2- 172.21.15.83:0/1918688233 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f44d8075dd0 0x7f44d81a0930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:38.731 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:38.730+0000 7f44dfe65640 1 -- 172.21.15.83:0/1918688233 >> 172.21.15.83:0/1918688233 conn(0x7f44d807b850 msgr2=0x7f44d8113040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:41:38.731 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:38.730+0000 7f44dfe65640 1 -- 172.21.15.83:0/1918688233 shutdown_connections 2024-09-21T01:41:38.731 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:38.730+0000 7f44dfe65640 1 -- 172.21.15.83:0/1918688233 wait complete. 2024-09-21T01:41:39.053 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:41:38 smithi083 ceph-mon[31370]: from='client.15327 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:41:39.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:41:38 smithi083 ceph-mon[31370]: from='client.15333 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:41:39.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:41:38 smithi083 ceph-mon[31370]: pgmap v327: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:41:39.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:41:38 smithi142 ceph-mon[34050]: from='client.15327 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:41:39.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:41:38 smithi142 ceph-mon[34050]: from='client.15333 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:41:39.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:41:38 smithi142 ceph-mon[34050]: pgmap v327: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:41:39.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:41:38 smithi119 ceph-mon[33693]: from='client.15327 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:41:39.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:41:38 smithi119 ceph-mon[33693]: from='client.15333 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:41:39.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:41:38 smithi119 ceph-mon[33693]: pgmap v327: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:41:39.435 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- bash -c 'ceph orch device ls' 2024-09-21T01:41:39.678 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:41:40.178 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:40.168+0000 7f0188708640 1 -- 172.21.15.83:0/3956294535 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0180107690 msgr2=0x7f0180107aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:40.178 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:40.168+0000 7f0188708640 1 --2- 172.21.15.83:0/3956294535 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0180107690 0x7f0180107aa0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f017c009900 tx=0x7f017c02a410 comp rx=0 tx=0).stop 2024-09-21T01:41:40.178 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:40.168+0000 7f0188708640 1 -- 172.21.15.83:0/3956294535 shutdown_connections 2024-09-21T01:41:40.178 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:40.168+0000 7f0188708640 1 --2- 172.21.15.83:0/3956294535 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0180103950 0x7f018010f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:40.178 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:40.168+0000 7f0188708640 1 --2- 172.21.15.83:0/3956294535 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0180103000 0x7f0180103410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:40.178 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:40.168+0000 7f0188708640 1 --2- 172.21.15.83:0/3956294535 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0180107690 0x7f0180107aa0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:40.178 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:40.169+0000 7f0188708640 1 -- 172.21.15.83:0/3956294535 >> 172.21.15.83:0/3956294535 conn(0x7f0180079ea0 msgr2=0x7f018007a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:41:40.178 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:40.169+0000 7f0188708640 1 -- 172.21.15.83:0/3956294535 shutdown_connections 2024-09-21T01:41:40.178 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:40.169+0000 7f0188708640 1 -- 172.21.15.83:0/3956294535 wait complete. 2024-09-21T01:41:40.178 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:40.169+0000 7f0188708640 1 Processor -- start 2024-09-21T01:41:40.179 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:40.169+0000 7f0188708640 1 -- start start 2024-09-21T01:41:40.179 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:40.169+0000 7f0188708640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0180103000 0x7f018019a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:40.179 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:40.170+0000 7f0188708640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0180103950 0x7f018019aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:40.179 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:40.170+0000 7f0188708640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0180107690 0x7f018019fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:40.179 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:40.170+0000 7f0188708640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f01801128f0 con 0x7f0180103000 2024-09-21T01:41:40.179 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:40.170+0000 7f0188708640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f0180112770 con 0x7f0180103950 2024-09-21T01:41:40.179 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:40.170+0000 7f0188708640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f0180112a70 con 0x7f0180107690 2024-09-21T01:41:40.179 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:40.170+0000 7f01864a4640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0180103000 0x7f018019a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:40.179 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:40.170+0000 7f01864a4640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0180103000 0x7f018019a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:39098/0 (socket says 172.21.15.83:39098) 2024-09-21T01:41:40.179 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:40.170+0000 7f01864a4640 1 -- 172.21.15.83:0/3329261510 learned_addr learned my addr 172.21.15.83:0/3329261510 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:41:40.179 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:40.170+0000 7f0186ca5640 1 --2- 172.21.15.83:0/3329261510 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0180107690 0x7f018019fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:40.179 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:40.170+0000 7f0185ca3640 1 --2- 172.21.15.83:0/3329261510 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0180103950 0x7f018019aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:40.179 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:40.170+0000 7f01864a4640 1 -- 172.21.15.83:0/3329261510 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0180107690 msgr2=0x7f018019fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:40.180 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:40.170+0000 7f01864a4640 1 --2- 172.21.15.83:0/3329261510 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0180107690 0x7f018019fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:40.180 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:40.170+0000 7f01864a4640 1 -- 172.21.15.83:0/3329261510 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0180103950 msgr2=0x7f018019aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:40.180 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:40.170+0000 7f01864a4640 1 --2- 172.21.15.83:0/3329261510 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0180103950 0x7f018019aa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:40.180 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:40.170+0000 7f01864a4640 1 -- 172.21.15.83:0/3329261510 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01801a0400 con 0x7f0180103000 2024-09-21T01:41:40.180 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:40.170+0000 7f01864a4640 1 --2- 172.21.15.83:0/3329261510 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0180103000 0x7f018019a490 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f017c009230 tx=0x7f017c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:41:40.180 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:40.170+0000 7f01777fe640 1 -- 172.21.15.83:0/3329261510 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f017c03f030 con 0x7f0180103000 2024-09-21T01:41:40.180 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:40.170+0000 7f01777fe640 1 -- 172.21.15.83:0/3329261510 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f017c003a80 con 0x7f0180103000 2024-09-21T01:41:40.180 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:40.170+0000 7f0188708640 1 -- 172.21.15.83:0/3329261510 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01801a0690 con 0x7f0180103000 2024-09-21T01:41:40.180 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:40.170+0000 7f01777fe640 1 -- 172.21.15.83:0/3329261510 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f017c035070 con 0x7f0180103000 2024-09-21T01:41:40.180 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:40.171+0000 7f0188708640 1 -- 172.21.15.83:0/3329261510 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01801a6e50 con 0x7f0180103000 2024-09-21T01:41:40.180 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:40.171+0000 7f0188708640 1 -- 172.21.15.83:0/3329261510 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f018006b940 con 0x7f0180103000 2024-09-21T01:41:40.180 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:40.173+0000 7f01777fe640 1 -- 172.21.15.83:0/3329261510 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7f017c042030 con 0x7f0180103000 2024-09-21T01:41:40.180 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:40.174+0000 7f01777fe640 1 --2- 172.21.15.83:0/3329261510 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f016c0b65f0 0x7f016c0b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:40.180 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:40.174+0000 7f0185ca3640 1 --2- 172.21.15.83:0/3329261510 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f016c0b65f0 0x7f016c0b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:40.181 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:40.174+0000 7f01777fe640 1 -- 172.21.15.83:0/3329261510 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9315+0+0 (secure 0 0 0) 0x7f017c108420 con 0x7f0180103000 2024-09-21T01:41:40.181 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:40.174+0000 7f0185ca3640 1 --2- 172.21.15.83:0/3329261510 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f016c0b65f0 0x7f016c0b8b00 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f0170005fd0 tx=0x7f0170005850 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:41:40.181 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:40.177+0000 7f01777fe640 1 -- 172.21.15.83:0/3329261510 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f017c0ce7b0 con 0x7f0180103000 2024-09-21T01:41:40.365 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:40.364+0000 7f0188708640 1 -- 172.21.15.83:0/3329261510 --> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7f0180063800 con 0x7f016c0b65f0 2024-09-21T01:41:40.366 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:40.366+0000 7f01777fe640 1 -- 172.21.15.83:0/3329261510 <== mgr.14223 v2:172.21.15.83:6800/1748483157 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+532 (secure 0 0 0) 0x7f0180063800 con 0x7f016c0b65f0 2024-09-21T01:41:40.367 INFO:teuthology.orchestra.run.smithi083.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-09-21T01:41:40.367 INFO:teuthology.orchestra.run.smithi083.stdout:smithi083 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT62040148400BGN 372G No 3m ago Has a FileSystem, LVM detected 2024-09-21T01:41:40.367 INFO:teuthology.orchestra.run.smithi083.stdout:smithi119 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620400Y1400BGN 372G No 3m ago Has a FileSystem, LVM detected 2024-09-21T01:41:40.367 INFO:teuthology.orchestra.run.smithi083.stdout:smithi142 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT6303009Y400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-09-21T01:41:40.369 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:40.368+0000 7f0188708640 1 -- 172.21.15.83:0/3329261510 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f016c0b65f0 msgr2=0x7f016c0b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:40.369 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:40.368+0000 7f0188708640 1 --2- 172.21.15.83:0/3329261510 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f016c0b65f0 0x7f016c0b8b00 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f0170005fd0 tx=0x7f0170005850 comp rx=0 tx=0).stop 2024-09-21T01:41:40.369 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:40.368+0000 7f0188708640 1 -- 172.21.15.83:0/3329261510 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0180103000 msgr2=0x7f018019a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:40.369 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:40.368+0000 7f0188708640 1 --2- 172.21.15.83:0/3329261510 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0180103000 0x7f018019a490 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f017c009230 tx=0x7f017c004270 comp rx=0 tx=0).stop 2024-09-21T01:41:40.369 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:40.368+0000 7f0188708640 1 -- 172.21.15.83:0/3329261510 shutdown_connections 2024-09-21T01:41:40.369 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:40.368+0000 7f0188708640 1 --2- 172.21.15.83:0/3329261510 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f016c0b65f0 0x7f016c0b8b00 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:40.369 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:40.368+0000 7f0188708640 1 --2- 172.21.15.83:0/3329261510 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0180107690 0x7f018019fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:40.369 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:40.368+0000 7f0188708640 1 --2- 172.21.15.83:0/3329261510 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0180103950 0x7f018019aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:40.369 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:40.368+0000 7f0188708640 1 --2- 172.21.15.83:0/3329261510 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0180103000 0x7f018019a490 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:40.369 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:40.368+0000 7f0188708640 1 -- 172.21.15.83:0/3329261510 >> 172.21.15.83:0/3329261510 conn(0x7f0180079ea0 msgr2=0x7f0180106650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:41:40.370 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:40.368+0000 7f0188708640 1 -- 172.21.15.83:0/3329261510 shutdown_connections 2024-09-21T01:41:40.370 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:40.368+0000 7f0188708640 1 -- 172.21.15.83:0/3329261510 wait complete. 2024-09-21T01:41:41.015 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-21T01:41:41.024 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi083.front.sepia.ceph.com 2024-09-21T01:41:41.024 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- bash -c 'ceph fs dump' 2024-09-21T01:41:41.271 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:41:41.762 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:41.750+0000 7f6c494d0640 1 -- 172.21.15.83:0/286924274 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6c44108cf0 msgr2=0x7f6c4410f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:41.762 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:41.750+0000 7f6c494d0640 1 --2- 172.21.15.83:0/286924274 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6c44108cf0 0x7f6c4410f520 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f6c3c009ca0 tx=0x7f6c3c02a8c0 comp rx=0 tx=0).stop 2024-09-21T01:41:41.762 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:41.750+0000 7f6c494d0640 1 -- 172.21.15.83:0/286924274 shutdown_connections 2024-09-21T01:41:41.762 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:41.750+0000 7f6c494d0640 1 --2- 172.21.15.83:0/286924274 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6c44108cf0 0x7f6c4410f520 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:41.762 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:41.750+0000 7f6c494d0640 1 --2- 172.21.15.83:0/286924274 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6c441083a0 0x7f6c441087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:41.763 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:41.750+0000 7f6c494d0640 1 --2- 172.21.15.83:0/286924274 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6c44102a60 0x7f6c44102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:41.763 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:41.750+0000 7f6c494d0640 1 -- 172.21.15.83:0/286924274 >> 172.21.15.83:0/286924274 conn(0x7f6c44079730 msgr2=0x7f6c44079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:41:41.763 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:41.750+0000 7f6c494d0640 1 -- 172.21.15.83:0/286924274 shutdown_connections 2024-09-21T01:41:41.763 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:41.751+0000 7f6c494d0640 1 -- 172.21.15.83:0/286924274 wait complete. 2024-09-21T01:41:41.763 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:41.751+0000 7f6c494d0640 1 Processor -- start 2024-09-21T01:41:41.763 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:41.751+0000 7f6c494d0640 1 -- start start 2024-09-21T01:41:41.763 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:41.752+0000 7f6c494d0640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6c44102a60 0x7f6c4419a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:41.763 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:41.752+0000 7f6c494d0640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6c441083a0 0x7f6c4419a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:41.763 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:41.752+0000 7f6c494d0640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6c44108cf0 0x7f6c4419fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:41.764 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:41.752+0000 7f6c494d0640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f6c44112860 con 0x7f6c44102a60 2024-09-21T01:41:41.764 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:41.752+0000 7f6c494d0640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f6c441126e0 con 0x7f6c441083a0 2024-09-21T01:41:41.764 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:41.752+0000 7f6c494d0640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f6c441129e0 con 0x7f6c44108cf0 2024-09-21T01:41:41.764 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:41.752+0000 7f6c42ffd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6c44102a60 0x7f6c4419a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:41.764 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:41.752+0000 7f6c42ffd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6c44102a60 0x7f6c4419a3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:39112/0 (socket says 172.21.15.83:39112) 2024-09-21T01:41:41.764 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:41.752+0000 7f6c42ffd640 1 -- 172.21.15.83:0/3700800200 learned_addr learned my addr 172.21.15.83:0/3700800200 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:41:41.764 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:41.752+0000 7f6c437fe640 1 --2- 172.21.15.83:0/3700800200 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6c44108cf0 0x7f6c4419fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:41.764 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:41.752+0000 7f6c3a7fc640 1 --2- 172.21.15.83:0/3700800200 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6c441083a0 0x7f6c4419a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:41.764 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:41.752+0000 7f6c42ffd640 1 -- 172.21.15.83:0/3700800200 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6c44108cf0 msgr2=0x7f6c4419fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:41.764 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:41.752+0000 7f6c42ffd640 1 --2- 172.21.15.83:0/3700800200 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6c44108cf0 0x7f6c4419fbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:41.764 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:41.752+0000 7f6c42ffd640 1 -- 172.21.15.83:0/3700800200 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6c441083a0 msgr2=0x7f6c4419a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:41.765 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:41.752+0000 7f6c42ffd640 1 --2- 172.21.15.83:0/3700800200 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6c441083a0 0x7f6c4419a940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:41.765 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:41.752+0000 7f6c42ffd640 1 -- 172.21.15.83:0/3700800200 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c441a0310 con 0x7f6c44102a60 2024-09-21T01:41:41.765 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:41.752+0000 7f6c437fe640 1 --2- 172.21.15.83:0/3700800200 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6c44108cf0 0x7f6c4419fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:41:41.765 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:41.752+0000 7f6c3a7fc640 1 --2- 172.21.15.83:0/3700800200 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6c441083a0 0x7f6c4419a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:41:41.765 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:41.752+0000 7f6c42ffd640 1 --2- 172.21.15.83:0/3700800200 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6c44102a60 0x7f6c4419a3a0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f6c3400d950 tx=0x7f6c3400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:41:41.765 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:41.752+0000 7f6c40ff9640 1 -- 172.21.15.83:0/3700800200 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c34017070 con 0x7f6c44102a60 2024-09-21T01:41:41.765 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:41.752+0000 7f6c40ff9640 1 -- 172.21.15.83:0/3700800200 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6c34009c30 con 0x7f6c44102a60 2024-09-21T01:41:41.765 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:41.752+0000 7f6c40ff9640 1 -- 172.21.15.83:0/3700800200 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c3400f620 con 0x7f6c44102a60 2024-09-21T01:41:41.765 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:41.752+0000 7f6c494d0640 1 -- 172.21.15.83:0/3700800200 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c441a0600 con 0x7f6c44102a60 2024-09-21T01:41:41.766 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:41.753+0000 7f6c494d0640 1 -- 172.21.15.83:0/3700800200 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c441a6d60 con 0x7f6c44102a60 2024-09-21T01:41:41.766 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:41.753+0000 7f6c494d0640 1 -- 172.21.15.83:0/3700800200 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c44102e70 con 0x7f6c44102a60 2024-09-21T01:41:41.766 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:41.755+0000 7f6c40ff9640 1 -- 172.21.15.83:0/3700800200 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7f6c34005030 con 0x7f6c44102a60 2024-09-21T01:41:41.766 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:41.756+0000 7f6c40ff9640 1 --2- 172.21.15.83:0/3700800200 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f6c300b6670 0x7f6c300b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:41.766 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:41.756+0000 7f6c3a7fc640 1 --2- 172.21.15.83:0/3700800200 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f6c300b6670 0x7f6c300b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:41.766 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:41.756+0000 7f6c40ff9640 1 -- 172.21.15.83:0/3700800200 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9315+0+0 (secure 0 0 0) 0x7f6c340e7550 con 0x7f6c44102a60 2024-09-21T01:41:41.766 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:41.756+0000 7f6c3a7fc640 1 --2- 172.21.15.83:0/3700800200 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f6c300b6670 0x7f6c300b8b80 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f6c2c005fd0 tx=0x7f6c2c0094d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:41:41.766 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:41.759+0000 7f6c40ff9640 1 -- 172.21.15.83:0/3700800200 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6c340ad8c0 con 0x7f6c44102a60 2024-09-21T01:41:41.858 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:41.856+0000 7f6c40ff9640 1 -- 172.21.15.83:0/3700800200 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mgrmap(e 22) ==== 154529+0+0 (secure 0 0 0) 0x7f6c340a9430 con 0x7f6c44102a60 2024-09-21T01:41:41.982 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:41.981+0000 7f6c494d0640 1 -- 172.21.15.83:0/3700800200 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f6c4402e640 con 0x7f6c44102a60 2024-09-21T01:41:41.982 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:41:41 smithi083 ceph-mon[31370]: from='client.15339 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:41:41.982 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:41:41 smithi083 ceph-mon[31370]: pgmap v328: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 0 B/s wr, 2 op/s 2024-09-21T01:41:41.982 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:41.982+0000 7f6c40ff9640 1 -- 172.21.15.83:0/3700800200 <== mon.0 v2:172.21.15.83:3300/0 8 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) ==== 76+0+3052 (secure 0 0 0) 0x7f6c34009de0 con 0x7f6c44102a60 2024-09-21T01:41:41.983 INFO:teuthology.orchestra.run.smithi083.stdout:e21 2024-09-21T01:41:41.983 INFO:teuthology.orchestra.run.smithi083.stdout:btime 2024-09-21T01:40:27:947059+0000 2024-09-21T01:41:41.983 INFO:teuthology.orchestra.run.smithi083.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T01:41:41.983 INFO:teuthology.orchestra.run.smithi083.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T01:41:41.983 INFO:teuthology.orchestra.run.smithi083.stdout:legacy client fscid: 1 2024-09-21T01:41:41.983 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T01:41:41.983 INFO:teuthology.orchestra.run.smithi083.stdout:Filesystem 'cephfs' (1) 2024-09-21T01:41:41.983 INFO:teuthology.orchestra.run.smithi083.stdout:fs_name cephfs 2024-09-21T01:41:41.983 INFO:teuthology.orchestra.run.smithi083.stdout:epoch 21 2024-09-21T01:41:41.983 INFO:teuthology.orchestra.run.smithi083.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-21T01:41:41.983 INFO:teuthology.orchestra.run.smithi083.stdout:created 2024-09-21T01:39:45.145124+0000 2024-09-21T01:41:41.983 INFO:teuthology.orchestra.run.smithi083.stdout:modified 2024-09-21T01:40:27.664151+0000 2024-09-21T01:41:41.984 INFO:teuthology.orchestra.run.smithi083.stdout:tableserver 0 2024-09-21T01:41:41.984 INFO:teuthology.orchestra.run.smithi083.stdout:root 0 2024-09-21T01:41:41.984 INFO:teuthology.orchestra.run.smithi083.stdout:session_timeout 300 2024-09-21T01:41:41.984 INFO:teuthology.orchestra.run.smithi083.stdout:session_autoclose 300 2024-09-21T01:41:41.984 INFO:teuthology.orchestra.run.smithi083.stdout:max_file_size 1099511627776 2024-09-21T01:41:41.984 INFO:teuthology.orchestra.run.smithi083.stdout:max_xattr_size 65536 2024-09-21T01:41:41.984 INFO:teuthology.orchestra.run.smithi083.stdout:required_client_features {} 2024-09-21T01:41:41.984 INFO:teuthology.orchestra.run.smithi083.stdout:last_failure 0 2024-09-21T01:41:41.984 INFO:teuthology.orchestra.run.smithi083.stdout:last_failure_osd_epoch 0 2024-09-21T01:41:41.984 INFO:teuthology.orchestra.run.smithi083.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T01:41:41.984 INFO:teuthology.orchestra.run.smithi083.stdout:max_mds 1 2024-09-21T01:41:41.984 INFO:teuthology.orchestra.run.smithi083.stdout:in 0 2024-09-21T01:41:41.984 INFO:teuthology.orchestra.run.smithi083.stdout:up {0=24653} 2024-09-21T01:41:41.985 INFO:teuthology.orchestra.run.smithi083.stdout:failed 2024-09-21T01:41:41.985 INFO:teuthology.orchestra.run.smithi083.stdout:damaged 2024-09-21T01:41:41.985 INFO:teuthology.orchestra.run.smithi083.stdout:stopped 2024-09-21T01:41:41.985 INFO:teuthology.orchestra.run.smithi083.stdout:data_pools [3,4] 2024-09-21T01:41:41.985 INFO:teuthology.orchestra.run.smithi083.stdout:metadata_pool 2 2024-09-21T01:41:41.985 INFO:teuthology.orchestra.run.smithi083.stdout:inline_data disabled 2024-09-21T01:41:41.985 INFO:teuthology.orchestra.run.smithi083.stdout:balancer 2024-09-21T01:41:41.985 INFO:teuthology.orchestra.run.smithi083.stdout:bal_rank_mask -1 2024-09-21T01:41:41.985 INFO:teuthology.orchestra.run.smithi083.stdout:standby_count_wanted 0 2024-09-21T01:41:41.985 INFO:teuthology.orchestra.run.smithi083.stdout:qdb_cluster leader: 24653 members: 24653 2024-09-21T01:41:41.985 INFO:teuthology.orchestra.run.smithi083.stdout:[mds.b{0:24653} state up:active seq 4 addr [v2:172.21.15.119:6838/3106757092,v1:172.21.15.119:6839/3106757092] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T01:41:41.985 INFO:teuthology.orchestra.run.smithi083.stdout:[mds.i{0:24631} state up:standby-replay seq 1 addr [v2:172.21.15.142:6838/1817880741,v1:172.21.15.142:6839/1817880741] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T01:41:41.985 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T01:41:41.985 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T01:41:41.985 INFO:teuthology.orchestra.run.smithi083.stdout:Standby daemons: 2024-09-21T01:41:41.985 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T01:41:41.985 INFO:teuthology.orchestra.run.smithi083.stdout:[mds.j{-1:14775} state up:standby seq 1 addr [v2:172.21.15.83:6834/1105040204,v1:172.21.15.83:6835/1105040204] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T01:41:41.986 INFO:teuthology.orchestra.run.smithi083.stdout:[mds.d{-1:14787} state up:standby seq 1 addr [v2:172.21.15.83:6836/2234789563,v1:172.21.15.83:6837/2234789563] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T01:41:41.986 INFO:teuthology.orchestra.run.smithi083.stdout:[mds.g{-1:14838} state up:standby seq 1 addr [v2:172.21.15.83:6838/136258364,v1:172.21.15.83:6839/136258364] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T01:41:41.986 INFO:teuthology.orchestra.run.smithi083.stdout:[mds.a{-1:14850} state up:standby seq 1 addr [v2:172.21.15.83:6840/129439444,v1:172.21.15.83:6841/129439444] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T01:41:41.986 INFO:teuthology.orchestra.run.smithi083.stdout:[mds.k{-1:24569} state up:standby seq 1 addr [v2:172.21.15.119:6832/2839502433,v1:172.21.15.119:6833/2839502433] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T01:41:41.986 INFO:teuthology.orchestra.run.smithi083.stdout:[mds.l{-1:24580} state up:standby seq 1 addr [v2:172.21.15.142:6832/2841606990,v1:172.21.15.142:6833/2841606990] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T01:41:41.986 INFO:teuthology.orchestra.run.smithi083.stdout:[mds.e{-1:24599} state up:standby seq 1 addr [v2:172.21.15.119:6834/415902608,v1:172.21.15.119:6835/415902608] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T01:41:41.986 INFO:teuthology.orchestra.run.smithi083.stdout:[mds.f{-1:24607} state up:standby seq 1 addr [v2:172.21.15.142:6834/3009088510,v1:172.21.15.142:6835/3009088510] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T01:41:41.986 INFO:teuthology.orchestra.run.smithi083.stdout:[mds.c{-1:24613} state up:standby seq 1 addr [v2:172.21.15.142:6836/3847200126,v1:172.21.15.142:6837/3847200126] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T01:41:41.986 INFO:teuthology.orchestra.run.smithi083.stdout:[mds.h{-1:24626} state up:standby seq 1 addr [v2:172.21.15.119:6836/3619222976,v1:172.21.15.119:6837/3619222976] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T01:41:41.987 INFO:teuthology.orchestra.run.smithi083.stderr:dumped fsmap epoch 21 2024-09-21T01:41:41.987 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:41.984+0000 7f6c494d0640 1 -- 172.21.15.83:0/3700800200 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f6c300b6670 msgr2=0x7f6c300b8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:41.987 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:41.984+0000 7f6c494d0640 1 --2- 172.21.15.83:0/3700800200 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f6c300b6670 0x7f6c300b8b80 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f6c2c005fd0 tx=0x7f6c2c0094d0 comp rx=0 tx=0).stop 2024-09-21T01:41:41.987 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:41.984+0000 7f6c494d0640 1 -- 172.21.15.83:0/3700800200 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6c44102a60 msgr2=0x7f6c4419a3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:41.987 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:41.984+0000 7f6c494d0640 1 --2- 172.21.15.83:0/3700800200 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6c44102a60 0x7f6c4419a3a0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f6c3400d950 tx=0x7f6c3400de10 comp rx=0 tx=0).stop 2024-09-21T01:41:41.987 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:41.984+0000 7f6c494d0640 1 -- 172.21.15.83:0/3700800200 shutdown_connections 2024-09-21T01:41:41.988 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:41.984+0000 7f6c494d0640 1 --2- 172.21.15.83:0/3700800200 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f6c300b6670 0x7f6c300b8b80 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:41.988 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:41.984+0000 7f6c494d0640 1 --2- 172.21.15.83:0/3700800200 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6c44108cf0 0x7f6c4419fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:41.988 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:41.984+0000 7f6c494d0640 1 --2- 172.21.15.83:0/3700800200 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6c441083a0 0x7f6c4419a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:41.988 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:41.984+0000 7f6c494d0640 1 --2- 172.21.15.83:0/3700800200 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6c44102a60 0x7f6c4419a3a0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:41.988 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:41.984+0000 7f6c494d0640 1 -- 172.21.15.83:0/3700800200 >> 172.21.15.83:0/3700800200 conn(0x7f6c44079730 msgr2=0x7f6c4406b2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:41:41.988 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:41.984+0000 7f6c494d0640 1 -- 172.21.15.83:0/3700800200 shutdown_connections 2024-09-21T01:41:41.988 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:41.984+0000 7f6c494d0640 1 -- 172.21.15.83:0/3700800200 wait complete. 2024-09-21T01:41:42.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:41:41 smithi142 ceph-mon[34050]: from='client.15339 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:41:42.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:41:41 smithi142 ceph-mon[34050]: pgmap v328: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 0 B/s wr, 2 op/s 2024-09-21T01:41:42.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:41:41 smithi119 ceph-mon[33693]: from='client.15339 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:41:42.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:41:41 smithi119 ceph-mon[33693]: pgmap v328: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 0 B/s wr, 2 op/s 2024-09-21T01:41:42.756 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- bash -c 'ceph osd dump' 2024-09-21T01:41:43.008 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:41:43.053 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:41:42 smithi083 ceph-mon[31370]: mgrmap e22: x(active, since 8m), standbys: z, y 2024-09-21T01:41:43.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:41:42 smithi083 ceph-mon[31370]: from='client.? 172.21.15.83:0/3700800200' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T01:41:43.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:41:42 smithi142 ceph-mon[34050]: mgrmap e22: x(active, since 8m), standbys: z, y 2024-09-21T01:41:43.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:41:42 smithi142 ceph-mon[34050]: from='client.? 172.21.15.83:0/3700800200' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T01:41:43.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:41:42 smithi119 ceph-mon[33693]: mgrmap e22: x(active, since 8m), standbys: z, y 2024-09-21T01:41:43.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:41:42 smithi119 ceph-mon[33693]: from='client.? 172.21.15.83:0/3700800200' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T01:41:43.505 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:43.493+0000 7f7773492640 1 -- 172.21.15.83:0/3402458492 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f776c108d10 msgr2=0x7f776c10f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:43.505 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:43.493+0000 7f7773492640 1 --2- 172.21.15.83:0/3402458492 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f776c108d10 0x7f776c10f540 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f7764009ca0 tx=0x7f776402a8c0 comp rx=0 tx=0).stop 2024-09-21T01:41:43.505 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:43.494+0000 7f7773492640 1 -- 172.21.15.83:0/3402458492 shutdown_connections 2024-09-21T01:41:43.505 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:43.494+0000 7f7773492640 1 --2- 172.21.15.83:0/3402458492 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f776c108d10 0x7f776c10f540 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:43.505 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:43.494+0000 7f7773492640 1 --2- 172.21.15.83:0/3402458492 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f776c1083c0 0x7f776c1087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:43.505 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:43.494+0000 7f7773492640 1 --2- 172.21.15.83:0/3402458492 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f776c102a80 0x7f776c102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:43.505 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:43.494+0000 7f7773492640 1 -- 172.21.15.83:0/3402458492 >> 172.21.15.83:0/3402458492 conn(0x7f776c079740 msgr2=0x7f776c079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:41:43.506 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:43.494+0000 7f7773492640 1 -- 172.21.15.83:0/3402458492 shutdown_connections 2024-09-21T01:41:43.506 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:43.494+0000 7f7773492640 1 -- 172.21.15.83:0/3402458492 wait complete. 2024-09-21T01:41:43.506 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:43.494+0000 7f7773492640 1 Processor -- start 2024-09-21T01:41:43.506 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:43.494+0000 7f7773492640 1 -- start start 2024-09-21T01:41:43.506 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:43.494+0000 7f7773492640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f776c102a80 0x7f776c19a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:43.506 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:43.495+0000 7f7773492640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f776c1083c0 0x7f776c19a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:43.506 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:43.495+0000 7f7773492640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f776c108d10 0x7f776c19fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:43.506 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:43.495+0000 7f7773492640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f776c112880 con 0x7f776c108d10 2024-09-21T01:41:43.506 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:43.495+0000 7f7773492640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f776c112700 con 0x7f776c1083c0 2024-09-21T01:41:43.506 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:43.495+0000 7f7773492640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f776c112a00 con 0x7f776c102a80 2024-09-21T01:41:43.506 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:43.495+0000 7f7771a2f640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f776c108d10 0x7f776c19fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:43.506 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:43.495+0000 7f7771a2f640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f776c108d10 0x7f776c19fb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:39540/0 (socket says 172.21.15.83:39540) 2024-09-21T01:41:43.506 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:43.495+0000 7f7771a2f640 1 -- 172.21.15.83:0/4145239092 learned_addr learned my addr 172.21.15.83:0/4145239092 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:41:43.507 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:43.495+0000 7f777122e640 1 --2- 172.21.15.83:0/4145239092 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f776c102a80 0x7f776c19a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:43.507 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:43.495+0000 7f7770a2d640 1 --2- 172.21.15.83:0/4145239092 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f776c1083c0 0x7f776c19a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:43.507 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:43.495+0000 7f7771a2f640 1 -- 172.21.15.83:0/4145239092 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f776c102a80 msgr2=0x7f776c19a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:43.507 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:43.495+0000 7f7771a2f640 1 --2- 172.21.15.83:0/4145239092 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f776c102a80 0x7f776c19a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:43.507 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:43.495+0000 7f7771a2f640 1 -- 172.21.15.83:0/4145239092 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f776c1083c0 msgr2=0x7f776c19a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:43.507 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:43.495+0000 7f7771a2f640 1 --2- 172.21.15.83:0/4145239092 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f776c1083c0 0x7f776c19a8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:43.507 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:43.495+0000 7f7771a2f640 1 -- 172.21.15.83:0/4145239092 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f776c1a02b0 con 0x7f776c108d10 2024-09-21T01:41:43.507 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:43.495+0000 7f7770a2d640 1 --2- 172.21.15.83:0/4145239092 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f776c1083c0 0x7f776c19a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:41:43.507 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:43.495+0000 7f7771a2f640 1 --2- 172.21.15.83:0/4145239092 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f776c108d10 0x7f776c19fb80 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f7764031040 tx=0x7f7764032bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:41:43.507 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:43.495+0000 7f77627fc640 1 -- 172.21.15.83:0/4145239092 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7764004040 con 0x7f776c108d10 2024-09-21T01:41:43.507 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:43.495+0000 7f7773492640 1 -- 172.21.15.83:0/4145239092 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f776c1a0540 con 0x7f776c108d10 2024-09-21T01:41:43.507 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:43.495+0000 7f77627fc640 1 -- 172.21.15.83:0/4145239092 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7764004670 con 0x7f776c108d10 2024-09-21T01:41:43.507 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:43.495+0000 7f77627fc640 1 -- 172.21.15.83:0/4145239092 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7764030bb0 con 0x7f776c108d10 2024-09-21T01:41:43.507 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:43.495+0000 7f7773492640 1 -- 172.21.15.83:0/4145239092 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f776c1a6d00 con 0x7f776c108d10 2024-09-21T01:41:43.508 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:43.497+0000 7f7773492640 1 -- 172.21.15.83:0/4145239092 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f776c103d00 con 0x7f776c108d10 2024-09-21T01:41:43.508 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:43.498+0000 7f77627fc640 1 -- 172.21.15.83:0/4145239092 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 22) ==== 154529+0+0 (secure 0 0 0) 0x7f77640041e0 con 0x7f776c108d10 2024-09-21T01:41:43.508 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:43.498+0000 7f77627fc640 1 --2- 172.21.15.83:0/4145239092 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f77580b6560 0x7f77580b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:43.508 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:43.499+0000 7f777122e640 1 --2- 172.21.15.83:0/4145239092 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f77580b6560 0x7f77580b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:43.508 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:43.499+0000 7f77627fc640 1 -- 172.21.15.83:0/4145239092 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9315+0+0 (secure 0 0 0) 0x7f77641089c0 con 0x7f776c108d10 2024-09-21T01:41:43.508 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:43.499+0000 7f777122e640 1 --2- 172.21.15.83:0/4145239092 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f77580b6560 0x7f77580b8a70 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f77680058c0 tx=0x7f776800a250 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:41:43.508 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:43.503+0000 7f77627fc640 1 -- 172.21.15.83:0/4145239092 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f776410ae20 con 0x7f776c108d10 2024-09-21T01:41:43.682 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:43.681+0000 7f7773492640 1 -- 172.21.15.83:0/4145239092 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd dump"} v 0) -- 0x7f776c10bb40 con 0x7f776c108d10 2024-09-21T01:41:43.683 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:43.683+0000 7f77627fc640 1 -- 172.21.15.83:0/4145239092 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v84) ==== 56+0+5995 (secure 0 0 0) 0x7f77640cee10 con 0x7f776c108d10 2024-09-21T01:41:43.684 INFO:teuthology.orchestra.run.smithi083.stdout:epoch 84 2024-09-21T01:41:43.684 INFO:teuthology.orchestra.run.smithi083.stdout:fsid f7697ecc-77b8-11ef-baf5-efdc52797490 2024-09-21T01:41:43.684 INFO:teuthology.orchestra.run.smithi083.stdout:created 2024-09-21T01:31:22.250342+0000 2024-09-21T01:41:43.684 INFO:teuthology.orchestra.run.smithi083.stdout:modified 2024-09-21T01:41:09.873952+0000 2024-09-21T01:41:43.684 INFO:teuthology.orchestra.run.smithi083.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-09-21T01:41:43.684 INFO:teuthology.orchestra.run.smithi083.stdout:crush_version 27 2024-09-21T01:41:43.684 INFO:teuthology.orchestra.run.smithi083.stdout:full_ratio 0.95 2024-09-21T01:41:43.684 INFO:teuthology.orchestra.run.smithi083.stdout:backfillfull_ratio 0.9 2024-09-21T01:41:43.684 INFO:teuthology.orchestra.run.smithi083.stdout:nearfull_ratio 0.85 2024-09-21T01:41:43.684 INFO:teuthology.orchestra.run.smithi083.stdout:require_min_compat_client luminous 2024-09-21T01:41:43.684 INFO:teuthology.orchestra.run.smithi083.stdout:min_compat_client luminous 2024-09-21T01:41:43.685 INFO:teuthology.orchestra.run.smithi083.stdout:require_osd_release squid 2024-09-21T01:41:43.685 INFO:teuthology.orchestra.run.smithi083.stdout:stretch_mode_enabled false 2024-09-21T01:41:43.685 INFO:teuthology.orchestra.run.smithi083.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 22 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-09-21T01:41:43.685 INFO:teuthology.orchestra.run.smithi083.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 74 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.88 2024-09-21T01:41:43.685 INFO:teuthology.orchestra.run.smithi083.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 74 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.05 application cephfs read_balance_score 1.50 2024-09-21T01:41:43.685 INFO:teuthology.orchestra.run.smithi083.stdout:pool 4 'cephfs_data_ec' erasure profile cephfs_data_ec size 4 min_size 3 crush_rule 1 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 80 flags hashpspool,ec_overwrites stripe_width 8192 pg_num_min 64 target_size_ratio 0.9 application cephfs 2024-09-21T01:41:43.685 INFO:teuthology.orchestra.run.smithi083.stdout:max_osd 12 2024-09-21T01:41:43.685 INFO:teuthology.orchestra.run.smithi083.stdout:osd.0 up in weight 1 up_from 9 up_thru 77 down_at 0 last_clean_interval [0,0) [v2:172.21.15.83:6802/3563457494,v1:172.21.15.83:6803/3563457494] [v2:172.21.15.83:6804/3563457494,v1:172.21.15.83:6805/3563457494] exists,up 66947512-01ee-4bf0-87b0-98a168cf50dc 2024-09-21T01:41:43.685 INFO:teuthology.orchestra.run.smithi083.stdout:osd.1 up in weight 1 up_from 13 up_thru 77 down_at 0 last_clean_interval [0,0) [v2:172.21.15.119:6800/2066870220,v1:172.21.15.119:6801/2066870220] [v2:172.21.15.119:6802/2066870220,v1:172.21.15.119:6803/2066870220] exists,up f7818a08-86a5-412d-a164-cfeb18f8650a 2024-09-21T01:41:43.686 INFO:teuthology.orchestra.run.smithi083.stdout:osd.2 up in weight 1 up_from 18 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.142:6800/3955936117,v1:172.21.15.142:6801/3955936117] [v2:172.21.15.142:6802/3955936117,v1:172.21.15.142:6803/3955936117] exists,up 0d1a3870-c67a-4783-85f9-be2bb36f7722 2024-09-21T01:41:43.686 INFO:teuthology.orchestra.run.smithi083.stdout:osd.3 up in weight 1 up_from 25 up_thru 77 down_at 0 last_clean_interval [0,0) [v2:172.21.15.83:6810/3746834093,v1:172.21.15.83:6811/3746834093] [v2:172.21.15.83:6812/3746834093,v1:172.21.15.83:6813/3746834093] exists,up a4cb1a36-3495-4d36-92da-ed3b6e852d14 2024-09-21T01:41:43.686 INFO:teuthology.orchestra.run.smithi083.stdout:osd.4 up in weight 1 up_from 30 up_thru 77 down_at 0 last_clean_interval [0,0) [v2:172.21.15.119:6808/3083907785,v1:172.21.15.119:6809/3083907785] [v2:172.21.15.119:6810/3083907785,v1:172.21.15.119:6811/3083907785] exists,up d6f2ec78-7f08-473b-a96c-e8590f5d2f25 2024-09-21T01:41:43.686 INFO:teuthology.orchestra.run.smithi083.stdout:osd.5 up in weight 1 up_from 35 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.142:6808/349001002,v1:172.21.15.142:6809/349001002] [v2:172.21.15.142:6810/349001002,v1:172.21.15.142:6811/349001002] exists,up c571d04d-d3ea-4d74-8867-e4c7816f4e0e 2024-09-21T01:41:43.686 INFO:teuthology.orchestra.run.smithi083.stdout:osd.6 up in weight 1 up_from 41 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.83:6818/771651063,v1:172.21.15.83:6819/771651063] [v2:172.21.15.83:6820/771651063,v1:172.21.15.83:6821/771651063] exists,up 6e1b6fe9-700a-448a-b382-59b97896ea7b 2024-09-21T01:41:43.686 INFO:teuthology.orchestra.run.smithi083.stdout:osd.7 up in weight 1 up_from 46 up_thru 83 down_at 0 last_clean_interval [0,0) [v2:172.21.15.119:6816/1556984819,v1:172.21.15.119:6817/1556984819] [v2:172.21.15.119:6818/1556984819,v1:172.21.15.119:6819/1556984819] exists,up 283bfae4-5f50-4f9e-860e-bbfd47e005e0 2024-09-21T01:41:43.686 INFO:teuthology.orchestra.run.smithi083.stdout:osd.8 up in weight 1 up_from 52 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.142:6816/1860679473,v1:172.21.15.142:6817/1860679473] [v2:172.21.15.142:6818/1860679473,v1:172.21.15.142:6819/1860679473] exists,up d46e56d4-ed4e-42c3-a315-66af014bd93a 2024-09-21T01:41:43.686 INFO:teuthology.orchestra.run.smithi083.stdout:osd.9 up in weight 1 up_from 58 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.83:6826/3636757924,v1:172.21.15.83:6827/3636757924] [v2:172.21.15.83:6828/3636757924,v1:172.21.15.83:6829/3636757924] exists,up 18a70ee6-56df-4f5c-868d-5db5e72a1859 2024-09-21T01:41:43.686 INFO:teuthology.orchestra.run.smithi083.stdout:osd.10 up in weight 1 up_from 63 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.119:6824/2561963910,v1:172.21.15.119:6825/2561963910] [v2:172.21.15.119:6826/2561963910,v1:172.21.15.119:6827/2561963910] exists,up 0d32c3de-db03-42c3-9914-07d675aaa339 2024-09-21T01:41:43.686 INFO:teuthology.orchestra.run.smithi083.stdout:osd.11 up in weight 1 up_from 68 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.142:6824/1174646198,v1:172.21.15.142:6825/1174646198] [v2:172.21.15.142:6826/1174646198,v1:172.21.15.142:6827/1174646198] exists,up 3a3b444d-b316-4256-bfad-378db29f0824 2024-09-21T01:41:43.686 INFO:teuthology.orchestra.run.smithi083.stdout:pg_upmap_items 2.4 [2,11] 2024-09-21T01:41:43.686 INFO:teuthology.orchestra.run.smithi083.stdout:pg_upmap_items 2.b [8,11] 2024-09-21T01:41:43.686 INFO:teuthology.orchestra.run.smithi083.stdout:pg_upmap_items 3.1 [4,9] 2024-09-21T01:41:43.687 INFO:teuthology.orchestra.run.smithi083.stdout:pg_upmap_items 3.c [3,9] 2024-09-21T01:41:43.687 INFO:teuthology.orchestra.run.smithi083.stdout:pg_upmap_items 3.e [4,8,5,9] 2024-09-21T01:41:43.687 INFO:teuthology.orchestra.run.smithi083.stdout:pg_upmap_items 3.11 [4,6] 2024-09-21T01:41:43.687 INFO:teuthology.orchestra.run.smithi083.stdout:pg_upmap_items 4.3 [5,8] 2024-09-21T01:41:43.687 INFO:teuthology.orchestra.run.smithi083.stdout:pg_upmap_items 4.10 [9,8] 2024-09-21T01:41:43.687 INFO:teuthology.orchestra.run.smithi083.stdout:pg_upmap_items 4.12 [9,10] 2024-09-21T01:41:43.687 INFO:teuthology.orchestra.run.smithi083.stdout:pg_upmap_items 4.1c [9,8] 2024-09-21T01:41:43.687 INFO:teuthology.orchestra.run.smithi083.stdout:blocklist 172.21.15.83:0/1619062496 expires 2024-09-22T01:33:08.666525+0000 2024-09-21T01:41:43.687 INFO:teuthology.orchestra.run.smithi083.stdout:blocklist 172.21.15.83:0/2412709299 expires 2024-09-22T01:31:45.834450+0000 2024-09-21T01:41:43.687 INFO:teuthology.orchestra.run.smithi083.stdout:blocklist 172.21.15.83:6800/4290325964 expires 2024-09-22T01:31:45.834450+0000 2024-09-21T01:41:43.688 INFO:teuthology.orchestra.run.smithi083.stdout:blocklist 172.21.15.83:6801/4290325964 expires 2024-09-22T01:31:45.834450+0000 2024-09-21T01:41:43.688 INFO:teuthology.orchestra.run.smithi083.stdout:blocklist 172.21.15.83:0/1440681183 expires 2024-09-22T01:31:45.834450+0000 2024-09-21T01:41:43.688 INFO:teuthology.orchestra.run.smithi083.stdout:blocklist 172.21.15.83:0/2745413305 expires 2024-09-22T01:31:45.834450+0000 2024-09-21T01:41:43.688 INFO:teuthology.orchestra.run.smithi083.stdout:blocklist 172.21.15.83:6800/1393748565 expires 2024-09-22T01:33:08.666525+0000 2024-09-21T01:41:43.688 INFO:teuthology.orchestra.run.smithi083.stdout:blocklist 172.21.15.83:0/110411274 expires 2024-09-22T01:32:10.073024+0000 2024-09-21T01:41:43.688 INFO:teuthology.orchestra.run.smithi083.stdout:blocklist 172.21.15.83:0/4267551123 expires 2024-09-22T01:33:08.666525+0000 2024-09-21T01:41:43.688 INFO:teuthology.orchestra.run.smithi083.stdout:blocklist 172.21.15.83:0/1068434643 expires 2024-09-22T01:32:10.073024+0000 2024-09-21T01:41:43.688 INFO:teuthology.orchestra.run.smithi083.stdout:blocklist 172.21.15.83:6800/2963261730 expires 2024-09-22T01:32:10.073024+0000 2024-09-21T01:41:43.688 INFO:teuthology.orchestra.run.smithi083.stdout:blocklist 172.21.15.83:0/3544333975 expires 2024-09-22T01:32:10.073024+0000 2024-09-21T01:41:43.688 INFO:teuthology.orchestra.run.smithi083.stdout:blocklist 172.21.15.83:6801/1393748565 expires 2024-09-22T01:33:08.666525+0000 2024-09-21T01:41:43.688 INFO:teuthology.orchestra.run.smithi083.stdout:blocklist 172.21.15.83:6801/2963261730 expires 2024-09-22T01:32:10.073024+0000 2024-09-21T01:41:43.688 INFO:teuthology.orchestra.run.smithi083.stdout:blocklist 172.21.15.83:0/1915285091 expires 2024-09-22T01:33:08.666525+0000 2024-09-21T01:41:43.689 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:43.685+0000 7f7773492640 1 -- 172.21.15.83:0/4145239092 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f77580b6560 msgr2=0x7f77580b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:43.689 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:43.685+0000 7f7773492640 1 --2- 172.21.15.83:0/4145239092 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f77580b6560 0x7f77580b8a70 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f77680058c0 tx=0x7f776800a250 comp rx=0 tx=0).stop 2024-09-21T01:41:43.689 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:43.685+0000 7f7773492640 1 -- 172.21.15.83:0/4145239092 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f776c108d10 msgr2=0x7f776c19fb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:43.690 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:43.685+0000 7f7773492640 1 --2- 172.21.15.83:0/4145239092 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f776c108d10 0x7f776c19fb80 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f7764031040 tx=0x7f7764032bc0 comp rx=0 tx=0).stop 2024-09-21T01:41:43.690 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:43.685+0000 7f7773492640 1 -- 172.21.15.83:0/4145239092 shutdown_connections 2024-09-21T01:41:43.690 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:43.685+0000 7f7773492640 1 --2- 172.21.15.83:0/4145239092 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f77580b6560 0x7f77580b8a70 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:43.690 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:43.685+0000 7f7773492640 1 --2- 172.21.15.83:0/4145239092 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f776c108d10 0x7f776c19fb80 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:43.690 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:43.685+0000 7f7773492640 1 --2- 172.21.15.83:0/4145239092 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f776c1083c0 0x7f776c19a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:43.690 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:43.685+0000 7f7773492640 1 --2- 172.21.15.83:0/4145239092 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f776c102a80 0x7f776c19a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:43.690 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:43.685+0000 7f7773492640 1 -- 172.21.15.83:0/4145239092 >> 172.21.15.83:0/4145239092 conn(0x7f776c079740 msgr2=0x7f776c06bee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:41:43.690 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:43.685+0000 7f7773492640 1 -- 172.21.15.83:0/4145239092 shutdown_connections 2024-09-21T01:41:43.690 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:43.685+0000 7f7773492640 1 -- 172.21.15.83:0/4145239092 wait complete. 2024-09-21T01:41:44.053 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:41:43 smithi083 ceph-mon[31370]: pgmap v329: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 0 B/s wr, 1 op/s 2024-09-21T01:41:44.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:41:43 smithi083 ceph-mon[31370]: from='client.? 172.21.15.83:0/4145239092' entity='client.admin' cmd={"prefix": "osd dump"} : dispatch 2024-09-21T01:41:44.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:41:43 smithi142 ceph-mon[34050]: pgmap v329: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 0 B/s wr, 1 op/s 2024-09-21T01:41:44.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:41:43 smithi142 ceph-mon[34050]: from='client.? 172.21.15.83:0/4145239092' entity='client.admin' cmd={"prefix": "osd dump"} : dispatch 2024-09-21T01:41:44.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:41:43 smithi119 ceph-mon[33693]: pgmap v329: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 0 B/s wr, 1 op/s 2024-09-21T01:41:44.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:41:43 smithi119 ceph-mon[33693]: from='client.? 172.21.15.83:0/4145239092' entity='client.admin' cmd={"prefix": "osd dump"} : dispatch 2024-09-21T01:41:44.561 INFO:teuthology.run_tasks:Running task fs.ready... 2024-09-21T01:41:44.573 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T01:41:45.152 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:41:44 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:41:45.156 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:41:44 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:41:45.182 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:41:44 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:41:45.422 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:41:45.896 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:45.895+0000 7fcc09ea7640 1 -- 172.21.15.83:0/1099851654 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcc041083e0 msgr2=0x7fcc041087f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:45.896 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:45.895+0000 7fcc09ea7640 1 --2- 172.21.15.83:0/1099851654 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcc041083e0 0x7fcc041087f0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fcbf4009900 tx=0x7fcbf402a410 comp rx=0 tx=0).stop 2024-09-21T01:41:45.896 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:45.895+0000 7fcc09ea7640 1 -- 172.21.15.83:0/1099851654 shutdown_connections 2024-09-21T01:41:45.896 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:45.895+0000 7fcc09ea7640 1 --2- 172.21.15.83:0/1099851654 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcc04108d30 0x7fcc0410f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:45.896 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:45.895+0000 7fcc09ea7640 1 --2- 172.21.15.83:0/1099851654 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcc041083e0 0x7fcc041087f0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:45.896 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:45.895+0000 7fcc09ea7640 1 --2- 172.21.15.83:0/1099851654 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcc04102aa0 0x7fcc04102eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:45.896 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:45.895+0000 7fcc09ea7640 1 -- 172.21.15.83:0/1099851654 >> 172.21.15.83:0/1099851654 conn(0x7fcc040797e0 msgr2=0x7fcc04079bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:41:45.896 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:45.895+0000 7fcc09ea7640 1 -- 172.21.15.83:0/1099851654 shutdown_connections 2024-09-21T01:41:45.896 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:45.895+0000 7fcc09ea7640 1 -- 172.21.15.83:0/1099851654 wait complete. 2024-09-21T01:41:45.896 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:45.896+0000 7fcc09ea7640 1 Processor -- start 2024-09-21T01:41:45.898 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:45.896+0000 7fcc09ea7640 1 -- start start 2024-09-21T01:41:45.898 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:45.896+0000 7fcc09ea7640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcc04102aa0 0x7fcc0419b240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:45.898 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:45.896+0000 7fcc09ea7640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcc041083e0 0x7fcc0419b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:45.898 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:45.896+0000 7fcc09ea7640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcc04108d30 0x7fcc0419bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:45.898 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:45.896+0000 7fcc09ea7640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fcc04112850 con 0x7fcc04108d30 2024-09-21T01:41:45.898 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:45.896+0000 7fcc09ea7640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fcc041126d0 con 0x7fcc041083e0 2024-09-21T01:41:45.899 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:45.896+0000 7fcc09ea7640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fcc041129d0 con 0x7fcc04102aa0 2024-09-21T01:41:45.899 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:45.896+0000 7fcc03fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcc04108d30 0x7fcc0419bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:45.899 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:45.896+0000 7fcc03fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcc04108d30 0x7fcc0419bcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:39564/0 (socket says 172.21.15.83:39564) 2024-09-21T01:41:45.899 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:45.896+0000 7fcc037fe640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcc04102aa0 0x7fcc0419b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:45.899 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:45.896+0000 7fcc03fff640 1 -- 172.21.15.83:0/3980958528 learned_addr learned my addr 172.21.15.83:0/3980958528 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:41:45.899 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:45.896+0000 7fcc02ffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcc041083e0 0x7fcc0419b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:45.899 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:45.897+0000 7fcc03fff640 1 -- 172.21.15.83:0/3980958528 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcc04102aa0 msgr2=0x7fcc0419b240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:45.899 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:45.897+0000 7fcc03fff640 1 --2- 172.21.15.83:0/3980958528 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcc04102aa0 0x7fcc0419b240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:45.899 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:45.897+0000 7fcc03fff640 1 -- 172.21.15.83:0/3980958528 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcc041083e0 msgr2=0x7fcc0419b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:45.899 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:45.897+0000 7fcc03fff640 1 --2- 172.21.15.83:0/3980958528 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcc041083e0 0x7fcc0419b780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:45.899 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:45.897+0000 7fcc03fff640 1 -- 172.21.15.83:0/3980958528 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc041a64d0 con 0x7fcc04108d30 2024-09-21T01:41:45.899 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:45.897+0000 7fcc037fe640 1 --2- 172.21.15.83:0/3980958528 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcc04102aa0 0x7fcc0419b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:41:45.899 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:45.897+0000 7fcc03fff640 1 --2- 172.21.15.83:0/3980958528 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcc04108d30 0x7fcc0419bcc0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fcbfc00eb10 tx=0x7fcbfc00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:41:45.899 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:45.897+0000 7fcc00ff9640 1 -- 172.21.15.83:0/3980958528 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbfc004b20 con 0x7fcc04108d30 2024-09-21T01:41:45.899 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:45.897+0000 7fcc00ff9640 1 -- 172.21.15.83:0/3980958528 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcbfc004cc0 con 0x7fcc04108d30 2024-09-21T01:41:45.900 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:45.897+0000 7fcc09ea7640 1 -- 172.21.15.83:0/3980958528 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc04199090 con 0x7fcc04108d30 2024-09-21T01:41:45.900 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:45.897+0000 7fcc00ff9640 1 -- 172.21.15.83:0/3980958528 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbfc010690 con 0x7fcc04108d30 2024-09-21T01:41:45.900 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:45.897+0000 7fcc09ea7640 1 -- 172.21.15.83:0/3980958528 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc04199550 con 0x7fcc04108d30 2024-09-21T01:41:45.900 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:45.898+0000 7fcc09ea7640 1 -- 172.21.15.83:0/3980958528 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc04102eb0 con 0x7fcc04108d30 2024-09-21T01:41:45.900 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:45.900+0000 7fcc00ff9640 1 -- 172.21.15.83:0/3980958528 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 22) ==== 154529+0+0 (secure 0 0 0) 0x7fcbfc010830 con 0x7fcc04108d30 2024-09-21T01:41:45.903 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:45.901+0000 7fcc00ff9640 1 --2- 172.21.15.83:0/3980958528 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fcbf00b6590 0x7fcbf00b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:45.903 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:45.901+0000 7fcc037fe640 1 --2- 172.21.15.83:0/3980958528 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fcbf00b6590 0x7fcbf00b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:45.903 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:45.901+0000 7fcc00ff9640 1 -- 172.21.15.83:0/3980958528 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9315+0+0 (secure 0 0 0) 0x7fcbfc0e7ee0 con 0x7fcc04108d30 2024-09-21T01:41:45.903 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:45.901+0000 7fcc037fe640 1 --2- 172.21.15.83:0/3980958528 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fcbf00b6590 0x7fcbf00b8aa0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fcc0406c380 tx=0x7fcbec012040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:41:45.909 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:45.909+0000 7fcc00ff9640 1 -- 172.21.15.83:0/3980958528 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fcbfc056710 con 0x7fcc04108d30 2024-09-21T01:41:46.053 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:41:45 smithi083 ceph-mon[31370]: pgmap v330: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-21T01:41:46.157 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:46.156+0000 7fcc09ea7640 1 -- 172.21.15.83:0/3980958528 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcc0402e640 con 0x7fcc04108d30 2024-09-21T01:41:46.157 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:46.157+0000 7fcc00ff9640 1 -- 172.21.15.83:0/3980958528 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11857 (secure 0 0 0) 0x7fcbfc0ae2d0 con 0x7fcc04108d30 2024-09-21T01:41:46.159 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T01:41:46.159 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":21,"btime":"2024-09-21T01:40:27:947059+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14775,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6835/1105040204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":1105040204},{"type":"v1","addr":"172.21.15.83:6835","nonce":1105040204}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14787,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/2234789563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6836","nonce":2234789563},{"type":"v1","addr":"172.21.15.83:6837","nonce":2234789563}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14838,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6839/136258364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6838","nonce":136258364},{"type":"v1","addr":"172.21.15.83:6839","nonce":136258364}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14850,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6841/129439444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6840","nonce":129439444},{"type":"v1","addr":"172.21.15.83:6841","nonce":129439444}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24569,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/2839502433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":2839502433},{"type":"v1","addr":"172.21.15.119:6833","nonce":2839502433}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24580,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6833/2841606990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":2841606990},{"type":"v1","addr":"172.21.15.142:6833","nonce":2841606990}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24599,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/415902608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":415902608},{"type":"v1","addr":"172.21.15.119:6835","nonce":415902608}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24607,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/3009088510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":3009088510},{"type":"v1","addr":"172.21.15.142:6835","nonce":3009088510}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24613,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/3847200126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6836","nonce":3847200126},{"type":"v1","addr":"172.21.15.142:6837","nonce":3847200126}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24626,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/3619222976","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":3619222976},{"type":"v1","addr":"172.21.15.119:6837","nonce":3619222976}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T01:39:45.145124+0000","modified":"2024-09-21T01:40:27.664151+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24653},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24631":{"gid":24631,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.142:6839/1817880741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6838","nonce":1817880741},{"type":"v1","addr":"172.21.15.142:6839","nonce":1817880741}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24653":{"gid":24653,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.119:6839/3106757092","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":3106757092},{"type":"v1","addr":"172.21.15.119:6839","nonce":3106757092}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24653,"qdb_cluster":[24653]},"id":1}]} 2024-09-21T01:41:46.159 INFO:teuthology.orchestra.run.smithi083.stderr:dumped fsmap epoch 21 2024-09-21T01:41:46.160 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:46.160+0000 7fcc09ea7640 1 -- 172.21.15.83:0/3980958528 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fcbf00b6590 msgr2=0x7fcbf00b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:46.161 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:46.160+0000 7fcc09ea7640 1 --2- 172.21.15.83:0/3980958528 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fcbf00b6590 0x7fcbf00b8aa0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fcc0406c380 tx=0x7fcbec012040 comp rx=0 tx=0).stop 2024-09-21T01:41:46.161 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:46.160+0000 7fcc09ea7640 1 -- 172.21.15.83:0/3980958528 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcc04108d30 msgr2=0x7fcc0419bcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:46.161 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:46.160+0000 7fcc09ea7640 1 --2- 172.21.15.83:0/3980958528 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcc04108d30 0x7fcc0419bcc0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fcbfc00eb10 tx=0x7fcbfc00c2d0 comp rx=0 tx=0).stop 2024-09-21T01:41:46.161 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:46.160+0000 7fcc09ea7640 1 -- 172.21.15.83:0/3980958528 shutdown_connections 2024-09-21T01:41:46.161 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:46.160+0000 7fcc09ea7640 1 --2- 172.21.15.83:0/3980958528 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fcbf00b6590 0x7fcbf00b8aa0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:46.161 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:46.160+0000 7fcc09ea7640 1 --2- 172.21.15.83:0/3980958528 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcc04108d30 0x7fcc0419bcc0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:46.161 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:46.160+0000 7fcc09ea7640 1 --2- 172.21.15.83:0/3980958528 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcc041083e0 0x7fcc0419b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:46.161 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:46.160+0000 7fcc09ea7640 1 --2- 172.21.15.83:0/3980958528 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcc04102aa0 0x7fcc0419b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:46.161 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:46.160+0000 7fcc09ea7640 1 -- 172.21.15.83:0/3980958528 >> 172.21.15.83:0/3980958528 conn(0x7fcc040797e0 msgr2=0x7fcc04104550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:41:46.161 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:46.160+0000 7fcc09ea7640 1 -- 172.21.15.83:0/3980958528 shutdown_connections 2024-09-21T01:41:46.161 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:46.160+0000 7fcc09ea7640 1 -- 172.21.15.83:0/3980958528 wait complete. 2024-09-21T01:41:46.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:41:45 smithi142 ceph-mon[34050]: pgmap v330: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-21T01:41:46.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:41:45 smithi119 ceph-mon[33693]: pgmap v330: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-21T01:41:46.862 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T01:41:47.118 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:41:47.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:41:46 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:41:47.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:41:46 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:41:47.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:41:46 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:41:47.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:41:46 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:41:47.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:41:46 smithi142 ceph-mon[34050]: from='client.? 172.21.15.83:0/3980958528' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:41:47.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:41:46 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:41:47.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:41:46 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:41:47.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:41:46 smithi142 ceph-mon[34050]: pgmap v331: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-09-21T01:41:47.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:41:46 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:41:47.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:41:46 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:41:47.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:41:46 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:41:47.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:41:46 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:41:47.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:41:46 smithi119 ceph-mon[33693]: from='client.? 172.21.15.83:0/3980958528' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:41:47.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:41:46 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:41:47.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:41:46 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:41:47.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:41:46 smithi119 ceph-mon[33693]: pgmap v331: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-09-21T01:41:47.239 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:41:46 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:41:47.239 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:41:46 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:41:47.239 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:41:46 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:41:47.239 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:41:46 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:41:47.239 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:41:46 smithi083 ceph-mon[31370]: from='client.? 172.21.15.83:0/3980958528' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:41:47.239 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:41:46 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:41:47.239 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:41:46 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:41:47.239 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:41:46 smithi083 ceph-mon[31370]: pgmap v331: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-09-21T01:41:47.646 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:47.634+0000 7fe9eb8a1640 1 -- 172.21.15.83:0/3987162742 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe9e410de70 msgr2=0x7fe9e4110380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:47.646 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:47.634+0000 7fe9eb8a1640 1 --2- 172.21.15.83:0/3987162742 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe9e410de70 0x7fe9e4110380 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fe9dc009ca0 tx=0x7fe9dc02a8c0 comp rx=0 tx=0).stop 2024-09-21T01:41:47.646 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:47.634+0000 7fe9eb8a1640 1 -- 172.21.15.83:0/3987162742 shutdown_connections 2024-09-21T01:41:47.646 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:47.634+0000 7fe9eb8a1640 1 --2- 172.21.15.83:0/3987162742 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe9e410de70 0x7fe9e4110380 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:47.646 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:47.634+0000 7fe9eb8a1640 1 --2- 172.21.15.83:0/3987162742 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe9e41052f0 0x7fe9e410d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:47.646 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:47.634+0000 7fe9eb8a1640 1 --2- 172.21.15.83:0/3987162742 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe9e41048c0 0x7fe9e4104cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:47.647 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:47.634+0000 7fe9eb8a1640 1 -- 172.21.15.83:0/3987162742 >> 172.21.15.83:0/3987162742 conn(0x7fe9e4079770 msgr2=0x7fe9e4079b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:41:47.647 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:47.634+0000 7fe9eb8a1640 1 -- 172.21.15.83:0/3987162742 shutdown_connections 2024-09-21T01:41:47.647 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:47.635+0000 7fe9eb8a1640 1 -- 172.21.15.83:0/3987162742 wait complete. 2024-09-21T01:41:47.647 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:47.635+0000 7fe9eb8a1640 1 Processor -- start 2024-09-21T01:41:47.647 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:47.635+0000 7fe9eb8a1640 1 -- start start 2024-09-21T01:41:47.647 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:47.635+0000 7fe9eb8a1640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe9e41048c0 0x7fe9e41027d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:47.647 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:47.635+0000 7fe9eb8a1640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe9e41052f0 0x7fe9e4102d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:47.647 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:47.635+0000 7fe9eb8a1640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe9e410de70 0x7fe9e4103250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:47.647 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:47.635+0000 7fe9eb8a1640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fe9e41139f0 con 0x7fe9e41048c0 2024-09-21T01:41:47.647 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:47.635+0000 7fe9eb8a1640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fe9e4113870 con 0x7fe9e41052f0 2024-09-21T01:41:47.647 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:47.635+0000 7fe9eb8a1640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fe9e4113b70 con 0x7fe9e410de70 2024-09-21T01:41:47.647 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:47.636+0000 7fe9e963d640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe9e41048c0 0x7fe9e41027d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:47.647 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:47.636+0000 7fe9e963d640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe9e41048c0 0x7fe9e41027d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:39584/0 (socket says 172.21.15.83:39584) 2024-09-21T01:41:47.647 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:47.636+0000 7fe9e963d640 1 -- 172.21.15.83:0/1098742838 learned_addr learned my addr 172.21.15.83:0/1098742838 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:41:47.648 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:47.636+0000 7fe9e8e3c640 1 --2- 172.21.15.83:0/1098742838 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe9e41052f0 0x7fe9e4102d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:47.648 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:47.636+0000 7fe9e9e3e640 1 --2- 172.21.15.83:0/1098742838 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe9e410de70 0x7fe9e4103250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:47.648 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:47.636+0000 7fe9e963d640 1 -- 172.21.15.83:0/1098742838 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe9e410de70 msgr2=0x7fe9e4103250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:47.648 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:47.636+0000 7fe9e963d640 1 --2- 172.21.15.83:0/1098742838 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe9e410de70 0x7fe9e4103250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:47.648 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:47.636+0000 7fe9e963d640 1 -- 172.21.15.83:0/1098742838 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe9e41052f0 msgr2=0x7fe9e4102d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:47.648 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:47.636+0000 7fe9e963d640 1 --2- 172.21.15.83:0/1098742838 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe9e41052f0 0x7fe9e4102d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:47.648 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:47.636+0000 7fe9e963d640 1 -- 172.21.15.83:0/1098742838 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9e41a86a0 con 0x7fe9e41048c0 2024-09-21T01:41:47.648 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:47.636+0000 7fe9e9e3e640 1 --2- 172.21.15.83:0/1098742838 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe9e410de70 0x7fe9e4103250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:41:47.648 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:47.636+0000 7fe9e963d640 1 --2- 172.21.15.83:0/1098742838 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe9e41048c0 0x7fe9e41027d0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fe9e000c890 tx=0x7fe9e000cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:41:47.648 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:47.636+0000 7fe9da7fc640 1 -- 172.21.15.83:0/1098742838 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9e0004220 con 0x7fe9e41048c0 2024-09-21T01:41:47.648 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:47.636+0000 7fe9eb8a1640 1 -- 172.21.15.83:0/1098742838 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9e41a8990 con 0x7fe9e41048c0 2024-09-21T01:41:47.648 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:47.636+0000 7fe9da7fc640 1 -- 172.21.15.83:0/1098742838 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe9e0007e40 con 0x7fe9e41048c0 2024-09-21T01:41:47.648 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:47.636+0000 7fe9da7fc640 1 -- 172.21.15.83:0/1098742838 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9e0004a00 con 0x7fe9e41048c0 2024-09-21T01:41:47.649 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:47.636+0000 7fe9eb8a1640 1 -- 172.21.15.83:0/1098742838 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9e41a8f20 con 0x7fe9e41048c0 2024-09-21T01:41:47.649 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:47.637+0000 7fe9eb8a1640 1 -- 172.21.15.83:0/1098742838 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9e406c200 con 0x7fe9e41048c0 2024-09-21T01:41:47.649 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:47.639+0000 7fe9da7fc640 1 -- 172.21.15.83:0/1098742838 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 22) ==== 154529+0+0 (secure 0 0 0) 0x7fe9e00079b0 con 0x7fe9e41048c0 2024-09-21T01:41:47.649 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:47.639+0000 7fe9da7fc640 1 --2- 172.21.15.83:0/1098742838 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fe9d00b6560 0x7fe9d00b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:47.649 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:47.640+0000 7fe9e8e3c640 1 --2- 172.21.15.83:0/1098742838 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fe9d00b6560 0x7fe9d00b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:47.649 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:47.640+0000 7fe9da7fc640 1 -- 172.21.15.83:0/1098742838 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9315+0+0 (secure 0 0 0) 0x7fe9e00e78d0 con 0x7fe9e41048c0 2024-09-21T01:41:47.649 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:47.640+0000 7fe9e8e3c640 1 --2- 172.21.15.83:0/1098742838 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fe9d00b6560 0x7fe9d00b8a70 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fe9e410fb10 tx=0x7fe9d400b410 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:41:47.649 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:47.643+0000 7fe9da7fc640 1 -- 172.21.15.83:0/1098742838 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe9e0014030 con 0x7fe9e41048c0 2024-09-21T01:41:47.860 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:47.859+0000 7fe9eb8a1640 1 -- 172.21.15.83:0/1098742838 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe9e4104cd0 con 0x7fe9e41048c0 2024-09-21T01:41:47.860 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:47.860+0000 7fe9da7fc640 1 -- 172.21.15.83:0/1098742838 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11857 (secure 0 0 0) 0x7fe9e00add20 con 0x7fe9e41048c0 2024-09-21T01:41:47.861 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T01:41:47.861 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":21,"btime":"2024-09-21T01:40:27:947059+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14775,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6835/1105040204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":1105040204},{"type":"v1","addr":"172.21.15.83:6835","nonce":1105040204}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14787,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/2234789563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6836","nonce":2234789563},{"type":"v1","addr":"172.21.15.83:6837","nonce":2234789563}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14838,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6839/136258364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6838","nonce":136258364},{"type":"v1","addr":"172.21.15.83:6839","nonce":136258364}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14850,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6841/129439444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6840","nonce":129439444},{"type":"v1","addr":"172.21.15.83:6841","nonce":129439444}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24569,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/2839502433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":2839502433},{"type":"v1","addr":"172.21.15.119:6833","nonce":2839502433}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24580,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6833/2841606990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":2841606990},{"type":"v1","addr":"172.21.15.142:6833","nonce":2841606990}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24599,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/415902608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":415902608},{"type":"v1","addr":"172.21.15.119:6835","nonce":415902608}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24607,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/3009088510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":3009088510},{"type":"v1","addr":"172.21.15.142:6835","nonce":3009088510}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24613,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/3847200126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6836","nonce":3847200126},{"type":"v1","addr":"172.21.15.142:6837","nonce":3847200126}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24626,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/3619222976","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":3619222976},{"type":"v1","addr":"172.21.15.119:6837","nonce":3619222976}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T01:39:45.145124+0000","modified":"2024-09-21T01:40:27.664151+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24653},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24631":{"gid":24631,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.142:6839/1817880741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6838","nonce":1817880741},{"type":"v1","addr":"172.21.15.142:6839","nonce":1817880741}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24653":{"gid":24653,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.119:6839/3106757092","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":3106757092},{"type":"v1","addr":"172.21.15.119:6839","nonce":3106757092}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24653,"qdb_cluster":[24653]},"id":1}]} 2024-09-21T01:41:47.861 INFO:teuthology.orchestra.run.smithi083.stderr:dumped fsmap epoch 21 2024-09-21T01:41:47.863 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:47.862+0000 7fe9eb8a1640 1 -- 172.21.15.83:0/1098742838 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fe9d00b6560 msgr2=0x7fe9d00b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:47.863 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:47.862+0000 7fe9eb8a1640 1 --2- 172.21.15.83:0/1098742838 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fe9d00b6560 0x7fe9d00b8a70 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fe9e410fb10 tx=0x7fe9d400b410 comp rx=0 tx=0).stop 2024-09-21T01:41:47.863 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:47.862+0000 7fe9eb8a1640 1 -- 172.21.15.83:0/1098742838 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe9e41048c0 msgr2=0x7fe9e41027d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:47.863 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:47.862+0000 7fe9eb8a1640 1 --2- 172.21.15.83:0/1098742838 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe9e41048c0 0x7fe9e41027d0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fe9e000c890 tx=0x7fe9e000cd50 comp rx=0 tx=0).stop 2024-09-21T01:41:47.863 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:47.862+0000 7fe9eb8a1640 1 -- 172.21.15.83:0/1098742838 shutdown_connections 2024-09-21T01:41:47.863 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:47.862+0000 7fe9eb8a1640 1 --2- 172.21.15.83:0/1098742838 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fe9d00b6560 0x7fe9d00b8a70 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:47.863 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:47.862+0000 7fe9eb8a1640 1 --2- 172.21.15.83:0/1098742838 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe9e410de70 0x7fe9e4103250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:47.863 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:47.862+0000 7fe9eb8a1640 1 --2- 172.21.15.83:0/1098742838 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe9e41052f0 0x7fe9e4102d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:47.863 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:47.862+0000 7fe9eb8a1640 1 --2- 172.21.15.83:0/1098742838 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe9e41048c0 0x7fe9e41027d0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:47.864 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:47.862+0000 7fe9eb8a1640 1 -- 172.21.15.83:0/1098742838 >> 172.21.15.83:0/1098742838 conn(0x7fe9e4079770 msgr2=0x7fe9e41079f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:41:47.864 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:47.862+0000 7fe9eb8a1640 1 -- 172.21.15.83:0/1098742838 shutdown_connections 2024-09-21T01:41:47.864 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:47.862+0000 7fe9eb8a1640 1 -- 172.21.15.83:0/1098742838 wait complete. 2024-09-21T01:41:48.183 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:41:47 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:41:48.183 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:41:47 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:41:48.183 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:41:47 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:41:48.183 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:41:47 smithi083 ceph-mon[31370]: from='client.? 172.21.15.83:0/1098742838' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:41:48.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:41:47 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:41:48.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:41:47 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:41:48.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:41:47 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:41:48.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:41:47 smithi142 ceph-mon[34050]: from='client.? 172.21.15.83:0/1098742838' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:41:48.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:41:47 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:41:48.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:41:47 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:41:48.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:41:47 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:41:48.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:41:47 smithi119 ceph-mon[33693]: from='client.? 172.21.15.83:0/1098742838' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:41:48.465 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T01:41:48.712 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:41:49.096 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:41:48 smithi083 ceph-mon[31370]: pgmap v332: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-09-21T01:41:49.189 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:49.185+0000 7f10dc316640 1 -- 172.21.15.83:0/2626420221 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f10d4108420 msgr2=0x7f10d4108830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:49.189 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:49.185+0000 7f10dc316640 1 --2- 172.21.15.83:0/2626420221 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f10d4108420 0x7f10d4108830 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f10c4009900 tx=0x7f10c402a410 comp rx=0 tx=0).stop 2024-09-21T01:41:49.189 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:49.185+0000 7f10dc316640 1 -- 172.21.15.83:0/2626420221 shutdown_connections 2024-09-21T01:41:49.189 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:49.185+0000 7f10dc316640 1 --2- 172.21.15.83:0/2626420221 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f10d4108d70 0x7f10d410f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:49.189 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:49.185+0000 7f10dc316640 1 --2- 172.21.15.83:0/2626420221 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f10d4108420 0x7f10d4108830 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:49.189 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:49.185+0000 7f10dc316640 1 --2- 172.21.15.83:0/2626420221 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f10d4102ae0 0x7f10d4102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:49.189 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:49.185+0000 7f10dc316640 1 -- 172.21.15.83:0/2626420221 >> 172.21.15.83:0/2626420221 conn(0x7f10d4079770 msgr2=0x7f10d4079b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:41:49.189 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:49.186+0000 7f10dc316640 1 -- 172.21.15.83:0/2626420221 shutdown_connections 2024-09-21T01:41:49.189 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:49.186+0000 7f10dc316640 1 -- 172.21.15.83:0/2626420221 wait complete. 2024-09-21T01:41:49.189 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:49.186+0000 7f10dc316640 1 Processor -- start 2024-09-21T01:41:49.190 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:49.186+0000 7f10dc316640 1 -- start start 2024-09-21T01:41:49.190 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:49.186+0000 7f10dc316640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f10d4102ae0 0x7f10d419b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:49.190 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:49.186+0000 7f10dc316640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f10d4108420 0x7f10d419b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:49.190 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:49.186+0000 7f10dc316640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f10d4108d70 0x7f10d419bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:49.190 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:49.186+0000 7f10dc316640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f10d41128e0 con 0x7f10d4108420 2024-09-21T01:41:49.190 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:49.186+0000 7f10dc316640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f10d4112760 con 0x7f10d4108d70 2024-09-21T01:41:49.190 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:49.186+0000 7f10dc316640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f10d4112a60 con 0x7f10d4102ae0 2024-09-21T01:41:49.190 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:49.187+0000 7f10d98b1640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f10d4108420 0x7f10d419b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:49.190 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:49.187+0000 7f10d98b1640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f10d4108420 0x7f10d419b730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:39614/0 (socket says 172.21.15.83:39614) 2024-09-21T01:41:49.190 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:49.187+0000 7f10d98b1640 1 -- 172.21.15.83:0/1495203299 learned_addr learned my addr 172.21.15.83:0/1495203299 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:41:49.190 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:49.187+0000 7f10da8b3640 1 --2- 172.21.15.83:0/1495203299 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f10d4108d70 0x7f10d419bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:49.190 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:49.187+0000 7f10da0b2640 1 --2- 172.21.15.83:0/1495203299 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f10d4102ae0 0x7f10d419b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:49.191 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:49.187+0000 7f10d98b1640 1 -- 172.21.15.83:0/1495203299 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f10d4102ae0 msgr2=0x7f10d419b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:49.191 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:49.187+0000 7f10d98b1640 1 --2- 172.21.15.83:0/1495203299 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f10d4102ae0 0x7f10d419b1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:49.191 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:49.187+0000 7f10d98b1640 1 -- 172.21.15.83:0/1495203299 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f10d4108d70 msgr2=0x7f10d419bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:49.191 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:49.187+0000 7f10d98b1640 1 --2- 172.21.15.83:0/1495203299 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f10d4108d70 0x7f10d419bc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:49.191 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:49.187+0000 7f10d98b1640 1 -- 172.21.15.83:0/1495203299 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10d41a6470 con 0x7f10d4108420 2024-09-21T01:41:49.191 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:49.187+0000 7f10da8b3640 1 --2- 172.21.15.83:0/1495203299 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f10d4108d70 0x7f10d419bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:41:49.191 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:49.187+0000 7f10d98b1640 1 --2- 172.21.15.83:0/1495203299 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f10d4108420 0x7f10d419b730 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f10c4005940 tx=0x7f10c40040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:41:49.191 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:49.187+0000 7f10cb7fe640 1 -- 172.21.15.83:0/1495203299 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10c403f030 con 0x7f10d4108420 2024-09-21T01:41:49.191 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:49.187+0000 7f10cb7fe640 1 -- 172.21.15.83:0/1495203299 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f10c4003a80 con 0x7f10d4108420 2024-09-21T01:41:49.191 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:49.187+0000 7f10dc316640 1 -- 172.21.15.83:0/1495203299 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10d41a6700 con 0x7f10d4108420 2024-09-21T01:41:49.191 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:49.187+0000 7f10cb7fe640 1 -- 172.21.15.83:0/1495203299 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10c4035070 con 0x7f10d4108420 2024-09-21T01:41:49.191 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:49.187+0000 7f10dc316640 1 -- 172.21.15.83:0/1495203299 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10d41a6be0 con 0x7f10d4108420 2024-09-21T01:41:49.191 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:49.188+0000 7f10dc316640 1 -- 172.21.15.83:0/1495203299 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10d4103d60 con 0x7f10d4108420 2024-09-21T01:41:49.192 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:49.190+0000 7f10cb7fe640 1 -- 172.21.15.83:0/1495203299 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 22) ==== 154529+0+0 (secure 0 0 0) 0x7f10c4042030 con 0x7f10d4108420 2024-09-21T01:41:49.192 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:49.191+0000 7f10cb7fe640 1 --2- 172.21.15.83:0/1495203299 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f10c00b6560 0x7f10c00b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:49.192 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:49.191+0000 7f10da0b2640 1 --2- 172.21.15.83:0/1495203299 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f10c00b6560 0x7f10c00b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:49.192 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:49.191+0000 7f10cb7fe640 1 -- 172.21.15.83:0/1495203299 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9315+0+0 (secure 0 0 0) 0x7f10c4108180 con 0x7f10d4108420 2024-09-21T01:41:49.192 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:49.191+0000 7f10da0b2640 1 --2- 172.21.15.83:0/1495203299 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f10c00b6560 0x7f10c00b8a70 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f10d0005fd0 tx=0x7f10d0005ce0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:41:49.194 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:49.194+0000 7f10cb7fe640 1 -- 172.21.15.83:0/1495203299 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f10c40ce5d0 con 0x7f10d4108420 2024-09-21T01:41:49.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:41:48 smithi142 ceph-mon[34050]: pgmap v332: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-09-21T01:41:49.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:41:48 smithi119 ceph-mon[33693]: pgmap v332: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-09-21T01:41:49.374 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:49.374+0000 7f10dc316640 1 -- 172.21.15.83:0/1495203299 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f10d4102ef0 con 0x7f10d4108420 2024-09-21T01:41:49.375 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:49.375+0000 7f10cb7fe640 1 -- 172.21.15.83:0/1495203299 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) ==== 74+0+25096 (secure 0 0 0) 0x7f10d4102ef0 con 0x7f10d4108420 2024-09-21T01:41:49.376 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T01:41:49.376 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":84,"fsid":"f7697ecc-77b8-11ef-baf5-efdc52797490","created":"2024-09-21T01:31:22.250342+0000","modified":"2024-09-21T01:41:09.873952+0000","last_up_change":"2024-09-21T01:38:53.501659+0000","last_in_change":"2024-09-21T01:38:30.688516+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T01:35:06.977668+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T01:39:41.041950+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T01:39:42.882272+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T01:39:49.320532+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"66947512-01ee-4bf0-87b0-98a168cf50dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":3563457494},{"type":"v1","addr":"172.21.15.83:6803","nonce":3563457494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":3563457494},{"type":"v1","addr":"172.21.15.83:6805","nonce":3563457494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":3563457494},{"type":"v1","addr":"172.21.15.83:6809","nonce":3563457494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":3563457494},{"type":"v1","addr":"172.21.15.83:6807","nonce":3563457494}]},"public_addr":"172.21.15.83:6803/3563457494","cluster_addr":"172.21.15.83:6805/3563457494","heartbeat_back_addr":"172.21.15.83:6809/3563457494","heartbeat_front_addr":"172.21.15.83:6807/3563457494","state":["exists","up"]},{"osd":1,"uuid":"f7818a08-86a5-412d-a164-cfeb18f8650a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":2066870220},{"type":"v1","addr":"172.21.15.119:6801","nonce":2066870220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":2066870220},{"type":"v1","addr":"172.21.15.119:6803","nonce":2066870220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":2066870220},{"type":"v1","addr":"172.21.15.119:6807","nonce":2066870220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":2066870220},{"type":"v1","addr":"172.21.15.119:6805","nonce":2066870220}]},"public_addr":"172.21.15.119:6801/2066870220","cluster_addr":"172.21.15.119:6803/2066870220","heartbeat_back_addr":"172.21.15.119:6807/2066870220","heartbeat_front_addr":"172.21.15.119:6805/2066870220","state":["exists","up"]},{"osd":2,"uuid":"0d1a3870-c67a-4783-85f9-be2bb36f7722","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":3955936117},{"type":"v1","addr":"172.21.15.142:6801","nonce":3955936117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3955936117},{"type":"v1","addr":"172.21.15.142:6803","nonce":3955936117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":3955936117},{"type":"v1","addr":"172.21.15.142:6807","nonce":3955936117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":3955936117},{"type":"v1","addr":"172.21.15.142:6805","nonce":3955936117}]},"public_addr":"172.21.15.142:6801/3955936117","cluster_addr":"172.21.15.142:6803/3955936117","heartbeat_back_addr":"172.21.15.142:6807/3955936117","heartbeat_front_addr":"172.21.15.142:6805/3955936117","state":["exists","up"]},{"osd":3,"uuid":"a4cb1a36-3495-4d36-92da-ed3b6e852d14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":3746834093},{"type":"v1","addr":"172.21.15.83:6811","nonce":3746834093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":3746834093},{"type":"v1","addr":"172.21.15.83:6813","nonce":3746834093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":3746834093},{"type":"v1","addr":"172.21.15.83:6817","nonce":3746834093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":3746834093},{"type":"v1","addr":"172.21.15.83:6815","nonce":3746834093}]},"public_addr":"172.21.15.83:6811/3746834093","cluster_addr":"172.21.15.83:6813/3746834093","heartbeat_back_addr":"172.21.15.83:6817/3746834093","heartbeat_front_addr":"172.21.15.83:6815/3746834093","state":["exists","up"]},{"osd":4,"uuid":"d6f2ec78-7f08-473b-a96c-e8590f5d2f25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":3083907785},{"type":"v1","addr":"172.21.15.119:6809","nonce":3083907785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":3083907785},{"type":"v1","addr":"172.21.15.119:6811","nonce":3083907785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":3083907785},{"type":"v1","addr":"172.21.15.119:6815","nonce":3083907785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":3083907785},{"type":"v1","addr":"172.21.15.119:6813","nonce":3083907785}]},"public_addr":"172.21.15.119:6809/3083907785","cluster_addr":"172.21.15.119:6811/3083907785","heartbeat_back_addr":"172.21.15.119:6815/3083907785","heartbeat_front_addr":"172.21.15.119:6813/3083907785","state":["exists","up"]},{"osd":5,"uuid":"c571d04d-d3ea-4d74-8867-e4c7816f4e0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":349001002},{"type":"v1","addr":"172.21.15.142:6809","nonce":349001002}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":349001002},{"type":"v1","addr":"172.21.15.142:6811","nonce":349001002}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":349001002},{"type":"v1","addr":"172.21.15.142:6815","nonce":349001002}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":349001002},{"type":"v1","addr":"172.21.15.142:6813","nonce":349001002}]},"public_addr":"172.21.15.142:6809/349001002","cluster_addr":"172.21.15.142:6811/349001002","heartbeat_back_addr":"172.21.15.142:6815/349001002","heartbeat_front_addr":"172.21.15.142:6813/349001002","state":["exists","up"]},{"osd":6,"uuid":"6e1b6fe9-700a-448a-b382-59b97896ea7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":771651063},{"type":"v1","addr":"172.21.15.83:6819","nonce":771651063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":771651063},{"type":"v1","addr":"172.21.15.83:6821","nonce":771651063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":771651063},{"type":"v1","addr":"172.21.15.83:6825","nonce":771651063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":771651063},{"type":"v1","addr":"172.21.15.83:6823","nonce":771651063}]},"public_addr":"172.21.15.83:6819/771651063","cluster_addr":"172.21.15.83:6821/771651063","heartbeat_back_addr":"172.21.15.83:6825/771651063","heartbeat_front_addr":"172.21.15.83:6823/771651063","state":["exists","up"]},{"osd":7,"uuid":"283bfae4-5f50-4f9e-860e-bbfd47e005e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":1556984819},{"type":"v1","addr":"172.21.15.119:6817","nonce":1556984819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":1556984819},{"type":"v1","addr":"172.21.15.119:6819","nonce":1556984819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":1556984819},{"type":"v1","addr":"172.21.15.119:6823","nonce":1556984819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":1556984819},{"type":"v1","addr":"172.21.15.119:6821","nonce":1556984819}]},"public_addr":"172.21.15.119:6817/1556984819","cluster_addr":"172.21.15.119:6819/1556984819","heartbeat_back_addr":"172.21.15.119:6823/1556984819","heartbeat_front_addr":"172.21.15.119:6821/1556984819","state":["exists","up"]},{"osd":8,"uuid":"d46e56d4-ed4e-42c3-a315-66af014bd93a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":1860679473},{"type":"v1","addr":"172.21.15.142:6817","nonce":1860679473}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":1860679473},{"type":"v1","addr":"172.21.15.142:6819","nonce":1860679473}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":1860679473},{"type":"v1","addr":"172.21.15.142:6823","nonce":1860679473}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":1860679473},{"type":"v1","addr":"172.21.15.142:6821","nonce":1860679473}]},"public_addr":"172.21.15.142:6817/1860679473","cluster_addr":"172.21.15.142:6819/1860679473","heartbeat_back_addr":"172.21.15.142:6823/1860679473","heartbeat_front_addr":"172.21.15.142:6821/1860679473","state":["exists","up"]},{"osd":9,"uuid":"18a70ee6-56df-4f5c-868d-5db5e72a1859","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":3636757924},{"type":"v1","addr":"172.21.15.83:6827","nonce":3636757924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":3636757924},{"type":"v1","addr":"172.21.15.83:6829","nonce":3636757924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6832","nonce":3636757924},{"type":"v1","addr":"172.21.15.83:6833","nonce":3636757924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":3636757924},{"type":"v1","addr":"172.21.15.83:6831","nonce":3636757924}]},"public_addr":"172.21.15.83:6827/3636757924","cluster_addr":"172.21.15.83:6829/3636757924","heartbeat_back_addr":"172.21.15.83:6833/3636757924","heartbeat_front_addr":"172.21.15.83:6831/3636757924","state":["exists","up"]},{"osd":10,"uuid":"0d32c3de-db03-42c3-9914-07d675aaa339","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":2561963910},{"type":"v1","addr":"172.21.15.119:6825","nonce":2561963910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":2561963910},{"type":"v1","addr":"172.21.15.119:6827","nonce":2561963910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2561963910},{"type":"v1","addr":"172.21.15.119:6831","nonce":2561963910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2561963910},{"type":"v1","addr":"172.21.15.119:6829","nonce":2561963910}]},"public_addr":"172.21.15.119:6825/2561963910","cluster_addr":"172.21.15.119:6827/2561963910","heartbeat_back_addr":"172.21.15.119:6831/2561963910","heartbeat_front_addr":"172.21.15.119:6829/2561963910","state":["exists","up"]},{"osd":11,"uuid":"3a3b444d-b316-4256-bfad-378db29f0824","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":1174646198},{"type":"v1","addr":"172.21.15.142:6825","nonce":1174646198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":1174646198},{"type":"v1","addr":"172.21.15.142:6827","nonce":1174646198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1174646198},{"type":"v1","addr":"172.21.15.142:6831","nonce":1174646198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1174646198},{"type":"v1","addr":"172.21.15.142:6829","nonce":1174646198}]},"public_addr":"172.21.15.142:6825/1174646198","cluster_addr":"172.21.15.142:6827/1174646198","heartbeat_back_addr":"172.21.15.142:6831/1174646198","heartbeat_front_addr":"172.21.15.142:6829/1174646198","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:34:15.337672+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:34:39.259716+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:35:03.348886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:35:29.465711+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:35:53.744378+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:36:19.488785+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:36:45.708616+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:37:11.501065+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:37:36.027277+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:38:01.903625+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:38:27.215212+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:38:51.891278+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.e","mappings":[{"from":4,"to":8},{"from":5,"to":9}]},{"pgid":"3.11","mappings":[{"from":4,"to":6}]},{"pgid":"4.3","mappings":[{"from":5,"to":8}]},{"pgid":"4.10","mappings":[{"from":9,"to":8}]},{"pgid":"4.12","mappings":[{"from":9,"to":10}]},{"pgid":"4.1c","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.83:0/1619062496":"2024-09-22T01:33:08.666525+0000","172.21.15.83:0/2412709299":"2024-09-22T01:31:45.834450+0000","172.21.15.83:6800/4290325964":"2024-09-22T01:31:45.834450+0000","172.21.15.83:6801/4290325964":"2024-09-22T01:31:45.834450+0000","172.21.15.83:0/1440681183":"2024-09-22T01:31:45.834450+0000","172.21.15.83:0/2745413305":"2024-09-22T01:31:45.834450+0000","172.21.15.83:6800/1393748565":"2024-09-22T01:33:08.666525+0000","172.21.15.83:0/110411274":"2024-09-22T01:32:10.073024+0000","172.21.15.83:0/4267551123":"2024-09-22T01:33:08.666525+0000","172.21.15.83:0/1068434643":"2024-09-22T01:32:10.073024+0000","172.21.15.83:6800/2963261730":"2024-09-22T01:32:10.073024+0000","172.21.15.83:0/3544333975":"2024-09-22T01:32:10.073024+0000","172.21.15.83:6801/1393748565":"2024-09-22T01:33:08.666525+0000","172.21.15.83:6801/2963261730":"2024-09-22T01:32:10.073024+0000","172.21.15.83:0/1915285091":"2024-09-22T01:33:08.666525+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T01:41:49.378 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:49.377+0000 7f10dc316640 1 -- 172.21.15.83:0/1495203299 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f10c00b6560 msgr2=0x7f10c00b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:49.378 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:49.377+0000 7f10dc316640 1 --2- 172.21.15.83:0/1495203299 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f10c00b6560 0x7f10c00b8a70 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f10d0005fd0 tx=0x7f10d0005ce0 comp rx=0 tx=0).stop 2024-09-21T01:41:49.378 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:49.377+0000 7f10dc316640 1 -- 172.21.15.83:0/1495203299 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f10d4108420 msgr2=0x7f10d419b730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:49.378 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:49.377+0000 7f10dc316640 1 --2- 172.21.15.83:0/1495203299 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f10d4108420 0x7f10d419b730 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f10c4005940 tx=0x7f10c40040e0 comp rx=0 tx=0).stop 2024-09-21T01:41:49.378 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:49.377+0000 7f10dc316640 1 -- 172.21.15.83:0/1495203299 shutdown_connections 2024-09-21T01:41:49.378 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:49.377+0000 7f10dc316640 1 --2- 172.21.15.83:0/1495203299 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f10c00b6560 0x7f10c00b8a70 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:49.378 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:49.377+0000 7f10dc316640 1 --2- 172.21.15.83:0/1495203299 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f10d4108d70 0x7f10d419bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:49.378 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:49.377+0000 7f10dc316640 1 --2- 172.21.15.83:0/1495203299 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f10d4108420 0x7f10d419b730 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:49.378 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:49.377+0000 7f10dc316640 1 --2- 172.21.15.83:0/1495203299 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f10d4102ae0 0x7f10d419b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:49.378 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:49.377+0000 7f10dc316640 1 -- 172.21.15.83:0/1495203299 >> 172.21.15.83:0/1495203299 conn(0x7f10d4079770 msgr2=0x7f10d4106570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:41:49.378 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:49.377+0000 7f10dc316640 1 -- 172.21.15.83:0/1495203299 shutdown_connections 2024-09-21T01:41:49.379 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:49.377+0000 7f10dc316640 1 -- 172.21.15.83:0/1495203299 wait complete. 2024-09-21T01:41:49.994 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:41:49 smithi083 ceph-mon[31370]: from='client.? 172.21.15.83:0/1495203299' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T01:41:50.023 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 21, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-21T01:39:45.145124+0000', 'modified': '2024-09-21T01:40:27.664151+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 24653}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24631': {'gid': 24631, 'name': 'i', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.142:6839/1817880741', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.142:6838', 'nonce': 1817880741}, {'type': 'v1', 'addr': '172.21.15.142:6839', 'nonce': 1817880741}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24653': {'gid': 24653, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.119:6839/3106757092', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.119:6838', 'nonce': 3106757092}, {'type': 'v1', 'addr': '172.21.15.119:6839', 'nonce': 3106757092}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24653, 'qdb_cluster': [24653]} 2024-09-21T01:41:50.023 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-21T01:41:50.023 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph tell mds.b status 2024-09-21T01:41:50.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:41:49 smithi142 ceph-mon[34050]: from='client.? 172.21.15.83:0/1495203299' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T01:41:50.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:41:49 smithi119 ceph-mon[33693]: from='client.? 172.21.15.83:0/1495203299' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T01:41:50.269 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:41:50.783 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.754+0000 7ff482cc7640 1 -- 172.21.15.83:0/2883033405 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff47c103bb0 msgr2=0x7ff47c103fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:50.783 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.754+0000 7ff482cc7640 1 --2- 172.21.15.83:0/2883033405 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff47c103bb0 0x7ff47c103fc0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7ff478009900 tx=0x7ff47802a410 comp rx=0 tx=0).stop 2024-09-21T01:41:50.783 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.754+0000 7ff482cc7640 1 -- 172.21.15.83:0/2883033405 shutdown_connections 2024-09-21T01:41:50.783 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.754+0000 7ff482cc7640 1 --2- 172.21.15.83:0/2883033405 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff47c109e40 0x7ff47c110670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:50.783 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.754+0000 7ff482cc7640 1 --2- 172.21.15.83:0/2883033405 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff47c1094f0 0x7ff47c109900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:50.783 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.754+0000 7ff482cc7640 1 --2- 172.21.15.83:0/2883033405 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff47c103bb0 0x7ff47c103fc0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:50.783 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.754+0000 7ff482cc7640 1 -- 172.21.15.83:0/2883033405 >> 172.21.15.83:0/2883033405 conn(0x7ff47c0ff600 msgr2=0x7ff47c101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:41:50.783 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.754+0000 7ff482cc7640 1 -- 172.21.15.83:0/2883033405 shutdown_connections 2024-09-21T01:41:50.784 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.754+0000 7ff482cc7640 1 -- 172.21.15.83:0/2883033405 wait complete. 2024-09-21T01:41:50.784 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.754+0000 7ff482cc7640 1 Processor -- start 2024-09-21T01:41:50.784 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.754+0000 7ff482cc7640 1 -- start start 2024-09-21T01:41:50.784 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.755+0000 7ff482cc7640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff47c103bb0 0x7ff47c19a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:50.784 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.755+0000 7ff482cc7640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff47c1094f0 0x7ff47c19aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:50.784 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.755+0000 7ff482cc7640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff47c109e40 0x7ff47c19fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:50.784 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.755+0000 7ff482cc7640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7ff47c113a10 con 0x7ff47c109e40 2024-09-21T01:41:50.784 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.755+0000 7ff482cc7640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7ff47c113890 con 0x7ff47c1094f0 2024-09-21T01:41:50.784 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.755+0000 7ff482cc7640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7ff47c113b90 con 0x7ff47c103bb0 2024-09-21T01:41:50.784 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.755+0000 7ff481264640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff47c109e40 0x7ff47c19fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:50.784 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.755+0000 7ff481264640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff47c109e40 0x7ff47c19fcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:39640/0 (socket says 172.21.15.83:39640) 2024-09-21T01:41:50.784 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.755+0000 7ff481264640 1 -- 172.21.15.83:0/1759817656 learned_addr learned my addr 172.21.15.83:0/1759817656 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:41:50.784 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.755+0000 7ff480a63640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff47c103bb0 0x7ff47c19a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:50.784 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.755+0000 7ff473fff640 1 --2- 172.21.15.83:0/1759817656 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff47c1094f0 0x7ff47c19aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:50.785 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.755+0000 7ff481264640 1 -- 172.21.15.83:0/1759817656 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff47c103bb0 msgr2=0x7ff47c19a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:50.785 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.755+0000 7ff481264640 1 --2- 172.21.15.83:0/1759817656 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff47c103bb0 0x7ff47c19a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:50.785 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.755+0000 7ff481264640 1 -- 172.21.15.83:0/1759817656 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff47c1094f0 msgr2=0x7ff47c19aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:50.785 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.755+0000 7ff481264640 1 --2- 172.21.15.83:0/1759817656 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff47c1094f0 0x7ff47c19aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:50.785 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.755+0000 7ff481264640 1 -- 172.21.15.83:0/1759817656 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff47c1a03f0 con 0x7ff47c109e40 2024-09-21T01:41:50.785 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.755+0000 7ff473fff640 1 --2- 172.21.15.83:0/1759817656 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff47c1094f0 0x7ff47c19aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:41:50.785 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.755+0000 7ff481264640 1 --2- 172.21.15.83:0/1759817656 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff47c109e40 0x7ff47c19fcc0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7ff47400cad0 tx=0x7ff47400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:41:50.785 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.755+0000 7ff471ffb640 1 -- 172.21.15.83:0/1759817656 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff47400ae20 con 0x7ff47c109e40 2024-09-21T01:41:50.785 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.756+0000 7ff471ffb640 1 -- 172.21.15.83:0/1759817656 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff474005020 con 0x7ff47c109e40 2024-09-21T01:41:50.785 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.756+0000 7ff482cc7640 1 -- 172.21.15.83:0/1759817656 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff47c1a06e0 con 0x7ff47c109e40 2024-09-21T01:41:50.785 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.756+0000 7ff471ffb640 1 -- 172.21.15.83:0/1759817656 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff47400f6b0 con 0x7ff47c109e40 2024-09-21T01:41:50.785 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.756+0000 7ff482cc7640 1 -- 172.21.15.83:0/1759817656 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff47c1a6ec0 con 0x7ff47c109e40 2024-09-21T01:41:50.785 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.758+0000 7ff471ffb640 1 -- 172.21.15.83:0/1759817656 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 22) ==== 154529+0+0 (secure 0 0 0) 0x7ff4740051d0 con 0x7ff47c109e40 2024-09-21T01:41:50.785 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.758+0000 7ff48923b740 1 Processor -- start 2024-09-21T01:41:50.786 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.758+0000 7ff48923b740 1 -- start start 2024-09-21T01:41:50.786 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.758+0000 7ff48923b740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ea418aef60 0x55ea41c54f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:50.786 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.759+0000 7ff48923b740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ea418860a0 0x55ea41c55440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:50.786 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.759+0000 7ff48923b740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ea4188e280 0x55ea41c55980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:50.786 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.759+0000 7ff48923b740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55ea41bccc10 con 0x55ea418860a0 2024-09-21T01:41:50.786 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.759+0000 7ff48923b740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55ea41bbc040 con 0x55ea4188e280 2024-09-21T01:41:50.786 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.759+0000 7ff48923b740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55ea41bbfe50 con 0x55ea418aef60 2024-09-21T01:41:50.786 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.759+0000 7ff480a63640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ea418860a0 0x55ea41c55440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:50.786 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.759+0000 7ff480a63640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ea418860a0 0x55ea41c55440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:39650/0 (socket says 172.21.15.83:39650) 2024-09-21T01:41:50.786 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.759+0000 7ff480a63640 1 -- 172.21.15.83:0/3394624517 learned_addr learned my addr 172.21.15.83:0/3394624517 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:41:50.786 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.759+0000 7ff473fff640 1 --2- 172.21.15.83:0/3394624517 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ea418aef60 0x55ea41c54f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:50.786 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.759+0000 7ff471ffb640 1 --2- 172.21.15.83:0/1759817656 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7ff4640b65e0 0x7ff4640b8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:50.786 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.759+0000 7ff473fff640 1 --2- 172.21.15.83:0/3394624517 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ea4188e280 0x55ea41c55980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:50.787 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.759+0000 7ff480a63640 1 -- 172.21.15.83:0/3394624517 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ea418aef60 msgr2=0x55ea41c54f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:41:50.787 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.759+0000 7ff480a63640 1 --2- 172.21.15.83:0/3394624517 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ea418aef60 0x55ea41c54f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:50.787 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.759+0000 7ff480a63640 1 -- 172.21.15.83:0/3394624517 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ea4188e280 msgr2=0x55ea41c55980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:41:50.787 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.759+0000 7ff480a63640 1 --2- 172.21.15.83:0/3394624517 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ea4188e280 0x55ea41c55980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:50.787 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.759+0000 7ff480a63640 1 -- 172.21.15.83:0/3394624517 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea4191a540 con 0x55ea418860a0 2024-09-21T01:41:50.787 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.759+0000 7ff473fff640 1 --2- 172.21.15.83:0/3394624517 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ea4188e280 0x55ea41c55980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:41:50.787 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.759+0000 7ff481264640 1 --2- 172.21.15.83:0/1759817656 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7ff4640b65e0 0x7ff4640b8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:50.787 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.759+0000 7ff471ffb640 1 -- 172.21.15.83:0/1759817656 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9315+0+0 (secure 0 0 0) 0x7ff4740e7ab0 con 0x7ff47c109e40 2024-09-21T01:41:50.787 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.759+0000 7ff480a63640 1 --2- 172.21.15.83:0/3394624517 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ea418860a0 0x55ea41c55440 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7ff47802a930 tx=0x7ff478031d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3e4fade0c92d37a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:41:50.787 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.759+0000 7ff462ffd640 1 -- 172.21.15.83:0/3394624517 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff478035030 con 0x55ea418860a0 2024-09-21T01:41:50.787 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.760+0000 7ff462ffd640 1 -- 172.21.15.83:0/3394624517 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff478040070 con 0x55ea418860a0 2024-09-21T01:41:50.787 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.760+0000 7ff462ffd640 1 -- 172.21.15.83:0/3394624517 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff478003a50 con 0x55ea418860a0 2024-09-21T01:41:50.787 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.760+0000 7ff48923b740 1 -- 172.21.15.83:0/3394624517 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ea418860a0 msgr2=0x55ea41c55440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:50.787 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.760+0000 7ff48923b740 1 --2- 172.21.15.83:0/3394624517 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ea418860a0 0x55ea41c55440 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7ff47802a930 tx=0x7ff478031d10 comp rx=0 tx=0).stop 2024-09-21T01:41:50.788 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.760+0000 7ff481264640 1 --2- 172.21.15.83:0/1759817656 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7ff4640b65e0 0x7ff4640b8af0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7ff4740aaa70 tx=0x7ff47407aae0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:41:50.788 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.761+0000 7ff48923b740 1 -- 172.21.15.83:0/3394624517 shutdown_connections 2024-09-21T01:41:50.788 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.761+0000 7ff48923b740 1 --2- 172.21.15.83:0/3394624517 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ea4188e280 0x55ea41c55980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:50.788 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.761+0000 7ff48923b740 1 --2- 172.21.15.83:0/3394624517 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ea418860a0 0x55ea41c55440 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:50.788 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.761+0000 7ff48923b740 1 --2- 172.21.15.83:0/3394624517 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ea418aef60 0x55ea41c54f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:50.788 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.761+0000 7ff48923b740 1 -- 172.21.15.83:0/3394624517 >> 172.21.15.83:0/3394624517 conn(0x55ea418a3350 msgr2=0x55ea41c52df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:41:50.788 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.761+0000 7ff48923b740 1 -- 172.21.15.83:0/3394624517 shutdown_connections 2024-09-21T01:41:50.788 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.761+0000 7ff48923b740 1 -- 172.21.15.83:0/3394624517 wait complete. 2024-09-21T01:41:50.788 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.761+0000 7ff48923b740 1 -- start start 2024-09-21T01:41:50.788 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.761+0000 7ff48923b740 1 Processor -- start 2024-09-21T01:41:50.788 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.762+0000 7ff48923b740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ea418860a0 0x55ea41c64e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:50.789 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.762+0000 7ff48923b740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ea4188e280 0x55ea41c65370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:50.789 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.762+0000 7ff48923b740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ea418aef60 0x55ea41c70d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:50.789 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.762+0000 7ff48923b740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55ea41a1d5f0 con 0x55ea418aef60 2024-09-21T01:41:50.789 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.762+0000 7ff48923b740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55ea41b57010 con 0x55ea418860a0 2024-09-21T01:41:50.789 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.762+0000 7ff48923b740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55ea41c679b0 con 0x55ea4188e280 2024-09-21T01:41:50.789 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.762+0000 7ff48923b740 10 client.0 _ll_register_callbacks cb 0x55ea41bb6340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:41:50.789 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.762+0000 7ff473fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ea418aef60 0x55ea41c70d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:50.789 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.762+0000 7ff473fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ea418aef60 0x55ea41c70d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:39654/0 (socket says 172.21.15.83:39654) 2024-09-21T01:41:50.789 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.762+0000 7ff473fff640 1 -- 172.21.15.83:0/1309335371 learned_addr learned my addr 172.21.15.83:0/1309335371 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:41:50.789 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.762+0000 7ff473fff640 1 --2- 172.21.15.83:0/1309335371 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ea418860a0 0x55ea41c64e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:50.789 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.762+0000 7ff480a63640 1 --2- 172.21.15.83:0/1309335371 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ea4188e280 0x55ea41c65370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:50.789 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.762+0000 7ff473fff640 1 -- 172.21.15.83:0/1309335371 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ea4188e280 msgr2=0x55ea41c65370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:41:50.789 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.762+0000 7ff473fff640 1 --2- 172.21.15.83:0/1309335371 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ea4188e280 0x55ea41c65370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:50.789 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.762+0000 7ff473fff640 1 -- 172.21.15.83:0/1309335371 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ea418860a0 msgr2=0x55ea41c64e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:41:50.790 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.762+0000 7ff473fff640 1 --2- 172.21.15.83:0/1309335371 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ea418860a0 0x55ea41c64e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:50.790 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.762+0000 7ff473fff640 1 -- 172.21.15.83:0/1309335371 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ea41b84a00 con 0x55ea418aef60 2024-09-21T01:41:50.790 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.762+0000 7ff473fff640 1 --2- 172.21.15.83:0/1309335371 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ea418aef60 0x55ea41c70d10 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7ff46c00cfd0 tx=0x7ff46c006bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d4dfcbfe0e1af36 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:41:50.790 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.762+0000 7ff45bfff640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-09-21T01:41:50.790 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.762+0000 7ff45bfff640 1 -- 172.21.15.83:0/1309335371 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff46c00f040 con 0x55ea418aef60 2024-09-21T01:41:50.790 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.762+0000 7ff45bfff640 1 -- 172.21.15.83:0/1309335371 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9315+0+0 (secure 0 0 0) 0x7ff46c011c60 con 0x55ea418aef60 2024-09-21T01:41:50.790 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.762+0000 7ff48923b740 1 -- 172.21.15.83:0/1309335371 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff478040070 con 0x55ea418aef60 2024-09-21T01:41:50.790 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.762+0000 7ff45bfff640 1 -- 172.21.15.83:0/1309335371 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7ff46c011e60 con 0x55ea418aef60 2024-09-21T01:41:50.790 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.763+0000 7ff48923b740 10 client.15381 fetch_fsmap learned FSMap version 21 2024-09-21T01:41:50.790 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.763+0000 7ff48923b740 1 -- 172.21.15.83:0/1309335371 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55ea41c73960 con 0x55ea418aef60 2024-09-21T01:41:50.790 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.763+0000 7ff45bfff640 1 -- 172.21.15.83:0/1309335371 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff478040070 con 0x55ea418aef60 2024-09-21T01:41:50.790 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.763+0000 7ff45bfff640 1 -- 172.21.15.83:0/1309335371 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7ff46c015050 con 0x55ea418aef60 2024-09-21T01:41:50.790 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.763+0000 7ff48923b740 10 client.15381 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T01:41:50.790 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.763+0000 7ff48923b740 10 client.15381 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-21T01:41:50.791 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.763+0000 7ff48923b740 20 client.15381 populate_metadata read hostname 'smithi083' 2024-09-21T01:41:50.791 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.763+0000 7ff48923b740 1 --2- 172.21.15.83:0/1309335371 >> [v2:172.21.15.119:6838/3106757092,v1:172.21.15.119:6839/3106757092] conn(0x55ea4186d8e0 0x55ea41c77450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:50.791 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.763+0000 7ff48923b740 4 client.15381 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:41:50.791 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.763+0000 7ff48923b740 1 -- 172.21.15.83:0/1309335371 --> [v2:172.21.15.119:6838/3106757092,v1:172.21.15.119:6839/3106757092] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ea41bceb60 con 0x55ea4186d8e0 2024-09-21T01:41:50.791 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.763+0000 7ff480a63640 1 --2- 172.21.15.83:0/1309335371 >> [v2:172.21.15.119:6838/3106757092,v1:172.21.15.119:6839/3106757092] conn(0x55ea4186d8e0 0x55ea41c77450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:50.791 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.764+0000 7ff45bfff640 10 client.15381 ms_handle_connect on v2:172.21.15.119:6838/3106757092 2024-09-21T01:41:50.791 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.764+0000 7ff480a63640 1 --2- 172.21.15.83:0/1309335371 >> [v2:172.21.15.119:6838/3106757092,v1:172.21.15.119:6839/3106757092] conn(0x55ea4186d8e0 0x55ea41c77450 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=990d6c679c5cf69a server_cookie=79852668c3269a3f in_seq=0 out_seq=0 2024-09-21T01:41:50.791 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.765+0000 7ff45bfff640 1 -- 172.21.15.83:0/1309335371 <== mds.0 v2:172.21.15.119:6838/3106757092 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ea41bceb60 con 0x55ea4186d8e0 2024-09-21T01:41:50.791 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.765+0000 7ff45bfff640 10 client.15381 handle_command_reply: tid=0 2024-09-21T01:41:50.792 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.765+0000 7ff48923b740 1 client.15381 shutdown 2024-09-21T01:41:50.792 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.765+0000 7ff48923b740 1 -- 172.21.15.83:0/1309335371 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ea418aef60 msgr2=0x55ea41c70d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:50.792 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.765+0000 7ff48923b740 1 --2- 172.21.15.83:0/1309335371 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ea418aef60 0x55ea41c70d10 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7ff46c00cfd0 tx=0x7ff46c006bf0 comp rx=0 tx=0).stop 2024-09-21T01:41:50.793 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.765+0000 7ff48923b740 1 -- 172.21.15.83:0/1309335371 shutdown_connections 2024-09-21T01:41:50.793 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.765+0000 7ff48923b740 1 --2- 172.21.15.83:0/1309335371 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ea418aef60 0x55ea41c70d10 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:50.793 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.765+0000 7ff48923b740 1 --2- 172.21.15.83:0/1309335371 >> [v2:172.21.15.119:6838/3106757092,v1:172.21.15.119:6839/3106757092] conn(0x55ea4186d8e0 0x55ea41c77450 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:50.793 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.765+0000 7ff45bfff640 0 client.15381 ms_handle_reset on v2:172.21.15.119:6838/3106757092 2024-09-21T01:41:50.793 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.765+0000 7ff48923b740 1 --2- 172.21.15.83:0/1309335371 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ea4188e280 0x55ea41c65370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:50.793 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.765+0000 7ff48923b740 1 --2- 172.21.15.83:0/1309335371 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ea418860a0 0x55ea41c64e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:50.793 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.765+0000 7ff48923b740 1 -- 172.21.15.83:0/1309335371 >> 172.21.15.83:0/1309335371 conn(0x55ea418a3350 msgr2=0x55ea41c513b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:41:50.793 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.765+0000 7ff48923b740 1 -- 172.21.15.83:0/1309335371 shutdown_connections 2024-09-21T01:41:50.793 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.765+0000 7ff48923b740 1 -- 172.21.15.83:0/1309335371 wait complete. 2024-09-21T01:41:50.793 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.765+0000 7ff48923b740 20 client.15381 trim_cache size 0 max 16384 2024-09-21T01:41:50.797 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.783+0000 7ff48923b740 1 Processor -- start 2024-09-21T01:41:50.798 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.783+0000 7ff48923b740 1 -- start start 2024-09-21T01:41:50.798 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.784+0000 7ff48923b740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ea4186d8e0 0x55ea41c64120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:50.798 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.784+0000 7ff48923b740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ea418860a0 0x55ea41c64e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:50.798 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.784+0000 7ff48923b740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ea4188e280 0x55ea41c65350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:50.798 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.784+0000 7ff48923b740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55ea41c75790 con 0x55ea4188e280 2024-09-21T01:41:50.798 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.784+0000 7ff48923b740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55ea41c75e60 con 0x55ea418860a0 2024-09-21T01:41:50.798 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.784+0000 7ff48923b740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55ea41c76530 con 0x55ea4186d8e0 2024-09-21T01:41:50.798 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.784+0000 7ff473fff640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ea4186d8e0 0x55ea41c64120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:50.798 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.784+0000 7ff473fff640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ea4186d8e0 0x55ea41c64120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.83:60150/0 (socket says 172.21.15.83:60150) 2024-09-21T01:41:50.798 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.784+0000 7ff473fff640 1 -- 172.21.15.83:0/3984453951 learned_addr learned my addr 172.21.15.83:0/3984453951 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:41:50.798 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.784+0000 7ff473fff640 1 --2- 172.21.15.83:0/3984453951 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ea4188e280 0x55ea41c65350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:50.798 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.784+0000 7ff480a63640 1 --2- 172.21.15.83:0/3984453951 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ea418860a0 0x55ea41c64e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:50.798 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.784+0000 7ff473fff640 1 -- 172.21.15.83:0/3984453951 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ea418860a0 msgr2=0x55ea41c64e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:41:50.799 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.784+0000 7ff473fff640 1 --2- 172.21.15.83:0/3984453951 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ea418860a0 0x55ea41c64e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:50.799 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.784+0000 7ff473fff640 1 -- 172.21.15.83:0/3984453951 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ea4188e280 msgr2=0x55ea41c65350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:41:50.799 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.784+0000 7ff473fff640 1 --2- 172.21.15.83:0/3984453951 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ea4188e280 0x55ea41c65350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:50.799 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.784+0000 7ff473fff640 1 -- 172.21.15.83:0/3984453951 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea41c57d10 con 0x55ea4186d8e0 2024-09-21T01:41:50.799 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.785+0000 7ff473fff640 1 --2- 172.21.15.83:0/3984453951 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ea4186d8e0 0x55ea41c64120 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff46c0163f0 tx=0x7ff46c006bf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=10a86563fc8fcda5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:41:50.799 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.785+0000 7ff4627fc640 1 -- 172.21.15.83:0/3984453951 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff46c00c530 con 0x55ea4186d8e0 2024-09-21T01:41:50.799 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.785+0000 7ff4627fc640 1 -- 172.21.15.83:0/3984453951 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff46c01d070 con 0x55ea4186d8e0 2024-09-21T01:41:50.799 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.785+0000 7ff4627fc640 1 -- 172.21.15.83:0/3984453951 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff46c005c00 con 0x55ea4186d8e0 2024-09-21T01:41:50.799 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.786+0000 7ff48923b740 1 -- 172.21.15.83:0/3984453951 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ea4186d8e0 msgr2=0x55ea41c64120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:50.799 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.786+0000 7ff48923b740 1 --2- 172.21.15.83:0/3984453951 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ea4186d8e0 0x55ea41c64120 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff46c0163f0 tx=0x7ff46c006bf0 comp rx=0 tx=0).stop 2024-09-21T01:41:50.799 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.786+0000 7ff48923b740 1 -- 172.21.15.83:0/3984453951 shutdown_connections 2024-09-21T01:41:50.799 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.786+0000 7ff48923b740 1 --2- 172.21.15.83:0/3984453951 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ea4188e280 0x55ea41c65350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:50.799 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.786+0000 7ff48923b740 1 --2- 172.21.15.83:0/3984453951 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ea418860a0 0x55ea41c64e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:50.799 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.786+0000 7ff48923b740 1 --2- 172.21.15.83:0/3984453951 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ea4186d8e0 0x55ea41c64120 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:50.800 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.786+0000 7ff48923b740 1 -- 172.21.15.83:0/3984453951 >> 172.21.15.83:0/3984453951 conn(0x55ea418a3350 msgr2=0x55ea41c70e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:41:50.800 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.786+0000 7ff48923b740 1 -- 172.21.15.83:0/3984453951 shutdown_connections 2024-09-21T01:41:50.800 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.786+0000 7ff48923b740 1 -- 172.21.15.83:0/3984453951 wait complete. 2024-09-21T01:41:50.800 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.786+0000 7ff48923b740 1 -- start start 2024-09-21T01:41:50.800 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.787+0000 7ff48923b740 1 Processor -- start 2024-09-21T01:41:50.800 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.787+0000 7ff48923b740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ea4186d8e0 0x55ea41c79e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:50.800 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.787+0000 7ff48923b740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ea418860a0 0x55ea41c7a370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:50.800 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.787+0000 7ff48923b740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ea4188e280 0x55ea41c7ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:50.800 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.787+0000 7ff48923b740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55ea41c772d0 con 0x55ea4188e280 2024-09-21T01:41:50.800 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.787+0000 7ff48923b740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55ea41c76c00 con 0x55ea4186d8e0 2024-09-21T01:41:50.800 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.787+0000 7ff48923b740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55ea41c779a0 con 0x55ea418860a0 2024-09-21T01:41:50.800 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.787+0000 7ff48923b740 10 client.0 _ll_register_callbacks cb 0x7ff46c00c450 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:41:50.800 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.787+0000 7ff473fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ea4188e280 0x55ea41c7ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:50.800 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.787+0000 7ff473fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ea4188e280 0x55ea41c7ec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:39672/0 (socket says 172.21.15.83:39672) 2024-09-21T01:41:50.801 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.787+0000 7ff473fff640 1 -- 172.21.15.83:0/4043703565 learned_addr learned my addr 172.21.15.83:0/4043703565 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:41:50.801 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.787+0000 7ff473fff640 1 --2- 172.21.15.83:0/4043703565 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ea4186d8e0 0x55ea41c79e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:50.801 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.787+0000 7ff480a63640 1 --2- 172.21.15.83:0/4043703565 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ea418860a0 0x55ea41c7a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:50.801 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.788+0000 7ff473fff640 1 -- 172.21.15.83:0/4043703565 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ea418860a0 msgr2=0x55ea41c7a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:41:50.801 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.788+0000 7ff473fff640 1 --2- 172.21.15.83:0/4043703565 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ea418860a0 0x55ea41c7a370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:50.801 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.788+0000 7ff473fff640 1 -- 172.21.15.83:0/4043703565 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ea4186d8e0 msgr2=0x55ea41c79e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:41:50.801 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.788+0000 7ff473fff640 1 --2- 172.21.15.83:0/4043703565 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ea4186d8e0 0x55ea41c79e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:50.801 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.788+0000 7ff473fff640 1 -- 172.21.15.83:0/4043703565 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ea41c7f1c0 con 0x55ea4188e280 2024-09-21T01:41:50.801 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.788+0000 7ff480a63640 1 --2- 172.21.15.83:0/4043703565 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ea418860a0 0x55ea41c7a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:41:50.801 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.788+0000 7ff473fff640 1 --2- 172.21.15.83:0/4043703565 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ea4188e280 0x55ea41c7ec80 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7ff46c0167d0 tx=0x7ff46c030040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99b64744b52b5229 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:41:50.801 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.788+0000 7ff45bfff640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-09-21T01:41:50.801 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.788+0000 7ff45bfff640 1 -- 172.21.15.83:0/4043703565 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff46c033040 con 0x55ea4188e280 2024-09-21T01:41:50.801 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.788+0000 7ff45bfff640 1 -- 172.21.15.83:0/4043703565 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9315+0+0 (secure 0 0 0) 0x7ff46c006110 con 0x55ea4188e280 2024-09-21T01:41:50.801 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.788+0000 7ff48923b740 1 -- 172.21.15.83:0/4043703565 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff46c01d070 con 0x55ea4188e280 2024-09-21T01:41:50.802 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.788+0000 7ff45bfff640 1 -- 172.21.15.83:0/4043703565 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7ff46c006310 con 0x55ea4188e280 2024-09-21T01:41:50.802 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.788+0000 7ff48923b740 10 client.15387 fetch_fsmap learned FSMap version 21 2024-09-21T01:41:50.802 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.788+0000 7ff48923b740 1 -- 172.21.15.83:0/4043703565 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55ea41c80440 con 0x55ea4188e280 2024-09-21T01:41:50.802 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.789+0000 7ff45bfff640 1 -- 172.21.15.83:0/4043703565 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff46c01d070 con 0x55ea4188e280 2024-09-21T01:41:50.802 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.789+0000 7ff45bfff640 1 -- 172.21.15.83:0/4043703565 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7ff46c039070 con 0x55ea4188e280 2024-09-21T01:41:50.802 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.789+0000 7ff48923b740 10 client.15387 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T01:41:50.802 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.789+0000 7ff48923b740 10 client.15387 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-21T01:41:50.802 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.789+0000 7ff48923b740 20 client.15387 populate_metadata read hostname 'smithi083' 2024-09-21T01:41:50.802 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.789+0000 7ff48923b740 1 --2- 172.21.15.83:0/4043703565 >> [v2:172.21.15.119:6838/3106757092,v1:172.21.15.119:6839/3106757092] conn(0x55ea418aef60 0x55ea41ce5a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:50.802 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.789+0000 7ff48923b740 4 client.15387 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T01:41:50.802 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.789+0000 7ff48923b740 1 -- 172.21.15.83:0/4043703565 --> [v2:172.21.15.119:6838/3106757092,v1:172.21.15.119:6839/3106757092] -- command(tid 0: {"prefix": "status"}) -- 0x55ea41bca610 con 0x55ea418aef60 2024-09-21T01:41:50.802 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.789+0000 7ff480a63640 1 --2- 172.21.15.83:0/4043703565 >> [v2:172.21.15.119:6838/3106757092,v1:172.21.15.119:6839/3106757092] conn(0x55ea418aef60 0x55ea41ce5a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:50.802 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.790+0000 7ff45bfff640 10 client.15387 ms_handle_connect on v2:172.21.15.119:6838/3106757092 2024-09-21T01:41:50.802 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.790+0000 7ff480a63640 1 --2- 172.21.15.83:0/4043703565 >> [v2:172.21.15.119:6838/3106757092,v1:172.21.15.119:6839/3106757092] conn(0x55ea418aef60 0x55ea41ce5a60 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=746d6977249a2111 server_cookie=cd65caaa762537f6 in_seq=0 out_seq=0 2024-09-21T01:41:50.803 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.790+0000 7ff45bfff640 1 -- 172.21.15.83:0/4043703565 <== mds.0 v2:172.21.15.119:6838/3106757092 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55ea41bca610 con 0x55ea418aef60 2024-09-21T01:41:50.803 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.790+0000 7ff45bfff640 10 client.15387 handle_command_reply: tid=0 2024-09-21T01:41:50.803 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.790+0000 7ff48923b740 1 client.15387 shutdown 2024-09-21T01:41:50.803 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.790+0000 7ff48923b740 1 -- 172.21.15.83:0/4043703565 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ea4188e280 msgr2=0x55ea41c7ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:50.803 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.790+0000 7ff48923b740 1 --2- 172.21.15.83:0/4043703565 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ea4188e280 0x55ea41c7ec80 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7ff46c0167d0 tx=0x7ff46c030040 comp rx=0 tx=0).stop 2024-09-21T01:41:50.803 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.790+0000 7ff48923b740 1 -- 172.21.15.83:0/4043703565 shutdown_connections 2024-09-21T01:41:50.803 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.790+0000 7ff48923b740 1 --2- 172.21.15.83:0/4043703565 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ea4188e280 0x55ea41c7ec80 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:50.803 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.790+0000 7ff48923b740 1 --2- 172.21.15.83:0/4043703565 >> [v2:172.21.15.119:6838/3106757092,v1:172.21.15.119:6839/3106757092] conn(0x55ea418aef60 0x55ea41ce5a60 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:50.803 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.790+0000 7ff48923b740 1 --2- 172.21.15.83:0/4043703565 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ea418860a0 0x55ea41c7a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:50.803 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.790+0000 7ff48923b740 1 --2- 172.21.15.83:0/4043703565 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ea4186d8e0 0x55ea41c79e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:50.803 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.790+0000 7ff48923b740 1 -- 172.21.15.83:0/4043703565 >> 172.21.15.83:0/4043703565 conn(0x55ea418a3350 msgr2=0x55ea41c70e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:41:50.803 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.790+0000 7ff45bfff640 0 client.15387 ms_handle_reset on v2:172.21.15.119:6838/3106757092 2024-09-21T01:41:50.803 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.790+0000 7ff48923b740 1 -- 172.21.15.83:0/4043703565 shutdown_connections 2024-09-21T01:41:50.804 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.791+0000 7ff48923b740 1 -- 172.21.15.83:0/4043703565 wait complete. 2024-09-21T01:41:50.804 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.791+0000 7ff48923b740 20 client.15387 trim_cache size 0 max 16384 2024-09-21T01:41:50.804 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-09-21T01:41:50.804 INFO:teuthology.orchestra.run.smithi083.stdout: "cluster_fsid": "f7697ecc-77b8-11ef-baf5-efdc52797490", 2024-09-21T01:41:50.804 INFO:teuthology.orchestra.run.smithi083.stdout: "whoami": 0, 2024-09-21T01:41:50.804 INFO:teuthology.orchestra.run.smithi083.stdout: "id": 24653, 2024-09-21T01:41:50.804 INFO:teuthology.orchestra.run.smithi083.stdout: "want_state": "up:active", 2024-09-21T01:41:50.804 INFO:teuthology.orchestra.run.smithi083.stdout: "state": "up:active", 2024-09-21T01:41:50.804 INFO:teuthology.orchestra.run.smithi083.stdout: "fs_name": "cephfs", 2024-09-21T01:41:50.804 INFO:teuthology.orchestra.run.smithi083.stdout: "rank_uptime": 125.50997624199999, 2024-09-21T01:41:50.804 INFO:teuthology.orchestra.run.smithi083.stdout: "mdsmap_epoch": 21, 2024-09-21T01:41:50.804 INFO:teuthology.orchestra.run.smithi083.stdout: "osdmap_epoch": 84, 2024-09-21T01:41:50.805 INFO:teuthology.orchestra.run.smithi083.stdout: "osdmap_epoch_barrier": 82, 2024-09-21T01:41:50.805 INFO:teuthology.orchestra.run.smithi083.stdout: "uptime": 135.87904331999999 2024-09-21T01:41:50.805 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-09-21T01:41:50.805 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.791+0000 7ff482cc7640 1 -- 172.21.15.83:0/1759817656 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7ff4640b65e0 msgr2=0x7ff4640b8af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:50.805 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.791+0000 7ff482cc7640 1 --2- 172.21.15.83:0/1759817656 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7ff4640b65e0 0x7ff4640b8af0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7ff4740aaa70 tx=0x7ff47407aae0 comp rx=0 tx=0).stop 2024-09-21T01:41:50.805 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.791+0000 7ff482cc7640 1 -- 172.21.15.83:0/1759817656 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff47c109e40 msgr2=0x7ff47c19fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:50.806 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.791+0000 7ff482cc7640 1 --2- 172.21.15.83:0/1759817656 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff47c109e40 0x7ff47c19fcc0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7ff47400cad0 tx=0x7ff47400cf90 comp rx=0 tx=0).stop 2024-09-21T01:41:50.806 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.791+0000 7ff482cc7640 1 -- 172.21.15.83:0/1759817656 shutdown_connections 2024-09-21T01:41:50.806 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.791+0000 7ff482cc7640 1 --2- 172.21.15.83:0/1759817656 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7ff4640b65e0 0x7ff4640b8af0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:50.806 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.791+0000 7ff482cc7640 1 --2- 172.21.15.83:0/1759817656 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff47c109e40 0x7ff47c19fcc0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:50.806 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.791+0000 7ff482cc7640 1 --2- 172.21.15.83:0/1759817656 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff47c1094f0 0x7ff47c19aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:50.806 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.791+0000 7ff482cc7640 1 --2- 172.21.15.83:0/1759817656 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff47c103bb0 0x7ff47c19a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:50.806 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.791+0000 7ff482cc7640 1 -- 172.21.15.83:0/1759817656 >> 172.21.15.83:0/1759817656 conn(0x7ff47c0ff600 msgr2=0x7ff47c101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:41:50.806 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.792+0000 7ff482cc7640 1 -- 172.21.15.83:0/1759817656 shutdown_connections 2024-09-21T01:41:50.806 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:50.792+0000 7ff482cc7640 1 -- 172.21.15.83:0/1759817656 wait complete. 2024-09-21T01:41:51.053 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:41:50 smithi083 ceph-mon[31370]: pgmap v333: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-21T01:41:51.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:41:50 smithi142 ceph-mon[34050]: pgmap v333: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-21T01:41:51.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:41:50 smithi119 ceph-mon[33693]: pgmap v333: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-21T01:41:51.472 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-09-21T01:41:51.481 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-09-21T01:41:51.482 INFO:tasks.ceph_fuse:config is {'client.0': {}} 2024-09-21T01:41:51.482 INFO:tasks.ceph_fuse:client.0 config is {'mount_subvol_num': 0} 2024-09-21T01:41:51.482 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-21T01:41:51.482 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-21T01:41:51.482 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T01:41:51.482 DEBUG:teuthology.orchestra.run.smithi083:> ip netns list 2024-09-21T01:41:51.499 INFO:teuthology.orchestra.run.smithi083.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-09-21T01:41:51.499 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T01:41:51.499 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-21T01:41:51.567 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T01:41:51.567 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip link delete ceph-brx 2024-09-21T01:41:51.675 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-09-21T01:41:51.675 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-21T01:41:51.675 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph fs ls 2024-09-21T01:41:51.924 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:41:52.440 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:52.439+0000 7fb83195e640 1 -- 172.21.15.83:0/110643521 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb82c108d70 msgr2=0x7fb82c10f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:52.441 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:52.439+0000 7fb83195e640 1 --2- 172.21.15.83:0/110643521 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb82c108d70 0x7fb82c10f5a0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fb81c009ca0 tx=0x7fb81c02a8c0 comp rx=0 tx=0).stop 2024-09-21T01:41:52.441 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:52.439+0000 7fb83195e640 1 -- 172.21.15.83:0/110643521 shutdown_connections 2024-09-21T01:41:52.441 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:52.439+0000 7fb83195e640 1 --2- 172.21.15.83:0/110643521 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb82c108d70 0x7fb82c10f5a0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:52.441 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:52.439+0000 7fb83195e640 1 --2- 172.21.15.83:0/110643521 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb82c108420 0x7fb82c108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:52.441 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:52.439+0000 7fb83195e640 1 --2- 172.21.15.83:0/110643521 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb82c102ae0 0x7fb82c102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:52.441 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:52.439+0000 7fb83195e640 1 -- 172.21.15.83:0/110643521 >> 172.21.15.83:0/110643521 conn(0x7fb82c079770 msgr2=0x7fb82c079b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:41:52.441 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:52.439+0000 7fb83195e640 1 -- 172.21.15.83:0/110643521 shutdown_connections 2024-09-21T01:41:52.441 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:52.439+0000 7fb83195e640 1 -- 172.21.15.83:0/110643521 wait complete. 2024-09-21T01:41:52.441 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:52.440+0000 7fb83195e640 1 Processor -- start 2024-09-21T01:41:52.441 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:52.440+0000 7fb83195e640 1 -- start start 2024-09-21T01:41:52.443 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:52.441+0000 7fb83195e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb82c102ae0 0x7fb82c19a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:52.443 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:52.441+0000 7fb83195e640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb82c108420 0x7fb82c19a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:52.443 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:52.441+0000 7fb83195e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb82c108d70 0x7fb82c19fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:52.443 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:52.441+0000 7fb83195e640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fb82c112930 con 0x7fb82c108420 2024-09-21T01:41:52.443 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:52.441+0000 7fb83195e640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fb82c1127b0 con 0x7fb82c108d70 2024-09-21T01:41:52.443 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:52.441+0000 7fb83195e640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fb82c112ab0 con 0x7fb82c102ae0 2024-09-21T01:41:52.443 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:52.441+0000 7fb82a7fc640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb82c108420 0x7fb82c19a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:52.443 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:52.441+0000 7fb82a7fc640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb82c108420 0x7fb82c19a990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:39680/0 (socket says 172.21.15.83:39680) 2024-09-21T01:41:52.443 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:52.441+0000 7fb82a7fc640 1 -- 172.21.15.83:0/3389572318 learned_addr learned my addr 172.21.15.83:0/3389572318 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:41:52.444 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:52.441+0000 7fb82affd640 1 --2- 172.21.15.83:0/3389572318 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb82c102ae0 0x7fb82c19a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:52.444 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:52.441+0000 7fb82b7fe640 1 --2- 172.21.15.83:0/3389572318 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb82c108d70 0x7fb82c19fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:52.444 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:52.441+0000 7fb82a7fc640 1 -- 172.21.15.83:0/3389572318 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb82c102ae0 msgr2=0x7fb82c19a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:52.444 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:52.441+0000 7fb82a7fc640 1 --2- 172.21.15.83:0/3389572318 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb82c102ae0 0x7fb82c19a3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:52.444 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:52.441+0000 7fb82a7fc640 1 -- 172.21.15.83:0/3389572318 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb82c108d70 msgr2=0x7fb82c19fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:52.444 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:52.441+0000 7fb82a7fc640 1 --2- 172.21.15.83:0/3389572318 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb82c108d70 0x7fb82c19fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:52.444 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:52.441+0000 7fb82a7fc640 1 -- 172.21.15.83:0/3389572318 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb82c1a02a0 con 0x7fb82c108420 2024-09-21T01:41:52.444 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:52.441+0000 7fb82affd640 1 --2- 172.21.15.83:0/3389572318 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb82c102ae0 0x7fb82c19a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:41:52.444 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:52.442+0000 7fb82a7fc640 1 --2- 172.21.15.83:0/3389572318 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb82c108420 0x7fb82c19a990 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fb81400c8c0 tx=0x7fb81400cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:41:52.444 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:52.442+0000 7fb83095c640 1 -- 172.21.15.83:0/3389572318 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb814007bb0 con 0x7fb82c108420 2024-09-21T01:41:52.444 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:52.442+0000 7fb83095c640 1 -- 172.21.15.83:0/3389572318 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb814007d50 con 0x7fb82c108420 2024-09-21T01:41:52.444 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:52.442+0000 7fb83095c640 1 -- 172.21.15.83:0/3389572318 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8140186a0 con 0x7fb82c108420 2024-09-21T01:41:52.444 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:52.442+0000 7fb83195e640 1 -- 172.21.15.83:0/3389572318 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb82c1a0590 con 0x7fb82c108420 2024-09-21T01:41:52.444 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:52.442+0000 7fb83195e640 1 -- 172.21.15.83:0/3389572318 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb82c1a6db0 con 0x7fb82c108420 2024-09-21T01:41:52.444 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:52.443+0000 7fb83195e640 1 -- 172.21.15.83:0/3389572318 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb82c103d60 con 0x7fb82c108420 2024-09-21T01:41:52.445 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:52.444+0000 7fb83095c640 1 -- 172.21.15.83:0/3389572318 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 22) ==== 154529+0+0 (secure 0 0 0) 0x7fb81400fa00 con 0x7fb82c108420 2024-09-21T01:41:52.445 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:52.445+0000 7fb83095c640 1 --2- 172.21.15.83:0/3389572318 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fb8180b6610 0x7fb8180b8b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:52.446 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:52.445+0000 7fb82affd640 1 --2- 172.21.15.83:0/3389572318 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fb8180b6610 0x7fb8180b8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:52.446 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:52.445+0000 7fb83095c640 1 -- 172.21.15.83:0/3389572318 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9315+0+0 (secure 0 0 0) 0x7fb8140e7af0 con 0x7fb82c108420 2024-09-21T01:41:52.446 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:52.446+0000 7fb82affd640 1 --2- 172.21.15.83:0/3389572318 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fb8180b6610 0x7fb8180b8b20 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fb824005fd0 tx=0x7fb824005ea0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:41:52.448 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:52.448+0000 7fb83095c640 1 -- 172.21.15.83:0/3389572318 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb814014030 con 0x7fb82c108420 2024-09-21T01:41:52.667 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:52.667+0000 7fb83195e640 1 -- 172.21.15.83:0/3389572318 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fb82c19b520 con 0x7fb82c108420 2024-09-21T01:41:52.667 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:52.667+0000 7fb83095c640 1 -- 172.21.15.83:0/3389572318 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v21) ==== 53+0+88 (secure 0 0 0) 0x7fb82c19b520 con 0x7fb82c108420 2024-09-21T01:41:52.668 INFO:teuthology.orchestra.run.smithi083.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-21T01:41:52.670 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:52.670+0000 7fb83195e640 1 -- 172.21.15.83:0/3389572318 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fb8180b6610 msgr2=0x7fb8180b8b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:52.670 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:52.670+0000 7fb83195e640 1 --2- 172.21.15.83:0/3389572318 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fb8180b6610 0x7fb8180b8b20 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fb824005fd0 tx=0x7fb824005ea0 comp rx=0 tx=0).stop 2024-09-21T01:41:52.670 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:52.670+0000 7fb83195e640 1 -- 172.21.15.83:0/3389572318 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb82c108420 msgr2=0x7fb82c19a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:52.671 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:52.670+0000 7fb83195e640 1 --2- 172.21.15.83:0/3389572318 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb82c108420 0x7fb82c19a990 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fb81400c8c0 tx=0x7fb81400cd80 comp rx=0 tx=0).stop 2024-09-21T01:41:52.671 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:52.670+0000 7fb83195e640 1 -- 172.21.15.83:0/3389572318 shutdown_connections 2024-09-21T01:41:52.671 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:52.670+0000 7fb83195e640 1 --2- 172.21.15.83:0/3389572318 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fb8180b6610 0x7fb8180b8b20 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:52.671 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:52.670+0000 7fb83195e640 1 --2- 172.21.15.83:0/3389572318 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb82c108d70 0x7fb82c19fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:52.671 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:52.670+0000 7fb83195e640 1 --2- 172.21.15.83:0/3389572318 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb82c108420 0x7fb82c19a990 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:52.671 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:52.670+0000 7fb83195e640 1 --2- 172.21.15.83:0/3389572318 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb82c102ae0 0x7fb82c19a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:52.671 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:52.670+0000 7fb83195e640 1 -- 172.21.15.83:0/3389572318 >> 172.21.15.83:0/3389572318 conn(0x7fb82c079770 msgr2=0x7fb82c101a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:41:52.671 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:52.670+0000 7fb83195e640 1 -- 172.21.15.83:0/3389572318 shutdown_connections 2024-09-21T01:41:52.671 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:52.670+0000 7fb83195e640 1 -- 172.21.15.83:0/3389572318 wait complete. 2024-09-21T01:41:52.978 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:41:52 smithi083 ceph-mon[31370]: from='client.? 172.21.15.83:0/3389572318' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-09-21T01:41:53.017 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:41:52 smithi142 ceph-mon[34050]: from='client.? 172.21.15.83:0/3389572318' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-09-21T01:41:53.019 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:41:52 smithi119 ceph-mon[33693]: from='client.? 172.21.15.83:0/3389572318' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-09-21T01:41:53.318 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-21T01:41:53.318 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-21T01:41:53.319 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi083.front.sepia.ceph.com 2024-09-21T01:41:53.319 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-21T01:41:53.319 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-21T01:41:53.319 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-21T01:41:53.319 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-21T01:41:53.319 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-21T01:41:53.319 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-21T01:41:53.319 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T01:41:53.319 DEBUG:teuthology.orchestra.run.smithi083:> ip addr 2024-09-21T01:41:53.336 INFO:teuthology.orchestra.run.smithi083.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T01:41:53.336 INFO:teuthology.orchestra.run.smithi083.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T01:41:53.337 INFO:teuthology.orchestra.run.smithi083.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T01:41:53.337 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2024-09-21T01:41:53.337 INFO:teuthology.orchestra.run.smithi083.stdout: inet6 ::1/128 scope host 2024-09-21T01:41:53.337 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2024-09-21T01:41:53.337 INFO:teuthology.orchestra.run.smithi083.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T01:41:53.337 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether 0c:c4:7a:d8:da:1e brd ff:ff:ff:ff:ff:ff 2024-09-21T01:41:53.337 INFO:teuthology.orchestra.run.smithi083.stdout: altname enp7s0f0 2024-09-21T01:41:53.337 INFO:teuthology.orchestra.run.smithi083.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T01:41:53.337 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether 0c:c4:7a:d8:da:1f brd ff:ff:ff:ff:ff:ff 2024-09-21T01:41:53.337 INFO:teuthology.orchestra.run.smithi083.stdout: altname enp7s0f1 2024-09-21T01:41:53.337 INFO:teuthology.orchestra.run.smithi083.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T01:41:53.337 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether 0c:c4:7a:8f:ce:90 brd ff:ff:ff:ff:ff:ff 2024-09-21T01:41:53.337 INFO:teuthology.orchestra.run.smithi083.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-21T01:41:53.337 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether 0c:c4:7a:8f:ce:91 brd ff:ff:ff:ff:ff:ff 2024-09-21T01:41:53.338 INFO:teuthology.orchestra.run.smithi083.stdout: inet 172.21.15.83/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-21T01:41:53.338 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft 42112sec preferred_lft 42112sec 2024-09-21T01:41:53.338 INFO:teuthology.orchestra.run.smithi083.stdout: inet6 fe80::ec4:7aff:fe8f:ce91/64 scope link noprefixroute 2024-09-21T01:41:53.338 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2024-09-21T01:41:53.338 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-21T01:41:53.338 DEBUG:teuthology.orchestra.run.smithi083:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T01:41:53.338 DEBUG:teuthology.orchestra.run.smithi083:> set -e 2024-09-21T01:41:53.338 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip link add name ceph-brx type bridge 2024-09-21T01:41:53.338 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip addr flush dev ceph-brx 2024-09-21T01:41:53.338 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip link set ceph-brx up 2024-09-21T01:41:53.338 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-21T01:41:53.338 DEBUG:teuthology.orchestra.run.smithi083:> ') 2024-09-21T01:41:53.426 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:53 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T01:41:53.472 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T01:41:53.478 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T01:41:53.478 DEBUG:teuthology.orchestra.run.smithi083:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-21T01:41:53.502 INFO:teuthology.orchestra.run.smithi083.stdout:1 2024-09-21T01:41:53.504 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T01:41:53.504 DEBUG:teuthology.orchestra.run.smithi083:> route 2024-09-21T01:41:53.560 INFO:teuthology.orchestra.run.smithi083.stdout:Kernel IP routing table 2024-09-21T01:41:53.561 INFO:teuthology.orchestra.run.smithi083.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-21T01:41:53.561 INFO:teuthology.orchestra.run.smithi083.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-21T01:41:53.561 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-21T01:41:53.561 INFO:teuthology.orchestra.run.smithi083.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-21T01:41:53.561 DEBUG:teuthology.orchestra.run.smithi083:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T01:41:53.561 DEBUG:teuthology.orchestra.run.smithi083:> set -e 2024-09-21T01:41:53.561 DEBUG:teuthology.orchestra.run.smithi083:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-21T01:41:53.561 DEBUG:teuthology.orchestra.run.smithi083:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-21T01:41:53.561 DEBUG:teuthology.orchestra.run.smithi083:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-21T01:41:53.561 DEBUG:teuthology.orchestra.run.smithi083:> ') 2024-09-21T01:41:53.650 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:53 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T01:41:53.681 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T01:41:53.687 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T01:41:53.688 DEBUG:teuthology.orchestra.run.smithi083:> ip netns list 2024-09-21T01:41:53.703 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T01:41:53.703 DEBUG:teuthology.orchestra.run.smithi083:> ip netns list-id 2024-09-21T01:41:53.758 DEBUG:teuthology.orchestra.run.smithi083:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T01:41:53.759 DEBUG:teuthology.orchestra.run.smithi083:> set -e 2024-09-21T01:41:53.759 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T01:41:53.759 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-21T01:41:53.759 DEBUG:teuthology.orchestra.run.smithi083:> ') 2024-09-21T01:41:53.848 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:53 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T01:41:53.857 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:41:53 smithi083 ceph-mon[31370]: pgmap v334: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 1 op/s 2024-09-21T01:41:53.873 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T01:41:53.879 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-21T01:41:53.879 DEBUG:teuthology.orchestra.run.smithi083:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T01:41:53.879 DEBUG:teuthology.orchestra.run.smithi083:> set -e 2024-09-21T01:41:53.880 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-21T01:41:53.880 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-21T01:41:53.880 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-21T01:41:53.880 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-21T01:41:53.880 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-21T01:41:53.880 DEBUG:teuthology.orchestra.run.smithi083:> ') 2024-09-21T01:41:53.927 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:53 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T01:41:53.988 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T01:41:53.994 DEBUG:teuthology.orchestra.run.smithi083:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T01:41:53.994 DEBUG:teuthology.orchestra.run.smithi083:> set -e 2024-09-21T01:41:53.994 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip link set brx.0 up 2024-09-21T01:41:53.994 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip link set dev brx.0 master ceph-brx 2024-09-21T01:41:53.994 DEBUG:teuthology.orchestra.run.smithi083:> ') 2024-09-21T01:41:54.043 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:54 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T01:41:54.065 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T01:41:54.071 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {'mount_subvol_num': 0} 2024-09-21T01:41:54.071 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T01:41:54.071 DEBUG:teuthology.orchestra.run.smithi083:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-21T01:41:54.086 INFO:teuthology.orchestra.run.smithi083.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-21T01:41:54.086 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T01:41:54.086 DEBUG:teuthology.orchestra.run.smithi083:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-21T01:41:54.140 DEBUG:teuthology.orchestra.run.smithi083:> sudo modprobe fuse 2024-09-21T01:41:54.207 DEBUG:teuthology.orchestra.run.smithi083:> cat /proc/self/mounts | awk '{print $2}' 2024-09-21T01:41:54.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:41:53 smithi142 ceph-mon[34050]: pgmap v334: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 1 op/s 2024-09-21T01:41:54.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:41:53 smithi119 ceph-mon[33693]: pgmap v334: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 1 op/s 2024-09-21T01:41:54.263 INFO:teuthology.orchestra.run.smithi083.stdout:/proc 2024-09-21T01:41:54.263 INFO:teuthology.orchestra.run.smithi083.stdout:/sys 2024-09-21T01:41:54.263 INFO:teuthology.orchestra.run.smithi083.stdout:/dev 2024-09-21T01:41:54.263 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/kernel/security 2024-09-21T01:41:54.263 INFO:teuthology.orchestra.run.smithi083.stdout:/dev/shm 2024-09-21T01:41:54.263 INFO:teuthology.orchestra.run.smithi083.stdout:/dev/pts 2024-09-21T01:41:54.263 INFO:teuthology.orchestra.run.smithi083.stdout:/run 2024-09-21T01:41:54.263 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/fs/cgroup 2024-09-21T01:41:54.263 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/fs/pstore 2024-09-21T01:41:54.264 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/fs/bpf 2024-09-21T01:41:54.264 INFO:teuthology.orchestra.run.smithi083.stdout:/ 2024-09-21T01:41:54.264 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/fs/selinux 2024-09-21T01:41:54.264 INFO:teuthology.orchestra.run.smithi083.stdout:/proc/sys/fs/binfmt_misc 2024-09-21T01:41:54.264 INFO:teuthology.orchestra.run.smithi083.stdout:/dev/mqueue 2024-09-21T01:41:54.264 INFO:teuthology.orchestra.run.smithi083.stdout:/dev/hugepages 2024-09-21T01:41:54.264 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/kernel/debug 2024-09-21T01:41:54.264 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/kernel/tracing 2024-09-21T01:41:54.264 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/fs/fuse/connections 2024-09-21T01:41:54.264 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/kernel/config 2024-09-21T01:41:54.264 INFO:teuthology.orchestra.run.smithi083.stdout:/run/credentials/systemd-sysctl.service 2024-09-21T01:41:54.264 INFO:teuthology.orchestra.run.smithi083.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-21T01:41:54.264 INFO:teuthology.orchestra.run.smithi083.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-21T01:41:54.264 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/nfs/rpc_pipefs 2024-09-21T01:41:54.264 INFO:teuthology.orchestra.run.smithi083.stdout:/run/user/1000 2024-09-21T01:41:54.264 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/ceph 2024-09-21T01:41:54.265 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/containers/storage/overlay 2024-09-21T01:41:54.265 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/containers/storage/overlay/8610c479554a68b60b556116ff6e514cdcd9befb70b0d2f3fbdef64d877d75a6/merged 2024-09-21T01:41:54.265 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/containers/storage/overlay/8fc1cebdde878a0da97639d6f35e2c82c46a02343fe7fddd910eee6dc545dbb7/merged 2024-09-21T01:41:54.265 INFO:teuthology.orchestra.run.smithi083.stdout:/run/user/0 2024-09-21T01:41:54.265 INFO:teuthology.orchestra.run.smithi083.stdout:/proc/sys/fs/binfmt_misc 2024-09-21T01:41:54.265 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/containers/storage/overlay/ad76de55564a12f7320a1fa3d68c79ab34a03d565911f777dafcdf10802e7c98/merged 2024-09-21T01:41:54.265 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/containers/storage/overlay/61137218722e21b10cdd26ad45c2efaf869dbdc95d756215c1b84c5bd14f33ac/merged 2024-09-21T01:41:54.265 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/containers/storage/overlay/64d8ca591d18f7fb8b99ae527f80494dcdceee6b86d596b554628a7b397c178b/merged 2024-09-21T01:41:54.265 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/containers/storage/overlay/b096af93d38803bd9e9ef8a24487e7dd393dbe2c34e64ea016823a8e5680e8b2/merged 2024-09-21T01:41:54.265 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/containers/storage/overlay/375d681aa48b1b0f6680477c67fefecf44779154c19359c89efed73b1a57b3c5/merged 2024-09-21T01:41:54.265 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/containers/storage/overlay/a3615517be2fee75ab7f67a8ad7bea0c7d3c81bc139d09f61dd63e684ccfc8a8/merged 2024-09-21T01:41:54.265 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/containers/storage/overlay/800e803861b074a9b64b91d871dcc1e65568a0e413b178b45a454410ab3ac552/merged 2024-09-21T01:41:54.265 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/containers/storage/overlay/f76304c49431914cf0f8d96992df204d511c35206b8a030fff223f7c2dc5bf9f/merged 2024-09-21T01:41:54.265 INFO:teuthology.orchestra.run.smithi083.stdout:/run/netns 2024-09-21T01:41:54.265 INFO:teuthology.orchestra.run.smithi083.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T01:41:54.265 INFO:teuthology.orchestra.run.smithi083.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T01:41:54.266 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T01:41:54.266 DEBUG:teuthology.orchestra.run.smithi083:> ls /sys/fs/fuse/connections 2024-09-21T01:41:54.318 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-21T01:41:54.318 DEBUG:teuthology.orchestra.run.smithi083:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0 --client_mountpoint=/volumes/qa/sv_0/d2f98f10-db6a-4a15-b493-6d0ac8493e5a --client_fs=cephfs) 2024-09-21T01:41:54.360 DEBUG:teuthology.orchestra.run.smithi083:> sudo modprobe fuse 2024-09-21T01:41:54.384 DEBUG:teuthology.orchestra.run.smithi083:> cat /proc/self/mounts | awk '{print $2}' 2024-09-21T01:41:54.442 INFO:teuthology.orchestra.run.smithi083.stdout:/proc 2024-09-21T01:41:54.443 INFO:teuthology.orchestra.run.smithi083.stdout:/sys 2024-09-21T01:41:54.443 INFO:teuthology.orchestra.run.smithi083.stdout:/dev 2024-09-21T01:41:54.443 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/kernel/security 2024-09-21T01:41:54.443 INFO:teuthology.orchestra.run.smithi083.stdout:/dev/shm 2024-09-21T01:41:54.443 INFO:teuthology.orchestra.run.smithi083.stdout:/dev/pts 2024-09-21T01:41:54.443 INFO:teuthology.orchestra.run.smithi083.stdout:/run 2024-09-21T01:41:54.443 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/fs/cgroup 2024-09-21T01:41:54.443 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/fs/pstore 2024-09-21T01:41:54.443 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/fs/bpf 2024-09-21T01:41:54.443 INFO:teuthology.orchestra.run.smithi083.stdout:/ 2024-09-21T01:41:54.443 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/fs/selinux 2024-09-21T01:41:54.443 INFO:teuthology.orchestra.run.smithi083.stdout:/proc/sys/fs/binfmt_misc 2024-09-21T01:41:54.443 INFO:teuthology.orchestra.run.smithi083.stdout:/dev/mqueue 2024-09-21T01:41:54.443 INFO:teuthology.orchestra.run.smithi083.stdout:/dev/hugepages 2024-09-21T01:41:54.444 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/kernel/debug 2024-09-21T01:41:54.444 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/kernel/tracing 2024-09-21T01:41:54.444 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/fs/fuse/connections 2024-09-21T01:41:54.444 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/kernel/config 2024-09-21T01:41:54.444 INFO:teuthology.orchestra.run.smithi083.stdout:/run/credentials/systemd-sysctl.service 2024-09-21T01:41:54.444 INFO:teuthology.orchestra.run.smithi083.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-21T01:41:54.444 INFO:teuthology.orchestra.run.smithi083.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-21T01:41:54.444 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/nfs/rpc_pipefs 2024-09-21T01:41:54.444 INFO:teuthology.orchestra.run.smithi083.stdout:/run/user/1000 2024-09-21T01:41:54.444 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/ceph 2024-09-21T01:41:54.444 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/containers/storage/overlay 2024-09-21T01:41:54.444 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/containers/storage/overlay/8610c479554a68b60b556116ff6e514cdcd9befb70b0d2f3fbdef64d877d75a6/merged 2024-09-21T01:41:54.444 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/containers/storage/overlay/8fc1cebdde878a0da97639d6f35e2c82c46a02343fe7fddd910eee6dc545dbb7/merged 2024-09-21T01:41:54.444 INFO:teuthology.orchestra.run.smithi083.stdout:/run/user/0 2024-09-21T01:41:54.444 INFO:teuthology.orchestra.run.smithi083.stdout:/proc/sys/fs/binfmt_misc 2024-09-21T01:41:54.445 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/containers/storage/overlay/ad76de55564a12f7320a1fa3d68c79ab34a03d565911f777dafcdf10802e7c98/merged 2024-09-21T01:41:54.445 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/containers/storage/overlay/61137218722e21b10cdd26ad45c2efaf869dbdc95d756215c1b84c5bd14f33ac/merged 2024-09-21T01:41:54.445 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/containers/storage/overlay/64d8ca591d18f7fb8b99ae527f80494dcdceee6b86d596b554628a7b397c178b/merged 2024-09-21T01:41:54.445 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/containers/storage/overlay/b096af93d38803bd9e9ef8a24487e7dd393dbe2c34e64ea016823a8e5680e8b2/merged 2024-09-21T01:41:54.445 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/containers/storage/overlay/375d681aa48b1b0f6680477c67fefecf44779154c19359c89efed73b1a57b3c5/merged 2024-09-21T01:41:54.445 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/containers/storage/overlay/a3615517be2fee75ab7f67a8ad7bea0c7d3c81bc139d09f61dd63e684ccfc8a8/merged 2024-09-21T01:41:54.445 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/containers/storage/overlay/800e803861b074a9b64b91d871dcc1e65568a0e413b178b45a454410ab3ac552/merged 2024-09-21T01:41:54.445 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/containers/storage/overlay/f76304c49431914cf0f8d96992df204d511c35206b8a030fff223f7c2dc5bf9f/merged 2024-09-21T01:41:54.445 INFO:teuthology.orchestra.run.smithi083.stdout:/run/netns 2024-09-21T01:41:54.445 INFO:teuthology.orchestra.run.smithi083.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T01:41:54.445 INFO:teuthology.orchestra.run.smithi083.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T01:41:54.445 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T01:41:54.446 DEBUG:teuthology.orchestra.run.smithi083:> ls /sys/fs/fuse/connections 2024-09-21T01:41:54.453 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi083.stderr:2024-09-21T01:41:54.453+0000 7f8355b24480 -1 init, newargv = 0x7f8338004720 newargc=15 2024-09-21T01:41:54.454 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi083.stderr:ceph-fuse[86128]: starting ceph client 2024-09-21T01:41:54.463 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi083.stderr:ceph-fuse[86128]: starting fuse 2024-09-21T01:41:54.470 INFO:teuthology.orchestra.run.smithi083.stdout:120 2024-09-21T01:41:54.470 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [120] 2024-09-21T01:41:54.470 DEBUG:teuthology.orchestra.run.smithi083:> sudo stdin-killer -- python3 -c ' 2024-09-21T01:41:54.470 DEBUG:teuthology.orchestra.run.smithi083:> import glob 2024-09-21T01:41:54.470 DEBUG:teuthology.orchestra.run.smithi083:> import re 2024-09-21T01:41:54.470 DEBUG:teuthology.orchestra.run.smithi083:> import os 2024-09-21T01:41:54.470 DEBUG:teuthology.orchestra.run.smithi083:> import subprocess 2024-09-21T01:41:54.470 DEBUG:teuthology.orchestra.run.smithi083:> 2024-09-21T01:41:54.470 DEBUG:teuthology.orchestra.run.smithi083:> def _find_admin_socket(client_name): 2024-09-21T01:41:54.471 DEBUG:teuthology.orchestra.run.smithi083:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-21T01:41:54.471 DEBUG:teuthology.orchestra.run.smithi083:> files = glob.glob(asok_path) 2024-09-21T01:41:54.471 DEBUG:teuthology.orchestra.run.smithi083:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-21T01:41:54.471 DEBUG:teuthology.orchestra.run.smithi083:> 2024-09-21T01:41:54.471 DEBUG:teuthology.orchestra.run.smithi083:> # Given a non-glob path, it better be there 2024-09-21T01:41:54.471 DEBUG:teuthology.orchestra.run.smithi083:> if "*" not in asok_path: 2024-09-21T01:41:54.471 DEBUG:teuthology.orchestra.run.smithi083:> assert(len(files) == 1) 2024-09-21T01:41:54.471 DEBUG:teuthology.orchestra.run.smithi083:> return files[0] 2024-09-21T01:41:54.471 DEBUG:teuthology.orchestra.run.smithi083:> 2024-09-21T01:41:54.471 DEBUG:teuthology.orchestra.run.smithi083:> for f in files: 2024-09-21T01:41:54.471 DEBUG:teuthology.orchestra.run.smithi083:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-21T01:41:54.471 DEBUG:teuthology.orchestra.run.smithi083:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-21T01:41:54.471 DEBUG:teuthology.orchestra.run.smithi083:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-21T01:41:54.471 DEBUG:teuthology.orchestra.run.smithi083:> contents = proc_f.read() 2024-09-21T01:41:54.471 DEBUG:teuthology.orchestra.run.smithi083:> if mountpoint in contents: 2024-09-21T01:41:54.471 DEBUG:teuthology.orchestra.run.smithi083:> return f 2024-09-21T01:41:54.472 DEBUG:teuthology.orchestra.run.smithi083:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-21T01:41:54.472 DEBUG:teuthology.orchestra.run.smithi083:> 2024-09-21T01:41:54.472 DEBUG:teuthology.orchestra.run.smithi083:> print(_find_admin_socket("client.0")) 2024-09-21T01:41:54.472 DEBUG:teuthology.orchestra.run.smithi083:> ' 2024-09-21T01:41:54.589 INFO:teuthology.orchestra.run.smithi083.stdout:/var/run/ceph/ceph-client.0.86128.asok 2024-09-21T01:41:54.593 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T01:41:54.601 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.86128.asok 2024-09-21T01:41:54.601 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T01:41:54.601 DEBUG:teuthology.orchestra.run.smithi083:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.86128.asok status 2024-09-21T01:41:54.744 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-09-21T01:41:54.745 INFO:teuthology.orchestra.run.smithi083.stdout: "metadata": { 2024-09-21T01:41:54.745 INFO:teuthology.orchestra.run.smithi083.stdout: "ceph_sha1": "1843221895adccfb3b692060251dd6a0183bc410", 2024-09-21T01:41:54.745 INFO:teuthology.orchestra.run.smithi083.stdout: "ceph_version": "ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev)", 2024-09-21T01:41:54.745 INFO:teuthology.orchestra.run.smithi083.stdout: "entity_id": "0", 2024-09-21T01:41:54.745 INFO:teuthology.orchestra.run.smithi083.stdout: "hostname": "smithi083", 2024-09-21T01:41:54.745 INFO:teuthology.orchestra.run.smithi083.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-21T01:41:54.745 INFO:teuthology.orchestra.run.smithi083.stdout: "pid": "86128", 2024-09-21T01:41:54.745 INFO:teuthology.orchestra.run.smithi083.stdout: "root": "/volumes/qa/sv_0/d2f98f10-db6a-4a15-b493-6d0ac8493e5a" 2024-09-21T01:41:54.745 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:41:54.745 INFO:teuthology.orchestra.run.smithi083.stdout: "dentry_count": 0, 2024-09-21T01:41:54.745 INFO:teuthology.orchestra.run.smithi083.stdout: "dentry_pinned_count": 0, 2024-09-21T01:41:54.746 INFO:teuthology.orchestra.run.smithi083.stdout: "id": 15399, 2024-09-21T01:41:54.746 INFO:teuthology.orchestra.run.smithi083.stdout: "inst": { 2024-09-21T01:41:54.746 INFO:teuthology.orchestra.run.smithi083.stdout: "name": { 2024-09-21T01:41:54.746 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "client", 2024-09-21T01:41:54.746 INFO:teuthology.orchestra.run.smithi083.stdout: "num": 15399 2024-09-21T01:41:54.746 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:41:54.746 INFO:teuthology.orchestra.run.smithi083.stdout: "addr": { 2024-09-21T01:41:54.746 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "v1", 2024-09-21T01:41:54.746 INFO:teuthology.orchestra.run.smithi083.stdout: "addr": "192.168.0.1:0", 2024-09-21T01:41:54.746 INFO:teuthology.orchestra.run.smithi083.stdout: "nonce": 3304244511 2024-09-21T01:41:54.746 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:41:54.746 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:41:54.746 INFO:teuthology.orchestra.run.smithi083.stdout: "addr": { 2024-09-21T01:41:54.746 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "v1", 2024-09-21T01:41:54.746 INFO:teuthology.orchestra.run.smithi083.stdout: "addr": "192.168.0.1:0", 2024-09-21T01:41:54.747 INFO:teuthology.orchestra.run.smithi083.stdout: "nonce": 3304244511 2024-09-21T01:41:54.747 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:41:54.747 INFO:teuthology.orchestra.run.smithi083.stdout: "inst_str": "client.15399 192.168.0.1:0/3304244511", 2024-09-21T01:41:54.747 INFO:teuthology.orchestra.run.smithi083.stdout: "addr_str": "192.168.0.1:0/3304244511", 2024-09-21T01:41:54.747 INFO:teuthology.orchestra.run.smithi083.stdout: "inode_count": 5, 2024-09-21T01:41:54.747 INFO:teuthology.orchestra.run.smithi083.stdout: "mds_epoch": 21, 2024-09-21T01:41:54.747 INFO:teuthology.orchestra.run.smithi083.stdout: "osd_epoch": 84, 2024-09-21T01:41:54.747 INFO:teuthology.orchestra.run.smithi083.stdout: "osd_epoch_barrier": 0, 2024-09-21T01:41:54.747 INFO:teuthology.orchestra.run.smithi083.stdout: "blocklisted": false, 2024-09-21T01:41:54.747 INFO:teuthology.orchestra.run.smithi083.stdout: "fs_name": "cephfs" 2024-09-21T01:41:54.747 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-09-21T01:41:54.753 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T01:41:54.753 DEBUG:teuthology.orchestra.run.smithi083:> stat --file-system '--printf=%T 2024-09-21T01:41:54.753 DEBUG:teuthology.orchestra.run.smithi083:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-21T01:41:54.769 INFO:teuthology.orchestra.run.smithi083.stdout:fuseblk 2024-09-21T01:41:54.769 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-21T01:41:54.769 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T01:41:54.769 DEBUG:teuthology.orchestra.run.smithi083:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-21T01:41:54.835 INFO:teuthology.run_tasks:Running task check-counter... 2024-09-21T01:41:54.845 INFO:teuthology.run_tasks:Running task exec... 2024-09-21T01:41:54.854 INFO:teuthology.task.exec:Executing custom commands... 2024-09-21T01:41:54.854 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi083.front.sepia.ceph.com 2024-09-21T01:41:54.854 DEBUG:teuthology.orchestra.run.smithi083:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m' 2024-09-21T01:41:54.988 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:54.987+0000 7f1e0a20a640 1 -- 172.21.15.83:0/611694113 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1e04108c30 msgr2=0x7f1e0410f460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:54.988 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:54.987+0000 7f1e0a20a640 1 --2- 172.21.15.83:0/611694113 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1e04108c30 0x7f1e0410f460 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f1dfc009ca0 tx=0x7f1dfc02a8c0 comp rx=0 tx=0).stop 2024-09-21T01:41:54.988 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:54.987+0000 7f1e0a20a640 1 -- 172.21.15.83:0/611694113 shutdown_connections 2024-09-21T01:41:54.988 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:54.987+0000 7f1e0a20a640 1 --2- 172.21.15.83:0/611694113 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1e04108c30 0x7f1e0410f460 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:54.988 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:54.987+0000 7f1e0a20a640 1 --2- 172.21.15.83:0/611694113 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1e041082e0 0x7f1e041086f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:54.988 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:54.987+0000 7f1e0a20a640 1 --2- 172.21.15.83:0/611694113 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1e041029b0 0x7f1e04102dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:54.988 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:54.987+0000 7f1e0a20a640 1 -- 172.21.15.83:0/611694113 >> 172.21.15.83:0/611694113 conn(0x7f1e0407a740 msgr2=0x7f1e0407ab50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:41:54.988 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:54.987+0000 7f1e0a20a640 1 -- 172.21.15.83:0/611694113 shutdown_connections 2024-09-21T01:41:54.988 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:54.987+0000 7f1e0a20a640 1 -- 172.21.15.83:0/611694113 wait complete. 2024-09-21T01:41:54.990 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:54.988+0000 7f1e0a20a640 1 Processor -- start 2024-09-21T01:41:54.990 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:54.988+0000 7f1e0a20a640 1 -- start start 2024-09-21T01:41:54.991 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:54.988+0000 7f1e0a20a640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1e041029b0 0x7f1e0419b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:54.991 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:54.988+0000 7f1e0a20a640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1e041082e0 0x7f1e0419b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:54.991 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:54.988+0000 7f1e0a20a640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1e04108c30 0x7f1e0419bb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:54.991 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:54.988+0000 7f1e0a20a640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f1e041127f0 con 0x7f1e04108c30 2024-09-21T01:41:54.991 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:54.988+0000 7f1e0a20a640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f1e04112670 con 0x7f1e041082e0 2024-09-21T01:41:54.991 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:54.988+0000 7f1e0a20a640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f1e04112970 con 0x7f1e041029b0 2024-09-21T01:41:54.991 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:54.988+0000 7f1e03fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1e04108c30 0x7f1e0419bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:54.991 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:54.988+0000 7f1e03fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1e04108c30 0x7f1e0419bb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:60536/0 (socket says 172.21.15.83:60536) 2024-09-21T01:41:54.991 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:54.988+0000 7f1e03fff640 1 -- 172.21.15.83:0/270573395 learned_addr learned my addr 172.21.15.83:0/270573395 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:41:54.991 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:54.988+0000 7f1e037fe640 1 --2- 172.21.15.83:0/270573395 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1e041029b0 0x7f1e0419b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:54.991 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:54.989+0000 7f1dfbfff640 1 --2- 172.21.15.83:0/270573395 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1e041082e0 0x7f1e0419b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:54.991 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:54.989+0000 7f1e03fff640 1 -- 172.21.15.83:0/270573395 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1e041029b0 msgr2=0x7f1e0419b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:54.991 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:54.989+0000 7f1e03fff640 1 --2- 172.21.15.83:0/270573395 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1e041029b0 0x7f1e0419b0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:54.991 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:54.989+0000 7f1e03fff640 1 -- 172.21.15.83:0/270573395 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1e041082e0 msgr2=0x7f1e0419b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:54.991 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:54.989+0000 7f1e03fff640 1 --2- 172.21.15.83:0/270573395 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1e041082e0 0x7f1e0419b620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:54.992 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:54.989+0000 7f1e03fff640 1 -- 172.21.15.83:0/270573395 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e041a62e0 con 0x7f1e04108c30 2024-09-21T01:41:54.992 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:54.989+0000 7f1e03fff640 1 --2- 172.21.15.83:0/270573395 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1e04108c30 0x7f1e0419bb60 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f1dfc005cc0 tx=0x7f1dfc032a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:41:54.992 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:54.989+0000 7f1e017fa640 1 -- 172.21.15.83:0/270573395 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dfc032e00 con 0x7f1e04108c30 2024-09-21T01:41:54.992 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:54.989+0000 7f1e017fa640 1 -- 172.21.15.83:0/270573395 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1dfc0044d0 con 0x7f1e04108c30 2024-09-21T01:41:54.992 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:54.989+0000 7f1e017fa640 1 -- 172.21.15.83:0/270573395 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dfc030b70 con 0x7f1e04108c30 2024-09-21T01:41:54.992 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:54.989+0000 7f1e0a20a640 1 -- 172.21.15.83:0/270573395 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e041a6570 con 0x7f1e04108c30 2024-09-21T01:41:54.992 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:54.989+0000 7f1e0a20a640 1 -- 172.21.15.83:0/270573395 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e041a6b10 con 0x7f1e04108c30 2024-09-21T01:41:54.992 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:54.990+0000 7f1e0a20a640 1 -- 172.21.15.83:0/270573395 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e04102dc0 con 0x7f1e04108c30 2024-09-21T01:41:54.993 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:54.991+0000 7f1e017fa640 1 -- 172.21.15.83:0/270573395 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 22) ==== 154529+0+0 (secure 0 0 0) 0x7f1dfc030d10 con 0x7f1e04108c30 2024-09-21T01:41:54.993 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:54.992+0000 7f1e017fa640 1 --2- 172.21.15.83:0/270573395 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f1df00b65e0 0x7f1df00b8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:54.993 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:54.992+0000 7f1e037fe640 1 --2- 172.21.15.83:0/270573395 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f1df00b65e0 0x7f1df00b8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:54.993 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:54.992+0000 7f1e017fa640 1 -- 172.21.15.83:0/270573395 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9315+0+0 (secure 0 0 0) 0x7f1dfc108b30 con 0x7f1e04108c30 2024-09-21T01:41:54.993 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:54.993+0000 7f1e037fe640 1 --2- 172.21.15.83:0/270573395 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f1df00b65e0 0x7f1df00b8af0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f1e0406b740 tx=0x7f1df400b410 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:41:54.996 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:54.995+0000 7f1e017fa640 1 -- 172.21.15.83:0/270573395 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f1dfc0cef80 con 0x7f1e04108c30 2024-09-21T01:41:55.196 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:55.196+0000 7f1e0a20a640 1 -- 172.21.15.83:0/270573395 --> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}) -- 0x7f1e04063800 con 0x7f1df00b65e0 2024-09-21T01:41:55.358 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:55.358+0000 7f1e017fa640 1 -- 172.21.15.83:0/270573395 <== mgr.14223 v2:172.21.15.83:6800/1748483157 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f1e04063800 con 0x7f1df00b65e0 2024-09-21T01:41:55.359 INFO:teuthology.orchestra.run.smithi083.stdout:Schedule set for path / 2024-09-21T01:41:55.361 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:55.360+0000 7f1e0a20a640 1 -- 172.21.15.83:0/270573395 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f1df00b65e0 msgr2=0x7f1df00b8af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:55.361 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:55.360+0000 7f1e0a20a640 1 --2- 172.21.15.83:0/270573395 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f1df00b65e0 0x7f1df00b8af0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f1e0406b740 tx=0x7f1df400b410 comp rx=0 tx=0).stop 2024-09-21T01:41:55.361 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:55.360+0000 7f1e0a20a640 1 -- 172.21.15.83:0/270573395 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1e04108c30 msgr2=0x7f1e0419bb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:55.362 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:55.360+0000 7f1e0a20a640 1 --2- 172.21.15.83:0/270573395 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1e04108c30 0x7f1e0419bb60 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f1dfc005cc0 tx=0x7f1dfc032a10 comp rx=0 tx=0).stop 2024-09-21T01:41:55.362 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:55.360+0000 7f1e0a20a640 1 -- 172.21.15.83:0/270573395 shutdown_connections 2024-09-21T01:41:55.362 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:55.360+0000 7f1e0a20a640 1 --2- 172.21.15.83:0/270573395 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f1df00b65e0 0x7f1df00b8af0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:55.362 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:55.360+0000 7f1e0a20a640 1 --2- 172.21.15.83:0/270573395 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1e04108c30 0x7f1e0419bb60 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:55.362 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:55.360+0000 7f1e0a20a640 1 --2- 172.21.15.83:0/270573395 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1e041082e0 0x7f1e0419b620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:55.363 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:55.360+0000 7f1e0a20a640 1 --2- 172.21.15.83:0/270573395 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1e041029b0 0x7f1e0419b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:55.363 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:55.360+0000 7f1e0a20a640 1 -- 172.21.15.83:0/270573395 >> 172.21.15.83:0/270573395 conn(0x7f1e0407a740 msgr2=0x7f1e041042f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:41:55.363 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:55.360+0000 7f1e0a20a640 1 -- 172.21.15.83:0/270573395 shutdown_connections 2024-09-21T01:41:55.363 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:55.360+0000 7f1e0a20a640 1 -- 172.21.15.83:0/270573395 wait complete. 2024-09-21T01:41:55.372 DEBUG:teuthology.orchestra.run.smithi083:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h' 2024-09-21T01:41:55.488 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:55.484+0000 7fb5b29ad640 1 -- 172.21.15.83:0/3252239452 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb5ac106200 msgr2=0x7fb5ac106610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:55.488 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:55.484+0000 7fb5b29ad640 1 --2- 172.21.15.83:0/3252239452 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb5ac106200 0x7fb5ac106610 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fb5a0009900 tx=0x7fb5a002a410 comp rx=0 tx=0).stop 2024-09-21T01:41:55.488 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:55.484+0000 7fb5b29ad640 1 -- 172.21.15.83:0/3252239452 shutdown_connections 2024-09-21T01:41:55.488 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:55.484+0000 7fb5b29ad640 1 --2- 172.21.15.83:0/3252239452 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb5ac106b50 0x7fb5ac110590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:55.489 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:55.484+0000 7fb5b29ad640 1 --2- 172.21.15.83:0/3252239452 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb5ac106200 0x7fb5ac106610 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:55.489 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:55.484+0000 7fb5b29ad640 1 --2- 172.21.15.83:0/3252239452 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb5ac102090 0x7fb5ac1024a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:55.489 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:55.484+0000 7fb5b29ad640 1 -- 172.21.15.83:0/3252239452 >> 172.21.15.83:0/3252239452 conn(0x7fb5ac079ec0 msgr2=0x7fb5ac07a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:41:55.489 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:55.484+0000 7fb5b29ad640 1 -- 172.21.15.83:0/3252239452 shutdown_connections 2024-09-21T01:41:55.489 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:55.484+0000 7fb5b29ad640 1 -- 172.21.15.83:0/3252239452 wait complete. 2024-09-21T01:41:55.489 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:55.484+0000 7fb5b29ad640 1 Processor -- start 2024-09-21T01:41:55.489 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:55.484+0000 7fb5b29ad640 1 -- start start 2024-09-21T01:41:55.490 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:55.485+0000 7fb5b29ad640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb5ac102090 0x7fb5ac103020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:55.490 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:55.485+0000 7fb5b29ad640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb5ac106200 0x7fb5ac103560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:55.490 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:55.485+0000 7fb5b29ad640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb5ac106b50 0x7fb5ac103aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:55.490 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:55.485+0000 7fb5b29ad640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fb5ac1138d0 con 0x7fb5ac106b50 2024-09-21T01:41:55.490 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:55.485+0000 7fb5b29ad640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fb5ac113750 con 0x7fb5ac106200 2024-09-21T01:41:55.490 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:55.485+0000 7fb5b29ad640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fb5ac113a50 con 0x7fb5ac102090 2024-09-21T01:41:55.490 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:55.485+0000 7fb5b0f4a640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb5ac106b50 0x7fb5ac103aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:55.491 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:55.485+0000 7fb5b0f4a640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb5ac106b50 0x7fb5ac103aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:60578/0 (socket says 172.21.15.83:60578) 2024-09-21T01:41:55.491 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:55.485+0000 7fb5b0f4a640 1 -- 172.21.15.83:0/870555060 learned_addr learned my addr 172.21.15.83:0/870555060 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:41:55.491 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:55.485+0000 7fb5ab7fe640 1 --2- 172.21.15.83:0/870555060 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb5ac106200 0x7fb5ac103560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:55.491 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:55.485+0000 7fb5abfff640 1 --2- 172.21.15.83:0/870555060 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb5ac102090 0x7fb5ac103020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:55.491 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:55.485+0000 7fb5b0f4a640 1 -- 172.21.15.83:0/870555060 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb5ac102090 msgr2=0x7fb5ac103020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:55.491 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:55.485+0000 7fb5b0f4a640 1 --2- 172.21.15.83:0/870555060 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb5ac102090 0x7fb5ac103020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:55.491 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:55.485+0000 7fb5b0f4a640 1 -- 172.21.15.83:0/870555060 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb5ac106200 msgr2=0x7fb5ac103560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:55.492 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:55.485+0000 7fb5b0f4a640 1 --2- 172.21.15.83:0/870555060 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb5ac106200 0x7fb5ac103560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:55.492 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:55.485+0000 7fb5b0f4a640 1 -- 172.21.15.83:0/870555060 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5ac1a86c0 con 0x7fb5ac106b50 2024-09-21T01:41:55.492 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:55.485+0000 7fb5abfff640 1 --2- 172.21.15.83:0/870555060 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb5ac102090 0x7fb5ac103020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:41:55.492 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:55.486+0000 7fb5b0f4a640 1 --2- 172.21.15.83:0/870555060 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb5ac106b50 0x7fb5ac103aa0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fb5a400eb10 tx=0x7fb5a400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:41:55.492 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:55.486+0000 7fb5a97fa640 1 -- 172.21.15.83:0/870555060 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5a4004b20 con 0x7fb5ac106b50 2024-09-21T01:41:55.492 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:55.486+0000 7fb5b29ad640 1 -- 172.21.15.83:0/870555060 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5ac1a89b0 con 0x7fb5ac106b50 2024-09-21T01:41:55.492 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:55.486+0000 7fb5a97fa640 1 -- 172.21.15.83:0/870555060 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb5a4004cc0 con 0x7fb5ac106b50 2024-09-21T01:41:55.492 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:55.486+0000 7fb5a97fa640 1 -- 172.21.15.83:0/870555060 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5a4010690 con 0x7fb5ac106b50 2024-09-21T01:41:55.493 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:55.486+0000 7fb5b29ad640 1 -- 172.21.15.83:0/870555060 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5ac1a8f20 con 0x7fb5ac106b50 2024-09-21T01:41:55.493 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:55.487+0000 7fb5b29ad640 1 -- 172.21.15.83:0/870555060 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5ac1024a0 con 0x7fb5ac106b50 2024-09-21T01:41:55.494 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:55.488+0000 7fb5a97fa640 1 -- 172.21.15.83:0/870555060 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 22) ==== 154529+0+0 (secure 0 0 0) 0x7fb5a4010830 con 0x7fb5ac106b50 2024-09-21T01:41:55.494 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:55.489+0000 7fb5a97fa640 1 --2- 172.21.15.83:0/870555060 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fb5940b6590 0x7fb5940b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:55.494 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:55.489+0000 7fb5abfff640 1 --2- 172.21.15.83:0/870555060 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fb5940b6590 0x7fb5940b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:55.494 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:55.489+0000 7fb5a97fa640 1 -- 172.21.15.83:0/870555060 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9315+0+0 (secure 0 0 0) 0x7fb5a40e7eb0 con 0x7fb5ac106b50 2024-09-21T01:41:55.495 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:55.490+0000 7fb5abfff640 1 --2- 172.21.15.83:0/870555060 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fb5940b6590 0x7fb5940b8aa0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fb59c005fd0 tx=0x7fb59c005850 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:41:55.495 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:55.492+0000 7fb5a97fa640 1 -- 172.21.15.83:0/870555060 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb5a4056710 con 0x7fb5ac106b50 2024-09-21T01:41:55.693 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:55.692+0000 7fb5b29ad640 1 -- 172.21.15.83:0/870555060 --> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] -- mgr_command(tid 0: {"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}) -- 0x7fb5ac063800 con 0x7fb5940b6590 2024-09-21T01:41:55.753 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:55.752+0000 7fb5a97fa640 1 -- 172.21.15.83:0/870555060 <== mgr.14223 v2:172.21.15.83:6800/1748483157 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+26 (secure 0 0 0) 0x7fb5ac063800 con 0x7fb5940b6590 2024-09-21T01:41:55.753 INFO:teuthology.orchestra.run.smithi083.stdout:Retention added to path / 2024-09-21T01:41:55.756 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:55.754+0000 7fb5b29ad640 1 -- 172.21.15.83:0/870555060 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fb5940b6590 msgr2=0x7fb5940b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:55.756 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:55.754+0000 7fb5b29ad640 1 --2- 172.21.15.83:0/870555060 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fb5940b6590 0x7fb5940b8aa0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fb59c005fd0 tx=0x7fb59c005850 comp rx=0 tx=0).stop 2024-09-21T01:41:55.756 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:55.755+0000 7fb5b29ad640 1 -- 172.21.15.83:0/870555060 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb5ac106b50 msgr2=0x7fb5ac103aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:55.756 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:55.755+0000 7fb5b29ad640 1 --2- 172.21.15.83:0/870555060 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb5ac106b50 0x7fb5ac103aa0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fb5a400eb10 tx=0x7fb5a400c2d0 comp rx=0 tx=0).stop 2024-09-21T01:41:55.756 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:55.755+0000 7fb5b29ad640 1 -- 172.21.15.83:0/870555060 shutdown_connections 2024-09-21T01:41:55.756 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:55.755+0000 7fb5b29ad640 1 --2- 172.21.15.83:0/870555060 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fb5940b6590 0x7fb5940b8aa0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:55.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:55.755+0000 7fb5b29ad640 1 --2- 172.21.15.83:0/870555060 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb5ac106b50 0x7fb5ac103aa0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:55.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:55.755+0000 7fb5b29ad640 1 --2- 172.21.15.83:0/870555060 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb5ac106200 0x7fb5ac103560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:55.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:55.755+0000 7fb5b29ad640 1 --2- 172.21.15.83:0/870555060 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb5ac102090 0x7fb5ac103020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:55.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:55.755+0000 7fb5b29ad640 1 -- 172.21.15.83:0/870555060 >> 172.21.15.83:0/870555060 conn(0x7fb5ac079ec0 msgr2=0x7fb5ac1074f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:41:55.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:55.755+0000 7fb5b29ad640 1 -- 172.21.15.83:0/870555060 shutdown_connections 2024-09-21T01:41:55.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:55.755+0000 7fb5b29ad640 1 -- 172.21.15.83:0/870555060 wait complete. 2024-09-21T01:41:55.766 DEBUG:teuthology.orchestra.run.smithi083:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2024-09-21T01:41:55.883 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:55.878+0000 7f4461958640 1 -- 172.21.15.83:0/2719958045 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f445c108c60 msgr2=0x7f445c10f490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:55.883 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:55.878+0000 7f4461958640 1 --2- 172.21.15.83:0/2719958045 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f445c108c60 0x7f445c10f490 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f4454009ca0 tx=0x7f445402a8c0 comp rx=0 tx=0).stop 2024-09-21T01:41:55.883 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:55.878+0000 7f4461958640 1 -- 172.21.15.83:0/2719958045 shutdown_connections 2024-09-21T01:41:55.883 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:55.878+0000 7f4461958640 1 --2- 172.21.15.83:0/2719958045 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f445c108c60 0x7f445c10f490 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:55.883 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:55.878+0000 7f4461958640 1 --2- 172.21.15.83:0/2719958045 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f445c108310 0x7f445c108720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:55.883 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:55.878+0000 7f4461958640 1 --2- 172.21.15.83:0/2719958045 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f445c1029e0 0x7f445c102df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:55.884 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:55.878+0000 7f4461958640 1 -- 172.21.15.83:0/2719958045 >> 172.21.15.83:0/2719958045 conn(0x7f445c0fe3e0 msgr2=0x7f445c100830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:41:55.884 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:55.878+0000 7f4461958640 1 -- 172.21.15.83:0/2719958045 shutdown_connections 2024-09-21T01:41:55.884 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:55.878+0000 7f4461958640 1 -- 172.21.15.83:0/2719958045 wait complete. 2024-09-21T01:41:55.884 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:55.878+0000 7f4461958640 1 Processor -- start 2024-09-21T01:41:55.884 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:55.878+0000 7f4461958640 1 -- start start 2024-09-21T01:41:55.884 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:55.879+0000 7f4461958640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f445c1029e0 0x7f445c19b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:55.885 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:55.879+0000 7f4461958640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f445c108310 0x7f445c19b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:55.885 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:55.879+0000 7f4461958640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f445c108c60 0x7f445c19bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:55.885 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:55.879+0000 7f4461958640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f445c112820 con 0x7f445c1029e0 2024-09-21T01:41:55.885 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:55.879+0000 7f4461958640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f445c1126a0 con 0x7f445c108310 2024-09-21T01:41:55.885 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:55.879+0000 7f4461958640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f445c1129a0 con 0x7f445c108c60 2024-09-21T01:41:55.885 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:55.879+0000 7f445affd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f445c1029e0 0x7f445c19b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:55.885 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:55.879+0000 7f445affd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f445c1029e0 0x7f445c19b1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:60590/0 (socket says 172.21.15.83:60590) 2024-09-21T01:41:55.886 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:55.879+0000 7f445affd640 1 -- 172.21.15.83:0/892420667 learned_addr learned my addr 172.21.15.83:0/892420667 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:41:55.886 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:55.879+0000 7f44527fc640 1 --2- 172.21.15.83:0/892420667 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f445c108310 0x7f445c19b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:55.886 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:55.879+0000 7f445b7fe640 1 --2- 172.21.15.83:0/892420667 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f445c108c60 0x7f445c19bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:55.886 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:55.879+0000 7f445affd640 1 -- 172.21.15.83:0/892420667 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f445c108c60 msgr2=0x7f445c19bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:55.886 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:55.879+0000 7f445affd640 1 --2- 172.21.15.83:0/892420667 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f445c108c60 0x7f445c19bc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:55.886 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:55.879+0000 7f445affd640 1 -- 172.21.15.83:0/892420667 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f445c108310 msgr2=0x7f445c19b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:55.886 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:55.879+0000 7f445affd640 1 --2- 172.21.15.83:0/892420667 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f445c108310 0x7f445c19b730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:55.887 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:55.879+0000 7f445affd640 1 -- 172.21.15.83:0/892420667 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f445c1a6480 con 0x7f445c1029e0 2024-09-21T01:41:55.887 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:55.879+0000 7f44527fc640 1 --2- 172.21.15.83:0/892420667 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f445c108310 0x7f445c19b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:41:55.887 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:55.879+0000 7f445b7fe640 1 --2- 172.21.15.83:0/892420667 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f445c108c60 0x7f445c19bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:41:55.887 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:55.879+0000 7f445affd640 1 --2- 172.21.15.83:0/892420667 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f445c1029e0 0x7f445c19b1f0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f444c00e9f0 tx=0x7f444c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:41:55.887 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:55.880+0000 7f4460956640 1 -- 172.21.15.83:0/892420667 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f444c00cd80 con 0x7f445c1029e0 2024-09-21T01:41:55.887 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:55.880+0000 7f4460956640 1 -- 172.21.15.83:0/892420667 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f444c0054b0 con 0x7f445c1029e0 2024-09-21T01:41:55.887 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:55.880+0000 7f4461958640 1 -- 172.21.15.83:0/892420667 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f445c1a6770 con 0x7f445c1029e0 2024-09-21T01:41:55.888 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:55.880+0000 7f4460956640 1 -- 172.21.15.83:0/892420667 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f444c010430 con 0x7f445c1029e0 2024-09-21T01:41:55.888 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:55.880+0000 7f4461958640 1 -- 172.21.15.83:0/892420667 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f445c1a6c70 con 0x7f445c1029e0 2024-09-21T01:41:55.888 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:55.881+0000 7f4461958640 1 -- 172.21.15.83:0/892420667 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f445c102df0 con 0x7f445c1029e0 2024-09-21T01:41:55.888 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:55.882+0000 7f4460956640 1 -- 172.21.15.83:0/892420667 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 22) ==== 154529+0+0 (secure 0 0 0) 0x7f444c0046c0 con 0x7f445c1029e0 2024-09-21T01:41:55.889 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:55.883+0000 7f4460956640 1 --2- 172.21.15.83:0/892420667 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f44480b6560 0x7f44480b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:55.889 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:55.883+0000 7f44527fc640 1 --2- 172.21.15.83:0/892420667 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f44480b6560 0x7f44480b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:55.890 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:55.883+0000 7f4460956640 1 -- 172.21.15.83:0/892420667 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9315+0+0 (secure 0 0 0) 0x7f444c0e7e70 con 0x7f445c1029e0 2024-09-21T01:41:55.890 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:55.884+0000 7f44527fc640 1 --2- 172.21.15.83:0/892420667 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f44480b6560 0x7f44480b8a70 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f445c101ae0 tx=0x7f44440094b0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:41:55.890 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:55.886+0000 7f4460956640 1 -- 172.21.15.83:0/892420667 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f444c056710 con 0x7f445c1029e0 2024-09-21T01:41:56.053 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:41:55 smithi083 ceph-mon[31370]: pgmap v335: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-21T01:41:56.084 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:56.084+0000 7f4461958640 1 -- 172.21.15.83:0/892420667 --> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) -- 0x7f445c063800 con 0x7f44480b6560 2024-09-21T01:41:56.091 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:56.091+0000 7f4460956640 1 -- 172.21.15.83:0/892420667 <== mgr.14223 v2:172.21.15.83:6800/1748483157 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+298 (secure 0 0 0) 0x7f445c063800 con 0x7f44480b6560 2024-09-21T01:41:56.092 INFO:teuthology.orchestra.run.smithi083.stdout:{"fs": "cephfs", "subvol": null, "group": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2024-09-21T00:00:00", "created": "2024-09-21T01:41:55", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": true} 2024-09-21T01:41:56.094 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:56.093+0000 7f4461958640 1 -- 172.21.15.83:0/892420667 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f44480b6560 msgr2=0x7f44480b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:56.094 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:56.093+0000 7f4461958640 1 --2- 172.21.15.83:0/892420667 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f44480b6560 0x7f44480b8a70 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f445c101ae0 tx=0x7f44440094b0 comp rx=0 tx=0).stop 2024-09-21T01:41:56.095 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:56.093+0000 7f4461958640 1 -- 172.21.15.83:0/892420667 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f445c1029e0 msgr2=0x7f445c19b1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:56.095 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:56.093+0000 7f4461958640 1 --2- 172.21.15.83:0/892420667 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f445c1029e0 0x7f445c19b1f0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f444c00e9f0 tx=0x7f444c00edf0 comp rx=0 tx=0).stop 2024-09-21T01:41:56.095 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:56.093+0000 7f4461958640 1 -- 172.21.15.83:0/892420667 shutdown_connections 2024-09-21T01:41:56.095 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:56.093+0000 7f4461958640 1 --2- 172.21.15.83:0/892420667 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f44480b6560 0x7f44480b8a70 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:56.095 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:56.093+0000 7f4461958640 1 --2- 172.21.15.83:0/892420667 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f445c108c60 0x7f445c19bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:56.095 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:56.093+0000 7f4461958640 1 --2- 172.21.15.83:0/892420667 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f445c108310 0x7f445c19b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:56.095 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:56.093+0000 7f4461958640 1 --2- 172.21.15.83:0/892420667 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f445c1029e0 0x7f445c19b1f0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:56.096 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:56.093+0000 7f4461958640 1 -- 172.21.15.83:0/892420667 >> 172.21.15.83:0/892420667 conn(0x7f445c0fe3e0 msgr2=0x7f445c1058c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:41:56.096 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:56.093+0000 7f4461958640 1 -- 172.21.15.83:0/892420667 shutdown_connections 2024-09-21T01:41:56.096 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:56.093+0000 7f4461958640 1 -- 172.21.15.83:0/892420667 wait complete. 2024-09-21T01:41:56.106 DEBUG:teuthology.orchestra.run.smithi083:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2024-09-21T01:41:56.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:41:55 smithi142 ceph-mon[34050]: pgmap v335: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-21T01:41:56.222 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:56.217+0000 7fa9248b6640 1 -- 172.21.15.83:0/397998639 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa920108310 msgr2=0x7fa920108720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:56.222 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:56.217+0000 7fa9248b6640 1 --2- 172.21.15.83:0/397998639 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa920108310 0x7fa920108720 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fa908009900 tx=0x7fa90802a410 comp rx=0 tx=0).stop 2024-09-21T01:41:56.222 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:56.217+0000 7fa9248b6640 1 -- 172.21.15.83:0/397998639 shutdown_connections 2024-09-21T01:41:56.223 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:56.217+0000 7fa9248b6640 1 --2- 172.21.15.83:0/397998639 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa920108c60 0x7fa92010f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:56.223 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:56.217+0000 7fa9248b6640 1 --2- 172.21.15.83:0/397998639 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa920108310 0x7fa920108720 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:56.223 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:56.217+0000 7fa9248b6640 1 --2- 172.21.15.83:0/397998639 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa9201029e0 0x7fa920102df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:56.223 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:56.217+0000 7fa9248b6640 1 -- 172.21.15.83:0/397998639 >> 172.21.15.83:0/397998639 conn(0x7fa9200fe3e0 msgr2=0x7fa920100830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:41:56.223 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:56.217+0000 7fa9248b6640 1 -- 172.21.15.83:0/397998639 shutdown_connections 2024-09-21T01:41:56.224 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:56.217+0000 7fa9248b6640 1 -- 172.21.15.83:0/397998639 wait complete. 2024-09-21T01:41:56.224 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:56.218+0000 7fa9248b6640 1 Processor -- start 2024-09-21T01:41:56.224 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:56.218+0000 7fa9248b6640 1 -- start start 2024-09-21T01:41:56.224 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:56.218+0000 7fa9248b6640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa9201029e0 0x7fa92019b160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:56.224 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:56.218+0000 7fa9248b6640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa920108310 0x7fa92019b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:56.225 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:56.218+0000 7fa9248b6640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa920108c60 0x7fa92019bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:56.225 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:56.218+0000 7fa9248b6640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fa9201127d0 con 0x7fa920108c60 2024-09-21T01:41:56.225 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:56.218+0000 7fa9248b6640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fa920112650 con 0x7fa920108310 2024-09-21T01:41:56.225 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:56.218+0000 7fa9248b6640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fa920112950 con 0x7fa9201029e0 2024-09-21T01:41:56.225 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:56.218+0000 7fa91ed9d640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa920108c60 0x7fa92019bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:56.225 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:56.218+0000 7fa91ed9d640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa920108c60 0x7fa92019bbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:60612/0 (socket says 172.21.15.83:60612) 2024-09-21T01:41:56.226 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:56.218+0000 7fa915d9b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa920108310 0x7fa92019b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:56.226 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:56.218+0000 7fa91ed9d640 1 -- 172.21.15.83:0/2837143265 learned_addr learned my addr 172.21.15.83:0/2837143265 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:41:56.226 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:56.218+0000 7fa91e59c640 1 --2- 172.21.15.83:0/2837143265 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa9201029e0 0x7fa92019b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:56.226 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:56.219+0000 7fa91ed9d640 1 -- 172.21.15.83:0/2837143265 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa9201029e0 msgr2=0x7fa92019b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:56.226 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:56.219+0000 7fa91ed9d640 1 --2- 172.21.15.83:0/2837143265 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa9201029e0 0x7fa92019b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:56.227 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:56.219+0000 7fa91ed9d640 1 -- 172.21.15.83:0/2837143265 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa920108310 msgr2=0x7fa92019b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:56.227 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:56.219+0000 7fa91ed9d640 1 --2- 172.21.15.83:0/2837143265 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa920108310 0x7fa92019b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:56.227 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:56.219+0000 7fa91ed9d640 1 -- 172.21.15.83:0/2837143265 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9201a6420 con 0x7fa920108c60 2024-09-21T01:41:56.227 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:56.219+0000 7fa91ed9d640 1 --2- 172.21.15.83:0/2837143265 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa920108c60 0x7fa92019bbe0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fa91800cad0 tx=0x7fa91800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:41:56.227 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:56.219+0000 7fa917fff640 1 -- 172.21.15.83:0/2837143265 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa91800ae20 con 0x7fa920108c60 2024-09-21T01:41:56.227 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:56.219+0000 7fa9248b6640 1 -- 172.21.15.83:0/2837143265 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9201a6710 con 0x7fa920108c60 2024-09-21T01:41:56.228 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:56.219+0000 7fa917fff640 1 -- 172.21.15.83:0/2837143265 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa918005020 con 0x7fa920108c60 2024-09-21T01:41:56.228 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:56.219+0000 7fa917fff640 1 -- 172.21.15.83:0/2837143265 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa91800f6b0 con 0x7fa920108c60 2024-09-21T01:41:56.228 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:56.219+0000 7fa9248b6640 1 -- 172.21.15.83:0/2837143265 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9201a6be0 con 0x7fa920108c60 2024-09-21T01:41:56.228 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:56.220+0000 7fa9248b6640 1 -- 172.21.15.83:0/2837143265 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa920102df0 con 0x7fa920108c60 2024-09-21T01:41:56.229 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:41:55 smithi119 ceph-mon[33693]: pgmap v335: 129 pgs: 129 active+clean; 644 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-21T01:41:56.230 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:56.223+0000 7fa917fff640 1 -- 172.21.15.83:0/2837143265 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 22) ==== 154529+0+0 (secure 0 0 0) 0x7fa9180051d0 con 0x7fa920108c60 2024-09-21T01:41:56.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:56.223+0000 7fa917fff640 1 --2- 172.21.15.83:0/2837143265 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fa90c0b6560 0x7fa90c0b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:56.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:56.223+0000 7fa91e59c640 1 --2- 172.21.15.83:0/2837143265 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fa90c0b6560 0x7fa90c0b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:56.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:56.223+0000 7fa917fff640 1 -- 172.21.15.83:0/2837143265 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9315+0+0 (secure 0 0 0) 0x7fa9180e7ae0 con 0x7fa920108c60 2024-09-21T01:41:56.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:56.224+0000 7fa91e59c640 1 --2- 172.21.15.83:0/2837143265 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fa90c0b6560 0x7fa90c0b8a70 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fa92006c540 tx=0x7fa910005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:41:56.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:56.226+0000 7fa917fff640 1 -- 172.21.15.83:0/2837143265 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa918014030 con 0x7fa920108c60 2024-09-21T01:41:56.425 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:56.424+0000 7fa9248b6640 1 -- 172.21.15.83:0/2837143265 --> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) -- 0x7fa920063800 con 0x7fa90c0b6560 2024-09-21T01:41:56.432 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:56.432+0000 7fa917fff640 1 -- 172.21.15.83:0/2837143265 <== mgr.14223 v2:172.21.15.83:6800/1748483157 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+10 (secure 0 0 0) 0x7fa920063800 con 0x7fa90c0b6560 2024-09-21T01:41:56.432 INFO:teuthology.orchestra.run.smithi083.stdout:/ 1m 6m3h 2024-09-21T01:41:56.435 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:56.434+0000 7fa9248b6640 1 -- 172.21.15.83:0/2837143265 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fa90c0b6560 msgr2=0x7fa90c0b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:56.435 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:56.434+0000 7fa9248b6640 1 --2- 172.21.15.83:0/2837143265 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fa90c0b6560 0x7fa90c0b8a70 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fa92006c540 tx=0x7fa910005f90 comp rx=0 tx=0).stop 2024-09-21T01:41:56.435 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:56.434+0000 7fa9248b6640 1 -- 172.21.15.83:0/2837143265 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa920108c60 msgr2=0x7fa92019bbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:56.435 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:56.434+0000 7fa9248b6640 1 --2- 172.21.15.83:0/2837143265 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa920108c60 0x7fa92019bbe0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fa91800cad0 tx=0x7fa91800cf90 comp rx=0 tx=0).stop 2024-09-21T01:41:56.435 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:56.434+0000 7fa9248b6640 1 -- 172.21.15.83:0/2837143265 shutdown_connections 2024-09-21T01:41:56.435 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:56.434+0000 7fa9248b6640 1 --2- 172.21.15.83:0/2837143265 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fa90c0b6560 0x7fa90c0b8a70 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:56.435 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:56.434+0000 7fa9248b6640 1 --2- 172.21.15.83:0/2837143265 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa920108c60 0x7fa92019bbe0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:56.435 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:56.434+0000 7fa9248b6640 1 --2- 172.21.15.83:0/2837143265 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa920108310 0x7fa92019b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:56.435 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:56.434+0000 7fa9248b6640 1 --2- 172.21.15.83:0/2837143265 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa9201029e0 0x7fa92019b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:56.436 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:56.434+0000 7fa9248b6640 1 -- 172.21.15.83:0/2837143265 >> 172.21.15.83:0/2837143265 conn(0x7fa9200fe3e0 msgr2=0x7fa920100800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:41:56.436 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:56.434+0000 7fa9248b6640 1 -- 172.21.15.83:0/2837143265 shutdown_connections 2024-09-21T01:41:56.436 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:56.434+0000 7fa9248b6640 1 -- 172.21.15.83:0/2837143265 wait complete. 2024-09-21T01:41:56.446 DEBUG:teuthology.orchestra.run.smithi083:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > START_TIME' 2024-09-21T01:41:56.472 INFO:teuthology.run_tasks:Running task full_sequential_finally... 2024-09-21T01:41:56.488 INFO:teuthology.run_tasks:Running task quiescer... 2024-09-21T01:41:56.532 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-21T01:41:56.532 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph pg dump --format=json 2024-09-21T01:41:56.778 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:41:57.195 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:41:56 smithi083 ceph-mon[31370]: from='client.15405 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:41:57.195 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:41:56 smithi083 ceph-mon[31370]: from='client.15417 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:41:57.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:41:56 smithi142 ceph-mon[34050]: from='client.15405 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:41:57.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:41:56 smithi142 ceph-mon[34050]: from='client.15417 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:41:57.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:41:56 smithi119 ceph-mon[33693]: from='client.15405 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:41:57.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:41:56 smithi119 ceph-mon[33693]: from='client.15417 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:41:57.303 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:57.285+0000 7fc33d0b5640 1 -- 172.21.15.83:0/46732479 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc338109e30 msgr2=0x7fc338110660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:57.304 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:57.285+0000 7fc33d0b5640 1 --2- 172.21.15.83:0/46732479 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc338109e30 0x7fc338110660 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fc330009ca0 tx=0x7fc33002a8c0 comp rx=0 tx=0).stop 2024-09-21T01:41:57.304 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:57.285+0000 7fc33d0b5640 1 -- 172.21.15.83:0/46732479 shutdown_connections 2024-09-21T01:41:57.304 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:57.285+0000 7fc33d0b5640 1 --2- 172.21.15.83:0/46732479 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc338109e30 0x7fc338110660 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:57.304 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:57.285+0000 7fc33d0b5640 1 --2- 172.21.15.83:0/46732479 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc3381094e0 0x7fc3381098f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:57.304 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:57.285+0000 7fc33d0b5640 1 --2- 172.21.15.83:0/46732479 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc338103ba0 0x7fc338103fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:57.304 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:57.285+0000 7fc33d0b5640 1 -- 172.21.15.83:0/46732479 >> 172.21.15.83:0/46732479 conn(0x7fc3380ff630 msgr2=0x7fc338101a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:41:57.304 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:57.285+0000 7fc33d0b5640 1 -- 172.21.15.83:0/46732479 shutdown_connections 2024-09-21T01:41:57.304 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:57.285+0000 7fc33d0b5640 1 -- 172.21.15.83:0/46732479 wait complete. 2024-09-21T01:41:57.304 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:57.286+0000 7fc33d0b5640 1 Processor -- start 2024-09-21T01:41:57.304 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:57.286+0000 7fc33d0b5640 1 -- start start 2024-09-21T01:41:57.304 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:57.286+0000 7fc33d0b5640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc338103ba0 0x7fc33819a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:57.304 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:57.286+0000 7fc33d0b5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc3381094e0 0x7fc33819a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:57.305 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:57.286+0000 7fc33d0b5640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc338109e30 0x7fc33819fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:57.305 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:57.286+0000 7fc33d0b5640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fc3381139f0 con 0x7fc338109e30 2024-09-21T01:41:57.305 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:57.286+0000 7fc33d0b5640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fc338113870 con 0x7fc338103ba0 2024-09-21T01:41:57.305 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:57.286+0000 7fc33d0b5640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fc338113b70 con 0x7fc3381094e0 2024-09-21T01:41:57.305 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:57.287+0000 7fc33759e640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc338109e30 0x7fc33819fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:57.305 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:57.287+0000 7fc33759e640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc338109e30 0x7fc33819fbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:60632/0 (socket says 172.21.15.83:60632) 2024-09-21T01:41:57.305 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:57.287+0000 7fc33759e640 1 -- 172.21.15.83:0/62058932 learned_addr learned my addr 172.21.15.83:0/62058932 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:41:57.305 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:57.287+0000 7fc33659c640 1 --2- 172.21.15.83:0/62058932 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc3381094e0 0x7fc33819a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:57.305 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:57.287+0000 7fc336d9d640 1 --2- 172.21.15.83:0/62058932 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc338103ba0 0x7fc33819a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:57.305 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:57.287+0000 7fc33759e640 1 -- 172.21.15.83:0/62058932 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc3381094e0 msgr2=0x7fc33819a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:57.305 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:57.287+0000 7fc33759e640 1 --2- 172.21.15.83:0/62058932 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc3381094e0 0x7fc33819a920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:57.305 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:57.287+0000 7fc33759e640 1 -- 172.21.15.83:0/62058932 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc338103ba0 msgr2=0x7fc33819a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:57.305 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:57.287+0000 7fc33759e640 1 --2- 172.21.15.83:0/62058932 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc338103ba0 0x7fc33819a380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:57.305 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:57.287+0000 7fc33759e640 1 -- 172.21.15.83:0/62058932 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3381a02f0 con 0x7fc338109e30 2024-09-21T01:41:57.305 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:57.287+0000 7fc33759e640 1 --2- 172.21.15.83:0/62058932 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc338109e30 0x7fc33819fbc0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fc330005cc0 tx=0x7fc330032a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:41:57.306 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:57.287+0000 7fc32ffff640 1 -- 172.21.15.83:0/62058932 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc330032e00 con 0x7fc338109e30 2024-09-21T01:41:57.306 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:57.287+0000 7fc33d0b5640 1 -- 172.21.15.83:0/62058932 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3381a0580 con 0x7fc338109e30 2024-09-21T01:41:57.306 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:57.287+0000 7fc32ffff640 1 -- 172.21.15.83:0/62058932 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc3300044d0 con 0x7fc338109e30 2024-09-21T01:41:57.306 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:57.287+0000 7fc32ffff640 1 -- 172.21.15.83:0/62058932 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc330030b70 con 0x7fc338109e30 2024-09-21T01:41:57.306 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:57.287+0000 7fc33d0b5640 1 -- 172.21.15.83:0/62058932 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3381a6d40 con 0x7fc338109e30 2024-09-21T01:41:57.306 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:57.289+0000 7fc33d0b5640 1 -- 172.21.15.83:0/62058932 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc338103fb0 con 0x7fc338109e30 2024-09-21T01:41:57.306 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:57.290+0000 7fc32ffff640 1 -- 172.21.15.83:0/62058932 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 22) ==== 154529+0+0 (secure 0 0 0) 0x7fc330030d10 con 0x7fc338109e30 2024-09-21T01:41:57.306 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:57.291+0000 7fc32ffff640 1 --2- 172.21.15.83:0/62058932 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fc3240b6560 0x7fc3240b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:57.306 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:57.291+0000 7fc336d9d640 1 --2- 172.21.15.83:0/62058932 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fc3240b6560 0x7fc3240b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:57.306 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:57.291+0000 7fc32ffff640 1 -- 172.21.15.83:0/62058932 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9315+0+0 (secure 0 0 0) 0x7fc330108c50 con 0x7fc338109e30 2024-09-21T01:41:57.306 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:57.292+0000 7fc336d9d640 1 --2- 172.21.15.83:0/62058932 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fc3240b6560 0x7fc3240b8a70 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fc320005fd0 tx=0x7fc320005850 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:41:57.306 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:57.295+0000 7fc32ffff640 1 -- 172.21.15.83:0/62058932 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc3300cf040 con 0x7fc338109e30 2024-09-21T01:41:57.472 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:57.472+0000 7fc33d0b5640 1 -- 172.21.15.83:0/62058932 --> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc338063800 con 0x7fc3240b6560 2024-09-21T01:41:57.478 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:57.478+0000 7fc32ffff640 1 -- 172.21.15.83:0/62058932 <== mgr.14223 v2:172.21.15.83:6800/1748483157 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340704 (secure 0 0 0) 0x7fc338063800 con 0x7fc3240b6560 2024-09-21T01:41:57.481 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T01:41:57.483 INFO:teuthology.orchestra.run.smithi083.stderr:dumped all 2024-09-21T01:41:57.485 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:57.481+0000 7fc33d0b5640 1 -- 172.21.15.83:0/62058932 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fc3240b6560 msgr2=0x7fc3240b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:57.485 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:57.481+0000 7fc33d0b5640 1 --2- 172.21.15.83:0/62058932 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fc3240b6560 0x7fc3240b8a70 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fc320005fd0 tx=0x7fc320005850 comp rx=0 tx=0).stop 2024-09-21T01:41:57.485 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:57.481+0000 7fc33d0b5640 1 -- 172.21.15.83:0/62058932 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc338109e30 msgr2=0x7fc33819fbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:57.485 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:57.481+0000 7fc33d0b5640 1 --2- 172.21.15.83:0/62058932 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc338109e30 0x7fc33819fbc0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fc330005cc0 tx=0x7fc330032a10 comp rx=0 tx=0).stop 2024-09-21T01:41:57.485 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:57.481+0000 7fc33d0b5640 1 -- 172.21.15.83:0/62058932 shutdown_connections 2024-09-21T01:41:57.485 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:57.481+0000 7fc33d0b5640 1 --2- 172.21.15.83:0/62058932 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fc3240b6560 0x7fc3240b8a70 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:57.485 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:57.481+0000 7fc33d0b5640 1 --2- 172.21.15.83:0/62058932 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc338109e30 0x7fc33819fbc0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:57.485 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:57.481+0000 7fc33d0b5640 1 --2- 172.21.15.83:0/62058932 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc3381094e0 0x7fc33819a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:57.485 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:57.481+0000 7fc33d0b5640 1 --2- 172.21.15.83:0/62058932 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc338103ba0 0x7fc33819a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:57.485 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:57.481+0000 7fc33d0b5640 1 -- 172.21.15.83:0/62058932 >> 172.21.15.83:0/62058932 conn(0x7fc3380ff630 msgr2=0x7fc338101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:41:57.485 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:57.482+0000 7fc33d0b5640 1 -- 172.21.15.83:0/62058932 shutdown_connections 2024-09-21T01:41:57.485 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:57.482+0000 7fc33d0b5640 1 -- 172.21.15.83:0/62058932 wait complete. 2024-09-21T01:41:58.134 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:41:57 smithi083 ceph-mon[31370]: from='client.15423 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:41:58.134 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:41:57 smithi083 ceph-mon[31370]: from='client.15429 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:41:58.134 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:41:57 smithi083 ceph-mon[31370]: pgmap v336: 129 pgs: 129 active+clean; 1.0 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 73 KiB/s wr, 10 op/s 2024-09-21T01:41:58.160 INFO:teuthology.orchestra.run.smithi083.stdout:{"pg_ready":true,"pg_map":{"version":336,"stamp":"2024-09-21T01:41:56.792832+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1053072,"num_objects":27,"num_object_clones":0,"num_object_copies":83,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":303,"num_read_kb":264,"num_write":283,"num_write_kb":3122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":727,"ondisk_log_size":727,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":368976,"kb_used_data":11400,"kb_used_omap":18,"kb_used_meta":357357,"kb_avail":1124572848,"statfs":{"total":1151940427776,"available":1151562596352,"internally_reserved":0,"allocated":11673600,"data_stored":9086910,"data_compressed":516964,"data_compressed_allocated":700416,"data_compressed_original":3883008,"omap_allocated":19139,"internal_metadata":365933885},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":393776,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":52,"num_read_kb":41,"num_write":70,"num_write_kb":872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003875"},"pg_stats":[{"pgid":"2.1f","version":"74'4","reported_seq":45,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:09.877493+0000","last_change":"2024-09-21T01:39:42.267244+0000","last_active":"2024-09-21T01:41:09.877493+0000","last_peered":"2024-09-21T01:41:09.877493+0000","last_clean":"2024-09-21T01:41:09.877493+0000","last_became_active":"2024-09-21T01:39:42.266786+0000","last_became_peered":"2024-09-21T01:39:42.266786+0000","last_unstale":"2024-09-21T01:41:09.877493+0000","last_undegraded":"2024-09-21T01:41:09.877493+0000","last_fullsized":"2024-09-21T01:41:09.877493+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:50:43.594150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"84'5","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.017571+0000","last_change":"2024-09-21T01:39:44.292808+0000","last_active":"2024-09-21T01:41:39.017571+0000","last_peered":"2024-09-21T01:41:39.017571+0000","last_clean":"2024-09-21T01:41:39.017571+0000","last_became_active":"2024-09-21T01:39:44.292416+0000","last_became_peered":"2024-09-21T01:39:44.292416+0000","last_unstale":"2024-09-21T01:41:39.017571+0000","last_undegraded":"2024-09-21T01:41:39.017571+0000","last_fullsized":"2024-09-21T01:41:39.017571+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:26:16.332353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:09.880685+0000","last_change":"2024-09-21T01:39:51.339117+0000","last_active":"2024-09-21T01:41:09.880685+0000","last_peered":"2024-09-21T01:41:09.880685+0000","last_clean":"2024-09-21T01:41:09.880685+0000","last_became_active":"2024-09-21T01:39:51.338467+0000","last_became_peered":"2024-09-21T01:39:51.338467+0000","last_unstale":"2024-09-21T01:41:09.880685+0000","last_undegraded":"2024-09-21T01:41:09.880685+0000","last_fullsized":"2024-09-21T01:41:09.880685+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:18:57.119730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"74'1","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.505280+0000","last_change":"2024-09-21T01:39:42.550130+0000","last_active":"2024-09-21T01:41:10.505280+0000","last_peered":"2024-09-21T01:41:10.505280+0000","last_clean":"2024-09-21T01:41:10.505280+0000","last_became_active":"2024-09-21T01:39:42.549676+0000","last_became_peered":"2024-09-21T01:39:42.549676+0000","last_unstale":"2024-09-21T01:41:10.505280+0000","last_undegraded":"2024-09-21T01:41:10.505280+0000","last_fullsized":"2024-09-21T01:41:10.505280+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:33:59.954738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"84'6","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.027338+0000","last_change":"2024-09-21T01:39:44.293860+0000","last_active":"2024-09-21T01:41:39.027338+0000","last_peered":"2024-09-21T01:41:39.027338+0000","last_clean":"2024-09-21T01:41:39.027338+0000","last_became_active":"2024-09-21T01:39:44.293490+0000","last_became_peered":"2024-09-21T01:39:44.293490+0000","last_unstale":"2024-09-21T01:41:39.027338+0000","last_undegraded":"2024-09-21T01:41:39.027338+0000","last_fullsized":"2024-09-21T01:41:39.027338+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:58:18.325647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.504013+0000","last_change":"2024-09-21T01:39:51.335826+0000","last_active":"2024-09-21T01:41:10.504013+0000","last_peered":"2024-09-21T01:41:10.504013+0000","last_clean":"2024-09-21T01:41:10.504013+0000","last_became_active":"2024-09-21T01:39:51.335346+0000","last_became_peered":"2024-09-21T01:39:51.335346+0000","last_unstale":"2024-09-21T01:41:10.504013+0000","last_undegraded":"2024-09-21T01:41:10.504013+0000","last_fullsized":"2024-09-21T01:41:10.504013+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:51:25.921336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"74'2","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.503563+0000","last_change":"2024-09-21T01:39:42.270594+0000","last_active":"2024-09-21T01:41:10.503563+0000","last_peered":"2024-09-21T01:41:10.503563+0000","last_clean":"2024-09-21T01:41:10.503563+0000","last_became_active":"2024-09-21T01:39:42.270138+0000","last_became_peered":"2024-09-21T01:39:42.270138+0000","last_unstale":"2024-09-21T01:41:10.503563+0000","last_undegraded":"2024-09-21T01:41:10.503563+0000","last_fullsized":"2024-09-21T01:41:10.503563+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:05:00.604343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"84'9","reported_seq":42,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.024710+0000","last_change":"2024-09-21T01:39:44.294397+0000","last_active":"2024-09-21T01:41:39.024710+0000","last_peered":"2024-09-21T01:41:39.024710+0000","last_clean":"2024-09-21T01:41:39.024710+0000","last_became_active":"2024-09-21T01:39:44.293992+0000","last_became_peered":"2024-09-21T01:39:44.293992+0000","last_unstale":"2024-09-21T01:41:39.024710+0000","last_undegraded":"2024-09-21T01:41:39.024710+0000","last_fullsized":"2024-09-21T01:41:39.024710+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:52:09.459167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.504060+0000","last_change":"2024-09-21T01:39:51.338546+0000","last_active":"2024-09-21T01:41:10.504060+0000","last_peered":"2024-09-21T01:41:10.504060+0000","last_clean":"2024-09-21T01:41:10.504060+0000","last_became_active":"2024-09-21T01:39:51.337850+0000","last_became_peered":"2024-09-21T01:39:51.337850+0000","last_unstale":"2024-09-21T01:41:10.504060+0000","last_undegraded":"2024-09-21T01:41:10.504060+0000","last_fullsized":"2024-09-21T01:41:10.504060+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:33:49.497520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"74'2","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.503562+0000","last_change":"2024-09-21T01:39:42.264214+0000","last_active":"2024-09-21T01:41:10.503562+0000","last_peered":"2024-09-21T01:41:10.503562+0000","last_clean":"2024-09-21T01:41:10.503562+0000","last_became_active":"2024-09-21T01:39:42.263782+0000","last_became_peered":"2024-09-21T01:39:42.263782+0000","last_unstale":"2024-09-21T01:41:10.503562+0000","last_undegraded":"2024-09-21T01:41:10.503562+0000","last_fullsized":"2024-09-21T01:41:10.503562+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:44:24.965078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"84'15","reported_seq":49,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.029147+0000","last_change":"2024-09-21T01:39:44.296579+0000","last_active":"2024-09-21T01:41:39.029147+0000","last_peered":"2024-09-21T01:41:39.029147+0000","last_clean":"2024-09-21T01:41:39.029147+0000","last_became_active":"2024-09-21T01:39:44.296175+0000","last_became_peered":"2024-09-21T01:39:44.296175+0000","last_unstale":"2024-09-21T01:41:39.029147+0000","last_undegraded":"2024-09-21T01:41:39.029147+0000","last_fullsized":"2024-09-21T01:41:39.029147+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:11:13.920000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.504011+0000","last_change":"2024-09-21T01:39:51.339046+0000","last_active":"2024-09-21T01:41:10.504011+0000","last_peered":"2024-09-21T01:41:10.504011+0000","last_clean":"2024-09-21T01:41:10.504011+0000","last_became_active":"2024-09-21T01:39:51.337379+0000","last_became_peered":"2024-09-21T01:39:51.337379+0000","last_unstale":"2024-09-21T01:41:10.504011+0000","last_undegraded":"2024-09-21T01:41:10.504011+0000","last_fullsized":"2024-09-21T01:41:10.504011+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:50:34.321615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"84'5","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.030815+0000","last_change":"2024-09-21T01:39:44.296849+0000","last_active":"2024-09-21T01:41:39.030815+0000","last_peered":"2024-09-21T01:41:39.030815+0000","last_clean":"2024-09-21T01:41:39.030815+0000","last_became_active":"2024-09-21T01:39:44.296460+0000","last_became_peered":"2024-09-21T01:39:44.296460+0000","last_unstale":"2024-09-21T01:41:39.030815+0000","last_undegraded":"2024-09-21T01:41:39.030815+0000","last_fullsized":"2024-09-21T01:41:39.030815+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:46:51.258576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"74'2","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.947238+0000","last_change":"2024-09-21T01:40:09.842127+0000","last_active":"2024-09-21T01:41:10.947238+0000","last_peered":"2024-09-21T01:41:10.947238+0000","last_clean":"2024-09-21T01:41:10.947238+0000","last_became_active":"2024-09-21T01:40:09.835330+0000","last_became_peered":"2024-09-21T01:40:09.835330+0000","last_unstale":"2024-09-21T01:41:10.947238+0000","last_undegraded":"2024-09-21T01:41:10.947238+0000","last_fullsized":"2024-09-21T01:41:10.947238+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:54:07.455805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.504140+0000","last_change":"2024-09-21T01:39:51.459595+0000","last_active":"2024-09-21T01:41:10.504140+0000","last_peered":"2024-09-21T01:41:10.504140+0000","last_clean":"2024-09-21T01:41:10.504140+0000","last_became_active":"2024-09-21T01:39:51.459137+0000","last_became_peered":"2024-09-21T01:39:51.459137+0000","last_unstale":"2024-09-21T01:41:10.504140+0000","last_undegraded":"2024-09-21T01:41:10.504140+0000","last_fullsized":"2024-09-21T01:41:10.504140+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:55:53.800615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"84'8","reported_seq":42,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.008399+0000","last_change":"2024-09-21T01:39:44.288328+0000","last_active":"2024-09-21T01:41:39.008399+0000","last_peered":"2024-09-21T01:41:39.008399+0000","last_clean":"2024-09-21T01:41:39.008399+0000","last_became_active":"2024-09-21T01:39:44.287994+0000","last_became_peered":"2024-09-21T01:39:44.287994+0000","last_unstale":"2024-09-21T01:41:39.008399+0000","last_undegraded":"2024-09-21T01:41:39.008399+0000","last_fullsized":"2024-09-21T01:41:39.008399+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:44:55.075693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:09.881129+0000","last_change":"2024-09-21T01:39:42.266271+0000","last_active":"2024-09-21T01:41:09.881129+0000","last_peered":"2024-09-21T01:41:09.881129+0000","last_clean":"2024-09-21T01:41:09.881129+0000","last_became_active":"2024-09-21T01:39:42.265904+0000","last_became_peered":"2024-09-21T01:39:42.265904+0000","last_unstale":"2024-09-21T01:41:09.881129+0000","last_undegraded":"2024-09-21T01:41:09.881129+0000","last_fullsized":"2024-09-21T01:41:09.881129+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:43:37.456263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"82'1","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.504229+0000","last_change":"2024-09-21T01:39:51.336649+0000","last_active":"2024-09-21T01:41:10.504229+0000","last_peered":"2024-09-21T01:41:10.504229+0000","last_clean":"2024-09-21T01:41:10.504229+0000","last_became_active":"2024-09-21T01:39:51.336153+0000","last_became_peered":"2024-09-21T01:39:51.336153+0000","last_unstale":"2024-09-21T01:41:10.504229+0000","last_undegraded":"2024-09-21T01:41:10.504229+0000","last_fullsized":"2024-09-21T01:41:10.504229+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:56:58.699051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"84'9","reported_seq":44,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.018381+0000","last_change":"2024-09-21T01:39:44.304919+0000","last_active":"2024-09-21T01:41:39.018381+0000","last_peered":"2024-09-21T01:41:39.018381+0000","last_clean":"2024-09-21T01:41:39.018381+0000","last_became_active":"2024-09-21T01:39:44.304509+0000","last_became_peered":"2024-09-21T01:39:44.304509+0000","last_unstale":"2024-09-21T01:41:39.018381+0000","last_undegraded":"2024-09-21T01:41:39.018381+0000","last_fullsized":"2024-09-21T01:41:39.018381+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:57:04.413151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.505571+0000","last_change":"2024-09-21T01:39:42.262536+0000","last_active":"2024-09-21T01:41:10.505571+0000","last_peered":"2024-09-21T01:41:10.505571+0000","last_clean":"2024-09-21T01:41:10.505571+0000","last_became_active":"2024-09-21T01:39:42.262179+0000","last_became_peered":"2024-09-21T01:39:42.262179+0000","last_unstale":"2024-09-21T01:41:10.505571+0000","last_undegraded":"2024-09-21T01:41:10.505571+0000","last_fullsized":"2024-09-21T01:41:10.505571+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:35:14.022839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:09.877283+0000","last_change":"2024-09-21T01:39:51.339664+0000","last_active":"2024-09-21T01:41:09.877283+0000","last_peered":"2024-09-21T01:41:09.877283+0000","last_clean":"2024-09-21T01:41:09.877283+0000","last_became_active":"2024-09-21T01:39:51.339140+0000","last_became_peered":"2024-09-21T01:39:51.339140+0000","last_unstale":"2024-09-21T01:41:09.877283+0000","last_undegraded":"2024-09-21T01:41:09.877283+0000","last_fullsized":"2024-09-21T01:41:09.877283+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:46:49.443937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"84'2","reported_seq":36,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:38.986836+0000","last_change":"2024-09-21T01:39:44.299174+0000","last_active":"2024-09-21T01:41:38.986836+0000","last_peered":"2024-09-21T01:41:38.986836+0000","last_clean":"2024-09-21T01:41:38.986836+0000","last_became_active":"2024-09-21T01:39:44.298778+0000","last_became_peered":"2024-09-21T01:39:44.298778+0000","last_unstale":"2024-09-21T01:41:38.986836+0000","last_undegraded":"2024-09-21T01:41:38.986836+0000","last_fullsized":"2024-09-21T01:41:38.986836+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:59:17.298726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:09.971718+0000","last_change":"2024-09-21T01:39:42.550521+0000","last_active":"2024-09-21T01:41:09.971718+0000","last_peered":"2024-09-21T01:41:09.971718+0000","last_clean":"2024-09-21T01:41:09.971718+0000","last_became_active":"2024-09-21T01:39:42.550210+0000","last_became_peered":"2024-09-21T01:39:42.550210+0000","last_unstale":"2024-09-21T01:41:09.971718+0000","last_undegraded":"2024-09-21T01:41:09.971718+0000","last_fullsized":"2024-09-21T01:41:09.971718+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:07:07.234815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.504302+0000","last_change":"2024-09-21T01:39:51.461448+0000","last_active":"2024-09-21T01:41:10.504302+0000","last_peered":"2024-09-21T01:41:10.504302+0000","last_clean":"2024-09-21T01:41:10.504302+0000","last_became_active":"2024-09-21T01:39:51.460790+0000","last_became_peered":"2024-09-21T01:39:51.460790+0000","last_unstale":"2024-09-21T01:41:10.504302+0000","last_undegraded":"2024-09-21T01:41:10.504302+0000","last_fullsized":"2024-09-21T01:41:10.504302+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:30:35.032588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"84'7","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.018465+0000","last_change":"2024-09-21T01:39:44.298697+0000","last_active":"2024-09-21T01:41:39.018465+0000","last_peered":"2024-09-21T01:41:39.018465+0000","last_clean":"2024-09-21T01:41:39.018465+0000","last_became_active":"2024-09-21T01:39:44.298333+0000","last_became_peered":"2024-09-21T01:39:44.298333+0000","last_unstale":"2024-09-21T01:41:39.018465+0000","last_undegraded":"2024-09-21T01:41:39.018465+0000","last_fullsized":"2024-09-21T01:41:39.018465+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:36:01.932630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"74'2","reported_seq":42,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.504712+0000","last_change":"2024-09-21T01:39:42.257383+0000","last_active":"2024-09-21T01:41:10.504712+0000","last_peered":"2024-09-21T01:41:10.504712+0000","last_clean":"2024-09-21T01:41:10.504712+0000","last_became_active":"2024-09-21T01:39:42.256896+0000","last_became_peered":"2024-09-21T01:39:42.256896+0000","last_unstale":"2024-09-21T01:41:10.504712+0000","last_undegraded":"2024-09-21T01:41:10.504712+0000","last_fullsized":"2024-09-21T01:41:10.504712+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:03:29.350623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:09.880899+0000","last_change":"2024-09-21T01:39:51.342055+0000","last_active":"2024-09-21T01:41:09.880899+0000","last_peered":"2024-09-21T01:41:09.880899+0000","last_clean":"2024-09-21T01:41:09.880899+0000","last_became_active":"2024-09-21T01:39:51.341602+0000","last_became_peered":"2024-09-21T01:39:51.341602+0000","last_unstale":"2024-09-21T01:41:09.880899+0000","last_undegraded":"2024-09-21T01:41:09.880899+0000","last_fullsized":"2024-09-21T01:41:09.880899+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:30:58.290018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"84'5","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.024216+0000","last_change":"2024-09-21T01:39:44.296725+0000","last_active":"2024-09-21T01:41:39.024216+0000","last_peered":"2024-09-21T01:41:39.024216+0000","last_clean":"2024-09-21T01:41:39.024216+0000","last_became_active":"2024-09-21T01:39:44.296411+0000","last_became_peered":"2024-09-21T01:39:44.296411+0000","last_unstale":"2024-09-21T01:41:39.024216+0000","last_undegraded":"2024-09-21T01:41:39.024216+0000","last_fullsized":"2024-09-21T01:41:39.024216+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:58:05.357486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"84'9","reported_seq":49,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.303877+0000","last_change":"2024-09-21T01:39:42.262831+0000","last_active":"2024-09-21T01:41:39.303877+0000","last_peered":"2024-09-21T01:41:39.303877+0000","last_clean":"2024-09-21T01:41:39.303877+0000","last_became_active":"2024-09-21T01:39:42.262462+0000","last_became_peered":"2024-09-21T01:39:42.262462+0000","last_unstale":"2024-09-21T01:41:39.303877+0000","last_undegraded":"2024-09-21T01:41:39.303877+0000","last_fullsized":"2024-09-21T01:41:39.303877+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:01:24.950607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.505262+0000","last_change":"2024-09-21T01:39:51.460620+0000","last_active":"2024-09-21T01:41:10.505262+0000","last_peered":"2024-09-21T01:41:10.505262+0000","last_clean":"2024-09-21T01:41:10.505262+0000","last_became_active":"2024-09-21T01:39:51.460052+0000","last_became_peered":"2024-09-21T01:39:51.460052+0000","last_unstale":"2024-09-21T01:41:10.505262+0000","last_undegraded":"2024-09-21T01:41:10.505262+0000","last_fullsized":"2024-09-21T01:41:10.505262+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:23:23.284102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"84'9","reported_seq":44,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:38.995410+0000","last_change":"2024-09-21T01:39:44.293129+0000","last_active":"2024-09-21T01:41:38.995410+0000","last_peered":"2024-09-21T01:41:38.995410+0000","last_clean":"2024-09-21T01:41:38.995410+0000","last_became_active":"2024-09-21T01:39:44.292799+0000","last_became_peered":"2024-09-21T01:39:44.292799+0000","last_unstale":"2024-09-21T01:41:38.995410+0000","last_undegraded":"2024-09-21T01:41:38.995410+0000","last_fullsized":"2024-09-21T01:41:38.995410+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:05:22.484632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.504453+0000","last_change":"2024-09-21T01:39:42.550724+0000","last_active":"2024-09-21T01:41:10.504453+0000","last_peered":"2024-09-21T01:41:10.504453+0000","last_clean":"2024-09-21T01:41:10.504453+0000","last_became_active":"2024-09-21T01:39:42.550334+0000","last_became_peered":"2024-09-21T01:39:42.550334+0000","last_unstale":"2024-09-21T01:41:10.504453+0000","last_undegraded":"2024-09-21T01:41:10.504453+0000","last_fullsized":"2024-09-21T01:41:10.504453+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:15:49.484663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.947380+0000","last_change":"2024-09-21T01:40:09.838305+0000","last_active":"2024-09-21T01:41:10.947380+0000","last_peered":"2024-09-21T01:41:10.947380+0000","last_clean":"2024-09-21T01:41:10.947380+0000","last_became_active":"2024-09-21T01:40:09.837734+0000","last_became_peered":"2024-09-21T01:40:09.837734+0000","last_unstale":"2024-09-21T01:41:10.947380+0000","last_undegraded":"2024-09-21T01:41:10.947380+0000","last_fullsized":"2024-09-21T01:41:10.947380+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:38:44.066723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,7,6],"acting":[11,8,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"84'4","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.011618+0000","last_change":"2024-09-21T01:39:44.292039+0000","last_active":"2024-09-21T01:41:39.011618+0000","last_peered":"2024-09-21T01:41:39.011618+0000","last_clean":"2024-09-21T01:41:39.011618+0000","last_became_active":"2024-09-21T01:39:44.291640+0000","last_became_peered":"2024-09-21T01:39:44.291640+0000","last_unstale":"2024-09-21T01:41:39.011618+0000","last_undegraded":"2024-09-21T01:41:39.011618+0000","last_fullsized":"2024-09-21T01:41:39.011618+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:24:59.891664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":47,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:09.877197+0000","last_change":"2024-09-21T01:40:10.063162+0000","last_active":"2024-09-21T01:41:09.877197+0000","last_peered":"2024-09-21T01:41:09.877197+0000","last_clean":"2024-09-21T01:41:09.877197+0000","last_became_active":"2024-09-21T01:40:10.062703+0000","last_became_peered":"2024-09-21T01:40:10.062703+0000","last_unstale":"2024-09-21T01:41:09.877197+0000","last_undegraded":"2024-09-21T01:41:09.877197+0000","last_fullsized":"2024-09-21T01:41:09.877197+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:32:04.933701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.504070+0000","last_change":"2024-09-21T01:39:51.460023+0000","last_active":"2024-09-21T01:41:10.504070+0000","last_peered":"2024-09-21T01:41:10.504070+0000","last_clean":"2024-09-21T01:41:10.504070+0000","last_became_active":"2024-09-21T01:39:51.459417+0000","last_became_peered":"2024-09-21T01:39:51.459417+0000","last_unstale":"2024-09-21T01:41:10.504070+0000","last_undegraded":"2024-09-21T01:41:10.504070+0000","last_fullsized":"2024-09-21T01:41:10.504070+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:54:24.301176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"84'7","reported_seq":42,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.007130+0000","last_change":"2024-09-21T01:39:44.295559+0000","last_active":"2024-09-21T01:41:39.007130+0000","last_peered":"2024-09-21T01:41:39.007130+0000","last_clean":"2024-09-21T01:41:39.007130+0000","last_became_active":"2024-09-21T01:39:44.294970+0000","last_became_peered":"2024-09-21T01:39:44.294970+0000","last_unstale":"2024-09-21T01:41:39.007130+0000","last_undegraded":"2024-09-21T01:41:39.007130+0000","last_fullsized":"2024-09-21T01:41:39.007130+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:46:16.582188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:09.878607+0000","last_change":"2024-09-21T01:39:42.269453+0000","last_active":"2024-09-21T01:41:09.878607+0000","last_peered":"2024-09-21T01:41:09.878607+0000","last_clean":"2024-09-21T01:41:09.878607+0000","last_became_active":"2024-09-21T01:39:42.269039+0000","last_became_peered":"2024-09-21T01:39:42.269039+0000","last_unstale":"2024-09-21T01:41:09.878607+0000","last_undegraded":"2024-09-21T01:41:09.878607+0000","last_fullsized":"2024-09-21T01:41:09.878607+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:47:29.053966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.504426+0000","last_change":"2024-09-21T01:39:51.337305+0000","last_active":"2024-09-21T01:41:10.504426+0000","last_peered":"2024-09-21T01:41:10.504426+0000","last_clean":"2024-09-21T01:41:10.504426+0000","last_became_active":"2024-09-21T01:39:51.336710+0000","last_became_peered":"2024-09-21T01:39:51.336710+0000","last_unstale":"2024-09-21T01:41:10.504426+0000","last_undegraded":"2024-09-21T01:41:10.504426+0000","last_fullsized":"2024-09-21T01:41:10.504426+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:13:42.333881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"84'8","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.019206+0000","last_change":"2024-09-21T01:39:44.297004+0000","last_active":"2024-09-21T01:41:39.019206+0000","last_peered":"2024-09-21T01:41:39.019206+0000","last_clean":"2024-09-21T01:41:39.019206+0000","last_became_active":"2024-09-21T01:39:44.296596+0000","last_became_peered":"2024-09-21T01:39:44.296596+0000","last_unstale":"2024-09-21T01:41:39.019206+0000","last_undegraded":"2024-09-21T01:41:39.019206+0000","last_fullsized":"2024-09-21T01:41:39.019206+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:14:32.542823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.503902+0000","last_change":"2024-09-21T01:39:42.550024+0000","last_active":"2024-09-21T01:41:10.503902+0000","last_peered":"2024-09-21T01:41:10.503902+0000","last_clean":"2024-09-21T01:41:10.503902+0000","last_became_active":"2024-09-21T01:39:42.549638+0000","last_became_peered":"2024-09-21T01:39:42.549638+0000","last_unstale":"2024-09-21T01:41:10.503902+0000","last_undegraded":"2024-09-21T01:41:10.503902+0000","last_fullsized":"2024-09-21T01:41:10.503902+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:23:39.210460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.505020+0000","last_change":"2024-09-21T01:39:51.459459+0000","last_active":"2024-09-21T01:41:10.505020+0000","last_peered":"2024-09-21T01:41:10.505020+0000","last_clean":"2024-09-21T01:41:10.505020+0000","last_became_active":"2024-09-21T01:39:51.459020+0000","last_became_peered":"2024-09-21T01:39:51.459020+0000","last_unstale":"2024-09-21T01:41:10.505020+0000","last_undegraded":"2024-09-21T01:41:10.505020+0000","last_fullsized":"2024-09-21T01:41:10.505020+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:50:08.337949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"84'5","reported_seq":47,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:38.995712+0000","last_change":"2024-09-21T01:40:09.833943+0000","last_active":"2024-09-21T01:41:38.995712+0000","last_peered":"2024-09-21T01:41:38.995712+0000","last_clean":"2024-09-21T01:41:38.995712+0000","last_became_active":"2024-09-21T01:40:09.833486+0000","last_became_peered":"2024-09-21T01:40:09.833486+0000","last_unstale":"2024-09-21T01:41:38.995712+0000","last_undegraded":"2024-09-21T01:41:38.995712+0000","last_fullsized":"2024-09-21T01:41:38.995712+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:26:52.751330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,2],"acting":[6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:09.878307+0000","last_change":"2024-09-21T01:39:42.267329+0000","last_active":"2024-09-21T01:41:09.878307+0000","last_peered":"2024-09-21T01:41:09.878307+0000","last_clean":"2024-09-21T01:41:09.878307+0000","last_became_active":"2024-09-21T01:39:42.266386+0000","last_became_peered":"2024-09-21T01:39:42.266386+0000","last_unstale":"2024-09-21T01:41:09.878307+0000","last_undegraded":"2024-09-21T01:41:09.878307+0000","last_fullsized":"2024-09-21T01:41:09.878307+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:31:20.877627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.044656+0000","last_change":"2024-09-21T01:39:51.461494+0000","last_active":"2024-09-21T01:41:10.044656+0000","last_peered":"2024-09-21T01:41:10.044656+0000","last_clean":"2024-09-21T01:41:10.044656+0000","last_became_active":"2024-09-21T01:39:51.460973+0000","last_became_peered":"2024-09-21T01:39:51.460973+0000","last_unstale":"2024-09-21T01:41:10.044656+0000","last_undegraded":"2024-09-21T01:41:10.044656+0000","last_fullsized":"2024-09-21T01:41:10.044656+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:09:50.319546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"84'8","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.027189+0000","last_change":"2024-09-21T01:39:44.300773+0000","last_active":"2024-09-21T01:41:39.027189+0000","last_peered":"2024-09-21T01:41:39.027189+0000","last_clean":"2024-09-21T01:41:39.027189+0000","last_became_active":"2024-09-21T01:39:44.300437+0000","last_became_peered":"2024-09-21T01:39:44.300437+0000","last_unstale":"2024-09-21T01:41:39.027189+0000","last_undegraded":"2024-09-21T01:41:39.027189+0000","last_fullsized":"2024-09-21T01:41:39.027189+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:06:34.171621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.503903+0000","last_change":"2024-09-21T01:39:42.262675+0000","last_active":"2024-09-21T01:41:10.503903+0000","last_peered":"2024-09-21T01:41:10.503903+0000","last_clean":"2024-09-21T01:41:10.503903+0000","last_became_active":"2024-09-21T01:39:42.262282+0000","last_became_peered":"2024-09-21T01:39:42.262282+0000","last_unstale":"2024-09-21T01:41:10.503903+0000","last_undegraded":"2024-09-21T01:41:10.503903+0000","last_fullsized":"2024-09-21T01:41:10.503903+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:26:01.595797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":114,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:09.878450+0000","last_change":"2024-09-21T01:38:31.172876+0000","last_active":"2024-09-21T01:41:09.878450+0000","last_peered":"2024-09-21T01:41:09.878450+0000","last_clean":"2024-09-21T01:41:09.878450+0000","last_became_active":"2024-09-21T01:38:31.167071+0000","last_became_peered":"2024-09-21T01:38:31.167071+0000","last_unstale":"2024-09-21T01:41:09.878450+0000","last_undegraded":"2024-09-21T01:41:09.878450+0000","last_fullsized":"2024-09-21T01:41:09.878450+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:35:07.475056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:35:07.475056+0000","last_clean_scrub_stamp":"2024-09-21T01:35:07.475056+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:56:01.878445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"82'1","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:09.878719+0000","last_change":"2024-09-21T01:39:51.338198+0000","last_active":"2024-09-21T01:41:09.878719+0000","last_peered":"2024-09-21T01:41:09.878719+0000","last_clean":"2024-09-21T01:41:09.878719+0000","last_became_active":"2024-09-21T01:39:51.337743+0000","last_became_peered":"2024-09-21T01:39:51.337743+0000","last_unstale":"2024-09-21T01:41:09.878719+0000","last_undegraded":"2024-09-21T01:41:09.878719+0000","last_fullsized":"2024-09-21T01:41:09.878719+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:19:45.552819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"84'7","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.030827+0000","last_change":"2024-09-21T01:39:44.298920+0000","last_active":"2024-09-21T01:41:39.030827+0000","last_peered":"2024-09-21T01:41:39.030827+0000","last_clean":"2024-09-21T01:41:39.030827+0000","last_became_active":"2024-09-21T01:39:44.298381+0000","last_became_peered":"2024-09-21T01:39:44.298381+0000","last_unstale":"2024-09-21T01:41:39.030827+0000","last_undegraded":"2024-09-21T01:41:39.030827+0000","last_fullsized":"2024-09-21T01:41:39.030827+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:12:53.681514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:09.881301+0000","last_change":"2024-09-21T01:39:42.550808+0000","last_active":"2024-09-21T01:41:09.881301+0000","last_peered":"2024-09-21T01:41:09.881301+0000","last_clean":"2024-09-21T01:41:09.881301+0000","last_became_active":"2024-09-21T01:39:42.550447+0000","last_became_peered":"2024-09-21T01:39:42.550447+0000","last_unstale":"2024-09-21T01:41:09.881301+0000","last_undegraded":"2024-09-21T01:41:09.881301+0000","last_fullsized":"2024-09-21T01:41:09.881301+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:20:56.996378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:09.971547+0000","last_change":"2024-09-21T01:39:51.338490+0000","last_active":"2024-09-21T01:41:09.971547+0000","last_peered":"2024-09-21T01:41:09.971547+0000","last_clean":"2024-09-21T01:41:09.971547+0000","last_became_active":"2024-09-21T01:39:51.338050+0000","last_became_peered":"2024-09-21T01:39:51.338050+0000","last_unstale":"2024-09-21T01:41:09.971547+0000","last_undegraded":"2024-09-21T01:41:09.971547+0000","last_fullsized":"2024-09-21T01:41:09.971547+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:49:56.705893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"84'6","reported_seq":47,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.021159+0000","last_change":"2024-09-21T01:41:10.045808+0000","last_active":"2024-09-21T01:41:39.021159+0000","last_peered":"2024-09-21T01:41:39.021159+0000","last_clean":"2024-09-21T01:41:39.021159+0000","last_became_active":"2024-09-21T01:41:10.045403+0000","last_became_peered":"2024-09-21T01:41:10.045403+0000","last_unstale":"2024-09-21T01:41:39.021159+0000","last_undegraded":"2024-09-21T01:41:39.021159+0000","last_fullsized":"2024-09-21T01:41:39.021159+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:15:46.067941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"84'60","reported_seq":130,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:56.430035+0000","last_change":"2024-09-21T01:39:42.270124+0000","last_active":"2024-09-21T01:41:56.430035+0000","last_peered":"2024-09-21T01:41:56.430035+0000","last_clean":"2024-09-21T01:41:56.430035+0000","last_became_active":"2024-09-21T01:39:42.269435+0000","last_became_peered":"2024-09-21T01:39:42.269435+0000","last_unstale":"2024-09-21T01:41:56.430035+0000","last_undegraded":"2024-09-21T01:41:56.430035+0000","last_fullsized":"2024-09-21T01:41:56.430035+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:12:08.374394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393846,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":33,"num_read_kb":32,"num_write":71,"num_write_kb":873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.504493+0000","last_change":"2024-09-21T01:39:51.334459+0000","last_active":"2024-09-21T01:41:10.504493+0000","last_peered":"2024-09-21T01:41:10.504493+0000","last_clean":"2024-09-21T01:41:10.504493+0000","last_became_active":"2024-09-21T01:39:51.334039+0000","last_became_peered":"2024-09-21T01:39:51.334039+0000","last_unstale":"2024-09-21T01:41:10.504493+0000","last_undegraded":"2024-09-21T01:41:10.504493+0000","last_fullsized":"2024-09-21T01:41:10.504493+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:04:44.906648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"84'9","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.023513+0000","last_change":"2024-09-21T01:39:44.298467+0000","last_active":"2024-09-21T01:41:39.023513+0000","last_peered":"2024-09-21T01:41:39.023513+0000","last_clean":"2024-09-21T01:41:39.023513+0000","last_became_active":"2024-09-21T01:39:44.298128+0000","last_became_peered":"2024-09-21T01:39:44.298128+0000","last_unstale":"2024-09-21T01:41:39.023513+0000","last_undegraded":"2024-09-21T01:41:39.023513+0000","last_fullsized":"2024-09-21T01:41:39.023513+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:54:11.096417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"74'2","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.503716+0000","last_change":"2024-09-21T01:39:42.262761+0000","last_active":"2024-09-21T01:41:10.503716+0000","last_peered":"2024-09-21T01:41:10.503716+0000","last_clean":"2024-09-21T01:41:10.503716+0000","last_became_active":"2024-09-21T01:39:42.262428+0000","last_became_peered":"2024-09-21T01:39:42.262428+0000","last_unstale":"2024-09-21T01:41:10.503716+0000","last_undegraded":"2024-09-21T01:41:10.503716+0000","last_fullsized":"2024-09-21T01:41:10.503716+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:11:50.326638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.043807+0000","last_change":"2024-09-21T01:39:51.344320+0000","last_active":"2024-09-21T01:41:10.043807+0000","last_peered":"2024-09-21T01:41:10.043807+0000","last_clean":"2024-09-21T01:41:10.043807+0000","last_became_active":"2024-09-21T01:39:51.343902+0000","last_became_peered":"2024-09-21T01:39:51.343902+0000","last_unstale":"2024-09-21T01:41:10.043807+0000","last_undegraded":"2024-09-21T01:41:10.043807+0000","last_fullsized":"2024-09-21T01:41:10.043807+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:13:36.139159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"84'5","reported_seq":46,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.007852+0000","last_change":"2024-09-21T01:40:09.837769+0000","last_active":"2024-09-21T01:41:39.007852+0000","last_peered":"2024-09-21T01:41:39.007852+0000","last_clean":"2024-09-21T01:41:39.007852+0000","last_became_active":"2024-09-21T01:40:09.837296+0000","last_became_peered":"2024-09-21T01:40:09.837296+0000","last_unstale":"2024-09-21T01:41:39.007852+0000","last_undegraded":"2024-09-21T01:41:39.007852+0000","last_fullsized":"2024-09-21T01:41:39.007852+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:37:20.360076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"74'1","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.503693+0000","last_change":"2024-09-21T01:39:42.264955+0000","last_active":"2024-09-21T01:41:10.503693+0000","last_peered":"2024-09-21T01:41:10.503693+0000","last_clean":"2024-09-21T01:41:10.503693+0000","last_became_active":"2024-09-21T01:39:42.264492+0000","last_became_peered":"2024-09-21T01:39:42.264492+0000","last_unstale":"2024-09-21T01:41:10.503693+0000","last_undegraded":"2024-09-21T01:41:10.503693+0000","last_fullsized":"2024-09-21T01:41:10.503693+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:17:38.631521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.044021+0000","last_change":"2024-09-21T01:39:51.337908+0000","last_active":"2024-09-21T01:41:10.044021+0000","last_peered":"2024-09-21T01:41:10.044021+0000","last_clean":"2024-09-21T01:41:10.044021+0000","last_became_active":"2024-09-21T01:39:51.337200+0000","last_became_peered":"2024-09-21T01:39:51.337200+0000","last_unstale":"2024-09-21T01:41:10.044021+0000","last_undegraded":"2024-09-21T01:41:10.044021+0000","last_fullsized":"2024-09-21T01:41:10.044021+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:07:18.505959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"84'6","reported_seq":47,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.027322+0000","last_change":"2024-09-21T01:40:10.063539+0000","last_active":"2024-09-21T01:41:39.027322+0000","last_peered":"2024-09-21T01:41:39.027322+0000","last_clean":"2024-09-21T01:41:39.027322+0000","last_became_active":"2024-09-21T01:40:10.062966+0000","last_became_peered":"2024-09-21T01:40:10.062966+0000","last_unstale":"2024-09-21T01:41:39.027322+0000","last_undegraded":"2024-09-21T01:41:39.027322+0000","last_fullsized":"2024-09-21T01:41:39.027322+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:53:20.747493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,1],"acting":[5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"74'8","reported_seq":47,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.503907+0000","last_change":"2024-09-21T01:39:42.550795+0000","last_active":"2024-09-21T01:41:10.503907+0000","last_peered":"2024-09-21T01:41:10.503907+0000","last_clean":"2024-09-21T01:41:10.503907+0000","last_became_active":"2024-09-21T01:39:42.550424+0000","last_became_peered":"2024-09-21T01:39:42.550424+0000","last_unstale":"2024-09-21T01:41:10.503907+0000","last_undegraded":"2024-09-21T01:41:10.503907+0000","last_fullsized":"2024-09-21T01:41:10.503907+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:50:53.421080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.504489+0000","last_change":"2024-09-21T01:39:51.335239+0000","last_active":"2024-09-21T01:41:10.504489+0000","last_peered":"2024-09-21T01:41:10.504489+0000","last_clean":"2024-09-21T01:41:10.504489+0000","last_became_active":"2024-09-21T01:39:51.334846+0000","last_became_peered":"2024-09-21T01:39:51.334846+0000","last_unstale":"2024-09-21T01:41:10.504489+0000","last_undegraded":"2024-09-21T01:41:10.504489+0000","last_fullsized":"2024-09-21T01:41:10.504489+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:47:30.820219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"84'6","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.023832+0000","last_change":"2024-09-21T01:39:44.296080+0000","last_active":"2024-09-21T01:41:39.023832+0000","last_peered":"2024-09-21T01:41:39.023832+0000","last_clean":"2024-09-21T01:41:39.023832+0000","last_became_active":"2024-09-21T01:39:44.295724+0000","last_became_peered":"2024-09-21T01:39:44.295724+0000","last_unstale":"2024-09-21T01:41:39.023832+0000","last_undegraded":"2024-09-21T01:41:39.023832+0000","last_fullsized":"2024-09-21T01:41:39.023832+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:20:56.366350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.503820+0000","last_change":"2024-09-21T01:39:42.264499+0000","last_active":"2024-09-21T01:41:10.503820+0000","last_peered":"2024-09-21T01:41:10.503820+0000","last_clean":"2024-09-21T01:41:10.503820+0000","last_became_active":"2024-09-21T01:39:42.264059+0000","last_became_peered":"2024-09-21T01:39:42.264059+0000","last_unstale":"2024-09-21T01:41:10.503820+0000","last_undegraded":"2024-09-21T01:41:10.503820+0000","last_fullsized":"2024-09-21T01:41:10.503820+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:27:42.970693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:09.877344+0000","last_change":"2024-09-21T01:39:51.329357+0000","last_active":"2024-09-21T01:41:09.877344+0000","last_peered":"2024-09-21T01:41:09.877344+0000","last_clean":"2024-09-21T01:41:09.877344+0000","last_became_active":"2024-09-21T01:39:51.328761+0000","last_became_peered":"2024-09-21T01:39:51.328761+0000","last_unstale":"2024-09-21T01:41:09.877344+0000","last_undegraded":"2024-09-21T01:41:09.877344+0000","last_fullsized":"2024-09-21T01:41:09.877344+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:48:04.089765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"84'15","reported_seq":49,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.025370+0000","last_change":"2024-09-21T01:39:44.295799+0000","last_active":"2024-09-21T01:41:39.025370+0000","last_peered":"2024-09-21T01:41:39.025370+0000","last_clean":"2024-09-21T01:41:39.025370+0000","last_became_active":"2024-09-21T01:39:44.295432+0000","last_became_peered":"2024-09-21T01:39:44.295432+0000","last_unstale":"2024-09-21T01:41:39.025370+0000","last_undegraded":"2024-09-21T01:41:39.025370+0000","last_fullsized":"2024-09-21T01:41:39.025370+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:18:10.702545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.044394+0000","last_change":"2024-09-21T01:39:42.270552+0000","last_active":"2024-09-21T01:41:10.044394+0000","last_peered":"2024-09-21T01:41:10.044394+0000","last_clean":"2024-09-21T01:41:10.044394+0000","last_became_active":"2024-09-21T01:39:42.270158+0000","last_became_peered":"2024-09-21T01:39:42.270158+0000","last_unstale":"2024-09-21T01:41:10.044394+0000","last_undegraded":"2024-09-21T01:41:10.044394+0000","last_fullsized":"2024-09-21T01:41:10.044394+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:19:52.229598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.947461+0000","last_change":"2024-09-21T01:39:51.335823+0000","last_active":"2024-09-21T01:41:10.947461+0000","last_peered":"2024-09-21T01:41:10.947461+0000","last_clean":"2024-09-21T01:41:10.947461+0000","last_became_active":"2024-09-21T01:39:51.335363+0000","last_became_peered":"2024-09-21T01:39:51.335363+0000","last_unstale":"2024-09-21T01:41:10.947461+0000","last_undegraded":"2024-09-21T01:41:10.947461+0000","last_fullsized":"2024-09-21T01:41:10.947461+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:33:01.418708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"84'9","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.022001+0000","last_change":"2024-09-21T01:39:44.288963+0000","last_active":"2024-09-21T01:41:39.022001+0000","last_peered":"2024-09-21T01:41:39.022001+0000","last_clean":"2024-09-21T01:41:39.022001+0000","last_became_active":"2024-09-21T01:39:44.286967+0000","last_became_peered":"2024-09-21T01:39:44.286967+0000","last_unstale":"2024-09-21T01:41:39.022001+0000","last_undegraded":"2024-09-21T01:41:39.022001+0000","last_fullsized":"2024-09-21T01:41:39.022001+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:02:32.653351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"74'2","reported_seq":42,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:09.881149+0000","last_change":"2024-09-21T01:39:42.268553+0000","last_active":"2024-09-21T01:41:09.881149+0000","last_peered":"2024-09-21T01:41:09.881149+0000","last_clean":"2024-09-21T01:41:09.881149+0000","last_became_active":"2024-09-21T01:39:42.268154+0000","last_became_peered":"2024-09-21T01:39:42.268154+0000","last_unstale":"2024-09-21T01:41:09.881149+0000","last_undegraded":"2024-09-21T01:41:09.881149+0000","last_fullsized":"2024-09-21T01:41:09.881149+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:22:54.223718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.044472+0000","last_change":"2024-09-21T01:39:51.342268+0000","last_active":"2024-09-21T01:41:10.044472+0000","last_peered":"2024-09-21T01:41:10.044472+0000","last_clean":"2024-09-21T01:41:10.044472+0000","last_became_active":"2024-09-21T01:39:51.341221+0000","last_became_peered":"2024-09-21T01:39:51.341221+0000","last_unstale":"2024-09-21T01:41:10.044472+0000","last_undegraded":"2024-09-21T01:41:10.044472+0000","last_fullsized":"2024-09-21T01:41:10.044472+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:46:16.297124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"84'6","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.022766+0000","last_change":"2024-09-21T01:39:44.300338+0000","last_active":"2024-09-21T01:41:39.022766+0000","last_peered":"2024-09-21T01:41:39.022766+0000","last_clean":"2024-09-21T01:41:39.022766+0000","last_became_active":"2024-09-21T01:39:44.299920+0000","last_became_peered":"2024-09-21T01:39:44.299920+0000","last_unstale":"2024-09-21T01:41:39.022766+0000","last_undegraded":"2024-09-21T01:41:39.022766+0000","last_fullsized":"2024-09-21T01:41:39.022766+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:23:47.631867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"84'33","reported_seq":256,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:53.118649+0000","last_change":"2024-09-21T01:39:42.266883+0000","last_active":"2024-09-21T01:41:53.118649+0000","last_peered":"2024-09-21T01:41:53.118649+0000","last_clean":"2024-09-21T01:41:53.118649+0000","last_became_active":"2024-09-21T01:39:42.266494+0000","last_became_peered":"2024-09-21T01:39:42.266494+0000","last_unstale":"2024-09-21T01:41:53.118649+0000","last_undegraded":"2024-09-21T01:41:53.118649+0000","last_fullsized":"2024-09-21T01:41:53.118649+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:56:46.777522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67896,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":184,"num_read_kb":158,"num_write":33,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.040673+0000","last_change":"2024-09-21T01:40:09.842036+0000","last_active":"2024-09-21T01:41:10.040673+0000","last_peered":"2024-09-21T01:41:10.040673+0000","last_clean":"2024-09-21T01:41:10.040673+0000","last_became_active":"2024-09-21T01:40:09.841680+0000","last_became_peered":"2024-09-21T01:40:09.841680+0000","last_unstale":"2024-09-21T01:41:10.040673+0000","last_undegraded":"2024-09-21T01:41:10.040673+0000","last_fullsized":"2024-09-21T01:41:10.040673+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:01:58.366511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,11,5],"acting":[10,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.14","version":"84'11","reported_seq":44,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.030064+0000","last_change":"2024-09-21T01:39:44.296958+0000","last_active":"2024-09-21T01:41:39.030064+0000","last_peered":"2024-09-21T01:41:39.030064+0000","last_clean":"2024-09-21T01:41:39.030064+0000","last_became_active":"2024-09-21T01:39:44.296588+0000","last_became_peered":"2024-09-21T01:39:44.296588+0000","last_unstale":"2024-09-21T01:41:39.030064+0000","last_undegraded":"2024-09-21T01:41:39.030064+0000","last_fullsized":"2024-09-21T01:41:39.030064+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:04:25.222279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"74'3","reported_seq":42,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.044764+0000","last_change":"2024-09-21T01:39:42.550770+0000","last_active":"2024-09-21T01:41:10.044764+0000","last_peered":"2024-09-21T01:41:10.044764+0000","last_clean":"2024-09-21T01:41:10.044764+0000","last_became_active":"2024-09-21T01:39:42.550317+0000","last_became_peered":"2024-09-21T01:39:42.550317+0000","last_unstale":"2024-09-21T01:41:10.044764+0000","last_undegraded":"2024-09-21T01:41:10.044764+0000","last_fullsized":"2024-09-21T01:41:10.044764+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:11:05.269317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.504279+0000","last_change":"2024-09-21T01:39:51.342166+0000","last_active":"2024-09-21T01:41:10.504279+0000","last_peered":"2024-09-21T01:41:10.504279+0000","last_clean":"2024-09-21T01:41:10.504279+0000","last_became_active":"2024-09-21T01:39:51.341633+0000","last_became_peered":"2024-09-21T01:39:51.341633+0000","last_unstale":"2024-09-21T01:41:10.504279+0000","last_undegraded":"2024-09-21T01:41:10.504279+0000","last_fullsized":"2024-09-21T01:41:10.504279+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:47:13.524123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"84'9","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.016737+0000","last_change":"2024-09-21T01:39:44.297652+0000","last_active":"2024-09-21T01:41:39.016737+0000","last_peered":"2024-09-21T01:41:39.016737+0000","last_clean":"2024-09-21T01:41:39.016737+0000","last_became_active":"2024-09-21T01:39:44.297289+0000","last_became_peered":"2024-09-21T01:39:44.297289+0000","last_unstale":"2024-09-21T01:41:39.016737+0000","last_undegraded":"2024-09-21T01:41:39.016737+0000","last_fullsized":"2024-09-21T01:41:39.016737+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:14:52.834492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:09.878796+0000","last_change":"2024-09-21T01:39:42.269881+0000","last_active":"2024-09-21T01:41:09.878796+0000","last_peered":"2024-09-21T01:41:09.878796+0000","last_clean":"2024-09-21T01:41:09.878796+0000","last_became_active":"2024-09-21T01:39:42.269498+0000","last_became_peered":"2024-09-21T01:39:42.269498+0000","last_unstale":"2024-09-21T01:41:09.878796+0000","last_undegraded":"2024-09-21T01:41:09.878796+0000","last_fullsized":"2024-09-21T01:41:09.878796+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:10:31.750792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.503690+0000","last_change":"2024-09-21T01:40:10.063827+0000","last_active":"2024-09-21T01:41:10.503690+0000","last_peered":"2024-09-21T01:41:10.503690+0000","last_clean":"2024-09-21T01:41:10.503690+0000","last_became_active":"2024-09-21T01:40:10.063206+0000","last_became_peered":"2024-09-21T01:40:10.063206+0000","last_unstale":"2024-09-21T01:41:10.503690+0000","last_undegraded":"2024-09-21T01:41:10.503690+0000","last_fullsized":"2024-09-21T01:41:10.503690+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:33:28.905812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2,4],"acting":[8,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.16","version":"84'10","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.027736+0000","last_change":"2024-09-21T01:39:44.292241+0000","last_active":"2024-09-21T01:41:39.027736+0000","last_peered":"2024-09-21T01:41:39.027736+0000","last_clean":"2024-09-21T01:41:39.027736+0000","last_became_active":"2024-09-21T01:39:44.291808+0000","last_became_peered":"2024-09-21T01:39:44.291808+0000","last_unstale":"2024-09-21T01:41:39.027736+0000","last_undegraded":"2024-09-21T01:41:39.027736+0000","last_fullsized":"2024-09-21T01:41:39.027736+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:47:24.761137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.041221+0000","last_change":"2024-09-21T01:39:42.272047+0000","last_active":"2024-09-21T01:41:10.041221+0000","last_peered":"2024-09-21T01:41:10.041221+0000","last_clean":"2024-09-21T01:41:10.041221+0000","last_became_active":"2024-09-21T01:39:42.271668+0000","last_became_peered":"2024-09-21T01:39:42.271668+0000","last_unstale":"2024-09-21T01:41:10.041221+0000","last_undegraded":"2024-09-21T01:41:10.041221+0000","last_fullsized":"2024-09-21T01:41:10.041221+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:44:09.702328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.505772+0000","last_change":"2024-09-21T01:39:51.337760+0000","last_active":"2024-09-21T01:41:10.505772+0000","last_peered":"2024-09-21T01:41:10.505772+0000","last_clean":"2024-09-21T01:41:10.505772+0000","last_became_active":"2024-09-21T01:39:51.337337+0000","last_became_peered":"2024-09-21T01:39:51.337337+0000","last_unstale":"2024-09-21T01:41:10.505772+0000","last_undegraded":"2024-09-21T01:41:10.505772+0000","last_fullsized":"2024-09-21T01:41:10.505772+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:33:49.316833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.503794+0000","last_change":"2024-09-21T01:39:51.334722+0000","last_active":"2024-09-21T01:41:10.503794+0000","last_peered":"2024-09-21T01:41:10.503794+0000","last_clean":"2024-09-21T01:41:10.503794+0000","last_became_active":"2024-09-21T01:39:51.334318+0000","last_became_peered":"2024-09-21T01:39:51.334318+0000","last_unstale":"2024-09-21T01:41:10.503794+0000","last_undegraded":"2024-09-21T01:41:10.503794+0000","last_fullsized":"2024-09-21T01:41:10.503794+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:29:17.625223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"84'11","reported_seq":45,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.006715+0000","last_change":"2024-09-21T01:39:44.283183+0000","last_active":"2024-09-21T01:41:39.006715+0000","last_peered":"2024-09-21T01:41:39.006715+0000","last_clean":"2024-09-21T01:41:39.006715+0000","last_became_active":"2024-09-21T01:39:44.282829+0000","last_became_peered":"2024-09-21T01:39:44.282829+0000","last_unstale":"2024-09-21T01:41:39.006715+0000","last_undegraded":"2024-09-21T01:41:39.006715+0000","last_fullsized":"2024-09-21T01:41:39.006715+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:31:43.602584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.044143+0000","last_change":"2024-09-21T01:39:42.267465+0000","last_active":"2024-09-21T01:41:10.044143+0000","last_peered":"2024-09-21T01:41:10.044143+0000","last_clean":"2024-09-21T01:41:10.044143+0000","last_became_active":"2024-09-21T01:39:42.267051+0000","last_became_peered":"2024-09-21T01:39:42.267051+0000","last_unstale":"2024-09-21T01:41:10.044143+0000","last_undegraded":"2024-09-21T01:41:10.044143+0000","last_fullsized":"2024-09-21T01:41:10.044143+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:17:30.917284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.947577+0000","last_change":"2024-09-21T01:39:51.338907+0000","last_active":"2024-09-21T01:41:10.947577+0000","last_peered":"2024-09-21T01:41:10.947577+0000","last_clean":"2024-09-21T01:41:10.947577+0000","last_became_active":"2024-09-21T01:39:51.338444+0000","last_became_peered":"2024-09-21T01:39:51.338444+0000","last_unstale":"2024-09-21T01:41:10.947577+0000","last_undegraded":"2024-09-21T01:41:10.947577+0000","last_fullsized":"2024-09-21T01:41:10.947577+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:35:44.819976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"84'8","reported_seq":42,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.015629+0000","last_change":"2024-09-21T01:39:44.293735+0000","last_active":"2024-09-21T01:41:39.015629+0000","last_peered":"2024-09-21T01:41:39.015629+0000","last_clean":"2024-09-21T01:41:39.015629+0000","last_became_active":"2024-09-21T01:39:44.293371+0000","last_became_peered":"2024-09-21T01:39:44.293371+0000","last_unstale":"2024-09-21T01:41:39.015629+0000","last_undegraded":"2024-09-21T01:41:39.015629+0000","last_fullsized":"2024-09-21T01:41:39.015629+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:50:50.404018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.503564+0000","last_change":"2024-09-21T01:39:42.259012+0000","last_active":"2024-09-21T01:41:10.503564+0000","last_peered":"2024-09-21T01:41:10.503564+0000","last_clean":"2024-09-21T01:41:10.503564+0000","last_became_active":"2024-09-21T01:39:42.258665+0000","last_became_peered":"2024-09-21T01:39:42.258665+0000","last_unstale":"2024-09-21T01:41:10.503564+0000","last_undegraded":"2024-09-21T01:41:10.503564+0000","last_fullsized":"2024-09-21T01:41:10.503564+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:25:24.797505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"74'1","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.040907+0000","last_change":"2024-09-21T01:39:42.270969+0000","last_active":"2024-09-21T01:41:10.040907+0000","last_peered":"2024-09-21T01:41:10.040907+0000","last_clean":"2024-09-21T01:41:10.040907+0000","last_became_active":"2024-09-21T01:39:42.270629+0000","last_became_peered":"2024-09-21T01:39:42.270629+0000","last_unstale":"2024-09-21T01:41:10.040907+0000","last_undegraded":"2024-09-21T01:41:10.040907+0000","last_fullsized":"2024-09-21T01:41:10.040907+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:30:06.321196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"84'8","reported_seq":42,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.019197+0000","last_change":"2024-09-21T01:39:44.297656+0000","last_active":"2024-09-21T01:41:39.019197+0000","last_peered":"2024-09-21T01:41:39.019197+0000","last_clean":"2024-09-21T01:41:39.019197+0000","last_became_active":"2024-09-21T01:39:44.297273+0000","last_became_peered":"2024-09-21T01:39:44.297273+0000","last_unstale":"2024-09-21T01:41:39.019197+0000","last_undegraded":"2024-09-21T01:41:39.019197+0000","last_fullsized":"2024-09-21T01:41:39.019197+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:35:24.645472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:09.881207+0000","last_change":"2024-09-21T01:40:09.842397+0000","last_active":"2024-09-21T01:41:09.881207+0000","last_peered":"2024-09-21T01:41:09.881207+0000","last_clean":"2024-09-21T01:41:09.881207+0000","last_became_active":"2024-09-21T01:40:09.841934+0000","last_became_peered":"2024-09-21T01:40:09.841934+0000","last_unstale":"2024-09-21T01:41:09.881207+0000","last_undegraded":"2024-09-21T01:41:09.881207+0000","last_fullsized":"2024-09-21T01:41:09.881207+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:06:36.189594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,8,5],"acting":[2,6,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"74'1","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.044389+0000","last_change":"2024-09-21T01:39:42.267207+0000","last_active":"2024-09-21T01:41:10.044389+0000","last_peered":"2024-09-21T01:41:10.044389+0000","last_clean":"2024-09-21T01:41:10.044389+0000","last_became_active":"2024-09-21T01:39:42.266829+0000","last_became_peered":"2024-09-21T01:39:42.266829+0000","last_unstale":"2024-09-21T01:41:10.044389+0000","last_undegraded":"2024-09-21T01:41:10.044389+0000","last_fullsized":"2024-09-21T01:41:10.044389+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:03:18.047546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"84'7","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.011573+0000","last_change":"2024-09-21T01:39:44.305545+0000","last_active":"2024-09-21T01:41:39.011573+0000","last_peered":"2024-09-21T01:41:39.011573+0000","last_clean":"2024-09-21T01:41:39.011573+0000","last_became_active":"2024-09-21T01:39:44.305195+0000","last_became_peered":"2024-09-21T01:39:44.305195+0000","last_unstale":"2024-09-21T01:41:39.011573+0000","last_undegraded":"2024-09-21T01:41:39.011573+0000","last_fullsized":"2024-09-21T01:41:39.011573+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:26:50.011622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:09.881130+0000","last_change":"2024-09-21T01:39:51.342132+0000","last_active":"2024-09-21T01:41:09.881130+0000","last_peered":"2024-09-21T01:41:09.881130+0000","last_clean":"2024-09-21T01:41:09.881130+0000","last_became_active":"2024-09-21T01:39:51.341668+0000","last_became_peered":"2024-09-21T01:39:51.341668+0000","last_unstale":"2024-09-21T01:41:09.881130+0000","last_undegraded":"2024-09-21T01:41:09.881130+0000","last_fullsized":"2024-09-21T01:41:09.881130+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:28:18.119259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"84'9","reported_seq":44,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.018291+0000","last_change":"2024-09-21T01:39:44.300226+0000","last_active":"2024-09-21T01:41:39.018291+0000","last_peered":"2024-09-21T01:41:39.018291+0000","last_clean":"2024-09-21T01:41:39.018291+0000","last_became_active":"2024-09-21T01:39:44.298740+0000","last_became_peered":"2024-09-21T01:39:44.298740+0000","last_unstale":"2024-09-21T01:41:39.018291+0000","last_undegraded":"2024-09-21T01:41:39.018291+0000","last_fullsized":"2024-09-21T01:41:39.018291+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:05:33.288070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"84'12","reported_seq":47,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.019746+0000","last_change":"2024-09-21T01:39:44.301379+0000","last_active":"2024-09-21T01:41:39.019746+0000","last_peered":"2024-09-21T01:41:39.019746+0000","last_clean":"2024-09-21T01:41:39.019746+0000","last_became_active":"2024-09-21T01:39:44.301011+0000","last_became_peered":"2024-09-21T01:39:44.301011+0000","last_unstale":"2024-09-21T01:41:39.019746+0000","last_undegraded":"2024-09-21T01:41:39.019746+0000","last_fullsized":"2024-09-21T01:41:39.019746+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:16:47.672736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"84'8","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.009440+0000","last_change":"2024-09-21T01:39:44.294318+0000","last_active":"2024-09-21T01:41:39.009440+0000","last_peered":"2024-09-21T01:41:39.009440+0000","last_clean":"2024-09-21T01:41:39.009440+0000","last_became_active":"2024-09-21T01:39:44.293941+0000","last_became_peered":"2024-09-21T01:39:44.293941+0000","last_unstale":"2024-09-21T01:41:39.009440+0000","last_undegraded":"2024-09-21T01:41:39.009440+0000","last_fullsized":"2024-09-21T01:41:39.009440+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:27:34.776088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"84'7","reported_seq":42,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.017627+0000","last_change":"2024-09-21T01:39:44.287815+0000","last_active":"2024-09-21T01:41:39.017627+0000","last_peered":"2024-09-21T01:41:39.017627+0000","last_clean":"2024-09-21T01:41:39.017627+0000","last_became_active":"2024-09-21T01:39:44.287471+0000","last_became_peered":"2024-09-21T01:39:44.287471+0000","last_unstale":"2024-09-21T01:41:39.017627+0000","last_undegraded":"2024-09-21T01:41:39.017627+0000","last_fullsized":"2024-09-21T01:41:39.017627+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:13:59.661464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"84'4","reported_seq":38,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.016316+0000","last_change":"2024-09-21T01:39:44.285591+0000","last_active":"2024-09-21T01:41:39.016316+0000","last_peered":"2024-09-21T01:41:39.016316+0000","last_clean":"2024-09-21T01:41:39.016316+0000","last_became_active":"2024-09-21T01:39:44.285253+0000","last_became_peered":"2024-09-21T01:39:44.285253+0000","last_unstale":"2024-09-21T01:41:39.016316+0000","last_undegraded":"2024-09-21T01:41:39.016316+0000","last_fullsized":"2024-09-21T01:41:39.016316+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:58:02.890685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"84'6","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.008718+0000","last_change":"2024-09-21T01:39:44.306547+0000","last_active":"2024-09-21T01:41:39.008718+0000","last_peered":"2024-09-21T01:41:39.008718+0000","last_clean":"2024-09-21T01:41:39.008718+0000","last_became_active":"2024-09-21T01:39:44.306116+0000","last_became_peered":"2024-09-21T01:39:44.306116+0000","last_unstale":"2024-09-21T01:41:39.008718+0000","last_undegraded":"2024-09-21T01:41:39.008718+0000","last_fullsized":"2024-09-21T01:41:39.008718+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:58:40.654784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"84'15","reported_seq":50,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.027813+0000","last_change":"2024-09-21T01:39:44.295317+0000","last_active":"2024-09-21T01:41:39.027813+0000","last_peered":"2024-09-21T01:41:39.027813+0000","last_clean":"2024-09-21T01:41:39.027813+0000","last_became_active":"2024-09-21T01:39:44.294936+0000","last_became_peered":"2024-09-21T01:39:44.294936+0000","last_unstale":"2024-09-21T01:41:39.027813+0000","last_undegraded":"2024-09-21T01:41:39.027813+0000","last_fullsized":"2024-09-21T01:41:39.027813+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:32:24.112588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"84'2","reported_seq":37,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.004826+0000","last_change":"2024-09-21T01:39:44.297242+0000","last_active":"2024-09-21T01:41:39.004826+0000","last_peered":"2024-09-21T01:41:39.004826+0000","last_clean":"2024-09-21T01:41:39.004826+0000","last_became_active":"2024-09-21T01:39:44.296072+0000","last_became_peered":"2024-09-21T01:39:44.296072+0000","last_unstale":"2024-09-21T01:41:39.004826+0000","last_undegraded":"2024-09-21T01:41:39.004826+0000","last_fullsized":"2024-09-21T01:41:39.004826+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:22:23.449535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"84'6","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.018645+0000","last_change":"2024-09-21T01:39:44.293899+0000","last_active":"2024-09-21T01:41:39.018645+0000","last_peered":"2024-09-21T01:41:39.018645+0000","last_clean":"2024-09-21T01:41:39.018645+0000","last_became_active":"2024-09-21T01:39:44.293502+0000","last_became_peered":"2024-09-21T01:39:44.293502+0000","last_unstale":"2024-09-21T01:41:39.018645+0000","last_undegraded":"2024-09-21T01:41:39.018645+0000","last_fullsized":"2024-09-21T01:41:39.018645+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:07:39.549931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"84'8","reported_seq":42,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.012852+0000","last_change":"2024-09-21T01:39:44.298192+0000","last_active":"2024-09-21T01:41:39.012852+0000","last_peered":"2024-09-21T01:41:39.012852+0000","last_clean":"2024-09-21T01:41:39.012852+0000","last_became_active":"2024-09-21T01:39:44.297834+0000","last_became_peered":"2024-09-21T01:39:44.297834+0000","last_unstale":"2024-09-21T01:41:39.012852+0000","last_undegraded":"2024-09-21T01:41:39.012852+0000","last_fullsized":"2024-09-21T01:41:39.012852+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:41:21.759972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"84'10","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.031026+0000","last_change":"2024-09-21T01:39:44.300125+0000","last_active":"2024-09-21T01:41:39.031026+0000","last_peered":"2024-09-21T01:41:39.031026+0000","last_clean":"2024-09-21T01:41:39.031026+0000","last_became_active":"2024-09-21T01:39:44.298047+0000","last_became_peered":"2024-09-21T01:39:44.298047+0000","last_unstale":"2024-09-21T01:41:39.031026+0000","last_undegraded":"2024-09-21T01:41:39.031026+0000","last_fullsized":"2024-09-21T01:41:39.031026+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:31:58.719520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"84'11","reported_seq":45,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.018117+0000","last_change":"2024-09-21T01:39:44.287346+0000","last_active":"2024-09-21T01:41:39.018117+0000","last_peered":"2024-09-21T01:41:39.018117+0000","last_clean":"2024-09-21T01:41:39.018117+0000","last_became_active":"2024-09-21T01:39:44.286999+0000","last_became_peered":"2024-09-21T01:39:44.286999+0000","last_unstale":"2024-09-21T01:41:39.018117+0000","last_undegraded":"2024-09-21T01:41:39.018117+0000","last_fullsized":"2024-09-21T01:41:39.018117+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:42:26.732516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"84'8","reported_seq":42,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.021318+0000","last_change":"2024-09-21T01:39:44.299083+0000","last_active":"2024-09-21T01:41:39.021318+0000","last_peered":"2024-09-21T01:41:39.021318+0000","last_clean":"2024-09-21T01:41:39.021318+0000","last_became_active":"2024-09-21T01:39:44.298194+0000","last_became_peered":"2024-09-21T01:39:44.298194+0000","last_unstale":"2024-09-21T01:41:39.021318+0000","last_undegraded":"2024-09-21T01:41:39.021318+0000","last_fullsized":"2024-09-21T01:41:39.021318+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:22:23.360519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"84'7","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.004792+0000","last_change":"2024-09-21T01:39:44.292985+0000","last_active":"2024-09-21T01:41:39.004792+0000","last_peered":"2024-09-21T01:41:39.004792+0000","last_clean":"2024-09-21T01:41:39.004792+0000","last_became_active":"2024-09-21T01:39:44.292565+0000","last_became_peered":"2024-09-21T01:39:44.292565+0000","last_unstale":"2024-09-21T01:41:39.004792+0000","last_undegraded":"2024-09-21T01:41:39.004792+0000","last_fullsized":"2024-09-21T01:41:39.004792+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:03:33.563458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"84'10","reported_seq":44,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.026635+0000","last_change":"2024-09-21T01:39:44.291522+0000","last_active":"2024-09-21T01:41:39.026635+0000","last_peered":"2024-09-21T01:41:39.026635+0000","last_clean":"2024-09-21T01:41:39.026635+0000","last_became_active":"2024-09-21T01:39:44.291173+0000","last_became_peered":"2024-09-21T01:39:44.291173+0000","last_unstale":"2024-09-21T01:41:39.026635+0000","last_undegraded":"2024-09-21T01:41:39.026635+0000","last_fullsized":"2024-09-21T01:41:39.026635+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:41:54.562004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"84'8","reported_seq":42,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.026808+0000","last_change":"2024-09-21T01:39:44.305053+0000","last_active":"2024-09-21T01:41:39.026808+0000","last_peered":"2024-09-21T01:41:39.026808+0000","last_clean":"2024-09-21T01:41:39.026808+0000","last_became_active":"2024-09-21T01:39:44.304651+0000","last_became_peered":"2024-09-21T01:39:44.304651+0000","last_unstale":"2024-09-21T01:41:39.026808+0000","last_undegraded":"2024-09-21T01:41:39.026808+0000","last_fullsized":"2024-09-21T01:41:39.026808+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:15:42.819633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"84'9","reported_seq":42,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.031281+0000","last_change":"2024-09-21T01:39:44.298405+0000","last_active":"2024-09-21T01:41:39.031281+0000","last_peered":"2024-09-21T01:41:39.031281+0000","last_clean":"2024-09-21T01:41:39.031281+0000","last_became_active":"2024-09-21T01:39:44.298010+0000","last_became_peered":"2024-09-21T01:39:44.298010+0000","last_unstale":"2024-09-21T01:41:39.031281+0000","last_undegraded":"2024-09-21T01:41:39.031281+0000","last_fullsized":"2024-09-21T01:41:39.031281+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:09:15.321530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"84'7","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.017606+0000","last_change":"2024-09-21T01:39:44.290593+0000","last_active":"2024-09-21T01:41:39.017606+0000","last_peered":"2024-09-21T01:41:39.017606+0000","last_clean":"2024-09-21T01:41:39.017606+0000","last_became_active":"2024-09-21T01:39:44.290235+0000","last_became_peered":"2024-09-21T01:39:44.290235+0000","last_unstale":"2024-09-21T01:41:39.017606+0000","last_undegraded":"2024-09-21T01:41:39.017606+0000","last_fullsized":"2024-09-21T01:41:39.017606+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:52:20.359493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"84'7","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.021489+0000","last_change":"2024-09-21T01:39:44.301902+0000","last_active":"2024-09-21T01:41:39.021489+0000","last_peered":"2024-09-21T01:41:39.021489+0000","last_clean":"2024-09-21T01:41:39.021489+0000","last_became_active":"2024-09-21T01:39:44.301494+0000","last_became_peered":"2024-09-21T01:39:44.301494+0000","last_unstale":"2024-09-21T01:41:39.021489+0000","last_undegraded":"2024-09-21T01:41:39.021489+0000","last_fullsized":"2024-09-21T01:41:39.021489+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:06:16.162987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"84'10","reported_seq":44,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.019702+0000","last_change":"2024-09-21T01:39:44.292360+0000","last_active":"2024-09-21T01:41:39.019702+0000","last_peered":"2024-09-21T01:41:39.019702+0000","last_clean":"2024-09-21T01:41:39.019702+0000","last_became_active":"2024-09-21T01:39:44.291995+0000","last_became_peered":"2024-09-21T01:39:44.291995+0000","last_unstale":"2024-09-21T01:41:39.019702+0000","last_undegraded":"2024-09-21T01:41:39.019702+0000","last_fullsized":"2024-09-21T01:41:39.019702+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:29:10.511082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"84'7","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.020802+0000","last_change":"2024-09-21T01:39:44.291836+0000","last_active":"2024-09-21T01:41:39.020802+0000","last_peered":"2024-09-21T01:41:39.020802+0000","last_clean":"2024-09-21T01:41:39.020802+0000","last_became_active":"2024-09-21T01:39:44.291459+0000","last_became_peered":"2024-09-21T01:39:44.291459+0000","last_unstale":"2024-09-21T01:41:39.020802+0000","last_undegraded":"2024-09-21T01:41:39.020802+0000","last_fullsized":"2024-09-21T01:41:39.020802+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:11:53.296520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"84'6","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.030806+0000","last_change":"2024-09-21T01:39:44.298572+0000","last_active":"2024-09-21T01:41:39.030806+0000","last_peered":"2024-09-21T01:41:39.030806+0000","last_clean":"2024-09-21T01:41:39.030806+0000","last_became_active":"2024-09-21T01:39:44.297903+0000","last_became_peered":"2024-09-21T01:39:44.297903+0000","last_unstale":"2024-09-21T01:41:39.030806+0000","last_undegraded":"2024-09-21T01:41:39.030806+0000","last_fullsized":"2024-09-21T01:41:39.030806+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:25:06.327202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"84'16","reported_seq":50,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.025882+0000","last_change":"2024-09-21T01:39:44.292648+0000","last_active":"2024-09-21T01:41:39.025882+0000","last_peered":"2024-09-21T01:41:39.025882+0000","last_clean":"2024-09-21T01:41:39.025882+0000","last_became_active":"2024-09-21T01:39:44.292215+0000","last_became_peered":"2024-09-21T01:39:44.292215+0000","last_unstale":"2024-09-21T01:41:39.025882+0000","last_undegraded":"2024-09-21T01:41:39.025882+0000","last_fullsized":"2024-09-21T01:41:39.025882+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:43:02.265276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"84'11","reported_seq":44,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.030192+0000","last_change":"2024-09-21T01:39:44.303330+0000","last_active":"2024-09-21T01:41:39.030192+0000","last_peered":"2024-09-21T01:41:39.030192+0000","last_clean":"2024-09-21T01:41:39.030192+0000","last_became_active":"2024-09-21T01:39:44.302862+0000","last_became_peered":"2024-09-21T01:39:44.302862+0000","last_unstale":"2024-09-21T01:41:39.030192+0000","last_undegraded":"2024-09-21T01:41:39.030192+0000","last_fullsized":"2024-09-21T01:41:39.030192+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:58:12.296150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"84'9","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.018434+0000","last_change":"2024-09-21T01:39:44.288015+0000","last_active":"2024-09-21T01:41:39.018434+0000","last_peered":"2024-09-21T01:41:39.018434+0000","last_clean":"2024-09-21T01:41:39.018434+0000","last_became_active":"2024-09-21T01:39:44.287455+0000","last_became_peered":"2024-09-21T01:39:44.287455+0000","last_unstale":"2024-09-21T01:41:39.018434+0000","last_undegraded":"2024-09-21T01:41:39.018434+0000","last_fullsized":"2024-09-21T01:41:39.018434+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:12:07.036882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"84'5","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.021128+0000","last_change":"2024-09-21T01:39:44.294594+0000","last_active":"2024-09-21T01:41:39.021128+0000","last_peered":"2024-09-21T01:41:39.021128+0000","last_clean":"2024-09-21T01:41:39.021128+0000","last_became_active":"2024-09-21T01:39:44.294218+0000","last_became_peered":"2024-09-21T01:39:44.294218+0000","last_unstale":"2024-09-21T01:41:39.021128+0000","last_undegraded":"2024-09-21T01:41:39.021128+0000","last_fullsized":"2024-09-21T01:41:39.021128+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:45:54.875131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"84'6","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.001865+0000","last_change":"2024-09-21T01:39:44.285172+0000","last_active":"2024-09-21T01:41:39.001865+0000","last_peered":"2024-09-21T01:41:39.001865+0000","last_clean":"2024-09-21T01:41:39.001865+0000","last_became_active":"2024-09-21T01:39:44.284799+0000","last_became_peered":"2024-09-21T01:39:44.284799+0000","last_unstale":"2024-09-21T01:41:39.001865+0000","last_undegraded":"2024-09-21T01:41:39.001865+0000","last_fullsized":"2024-09-21T01:41:39.001865+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:06:30.562297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"84'4","reported_seq":38,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:38.994895+0000","last_change":"2024-09-21T01:39:44.295990+0000","last_active":"2024-09-21T01:41:38.994895+0000","last_peered":"2024-09-21T01:41:38.994895+0000","last_clean":"2024-09-21T01:41:38.994895+0000","last_became_active":"2024-09-21T01:39:44.295601+0000","last_became_peered":"2024-09-21T01:39:44.295601+0000","last_unstale":"2024-09-21T01:41:38.994895+0000","last_undegraded":"2024-09-21T01:41:38.994895+0000","last_fullsized":"2024-09-21T01:41:38.994895+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:37:08.300911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"84'8","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.007027+0000","last_change":"2024-09-21T01:39:44.300104+0000","last_active":"2024-09-21T01:41:39.007027+0000","last_peered":"2024-09-21T01:41:39.007027+0000","last_clean":"2024-09-21T01:41:39.007027+0000","last_became_active":"2024-09-21T01:39:44.299709+0000","last_became_peered":"2024-09-21T01:39:44.299709+0000","last_unstale":"2024-09-21T01:41:39.007027+0000","last_undegraded":"2024-09-21T01:41:39.007027+0000","last_fullsized":"2024-09-21T01:41:39.007027+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:01:35.013021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"84'7","reported_seq":42,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.027402+0000","last_change":"2024-09-21T01:39:44.295900+0000","last_active":"2024-09-21T01:41:39.027402+0000","last_peered":"2024-09-21T01:41:39.027402+0000","last_clean":"2024-09-21T01:41:39.027402+0000","last_became_active":"2024-09-21T01:39:44.295303+0000","last_became_peered":"2024-09-21T01:39:44.295303+0000","last_unstale":"2024-09-21T01:41:39.027402+0000","last_undegraded":"2024-09-21T01:41:39.027402+0000","last_fullsized":"2024-09-21T01:41:39.027402+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:00:23.097745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"84'4","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.018723+0000","last_change":"2024-09-21T01:39:44.303627+0000","last_active":"2024-09-21T01:41:39.018723+0000","last_peered":"2024-09-21T01:41:39.018723+0000","last_clean":"2024-09-21T01:41:39.018723+0000","last_became_active":"2024-09-21T01:39:44.303260+0000","last_became_peered":"2024-09-21T01:39:44.303260+0000","last_unstale":"2024-09-21T01:41:39.018723+0000","last_undegraded":"2024-09-21T01:41:39.018723+0000","last_fullsized":"2024-09-21T01:41:39.018723+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:17:39.630994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"84'8","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.026548+0000","last_change":"2024-09-21T01:39:44.306087+0000","last_active":"2024-09-21T01:41:39.026548+0000","last_peered":"2024-09-21T01:41:39.026548+0000","last_clean":"2024-09-21T01:41:39.026548+0000","last_became_active":"2024-09-21T01:39:44.305660+0000","last_became_peered":"2024-09-21T01:39:44.305660+0000","last_unstale":"2024-09-21T01:41:39.026548+0000","last_undegraded":"2024-09-21T01:41:39.026548+0000","last_fullsized":"2024-09-21T01:41:39.026548+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:26:46.911966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":462470,"num_objects":23,"num_object_clones":0,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":222,"num_read_kb":195,"num_write":158,"num_write_kb":970,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":434176,"data_stored":1396534,"data_compressed":55471,"data_compressed_allocated":73728,"data_compressed_original":1130496,"omap_allocated":0,"internal_metadata":0},"log_size":133,"ondisk_log_size":133,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":376832,"data_stored":4132576,"data_compressed":247723,"data_compressed_allocated":315392,"data_compressed_original":4096000,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":68,"seq":292057776168,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":925696,"data_stored":494638,"data_compressed":29495,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939692,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32220,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712932,"statfs":{"total":95995035648,"available":95962042368,"internally_reserved":0,"allocated":1060864,"data_stored":1149000,"data_compressed":65346,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":58,"seq":249108103218,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":933888,"data_stored":499316,"data_compressed":29495,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":52,"seq":223338299447,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":933888,"data_stored":495242,"data_compressed":29495,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495675,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32144,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713008,"statfs":{"total":95995035648,"available":95962120192,"internally_reserved":0,"allocated":983040,"data_stored":1089684,"data_compressed":65346,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":41,"seq":176093659200,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":921600,"data_stored":490542,"data_compressed":29495,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855431,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32204,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712948,"statfs":{"total":95995035648,"available":95962058752,"internally_reserved":0,"allocated":1040384,"data_stored":1478964,"data_compressed":83437,"data_compressed_allocated":110592,"data_compressed_original":1040384,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018955,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27932,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717220,"statfs":{"total":95995035648,"available":95966433280,"internally_reserved":0,"allocated":929792,"data_stored":494660,"data_compressed":29495,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182481,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36332,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708820,"statfs":{"total":95995035648,"available":95957831680,"internally_reserved":0,"allocated":1007616,"data_stored":1277638,"data_compressed":66875,"data_compressed_allocated":90112,"data_compressed_original":843776,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411414,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36328,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708824,"statfs":{"total":95995035648,"available":95957835776,"internally_reserved":0,"allocated":1007616,"data_stored":563314,"data_compressed":29495,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574938,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32164,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712988,"statfs":{"total":95995035648,"available":95962099712,"internally_reserved":0,"allocated":1003520,"data_stored":563280,"data_compressed":29495,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705759,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":925696,"data_stored":490632,"data_compressed":29495,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34234,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34234,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35851,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35851,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35851,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35851,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35851,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":72738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":72772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":787096,"data_compressed":37380,"data_compressed_allocated":49152,"data_compressed_original":761856,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":393958,"data_compressed":18091,"data_compressed_allocated":24576,"data_compressed_original":368640,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":68090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T01:41:58.166 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph pg dump --format=json 2024-09-21T01:41:58.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:41:57 smithi142 ceph-mon[34050]: from='client.15423 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:41:58.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:41:57 smithi142 ceph-mon[34050]: from='client.15429 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:41:58.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:41:57 smithi142 ceph-mon[34050]: pgmap v336: 129 pgs: 129 active+clean; 1.0 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 73 KiB/s wr, 10 op/s 2024-09-21T01:41:58.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:41:57 smithi119 ceph-mon[33693]: from='client.15423 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:41:58.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:41:57 smithi119 ceph-mon[33693]: from='client.15429 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:41:58.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:41:57 smithi119 ceph-mon[33693]: pgmap v336: 129 pgs: 129 active+clean; 1.0 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 73 KiB/s wr, 10 op/s 2024-09-21T01:41:58.414 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:41:58.922 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:58.906+0000 7fa2096b2640 1 -- 172.21.15.83:0/1707472601 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa204102ae0 msgr2=0x7fa204102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:58.922 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:58.906+0000 7fa2096b2640 1 --2- 172.21.15.83:0/1707472601 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa204102ae0 0x7fa204102ef0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fa1f4009ca0 tx=0x7fa1f402a8e0 comp rx=0 tx=0).stop 2024-09-21T01:41:58.922 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:58.906+0000 7fa2096b2640 1 -- 172.21.15.83:0/1707472601 shutdown_connections 2024-09-21T01:41:58.922 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:58.906+0000 7fa2096b2640 1 --2- 172.21.15.83:0/1707472601 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa204108d70 0x7fa20410f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:58.922 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:58.906+0000 7fa2096b2640 1 --2- 172.21.15.83:0/1707472601 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa204108420 0x7fa204108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:58.922 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:58.906+0000 7fa2096b2640 1 --2- 172.21.15.83:0/1707472601 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa204102ae0 0x7fa204102ef0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:58.922 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:58.906+0000 7fa2096b2640 1 -- 172.21.15.83:0/1707472601 >> 172.21.15.83:0/1707472601 conn(0x7fa204079770 msgr2=0x7fa204079b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:41:58.922 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:58.906+0000 7fa2096b2640 1 -- 172.21.15.83:0/1707472601 shutdown_connections 2024-09-21T01:41:58.922 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:58.906+0000 7fa2096b2640 1 -- 172.21.15.83:0/1707472601 wait complete. 2024-09-21T01:41:58.922 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:58.906+0000 7fa2096b2640 1 Processor -- start 2024-09-21T01:41:58.922 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:58.907+0000 7fa2096b2640 1 -- start start 2024-09-21T01:41:58.923 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:58.907+0000 7fa2096b2640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa204102ae0 0x7fa2040ff670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:58.923 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:58.907+0000 7fa2096b2640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa204108420 0x7fa2040ffbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:58.923 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:58.907+0000 7fa2096b2640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa204108d70 0x7fa2041000f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:58.923 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:58.907+0000 7fa2096b2640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fa204112940 con 0x7fa204108d70 2024-09-21T01:41:58.923 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:58.907+0000 7fa2096b2640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fa2041127c0 con 0x7fa204102ae0 2024-09-21T01:41:58.923 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:58.907+0000 7fa2096b2640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fa204112ac0 con 0x7fa204108420 2024-09-21T01:41:58.923 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:58.907+0000 7fa2037fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa204108d70 0x7fa2041000f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:58.923 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:58.907+0000 7fa2037fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa204108d70 0x7fa2041000f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:60652/0 (socket says 172.21.15.83:60652) 2024-09-21T01:41:58.923 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:58.907+0000 7fa2037fe640 1 -- 172.21.15.83:0/1086922811 learned_addr learned my addr 172.21.15.83:0/1086922811 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:41:58.923 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:58.907+0000 7fa2027fc640 1 --2- 172.21.15.83:0/1086922811 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa204108420 0x7fa2040ffbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:58.923 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:58.907+0000 7fa202ffd640 1 --2- 172.21.15.83:0/1086922811 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa204102ae0 0x7fa2040ff670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:58.923 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:58.907+0000 7fa2037fe640 1 -- 172.21.15.83:0/1086922811 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa204108420 msgr2=0x7fa2040ffbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:58.923 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:58.907+0000 7fa2037fe640 1 --2- 172.21.15.83:0/1086922811 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa204108420 0x7fa2040ffbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:58.923 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:58.907+0000 7fa2037fe640 1 -- 172.21.15.83:0/1086922811 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa204102ae0 msgr2=0x7fa2040ff670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:58.923 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:58.907+0000 7fa2037fe640 1 --2- 172.21.15.83:0/1086922811 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa204102ae0 0x7fa2040ff670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:58.924 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:58.907+0000 7fa2037fe640 1 -- 172.21.15.83:0/1086922811 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2041a8780 con 0x7fa204108d70 2024-09-21T01:41:58.924 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:58.907+0000 7fa202ffd640 1 --2- 172.21.15.83:0/1086922811 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa204102ae0 0x7fa2040ff670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:41:58.924 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:58.908+0000 7fa2037fe640 1 --2- 172.21.15.83:0/1086922811 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa204108d70 0x7fa2041000f0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fa1fc00d750 tx=0x7fa1fc00db50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:41:58.924 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:58.908+0000 7fa1fbfff640 1 -- 172.21.15.83:0/1086922811 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1fc017070 con 0x7fa204108d70 2024-09-21T01:41:58.924 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:58.908+0000 7fa2096b2640 1 -- 172.21.15.83:0/1086922811 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2041a8a70 con 0x7fa204108d70 2024-09-21T01:41:58.924 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:58.908+0000 7fa1fbfff640 1 -- 172.21.15.83:0/1086922811 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa1fc0097c0 con 0x7fa204108d70 2024-09-21T01:41:58.924 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:58.908+0000 7fa1fbfff640 1 -- 172.21.15.83:0/1086922811 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1fc004b20 con 0x7fa204108d70 2024-09-21T01:41:58.924 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:58.908+0000 7fa2096b2640 1 -- 172.21.15.83:0/1086922811 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2041a9000 con 0x7fa204108d70 2024-09-21T01:41:58.924 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:58.909+0000 7fa2096b2640 1 -- 172.21.15.83:0/1086922811 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa204103d60 con 0x7fa204108d70 2024-09-21T01:41:58.924 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:58.910+0000 7fa1fbfff640 1 -- 172.21.15.83:0/1086922811 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 23) ==== 154586+0+0 (secure 0 0 0) 0x7fa1fc004cc0 con 0x7fa204108d70 2024-09-21T01:41:58.924 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:58.911+0000 7fa1fbfff640 1 --2- 172.21.15.83:0/1086922811 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fa1f00b65f0 0x7fa1f00b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:41:58.924 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:58.911+0000 7fa202ffd640 1 --2- 172.21.15.83:0/1086922811 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fa1f00b65f0 0x7fa1f00b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:41:58.924 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:58.911+0000 7fa1fbfff640 1 -- 172.21.15.83:0/1086922811 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9315+0+0 (secure 0 0 0) 0x7fa1fc0e7700 con 0x7fa204108d70 2024-09-21T01:41:58.924 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:58.911+0000 7fa202ffd640 1 --2- 172.21.15.83:0/1086922811 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fa1f00b65f0 0x7fa1f00b8b00 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fa1f4031fd0 tx=0x7fa1f40093f0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:41:58.924 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:58.914+0000 7fa1fbfff640 1 -- 172.21.15.83:0/1086922811 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa1fc0ad9f0 con 0x7fa204108d70 2024-09-21T01:41:59.087 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:59.087+0000 7fa2096b2640 1 -- 172.21.15.83:0/1086922811 --> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa204063800 con 0x7fa1f00b65f0 2024-09-21T01:41:59.087 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:41:58 smithi083 ceph-mon[31370]: from='client.15435 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T01:41:59.088 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:41:58 smithi083 ceph-mon[31370]: mgrmap e23: x(active, since 8m), standbys: z, y 2024-09-21T01:41:59.093 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:59.093+0000 7fa1fbfff640 1 -- 172.21.15.83:0/1086922811 <== mgr.14223 v2:172.21.15.83:6800/1748483157 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340722 (secure 0 0 0) 0x7fa204063800 con 0x7fa1f00b65f0 2024-09-21T01:41:59.096 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T01:41:59.098 INFO:teuthology.orchestra.run.smithi083.stderr:dumped all 2024-09-21T01:41:59.100 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:59.096+0000 7fa2096b2640 1 -- 172.21.15.83:0/1086922811 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fa1f00b65f0 msgr2=0x7fa1f00b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:59.100 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:59.096+0000 7fa2096b2640 1 --2- 172.21.15.83:0/1086922811 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fa1f00b65f0 0x7fa1f00b8b00 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fa1f4031fd0 tx=0x7fa1f40093f0 comp rx=0 tx=0).stop 2024-09-21T01:41:59.100 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:59.096+0000 7fa2096b2640 1 -- 172.21.15.83:0/1086922811 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa204108d70 msgr2=0x7fa2041000f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:41:59.100 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:59.096+0000 7fa2096b2640 1 --2- 172.21.15.83:0/1086922811 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa204108d70 0x7fa2041000f0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fa1fc00d750 tx=0x7fa1fc00db50 comp rx=0 tx=0).stop 2024-09-21T01:41:59.100 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:59.097+0000 7fa2096b2640 1 -- 172.21.15.83:0/1086922811 shutdown_connections 2024-09-21T01:41:59.100 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:59.097+0000 7fa2096b2640 1 --2- 172.21.15.83:0/1086922811 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fa1f00b65f0 0x7fa1f00b8b00 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:59.100 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:59.097+0000 7fa2096b2640 1 --2- 172.21.15.83:0/1086922811 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa204108d70 0x7fa2041000f0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:59.100 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:59.097+0000 7fa2096b2640 1 --2- 172.21.15.83:0/1086922811 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa204108420 0x7fa2040ffbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:59.100 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:59.097+0000 7fa2096b2640 1 --2- 172.21.15.83:0/1086922811 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa204102ae0 0x7fa2040ff670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:41:59.100 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:59.097+0000 7fa2096b2640 1 -- 172.21.15.83:0/1086922811 >> 172.21.15.83:0/1086922811 conn(0x7fa204079770 msgr2=0x7fa204101ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:41:59.100 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:59.097+0000 7fa2096b2640 1 -- 172.21.15.83:0/1086922811 shutdown_connections 2024-09-21T01:41:59.100 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:41:59.097+0000 7fa2096b2640 1 -- 172.21.15.83:0/1086922811 wait complete. 2024-09-21T01:41:59.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:41:58 smithi142 ceph-mon[34050]: from='client.15435 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T01:41:59.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:41:58 smithi142 ceph-mon[34050]: mgrmap e23: x(active, since 8m), standbys: z, y 2024-09-21T01:41:59.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:41:58 smithi119 ceph-mon[33693]: from='client.15435 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T01:41:59.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:41:58 smithi119 ceph-mon[33693]: mgrmap e23: x(active, since 8m), standbys: z, y 2024-09-21T01:41:59.809 INFO:teuthology.orchestra.run.smithi083.stdout:{"pg_ready":true,"pg_map":{"version":337,"stamp":"2024-09-21T01:41:58.793397+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1053072,"num_objects":27,"num_object_clones":0,"num_object_copies":83,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":303,"num_read_kb":264,"num_write":283,"num_write_kb":3122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":727,"ondisk_log_size":727,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":369000,"kb_used_data":11424,"kb_used_omap":18,"kb_used_meta":357357,"kb_avail":1124572824,"statfs":{"total":1151940427776,"available":1151562571776,"internally_reserved":0,"allocated":11698176,"data_stored":9480126,"data_compressed":536253,"data_compressed_allocated":724992,"data_compressed_original":4276224,"omap_allocated":19139,"internal_metadata":365933885},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":393776,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":52,"num_read_kb":41,"num_write":70,"num_write_kb":872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003675"},"pg_stats":[{"pgid":"2.1f","version":"74'4","reported_seq":45,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:09.877493+0000","last_change":"2024-09-21T01:39:42.267244+0000","last_active":"2024-09-21T01:41:09.877493+0000","last_peered":"2024-09-21T01:41:09.877493+0000","last_clean":"2024-09-21T01:41:09.877493+0000","last_became_active":"2024-09-21T01:39:42.266786+0000","last_became_peered":"2024-09-21T01:39:42.266786+0000","last_unstale":"2024-09-21T01:41:09.877493+0000","last_undegraded":"2024-09-21T01:41:09.877493+0000","last_fullsized":"2024-09-21T01:41:09.877493+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:50:43.594150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"84'5","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.017571+0000","last_change":"2024-09-21T01:39:44.292808+0000","last_active":"2024-09-21T01:41:39.017571+0000","last_peered":"2024-09-21T01:41:39.017571+0000","last_clean":"2024-09-21T01:41:39.017571+0000","last_became_active":"2024-09-21T01:39:44.292416+0000","last_became_peered":"2024-09-21T01:39:44.292416+0000","last_unstale":"2024-09-21T01:41:39.017571+0000","last_undegraded":"2024-09-21T01:41:39.017571+0000","last_fullsized":"2024-09-21T01:41:39.017571+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:26:16.332353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:09.880685+0000","last_change":"2024-09-21T01:39:51.339117+0000","last_active":"2024-09-21T01:41:09.880685+0000","last_peered":"2024-09-21T01:41:09.880685+0000","last_clean":"2024-09-21T01:41:09.880685+0000","last_became_active":"2024-09-21T01:39:51.338467+0000","last_became_peered":"2024-09-21T01:39:51.338467+0000","last_unstale":"2024-09-21T01:41:09.880685+0000","last_undegraded":"2024-09-21T01:41:09.880685+0000","last_fullsized":"2024-09-21T01:41:09.880685+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:18:57.119730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"74'1","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.505280+0000","last_change":"2024-09-21T01:39:42.550130+0000","last_active":"2024-09-21T01:41:10.505280+0000","last_peered":"2024-09-21T01:41:10.505280+0000","last_clean":"2024-09-21T01:41:10.505280+0000","last_became_active":"2024-09-21T01:39:42.549676+0000","last_became_peered":"2024-09-21T01:39:42.549676+0000","last_unstale":"2024-09-21T01:41:10.505280+0000","last_undegraded":"2024-09-21T01:41:10.505280+0000","last_fullsized":"2024-09-21T01:41:10.505280+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:33:59.954738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"84'6","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.027338+0000","last_change":"2024-09-21T01:39:44.293860+0000","last_active":"2024-09-21T01:41:39.027338+0000","last_peered":"2024-09-21T01:41:39.027338+0000","last_clean":"2024-09-21T01:41:39.027338+0000","last_became_active":"2024-09-21T01:39:44.293490+0000","last_became_peered":"2024-09-21T01:39:44.293490+0000","last_unstale":"2024-09-21T01:41:39.027338+0000","last_undegraded":"2024-09-21T01:41:39.027338+0000","last_fullsized":"2024-09-21T01:41:39.027338+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:58:18.325647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.504013+0000","last_change":"2024-09-21T01:39:51.335826+0000","last_active":"2024-09-21T01:41:10.504013+0000","last_peered":"2024-09-21T01:41:10.504013+0000","last_clean":"2024-09-21T01:41:10.504013+0000","last_became_active":"2024-09-21T01:39:51.335346+0000","last_became_peered":"2024-09-21T01:39:51.335346+0000","last_unstale":"2024-09-21T01:41:10.504013+0000","last_undegraded":"2024-09-21T01:41:10.504013+0000","last_fullsized":"2024-09-21T01:41:10.504013+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:51:25.921336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"74'2","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.503563+0000","last_change":"2024-09-21T01:39:42.270594+0000","last_active":"2024-09-21T01:41:10.503563+0000","last_peered":"2024-09-21T01:41:10.503563+0000","last_clean":"2024-09-21T01:41:10.503563+0000","last_became_active":"2024-09-21T01:39:42.270138+0000","last_became_peered":"2024-09-21T01:39:42.270138+0000","last_unstale":"2024-09-21T01:41:10.503563+0000","last_undegraded":"2024-09-21T01:41:10.503563+0000","last_fullsized":"2024-09-21T01:41:10.503563+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:05:00.604343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"84'9","reported_seq":42,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.024710+0000","last_change":"2024-09-21T01:39:44.294397+0000","last_active":"2024-09-21T01:41:39.024710+0000","last_peered":"2024-09-21T01:41:39.024710+0000","last_clean":"2024-09-21T01:41:39.024710+0000","last_became_active":"2024-09-21T01:39:44.293992+0000","last_became_peered":"2024-09-21T01:39:44.293992+0000","last_unstale":"2024-09-21T01:41:39.024710+0000","last_undegraded":"2024-09-21T01:41:39.024710+0000","last_fullsized":"2024-09-21T01:41:39.024710+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:52:09.459167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.504060+0000","last_change":"2024-09-21T01:39:51.338546+0000","last_active":"2024-09-21T01:41:10.504060+0000","last_peered":"2024-09-21T01:41:10.504060+0000","last_clean":"2024-09-21T01:41:10.504060+0000","last_became_active":"2024-09-21T01:39:51.337850+0000","last_became_peered":"2024-09-21T01:39:51.337850+0000","last_unstale":"2024-09-21T01:41:10.504060+0000","last_undegraded":"2024-09-21T01:41:10.504060+0000","last_fullsized":"2024-09-21T01:41:10.504060+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:33:49.497520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"74'2","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.503562+0000","last_change":"2024-09-21T01:39:42.264214+0000","last_active":"2024-09-21T01:41:10.503562+0000","last_peered":"2024-09-21T01:41:10.503562+0000","last_clean":"2024-09-21T01:41:10.503562+0000","last_became_active":"2024-09-21T01:39:42.263782+0000","last_became_peered":"2024-09-21T01:39:42.263782+0000","last_unstale":"2024-09-21T01:41:10.503562+0000","last_undegraded":"2024-09-21T01:41:10.503562+0000","last_fullsized":"2024-09-21T01:41:10.503562+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:44:24.965078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"84'15","reported_seq":49,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.029147+0000","last_change":"2024-09-21T01:39:44.296579+0000","last_active":"2024-09-21T01:41:39.029147+0000","last_peered":"2024-09-21T01:41:39.029147+0000","last_clean":"2024-09-21T01:41:39.029147+0000","last_became_active":"2024-09-21T01:39:44.296175+0000","last_became_peered":"2024-09-21T01:39:44.296175+0000","last_unstale":"2024-09-21T01:41:39.029147+0000","last_undegraded":"2024-09-21T01:41:39.029147+0000","last_fullsized":"2024-09-21T01:41:39.029147+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:11:13.920000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.504011+0000","last_change":"2024-09-21T01:39:51.339046+0000","last_active":"2024-09-21T01:41:10.504011+0000","last_peered":"2024-09-21T01:41:10.504011+0000","last_clean":"2024-09-21T01:41:10.504011+0000","last_became_active":"2024-09-21T01:39:51.337379+0000","last_became_peered":"2024-09-21T01:39:51.337379+0000","last_unstale":"2024-09-21T01:41:10.504011+0000","last_undegraded":"2024-09-21T01:41:10.504011+0000","last_fullsized":"2024-09-21T01:41:10.504011+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:50:34.321615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"84'5","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.030962+0000","last_change":"2024-09-21T01:39:44.296849+0000","last_active":"2024-09-21T01:41:39.030962+0000","last_peered":"2024-09-21T01:41:39.030962+0000","last_clean":"2024-09-21T01:41:39.030962+0000","last_became_active":"2024-09-21T01:39:44.296460+0000","last_became_peered":"2024-09-21T01:39:44.296460+0000","last_unstale":"2024-09-21T01:41:39.030962+0000","last_undegraded":"2024-09-21T01:41:39.030962+0000","last_fullsized":"2024-09-21T01:41:39.030962+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:46:51.258576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"74'2","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.947238+0000","last_change":"2024-09-21T01:40:09.842127+0000","last_active":"2024-09-21T01:41:10.947238+0000","last_peered":"2024-09-21T01:41:10.947238+0000","last_clean":"2024-09-21T01:41:10.947238+0000","last_became_active":"2024-09-21T01:40:09.835330+0000","last_became_peered":"2024-09-21T01:40:09.835330+0000","last_unstale":"2024-09-21T01:41:10.947238+0000","last_undegraded":"2024-09-21T01:41:10.947238+0000","last_fullsized":"2024-09-21T01:41:10.947238+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:54:07.455805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.504140+0000","last_change":"2024-09-21T01:39:51.459595+0000","last_active":"2024-09-21T01:41:10.504140+0000","last_peered":"2024-09-21T01:41:10.504140+0000","last_clean":"2024-09-21T01:41:10.504140+0000","last_became_active":"2024-09-21T01:39:51.459137+0000","last_became_peered":"2024-09-21T01:39:51.459137+0000","last_unstale":"2024-09-21T01:41:10.504140+0000","last_undegraded":"2024-09-21T01:41:10.504140+0000","last_fullsized":"2024-09-21T01:41:10.504140+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:55:53.800615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"84'8","reported_seq":42,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.008399+0000","last_change":"2024-09-21T01:39:44.288328+0000","last_active":"2024-09-21T01:41:39.008399+0000","last_peered":"2024-09-21T01:41:39.008399+0000","last_clean":"2024-09-21T01:41:39.008399+0000","last_became_active":"2024-09-21T01:39:44.287994+0000","last_became_peered":"2024-09-21T01:39:44.287994+0000","last_unstale":"2024-09-21T01:41:39.008399+0000","last_undegraded":"2024-09-21T01:41:39.008399+0000","last_fullsized":"2024-09-21T01:41:39.008399+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:44:55.075693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:09.881129+0000","last_change":"2024-09-21T01:39:42.266271+0000","last_active":"2024-09-21T01:41:09.881129+0000","last_peered":"2024-09-21T01:41:09.881129+0000","last_clean":"2024-09-21T01:41:09.881129+0000","last_became_active":"2024-09-21T01:39:42.265904+0000","last_became_peered":"2024-09-21T01:39:42.265904+0000","last_unstale":"2024-09-21T01:41:09.881129+0000","last_undegraded":"2024-09-21T01:41:09.881129+0000","last_fullsized":"2024-09-21T01:41:09.881129+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:43:37.456263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"82'1","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.504229+0000","last_change":"2024-09-21T01:39:51.336649+0000","last_active":"2024-09-21T01:41:10.504229+0000","last_peered":"2024-09-21T01:41:10.504229+0000","last_clean":"2024-09-21T01:41:10.504229+0000","last_became_active":"2024-09-21T01:39:51.336153+0000","last_became_peered":"2024-09-21T01:39:51.336153+0000","last_unstale":"2024-09-21T01:41:10.504229+0000","last_undegraded":"2024-09-21T01:41:10.504229+0000","last_fullsized":"2024-09-21T01:41:10.504229+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:56:58.699051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"84'9","reported_seq":44,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.018381+0000","last_change":"2024-09-21T01:39:44.304919+0000","last_active":"2024-09-21T01:41:39.018381+0000","last_peered":"2024-09-21T01:41:39.018381+0000","last_clean":"2024-09-21T01:41:39.018381+0000","last_became_active":"2024-09-21T01:39:44.304509+0000","last_became_peered":"2024-09-21T01:39:44.304509+0000","last_unstale":"2024-09-21T01:41:39.018381+0000","last_undegraded":"2024-09-21T01:41:39.018381+0000","last_fullsized":"2024-09-21T01:41:39.018381+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:57:04.413151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.505571+0000","last_change":"2024-09-21T01:39:42.262536+0000","last_active":"2024-09-21T01:41:10.505571+0000","last_peered":"2024-09-21T01:41:10.505571+0000","last_clean":"2024-09-21T01:41:10.505571+0000","last_became_active":"2024-09-21T01:39:42.262179+0000","last_became_peered":"2024-09-21T01:39:42.262179+0000","last_unstale":"2024-09-21T01:41:10.505571+0000","last_undegraded":"2024-09-21T01:41:10.505571+0000","last_fullsized":"2024-09-21T01:41:10.505571+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:35:14.022839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:09.877283+0000","last_change":"2024-09-21T01:39:51.339664+0000","last_active":"2024-09-21T01:41:09.877283+0000","last_peered":"2024-09-21T01:41:09.877283+0000","last_clean":"2024-09-21T01:41:09.877283+0000","last_became_active":"2024-09-21T01:39:51.339140+0000","last_became_peered":"2024-09-21T01:39:51.339140+0000","last_unstale":"2024-09-21T01:41:09.877283+0000","last_undegraded":"2024-09-21T01:41:09.877283+0000","last_fullsized":"2024-09-21T01:41:09.877283+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:46:49.443937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"84'2","reported_seq":37,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:38.997313+0000","last_change":"2024-09-21T01:39:44.299174+0000","last_active":"2024-09-21T01:41:38.997313+0000","last_peered":"2024-09-21T01:41:38.997313+0000","last_clean":"2024-09-21T01:41:38.997313+0000","last_became_active":"2024-09-21T01:39:44.298778+0000","last_became_peered":"2024-09-21T01:39:44.298778+0000","last_unstale":"2024-09-21T01:41:38.997313+0000","last_undegraded":"2024-09-21T01:41:38.997313+0000","last_fullsized":"2024-09-21T01:41:38.997313+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:59:17.298726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:09.971718+0000","last_change":"2024-09-21T01:39:42.550521+0000","last_active":"2024-09-21T01:41:09.971718+0000","last_peered":"2024-09-21T01:41:09.971718+0000","last_clean":"2024-09-21T01:41:09.971718+0000","last_became_active":"2024-09-21T01:39:42.550210+0000","last_became_peered":"2024-09-21T01:39:42.550210+0000","last_unstale":"2024-09-21T01:41:09.971718+0000","last_undegraded":"2024-09-21T01:41:09.971718+0000","last_fullsized":"2024-09-21T01:41:09.971718+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:07:07.234815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.504302+0000","last_change":"2024-09-21T01:39:51.461448+0000","last_active":"2024-09-21T01:41:10.504302+0000","last_peered":"2024-09-21T01:41:10.504302+0000","last_clean":"2024-09-21T01:41:10.504302+0000","last_became_active":"2024-09-21T01:39:51.460790+0000","last_became_peered":"2024-09-21T01:39:51.460790+0000","last_unstale":"2024-09-21T01:41:10.504302+0000","last_undegraded":"2024-09-21T01:41:10.504302+0000","last_fullsized":"2024-09-21T01:41:10.504302+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:30:35.032588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"84'7","reported_seq":42,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.018869+0000","last_change":"2024-09-21T01:39:44.298697+0000","last_active":"2024-09-21T01:41:39.018869+0000","last_peered":"2024-09-21T01:41:39.018869+0000","last_clean":"2024-09-21T01:41:39.018869+0000","last_became_active":"2024-09-21T01:39:44.298333+0000","last_became_peered":"2024-09-21T01:39:44.298333+0000","last_unstale":"2024-09-21T01:41:39.018869+0000","last_undegraded":"2024-09-21T01:41:39.018869+0000","last_fullsized":"2024-09-21T01:41:39.018869+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:36:01.932630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"74'2","reported_seq":42,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.504712+0000","last_change":"2024-09-21T01:39:42.257383+0000","last_active":"2024-09-21T01:41:10.504712+0000","last_peered":"2024-09-21T01:41:10.504712+0000","last_clean":"2024-09-21T01:41:10.504712+0000","last_became_active":"2024-09-21T01:39:42.256896+0000","last_became_peered":"2024-09-21T01:39:42.256896+0000","last_unstale":"2024-09-21T01:41:10.504712+0000","last_undegraded":"2024-09-21T01:41:10.504712+0000","last_fullsized":"2024-09-21T01:41:10.504712+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:03:29.350623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:09.880899+0000","last_change":"2024-09-21T01:39:51.342055+0000","last_active":"2024-09-21T01:41:09.880899+0000","last_peered":"2024-09-21T01:41:09.880899+0000","last_clean":"2024-09-21T01:41:09.880899+0000","last_became_active":"2024-09-21T01:39:51.341602+0000","last_became_peered":"2024-09-21T01:39:51.341602+0000","last_unstale":"2024-09-21T01:41:09.880899+0000","last_undegraded":"2024-09-21T01:41:09.880899+0000","last_fullsized":"2024-09-21T01:41:09.880899+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:30:58.290018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"84'5","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.024216+0000","last_change":"2024-09-21T01:39:44.296725+0000","last_active":"2024-09-21T01:41:39.024216+0000","last_peered":"2024-09-21T01:41:39.024216+0000","last_clean":"2024-09-21T01:41:39.024216+0000","last_became_active":"2024-09-21T01:39:44.296411+0000","last_became_peered":"2024-09-21T01:39:44.296411+0000","last_unstale":"2024-09-21T01:41:39.024216+0000","last_undegraded":"2024-09-21T01:41:39.024216+0000","last_fullsized":"2024-09-21T01:41:39.024216+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:58:05.357486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"84'9","reported_seq":49,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.303877+0000","last_change":"2024-09-21T01:39:42.262831+0000","last_active":"2024-09-21T01:41:39.303877+0000","last_peered":"2024-09-21T01:41:39.303877+0000","last_clean":"2024-09-21T01:41:39.303877+0000","last_became_active":"2024-09-21T01:39:42.262462+0000","last_became_peered":"2024-09-21T01:39:42.262462+0000","last_unstale":"2024-09-21T01:41:39.303877+0000","last_undegraded":"2024-09-21T01:41:39.303877+0000","last_fullsized":"2024-09-21T01:41:39.303877+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:01:24.950607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.505262+0000","last_change":"2024-09-21T01:39:51.460620+0000","last_active":"2024-09-21T01:41:10.505262+0000","last_peered":"2024-09-21T01:41:10.505262+0000","last_clean":"2024-09-21T01:41:10.505262+0000","last_became_active":"2024-09-21T01:39:51.460052+0000","last_became_peered":"2024-09-21T01:39:51.460052+0000","last_unstale":"2024-09-21T01:41:10.505262+0000","last_undegraded":"2024-09-21T01:41:10.505262+0000","last_fullsized":"2024-09-21T01:41:10.505262+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:23:23.284102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"84'9","reported_seq":44,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:38.995410+0000","last_change":"2024-09-21T01:39:44.293129+0000","last_active":"2024-09-21T01:41:38.995410+0000","last_peered":"2024-09-21T01:41:38.995410+0000","last_clean":"2024-09-21T01:41:38.995410+0000","last_became_active":"2024-09-21T01:39:44.292799+0000","last_became_peered":"2024-09-21T01:39:44.292799+0000","last_unstale":"2024-09-21T01:41:38.995410+0000","last_undegraded":"2024-09-21T01:41:38.995410+0000","last_fullsized":"2024-09-21T01:41:38.995410+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:05:22.484632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.504453+0000","last_change":"2024-09-21T01:39:42.550724+0000","last_active":"2024-09-21T01:41:10.504453+0000","last_peered":"2024-09-21T01:41:10.504453+0000","last_clean":"2024-09-21T01:41:10.504453+0000","last_became_active":"2024-09-21T01:39:42.550334+0000","last_became_peered":"2024-09-21T01:39:42.550334+0000","last_unstale":"2024-09-21T01:41:10.504453+0000","last_undegraded":"2024-09-21T01:41:10.504453+0000","last_fullsized":"2024-09-21T01:41:10.504453+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:15:49.484663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.947380+0000","last_change":"2024-09-21T01:40:09.838305+0000","last_active":"2024-09-21T01:41:10.947380+0000","last_peered":"2024-09-21T01:41:10.947380+0000","last_clean":"2024-09-21T01:41:10.947380+0000","last_became_active":"2024-09-21T01:40:09.837734+0000","last_became_peered":"2024-09-21T01:40:09.837734+0000","last_unstale":"2024-09-21T01:41:10.947380+0000","last_undegraded":"2024-09-21T01:41:10.947380+0000","last_fullsized":"2024-09-21T01:41:10.947380+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:38:44.066723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,7,6],"acting":[11,8,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"84'4","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.011618+0000","last_change":"2024-09-21T01:39:44.292039+0000","last_active":"2024-09-21T01:41:39.011618+0000","last_peered":"2024-09-21T01:41:39.011618+0000","last_clean":"2024-09-21T01:41:39.011618+0000","last_became_active":"2024-09-21T01:39:44.291640+0000","last_became_peered":"2024-09-21T01:39:44.291640+0000","last_unstale":"2024-09-21T01:41:39.011618+0000","last_undegraded":"2024-09-21T01:41:39.011618+0000","last_fullsized":"2024-09-21T01:41:39.011618+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:24:59.891664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":47,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:09.877197+0000","last_change":"2024-09-21T01:40:10.063162+0000","last_active":"2024-09-21T01:41:09.877197+0000","last_peered":"2024-09-21T01:41:09.877197+0000","last_clean":"2024-09-21T01:41:09.877197+0000","last_became_active":"2024-09-21T01:40:10.062703+0000","last_became_peered":"2024-09-21T01:40:10.062703+0000","last_unstale":"2024-09-21T01:41:09.877197+0000","last_undegraded":"2024-09-21T01:41:09.877197+0000","last_fullsized":"2024-09-21T01:41:09.877197+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:32:04.933701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.504118+0000","last_change":"2024-09-21T01:39:51.460023+0000","last_active":"2024-09-21T01:41:10.504118+0000","last_peered":"2024-09-21T01:41:10.504118+0000","last_clean":"2024-09-21T01:41:10.504118+0000","last_became_active":"2024-09-21T01:39:51.459417+0000","last_became_peered":"2024-09-21T01:39:51.459417+0000","last_unstale":"2024-09-21T01:41:10.504118+0000","last_undegraded":"2024-09-21T01:41:10.504118+0000","last_fullsized":"2024-09-21T01:41:10.504118+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:54:24.301176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"84'7","reported_seq":42,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.007130+0000","last_change":"2024-09-21T01:39:44.295559+0000","last_active":"2024-09-21T01:41:39.007130+0000","last_peered":"2024-09-21T01:41:39.007130+0000","last_clean":"2024-09-21T01:41:39.007130+0000","last_became_active":"2024-09-21T01:39:44.294970+0000","last_became_peered":"2024-09-21T01:39:44.294970+0000","last_unstale":"2024-09-21T01:41:39.007130+0000","last_undegraded":"2024-09-21T01:41:39.007130+0000","last_fullsized":"2024-09-21T01:41:39.007130+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:46:16.582188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:09.878607+0000","last_change":"2024-09-21T01:39:42.269453+0000","last_active":"2024-09-21T01:41:09.878607+0000","last_peered":"2024-09-21T01:41:09.878607+0000","last_clean":"2024-09-21T01:41:09.878607+0000","last_became_active":"2024-09-21T01:39:42.269039+0000","last_became_peered":"2024-09-21T01:39:42.269039+0000","last_unstale":"2024-09-21T01:41:09.878607+0000","last_undegraded":"2024-09-21T01:41:09.878607+0000","last_fullsized":"2024-09-21T01:41:09.878607+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:47:29.053966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.504474+0000","last_change":"2024-09-21T01:39:51.337305+0000","last_active":"2024-09-21T01:41:10.504474+0000","last_peered":"2024-09-21T01:41:10.504474+0000","last_clean":"2024-09-21T01:41:10.504474+0000","last_became_active":"2024-09-21T01:39:51.336710+0000","last_became_peered":"2024-09-21T01:39:51.336710+0000","last_unstale":"2024-09-21T01:41:10.504474+0000","last_undegraded":"2024-09-21T01:41:10.504474+0000","last_fullsized":"2024-09-21T01:41:10.504474+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:13:42.333881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"84'8","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.019206+0000","last_change":"2024-09-21T01:39:44.297004+0000","last_active":"2024-09-21T01:41:39.019206+0000","last_peered":"2024-09-21T01:41:39.019206+0000","last_clean":"2024-09-21T01:41:39.019206+0000","last_became_active":"2024-09-21T01:39:44.296596+0000","last_became_peered":"2024-09-21T01:39:44.296596+0000","last_unstale":"2024-09-21T01:41:39.019206+0000","last_undegraded":"2024-09-21T01:41:39.019206+0000","last_fullsized":"2024-09-21T01:41:39.019206+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:14:32.542823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.503902+0000","last_change":"2024-09-21T01:39:42.550024+0000","last_active":"2024-09-21T01:41:10.503902+0000","last_peered":"2024-09-21T01:41:10.503902+0000","last_clean":"2024-09-21T01:41:10.503902+0000","last_became_active":"2024-09-21T01:39:42.549638+0000","last_became_peered":"2024-09-21T01:39:42.549638+0000","last_unstale":"2024-09-21T01:41:10.503902+0000","last_undegraded":"2024-09-21T01:41:10.503902+0000","last_fullsized":"2024-09-21T01:41:10.503902+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:23:39.210460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.505020+0000","last_change":"2024-09-21T01:39:51.459459+0000","last_active":"2024-09-21T01:41:10.505020+0000","last_peered":"2024-09-21T01:41:10.505020+0000","last_clean":"2024-09-21T01:41:10.505020+0000","last_became_active":"2024-09-21T01:39:51.459020+0000","last_became_peered":"2024-09-21T01:39:51.459020+0000","last_unstale":"2024-09-21T01:41:10.505020+0000","last_undegraded":"2024-09-21T01:41:10.505020+0000","last_fullsized":"2024-09-21T01:41:10.505020+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:50:08.337949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"84'5","reported_seq":47,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:38.995712+0000","last_change":"2024-09-21T01:40:09.833943+0000","last_active":"2024-09-21T01:41:38.995712+0000","last_peered":"2024-09-21T01:41:38.995712+0000","last_clean":"2024-09-21T01:41:38.995712+0000","last_became_active":"2024-09-21T01:40:09.833486+0000","last_became_peered":"2024-09-21T01:40:09.833486+0000","last_unstale":"2024-09-21T01:41:38.995712+0000","last_undegraded":"2024-09-21T01:41:38.995712+0000","last_fullsized":"2024-09-21T01:41:38.995712+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:26:52.751330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,2],"acting":[6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:09.878307+0000","last_change":"2024-09-21T01:39:42.267329+0000","last_active":"2024-09-21T01:41:09.878307+0000","last_peered":"2024-09-21T01:41:09.878307+0000","last_clean":"2024-09-21T01:41:09.878307+0000","last_became_active":"2024-09-21T01:39:42.266386+0000","last_became_peered":"2024-09-21T01:39:42.266386+0000","last_unstale":"2024-09-21T01:41:09.878307+0000","last_undegraded":"2024-09-21T01:41:09.878307+0000","last_fullsized":"2024-09-21T01:41:09.878307+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:31:20.877627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.044656+0000","last_change":"2024-09-21T01:39:51.461494+0000","last_active":"2024-09-21T01:41:10.044656+0000","last_peered":"2024-09-21T01:41:10.044656+0000","last_clean":"2024-09-21T01:41:10.044656+0000","last_became_active":"2024-09-21T01:39:51.460973+0000","last_became_peered":"2024-09-21T01:39:51.460973+0000","last_unstale":"2024-09-21T01:41:10.044656+0000","last_undegraded":"2024-09-21T01:41:10.044656+0000","last_fullsized":"2024-09-21T01:41:10.044656+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:09:50.319546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"84'8","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.027189+0000","last_change":"2024-09-21T01:39:44.300773+0000","last_active":"2024-09-21T01:41:39.027189+0000","last_peered":"2024-09-21T01:41:39.027189+0000","last_clean":"2024-09-21T01:41:39.027189+0000","last_became_active":"2024-09-21T01:39:44.300437+0000","last_became_peered":"2024-09-21T01:39:44.300437+0000","last_unstale":"2024-09-21T01:41:39.027189+0000","last_undegraded":"2024-09-21T01:41:39.027189+0000","last_fullsized":"2024-09-21T01:41:39.027189+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:06:34.171621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.503903+0000","last_change":"2024-09-21T01:39:42.262675+0000","last_active":"2024-09-21T01:41:10.503903+0000","last_peered":"2024-09-21T01:41:10.503903+0000","last_clean":"2024-09-21T01:41:10.503903+0000","last_became_active":"2024-09-21T01:39:42.262282+0000","last_became_peered":"2024-09-21T01:39:42.262282+0000","last_unstale":"2024-09-21T01:41:10.503903+0000","last_undegraded":"2024-09-21T01:41:10.503903+0000","last_fullsized":"2024-09-21T01:41:10.503903+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:26:01.595797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":114,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:09.878450+0000","last_change":"2024-09-21T01:38:31.172876+0000","last_active":"2024-09-21T01:41:09.878450+0000","last_peered":"2024-09-21T01:41:09.878450+0000","last_clean":"2024-09-21T01:41:09.878450+0000","last_became_active":"2024-09-21T01:38:31.167071+0000","last_became_peered":"2024-09-21T01:38:31.167071+0000","last_unstale":"2024-09-21T01:41:09.878450+0000","last_undegraded":"2024-09-21T01:41:09.878450+0000","last_fullsized":"2024-09-21T01:41:09.878450+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:35:07.475056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:35:07.475056+0000","last_clean_scrub_stamp":"2024-09-21T01:35:07.475056+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:56:01.878445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"82'1","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:09.878776+0000","last_change":"2024-09-21T01:39:51.338198+0000","last_active":"2024-09-21T01:41:09.878776+0000","last_peered":"2024-09-21T01:41:09.878776+0000","last_clean":"2024-09-21T01:41:09.878776+0000","last_became_active":"2024-09-21T01:39:51.337743+0000","last_became_peered":"2024-09-21T01:39:51.337743+0000","last_unstale":"2024-09-21T01:41:09.878776+0000","last_undegraded":"2024-09-21T01:41:09.878776+0000","last_fullsized":"2024-09-21T01:41:09.878776+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:19:45.552819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"84'7","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.030827+0000","last_change":"2024-09-21T01:39:44.298920+0000","last_active":"2024-09-21T01:41:39.030827+0000","last_peered":"2024-09-21T01:41:39.030827+0000","last_clean":"2024-09-21T01:41:39.030827+0000","last_became_active":"2024-09-21T01:39:44.298381+0000","last_became_peered":"2024-09-21T01:39:44.298381+0000","last_unstale":"2024-09-21T01:41:39.030827+0000","last_undegraded":"2024-09-21T01:41:39.030827+0000","last_fullsized":"2024-09-21T01:41:39.030827+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:12:53.681514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:09.881301+0000","last_change":"2024-09-21T01:39:42.550808+0000","last_active":"2024-09-21T01:41:09.881301+0000","last_peered":"2024-09-21T01:41:09.881301+0000","last_clean":"2024-09-21T01:41:09.881301+0000","last_became_active":"2024-09-21T01:39:42.550447+0000","last_became_peered":"2024-09-21T01:39:42.550447+0000","last_unstale":"2024-09-21T01:41:09.881301+0000","last_undegraded":"2024-09-21T01:41:09.881301+0000","last_fullsized":"2024-09-21T01:41:09.881301+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:20:56.996378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:09.971547+0000","last_change":"2024-09-21T01:39:51.338490+0000","last_active":"2024-09-21T01:41:09.971547+0000","last_peered":"2024-09-21T01:41:09.971547+0000","last_clean":"2024-09-21T01:41:09.971547+0000","last_became_active":"2024-09-21T01:39:51.338050+0000","last_became_peered":"2024-09-21T01:39:51.338050+0000","last_unstale":"2024-09-21T01:41:09.971547+0000","last_undegraded":"2024-09-21T01:41:09.971547+0000","last_fullsized":"2024-09-21T01:41:09.971547+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:49:56.705893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"84'6","reported_seq":47,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.021159+0000","last_change":"2024-09-21T01:41:10.045808+0000","last_active":"2024-09-21T01:41:39.021159+0000","last_peered":"2024-09-21T01:41:39.021159+0000","last_clean":"2024-09-21T01:41:39.021159+0000","last_became_active":"2024-09-21T01:41:10.045403+0000","last_became_peered":"2024-09-21T01:41:10.045403+0000","last_unstale":"2024-09-21T01:41:39.021159+0000","last_undegraded":"2024-09-21T01:41:39.021159+0000","last_fullsized":"2024-09-21T01:41:39.021159+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:15:46.067941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"84'60","reported_seq":130,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:56.430035+0000","last_change":"2024-09-21T01:39:42.270124+0000","last_active":"2024-09-21T01:41:56.430035+0000","last_peered":"2024-09-21T01:41:56.430035+0000","last_clean":"2024-09-21T01:41:56.430035+0000","last_became_active":"2024-09-21T01:39:42.269435+0000","last_became_peered":"2024-09-21T01:39:42.269435+0000","last_unstale":"2024-09-21T01:41:56.430035+0000","last_undegraded":"2024-09-21T01:41:56.430035+0000","last_fullsized":"2024-09-21T01:41:56.430035+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:12:08.374394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393846,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":33,"num_read_kb":32,"num_write":71,"num_write_kb":873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.504493+0000","last_change":"2024-09-21T01:39:51.334459+0000","last_active":"2024-09-21T01:41:10.504493+0000","last_peered":"2024-09-21T01:41:10.504493+0000","last_clean":"2024-09-21T01:41:10.504493+0000","last_became_active":"2024-09-21T01:39:51.334039+0000","last_became_peered":"2024-09-21T01:39:51.334039+0000","last_unstale":"2024-09-21T01:41:10.504493+0000","last_undegraded":"2024-09-21T01:41:10.504493+0000","last_fullsized":"2024-09-21T01:41:10.504493+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:04:44.906648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"84'9","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.023513+0000","last_change":"2024-09-21T01:39:44.298467+0000","last_active":"2024-09-21T01:41:39.023513+0000","last_peered":"2024-09-21T01:41:39.023513+0000","last_clean":"2024-09-21T01:41:39.023513+0000","last_became_active":"2024-09-21T01:39:44.298128+0000","last_became_peered":"2024-09-21T01:39:44.298128+0000","last_unstale":"2024-09-21T01:41:39.023513+0000","last_undegraded":"2024-09-21T01:41:39.023513+0000","last_fullsized":"2024-09-21T01:41:39.023513+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:54:11.096417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"74'2","reported_seq":42,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.504261+0000","last_change":"2024-09-21T01:39:42.262761+0000","last_active":"2024-09-21T01:41:10.504261+0000","last_peered":"2024-09-21T01:41:10.504261+0000","last_clean":"2024-09-21T01:41:10.504261+0000","last_became_active":"2024-09-21T01:39:42.262428+0000","last_became_peered":"2024-09-21T01:39:42.262428+0000","last_unstale":"2024-09-21T01:41:10.504261+0000","last_undegraded":"2024-09-21T01:41:10.504261+0000","last_fullsized":"2024-09-21T01:41:10.504261+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:11:50.326638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.043807+0000","last_change":"2024-09-21T01:39:51.344320+0000","last_active":"2024-09-21T01:41:10.043807+0000","last_peered":"2024-09-21T01:41:10.043807+0000","last_clean":"2024-09-21T01:41:10.043807+0000","last_became_active":"2024-09-21T01:39:51.343902+0000","last_became_peered":"2024-09-21T01:39:51.343902+0000","last_unstale":"2024-09-21T01:41:10.043807+0000","last_undegraded":"2024-09-21T01:41:10.043807+0000","last_fullsized":"2024-09-21T01:41:10.043807+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:13:36.139159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"84'5","reported_seq":46,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.007852+0000","last_change":"2024-09-21T01:40:09.837769+0000","last_active":"2024-09-21T01:41:39.007852+0000","last_peered":"2024-09-21T01:41:39.007852+0000","last_clean":"2024-09-21T01:41:39.007852+0000","last_became_active":"2024-09-21T01:40:09.837296+0000","last_became_peered":"2024-09-21T01:40:09.837296+0000","last_unstale":"2024-09-21T01:41:39.007852+0000","last_undegraded":"2024-09-21T01:41:39.007852+0000","last_fullsized":"2024-09-21T01:41:39.007852+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:37:20.360076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"74'1","reported_seq":42,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.503756+0000","last_change":"2024-09-21T01:39:42.264955+0000","last_active":"2024-09-21T01:41:10.503756+0000","last_peered":"2024-09-21T01:41:10.503756+0000","last_clean":"2024-09-21T01:41:10.503756+0000","last_became_active":"2024-09-21T01:39:42.264492+0000","last_became_peered":"2024-09-21T01:39:42.264492+0000","last_unstale":"2024-09-21T01:41:10.503756+0000","last_undegraded":"2024-09-21T01:41:10.503756+0000","last_fullsized":"2024-09-21T01:41:10.503756+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:17:38.631521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.044021+0000","last_change":"2024-09-21T01:39:51.337908+0000","last_active":"2024-09-21T01:41:10.044021+0000","last_peered":"2024-09-21T01:41:10.044021+0000","last_clean":"2024-09-21T01:41:10.044021+0000","last_became_active":"2024-09-21T01:39:51.337200+0000","last_became_peered":"2024-09-21T01:39:51.337200+0000","last_unstale":"2024-09-21T01:41:10.044021+0000","last_undegraded":"2024-09-21T01:41:10.044021+0000","last_fullsized":"2024-09-21T01:41:10.044021+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:07:18.505959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"84'6","reported_seq":47,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.027322+0000","last_change":"2024-09-21T01:40:10.063539+0000","last_active":"2024-09-21T01:41:39.027322+0000","last_peered":"2024-09-21T01:41:39.027322+0000","last_clean":"2024-09-21T01:41:39.027322+0000","last_became_active":"2024-09-21T01:40:10.062966+0000","last_became_peered":"2024-09-21T01:40:10.062966+0000","last_unstale":"2024-09-21T01:41:39.027322+0000","last_undegraded":"2024-09-21T01:41:39.027322+0000","last_fullsized":"2024-09-21T01:41:39.027322+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:53:20.747493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,1],"acting":[5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"74'8","reported_seq":47,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.503907+0000","last_change":"2024-09-21T01:39:42.550795+0000","last_active":"2024-09-21T01:41:10.503907+0000","last_peered":"2024-09-21T01:41:10.503907+0000","last_clean":"2024-09-21T01:41:10.503907+0000","last_became_active":"2024-09-21T01:39:42.550424+0000","last_became_peered":"2024-09-21T01:39:42.550424+0000","last_unstale":"2024-09-21T01:41:10.503907+0000","last_undegraded":"2024-09-21T01:41:10.503907+0000","last_fullsized":"2024-09-21T01:41:10.503907+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:50:53.421080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.504489+0000","last_change":"2024-09-21T01:39:51.335239+0000","last_active":"2024-09-21T01:41:10.504489+0000","last_peered":"2024-09-21T01:41:10.504489+0000","last_clean":"2024-09-21T01:41:10.504489+0000","last_became_active":"2024-09-21T01:39:51.334846+0000","last_became_peered":"2024-09-21T01:39:51.334846+0000","last_unstale":"2024-09-21T01:41:10.504489+0000","last_undegraded":"2024-09-21T01:41:10.504489+0000","last_fullsized":"2024-09-21T01:41:10.504489+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:47:30.820219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"84'6","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.023832+0000","last_change":"2024-09-21T01:39:44.296080+0000","last_active":"2024-09-21T01:41:39.023832+0000","last_peered":"2024-09-21T01:41:39.023832+0000","last_clean":"2024-09-21T01:41:39.023832+0000","last_became_active":"2024-09-21T01:39:44.295724+0000","last_became_peered":"2024-09-21T01:39:44.295724+0000","last_unstale":"2024-09-21T01:41:39.023832+0000","last_undegraded":"2024-09-21T01:41:39.023832+0000","last_fullsized":"2024-09-21T01:41:39.023832+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:20:56.366350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.503820+0000","last_change":"2024-09-21T01:39:42.264499+0000","last_active":"2024-09-21T01:41:10.503820+0000","last_peered":"2024-09-21T01:41:10.503820+0000","last_clean":"2024-09-21T01:41:10.503820+0000","last_became_active":"2024-09-21T01:39:42.264059+0000","last_became_peered":"2024-09-21T01:39:42.264059+0000","last_unstale":"2024-09-21T01:41:10.503820+0000","last_undegraded":"2024-09-21T01:41:10.503820+0000","last_fullsized":"2024-09-21T01:41:10.503820+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:27:42.970693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:09.877344+0000","last_change":"2024-09-21T01:39:51.329357+0000","last_active":"2024-09-21T01:41:09.877344+0000","last_peered":"2024-09-21T01:41:09.877344+0000","last_clean":"2024-09-21T01:41:09.877344+0000","last_became_active":"2024-09-21T01:39:51.328761+0000","last_became_peered":"2024-09-21T01:39:51.328761+0000","last_unstale":"2024-09-21T01:41:09.877344+0000","last_undegraded":"2024-09-21T01:41:09.877344+0000","last_fullsized":"2024-09-21T01:41:09.877344+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:48:04.089765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"84'15","reported_seq":49,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.025370+0000","last_change":"2024-09-21T01:39:44.295799+0000","last_active":"2024-09-21T01:41:39.025370+0000","last_peered":"2024-09-21T01:41:39.025370+0000","last_clean":"2024-09-21T01:41:39.025370+0000","last_became_active":"2024-09-21T01:39:44.295432+0000","last_became_peered":"2024-09-21T01:39:44.295432+0000","last_unstale":"2024-09-21T01:41:39.025370+0000","last_undegraded":"2024-09-21T01:41:39.025370+0000","last_fullsized":"2024-09-21T01:41:39.025370+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:18:10.702545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.044394+0000","last_change":"2024-09-21T01:39:42.270552+0000","last_active":"2024-09-21T01:41:10.044394+0000","last_peered":"2024-09-21T01:41:10.044394+0000","last_clean":"2024-09-21T01:41:10.044394+0000","last_became_active":"2024-09-21T01:39:42.270158+0000","last_became_peered":"2024-09-21T01:39:42.270158+0000","last_unstale":"2024-09-21T01:41:10.044394+0000","last_undegraded":"2024-09-21T01:41:10.044394+0000","last_fullsized":"2024-09-21T01:41:10.044394+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:19:52.229598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.947461+0000","last_change":"2024-09-21T01:39:51.335823+0000","last_active":"2024-09-21T01:41:10.947461+0000","last_peered":"2024-09-21T01:41:10.947461+0000","last_clean":"2024-09-21T01:41:10.947461+0000","last_became_active":"2024-09-21T01:39:51.335363+0000","last_became_peered":"2024-09-21T01:39:51.335363+0000","last_unstale":"2024-09-21T01:41:10.947461+0000","last_undegraded":"2024-09-21T01:41:10.947461+0000","last_fullsized":"2024-09-21T01:41:10.947461+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:33:01.418708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"84'9","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.022001+0000","last_change":"2024-09-21T01:39:44.288963+0000","last_active":"2024-09-21T01:41:39.022001+0000","last_peered":"2024-09-21T01:41:39.022001+0000","last_clean":"2024-09-21T01:41:39.022001+0000","last_became_active":"2024-09-21T01:39:44.286967+0000","last_became_peered":"2024-09-21T01:39:44.286967+0000","last_unstale":"2024-09-21T01:41:39.022001+0000","last_undegraded":"2024-09-21T01:41:39.022001+0000","last_fullsized":"2024-09-21T01:41:39.022001+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:02:32.653351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"74'2","reported_seq":42,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:09.881149+0000","last_change":"2024-09-21T01:39:42.268553+0000","last_active":"2024-09-21T01:41:09.881149+0000","last_peered":"2024-09-21T01:41:09.881149+0000","last_clean":"2024-09-21T01:41:09.881149+0000","last_became_active":"2024-09-21T01:39:42.268154+0000","last_became_peered":"2024-09-21T01:39:42.268154+0000","last_unstale":"2024-09-21T01:41:09.881149+0000","last_undegraded":"2024-09-21T01:41:09.881149+0000","last_fullsized":"2024-09-21T01:41:09.881149+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:22:54.223718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.044472+0000","last_change":"2024-09-21T01:39:51.342268+0000","last_active":"2024-09-21T01:41:10.044472+0000","last_peered":"2024-09-21T01:41:10.044472+0000","last_clean":"2024-09-21T01:41:10.044472+0000","last_became_active":"2024-09-21T01:39:51.341221+0000","last_became_peered":"2024-09-21T01:39:51.341221+0000","last_unstale":"2024-09-21T01:41:10.044472+0000","last_undegraded":"2024-09-21T01:41:10.044472+0000","last_fullsized":"2024-09-21T01:41:10.044472+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:46:16.297124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"84'6","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.022766+0000","last_change":"2024-09-21T01:39:44.300338+0000","last_active":"2024-09-21T01:41:39.022766+0000","last_peered":"2024-09-21T01:41:39.022766+0000","last_clean":"2024-09-21T01:41:39.022766+0000","last_became_active":"2024-09-21T01:39:44.299920+0000","last_became_peered":"2024-09-21T01:39:44.299920+0000","last_unstale":"2024-09-21T01:41:39.022766+0000","last_undegraded":"2024-09-21T01:41:39.022766+0000","last_fullsized":"2024-09-21T01:41:39.022766+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:23:47.631867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"84'33","reported_seq":256,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:53.118649+0000","last_change":"2024-09-21T01:39:42.266883+0000","last_active":"2024-09-21T01:41:53.118649+0000","last_peered":"2024-09-21T01:41:53.118649+0000","last_clean":"2024-09-21T01:41:53.118649+0000","last_became_active":"2024-09-21T01:39:42.266494+0000","last_became_peered":"2024-09-21T01:39:42.266494+0000","last_unstale":"2024-09-21T01:41:53.118649+0000","last_undegraded":"2024-09-21T01:41:53.118649+0000","last_fullsized":"2024-09-21T01:41:53.118649+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:56:46.777522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67896,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":184,"num_read_kb":158,"num_write":33,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.040673+0000","last_change":"2024-09-21T01:40:09.842036+0000","last_active":"2024-09-21T01:41:10.040673+0000","last_peered":"2024-09-21T01:41:10.040673+0000","last_clean":"2024-09-21T01:41:10.040673+0000","last_became_active":"2024-09-21T01:40:09.841680+0000","last_became_peered":"2024-09-21T01:40:09.841680+0000","last_unstale":"2024-09-21T01:41:10.040673+0000","last_undegraded":"2024-09-21T01:41:10.040673+0000","last_fullsized":"2024-09-21T01:41:10.040673+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:01:58.366511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,11,5],"acting":[10,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.14","version":"84'11","reported_seq":44,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.030064+0000","last_change":"2024-09-21T01:39:44.296958+0000","last_active":"2024-09-21T01:41:39.030064+0000","last_peered":"2024-09-21T01:41:39.030064+0000","last_clean":"2024-09-21T01:41:39.030064+0000","last_became_active":"2024-09-21T01:39:44.296588+0000","last_became_peered":"2024-09-21T01:39:44.296588+0000","last_unstale":"2024-09-21T01:41:39.030064+0000","last_undegraded":"2024-09-21T01:41:39.030064+0000","last_fullsized":"2024-09-21T01:41:39.030064+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:04:25.222279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"74'3","reported_seq":42,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.044764+0000","last_change":"2024-09-21T01:39:42.550770+0000","last_active":"2024-09-21T01:41:10.044764+0000","last_peered":"2024-09-21T01:41:10.044764+0000","last_clean":"2024-09-21T01:41:10.044764+0000","last_became_active":"2024-09-21T01:39:42.550317+0000","last_became_peered":"2024-09-21T01:39:42.550317+0000","last_unstale":"2024-09-21T01:41:10.044764+0000","last_undegraded":"2024-09-21T01:41:10.044764+0000","last_fullsized":"2024-09-21T01:41:10.044764+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:11:05.269317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.504279+0000","last_change":"2024-09-21T01:39:51.342166+0000","last_active":"2024-09-21T01:41:10.504279+0000","last_peered":"2024-09-21T01:41:10.504279+0000","last_clean":"2024-09-21T01:41:10.504279+0000","last_became_active":"2024-09-21T01:39:51.341633+0000","last_became_peered":"2024-09-21T01:39:51.341633+0000","last_unstale":"2024-09-21T01:41:10.504279+0000","last_undegraded":"2024-09-21T01:41:10.504279+0000","last_fullsized":"2024-09-21T01:41:10.504279+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:47:13.524123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"84'9","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.016737+0000","last_change":"2024-09-21T01:39:44.297652+0000","last_active":"2024-09-21T01:41:39.016737+0000","last_peered":"2024-09-21T01:41:39.016737+0000","last_clean":"2024-09-21T01:41:39.016737+0000","last_became_active":"2024-09-21T01:39:44.297289+0000","last_became_peered":"2024-09-21T01:39:44.297289+0000","last_unstale":"2024-09-21T01:41:39.016737+0000","last_undegraded":"2024-09-21T01:41:39.016737+0000","last_fullsized":"2024-09-21T01:41:39.016737+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:14:52.834492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:09.878796+0000","last_change":"2024-09-21T01:39:42.269881+0000","last_active":"2024-09-21T01:41:09.878796+0000","last_peered":"2024-09-21T01:41:09.878796+0000","last_clean":"2024-09-21T01:41:09.878796+0000","last_became_active":"2024-09-21T01:39:42.269498+0000","last_became_peered":"2024-09-21T01:39:42.269498+0000","last_unstale":"2024-09-21T01:41:09.878796+0000","last_undegraded":"2024-09-21T01:41:09.878796+0000","last_fullsized":"2024-09-21T01:41:09.878796+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:10:31.750792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.503690+0000","last_change":"2024-09-21T01:40:10.063827+0000","last_active":"2024-09-21T01:41:10.503690+0000","last_peered":"2024-09-21T01:41:10.503690+0000","last_clean":"2024-09-21T01:41:10.503690+0000","last_became_active":"2024-09-21T01:40:10.063206+0000","last_became_peered":"2024-09-21T01:40:10.063206+0000","last_unstale":"2024-09-21T01:41:10.503690+0000","last_undegraded":"2024-09-21T01:41:10.503690+0000","last_fullsized":"2024-09-21T01:41:10.503690+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:33:28.905812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2,4],"acting":[8,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.16","version":"84'10","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.027736+0000","last_change":"2024-09-21T01:39:44.292241+0000","last_active":"2024-09-21T01:41:39.027736+0000","last_peered":"2024-09-21T01:41:39.027736+0000","last_clean":"2024-09-21T01:41:39.027736+0000","last_became_active":"2024-09-21T01:39:44.291808+0000","last_became_peered":"2024-09-21T01:39:44.291808+0000","last_unstale":"2024-09-21T01:41:39.027736+0000","last_undegraded":"2024-09-21T01:41:39.027736+0000","last_fullsized":"2024-09-21T01:41:39.027736+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:47:24.761137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.041221+0000","last_change":"2024-09-21T01:39:42.272047+0000","last_active":"2024-09-21T01:41:10.041221+0000","last_peered":"2024-09-21T01:41:10.041221+0000","last_clean":"2024-09-21T01:41:10.041221+0000","last_became_active":"2024-09-21T01:39:42.271668+0000","last_became_peered":"2024-09-21T01:39:42.271668+0000","last_unstale":"2024-09-21T01:41:10.041221+0000","last_undegraded":"2024-09-21T01:41:10.041221+0000","last_fullsized":"2024-09-21T01:41:10.041221+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:44:09.702328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.505772+0000","last_change":"2024-09-21T01:39:51.337760+0000","last_active":"2024-09-21T01:41:10.505772+0000","last_peered":"2024-09-21T01:41:10.505772+0000","last_clean":"2024-09-21T01:41:10.505772+0000","last_became_active":"2024-09-21T01:39:51.337337+0000","last_became_peered":"2024-09-21T01:39:51.337337+0000","last_unstale":"2024-09-21T01:41:10.505772+0000","last_undegraded":"2024-09-21T01:41:10.505772+0000","last_fullsized":"2024-09-21T01:41:10.505772+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:33:49.316833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.503794+0000","last_change":"2024-09-21T01:39:51.334722+0000","last_active":"2024-09-21T01:41:10.503794+0000","last_peered":"2024-09-21T01:41:10.503794+0000","last_clean":"2024-09-21T01:41:10.503794+0000","last_became_active":"2024-09-21T01:39:51.334318+0000","last_became_peered":"2024-09-21T01:39:51.334318+0000","last_unstale":"2024-09-21T01:41:10.503794+0000","last_undegraded":"2024-09-21T01:41:10.503794+0000","last_fullsized":"2024-09-21T01:41:10.503794+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:29:17.625223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"84'11","reported_seq":45,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.006715+0000","last_change":"2024-09-21T01:39:44.283183+0000","last_active":"2024-09-21T01:41:39.006715+0000","last_peered":"2024-09-21T01:41:39.006715+0000","last_clean":"2024-09-21T01:41:39.006715+0000","last_became_active":"2024-09-21T01:39:44.282829+0000","last_became_peered":"2024-09-21T01:39:44.282829+0000","last_unstale":"2024-09-21T01:41:39.006715+0000","last_undegraded":"2024-09-21T01:41:39.006715+0000","last_fullsized":"2024-09-21T01:41:39.006715+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:31:43.602584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.044143+0000","last_change":"2024-09-21T01:39:42.267465+0000","last_active":"2024-09-21T01:41:10.044143+0000","last_peered":"2024-09-21T01:41:10.044143+0000","last_clean":"2024-09-21T01:41:10.044143+0000","last_became_active":"2024-09-21T01:39:42.267051+0000","last_became_peered":"2024-09-21T01:39:42.267051+0000","last_unstale":"2024-09-21T01:41:10.044143+0000","last_undegraded":"2024-09-21T01:41:10.044143+0000","last_fullsized":"2024-09-21T01:41:10.044143+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:17:30.917284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.947577+0000","last_change":"2024-09-21T01:39:51.338907+0000","last_active":"2024-09-21T01:41:10.947577+0000","last_peered":"2024-09-21T01:41:10.947577+0000","last_clean":"2024-09-21T01:41:10.947577+0000","last_became_active":"2024-09-21T01:39:51.338444+0000","last_became_peered":"2024-09-21T01:39:51.338444+0000","last_unstale":"2024-09-21T01:41:10.947577+0000","last_undegraded":"2024-09-21T01:41:10.947577+0000","last_fullsized":"2024-09-21T01:41:10.947577+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:35:44.819976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"84'8","reported_seq":42,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.015629+0000","last_change":"2024-09-21T01:39:44.293735+0000","last_active":"2024-09-21T01:41:39.015629+0000","last_peered":"2024-09-21T01:41:39.015629+0000","last_clean":"2024-09-21T01:41:39.015629+0000","last_became_active":"2024-09-21T01:39:44.293371+0000","last_became_peered":"2024-09-21T01:39:44.293371+0000","last_unstale":"2024-09-21T01:41:39.015629+0000","last_undegraded":"2024-09-21T01:41:39.015629+0000","last_fullsized":"2024-09-21T01:41:39.015629+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:50:50.404018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.503564+0000","last_change":"2024-09-21T01:39:42.259012+0000","last_active":"2024-09-21T01:41:10.503564+0000","last_peered":"2024-09-21T01:41:10.503564+0000","last_clean":"2024-09-21T01:41:10.503564+0000","last_became_active":"2024-09-21T01:39:42.258665+0000","last_became_peered":"2024-09-21T01:39:42.258665+0000","last_unstale":"2024-09-21T01:41:10.503564+0000","last_undegraded":"2024-09-21T01:41:10.503564+0000","last_fullsized":"2024-09-21T01:41:10.503564+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:25:24.797505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"74'1","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.040907+0000","last_change":"2024-09-21T01:39:42.270969+0000","last_active":"2024-09-21T01:41:10.040907+0000","last_peered":"2024-09-21T01:41:10.040907+0000","last_clean":"2024-09-21T01:41:10.040907+0000","last_became_active":"2024-09-21T01:39:42.270629+0000","last_became_peered":"2024-09-21T01:39:42.270629+0000","last_unstale":"2024-09-21T01:41:10.040907+0000","last_undegraded":"2024-09-21T01:41:10.040907+0000","last_fullsized":"2024-09-21T01:41:10.040907+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:30:06.321196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"84'8","reported_seq":42,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.019197+0000","last_change":"2024-09-21T01:39:44.297656+0000","last_active":"2024-09-21T01:41:39.019197+0000","last_peered":"2024-09-21T01:41:39.019197+0000","last_clean":"2024-09-21T01:41:39.019197+0000","last_became_active":"2024-09-21T01:39:44.297273+0000","last_became_peered":"2024-09-21T01:39:44.297273+0000","last_unstale":"2024-09-21T01:41:39.019197+0000","last_undegraded":"2024-09-21T01:41:39.019197+0000","last_fullsized":"2024-09-21T01:41:39.019197+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:35:24.645472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:09.881207+0000","last_change":"2024-09-21T01:40:09.842397+0000","last_active":"2024-09-21T01:41:09.881207+0000","last_peered":"2024-09-21T01:41:09.881207+0000","last_clean":"2024-09-21T01:41:09.881207+0000","last_became_active":"2024-09-21T01:40:09.841934+0000","last_became_peered":"2024-09-21T01:40:09.841934+0000","last_unstale":"2024-09-21T01:41:09.881207+0000","last_undegraded":"2024-09-21T01:41:09.881207+0000","last_fullsized":"2024-09-21T01:41:09.881207+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:06:36.189594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,8,5],"acting":[2,6,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"74'1","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.044389+0000","last_change":"2024-09-21T01:39:42.267207+0000","last_active":"2024-09-21T01:41:10.044389+0000","last_peered":"2024-09-21T01:41:10.044389+0000","last_clean":"2024-09-21T01:41:10.044389+0000","last_became_active":"2024-09-21T01:39:42.266829+0000","last_became_peered":"2024-09-21T01:39:42.266829+0000","last_unstale":"2024-09-21T01:41:10.044389+0000","last_undegraded":"2024-09-21T01:41:10.044389+0000","last_fullsized":"2024-09-21T01:41:10.044389+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:03:18.047546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"84'7","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.011573+0000","last_change":"2024-09-21T01:39:44.305545+0000","last_active":"2024-09-21T01:41:39.011573+0000","last_peered":"2024-09-21T01:41:39.011573+0000","last_clean":"2024-09-21T01:41:39.011573+0000","last_became_active":"2024-09-21T01:39:44.305195+0000","last_became_peered":"2024-09-21T01:39:44.305195+0000","last_unstale":"2024-09-21T01:41:39.011573+0000","last_undegraded":"2024-09-21T01:41:39.011573+0000","last_fullsized":"2024-09-21T01:41:39.011573+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:26:50.011622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:09.881130+0000","last_change":"2024-09-21T01:39:51.342132+0000","last_active":"2024-09-21T01:41:09.881130+0000","last_peered":"2024-09-21T01:41:09.881130+0000","last_clean":"2024-09-21T01:41:09.881130+0000","last_became_active":"2024-09-21T01:39:51.341668+0000","last_became_peered":"2024-09-21T01:39:51.341668+0000","last_unstale":"2024-09-21T01:41:09.881130+0000","last_undegraded":"2024-09-21T01:41:09.881130+0000","last_fullsized":"2024-09-21T01:41:09.881130+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:28:18.119259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"84'9","reported_seq":44,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.018291+0000","last_change":"2024-09-21T01:39:44.300226+0000","last_active":"2024-09-21T01:41:39.018291+0000","last_peered":"2024-09-21T01:41:39.018291+0000","last_clean":"2024-09-21T01:41:39.018291+0000","last_became_active":"2024-09-21T01:39:44.298740+0000","last_became_peered":"2024-09-21T01:39:44.298740+0000","last_unstale":"2024-09-21T01:41:39.018291+0000","last_undegraded":"2024-09-21T01:41:39.018291+0000","last_fullsized":"2024-09-21T01:41:39.018291+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:05:33.288070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"84'12","reported_seq":47,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.019746+0000","last_change":"2024-09-21T01:39:44.301379+0000","last_active":"2024-09-21T01:41:39.019746+0000","last_peered":"2024-09-21T01:41:39.019746+0000","last_clean":"2024-09-21T01:41:39.019746+0000","last_became_active":"2024-09-21T01:39:44.301011+0000","last_became_peered":"2024-09-21T01:39:44.301011+0000","last_unstale":"2024-09-21T01:41:39.019746+0000","last_undegraded":"2024-09-21T01:41:39.019746+0000","last_fullsized":"2024-09-21T01:41:39.019746+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:16:47.672736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"84'8","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.009440+0000","last_change":"2024-09-21T01:39:44.294318+0000","last_active":"2024-09-21T01:41:39.009440+0000","last_peered":"2024-09-21T01:41:39.009440+0000","last_clean":"2024-09-21T01:41:39.009440+0000","last_became_active":"2024-09-21T01:39:44.293941+0000","last_became_peered":"2024-09-21T01:39:44.293941+0000","last_unstale":"2024-09-21T01:41:39.009440+0000","last_undegraded":"2024-09-21T01:41:39.009440+0000","last_fullsized":"2024-09-21T01:41:39.009440+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:27:34.776088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"84'7","reported_seq":42,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.017627+0000","last_change":"2024-09-21T01:39:44.287815+0000","last_active":"2024-09-21T01:41:39.017627+0000","last_peered":"2024-09-21T01:41:39.017627+0000","last_clean":"2024-09-21T01:41:39.017627+0000","last_became_active":"2024-09-21T01:39:44.287471+0000","last_became_peered":"2024-09-21T01:39:44.287471+0000","last_unstale":"2024-09-21T01:41:39.017627+0000","last_undegraded":"2024-09-21T01:41:39.017627+0000","last_fullsized":"2024-09-21T01:41:39.017627+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:13:59.661464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"84'4","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.017823+0000","last_change":"2024-09-21T01:39:44.285591+0000","last_active":"2024-09-21T01:41:39.017823+0000","last_peered":"2024-09-21T01:41:39.017823+0000","last_clean":"2024-09-21T01:41:39.017823+0000","last_became_active":"2024-09-21T01:39:44.285253+0000","last_became_peered":"2024-09-21T01:39:44.285253+0000","last_unstale":"2024-09-21T01:41:39.017823+0000","last_undegraded":"2024-09-21T01:41:39.017823+0000","last_fullsized":"2024-09-21T01:41:39.017823+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:58:02.890685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"84'6","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.008718+0000","last_change":"2024-09-21T01:39:44.306547+0000","last_active":"2024-09-21T01:41:39.008718+0000","last_peered":"2024-09-21T01:41:39.008718+0000","last_clean":"2024-09-21T01:41:39.008718+0000","last_became_active":"2024-09-21T01:39:44.306116+0000","last_became_peered":"2024-09-21T01:39:44.306116+0000","last_unstale":"2024-09-21T01:41:39.008718+0000","last_undegraded":"2024-09-21T01:41:39.008718+0000","last_fullsized":"2024-09-21T01:41:39.008718+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:58:40.654784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"84'15","reported_seq":50,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.027813+0000","last_change":"2024-09-21T01:39:44.295317+0000","last_active":"2024-09-21T01:41:39.027813+0000","last_peered":"2024-09-21T01:41:39.027813+0000","last_clean":"2024-09-21T01:41:39.027813+0000","last_became_active":"2024-09-21T01:39:44.294936+0000","last_became_peered":"2024-09-21T01:39:44.294936+0000","last_unstale":"2024-09-21T01:41:39.027813+0000","last_undegraded":"2024-09-21T01:41:39.027813+0000","last_fullsized":"2024-09-21T01:41:39.027813+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:32:24.112588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"84'2","reported_seq":37,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.004826+0000","last_change":"2024-09-21T01:39:44.297242+0000","last_active":"2024-09-21T01:41:39.004826+0000","last_peered":"2024-09-21T01:41:39.004826+0000","last_clean":"2024-09-21T01:41:39.004826+0000","last_became_active":"2024-09-21T01:39:44.296072+0000","last_became_peered":"2024-09-21T01:39:44.296072+0000","last_unstale":"2024-09-21T01:41:39.004826+0000","last_undegraded":"2024-09-21T01:41:39.004826+0000","last_fullsized":"2024-09-21T01:41:39.004826+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:22:23.449535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"84'6","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.018645+0000","last_change":"2024-09-21T01:39:44.293899+0000","last_active":"2024-09-21T01:41:39.018645+0000","last_peered":"2024-09-21T01:41:39.018645+0000","last_clean":"2024-09-21T01:41:39.018645+0000","last_became_active":"2024-09-21T01:39:44.293502+0000","last_became_peered":"2024-09-21T01:39:44.293502+0000","last_unstale":"2024-09-21T01:41:39.018645+0000","last_undegraded":"2024-09-21T01:41:39.018645+0000","last_fullsized":"2024-09-21T01:41:39.018645+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:07:39.549931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"84'8","reported_seq":42,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.012852+0000","last_change":"2024-09-21T01:39:44.298192+0000","last_active":"2024-09-21T01:41:39.012852+0000","last_peered":"2024-09-21T01:41:39.012852+0000","last_clean":"2024-09-21T01:41:39.012852+0000","last_became_active":"2024-09-21T01:39:44.297834+0000","last_became_peered":"2024-09-21T01:39:44.297834+0000","last_unstale":"2024-09-21T01:41:39.012852+0000","last_undegraded":"2024-09-21T01:41:39.012852+0000","last_fullsized":"2024-09-21T01:41:39.012852+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:41:21.759972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"84'10","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.031026+0000","last_change":"2024-09-21T01:39:44.300125+0000","last_active":"2024-09-21T01:41:39.031026+0000","last_peered":"2024-09-21T01:41:39.031026+0000","last_clean":"2024-09-21T01:41:39.031026+0000","last_became_active":"2024-09-21T01:39:44.298047+0000","last_became_peered":"2024-09-21T01:39:44.298047+0000","last_unstale":"2024-09-21T01:41:39.031026+0000","last_undegraded":"2024-09-21T01:41:39.031026+0000","last_fullsized":"2024-09-21T01:41:39.031026+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:31:58.719520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"84'11","reported_seq":45,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.018117+0000","last_change":"2024-09-21T01:39:44.287346+0000","last_active":"2024-09-21T01:41:39.018117+0000","last_peered":"2024-09-21T01:41:39.018117+0000","last_clean":"2024-09-21T01:41:39.018117+0000","last_became_active":"2024-09-21T01:39:44.286999+0000","last_became_peered":"2024-09-21T01:39:44.286999+0000","last_unstale":"2024-09-21T01:41:39.018117+0000","last_undegraded":"2024-09-21T01:41:39.018117+0000","last_fullsized":"2024-09-21T01:41:39.018117+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:42:26.732516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"84'8","reported_seq":42,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.021318+0000","last_change":"2024-09-21T01:39:44.299083+0000","last_active":"2024-09-21T01:41:39.021318+0000","last_peered":"2024-09-21T01:41:39.021318+0000","last_clean":"2024-09-21T01:41:39.021318+0000","last_became_active":"2024-09-21T01:39:44.298194+0000","last_became_peered":"2024-09-21T01:39:44.298194+0000","last_unstale":"2024-09-21T01:41:39.021318+0000","last_undegraded":"2024-09-21T01:41:39.021318+0000","last_fullsized":"2024-09-21T01:41:39.021318+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:22:23.360519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"84'7","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.004792+0000","last_change":"2024-09-21T01:39:44.292985+0000","last_active":"2024-09-21T01:41:39.004792+0000","last_peered":"2024-09-21T01:41:39.004792+0000","last_clean":"2024-09-21T01:41:39.004792+0000","last_became_active":"2024-09-21T01:39:44.292565+0000","last_became_peered":"2024-09-21T01:39:44.292565+0000","last_unstale":"2024-09-21T01:41:39.004792+0000","last_undegraded":"2024-09-21T01:41:39.004792+0000","last_fullsized":"2024-09-21T01:41:39.004792+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:03:33.563458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"84'10","reported_seq":44,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.026635+0000","last_change":"2024-09-21T01:39:44.291522+0000","last_active":"2024-09-21T01:41:39.026635+0000","last_peered":"2024-09-21T01:41:39.026635+0000","last_clean":"2024-09-21T01:41:39.026635+0000","last_became_active":"2024-09-21T01:39:44.291173+0000","last_became_peered":"2024-09-21T01:39:44.291173+0000","last_unstale":"2024-09-21T01:41:39.026635+0000","last_undegraded":"2024-09-21T01:41:39.026635+0000","last_fullsized":"2024-09-21T01:41:39.026635+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:41:54.562004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"84'8","reported_seq":42,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.026808+0000","last_change":"2024-09-21T01:39:44.305053+0000","last_active":"2024-09-21T01:41:39.026808+0000","last_peered":"2024-09-21T01:41:39.026808+0000","last_clean":"2024-09-21T01:41:39.026808+0000","last_became_active":"2024-09-21T01:39:44.304651+0000","last_became_peered":"2024-09-21T01:39:44.304651+0000","last_unstale":"2024-09-21T01:41:39.026808+0000","last_undegraded":"2024-09-21T01:41:39.026808+0000","last_fullsized":"2024-09-21T01:41:39.026808+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:15:42.819633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"84'9","reported_seq":42,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.031281+0000","last_change":"2024-09-21T01:39:44.298405+0000","last_active":"2024-09-21T01:41:39.031281+0000","last_peered":"2024-09-21T01:41:39.031281+0000","last_clean":"2024-09-21T01:41:39.031281+0000","last_became_active":"2024-09-21T01:39:44.298010+0000","last_became_peered":"2024-09-21T01:39:44.298010+0000","last_unstale":"2024-09-21T01:41:39.031281+0000","last_undegraded":"2024-09-21T01:41:39.031281+0000","last_fullsized":"2024-09-21T01:41:39.031281+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:09:15.321530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"84'7","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.017606+0000","last_change":"2024-09-21T01:39:44.290593+0000","last_active":"2024-09-21T01:41:39.017606+0000","last_peered":"2024-09-21T01:41:39.017606+0000","last_clean":"2024-09-21T01:41:39.017606+0000","last_became_active":"2024-09-21T01:39:44.290235+0000","last_became_peered":"2024-09-21T01:39:44.290235+0000","last_unstale":"2024-09-21T01:41:39.017606+0000","last_undegraded":"2024-09-21T01:41:39.017606+0000","last_fullsized":"2024-09-21T01:41:39.017606+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:52:20.359493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"84'7","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.021489+0000","last_change":"2024-09-21T01:39:44.301902+0000","last_active":"2024-09-21T01:41:39.021489+0000","last_peered":"2024-09-21T01:41:39.021489+0000","last_clean":"2024-09-21T01:41:39.021489+0000","last_became_active":"2024-09-21T01:39:44.301494+0000","last_became_peered":"2024-09-21T01:39:44.301494+0000","last_unstale":"2024-09-21T01:41:39.021489+0000","last_undegraded":"2024-09-21T01:41:39.021489+0000","last_fullsized":"2024-09-21T01:41:39.021489+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:06:16.162987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"84'10","reported_seq":44,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.019702+0000","last_change":"2024-09-21T01:39:44.292360+0000","last_active":"2024-09-21T01:41:39.019702+0000","last_peered":"2024-09-21T01:41:39.019702+0000","last_clean":"2024-09-21T01:41:39.019702+0000","last_became_active":"2024-09-21T01:39:44.291995+0000","last_became_peered":"2024-09-21T01:39:44.291995+0000","last_unstale":"2024-09-21T01:41:39.019702+0000","last_undegraded":"2024-09-21T01:41:39.019702+0000","last_fullsized":"2024-09-21T01:41:39.019702+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:29:10.511082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"84'7","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.020802+0000","last_change":"2024-09-21T01:39:44.291836+0000","last_active":"2024-09-21T01:41:39.020802+0000","last_peered":"2024-09-21T01:41:39.020802+0000","last_clean":"2024-09-21T01:41:39.020802+0000","last_became_active":"2024-09-21T01:39:44.291459+0000","last_became_peered":"2024-09-21T01:39:44.291459+0000","last_unstale":"2024-09-21T01:41:39.020802+0000","last_undegraded":"2024-09-21T01:41:39.020802+0000","last_fullsized":"2024-09-21T01:41:39.020802+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:11:53.296520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"84'6","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.030806+0000","last_change":"2024-09-21T01:39:44.298572+0000","last_active":"2024-09-21T01:41:39.030806+0000","last_peered":"2024-09-21T01:41:39.030806+0000","last_clean":"2024-09-21T01:41:39.030806+0000","last_became_active":"2024-09-21T01:39:44.297903+0000","last_became_peered":"2024-09-21T01:39:44.297903+0000","last_unstale":"2024-09-21T01:41:39.030806+0000","last_undegraded":"2024-09-21T01:41:39.030806+0000","last_fullsized":"2024-09-21T01:41:39.030806+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:25:06.327202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"84'16","reported_seq":50,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.025882+0000","last_change":"2024-09-21T01:39:44.292648+0000","last_active":"2024-09-21T01:41:39.025882+0000","last_peered":"2024-09-21T01:41:39.025882+0000","last_clean":"2024-09-21T01:41:39.025882+0000","last_became_active":"2024-09-21T01:39:44.292215+0000","last_became_peered":"2024-09-21T01:39:44.292215+0000","last_unstale":"2024-09-21T01:41:39.025882+0000","last_undegraded":"2024-09-21T01:41:39.025882+0000","last_fullsized":"2024-09-21T01:41:39.025882+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:43:02.265276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"84'11","reported_seq":44,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.030192+0000","last_change":"2024-09-21T01:39:44.303330+0000","last_active":"2024-09-21T01:41:39.030192+0000","last_peered":"2024-09-21T01:41:39.030192+0000","last_clean":"2024-09-21T01:41:39.030192+0000","last_became_active":"2024-09-21T01:39:44.302862+0000","last_became_peered":"2024-09-21T01:39:44.302862+0000","last_unstale":"2024-09-21T01:41:39.030192+0000","last_undegraded":"2024-09-21T01:41:39.030192+0000","last_fullsized":"2024-09-21T01:41:39.030192+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:58:12.296150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"84'9","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.018434+0000","last_change":"2024-09-21T01:39:44.288015+0000","last_active":"2024-09-21T01:41:39.018434+0000","last_peered":"2024-09-21T01:41:39.018434+0000","last_clean":"2024-09-21T01:41:39.018434+0000","last_became_active":"2024-09-21T01:39:44.287455+0000","last_became_peered":"2024-09-21T01:39:44.287455+0000","last_unstale":"2024-09-21T01:41:39.018434+0000","last_undegraded":"2024-09-21T01:41:39.018434+0000","last_fullsized":"2024-09-21T01:41:39.018434+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:12:07.036882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"84'5","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.021128+0000","last_change":"2024-09-21T01:39:44.294594+0000","last_active":"2024-09-21T01:41:39.021128+0000","last_peered":"2024-09-21T01:41:39.021128+0000","last_clean":"2024-09-21T01:41:39.021128+0000","last_became_active":"2024-09-21T01:39:44.294218+0000","last_became_peered":"2024-09-21T01:39:44.294218+0000","last_unstale":"2024-09-21T01:41:39.021128+0000","last_undegraded":"2024-09-21T01:41:39.021128+0000","last_fullsized":"2024-09-21T01:41:39.021128+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:45:54.875131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"84'6","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.001865+0000","last_change":"2024-09-21T01:39:44.285172+0000","last_active":"2024-09-21T01:41:39.001865+0000","last_peered":"2024-09-21T01:41:39.001865+0000","last_clean":"2024-09-21T01:41:39.001865+0000","last_became_active":"2024-09-21T01:39:44.284799+0000","last_became_peered":"2024-09-21T01:39:44.284799+0000","last_unstale":"2024-09-21T01:41:39.001865+0000","last_undegraded":"2024-09-21T01:41:39.001865+0000","last_fullsized":"2024-09-21T01:41:39.001865+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:06:30.562297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"84'4","reported_seq":38,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:38.994895+0000","last_change":"2024-09-21T01:39:44.295990+0000","last_active":"2024-09-21T01:41:38.994895+0000","last_peered":"2024-09-21T01:41:38.994895+0000","last_clean":"2024-09-21T01:41:38.994895+0000","last_became_active":"2024-09-21T01:39:44.295601+0000","last_became_peered":"2024-09-21T01:39:44.295601+0000","last_unstale":"2024-09-21T01:41:38.994895+0000","last_undegraded":"2024-09-21T01:41:38.994895+0000","last_fullsized":"2024-09-21T01:41:38.994895+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:37:08.300911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"84'8","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.007027+0000","last_change":"2024-09-21T01:39:44.300104+0000","last_active":"2024-09-21T01:41:39.007027+0000","last_peered":"2024-09-21T01:41:39.007027+0000","last_clean":"2024-09-21T01:41:39.007027+0000","last_became_active":"2024-09-21T01:39:44.299709+0000","last_became_peered":"2024-09-21T01:39:44.299709+0000","last_unstale":"2024-09-21T01:41:39.007027+0000","last_undegraded":"2024-09-21T01:41:39.007027+0000","last_fullsized":"2024-09-21T01:41:39.007027+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:01:35.013021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"84'7","reported_seq":42,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.027402+0000","last_change":"2024-09-21T01:39:44.295900+0000","last_active":"2024-09-21T01:41:39.027402+0000","last_peered":"2024-09-21T01:41:39.027402+0000","last_clean":"2024-09-21T01:41:39.027402+0000","last_became_active":"2024-09-21T01:39:44.295303+0000","last_became_peered":"2024-09-21T01:39:44.295303+0000","last_unstale":"2024-09-21T01:41:39.027402+0000","last_undegraded":"2024-09-21T01:41:39.027402+0000","last_fullsized":"2024-09-21T01:41:39.027402+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:00:23.097745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"84'4","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.018723+0000","last_change":"2024-09-21T01:39:44.303627+0000","last_active":"2024-09-21T01:41:39.018723+0000","last_peered":"2024-09-21T01:41:39.018723+0000","last_clean":"2024-09-21T01:41:39.018723+0000","last_became_active":"2024-09-21T01:39:44.303260+0000","last_became_peered":"2024-09-21T01:39:44.303260+0000","last_unstale":"2024-09-21T01:41:39.018723+0000","last_undegraded":"2024-09-21T01:41:39.018723+0000","last_fullsized":"2024-09-21T01:41:39.018723+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:17:39.630994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"84'8","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.026548+0000","last_change":"2024-09-21T01:39:44.306087+0000","last_active":"2024-09-21T01:41:39.026548+0000","last_peered":"2024-09-21T01:41:39.026548+0000","last_clean":"2024-09-21T01:41:39.026548+0000","last_became_active":"2024-09-21T01:39:44.305660+0000","last_became_peered":"2024-09-21T01:39:44.305660+0000","last_unstale":"2024-09-21T01:41:39.026548+0000","last_undegraded":"2024-09-21T01:41:39.026548+0000","last_fullsized":"2024-09-21T01:41:39.026548+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:26:46.911966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":462470,"num_objects":23,"num_object_clones":0,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":222,"num_read_kb":195,"num_write":158,"num_write_kb":970,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":458752,"data_stored":1789750,"data_compressed":74760,"data_compressed_allocated":98304,"data_compressed_original":1523712,"omap_allocated":0,"internal_metadata":0},"log_size":133,"ondisk_log_size":133,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":376832,"data_stored":4132576,"data_compressed":247723,"data_compressed_allocated":315392,"data_compressed_original":4096000,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":68,"seq":292057776168,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":925696,"data_stored":494638,"data_compressed":29495,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939692,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32220,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712932,"statfs":{"total":95995035648,"available":95962042368,"internally_reserved":0,"allocated":1060864,"data_stored":1149000,"data_compressed":65346,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":58,"seq":249108103218,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":933888,"data_stored":499316,"data_compressed":29495,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":52,"seq":223338299448,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":958464,"data_stored":888458,"data_compressed":48784,"data_compressed_allocated":65536,"data_compressed_original":475136,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495676,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32144,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713008,"statfs":{"total":95995035648,"available":95962120192,"internally_reserved":0,"allocated":983040,"data_stored":1089684,"data_compressed":65346,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":41,"seq":176093659201,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":921600,"data_stored":490542,"data_compressed":29495,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855431,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32204,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712948,"statfs":{"total":95995035648,"available":95962058752,"internally_reserved":0,"allocated":1040384,"data_stored":1478964,"data_compressed":83437,"data_compressed_allocated":110592,"data_compressed_original":1040384,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018956,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27932,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717220,"statfs":{"total":95995035648,"available":95966433280,"internally_reserved":0,"allocated":929792,"data_stored":494660,"data_compressed":29495,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182481,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36332,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708820,"statfs":{"total":95995035648,"available":95957831680,"internally_reserved":0,"allocated":1007616,"data_stored":1277638,"data_compressed":66875,"data_compressed_allocated":90112,"data_compressed_original":843776,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411414,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36328,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708824,"statfs":{"total":95995035648,"available":95957835776,"internally_reserved":0,"allocated":1007616,"data_stored":563314,"data_compressed":29495,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574938,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32164,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712988,"statfs":{"total":95995035648,"available":95962099712,"internally_reserved":0,"allocated":1003520,"data_stored":563280,"data_compressed":29495,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705760,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":925696,"data_stored":490632,"data_compressed":29495,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34234,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34234,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35851,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35851,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35851,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35851,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35851,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":72738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":72772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":787096,"data_compressed":37380,"data_compressed_allocated":49152,"data_compressed_original":761856,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":393958,"data_compressed":18091,"data_compressed_allocated":24576,"data_compressed_original":368640,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":393820,"data_compressed":19289,"data_compressed_allocated":24576,"data_compressed_original":393216,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":68090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T01:41:59.814 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-21T01:41:59.814 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph pg dump --format=json 2024-09-21T01:42:00.053 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:41:59 smithi083 ceph-mon[31370]: pgmap v337: 129 pgs: 129 active+clean; 1.0 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 73 KiB/s wr, 10 op/s 2024-09-21T01:42:00.065 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:42:00.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:41:59 smithi142 ceph-mon[34050]: pgmap v337: 129 pgs: 129 active+clean; 1.0 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 73 KiB/s wr, 10 op/s 2024-09-21T01:42:00.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:41:59 smithi119 ceph-mon[33693]: pgmap v337: 129 pgs: 129 active+clean; 1.0 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 73 KiB/s wr, 10 op/s 2024-09-21T01:42:00.511 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:00.510+0000 7f22cd646640 1 -- 172.21.15.83:0/2595723078 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f22c8103b80 msgr2=0x7f22c8103f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:42:00.511 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:00.510+0000 7f22cd646640 1 --2- 172.21.15.83:0/2595723078 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f22c8103b80 0x7f22c8103f90 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f22b8009900 tx=0x7f22b802a410 comp rx=0 tx=0).stop 2024-09-21T01:42:00.511 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:00.510+0000 7f22cd646640 1 -- 172.21.15.83:0/2595723078 shutdown_connections 2024-09-21T01:42:00.511 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:00.510+0000 7f22cd646640 1 --2- 172.21.15.83:0/2595723078 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f22c8109e10 0x7f22c8110640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:42:00.511 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:00.510+0000 7f22cd646640 1 --2- 172.21.15.83:0/2595723078 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f22c81094c0 0x7f22c81098d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:42:00.511 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:00.510+0000 7f22cd646640 1 --2- 172.21.15.83:0/2595723078 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f22c8103b80 0x7f22c8103f90 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:42:00.511 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:00.510+0000 7f22cd646640 1 -- 172.21.15.83:0/2595723078 >> 172.21.15.83:0/2595723078 conn(0x7f22c80ff5b0 msgr2=0x7f22c8101a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:42:00.512 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:00.510+0000 7f22cd646640 1 -- 172.21.15.83:0/2595723078 shutdown_connections 2024-09-21T01:42:00.512 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:00.510+0000 7f22cd646640 1 -- 172.21.15.83:0/2595723078 wait complete. 2024-09-21T01:42:00.513 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:00.511+0000 7f22cd646640 1 Processor -- start 2024-09-21T01:42:00.513 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:00.511+0000 7f22cd646640 1 -- start start 2024-09-21T01:42:00.513 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:00.512+0000 7f22cd646640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f22c8103b80 0x7f22c819c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:42:00.513 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:00.512+0000 7f22cd646640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f22c81094c0 0x7f22c819cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:42:00.513 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:00.512+0000 7f22cd646640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f22c8109e10 0x7f22c81a1e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:42:00.513 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:00.512+0000 7f22cd646640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f22c8077070 con 0x7f22c81094c0 2024-09-21T01:42:00.513 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:00.512+0000 7f22cd646640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f22c8076ef0 con 0x7f22c8109e10 2024-09-21T01:42:00.513 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:00.512+0000 7f22cd646640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f22c80771f0 con 0x7f22c8103b80 2024-09-21T01:42:00.514 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:00.512+0000 7f22be7fc640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f22c81094c0 0x7f22c819cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:42:00.514 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:00.512+0000 7f22be7fc640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f22c81094c0 0x7f22c819cb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:60666/0 (socket says 172.21.15.83:60666) 2024-09-21T01:42:00.514 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:00.512+0000 7f22be7fc640 1 -- 172.21.15.83:0/2416391870 learned_addr learned my addr 172.21.15.83:0/2416391870 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:42:00.514 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:00.512+0000 7f22c6ffd640 1 --2- 172.21.15.83:0/2416391870 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f22c8103b80 0x7f22c819c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:42:00.514 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:00.512+0000 7f22c77fe640 1 --2- 172.21.15.83:0/2416391870 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f22c8109e10 0x7f22c81a1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:42:00.514 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:00.512+0000 7f22be7fc640 1 -- 172.21.15.83:0/2416391870 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f22c8103b80 msgr2=0x7f22c819c5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:42:00.514 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:00.512+0000 7f22be7fc640 1 --2- 172.21.15.83:0/2416391870 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f22c8103b80 0x7f22c819c5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:42:00.514 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:00.512+0000 7f22be7fc640 1 -- 172.21.15.83:0/2416391870 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f22c8109e10 msgr2=0x7f22c81a1e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:42:00.514 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:00.512+0000 7f22be7fc640 1 --2- 172.21.15.83:0/2416391870 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f22c8109e10 0x7f22c81a1e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:42:00.514 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:00.512+0000 7f22be7fc640 1 -- 172.21.15.83:0/2416391870 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22c81a2530 con 0x7f22c81094c0 2024-09-21T01:42:00.514 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:00.512+0000 7f22be7fc640 1 --2- 172.21.15.83:0/2416391870 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f22c81094c0 0x7f22c819cb60 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f22b000c970 tx=0x7f22b000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:42:00.514 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:00.512+0000 7f22c4ff9640 1 -- 172.21.15.83:0/2416391870 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22b0004220 con 0x7f22c81094c0 2024-09-21T01:42:00.514 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:00.512+0000 7f22cd646640 1 -- 172.21.15.83:0/2416391870 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22c81a2820 con 0x7f22c81094c0 2024-09-21T01:42:00.514 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:00.512+0000 7f22c4ff9640 1 -- 172.21.15.83:0/2416391870 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f22b0007e40 con 0x7f22c81094c0 2024-09-21T01:42:00.514 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:00.512+0000 7f22c4ff9640 1 -- 172.21.15.83:0/2416391870 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22b00047a0 con 0x7f22c81094c0 2024-09-21T01:42:00.515 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:00.512+0000 7f22cd646640 1 -- 172.21.15.83:0/2416391870 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22c81a8f80 con 0x7f22c81094c0 2024-09-21T01:42:00.515 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:00.514+0000 7f22cd646640 1 -- 172.21.15.83:0/2416391870 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22c8104e00 con 0x7f22c81094c0 2024-09-21T01:42:00.515 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:00.515+0000 7f22c4ff9640 1 -- 172.21.15.83:0/2416391870 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 23) ==== 154586+0+0 (secure 0 0 0) 0x7f22b00079b0 con 0x7f22c81094c0 2024-09-21T01:42:00.516 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:00.516+0000 7f22c4ff9640 1 --2- 172.21.15.83:0/2416391870 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f22b40b65f0 0x7f22b40b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:42:00.516 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:00.516+0000 7f22c6ffd640 1 --2- 172.21.15.83:0/2416391870 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f22b40b65f0 0x7f22b40b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:42:00.516 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:00.516+0000 7f22c4ff9640 1 -- 172.21.15.83:0/2416391870 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9315+0+0 (secure 0 0 0) 0x7f22b00e75d0 con 0x7f22c81094c0 2024-09-21T01:42:00.516 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:00.516+0000 7f22c6ffd640 1 --2- 172.21.15.83:0/2416391870 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f22b40b65f0 0x7f22b40b8b00 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f22b80057c0 tx=0x7f22b80058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:42:00.520 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:00.520+0000 7f22c4ff9640 1 -- 172.21.15.83:0/2416391870 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f22b0014030 con 0x7f22c81094c0 2024-09-21T01:42:00.694 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:00.694+0000 7f22cd646640 1 -- 172.21.15.83:0/2416391870 --> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f22c8063800 con 0x7f22b40b65f0 2024-09-21T01:42:00.700 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:00.699+0000 7f22c4ff9640 1 -- 172.21.15.83:0/2416391870 <== mgr.14223 v2:172.21.15.83:6800/1748483157 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340722 (secure 0 0 0) 0x7f22c8063800 con 0x7f22b40b65f0 2024-09-21T01:42:00.703 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T01:42:00.704 INFO:teuthology.orchestra.run.smithi083.stderr:dumped all 2024-09-21T01:42:00.706 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:00.702+0000 7f22cd646640 1 -- 172.21.15.83:0/2416391870 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f22b40b65f0 msgr2=0x7f22b40b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:42:00.706 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:00.703+0000 7f22cd646640 1 --2- 172.21.15.83:0/2416391870 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f22b40b65f0 0x7f22b40b8b00 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f22b80057c0 tx=0x7f22b80058d0 comp rx=0 tx=0).stop 2024-09-21T01:42:00.706 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:00.703+0000 7f22cd646640 1 -- 172.21.15.83:0/2416391870 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f22c81094c0 msgr2=0x7f22c819cb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:42:00.707 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:00.703+0000 7f22cd646640 1 --2- 172.21.15.83:0/2416391870 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f22c81094c0 0x7f22c819cb60 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f22b000c970 tx=0x7f22b000ce30 comp rx=0 tx=0).stop 2024-09-21T01:42:00.707 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:00.703+0000 7f22cd646640 1 -- 172.21.15.83:0/2416391870 shutdown_connections 2024-09-21T01:42:00.707 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:00.703+0000 7f22cd646640 1 --2- 172.21.15.83:0/2416391870 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f22b40b65f0 0x7f22b40b8b00 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:42:00.707 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:00.703+0000 7f22cd646640 1 --2- 172.21.15.83:0/2416391870 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f22c8109e10 0x7f22c81a1e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:42:00.707 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:00.703+0000 7f22cd646640 1 --2- 172.21.15.83:0/2416391870 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f22c81094c0 0x7f22c819cb60 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:42:00.707 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:00.703+0000 7f22cd646640 1 --2- 172.21.15.83:0/2416391870 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f22c8103b80 0x7f22c819c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:42:00.707 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:00.703+0000 7f22cd646640 1 -- 172.21.15.83:0/2416391870 >> 172.21.15.83:0/2416391870 conn(0x7f22c80ff5b0 msgr2=0x7f22c8108b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:42:00.707 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:00.703+0000 7f22cd646640 1 -- 172.21.15.83:0/2416391870 shutdown_connections 2024-09-21T01:42:00.707 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:00.703+0000 7f22cd646640 1 -- 172.21.15.83:0/2416391870 wait complete. 2024-09-21T01:42:01.045 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:42:00 smithi083 ceph-mon[31370]: from='client.15441 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T01:42:01.045 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 21 01:42:00 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mgr-x[31598]: 2024-09-21T01:42:00.763+0000 7f4305eeb640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T01:42:01.045 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 21 01:42:00 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mgr-x[31598]: 2024-09-21T01:42:00.763+0000 7f4305eeb640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T01:42:01.045 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 21 01:42:00 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mgr-x[31598]: 2024-09-21T01:42:00.763+0000 7f4305eeb640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T01:42:01.045 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 21 01:42:00 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mgr-x[31598]: 2024-09-21T01:42:00.763+0000 7f4305eeb640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T01:42:01.045 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 21 01:42:00 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mgr-x[31598]: 2024-09-21T01:42:00.763+0000 7f4305eeb640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T01:42:01.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:42:00 smithi142 ceph-mon[34050]: from='client.15441 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T01:42:01.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:42:00 smithi119 ceph-mon[33693]: from='client.15441 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T01:42:01.347 INFO:teuthology.orchestra.run.smithi083.stdout:{"pg_ready":true,"pg_map":{"version":337,"stamp":"2024-09-21T01:41:58.793397+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1053072,"num_objects":27,"num_object_clones":0,"num_object_copies":83,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":303,"num_read_kb":264,"num_write":283,"num_write_kb":3122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":727,"ondisk_log_size":727,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":369000,"kb_used_data":11424,"kb_used_omap":18,"kb_used_meta":357357,"kb_avail":1124572824,"statfs":{"total":1151940427776,"available":1151562571776,"internally_reserved":0,"allocated":11698176,"data_stored":9480126,"data_compressed":536253,"data_compressed_allocated":724992,"data_compressed_original":4276224,"omap_allocated":19139,"internal_metadata":365933885},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":393776,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":52,"num_read_kb":41,"num_write":70,"num_write_kb":872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003675"},"pg_stats":[{"pgid":"2.1f","version":"74'4","reported_seq":45,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:09.877493+0000","last_change":"2024-09-21T01:39:42.267244+0000","last_active":"2024-09-21T01:41:09.877493+0000","last_peered":"2024-09-21T01:41:09.877493+0000","last_clean":"2024-09-21T01:41:09.877493+0000","last_became_active":"2024-09-21T01:39:42.266786+0000","last_became_peered":"2024-09-21T01:39:42.266786+0000","last_unstale":"2024-09-21T01:41:09.877493+0000","last_undegraded":"2024-09-21T01:41:09.877493+0000","last_fullsized":"2024-09-21T01:41:09.877493+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:50:43.594150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"84'5","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.017571+0000","last_change":"2024-09-21T01:39:44.292808+0000","last_active":"2024-09-21T01:41:39.017571+0000","last_peered":"2024-09-21T01:41:39.017571+0000","last_clean":"2024-09-21T01:41:39.017571+0000","last_became_active":"2024-09-21T01:39:44.292416+0000","last_became_peered":"2024-09-21T01:39:44.292416+0000","last_unstale":"2024-09-21T01:41:39.017571+0000","last_undegraded":"2024-09-21T01:41:39.017571+0000","last_fullsized":"2024-09-21T01:41:39.017571+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:26:16.332353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:09.880685+0000","last_change":"2024-09-21T01:39:51.339117+0000","last_active":"2024-09-21T01:41:09.880685+0000","last_peered":"2024-09-21T01:41:09.880685+0000","last_clean":"2024-09-21T01:41:09.880685+0000","last_became_active":"2024-09-21T01:39:51.338467+0000","last_became_peered":"2024-09-21T01:39:51.338467+0000","last_unstale":"2024-09-21T01:41:09.880685+0000","last_undegraded":"2024-09-21T01:41:09.880685+0000","last_fullsized":"2024-09-21T01:41:09.880685+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:18:57.119730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"74'1","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.505280+0000","last_change":"2024-09-21T01:39:42.550130+0000","last_active":"2024-09-21T01:41:10.505280+0000","last_peered":"2024-09-21T01:41:10.505280+0000","last_clean":"2024-09-21T01:41:10.505280+0000","last_became_active":"2024-09-21T01:39:42.549676+0000","last_became_peered":"2024-09-21T01:39:42.549676+0000","last_unstale":"2024-09-21T01:41:10.505280+0000","last_undegraded":"2024-09-21T01:41:10.505280+0000","last_fullsized":"2024-09-21T01:41:10.505280+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:33:59.954738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"84'6","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.027338+0000","last_change":"2024-09-21T01:39:44.293860+0000","last_active":"2024-09-21T01:41:39.027338+0000","last_peered":"2024-09-21T01:41:39.027338+0000","last_clean":"2024-09-21T01:41:39.027338+0000","last_became_active":"2024-09-21T01:39:44.293490+0000","last_became_peered":"2024-09-21T01:39:44.293490+0000","last_unstale":"2024-09-21T01:41:39.027338+0000","last_undegraded":"2024-09-21T01:41:39.027338+0000","last_fullsized":"2024-09-21T01:41:39.027338+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:58:18.325647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.504013+0000","last_change":"2024-09-21T01:39:51.335826+0000","last_active":"2024-09-21T01:41:10.504013+0000","last_peered":"2024-09-21T01:41:10.504013+0000","last_clean":"2024-09-21T01:41:10.504013+0000","last_became_active":"2024-09-21T01:39:51.335346+0000","last_became_peered":"2024-09-21T01:39:51.335346+0000","last_unstale":"2024-09-21T01:41:10.504013+0000","last_undegraded":"2024-09-21T01:41:10.504013+0000","last_fullsized":"2024-09-21T01:41:10.504013+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:51:25.921336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"74'2","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.503563+0000","last_change":"2024-09-21T01:39:42.270594+0000","last_active":"2024-09-21T01:41:10.503563+0000","last_peered":"2024-09-21T01:41:10.503563+0000","last_clean":"2024-09-21T01:41:10.503563+0000","last_became_active":"2024-09-21T01:39:42.270138+0000","last_became_peered":"2024-09-21T01:39:42.270138+0000","last_unstale":"2024-09-21T01:41:10.503563+0000","last_undegraded":"2024-09-21T01:41:10.503563+0000","last_fullsized":"2024-09-21T01:41:10.503563+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:05:00.604343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"84'9","reported_seq":42,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.024710+0000","last_change":"2024-09-21T01:39:44.294397+0000","last_active":"2024-09-21T01:41:39.024710+0000","last_peered":"2024-09-21T01:41:39.024710+0000","last_clean":"2024-09-21T01:41:39.024710+0000","last_became_active":"2024-09-21T01:39:44.293992+0000","last_became_peered":"2024-09-21T01:39:44.293992+0000","last_unstale":"2024-09-21T01:41:39.024710+0000","last_undegraded":"2024-09-21T01:41:39.024710+0000","last_fullsized":"2024-09-21T01:41:39.024710+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:52:09.459167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.504060+0000","last_change":"2024-09-21T01:39:51.338546+0000","last_active":"2024-09-21T01:41:10.504060+0000","last_peered":"2024-09-21T01:41:10.504060+0000","last_clean":"2024-09-21T01:41:10.504060+0000","last_became_active":"2024-09-21T01:39:51.337850+0000","last_became_peered":"2024-09-21T01:39:51.337850+0000","last_unstale":"2024-09-21T01:41:10.504060+0000","last_undegraded":"2024-09-21T01:41:10.504060+0000","last_fullsized":"2024-09-21T01:41:10.504060+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:33:49.497520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"74'2","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.503562+0000","last_change":"2024-09-21T01:39:42.264214+0000","last_active":"2024-09-21T01:41:10.503562+0000","last_peered":"2024-09-21T01:41:10.503562+0000","last_clean":"2024-09-21T01:41:10.503562+0000","last_became_active":"2024-09-21T01:39:42.263782+0000","last_became_peered":"2024-09-21T01:39:42.263782+0000","last_unstale":"2024-09-21T01:41:10.503562+0000","last_undegraded":"2024-09-21T01:41:10.503562+0000","last_fullsized":"2024-09-21T01:41:10.503562+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:44:24.965078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"84'15","reported_seq":49,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.029147+0000","last_change":"2024-09-21T01:39:44.296579+0000","last_active":"2024-09-21T01:41:39.029147+0000","last_peered":"2024-09-21T01:41:39.029147+0000","last_clean":"2024-09-21T01:41:39.029147+0000","last_became_active":"2024-09-21T01:39:44.296175+0000","last_became_peered":"2024-09-21T01:39:44.296175+0000","last_unstale":"2024-09-21T01:41:39.029147+0000","last_undegraded":"2024-09-21T01:41:39.029147+0000","last_fullsized":"2024-09-21T01:41:39.029147+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:11:13.920000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.504011+0000","last_change":"2024-09-21T01:39:51.339046+0000","last_active":"2024-09-21T01:41:10.504011+0000","last_peered":"2024-09-21T01:41:10.504011+0000","last_clean":"2024-09-21T01:41:10.504011+0000","last_became_active":"2024-09-21T01:39:51.337379+0000","last_became_peered":"2024-09-21T01:39:51.337379+0000","last_unstale":"2024-09-21T01:41:10.504011+0000","last_undegraded":"2024-09-21T01:41:10.504011+0000","last_fullsized":"2024-09-21T01:41:10.504011+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:50:34.321615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"84'5","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.030962+0000","last_change":"2024-09-21T01:39:44.296849+0000","last_active":"2024-09-21T01:41:39.030962+0000","last_peered":"2024-09-21T01:41:39.030962+0000","last_clean":"2024-09-21T01:41:39.030962+0000","last_became_active":"2024-09-21T01:39:44.296460+0000","last_became_peered":"2024-09-21T01:39:44.296460+0000","last_unstale":"2024-09-21T01:41:39.030962+0000","last_undegraded":"2024-09-21T01:41:39.030962+0000","last_fullsized":"2024-09-21T01:41:39.030962+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:46:51.258576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"74'2","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.947238+0000","last_change":"2024-09-21T01:40:09.842127+0000","last_active":"2024-09-21T01:41:10.947238+0000","last_peered":"2024-09-21T01:41:10.947238+0000","last_clean":"2024-09-21T01:41:10.947238+0000","last_became_active":"2024-09-21T01:40:09.835330+0000","last_became_peered":"2024-09-21T01:40:09.835330+0000","last_unstale":"2024-09-21T01:41:10.947238+0000","last_undegraded":"2024-09-21T01:41:10.947238+0000","last_fullsized":"2024-09-21T01:41:10.947238+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:54:07.455805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.504140+0000","last_change":"2024-09-21T01:39:51.459595+0000","last_active":"2024-09-21T01:41:10.504140+0000","last_peered":"2024-09-21T01:41:10.504140+0000","last_clean":"2024-09-21T01:41:10.504140+0000","last_became_active":"2024-09-21T01:39:51.459137+0000","last_became_peered":"2024-09-21T01:39:51.459137+0000","last_unstale":"2024-09-21T01:41:10.504140+0000","last_undegraded":"2024-09-21T01:41:10.504140+0000","last_fullsized":"2024-09-21T01:41:10.504140+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:55:53.800615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"84'8","reported_seq":42,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.008399+0000","last_change":"2024-09-21T01:39:44.288328+0000","last_active":"2024-09-21T01:41:39.008399+0000","last_peered":"2024-09-21T01:41:39.008399+0000","last_clean":"2024-09-21T01:41:39.008399+0000","last_became_active":"2024-09-21T01:39:44.287994+0000","last_became_peered":"2024-09-21T01:39:44.287994+0000","last_unstale":"2024-09-21T01:41:39.008399+0000","last_undegraded":"2024-09-21T01:41:39.008399+0000","last_fullsized":"2024-09-21T01:41:39.008399+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:44:55.075693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:09.881129+0000","last_change":"2024-09-21T01:39:42.266271+0000","last_active":"2024-09-21T01:41:09.881129+0000","last_peered":"2024-09-21T01:41:09.881129+0000","last_clean":"2024-09-21T01:41:09.881129+0000","last_became_active":"2024-09-21T01:39:42.265904+0000","last_became_peered":"2024-09-21T01:39:42.265904+0000","last_unstale":"2024-09-21T01:41:09.881129+0000","last_undegraded":"2024-09-21T01:41:09.881129+0000","last_fullsized":"2024-09-21T01:41:09.881129+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:43:37.456263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"82'1","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.504229+0000","last_change":"2024-09-21T01:39:51.336649+0000","last_active":"2024-09-21T01:41:10.504229+0000","last_peered":"2024-09-21T01:41:10.504229+0000","last_clean":"2024-09-21T01:41:10.504229+0000","last_became_active":"2024-09-21T01:39:51.336153+0000","last_became_peered":"2024-09-21T01:39:51.336153+0000","last_unstale":"2024-09-21T01:41:10.504229+0000","last_undegraded":"2024-09-21T01:41:10.504229+0000","last_fullsized":"2024-09-21T01:41:10.504229+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:56:58.699051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"84'9","reported_seq":44,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.018381+0000","last_change":"2024-09-21T01:39:44.304919+0000","last_active":"2024-09-21T01:41:39.018381+0000","last_peered":"2024-09-21T01:41:39.018381+0000","last_clean":"2024-09-21T01:41:39.018381+0000","last_became_active":"2024-09-21T01:39:44.304509+0000","last_became_peered":"2024-09-21T01:39:44.304509+0000","last_unstale":"2024-09-21T01:41:39.018381+0000","last_undegraded":"2024-09-21T01:41:39.018381+0000","last_fullsized":"2024-09-21T01:41:39.018381+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:57:04.413151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.505571+0000","last_change":"2024-09-21T01:39:42.262536+0000","last_active":"2024-09-21T01:41:10.505571+0000","last_peered":"2024-09-21T01:41:10.505571+0000","last_clean":"2024-09-21T01:41:10.505571+0000","last_became_active":"2024-09-21T01:39:42.262179+0000","last_became_peered":"2024-09-21T01:39:42.262179+0000","last_unstale":"2024-09-21T01:41:10.505571+0000","last_undegraded":"2024-09-21T01:41:10.505571+0000","last_fullsized":"2024-09-21T01:41:10.505571+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:35:14.022839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:09.877283+0000","last_change":"2024-09-21T01:39:51.339664+0000","last_active":"2024-09-21T01:41:09.877283+0000","last_peered":"2024-09-21T01:41:09.877283+0000","last_clean":"2024-09-21T01:41:09.877283+0000","last_became_active":"2024-09-21T01:39:51.339140+0000","last_became_peered":"2024-09-21T01:39:51.339140+0000","last_unstale":"2024-09-21T01:41:09.877283+0000","last_undegraded":"2024-09-21T01:41:09.877283+0000","last_fullsized":"2024-09-21T01:41:09.877283+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:46:49.443937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"84'2","reported_seq":37,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:38.997313+0000","last_change":"2024-09-21T01:39:44.299174+0000","last_active":"2024-09-21T01:41:38.997313+0000","last_peered":"2024-09-21T01:41:38.997313+0000","last_clean":"2024-09-21T01:41:38.997313+0000","last_became_active":"2024-09-21T01:39:44.298778+0000","last_became_peered":"2024-09-21T01:39:44.298778+0000","last_unstale":"2024-09-21T01:41:38.997313+0000","last_undegraded":"2024-09-21T01:41:38.997313+0000","last_fullsized":"2024-09-21T01:41:38.997313+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:59:17.298726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:09.971718+0000","last_change":"2024-09-21T01:39:42.550521+0000","last_active":"2024-09-21T01:41:09.971718+0000","last_peered":"2024-09-21T01:41:09.971718+0000","last_clean":"2024-09-21T01:41:09.971718+0000","last_became_active":"2024-09-21T01:39:42.550210+0000","last_became_peered":"2024-09-21T01:39:42.550210+0000","last_unstale":"2024-09-21T01:41:09.971718+0000","last_undegraded":"2024-09-21T01:41:09.971718+0000","last_fullsized":"2024-09-21T01:41:09.971718+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:07:07.234815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.504302+0000","last_change":"2024-09-21T01:39:51.461448+0000","last_active":"2024-09-21T01:41:10.504302+0000","last_peered":"2024-09-21T01:41:10.504302+0000","last_clean":"2024-09-21T01:41:10.504302+0000","last_became_active":"2024-09-21T01:39:51.460790+0000","last_became_peered":"2024-09-21T01:39:51.460790+0000","last_unstale":"2024-09-21T01:41:10.504302+0000","last_undegraded":"2024-09-21T01:41:10.504302+0000","last_fullsized":"2024-09-21T01:41:10.504302+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:30:35.032588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"84'7","reported_seq":42,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.018869+0000","last_change":"2024-09-21T01:39:44.298697+0000","last_active":"2024-09-21T01:41:39.018869+0000","last_peered":"2024-09-21T01:41:39.018869+0000","last_clean":"2024-09-21T01:41:39.018869+0000","last_became_active":"2024-09-21T01:39:44.298333+0000","last_became_peered":"2024-09-21T01:39:44.298333+0000","last_unstale":"2024-09-21T01:41:39.018869+0000","last_undegraded":"2024-09-21T01:41:39.018869+0000","last_fullsized":"2024-09-21T01:41:39.018869+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:36:01.932630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"74'2","reported_seq":42,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.504712+0000","last_change":"2024-09-21T01:39:42.257383+0000","last_active":"2024-09-21T01:41:10.504712+0000","last_peered":"2024-09-21T01:41:10.504712+0000","last_clean":"2024-09-21T01:41:10.504712+0000","last_became_active":"2024-09-21T01:39:42.256896+0000","last_became_peered":"2024-09-21T01:39:42.256896+0000","last_unstale":"2024-09-21T01:41:10.504712+0000","last_undegraded":"2024-09-21T01:41:10.504712+0000","last_fullsized":"2024-09-21T01:41:10.504712+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:03:29.350623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:09.880899+0000","last_change":"2024-09-21T01:39:51.342055+0000","last_active":"2024-09-21T01:41:09.880899+0000","last_peered":"2024-09-21T01:41:09.880899+0000","last_clean":"2024-09-21T01:41:09.880899+0000","last_became_active":"2024-09-21T01:39:51.341602+0000","last_became_peered":"2024-09-21T01:39:51.341602+0000","last_unstale":"2024-09-21T01:41:09.880899+0000","last_undegraded":"2024-09-21T01:41:09.880899+0000","last_fullsized":"2024-09-21T01:41:09.880899+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:30:58.290018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"84'5","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.024216+0000","last_change":"2024-09-21T01:39:44.296725+0000","last_active":"2024-09-21T01:41:39.024216+0000","last_peered":"2024-09-21T01:41:39.024216+0000","last_clean":"2024-09-21T01:41:39.024216+0000","last_became_active":"2024-09-21T01:39:44.296411+0000","last_became_peered":"2024-09-21T01:39:44.296411+0000","last_unstale":"2024-09-21T01:41:39.024216+0000","last_undegraded":"2024-09-21T01:41:39.024216+0000","last_fullsized":"2024-09-21T01:41:39.024216+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:58:05.357486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"84'9","reported_seq":49,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.303877+0000","last_change":"2024-09-21T01:39:42.262831+0000","last_active":"2024-09-21T01:41:39.303877+0000","last_peered":"2024-09-21T01:41:39.303877+0000","last_clean":"2024-09-21T01:41:39.303877+0000","last_became_active":"2024-09-21T01:39:42.262462+0000","last_became_peered":"2024-09-21T01:39:42.262462+0000","last_unstale":"2024-09-21T01:41:39.303877+0000","last_undegraded":"2024-09-21T01:41:39.303877+0000","last_fullsized":"2024-09-21T01:41:39.303877+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:01:24.950607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.505262+0000","last_change":"2024-09-21T01:39:51.460620+0000","last_active":"2024-09-21T01:41:10.505262+0000","last_peered":"2024-09-21T01:41:10.505262+0000","last_clean":"2024-09-21T01:41:10.505262+0000","last_became_active":"2024-09-21T01:39:51.460052+0000","last_became_peered":"2024-09-21T01:39:51.460052+0000","last_unstale":"2024-09-21T01:41:10.505262+0000","last_undegraded":"2024-09-21T01:41:10.505262+0000","last_fullsized":"2024-09-21T01:41:10.505262+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:23:23.284102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"84'9","reported_seq":44,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:38.995410+0000","last_change":"2024-09-21T01:39:44.293129+0000","last_active":"2024-09-21T01:41:38.995410+0000","last_peered":"2024-09-21T01:41:38.995410+0000","last_clean":"2024-09-21T01:41:38.995410+0000","last_became_active":"2024-09-21T01:39:44.292799+0000","last_became_peered":"2024-09-21T01:39:44.292799+0000","last_unstale":"2024-09-21T01:41:38.995410+0000","last_undegraded":"2024-09-21T01:41:38.995410+0000","last_fullsized":"2024-09-21T01:41:38.995410+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:05:22.484632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.504453+0000","last_change":"2024-09-21T01:39:42.550724+0000","last_active":"2024-09-21T01:41:10.504453+0000","last_peered":"2024-09-21T01:41:10.504453+0000","last_clean":"2024-09-21T01:41:10.504453+0000","last_became_active":"2024-09-21T01:39:42.550334+0000","last_became_peered":"2024-09-21T01:39:42.550334+0000","last_unstale":"2024-09-21T01:41:10.504453+0000","last_undegraded":"2024-09-21T01:41:10.504453+0000","last_fullsized":"2024-09-21T01:41:10.504453+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:15:49.484663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.947380+0000","last_change":"2024-09-21T01:40:09.838305+0000","last_active":"2024-09-21T01:41:10.947380+0000","last_peered":"2024-09-21T01:41:10.947380+0000","last_clean":"2024-09-21T01:41:10.947380+0000","last_became_active":"2024-09-21T01:40:09.837734+0000","last_became_peered":"2024-09-21T01:40:09.837734+0000","last_unstale":"2024-09-21T01:41:10.947380+0000","last_undegraded":"2024-09-21T01:41:10.947380+0000","last_fullsized":"2024-09-21T01:41:10.947380+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:38:44.066723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,7,6],"acting":[11,8,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"84'4","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.011618+0000","last_change":"2024-09-21T01:39:44.292039+0000","last_active":"2024-09-21T01:41:39.011618+0000","last_peered":"2024-09-21T01:41:39.011618+0000","last_clean":"2024-09-21T01:41:39.011618+0000","last_became_active":"2024-09-21T01:39:44.291640+0000","last_became_peered":"2024-09-21T01:39:44.291640+0000","last_unstale":"2024-09-21T01:41:39.011618+0000","last_undegraded":"2024-09-21T01:41:39.011618+0000","last_fullsized":"2024-09-21T01:41:39.011618+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:24:59.891664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":47,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:09.877197+0000","last_change":"2024-09-21T01:40:10.063162+0000","last_active":"2024-09-21T01:41:09.877197+0000","last_peered":"2024-09-21T01:41:09.877197+0000","last_clean":"2024-09-21T01:41:09.877197+0000","last_became_active":"2024-09-21T01:40:10.062703+0000","last_became_peered":"2024-09-21T01:40:10.062703+0000","last_unstale":"2024-09-21T01:41:09.877197+0000","last_undegraded":"2024-09-21T01:41:09.877197+0000","last_fullsized":"2024-09-21T01:41:09.877197+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:32:04.933701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.504118+0000","last_change":"2024-09-21T01:39:51.460023+0000","last_active":"2024-09-21T01:41:10.504118+0000","last_peered":"2024-09-21T01:41:10.504118+0000","last_clean":"2024-09-21T01:41:10.504118+0000","last_became_active":"2024-09-21T01:39:51.459417+0000","last_became_peered":"2024-09-21T01:39:51.459417+0000","last_unstale":"2024-09-21T01:41:10.504118+0000","last_undegraded":"2024-09-21T01:41:10.504118+0000","last_fullsized":"2024-09-21T01:41:10.504118+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:54:24.301176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"84'7","reported_seq":42,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.007130+0000","last_change":"2024-09-21T01:39:44.295559+0000","last_active":"2024-09-21T01:41:39.007130+0000","last_peered":"2024-09-21T01:41:39.007130+0000","last_clean":"2024-09-21T01:41:39.007130+0000","last_became_active":"2024-09-21T01:39:44.294970+0000","last_became_peered":"2024-09-21T01:39:44.294970+0000","last_unstale":"2024-09-21T01:41:39.007130+0000","last_undegraded":"2024-09-21T01:41:39.007130+0000","last_fullsized":"2024-09-21T01:41:39.007130+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:46:16.582188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:09.878607+0000","last_change":"2024-09-21T01:39:42.269453+0000","last_active":"2024-09-21T01:41:09.878607+0000","last_peered":"2024-09-21T01:41:09.878607+0000","last_clean":"2024-09-21T01:41:09.878607+0000","last_became_active":"2024-09-21T01:39:42.269039+0000","last_became_peered":"2024-09-21T01:39:42.269039+0000","last_unstale":"2024-09-21T01:41:09.878607+0000","last_undegraded":"2024-09-21T01:41:09.878607+0000","last_fullsized":"2024-09-21T01:41:09.878607+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:47:29.053966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.504474+0000","last_change":"2024-09-21T01:39:51.337305+0000","last_active":"2024-09-21T01:41:10.504474+0000","last_peered":"2024-09-21T01:41:10.504474+0000","last_clean":"2024-09-21T01:41:10.504474+0000","last_became_active":"2024-09-21T01:39:51.336710+0000","last_became_peered":"2024-09-21T01:39:51.336710+0000","last_unstale":"2024-09-21T01:41:10.504474+0000","last_undegraded":"2024-09-21T01:41:10.504474+0000","last_fullsized":"2024-09-21T01:41:10.504474+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:13:42.333881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"84'8","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.019206+0000","last_change":"2024-09-21T01:39:44.297004+0000","last_active":"2024-09-21T01:41:39.019206+0000","last_peered":"2024-09-21T01:41:39.019206+0000","last_clean":"2024-09-21T01:41:39.019206+0000","last_became_active":"2024-09-21T01:39:44.296596+0000","last_became_peered":"2024-09-21T01:39:44.296596+0000","last_unstale":"2024-09-21T01:41:39.019206+0000","last_undegraded":"2024-09-21T01:41:39.019206+0000","last_fullsized":"2024-09-21T01:41:39.019206+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:14:32.542823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.503902+0000","last_change":"2024-09-21T01:39:42.550024+0000","last_active":"2024-09-21T01:41:10.503902+0000","last_peered":"2024-09-21T01:41:10.503902+0000","last_clean":"2024-09-21T01:41:10.503902+0000","last_became_active":"2024-09-21T01:39:42.549638+0000","last_became_peered":"2024-09-21T01:39:42.549638+0000","last_unstale":"2024-09-21T01:41:10.503902+0000","last_undegraded":"2024-09-21T01:41:10.503902+0000","last_fullsized":"2024-09-21T01:41:10.503902+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:23:39.210460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.505020+0000","last_change":"2024-09-21T01:39:51.459459+0000","last_active":"2024-09-21T01:41:10.505020+0000","last_peered":"2024-09-21T01:41:10.505020+0000","last_clean":"2024-09-21T01:41:10.505020+0000","last_became_active":"2024-09-21T01:39:51.459020+0000","last_became_peered":"2024-09-21T01:39:51.459020+0000","last_unstale":"2024-09-21T01:41:10.505020+0000","last_undegraded":"2024-09-21T01:41:10.505020+0000","last_fullsized":"2024-09-21T01:41:10.505020+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:50:08.337949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"84'5","reported_seq":47,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:38.995712+0000","last_change":"2024-09-21T01:40:09.833943+0000","last_active":"2024-09-21T01:41:38.995712+0000","last_peered":"2024-09-21T01:41:38.995712+0000","last_clean":"2024-09-21T01:41:38.995712+0000","last_became_active":"2024-09-21T01:40:09.833486+0000","last_became_peered":"2024-09-21T01:40:09.833486+0000","last_unstale":"2024-09-21T01:41:38.995712+0000","last_undegraded":"2024-09-21T01:41:38.995712+0000","last_fullsized":"2024-09-21T01:41:38.995712+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:26:52.751330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,2],"acting":[6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:09.878307+0000","last_change":"2024-09-21T01:39:42.267329+0000","last_active":"2024-09-21T01:41:09.878307+0000","last_peered":"2024-09-21T01:41:09.878307+0000","last_clean":"2024-09-21T01:41:09.878307+0000","last_became_active":"2024-09-21T01:39:42.266386+0000","last_became_peered":"2024-09-21T01:39:42.266386+0000","last_unstale":"2024-09-21T01:41:09.878307+0000","last_undegraded":"2024-09-21T01:41:09.878307+0000","last_fullsized":"2024-09-21T01:41:09.878307+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:31:20.877627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.044656+0000","last_change":"2024-09-21T01:39:51.461494+0000","last_active":"2024-09-21T01:41:10.044656+0000","last_peered":"2024-09-21T01:41:10.044656+0000","last_clean":"2024-09-21T01:41:10.044656+0000","last_became_active":"2024-09-21T01:39:51.460973+0000","last_became_peered":"2024-09-21T01:39:51.460973+0000","last_unstale":"2024-09-21T01:41:10.044656+0000","last_undegraded":"2024-09-21T01:41:10.044656+0000","last_fullsized":"2024-09-21T01:41:10.044656+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:09:50.319546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"84'8","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.027189+0000","last_change":"2024-09-21T01:39:44.300773+0000","last_active":"2024-09-21T01:41:39.027189+0000","last_peered":"2024-09-21T01:41:39.027189+0000","last_clean":"2024-09-21T01:41:39.027189+0000","last_became_active":"2024-09-21T01:39:44.300437+0000","last_became_peered":"2024-09-21T01:39:44.300437+0000","last_unstale":"2024-09-21T01:41:39.027189+0000","last_undegraded":"2024-09-21T01:41:39.027189+0000","last_fullsized":"2024-09-21T01:41:39.027189+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:06:34.171621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.503903+0000","last_change":"2024-09-21T01:39:42.262675+0000","last_active":"2024-09-21T01:41:10.503903+0000","last_peered":"2024-09-21T01:41:10.503903+0000","last_clean":"2024-09-21T01:41:10.503903+0000","last_became_active":"2024-09-21T01:39:42.262282+0000","last_became_peered":"2024-09-21T01:39:42.262282+0000","last_unstale":"2024-09-21T01:41:10.503903+0000","last_undegraded":"2024-09-21T01:41:10.503903+0000","last_fullsized":"2024-09-21T01:41:10.503903+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:26:01.595797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":114,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:09.878450+0000","last_change":"2024-09-21T01:38:31.172876+0000","last_active":"2024-09-21T01:41:09.878450+0000","last_peered":"2024-09-21T01:41:09.878450+0000","last_clean":"2024-09-21T01:41:09.878450+0000","last_became_active":"2024-09-21T01:38:31.167071+0000","last_became_peered":"2024-09-21T01:38:31.167071+0000","last_unstale":"2024-09-21T01:41:09.878450+0000","last_undegraded":"2024-09-21T01:41:09.878450+0000","last_fullsized":"2024-09-21T01:41:09.878450+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:35:07.475056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:35:07.475056+0000","last_clean_scrub_stamp":"2024-09-21T01:35:07.475056+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:56:01.878445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"82'1","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:09.878776+0000","last_change":"2024-09-21T01:39:51.338198+0000","last_active":"2024-09-21T01:41:09.878776+0000","last_peered":"2024-09-21T01:41:09.878776+0000","last_clean":"2024-09-21T01:41:09.878776+0000","last_became_active":"2024-09-21T01:39:51.337743+0000","last_became_peered":"2024-09-21T01:39:51.337743+0000","last_unstale":"2024-09-21T01:41:09.878776+0000","last_undegraded":"2024-09-21T01:41:09.878776+0000","last_fullsized":"2024-09-21T01:41:09.878776+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:19:45.552819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"84'7","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.030827+0000","last_change":"2024-09-21T01:39:44.298920+0000","last_active":"2024-09-21T01:41:39.030827+0000","last_peered":"2024-09-21T01:41:39.030827+0000","last_clean":"2024-09-21T01:41:39.030827+0000","last_became_active":"2024-09-21T01:39:44.298381+0000","last_became_peered":"2024-09-21T01:39:44.298381+0000","last_unstale":"2024-09-21T01:41:39.030827+0000","last_undegraded":"2024-09-21T01:41:39.030827+0000","last_fullsized":"2024-09-21T01:41:39.030827+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:12:53.681514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:09.881301+0000","last_change":"2024-09-21T01:39:42.550808+0000","last_active":"2024-09-21T01:41:09.881301+0000","last_peered":"2024-09-21T01:41:09.881301+0000","last_clean":"2024-09-21T01:41:09.881301+0000","last_became_active":"2024-09-21T01:39:42.550447+0000","last_became_peered":"2024-09-21T01:39:42.550447+0000","last_unstale":"2024-09-21T01:41:09.881301+0000","last_undegraded":"2024-09-21T01:41:09.881301+0000","last_fullsized":"2024-09-21T01:41:09.881301+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:20:56.996378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:09.971547+0000","last_change":"2024-09-21T01:39:51.338490+0000","last_active":"2024-09-21T01:41:09.971547+0000","last_peered":"2024-09-21T01:41:09.971547+0000","last_clean":"2024-09-21T01:41:09.971547+0000","last_became_active":"2024-09-21T01:39:51.338050+0000","last_became_peered":"2024-09-21T01:39:51.338050+0000","last_unstale":"2024-09-21T01:41:09.971547+0000","last_undegraded":"2024-09-21T01:41:09.971547+0000","last_fullsized":"2024-09-21T01:41:09.971547+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:49:56.705893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"84'6","reported_seq":47,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.021159+0000","last_change":"2024-09-21T01:41:10.045808+0000","last_active":"2024-09-21T01:41:39.021159+0000","last_peered":"2024-09-21T01:41:39.021159+0000","last_clean":"2024-09-21T01:41:39.021159+0000","last_became_active":"2024-09-21T01:41:10.045403+0000","last_became_peered":"2024-09-21T01:41:10.045403+0000","last_unstale":"2024-09-21T01:41:39.021159+0000","last_undegraded":"2024-09-21T01:41:39.021159+0000","last_fullsized":"2024-09-21T01:41:39.021159+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:15:46.067941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"84'60","reported_seq":130,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:56.430035+0000","last_change":"2024-09-21T01:39:42.270124+0000","last_active":"2024-09-21T01:41:56.430035+0000","last_peered":"2024-09-21T01:41:56.430035+0000","last_clean":"2024-09-21T01:41:56.430035+0000","last_became_active":"2024-09-21T01:39:42.269435+0000","last_became_peered":"2024-09-21T01:39:42.269435+0000","last_unstale":"2024-09-21T01:41:56.430035+0000","last_undegraded":"2024-09-21T01:41:56.430035+0000","last_fullsized":"2024-09-21T01:41:56.430035+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:12:08.374394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393846,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":33,"num_read_kb":32,"num_write":71,"num_write_kb":873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.504493+0000","last_change":"2024-09-21T01:39:51.334459+0000","last_active":"2024-09-21T01:41:10.504493+0000","last_peered":"2024-09-21T01:41:10.504493+0000","last_clean":"2024-09-21T01:41:10.504493+0000","last_became_active":"2024-09-21T01:39:51.334039+0000","last_became_peered":"2024-09-21T01:39:51.334039+0000","last_unstale":"2024-09-21T01:41:10.504493+0000","last_undegraded":"2024-09-21T01:41:10.504493+0000","last_fullsized":"2024-09-21T01:41:10.504493+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:04:44.906648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"84'9","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.023513+0000","last_change":"2024-09-21T01:39:44.298467+0000","last_active":"2024-09-21T01:41:39.023513+0000","last_peered":"2024-09-21T01:41:39.023513+0000","last_clean":"2024-09-21T01:41:39.023513+0000","last_became_active":"2024-09-21T01:39:44.298128+0000","last_became_peered":"2024-09-21T01:39:44.298128+0000","last_unstale":"2024-09-21T01:41:39.023513+0000","last_undegraded":"2024-09-21T01:41:39.023513+0000","last_fullsized":"2024-09-21T01:41:39.023513+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:54:11.096417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"74'2","reported_seq":42,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.504261+0000","last_change":"2024-09-21T01:39:42.262761+0000","last_active":"2024-09-21T01:41:10.504261+0000","last_peered":"2024-09-21T01:41:10.504261+0000","last_clean":"2024-09-21T01:41:10.504261+0000","last_became_active":"2024-09-21T01:39:42.262428+0000","last_became_peered":"2024-09-21T01:39:42.262428+0000","last_unstale":"2024-09-21T01:41:10.504261+0000","last_undegraded":"2024-09-21T01:41:10.504261+0000","last_fullsized":"2024-09-21T01:41:10.504261+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:11:50.326638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.043807+0000","last_change":"2024-09-21T01:39:51.344320+0000","last_active":"2024-09-21T01:41:10.043807+0000","last_peered":"2024-09-21T01:41:10.043807+0000","last_clean":"2024-09-21T01:41:10.043807+0000","last_became_active":"2024-09-21T01:39:51.343902+0000","last_became_peered":"2024-09-21T01:39:51.343902+0000","last_unstale":"2024-09-21T01:41:10.043807+0000","last_undegraded":"2024-09-21T01:41:10.043807+0000","last_fullsized":"2024-09-21T01:41:10.043807+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:13:36.139159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"84'5","reported_seq":46,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.007852+0000","last_change":"2024-09-21T01:40:09.837769+0000","last_active":"2024-09-21T01:41:39.007852+0000","last_peered":"2024-09-21T01:41:39.007852+0000","last_clean":"2024-09-21T01:41:39.007852+0000","last_became_active":"2024-09-21T01:40:09.837296+0000","last_became_peered":"2024-09-21T01:40:09.837296+0000","last_unstale":"2024-09-21T01:41:39.007852+0000","last_undegraded":"2024-09-21T01:41:39.007852+0000","last_fullsized":"2024-09-21T01:41:39.007852+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:37:20.360076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"74'1","reported_seq":42,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.503756+0000","last_change":"2024-09-21T01:39:42.264955+0000","last_active":"2024-09-21T01:41:10.503756+0000","last_peered":"2024-09-21T01:41:10.503756+0000","last_clean":"2024-09-21T01:41:10.503756+0000","last_became_active":"2024-09-21T01:39:42.264492+0000","last_became_peered":"2024-09-21T01:39:42.264492+0000","last_unstale":"2024-09-21T01:41:10.503756+0000","last_undegraded":"2024-09-21T01:41:10.503756+0000","last_fullsized":"2024-09-21T01:41:10.503756+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:17:38.631521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.044021+0000","last_change":"2024-09-21T01:39:51.337908+0000","last_active":"2024-09-21T01:41:10.044021+0000","last_peered":"2024-09-21T01:41:10.044021+0000","last_clean":"2024-09-21T01:41:10.044021+0000","last_became_active":"2024-09-21T01:39:51.337200+0000","last_became_peered":"2024-09-21T01:39:51.337200+0000","last_unstale":"2024-09-21T01:41:10.044021+0000","last_undegraded":"2024-09-21T01:41:10.044021+0000","last_fullsized":"2024-09-21T01:41:10.044021+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:07:18.505959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"84'6","reported_seq":47,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.027322+0000","last_change":"2024-09-21T01:40:10.063539+0000","last_active":"2024-09-21T01:41:39.027322+0000","last_peered":"2024-09-21T01:41:39.027322+0000","last_clean":"2024-09-21T01:41:39.027322+0000","last_became_active":"2024-09-21T01:40:10.062966+0000","last_became_peered":"2024-09-21T01:40:10.062966+0000","last_unstale":"2024-09-21T01:41:39.027322+0000","last_undegraded":"2024-09-21T01:41:39.027322+0000","last_fullsized":"2024-09-21T01:41:39.027322+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:53:20.747493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,1],"acting":[5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"74'8","reported_seq":47,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.503907+0000","last_change":"2024-09-21T01:39:42.550795+0000","last_active":"2024-09-21T01:41:10.503907+0000","last_peered":"2024-09-21T01:41:10.503907+0000","last_clean":"2024-09-21T01:41:10.503907+0000","last_became_active":"2024-09-21T01:39:42.550424+0000","last_became_peered":"2024-09-21T01:39:42.550424+0000","last_unstale":"2024-09-21T01:41:10.503907+0000","last_undegraded":"2024-09-21T01:41:10.503907+0000","last_fullsized":"2024-09-21T01:41:10.503907+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:50:53.421080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.504489+0000","last_change":"2024-09-21T01:39:51.335239+0000","last_active":"2024-09-21T01:41:10.504489+0000","last_peered":"2024-09-21T01:41:10.504489+0000","last_clean":"2024-09-21T01:41:10.504489+0000","last_became_active":"2024-09-21T01:39:51.334846+0000","last_became_peered":"2024-09-21T01:39:51.334846+0000","last_unstale":"2024-09-21T01:41:10.504489+0000","last_undegraded":"2024-09-21T01:41:10.504489+0000","last_fullsized":"2024-09-21T01:41:10.504489+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:47:30.820219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"84'6","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.023832+0000","last_change":"2024-09-21T01:39:44.296080+0000","last_active":"2024-09-21T01:41:39.023832+0000","last_peered":"2024-09-21T01:41:39.023832+0000","last_clean":"2024-09-21T01:41:39.023832+0000","last_became_active":"2024-09-21T01:39:44.295724+0000","last_became_peered":"2024-09-21T01:39:44.295724+0000","last_unstale":"2024-09-21T01:41:39.023832+0000","last_undegraded":"2024-09-21T01:41:39.023832+0000","last_fullsized":"2024-09-21T01:41:39.023832+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:20:56.366350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.503820+0000","last_change":"2024-09-21T01:39:42.264499+0000","last_active":"2024-09-21T01:41:10.503820+0000","last_peered":"2024-09-21T01:41:10.503820+0000","last_clean":"2024-09-21T01:41:10.503820+0000","last_became_active":"2024-09-21T01:39:42.264059+0000","last_became_peered":"2024-09-21T01:39:42.264059+0000","last_unstale":"2024-09-21T01:41:10.503820+0000","last_undegraded":"2024-09-21T01:41:10.503820+0000","last_fullsized":"2024-09-21T01:41:10.503820+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:27:42.970693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:09.877344+0000","last_change":"2024-09-21T01:39:51.329357+0000","last_active":"2024-09-21T01:41:09.877344+0000","last_peered":"2024-09-21T01:41:09.877344+0000","last_clean":"2024-09-21T01:41:09.877344+0000","last_became_active":"2024-09-21T01:39:51.328761+0000","last_became_peered":"2024-09-21T01:39:51.328761+0000","last_unstale":"2024-09-21T01:41:09.877344+0000","last_undegraded":"2024-09-21T01:41:09.877344+0000","last_fullsized":"2024-09-21T01:41:09.877344+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:48:04.089765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"84'15","reported_seq":49,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.025370+0000","last_change":"2024-09-21T01:39:44.295799+0000","last_active":"2024-09-21T01:41:39.025370+0000","last_peered":"2024-09-21T01:41:39.025370+0000","last_clean":"2024-09-21T01:41:39.025370+0000","last_became_active":"2024-09-21T01:39:44.295432+0000","last_became_peered":"2024-09-21T01:39:44.295432+0000","last_unstale":"2024-09-21T01:41:39.025370+0000","last_undegraded":"2024-09-21T01:41:39.025370+0000","last_fullsized":"2024-09-21T01:41:39.025370+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:18:10.702545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.044394+0000","last_change":"2024-09-21T01:39:42.270552+0000","last_active":"2024-09-21T01:41:10.044394+0000","last_peered":"2024-09-21T01:41:10.044394+0000","last_clean":"2024-09-21T01:41:10.044394+0000","last_became_active":"2024-09-21T01:39:42.270158+0000","last_became_peered":"2024-09-21T01:39:42.270158+0000","last_unstale":"2024-09-21T01:41:10.044394+0000","last_undegraded":"2024-09-21T01:41:10.044394+0000","last_fullsized":"2024-09-21T01:41:10.044394+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:19:52.229598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.947461+0000","last_change":"2024-09-21T01:39:51.335823+0000","last_active":"2024-09-21T01:41:10.947461+0000","last_peered":"2024-09-21T01:41:10.947461+0000","last_clean":"2024-09-21T01:41:10.947461+0000","last_became_active":"2024-09-21T01:39:51.335363+0000","last_became_peered":"2024-09-21T01:39:51.335363+0000","last_unstale":"2024-09-21T01:41:10.947461+0000","last_undegraded":"2024-09-21T01:41:10.947461+0000","last_fullsized":"2024-09-21T01:41:10.947461+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:33:01.418708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"84'9","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.022001+0000","last_change":"2024-09-21T01:39:44.288963+0000","last_active":"2024-09-21T01:41:39.022001+0000","last_peered":"2024-09-21T01:41:39.022001+0000","last_clean":"2024-09-21T01:41:39.022001+0000","last_became_active":"2024-09-21T01:39:44.286967+0000","last_became_peered":"2024-09-21T01:39:44.286967+0000","last_unstale":"2024-09-21T01:41:39.022001+0000","last_undegraded":"2024-09-21T01:41:39.022001+0000","last_fullsized":"2024-09-21T01:41:39.022001+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:02:32.653351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"74'2","reported_seq":42,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:09.881149+0000","last_change":"2024-09-21T01:39:42.268553+0000","last_active":"2024-09-21T01:41:09.881149+0000","last_peered":"2024-09-21T01:41:09.881149+0000","last_clean":"2024-09-21T01:41:09.881149+0000","last_became_active":"2024-09-21T01:39:42.268154+0000","last_became_peered":"2024-09-21T01:39:42.268154+0000","last_unstale":"2024-09-21T01:41:09.881149+0000","last_undegraded":"2024-09-21T01:41:09.881149+0000","last_fullsized":"2024-09-21T01:41:09.881149+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:22:54.223718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.044472+0000","last_change":"2024-09-21T01:39:51.342268+0000","last_active":"2024-09-21T01:41:10.044472+0000","last_peered":"2024-09-21T01:41:10.044472+0000","last_clean":"2024-09-21T01:41:10.044472+0000","last_became_active":"2024-09-21T01:39:51.341221+0000","last_became_peered":"2024-09-21T01:39:51.341221+0000","last_unstale":"2024-09-21T01:41:10.044472+0000","last_undegraded":"2024-09-21T01:41:10.044472+0000","last_fullsized":"2024-09-21T01:41:10.044472+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:46:16.297124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"84'6","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.022766+0000","last_change":"2024-09-21T01:39:44.300338+0000","last_active":"2024-09-21T01:41:39.022766+0000","last_peered":"2024-09-21T01:41:39.022766+0000","last_clean":"2024-09-21T01:41:39.022766+0000","last_became_active":"2024-09-21T01:39:44.299920+0000","last_became_peered":"2024-09-21T01:39:44.299920+0000","last_unstale":"2024-09-21T01:41:39.022766+0000","last_undegraded":"2024-09-21T01:41:39.022766+0000","last_fullsized":"2024-09-21T01:41:39.022766+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:23:47.631867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"84'33","reported_seq":256,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:53.118649+0000","last_change":"2024-09-21T01:39:42.266883+0000","last_active":"2024-09-21T01:41:53.118649+0000","last_peered":"2024-09-21T01:41:53.118649+0000","last_clean":"2024-09-21T01:41:53.118649+0000","last_became_active":"2024-09-21T01:39:42.266494+0000","last_became_peered":"2024-09-21T01:39:42.266494+0000","last_unstale":"2024-09-21T01:41:53.118649+0000","last_undegraded":"2024-09-21T01:41:53.118649+0000","last_fullsized":"2024-09-21T01:41:53.118649+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:56:46.777522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67896,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":184,"num_read_kb":158,"num_write":33,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.040673+0000","last_change":"2024-09-21T01:40:09.842036+0000","last_active":"2024-09-21T01:41:10.040673+0000","last_peered":"2024-09-21T01:41:10.040673+0000","last_clean":"2024-09-21T01:41:10.040673+0000","last_became_active":"2024-09-21T01:40:09.841680+0000","last_became_peered":"2024-09-21T01:40:09.841680+0000","last_unstale":"2024-09-21T01:41:10.040673+0000","last_undegraded":"2024-09-21T01:41:10.040673+0000","last_fullsized":"2024-09-21T01:41:10.040673+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:01:58.366511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,11,5],"acting":[10,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.14","version":"84'11","reported_seq":44,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.030064+0000","last_change":"2024-09-21T01:39:44.296958+0000","last_active":"2024-09-21T01:41:39.030064+0000","last_peered":"2024-09-21T01:41:39.030064+0000","last_clean":"2024-09-21T01:41:39.030064+0000","last_became_active":"2024-09-21T01:39:44.296588+0000","last_became_peered":"2024-09-21T01:39:44.296588+0000","last_unstale":"2024-09-21T01:41:39.030064+0000","last_undegraded":"2024-09-21T01:41:39.030064+0000","last_fullsized":"2024-09-21T01:41:39.030064+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:04:25.222279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"74'3","reported_seq":42,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.044764+0000","last_change":"2024-09-21T01:39:42.550770+0000","last_active":"2024-09-21T01:41:10.044764+0000","last_peered":"2024-09-21T01:41:10.044764+0000","last_clean":"2024-09-21T01:41:10.044764+0000","last_became_active":"2024-09-21T01:39:42.550317+0000","last_became_peered":"2024-09-21T01:39:42.550317+0000","last_unstale":"2024-09-21T01:41:10.044764+0000","last_undegraded":"2024-09-21T01:41:10.044764+0000","last_fullsized":"2024-09-21T01:41:10.044764+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:11:05.269317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.504279+0000","last_change":"2024-09-21T01:39:51.342166+0000","last_active":"2024-09-21T01:41:10.504279+0000","last_peered":"2024-09-21T01:41:10.504279+0000","last_clean":"2024-09-21T01:41:10.504279+0000","last_became_active":"2024-09-21T01:39:51.341633+0000","last_became_peered":"2024-09-21T01:39:51.341633+0000","last_unstale":"2024-09-21T01:41:10.504279+0000","last_undegraded":"2024-09-21T01:41:10.504279+0000","last_fullsized":"2024-09-21T01:41:10.504279+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:47:13.524123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"84'9","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.016737+0000","last_change":"2024-09-21T01:39:44.297652+0000","last_active":"2024-09-21T01:41:39.016737+0000","last_peered":"2024-09-21T01:41:39.016737+0000","last_clean":"2024-09-21T01:41:39.016737+0000","last_became_active":"2024-09-21T01:39:44.297289+0000","last_became_peered":"2024-09-21T01:39:44.297289+0000","last_unstale":"2024-09-21T01:41:39.016737+0000","last_undegraded":"2024-09-21T01:41:39.016737+0000","last_fullsized":"2024-09-21T01:41:39.016737+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:14:52.834492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:09.878796+0000","last_change":"2024-09-21T01:39:42.269881+0000","last_active":"2024-09-21T01:41:09.878796+0000","last_peered":"2024-09-21T01:41:09.878796+0000","last_clean":"2024-09-21T01:41:09.878796+0000","last_became_active":"2024-09-21T01:39:42.269498+0000","last_became_peered":"2024-09-21T01:39:42.269498+0000","last_unstale":"2024-09-21T01:41:09.878796+0000","last_undegraded":"2024-09-21T01:41:09.878796+0000","last_fullsized":"2024-09-21T01:41:09.878796+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:10:31.750792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.503690+0000","last_change":"2024-09-21T01:40:10.063827+0000","last_active":"2024-09-21T01:41:10.503690+0000","last_peered":"2024-09-21T01:41:10.503690+0000","last_clean":"2024-09-21T01:41:10.503690+0000","last_became_active":"2024-09-21T01:40:10.063206+0000","last_became_peered":"2024-09-21T01:40:10.063206+0000","last_unstale":"2024-09-21T01:41:10.503690+0000","last_undegraded":"2024-09-21T01:41:10.503690+0000","last_fullsized":"2024-09-21T01:41:10.503690+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:33:28.905812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2,4],"acting":[8,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.16","version":"84'10","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.027736+0000","last_change":"2024-09-21T01:39:44.292241+0000","last_active":"2024-09-21T01:41:39.027736+0000","last_peered":"2024-09-21T01:41:39.027736+0000","last_clean":"2024-09-21T01:41:39.027736+0000","last_became_active":"2024-09-21T01:39:44.291808+0000","last_became_peered":"2024-09-21T01:39:44.291808+0000","last_unstale":"2024-09-21T01:41:39.027736+0000","last_undegraded":"2024-09-21T01:41:39.027736+0000","last_fullsized":"2024-09-21T01:41:39.027736+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:47:24.761137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.041221+0000","last_change":"2024-09-21T01:39:42.272047+0000","last_active":"2024-09-21T01:41:10.041221+0000","last_peered":"2024-09-21T01:41:10.041221+0000","last_clean":"2024-09-21T01:41:10.041221+0000","last_became_active":"2024-09-21T01:39:42.271668+0000","last_became_peered":"2024-09-21T01:39:42.271668+0000","last_unstale":"2024-09-21T01:41:10.041221+0000","last_undegraded":"2024-09-21T01:41:10.041221+0000","last_fullsized":"2024-09-21T01:41:10.041221+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:44:09.702328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.505772+0000","last_change":"2024-09-21T01:39:51.337760+0000","last_active":"2024-09-21T01:41:10.505772+0000","last_peered":"2024-09-21T01:41:10.505772+0000","last_clean":"2024-09-21T01:41:10.505772+0000","last_became_active":"2024-09-21T01:39:51.337337+0000","last_became_peered":"2024-09-21T01:39:51.337337+0000","last_unstale":"2024-09-21T01:41:10.505772+0000","last_undegraded":"2024-09-21T01:41:10.505772+0000","last_fullsized":"2024-09-21T01:41:10.505772+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:33:49.316833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.503794+0000","last_change":"2024-09-21T01:39:51.334722+0000","last_active":"2024-09-21T01:41:10.503794+0000","last_peered":"2024-09-21T01:41:10.503794+0000","last_clean":"2024-09-21T01:41:10.503794+0000","last_became_active":"2024-09-21T01:39:51.334318+0000","last_became_peered":"2024-09-21T01:39:51.334318+0000","last_unstale":"2024-09-21T01:41:10.503794+0000","last_undegraded":"2024-09-21T01:41:10.503794+0000","last_fullsized":"2024-09-21T01:41:10.503794+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:29:17.625223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"84'11","reported_seq":45,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.006715+0000","last_change":"2024-09-21T01:39:44.283183+0000","last_active":"2024-09-21T01:41:39.006715+0000","last_peered":"2024-09-21T01:41:39.006715+0000","last_clean":"2024-09-21T01:41:39.006715+0000","last_became_active":"2024-09-21T01:39:44.282829+0000","last_became_peered":"2024-09-21T01:39:44.282829+0000","last_unstale":"2024-09-21T01:41:39.006715+0000","last_undegraded":"2024-09-21T01:41:39.006715+0000","last_fullsized":"2024-09-21T01:41:39.006715+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:31:43.602584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.044143+0000","last_change":"2024-09-21T01:39:42.267465+0000","last_active":"2024-09-21T01:41:10.044143+0000","last_peered":"2024-09-21T01:41:10.044143+0000","last_clean":"2024-09-21T01:41:10.044143+0000","last_became_active":"2024-09-21T01:39:42.267051+0000","last_became_peered":"2024-09-21T01:39:42.267051+0000","last_unstale":"2024-09-21T01:41:10.044143+0000","last_undegraded":"2024-09-21T01:41:10.044143+0000","last_fullsized":"2024-09-21T01:41:10.044143+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:17:30.917284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.947577+0000","last_change":"2024-09-21T01:39:51.338907+0000","last_active":"2024-09-21T01:41:10.947577+0000","last_peered":"2024-09-21T01:41:10.947577+0000","last_clean":"2024-09-21T01:41:10.947577+0000","last_became_active":"2024-09-21T01:39:51.338444+0000","last_became_peered":"2024-09-21T01:39:51.338444+0000","last_unstale":"2024-09-21T01:41:10.947577+0000","last_undegraded":"2024-09-21T01:41:10.947577+0000","last_fullsized":"2024-09-21T01:41:10.947577+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:35:44.819976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"84'8","reported_seq":42,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.015629+0000","last_change":"2024-09-21T01:39:44.293735+0000","last_active":"2024-09-21T01:41:39.015629+0000","last_peered":"2024-09-21T01:41:39.015629+0000","last_clean":"2024-09-21T01:41:39.015629+0000","last_became_active":"2024-09-21T01:39:44.293371+0000","last_became_peered":"2024-09-21T01:39:44.293371+0000","last_unstale":"2024-09-21T01:41:39.015629+0000","last_undegraded":"2024-09-21T01:41:39.015629+0000","last_fullsized":"2024-09-21T01:41:39.015629+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:50:50.404018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.503564+0000","last_change":"2024-09-21T01:39:42.259012+0000","last_active":"2024-09-21T01:41:10.503564+0000","last_peered":"2024-09-21T01:41:10.503564+0000","last_clean":"2024-09-21T01:41:10.503564+0000","last_became_active":"2024-09-21T01:39:42.258665+0000","last_became_peered":"2024-09-21T01:39:42.258665+0000","last_unstale":"2024-09-21T01:41:10.503564+0000","last_undegraded":"2024-09-21T01:41:10.503564+0000","last_fullsized":"2024-09-21T01:41:10.503564+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:25:24.797505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"74'1","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.040907+0000","last_change":"2024-09-21T01:39:42.270969+0000","last_active":"2024-09-21T01:41:10.040907+0000","last_peered":"2024-09-21T01:41:10.040907+0000","last_clean":"2024-09-21T01:41:10.040907+0000","last_became_active":"2024-09-21T01:39:42.270629+0000","last_became_peered":"2024-09-21T01:39:42.270629+0000","last_unstale":"2024-09-21T01:41:10.040907+0000","last_undegraded":"2024-09-21T01:41:10.040907+0000","last_fullsized":"2024-09-21T01:41:10.040907+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:30:06.321196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"84'8","reported_seq":42,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.019197+0000","last_change":"2024-09-21T01:39:44.297656+0000","last_active":"2024-09-21T01:41:39.019197+0000","last_peered":"2024-09-21T01:41:39.019197+0000","last_clean":"2024-09-21T01:41:39.019197+0000","last_became_active":"2024-09-21T01:39:44.297273+0000","last_became_peered":"2024-09-21T01:39:44.297273+0000","last_unstale":"2024-09-21T01:41:39.019197+0000","last_undegraded":"2024-09-21T01:41:39.019197+0000","last_fullsized":"2024-09-21T01:41:39.019197+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:35:24.645472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:09.881207+0000","last_change":"2024-09-21T01:40:09.842397+0000","last_active":"2024-09-21T01:41:09.881207+0000","last_peered":"2024-09-21T01:41:09.881207+0000","last_clean":"2024-09-21T01:41:09.881207+0000","last_became_active":"2024-09-21T01:40:09.841934+0000","last_became_peered":"2024-09-21T01:40:09.841934+0000","last_unstale":"2024-09-21T01:41:09.881207+0000","last_undegraded":"2024-09-21T01:41:09.881207+0000","last_fullsized":"2024-09-21T01:41:09.881207+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:06:36.189594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,8,5],"acting":[2,6,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"74'1","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:10.044389+0000","last_change":"2024-09-21T01:39:42.267207+0000","last_active":"2024-09-21T01:41:10.044389+0000","last_peered":"2024-09-21T01:41:10.044389+0000","last_clean":"2024-09-21T01:41:10.044389+0000","last_became_active":"2024-09-21T01:39:42.266829+0000","last_became_peered":"2024-09-21T01:39:42.266829+0000","last_unstale":"2024-09-21T01:41:10.044389+0000","last_undegraded":"2024-09-21T01:41:10.044389+0000","last_fullsized":"2024-09-21T01:41:10.044389+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:41.246201+0000","last_clean_scrub_stamp":"2024-09-21T01:39:41.246201+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:03:18.047546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"84'7","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.011573+0000","last_change":"2024-09-21T01:39:44.305545+0000","last_active":"2024-09-21T01:41:39.011573+0000","last_peered":"2024-09-21T01:41:39.011573+0000","last_clean":"2024-09-21T01:41:39.011573+0000","last_became_active":"2024-09-21T01:39:44.305195+0000","last_became_peered":"2024-09-21T01:39:44.305195+0000","last_unstale":"2024-09-21T01:41:39.011573+0000","last_undegraded":"2024-09-21T01:41:39.011573+0000","last_fullsized":"2024-09-21T01:41:39.011573+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:26:50.011622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:09.881130+0000","last_change":"2024-09-21T01:39:51.342132+0000","last_active":"2024-09-21T01:41:09.881130+0000","last_peered":"2024-09-21T01:41:09.881130+0000","last_clean":"2024-09-21T01:41:09.881130+0000","last_became_active":"2024-09-21T01:39:51.341668+0000","last_became_peered":"2024-09-21T01:39:51.341668+0000","last_unstale":"2024-09-21T01:41:09.881130+0000","last_undegraded":"2024-09-21T01:41:09.881130+0000","last_fullsized":"2024-09-21T01:41:09.881130+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:50.314109+0000","last_clean_scrub_stamp":"2024-09-21T01:39:50.314109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:28:18.119259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"84'9","reported_seq":44,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.018291+0000","last_change":"2024-09-21T01:39:44.300226+0000","last_active":"2024-09-21T01:41:39.018291+0000","last_peered":"2024-09-21T01:41:39.018291+0000","last_clean":"2024-09-21T01:41:39.018291+0000","last_became_active":"2024-09-21T01:39:44.298740+0000","last_became_peered":"2024-09-21T01:39:44.298740+0000","last_unstale":"2024-09-21T01:41:39.018291+0000","last_undegraded":"2024-09-21T01:41:39.018291+0000","last_fullsized":"2024-09-21T01:41:39.018291+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:05:33.288070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"84'12","reported_seq":47,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.019746+0000","last_change":"2024-09-21T01:39:44.301379+0000","last_active":"2024-09-21T01:41:39.019746+0000","last_peered":"2024-09-21T01:41:39.019746+0000","last_clean":"2024-09-21T01:41:39.019746+0000","last_became_active":"2024-09-21T01:39:44.301011+0000","last_became_peered":"2024-09-21T01:39:44.301011+0000","last_unstale":"2024-09-21T01:41:39.019746+0000","last_undegraded":"2024-09-21T01:41:39.019746+0000","last_fullsized":"2024-09-21T01:41:39.019746+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:16:47.672736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"84'8","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.009440+0000","last_change":"2024-09-21T01:39:44.294318+0000","last_active":"2024-09-21T01:41:39.009440+0000","last_peered":"2024-09-21T01:41:39.009440+0000","last_clean":"2024-09-21T01:41:39.009440+0000","last_became_active":"2024-09-21T01:39:44.293941+0000","last_became_peered":"2024-09-21T01:39:44.293941+0000","last_unstale":"2024-09-21T01:41:39.009440+0000","last_undegraded":"2024-09-21T01:41:39.009440+0000","last_fullsized":"2024-09-21T01:41:39.009440+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:27:34.776088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"84'7","reported_seq":42,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.017627+0000","last_change":"2024-09-21T01:39:44.287815+0000","last_active":"2024-09-21T01:41:39.017627+0000","last_peered":"2024-09-21T01:41:39.017627+0000","last_clean":"2024-09-21T01:41:39.017627+0000","last_became_active":"2024-09-21T01:39:44.287471+0000","last_became_peered":"2024-09-21T01:39:44.287471+0000","last_unstale":"2024-09-21T01:41:39.017627+0000","last_undegraded":"2024-09-21T01:41:39.017627+0000","last_fullsized":"2024-09-21T01:41:39.017627+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:13:59.661464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"84'4","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.017823+0000","last_change":"2024-09-21T01:39:44.285591+0000","last_active":"2024-09-21T01:41:39.017823+0000","last_peered":"2024-09-21T01:41:39.017823+0000","last_clean":"2024-09-21T01:41:39.017823+0000","last_became_active":"2024-09-21T01:39:44.285253+0000","last_became_peered":"2024-09-21T01:39:44.285253+0000","last_unstale":"2024-09-21T01:41:39.017823+0000","last_undegraded":"2024-09-21T01:41:39.017823+0000","last_fullsized":"2024-09-21T01:41:39.017823+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:58:02.890685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"84'6","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.008718+0000","last_change":"2024-09-21T01:39:44.306547+0000","last_active":"2024-09-21T01:41:39.008718+0000","last_peered":"2024-09-21T01:41:39.008718+0000","last_clean":"2024-09-21T01:41:39.008718+0000","last_became_active":"2024-09-21T01:39:44.306116+0000","last_became_peered":"2024-09-21T01:39:44.306116+0000","last_unstale":"2024-09-21T01:41:39.008718+0000","last_undegraded":"2024-09-21T01:41:39.008718+0000","last_fullsized":"2024-09-21T01:41:39.008718+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:58:40.654784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"84'15","reported_seq":50,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.027813+0000","last_change":"2024-09-21T01:39:44.295317+0000","last_active":"2024-09-21T01:41:39.027813+0000","last_peered":"2024-09-21T01:41:39.027813+0000","last_clean":"2024-09-21T01:41:39.027813+0000","last_became_active":"2024-09-21T01:39:44.294936+0000","last_became_peered":"2024-09-21T01:39:44.294936+0000","last_unstale":"2024-09-21T01:41:39.027813+0000","last_undegraded":"2024-09-21T01:41:39.027813+0000","last_fullsized":"2024-09-21T01:41:39.027813+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:32:24.112588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"84'2","reported_seq":37,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.004826+0000","last_change":"2024-09-21T01:39:44.297242+0000","last_active":"2024-09-21T01:41:39.004826+0000","last_peered":"2024-09-21T01:41:39.004826+0000","last_clean":"2024-09-21T01:41:39.004826+0000","last_became_active":"2024-09-21T01:39:44.296072+0000","last_became_peered":"2024-09-21T01:39:44.296072+0000","last_unstale":"2024-09-21T01:41:39.004826+0000","last_undegraded":"2024-09-21T01:41:39.004826+0000","last_fullsized":"2024-09-21T01:41:39.004826+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:22:23.449535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"84'6","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.018645+0000","last_change":"2024-09-21T01:39:44.293899+0000","last_active":"2024-09-21T01:41:39.018645+0000","last_peered":"2024-09-21T01:41:39.018645+0000","last_clean":"2024-09-21T01:41:39.018645+0000","last_became_active":"2024-09-21T01:39:44.293502+0000","last_became_peered":"2024-09-21T01:39:44.293502+0000","last_unstale":"2024-09-21T01:41:39.018645+0000","last_undegraded":"2024-09-21T01:41:39.018645+0000","last_fullsized":"2024-09-21T01:41:39.018645+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:07:39.549931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"84'8","reported_seq":42,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.012852+0000","last_change":"2024-09-21T01:39:44.298192+0000","last_active":"2024-09-21T01:41:39.012852+0000","last_peered":"2024-09-21T01:41:39.012852+0000","last_clean":"2024-09-21T01:41:39.012852+0000","last_became_active":"2024-09-21T01:39:44.297834+0000","last_became_peered":"2024-09-21T01:39:44.297834+0000","last_unstale":"2024-09-21T01:41:39.012852+0000","last_undegraded":"2024-09-21T01:41:39.012852+0000","last_fullsized":"2024-09-21T01:41:39.012852+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:41:21.759972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"84'10","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.031026+0000","last_change":"2024-09-21T01:39:44.300125+0000","last_active":"2024-09-21T01:41:39.031026+0000","last_peered":"2024-09-21T01:41:39.031026+0000","last_clean":"2024-09-21T01:41:39.031026+0000","last_became_active":"2024-09-21T01:39:44.298047+0000","last_became_peered":"2024-09-21T01:39:44.298047+0000","last_unstale":"2024-09-21T01:41:39.031026+0000","last_undegraded":"2024-09-21T01:41:39.031026+0000","last_fullsized":"2024-09-21T01:41:39.031026+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:31:58.719520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"84'11","reported_seq":45,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.018117+0000","last_change":"2024-09-21T01:39:44.287346+0000","last_active":"2024-09-21T01:41:39.018117+0000","last_peered":"2024-09-21T01:41:39.018117+0000","last_clean":"2024-09-21T01:41:39.018117+0000","last_became_active":"2024-09-21T01:39:44.286999+0000","last_became_peered":"2024-09-21T01:39:44.286999+0000","last_unstale":"2024-09-21T01:41:39.018117+0000","last_undegraded":"2024-09-21T01:41:39.018117+0000","last_fullsized":"2024-09-21T01:41:39.018117+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:42:26.732516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"84'8","reported_seq":42,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.021318+0000","last_change":"2024-09-21T01:39:44.299083+0000","last_active":"2024-09-21T01:41:39.021318+0000","last_peered":"2024-09-21T01:41:39.021318+0000","last_clean":"2024-09-21T01:41:39.021318+0000","last_became_active":"2024-09-21T01:39:44.298194+0000","last_became_peered":"2024-09-21T01:39:44.298194+0000","last_unstale":"2024-09-21T01:41:39.021318+0000","last_undegraded":"2024-09-21T01:41:39.021318+0000","last_fullsized":"2024-09-21T01:41:39.021318+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:22:23.360519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"84'7","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.004792+0000","last_change":"2024-09-21T01:39:44.292985+0000","last_active":"2024-09-21T01:41:39.004792+0000","last_peered":"2024-09-21T01:41:39.004792+0000","last_clean":"2024-09-21T01:41:39.004792+0000","last_became_active":"2024-09-21T01:39:44.292565+0000","last_became_peered":"2024-09-21T01:39:44.292565+0000","last_unstale":"2024-09-21T01:41:39.004792+0000","last_undegraded":"2024-09-21T01:41:39.004792+0000","last_fullsized":"2024-09-21T01:41:39.004792+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:03:33.563458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"84'10","reported_seq":44,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.026635+0000","last_change":"2024-09-21T01:39:44.291522+0000","last_active":"2024-09-21T01:41:39.026635+0000","last_peered":"2024-09-21T01:41:39.026635+0000","last_clean":"2024-09-21T01:41:39.026635+0000","last_became_active":"2024-09-21T01:39:44.291173+0000","last_became_peered":"2024-09-21T01:39:44.291173+0000","last_unstale":"2024-09-21T01:41:39.026635+0000","last_undegraded":"2024-09-21T01:41:39.026635+0000","last_fullsized":"2024-09-21T01:41:39.026635+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:41:54.562004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"84'8","reported_seq":42,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.026808+0000","last_change":"2024-09-21T01:39:44.305053+0000","last_active":"2024-09-21T01:41:39.026808+0000","last_peered":"2024-09-21T01:41:39.026808+0000","last_clean":"2024-09-21T01:41:39.026808+0000","last_became_active":"2024-09-21T01:39:44.304651+0000","last_became_peered":"2024-09-21T01:39:44.304651+0000","last_unstale":"2024-09-21T01:41:39.026808+0000","last_undegraded":"2024-09-21T01:41:39.026808+0000","last_fullsized":"2024-09-21T01:41:39.026808+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:15:42.819633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"84'9","reported_seq":42,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.031281+0000","last_change":"2024-09-21T01:39:44.298405+0000","last_active":"2024-09-21T01:41:39.031281+0000","last_peered":"2024-09-21T01:41:39.031281+0000","last_clean":"2024-09-21T01:41:39.031281+0000","last_became_active":"2024-09-21T01:39:44.298010+0000","last_became_peered":"2024-09-21T01:39:44.298010+0000","last_unstale":"2024-09-21T01:41:39.031281+0000","last_undegraded":"2024-09-21T01:41:39.031281+0000","last_fullsized":"2024-09-21T01:41:39.031281+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:09:15.321530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"84'7","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.017606+0000","last_change":"2024-09-21T01:39:44.290593+0000","last_active":"2024-09-21T01:41:39.017606+0000","last_peered":"2024-09-21T01:41:39.017606+0000","last_clean":"2024-09-21T01:41:39.017606+0000","last_became_active":"2024-09-21T01:39:44.290235+0000","last_became_peered":"2024-09-21T01:39:44.290235+0000","last_unstale":"2024-09-21T01:41:39.017606+0000","last_undegraded":"2024-09-21T01:41:39.017606+0000","last_fullsized":"2024-09-21T01:41:39.017606+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:52:20.359493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"84'7","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.021489+0000","last_change":"2024-09-21T01:39:44.301902+0000","last_active":"2024-09-21T01:41:39.021489+0000","last_peered":"2024-09-21T01:41:39.021489+0000","last_clean":"2024-09-21T01:41:39.021489+0000","last_became_active":"2024-09-21T01:39:44.301494+0000","last_became_peered":"2024-09-21T01:39:44.301494+0000","last_unstale":"2024-09-21T01:41:39.021489+0000","last_undegraded":"2024-09-21T01:41:39.021489+0000","last_fullsized":"2024-09-21T01:41:39.021489+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:06:16.162987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"84'10","reported_seq":44,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.019702+0000","last_change":"2024-09-21T01:39:44.292360+0000","last_active":"2024-09-21T01:41:39.019702+0000","last_peered":"2024-09-21T01:41:39.019702+0000","last_clean":"2024-09-21T01:41:39.019702+0000","last_became_active":"2024-09-21T01:39:44.291995+0000","last_became_peered":"2024-09-21T01:39:44.291995+0000","last_unstale":"2024-09-21T01:41:39.019702+0000","last_undegraded":"2024-09-21T01:41:39.019702+0000","last_fullsized":"2024-09-21T01:41:39.019702+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:29:10.511082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"84'7","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.020802+0000","last_change":"2024-09-21T01:39:44.291836+0000","last_active":"2024-09-21T01:41:39.020802+0000","last_peered":"2024-09-21T01:41:39.020802+0000","last_clean":"2024-09-21T01:41:39.020802+0000","last_became_active":"2024-09-21T01:39:44.291459+0000","last_became_peered":"2024-09-21T01:39:44.291459+0000","last_unstale":"2024-09-21T01:41:39.020802+0000","last_undegraded":"2024-09-21T01:41:39.020802+0000","last_fullsized":"2024-09-21T01:41:39.020802+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:11:53.296520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"84'6","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.030806+0000","last_change":"2024-09-21T01:39:44.298572+0000","last_active":"2024-09-21T01:41:39.030806+0000","last_peered":"2024-09-21T01:41:39.030806+0000","last_clean":"2024-09-21T01:41:39.030806+0000","last_became_active":"2024-09-21T01:39:44.297903+0000","last_became_peered":"2024-09-21T01:39:44.297903+0000","last_unstale":"2024-09-21T01:41:39.030806+0000","last_undegraded":"2024-09-21T01:41:39.030806+0000","last_fullsized":"2024-09-21T01:41:39.030806+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:25:06.327202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"84'16","reported_seq":50,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.025882+0000","last_change":"2024-09-21T01:39:44.292648+0000","last_active":"2024-09-21T01:41:39.025882+0000","last_peered":"2024-09-21T01:41:39.025882+0000","last_clean":"2024-09-21T01:41:39.025882+0000","last_became_active":"2024-09-21T01:39:44.292215+0000","last_became_peered":"2024-09-21T01:39:44.292215+0000","last_unstale":"2024-09-21T01:41:39.025882+0000","last_undegraded":"2024-09-21T01:41:39.025882+0000","last_fullsized":"2024-09-21T01:41:39.025882+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T01:43:02.265276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"84'11","reported_seq":44,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.030192+0000","last_change":"2024-09-21T01:39:44.303330+0000","last_active":"2024-09-21T01:41:39.030192+0000","last_peered":"2024-09-21T01:41:39.030192+0000","last_clean":"2024-09-21T01:41:39.030192+0000","last_became_active":"2024-09-21T01:39:44.302862+0000","last_became_peered":"2024-09-21T01:39:44.302862+0000","last_unstale":"2024-09-21T01:41:39.030192+0000","last_undegraded":"2024-09-21T01:41:39.030192+0000","last_fullsized":"2024-09-21T01:41:39.030192+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:58:12.296150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"84'9","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.018434+0000","last_change":"2024-09-21T01:39:44.288015+0000","last_active":"2024-09-21T01:41:39.018434+0000","last_peered":"2024-09-21T01:41:39.018434+0000","last_clean":"2024-09-21T01:41:39.018434+0000","last_became_active":"2024-09-21T01:39:44.287455+0000","last_became_peered":"2024-09-21T01:39:44.287455+0000","last_unstale":"2024-09-21T01:41:39.018434+0000","last_undegraded":"2024-09-21T01:41:39.018434+0000","last_fullsized":"2024-09-21T01:41:39.018434+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:12:07.036882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"84'5","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.021128+0000","last_change":"2024-09-21T01:39:44.294594+0000","last_active":"2024-09-21T01:41:39.021128+0000","last_peered":"2024-09-21T01:41:39.021128+0000","last_clean":"2024-09-21T01:41:39.021128+0000","last_became_active":"2024-09-21T01:39:44.294218+0000","last_became_peered":"2024-09-21T01:39:44.294218+0000","last_unstale":"2024-09-21T01:41:39.021128+0000","last_undegraded":"2024-09-21T01:41:39.021128+0000","last_fullsized":"2024-09-21T01:41:39.021128+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T02:45:54.875131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"84'6","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.001865+0000","last_change":"2024-09-21T01:39:44.285172+0000","last_active":"2024-09-21T01:41:39.001865+0000","last_peered":"2024-09-21T01:41:39.001865+0000","last_clean":"2024-09-21T01:41:39.001865+0000","last_became_active":"2024-09-21T01:39:44.284799+0000","last_became_peered":"2024-09-21T01:39:44.284799+0000","last_unstale":"2024-09-21T01:41:39.001865+0000","last_undegraded":"2024-09-21T01:41:39.001865+0000","last_fullsized":"2024-09-21T01:41:39.001865+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:06:30.562297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"84'4","reported_seq":38,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:38.994895+0000","last_change":"2024-09-21T01:39:44.295990+0000","last_active":"2024-09-21T01:41:38.994895+0000","last_peered":"2024-09-21T01:41:38.994895+0000","last_clean":"2024-09-21T01:41:38.994895+0000","last_became_active":"2024-09-21T01:39:44.295601+0000","last_became_peered":"2024-09-21T01:39:44.295601+0000","last_unstale":"2024-09-21T01:41:38.994895+0000","last_undegraded":"2024-09-21T01:41:38.994895+0000","last_fullsized":"2024-09-21T01:41:38.994895+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:37:08.300911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"84'8","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.007027+0000","last_change":"2024-09-21T01:39:44.300104+0000","last_active":"2024-09-21T01:41:39.007027+0000","last_peered":"2024-09-21T01:41:39.007027+0000","last_clean":"2024-09-21T01:41:39.007027+0000","last_became_active":"2024-09-21T01:39:44.299709+0000","last_became_peered":"2024-09-21T01:39:44.299709+0000","last_unstale":"2024-09-21T01:41:39.007027+0000","last_undegraded":"2024-09-21T01:41:39.007027+0000","last_fullsized":"2024-09-21T01:41:39.007027+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:01:35.013021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"84'7","reported_seq":42,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.027402+0000","last_change":"2024-09-21T01:39:44.295900+0000","last_active":"2024-09-21T01:41:39.027402+0000","last_peered":"2024-09-21T01:41:39.027402+0000","last_clean":"2024-09-21T01:41:39.027402+0000","last_became_active":"2024-09-21T01:39:44.295303+0000","last_became_peered":"2024-09-21T01:39:44.295303+0000","last_unstale":"2024-09-21T01:41:39.027402+0000","last_undegraded":"2024-09-21T01:41:39.027402+0000","last_fullsized":"2024-09-21T01:41:39.027402+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:00:23.097745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"84'4","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.018723+0000","last_change":"2024-09-21T01:39:44.303627+0000","last_active":"2024-09-21T01:41:39.018723+0000","last_peered":"2024-09-21T01:41:39.018723+0000","last_clean":"2024-09-21T01:41:39.018723+0000","last_became_active":"2024-09-21T01:39:44.303260+0000","last_became_peered":"2024-09-21T01:39:44.303260+0000","last_unstale":"2024-09-21T01:41:39.018723+0000","last_undegraded":"2024-09-21T01:41:39.018723+0000","last_fullsized":"2024-09-21T01:41:39.018723+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:17:39.630994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"84'8","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-21T01:41:39.026548+0000","last_change":"2024-09-21T01:39:44.306087+0000","last_active":"2024-09-21T01:41:39.026548+0000","last_peered":"2024-09-21T01:41:39.026548+0000","last_clean":"2024-09-21T01:41:39.026548+0000","last_became_active":"2024-09-21T01:39:44.305660+0000","last_became_peered":"2024-09-21T01:39:44.305660+0000","last_unstale":"2024-09-21T01:41:39.026548+0000","last_undegraded":"2024-09-21T01:41:39.026548+0000","last_fullsized":"2024-09-21T01:41:39.026548+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T01:39:43.260341+0000","last_clean_scrub_stamp":"2024-09-21T01:39:43.260341+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:26:46.911966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":462470,"num_objects":23,"num_object_clones":0,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":222,"num_read_kb":195,"num_write":158,"num_write_kb":970,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":458752,"data_stored":1789750,"data_compressed":74760,"data_compressed_allocated":98304,"data_compressed_original":1523712,"omap_allocated":0,"internal_metadata":0},"log_size":133,"ondisk_log_size":133,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":376832,"data_stored":4132576,"data_compressed":247723,"data_compressed_allocated":315392,"data_compressed_original":4096000,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":68,"seq":292057776168,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":925696,"data_stored":494638,"data_compressed":29495,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939692,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32220,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712932,"statfs":{"total":95995035648,"available":95962042368,"internally_reserved":0,"allocated":1060864,"data_stored":1149000,"data_compressed":65346,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":58,"seq":249108103218,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":933888,"data_stored":499316,"data_compressed":29495,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":52,"seq":223338299448,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":958464,"data_stored":888458,"data_compressed":48784,"data_compressed_allocated":65536,"data_compressed_original":475136,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495676,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32144,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713008,"statfs":{"total":95995035648,"available":95962120192,"internally_reserved":0,"allocated":983040,"data_stored":1089684,"data_compressed":65346,"data_compressed_allocated":86016,"data_compressed_original":671744,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":41,"seq":176093659201,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":921600,"data_stored":490542,"data_compressed":29495,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855431,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32204,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712948,"statfs":{"total":95995035648,"available":95962058752,"internally_reserved":0,"allocated":1040384,"data_stored":1478964,"data_compressed":83437,"data_compressed_allocated":110592,"data_compressed_original":1040384,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":30,"seq":128849018956,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27932,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717220,"statfs":{"total":95995035648,"available":95966433280,"internally_reserved":0,"allocated":929792,"data_stored":494660,"data_compressed":29495,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182481,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36332,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708820,"statfs":{"total":95995035648,"available":95957831680,"internally_reserved":0,"allocated":1007616,"data_stored":1277638,"data_compressed":66875,"data_compressed_allocated":90112,"data_compressed_original":843776,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411414,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36328,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708824,"statfs":{"total":95995035648,"available":95957835776,"internally_reserved":0,"allocated":1007616,"data_stored":563314,"data_compressed":29495,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574938,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32164,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712988,"statfs":{"total":95995035648,"available":95962099712,"internally_reserved":0,"allocated":1003520,"data_stored":563280,"data_compressed":29495,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705760,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":925696,"data_stored":490632,"data_compressed":29495,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34234,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34234,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35851,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35851,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35851,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35851,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35851,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":72738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":72772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":787096,"data_compressed":37380,"data_compressed_allocated":49152,"data_compressed_original":761856,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":393958,"data_compressed":18091,"data_compressed_allocated":24576,"data_compressed_original":368640,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":393820,"data_compressed":19289,"data_compressed_allocated":24576,"data_compressed_original":393216,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":68090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T01:42:01.352 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T01:42:01.598 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:42:02.000 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:42:01 smithi083 ceph-mon[31370]: from='client.15447 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T01:42:02.000 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:42:01 smithi083 ceph-mon[31370]: pgmap v338: 129 pgs: 129 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 175 KiB/s wr, 49 op/s 2024-09-21T01:42:02.000 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:42:01 smithi083 ceph-mon[31370]: mgrmap e24: x(active, since 8m), standbys: z, y 2024-09-21T01:42:02.108 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:02.090+0000 7f43522e6640 1 -- 172.21.15.83:0/3429094964 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f434c108420 msgr2=0x7f434c108830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:42:02.109 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:02.090+0000 7f43522e6640 1 --2- 172.21.15.83:0/3429094964 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f434c108420 0x7f434c108830 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f4340009900 tx=0x7f434002a410 comp rx=0 tx=0).stop 2024-09-21T01:42:02.109 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:02.090+0000 7f43522e6640 1 -- 172.21.15.83:0/3429094964 shutdown_connections 2024-09-21T01:42:02.109 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:02.090+0000 7f43522e6640 1 --2- 172.21.15.83:0/3429094964 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f434c108d70 0x7f434c10f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:42:02.109 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:02.090+0000 7f43522e6640 1 --2- 172.21.15.83:0/3429094964 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f434c108420 0x7f434c108830 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:42:02.109 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:02.090+0000 7f43522e6640 1 --2- 172.21.15.83:0/3429094964 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f434c102ae0 0x7f434c102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:42:02.109 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:02.090+0000 7f43522e6640 1 -- 172.21.15.83:0/3429094964 >> 172.21.15.83:0/3429094964 conn(0x7f434c079770 msgr2=0x7f434c079b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:42:02.109 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:02.090+0000 7f43522e6640 1 -- 172.21.15.83:0/3429094964 shutdown_connections 2024-09-21T01:42:02.109 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:02.090+0000 7f43522e6640 1 -- 172.21.15.83:0/3429094964 wait complete. 2024-09-21T01:42:02.109 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:02.091+0000 7f43522e6640 1 Processor -- start 2024-09-21T01:42:02.109 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:02.091+0000 7f43522e6640 1 -- start start 2024-09-21T01:42:02.109 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:02.092+0000 7f43522e6640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f434c102ae0 0x7f434c199330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:42:02.110 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:02.092+0000 7f43522e6640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f434c108420 0x7f434c1998d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:42:02.110 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:02.092+0000 7f43522e6640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f434c108d70 0x7f434c19eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:42:02.110 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:02.092+0000 7f43522e6640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f434c1128e0 con 0x7f434c102ae0 2024-09-21T01:42:02.110 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:02.092+0000 7f43522e6640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f434c112760 con 0x7f434c108420 2024-09-21T01:42:02.110 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:02.092+0000 7f43522e6640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f434c112a60 con 0x7f434c108d70 2024-09-21T01:42:02.110 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:02.092+0000 7f434bfff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f434c102ae0 0x7f434c199330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:42:02.110 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:02.092+0000 7f434bfff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f434c102ae0 0x7f434c199330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:60698/0 (socket says 172.21.15.83:60698) 2024-09-21T01:42:02.110 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:02.092+0000 7f434bfff640 1 -- 172.21.15.83:0/1811982062 learned_addr learned my addr 172.21.15.83:0/1811982062 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:42:02.110 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:02.092+0000 7f4350883640 1 --2- 172.21.15.83:0/1811982062 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f434c108d70 0x7f434c19eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:42:02.110 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:02.092+0000 7f434b7fe640 1 --2- 172.21.15.83:0/1811982062 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f434c108420 0x7f434c1998d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:42:02.110 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:02.092+0000 7f434bfff640 1 -- 172.21.15.83:0/1811982062 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f434c108d70 msgr2=0x7f434c19eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:42:02.110 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:02.092+0000 7f434bfff640 1 --2- 172.21.15.83:0/1811982062 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f434c108d70 0x7f434c19eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:42:02.110 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:02.092+0000 7f434bfff640 1 -- 172.21.15.83:0/1811982062 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f434c108420 msgr2=0x7f434c1998d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:42:02.111 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:02.092+0000 7f434bfff640 1 --2- 172.21.15.83:0/1811982062 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f434c108420 0x7f434c1998d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:42:02.111 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:02.092+0000 7f434bfff640 1 -- 172.21.15.83:0/1811982062 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f434c19f2a0 con 0x7f434c102ae0 2024-09-21T01:42:02.111 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:02.092+0000 7f434b7fe640 1 --2- 172.21.15.83:0/1811982062 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f434c108420 0x7f434c1998d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:42:02.111 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:02.092+0000 7f434bfff640 1 --2- 172.21.15.83:0/1811982062 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f434c102ae0 0x7f434c199330 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f433c00d950 tx=0x7f433c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:42:02.111 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:02.093+0000 7f43497fa640 1 -- 172.21.15.83:0/1811982062 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f433c017070 con 0x7f434c102ae0 2024-09-21T01:42:02.111 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:02.093+0000 7f43522e6640 1 -- 172.21.15.83:0/1811982062 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f434c19f590 con 0x7f434c102ae0 2024-09-21T01:42:02.111 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:02.093+0000 7f43497fa640 1 -- 172.21.15.83:0/1811982062 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f433c009c30 con 0x7f434c102ae0 2024-09-21T01:42:02.111 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:02.093+0000 7f43497fa640 1 -- 172.21.15.83:0/1811982062 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f433c00f620 con 0x7f434c102ae0 2024-09-21T01:42:02.111 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:02.093+0000 7f43522e6640 1 -- 172.21.15.83:0/1811982062 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f434c1a5cf0 con 0x7f434c102ae0 2024-09-21T01:42:02.111 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:02.094+0000 7f43522e6640 1 -- 172.21.15.83:0/1811982062 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f434c103d60 con 0x7f434c102ae0 2024-09-21T01:42:02.111 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:02.095+0000 7f43497fa640 1 -- 172.21.15.83:0/1811982062 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7f433c005030 con 0x7f434c102ae0 2024-09-21T01:42:02.111 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:02.096+0000 7f43497fa640 1 --2- 172.21.15.83:0/1811982062 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f43340b6680 0x7f43340b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:42:02.111 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:02.096+0000 7f434b7fe640 1 --2- 172.21.15.83:0/1811982062 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f43340b6680 0x7f43340b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:42:02.111 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:02.096+0000 7f43497fa640 1 -- 172.21.15.83:0/1811982062 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9315+0+0 (secure 0 0 0) 0x7f433c0e76c0 con 0x7f434c102ae0 2024-09-21T01:42:02.112 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:02.097+0000 7f434b7fe640 1 --2- 172.21.15.83:0/1811982062 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f43340b6680 0x7f43340b8b90 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f4340006010 tx=0x7f4340000bc0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:42:02.112 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:02.100+0000 7f43497fa640 1 -- 172.21.15.83:0/1811982062 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f433c0ad890 con 0x7f434c102ae0 2024-09-21T01:42:02.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:42:01 smithi142 ceph-mon[34050]: from='client.15447 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T01:42:02.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:42:01 smithi142 ceph-mon[34050]: pgmap v338: 129 pgs: 129 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 175 KiB/s wr, 49 op/s 2024-09-21T01:42:02.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:42:01 smithi142 ceph-mon[34050]: mgrmap e24: x(active, since 8m), standbys: z, y 2024-09-21T01:42:02.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:42:01 smithi119 ceph-mon[33693]: from='client.15447 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T01:42:02.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:42:01 smithi119 ceph-mon[33693]: pgmap v338: 129 pgs: 129 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 175 KiB/s wr, 49 op/s 2024-09-21T01:42:02.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:42:01 smithi119 ceph-mon[33693]: mgrmap e24: x(active, since 8m), standbys: z, y 2024-09-21T01:42:02.314 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:02.314+0000 7f43522e6640 1 -- 172.21.15.83:0/1811982062 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f434c10abc0 con 0x7f434c102ae0 2024-09-21T01:42:02.315 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:02.315+0000 7f43497fa640 1 -- 172.21.15.83:0/1811982062 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11857 (secure 0 0 0) 0x7f433c009de0 con 0x7f434c102ae0 2024-09-21T01:42:02.315 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T01:42:02.316 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":21,"btime":"2024-09-21T01:40:27:947059+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14775,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6835/1105040204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":1105040204},{"type":"v1","addr":"172.21.15.83:6835","nonce":1105040204}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14787,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/2234789563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6836","nonce":2234789563},{"type":"v1","addr":"172.21.15.83:6837","nonce":2234789563}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14838,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6839/136258364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6838","nonce":136258364},{"type":"v1","addr":"172.21.15.83:6839","nonce":136258364}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14850,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6841/129439444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6840","nonce":129439444},{"type":"v1","addr":"172.21.15.83:6841","nonce":129439444}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24569,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/2839502433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":2839502433},{"type":"v1","addr":"172.21.15.119:6833","nonce":2839502433}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24580,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6833/2841606990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":2841606990},{"type":"v1","addr":"172.21.15.142:6833","nonce":2841606990}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24599,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/415902608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":415902608},{"type":"v1","addr":"172.21.15.119:6835","nonce":415902608}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24607,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/3009088510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":3009088510},{"type":"v1","addr":"172.21.15.142:6835","nonce":3009088510}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24613,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/3847200126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6836","nonce":3847200126},{"type":"v1","addr":"172.21.15.142:6837","nonce":3847200126}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24626,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/3619222976","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":3619222976},{"type":"v1","addr":"172.21.15.119:6837","nonce":3619222976}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T01:39:45.145124+0000","modified":"2024-09-21T01:40:27.664151+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24653},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24631":{"gid":24631,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.142:6839/1817880741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6838","nonce":1817880741},{"type":"v1","addr":"172.21.15.142:6839","nonce":1817880741}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24653":{"gid":24653,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.119:6839/3106757092","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":3106757092},{"type":"v1","addr":"172.21.15.119:6839","nonce":3106757092}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24653,"qdb_cluster":[24653]},"id":1}]} 2024-09-21T01:42:02.316 INFO:teuthology.orchestra.run.smithi083.stderr:dumped fsmap epoch 21 2024-09-21T01:42:02.317 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:02.317+0000 7f43522e6640 1 -- 172.21.15.83:0/1811982062 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f43340b6680 msgr2=0x7f43340b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:42:02.317 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:02.317+0000 7f43522e6640 1 --2- 172.21.15.83:0/1811982062 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f43340b6680 0x7f43340b8b90 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f4340006010 tx=0x7f4340000bc0 comp rx=0 tx=0).stop 2024-09-21T01:42:02.318 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:02.317+0000 7f43522e6640 1 -- 172.21.15.83:0/1811982062 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f434c102ae0 msgr2=0x7f434c199330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:42:02.318 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:02.317+0000 7f43522e6640 1 --2- 172.21.15.83:0/1811982062 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f434c102ae0 0x7f434c199330 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f433c00d950 tx=0x7f433c00de10 comp rx=0 tx=0).stop 2024-09-21T01:42:02.318 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:02.317+0000 7f43522e6640 1 -- 172.21.15.83:0/1811982062 shutdown_connections 2024-09-21T01:42:02.318 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:02.317+0000 7f43522e6640 1 --2- 172.21.15.83:0/1811982062 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f43340b6680 0x7f43340b8b90 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:42:02.318 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:02.317+0000 7f43522e6640 1 --2- 172.21.15.83:0/1811982062 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f434c108d70 0x7f434c19eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:42:02.318 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:02.317+0000 7f43522e6640 1 --2- 172.21.15.83:0/1811982062 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f434c108420 0x7f434c1998d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:42:02.318 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:02.317+0000 7f43522e6640 1 --2- 172.21.15.83:0/1811982062 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f434c102ae0 0x7f434c199330 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:42:02.318 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:02.317+0000 7f43522e6640 1 -- 172.21.15.83:0/1811982062 >> 172.21.15.83:0/1811982062 conn(0x7f434c079770 msgr2=0x7f434c106570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:42:02.318 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:02.317+0000 7f43522e6640 1 -- 172.21.15.83:0/1811982062 shutdown_connections 2024-09-21T01:42:02.318 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:02.317+0000 7f43522e6640 1 -- 172.21.15.83:0/1811982062 wait complete. 2024-09-21T01:42:02.976 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T01:42:02.998 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:42:02 smithi083 ceph-mon[31370]: from='client.? 172.21.15.83:0/1811982062' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:42:03.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:42:02 smithi142 ceph-mon[34050]: from='client.? 172.21.15.83:0/1811982062' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:42:03.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:42:02 smithi119 ceph-mon[33693]: from='client.? 172.21.15.83:0/1811982062' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:42:03.222 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:42:03.709 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:03.697+0000 7f9fe8c0f640 1 -- 172.21.15.83:0/3084301027 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9fe4102a60 msgr2=0x7f9fe4102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:42:03.709 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:03.697+0000 7f9fe8c0f640 1 --2- 172.21.15.83:0/3084301027 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9fe4102a60 0x7f9fe4102e70 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f9fd8009ca0 tx=0x7f9fd802a8c0 comp rx=0 tx=0).stop 2024-09-21T01:42:03.709 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:03.697+0000 7f9fe8c0f640 1 -- 172.21.15.83:0/3084301027 shutdown_connections 2024-09-21T01:42:03.710 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:03.697+0000 7f9fe8c0f640 1 --2- 172.21.15.83:0/3084301027 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9fe4108cf0 0x7f9fe410f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:42:03.710 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:03.697+0000 7f9fe8c0f640 1 --2- 172.21.15.83:0/3084301027 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9fe41083a0 0x7f9fe41087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:42:03.710 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:03.697+0000 7f9fe8c0f640 1 --2- 172.21.15.83:0/3084301027 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9fe4102a60 0x7f9fe4102e70 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:42:03.710 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:03.697+0000 7f9fe8c0f640 1 -- 172.21.15.83:0/3084301027 >> 172.21.15.83:0/3084301027 conn(0x7f9fe4079730 msgr2=0x7f9fe4079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:42:03.710 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:03.697+0000 7f9fe8c0f640 1 -- 172.21.15.83:0/3084301027 shutdown_connections 2024-09-21T01:42:03.710 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:03.697+0000 7f9fe8c0f640 1 -- 172.21.15.83:0/3084301027 wait complete. 2024-09-21T01:42:03.710 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:03.698+0000 7f9fe8c0f640 1 Processor -- start 2024-09-21T01:42:03.710 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:03.698+0000 7f9fe8c0f640 1 -- start start 2024-09-21T01:42:03.710 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:03.698+0000 7f9fe8c0f640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9fe4102a60 0x7f9fe419a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:42:03.710 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:03.698+0000 7f9fe8c0f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9fe41083a0 0x7f9fe419a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:42:03.710 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:03.698+0000 7f9fe8c0f640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9fe4108cf0 0x7f9fe419fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:42:03.710 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:03.698+0000 7f9fe8c0f640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f9fe4112940 con 0x7f9fe4108cf0 2024-09-21T01:42:03.710 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:03.698+0000 7f9fe8c0f640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f9fe41127c0 con 0x7f9fe41083a0 2024-09-21T01:42:03.711 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:03.698+0000 7f9fe8c0f640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f9fe4112ac0 con 0x7f9fe4102a60 2024-09-21T01:42:03.711 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:03.699+0000 7f9fe2d9d640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9fe4108cf0 0x7f9fe419fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:42:03.711 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:03.699+0000 7f9fe2d9d640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9fe4108cf0 0x7f9fe419fc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:34992/0 (socket says 172.21.15.83:34992) 2024-09-21T01:42:03.711 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:03.699+0000 7f9fe2d9d640 1 -- 172.21.15.83:0/4216733667 learned_addr learned my addr 172.21.15.83:0/4216733667 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:42:03.711 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:03.699+0000 7f9fe259c640 1 --2- 172.21.15.83:0/4216733667 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9fe4102a60 0x7f9fe419a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:42:03.711 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:03.699+0000 7f9fe1d9b640 1 --2- 172.21.15.83:0/4216733667 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9fe41083a0 0x7f9fe419a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:42:03.711 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:03.699+0000 7f9fe2d9d640 1 -- 172.21.15.83:0/4216733667 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9fe4102a60 msgr2=0x7f9fe419a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:42:03.711 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:03.699+0000 7f9fe2d9d640 1 --2- 172.21.15.83:0/4216733667 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9fe4102a60 0x7f9fe419a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:42:03.711 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:03.699+0000 7f9fe2d9d640 1 -- 172.21.15.83:0/4216733667 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9fe41083a0 msgr2=0x7f9fe419a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:42:03.711 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:03.699+0000 7f9fe2d9d640 1 --2- 172.21.15.83:0/4216733667 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9fe41083a0 0x7f9fe419a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:42:03.711 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:03.699+0000 7f9fe2d9d640 1 -- 172.21.15.83:0/4216733667 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fe41a0390 con 0x7f9fe4108cf0 2024-09-21T01:42:03.711 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:03.699+0000 7f9fe259c640 1 --2- 172.21.15.83:0/4216733667 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9fe4102a60 0x7f9fe419a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:42:03.711 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:03.699+0000 7f9fe2d9d640 1 --2- 172.21.15.83:0/4216733667 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9fe4108cf0 0x7f9fe419fc60 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f9fdc009fd0 tx=0x7f9fdc00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:42:03.711 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:03.699+0000 7f9fd37fe640 1 -- 172.21.15.83:0/4216733667 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fdc011830 con 0x7f9fe4108cf0 2024-09-21T01:42:03.712 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:03.699+0000 7f9fe8c0f640 1 -- 172.21.15.83:0/4216733667 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9fe41a0680 con 0x7f9fe4108cf0 2024-09-21T01:42:03.712 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:03.699+0000 7f9fd37fe640 1 -- 172.21.15.83:0/4216733667 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9fdc016070 con 0x7f9fe4108cf0 2024-09-21T01:42:03.712 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:03.699+0000 7f9fd37fe640 1 -- 172.21.15.83:0/4216733667 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fdc010d20 con 0x7f9fe4108cf0 2024-09-21T01:42:03.712 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:03.699+0000 7f9fe8c0f640 1 -- 172.21.15.83:0/4216733667 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9fe41a6de0 con 0x7f9fe4108cf0 2024-09-21T01:42:03.712 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:03.700+0000 7f9fe8c0f640 1 -- 172.21.15.83:0/4216733667 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9fe4102e70 con 0x7f9fe4108cf0 2024-09-21T01:42:03.712 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:03.702+0000 7f9fd37fe640 1 -- 172.21.15.83:0/4216733667 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7f9fdc01b460 con 0x7f9fe4108cf0 2024-09-21T01:42:03.712 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:03.702+0000 7f9fd37fe640 1 --2- 172.21.15.83:0/4216733667 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f9fcc0b6680 0x7f9fcc0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:42:03.712 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:03.703+0000 7f9fe259c640 1 --2- 172.21.15.83:0/4216733667 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f9fcc0b6680 0x7f9fcc0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:42:03.712 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:03.703+0000 7f9fd37fe640 1 -- 172.21.15.83:0/4216733667 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9315+0+0 (secure 0 0 0) 0x7f9fdc0e7690 con 0x7f9fe4108cf0 2024-09-21T01:42:03.712 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:03.703+0000 7f9fe259c640 1 --2- 172.21.15.83:0/4216733667 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f9fcc0b6680 0x7f9fcc0b8b90 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f9fd8000f80 tx=0x7f9fd8031000 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:42:03.712 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:03.706+0000 7f9fd37fe640 1 -- 172.21.15.83:0/4216733667 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f9fdc0b1ca0 con 0x7f9fe4108cf0 2024-09-21T01:42:03.923 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:03.923+0000 7f9fe8c0f640 1 -- 172.21.15.83:0/4216733667 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9fe41a7170 con 0x7f9fe4108cf0 2024-09-21T01:42:03.924 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:03.924+0000 7f9fd37fe640 1 -- 172.21.15.83:0/4216733667 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11857 (secure 0 0 0) 0x7f9fdc0b6be0 con 0x7f9fe4108cf0 2024-09-21T01:42:03.924 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T01:42:03.924 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":21,"btime":"2024-09-21T01:40:27:947059+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14775,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6835/1105040204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":1105040204},{"type":"v1","addr":"172.21.15.83:6835","nonce":1105040204}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14787,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/2234789563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6836","nonce":2234789563},{"type":"v1","addr":"172.21.15.83:6837","nonce":2234789563}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14838,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6839/136258364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6838","nonce":136258364},{"type":"v1","addr":"172.21.15.83:6839","nonce":136258364}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14850,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6841/129439444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6840","nonce":129439444},{"type":"v1","addr":"172.21.15.83:6841","nonce":129439444}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24569,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/2839502433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":2839502433},{"type":"v1","addr":"172.21.15.119:6833","nonce":2839502433}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24580,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6833/2841606990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":2841606990},{"type":"v1","addr":"172.21.15.142:6833","nonce":2841606990}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24599,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/415902608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":415902608},{"type":"v1","addr":"172.21.15.119:6835","nonce":415902608}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24607,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/3009088510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":3009088510},{"type":"v1","addr":"172.21.15.142:6835","nonce":3009088510}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24613,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/3847200126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6836","nonce":3847200126},{"type":"v1","addr":"172.21.15.142:6837","nonce":3847200126}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24626,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/3619222976","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":3619222976},{"type":"v1","addr":"172.21.15.119:6837","nonce":3619222976}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T01:39:45.145124+0000","modified":"2024-09-21T01:40:27.664151+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24653},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24631":{"gid":24631,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.142:6839/1817880741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6838","nonce":1817880741},{"type":"v1","addr":"172.21.15.142:6839","nonce":1817880741}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24653":{"gid":24653,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.119:6839/3106757092","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":3106757092},{"type":"v1","addr":"172.21.15.119:6839","nonce":3106757092}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24653,"qdb_cluster":[24653]},"id":1}]} 2024-09-21T01:42:03.925 INFO:teuthology.orchestra.run.smithi083.stderr:dumped fsmap epoch 21 2024-09-21T01:42:03.927 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:03.926+0000 7f9fe8c0f640 1 -- 172.21.15.83:0/4216733667 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f9fcc0b6680 msgr2=0x7f9fcc0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:42:03.927 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:03.926+0000 7f9fe8c0f640 1 --2- 172.21.15.83:0/4216733667 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f9fcc0b6680 0x7f9fcc0b8b90 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f9fd8000f80 tx=0x7f9fd8031000 comp rx=0 tx=0).stop 2024-09-21T01:42:03.927 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:03.926+0000 7f9fe8c0f640 1 -- 172.21.15.83:0/4216733667 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9fe4108cf0 msgr2=0x7f9fe419fc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:42:03.927 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:03.926+0000 7f9fe8c0f640 1 --2- 172.21.15.83:0/4216733667 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9fe4108cf0 0x7f9fe419fc60 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f9fdc009fd0 tx=0x7f9fdc00b8e0 comp rx=0 tx=0).stop 2024-09-21T01:42:03.927 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:03.926+0000 7f9fe8c0f640 1 -- 172.21.15.83:0/4216733667 shutdown_connections 2024-09-21T01:42:03.927 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:03.926+0000 7f9fe8c0f640 1 --2- 172.21.15.83:0/4216733667 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f9fcc0b6680 0x7f9fcc0b8b90 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:42:03.927 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:03.926+0000 7f9fe8c0f640 1 --2- 172.21.15.83:0/4216733667 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9fe4108cf0 0x7f9fe419fc60 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:42:03.927 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:03.926+0000 7f9fe8c0f640 1 --2- 172.21.15.83:0/4216733667 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9fe41083a0 0x7f9fe419a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:42:03.928 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:03.926+0000 7f9fe8c0f640 1 --2- 172.21.15.83:0/4216733667 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9fe4102a60 0x7f9fe419a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:42:03.928 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:03.926+0000 7f9fe8c0f640 1 -- 172.21.15.83:0/4216733667 >> 172.21.15.83:0/4216733667 conn(0x7f9fe4079730 msgr2=0x7f9fe4101af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:42:03.928 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:03.927+0000 7f9fe8c0f640 1 -- 172.21.15.83:0/4216733667 shutdown_connections 2024-09-21T01:42:03.928 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:03.927+0000 7f9fe8c0f640 1 -- 172.21.15.83:0/4216733667 wait complete. 2024-09-21T01:42:04.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:42:03 smithi142 ceph-mon[34050]: pgmap v339: 129 pgs: 129 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 186 KiB/s wr, 50 op/s 2024-09-21T01:42:04.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:42:03 smithi119 ceph-mon[33693]: pgmap v339: 129 pgs: 129 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 186 KiB/s wr, 50 op/s 2024-09-21T01:42:04.246 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:42:03 smithi083 ceph-mon[31370]: pgmap v339: 129 pgs: 129 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 186 KiB/s wr, 50 op/s 2024-09-21T01:42:04.587 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T01:42:04.880 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:42:05.145 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:42:04 smithi083 ceph-mon[31370]: from='client.? 172.21.15.83:0/4216733667' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:42:05.145 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:42:04 smithi083 ceph-mon[31370]: pgmap v340: 129 pgs: 129 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 186 KiB/s wr, 51 op/s 2024-09-21T01:42:05.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:42:04 smithi142 ceph-mon[34050]: from='client.? 172.21.15.83:0/4216733667' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:42:05.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:42:04 smithi142 ceph-mon[34050]: pgmap v340: 129 pgs: 129 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 186 KiB/s wr, 51 op/s 2024-09-21T01:42:05.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:42:04 smithi119 ceph-mon[33693]: from='client.? 172.21.15.83:0/4216733667' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:42:05.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:42:04 smithi119 ceph-mon[33693]: pgmap v340: 129 pgs: 129 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 186 KiB/s wr, 51 op/s 2024-09-21T01:42:05.375 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:05.373+0000 7f25c7e4b640 1 -- 172.21.15.83:0/1818872148 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f25c01094a0 msgr2=0x7f25c01098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:42:05.375 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:05.373+0000 7f25c7e4b640 1 --2- 172.21.15.83:0/1818872148 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f25c01094a0 0x7f25c01098b0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f25b4009ca0 tx=0x7f25b402a8c0 comp rx=0 tx=0).stop 2024-09-21T01:42:05.375 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:05.373+0000 7f25c7e4b640 1 -- 172.21.15.83:0/1818872148 shutdown_connections 2024-09-21T01:42:05.375 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:05.373+0000 7f25c7e4b640 1 --2- 172.21.15.83:0/1818872148 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f25c0109df0 0x7f25c0110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:42:05.375 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:05.373+0000 7f25c7e4b640 1 --2- 172.21.15.83:0/1818872148 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f25c01094a0 0x7f25c01098b0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:42:05.375 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:05.373+0000 7f25c7e4b640 1 --2- 172.21.15.83:0/1818872148 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f25c0103b60 0x7f25c0103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:42:05.375 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:05.373+0000 7f25c7e4b640 1 -- 172.21.15.83:0/1818872148 >> 172.21.15.83:0/1818872148 conn(0x7f25c007b850 msgr2=0x7f25c007bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:42:05.375 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:05.373+0000 7f25c7e4b640 1 -- 172.21.15.83:0/1818872148 shutdown_connections 2024-09-21T01:42:05.375 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:05.373+0000 7f25c7e4b640 1 -- 172.21.15.83:0/1818872148 wait complete. 2024-09-21T01:42:05.377 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:05.374+0000 7f25c7e4b640 1 Processor -- start 2024-09-21T01:42:05.377 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:05.374+0000 7f25c7e4b640 1 -- start start 2024-09-21T01:42:05.377 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:05.374+0000 7f25c7e4b640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f25c0103b60 0x7f25c0075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:42:05.377 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:05.374+0000 7f25c7e4b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f25c01094a0 0x7f25c0075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:42:05.377 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:05.374+0000 7f25c7e4b640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f25c0109df0 0x7f25c0076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:42:05.377 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:05.374+0000 7f25c7e4b640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f25c01139b0 con 0x7f25c0109df0 2024-09-21T01:42:05.377 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:05.374+0000 7f25c7e4b640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f25c0113830 con 0x7f25c01094a0 2024-09-21T01:42:05.377 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:05.374+0000 7f25c7e4b640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f25c0113b30 con 0x7f25c0103b60 2024-09-21T01:42:05.377 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:05.374+0000 7f25c63e8640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f25c0109df0 0x7f25c0076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:42:05.377 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:05.374+0000 7f25c63e8640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f25c0109df0 0x7f25c0076190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:35012/0 (socket says 172.21.15.83:35012) 2024-09-21T01:42:05.377 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:05.374+0000 7f25c63e8640 1 -- 172.21.15.83:0/3811416914 learned_addr learned my addr 172.21.15.83:0/3811416914 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:42:05.378 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:05.375+0000 7f25c5be7640 1 --2- 172.21.15.83:0/3811416914 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f25c0103b60 0x7f25c0075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:42:05.378 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:05.375+0000 7f25c53e6640 1 --2- 172.21.15.83:0/3811416914 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f25c01094a0 0x7f25c0075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:42:05.378 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:05.375+0000 7f25c63e8640 1 -- 172.21.15.83:0/3811416914 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f25c0103b60 msgr2=0x7f25c0075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:42:05.378 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:05.375+0000 7f25c63e8640 1 --2- 172.21.15.83:0/3811416914 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f25c0103b60 0x7f25c0075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:42:05.378 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:05.375+0000 7f25c63e8640 1 -- 172.21.15.83:0/3811416914 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f25c01094a0 msgr2=0x7f25c0075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:42:05.378 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:05.375+0000 7f25c63e8640 1 --2- 172.21.15.83:0/3811416914 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f25c01094a0 0x7f25c0075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:42:05.378 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:05.375+0000 7f25c63e8640 1 -- 172.21.15.83:0/3811416914 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25c01a8760 con 0x7f25c0109df0 2024-09-21T01:42:05.378 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:05.375+0000 7f25c63e8640 1 --2- 172.21.15.83:0/3811416914 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f25c0109df0 0x7f25c0076190 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f25bc00c970 tx=0x7f25bc00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:42:05.378 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:05.375+0000 7f25b2ffd640 1 -- 172.21.15.83:0/3811416914 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25bc007bb0 con 0x7f25c0109df0 2024-09-21T01:42:05.378 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:05.375+0000 7f25b2ffd640 1 -- 172.21.15.83:0/3811416914 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f25bc007d50 con 0x7f25c0109df0 2024-09-21T01:42:05.378 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:05.375+0000 7f25c7e4b640 1 -- 172.21.15.83:0/3811416914 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25c01a8a50 con 0x7f25c0109df0 2024-09-21T01:42:05.378 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:05.375+0000 7f25b2ffd640 1 -- 172.21.15.83:0/3811416914 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25bc004d50 con 0x7f25c0109df0 2024-09-21T01:42:05.378 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:05.375+0000 7f25c7e4b640 1 -- 172.21.15.83:0/3811416914 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25c01a8f10 con 0x7f25c0109df0 2024-09-21T01:42:05.379 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:05.376+0000 7f25c7e4b640 1 -- 172.21.15.83:0/3811416914 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25c0103f70 con 0x7f25c0109df0 2024-09-21T01:42:05.379 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:05.378+0000 7f25b2ffd640 1 -- 172.21.15.83:0/3811416914 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7f25bc004f10 con 0x7f25c0109df0 2024-09-21T01:42:05.379 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:05.378+0000 7f25b2ffd640 1 --2- 172.21.15.83:0/3811416914 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f25ac0b6680 0x7f25ac0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:42:05.380 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:05.379+0000 7f25c5be7640 1 --2- 172.21.15.83:0/3811416914 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f25ac0b6680 0x7f25ac0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:42:05.380 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:05.379+0000 7f25b2ffd640 1 -- 172.21.15.83:0/3811416914 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9315+0+0 (secure 0 0 0) 0x7f25bc0e7a50 con 0x7f25c0109df0 2024-09-21T01:42:05.380 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:05.379+0000 7f25c5be7640 1 --2- 172.21.15.83:0/3811416914 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f25ac0b6680 0x7f25ac0b8b90 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f25c0077160 tx=0x7f25b800b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:42:05.383 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:05.382+0000 7f25b2ffd640 1 -- 172.21.15.83:0/3811416914 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f25bc014030 con 0x7f25c0109df0 2024-09-21T01:42:05.563 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:05.562+0000 7f25c7e4b640 1 -- 172.21.15.83:0/3811416914 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f25c0076a10 con 0x7f25c0109df0 2024-09-21T01:42:05.564 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:05.563+0000 7f25b2ffd640 1 -- 172.21.15.83:0/3811416914 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) ==== 74+0+25096 (secure 0 0 0) 0x7f25c0076a10 con 0x7f25c0109df0 2024-09-21T01:42:05.565 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T01:42:05.565 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":84,"fsid":"f7697ecc-77b8-11ef-baf5-efdc52797490","created":"2024-09-21T01:31:22.250342+0000","modified":"2024-09-21T01:41:09.873952+0000","last_up_change":"2024-09-21T01:38:53.501659+0000","last_in_change":"2024-09-21T01:38:30.688516+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T01:35:06.977668+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T01:39:41.041950+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T01:39:42.882272+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T01:39:49.320532+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"66947512-01ee-4bf0-87b0-98a168cf50dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":3563457494},{"type":"v1","addr":"172.21.15.83:6803","nonce":3563457494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":3563457494},{"type":"v1","addr":"172.21.15.83:6805","nonce":3563457494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":3563457494},{"type":"v1","addr":"172.21.15.83:6809","nonce":3563457494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":3563457494},{"type":"v1","addr":"172.21.15.83:6807","nonce":3563457494}]},"public_addr":"172.21.15.83:6803/3563457494","cluster_addr":"172.21.15.83:6805/3563457494","heartbeat_back_addr":"172.21.15.83:6809/3563457494","heartbeat_front_addr":"172.21.15.83:6807/3563457494","state":["exists","up"]},{"osd":1,"uuid":"f7818a08-86a5-412d-a164-cfeb18f8650a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":2066870220},{"type":"v1","addr":"172.21.15.119:6801","nonce":2066870220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":2066870220},{"type":"v1","addr":"172.21.15.119:6803","nonce":2066870220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":2066870220},{"type":"v1","addr":"172.21.15.119:6807","nonce":2066870220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":2066870220},{"type":"v1","addr":"172.21.15.119:6805","nonce":2066870220}]},"public_addr":"172.21.15.119:6801/2066870220","cluster_addr":"172.21.15.119:6803/2066870220","heartbeat_back_addr":"172.21.15.119:6807/2066870220","heartbeat_front_addr":"172.21.15.119:6805/2066870220","state":["exists","up"]},{"osd":2,"uuid":"0d1a3870-c67a-4783-85f9-be2bb36f7722","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":3955936117},{"type":"v1","addr":"172.21.15.142:6801","nonce":3955936117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3955936117},{"type":"v1","addr":"172.21.15.142:6803","nonce":3955936117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":3955936117},{"type":"v1","addr":"172.21.15.142:6807","nonce":3955936117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":3955936117},{"type":"v1","addr":"172.21.15.142:6805","nonce":3955936117}]},"public_addr":"172.21.15.142:6801/3955936117","cluster_addr":"172.21.15.142:6803/3955936117","heartbeat_back_addr":"172.21.15.142:6807/3955936117","heartbeat_front_addr":"172.21.15.142:6805/3955936117","state":["exists","up"]},{"osd":3,"uuid":"a4cb1a36-3495-4d36-92da-ed3b6e852d14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":3746834093},{"type":"v1","addr":"172.21.15.83:6811","nonce":3746834093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":3746834093},{"type":"v1","addr":"172.21.15.83:6813","nonce":3746834093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":3746834093},{"type":"v1","addr":"172.21.15.83:6817","nonce":3746834093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":3746834093},{"type":"v1","addr":"172.21.15.83:6815","nonce":3746834093}]},"public_addr":"172.21.15.83:6811/3746834093","cluster_addr":"172.21.15.83:6813/3746834093","heartbeat_back_addr":"172.21.15.83:6817/3746834093","heartbeat_front_addr":"172.21.15.83:6815/3746834093","state":["exists","up"]},{"osd":4,"uuid":"d6f2ec78-7f08-473b-a96c-e8590f5d2f25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":3083907785},{"type":"v1","addr":"172.21.15.119:6809","nonce":3083907785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":3083907785},{"type":"v1","addr":"172.21.15.119:6811","nonce":3083907785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":3083907785},{"type":"v1","addr":"172.21.15.119:6815","nonce":3083907785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":3083907785},{"type":"v1","addr":"172.21.15.119:6813","nonce":3083907785}]},"public_addr":"172.21.15.119:6809/3083907785","cluster_addr":"172.21.15.119:6811/3083907785","heartbeat_back_addr":"172.21.15.119:6815/3083907785","heartbeat_front_addr":"172.21.15.119:6813/3083907785","state":["exists","up"]},{"osd":5,"uuid":"c571d04d-d3ea-4d74-8867-e4c7816f4e0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":349001002},{"type":"v1","addr":"172.21.15.142:6809","nonce":349001002}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":349001002},{"type":"v1","addr":"172.21.15.142:6811","nonce":349001002}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":349001002},{"type":"v1","addr":"172.21.15.142:6815","nonce":349001002}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":349001002},{"type":"v1","addr":"172.21.15.142:6813","nonce":349001002}]},"public_addr":"172.21.15.142:6809/349001002","cluster_addr":"172.21.15.142:6811/349001002","heartbeat_back_addr":"172.21.15.142:6815/349001002","heartbeat_front_addr":"172.21.15.142:6813/349001002","state":["exists","up"]},{"osd":6,"uuid":"6e1b6fe9-700a-448a-b382-59b97896ea7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":771651063},{"type":"v1","addr":"172.21.15.83:6819","nonce":771651063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":771651063},{"type":"v1","addr":"172.21.15.83:6821","nonce":771651063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":771651063},{"type":"v1","addr":"172.21.15.83:6825","nonce":771651063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":771651063},{"type":"v1","addr":"172.21.15.83:6823","nonce":771651063}]},"public_addr":"172.21.15.83:6819/771651063","cluster_addr":"172.21.15.83:6821/771651063","heartbeat_back_addr":"172.21.15.83:6825/771651063","heartbeat_front_addr":"172.21.15.83:6823/771651063","state":["exists","up"]},{"osd":7,"uuid":"283bfae4-5f50-4f9e-860e-bbfd47e005e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":1556984819},{"type":"v1","addr":"172.21.15.119:6817","nonce":1556984819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":1556984819},{"type":"v1","addr":"172.21.15.119:6819","nonce":1556984819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":1556984819},{"type":"v1","addr":"172.21.15.119:6823","nonce":1556984819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":1556984819},{"type":"v1","addr":"172.21.15.119:6821","nonce":1556984819}]},"public_addr":"172.21.15.119:6817/1556984819","cluster_addr":"172.21.15.119:6819/1556984819","heartbeat_back_addr":"172.21.15.119:6823/1556984819","heartbeat_front_addr":"172.21.15.119:6821/1556984819","state":["exists","up"]},{"osd":8,"uuid":"d46e56d4-ed4e-42c3-a315-66af014bd93a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":1860679473},{"type":"v1","addr":"172.21.15.142:6817","nonce":1860679473}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":1860679473},{"type":"v1","addr":"172.21.15.142:6819","nonce":1860679473}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":1860679473},{"type":"v1","addr":"172.21.15.142:6823","nonce":1860679473}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":1860679473},{"type":"v1","addr":"172.21.15.142:6821","nonce":1860679473}]},"public_addr":"172.21.15.142:6817/1860679473","cluster_addr":"172.21.15.142:6819/1860679473","heartbeat_back_addr":"172.21.15.142:6823/1860679473","heartbeat_front_addr":"172.21.15.142:6821/1860679473","state":["exists","up"]},{"osd":9,"uuid":"18a70ee6-56df-4f5c-868d-5db5e72a1859","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":3636757924},{"type":"v1","addr":"172.21.15.83:6827","nonce":3636757924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":3636757924},{"type":"v1","addr":"172.21.15.83:6829","nonce":3636757924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6832","nonce":3636757924},{"type":"v1","addr":"172.21.15.83:6833","nonce":3636757924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":3636757924},{"type":"v1","addr":"172.21.15.83:6831","nonce":3636757924}]},"public_addr":"172.21.15.83:6827/3636757924","cluster_addr":"172.21.15.83:6829/3636757924","heartbeat_back_addr":"172.21.15.83:6833/3636757924","heartbeat_front_addr":"172.21.15.83:6831/3636757924","state":["exists","up"]},{"osd":10,"uuid":"0d32c3de-db03-42c3-9914-07d675aaa339","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":2561963910},{"type":"v1","addr":"172.21.15.119:6825","nonce":2561963910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":2561963910},{"type":"v1","addr":"172.21.15.119:6827","nonce":2561963910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2561963910},{"type":"v1","addr":"172.21.15.119:6831","nonce":2561963910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2561963910},{"type":"v1","addr":"172.21.15.119:6829","nonce":2561963910}]},"public_addr":"172.21.15.119:6825/2561963910","cluster_addr":"172.21.15.119:6827/2561963910","heartbeat_back_addr":"172.21.15.119:6831/2561963910","heartbeat_front_addr":"172.21.15.119:6829/2561963910","state":["exists","up"]},{"osd":11,"uuid":"3a3b444d-b316-4256-bfad-378db29f0824","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":1174646198},{"type":"v1","addr":"172.21.15.142:6825","nonce":1174646198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":1174646198},{"type":"v1","addr":"172.21.15.142:6827","nonce":1174646198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1174646198},{"type":"v1","addr":"172.21.15.142:6831","nonce":1174646198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1174646198},{"type":"v1","addr":"172.21.15.142:6829","nonce":1174646198}]},"public_addr":"172.21.15.142:6825/1174646198","cluster_addr":"172.21.15.142:6827/1174646198","heartbeat_back_addr":"172.21.15.142:6831/1174646198","heartbeat_front_addr":"172.21.15.142:6829/1174646198","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:34:15.337672+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:34:39.259716+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:35:03.348886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:35:29.465711+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:35:53.744378+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:36:19.488785+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:36:45.708616+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:37:11.501065+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:37:36.027277+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:38:01.903625+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:38:27.215212+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:38:51.891278+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.e","mappings":[{"from":4,"to":8},{"from":5,"to":9}]},{"pgid":"3.11","mappings":[{"from":4,"to":6}]},{"pgid":"4.3","mappings":[{"from":5,"to":8}]},{"pgid":"4.10","mappings":[{"from":9,"to":8}]},{"pgid":"4.12","mappings":[{"from":9,"to":10}]},{"pgid":"4.1c","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.83:0/1619062496":"2024-09-22T01:33:08.666525+0000","172.21.15.83:0/2412709299":"2024-09-22T01:31:45.834450+0000","172.21.15.83:6800/4290325964":"2024-09-22T01:31:45.834450+0000","172.21.15.83:6801/4290325964":"2024-09-22T01:31:45.834450+0000","172.21.15.83:0/1440681183":"2024-09-22T01:31:45.834450+0000","172.21.15.83:0/2745413305":"2024-09-22T01:31:45.834450+0000","172.21.15.83:6800/1393748565":"2024-09-22T01:33:08.666525+0000","172.21.15.83:0/110411274":"2024-09-22T01:32:10.073024+0000","172.21.15.83:0/4267551123":"2024-09-22T01:33:08.666525+0000","172.21.15.83:0/1068434643":"2024-09-22T01:32:10.073024+0000","172.21.15.83:6800/2963261730":"2024-09-22T01:32:10.073024+0000","172.21.15.83:0/3544333975":"2024-09-22T01:32:10.073024+0000","172.21.15.83:6801/1393748565":"2024-09-22T01:33:08.666525+0000","172.21.15.83:6801/2963261730":"2024-09-22T01:32:10.073024+0000","172.21.15.83:0/1915285091":"2024-09-22T01:33:08.666525+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T01:42:05.567 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:05.565+0000 7f25c7e4b640 1 -- 172.21.15.83:0/3811416914 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f25ac0b6680 msgr2=0x7f25ac0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:42:05.567 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:05.565+0000 7f25c7e4b640 1 --2- 172.21.15.83:0/3811416914 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f25ac0b6680 0x7f25ac0b8b90 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f25c0077160 tx=0x7f25b800b390 comp rx=0 tx=0).stop 2024-09-21T01:42:05.567 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:05.565+0000 7f25c7e4b640 1 -- 172.21.15.83:0/3811416914 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f25c0109df0 msgr2=0x7f25c0076190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:42:05.567 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:05.565+0000 7f25c7e4b640 1 --2- 172.21.15.83:0/3811416914 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f25c0109df0 0x7f25c0076190 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f25bc00c970 tx=0x7f25bc00ce30 comp rx=0 tx=0).stop 2024-09-21T01:42:05.567 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:05.565+0000 7f25c7e4b640 1 -- 172.21.15.83:0/3811416914 shutdown_connections 2024-09-21T01:42:05.567 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:05.565+0000 7f25c7e4b640 1 --2- 172.21.15.83:0/3811416914 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f25ac0b6680 0x7f25ac0b8b90 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:42:05.567 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:05.565+0000 7f25c7e4b640 1 --2- 172.21.15.83:0/3811416914 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f25c0109df0 0x7f25c0076190 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:42:05.567 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:05.565+0000 7f25c7e4b640 1 --2- 172.21.15.83:0/3811416914 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f25c01094a0 0x7f25c0075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:42:05.567 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:05.565+0000 7f25c7e4b640 1 --2- 172.21.15.83:0/3811416914 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f25c0103b60 0x7f25c0075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:42:05.567 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:05.566+0000 7f25c7e4b640 1 -- 172.21.15.83:0/3811416914 >> 172.21.15.83:0/3811416914 conn(0x7f25c007b850 msgr2=0x7f25c0105620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:42:05.568 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:05.566+0000 7f25c7e4b640 1 -- 172.21.15.83:0/3811416914 shutdown_connections 2024-09-21T01:42:05.568 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:05.566+0000 7f25c7e4b640 1 -- 172.21.15.83:0/3811416914 wait complete. 2024-09-21T01:42:06.165 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:42:05 smithi083 ceph-mon[31370]: from='client.? 172.21.15.83:0/3811416914' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T01:42:06.193 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph daemon mon.a --format=json config get run_dir 2024-09-21T01:42:06.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:42:05 smithi142 ceph-mon[34050]: from='client.? 172.21.15.83:0/3811416914' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T01:42:06.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:42:05 smithi119 ceph-mon[33693]: from='client.? 172.21.15.83:0/3811416914' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T01:42:06.439 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:42:07.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:42:06 smithi142 ceph-mon[34050]: pgmap v341: 129 pgs: 129 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 197 KiB/s wr, 63 op/s 2024-09-21T01:42:07.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:42:06 smithi119 ceph-mon[33693]: pgmap v341: 129 pgs: 129 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 197 KiB/s wr, 63 op/s 2024-09-21T01:42:07.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:42:06 smithi083 ceph-mon[31370]: pgmap v341: 129 pgs: 129 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 197 KiB/s wr, 63 op/s 2024-09-21T01:42:07.603 INFO:teuthology.orchestra.run.smithi083.stdout:{"run_dir":"/var/run/ceph"} 2024-09-21T01:42:07.603 DEBUG:tasks.cephfs.filesystem:_json_asok output { "run_dir": "/var/run/ceph" } 2024-09-21T01:42:07.603 INFO:tasks.quiescer.fs.[cephfs]:Initializing Quiescer with seed 7864 2024-09-21T01:42:07.604 DEBUG:tasks.quiescer:Yielding 2024-09-21T01:42:07.604 INFO:teuthology.run_tasks:Running task workunit... 2024-09-21T01:42:07.616 INFO:tasks.workunit:Pulling workunits from ref 1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T01:42:07.616 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-21T01:42:07.616 INFO:tasks.workunit:timeout=3h 2024-09-21T01:42:07.616 INFO:tasks.workunit:cleanup=True 2024-09-21T01:42:07.616 DEBUG:teuthology.orchestra.run.smithi083:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-21T01:42:07.617 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T01:42:07.632 INFO:teuthology.orchestra.run.smithi083.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-09-21T01:42:07.632 INFO:teuthology.orchestra.run.smithi083.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-09-21T01:42:07.633 INFO:teuthology.orchestra.run.smithi083.stdout:Device: 78h/120d Inode: 1 Links: 2 2024-09-21T01:42:07.633 INFO:teuthology.orchestra.run.smithi083.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T01:42:07.633 INFO:teuthology.orchestra.run.smithi083.stdout:Context: system_u:object_r:fusefs_t:s0 2024-09-21T01:42:07.633 INFO:teuthology.orchestra.run.smithi083.stdout:Access: 2024-09-21 01:40:31.403926029 +0000 2024-09-21T01:42:07.633 INFO:teuthology.orchestra.run.smithi083.stdout:Modify: 2024-09-21 01:40:31.403926029 +0000 2024-09-21T01:42:07.633 INFO:teuthology.orchestra.run.smithi083.stdout:Change: 2024-09-21 01:41:54.833503658 +0000 2024-09-21T01:42:07.633 INFO:teuthology.orchestra.run.smithi083.stdout: Birth: - 2024-09-21T01:42:07.633 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-09-21T01:42:07.633 DEBUG:teuthology.orchestra.run.smithi083:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-09-21T01:42:07.704 DEBUG:teuthology.orchestra.run.smithi083:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T01:42:07.760 INFO:tasks.workunit.client.0.smithi083.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-21T01:42:07.871 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:42:08.396 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:08.378+0000 7f0cd65b7640 1 -- 172.21.15.83:0/1500793152 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0cd0109e00 msgr2=0x7f0cd0110630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:42:08.396 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:08.378+0000 7f0cd65b7640 1 --2- 172.21.15.83:0/1500793152 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0cd0109e00 0x7f0cd0110630 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f0cc8009ca0 tx=0x7f0cc802a8c0 comp rx=0 tx=0).stop 2024-09-21T01:42:08.396 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:08.378+0000 7f0cd65b7640 1 -- 172.21.15.83:0/1500793152 shutdown_connections 2024-09-21T01:42:08.396 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:08.378+0000 7f0cd65b7640 1 --2- 172.21.15.83:0/1500793152 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0cd0109e00 0x7f0cd0110630 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:42:08.396 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:08.378+0000 7f0cd65b7640 1 --2- 172.21.15.83:0/1500793152 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0cd01094b0 0x7f0cd01098c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:42:08.396 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:08.378+0000 7f0cd65b7640 1 --2- 172.21.15.83:0/1500793152 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0cd0103bc0 0x7f0cd0103fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:42:08.397 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:08.378+0000 7f0cd65b7640 1 -- 172.21.15.83:0/1500793152 >> 172.21.15.83:0/1500793152 conn(0x7f0cd007b910 msgr2=0x7f0cd007bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:42:08.397 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:08.378+0000 7f0cd65b7640 1 -- 172.21.15.83:0/1500793152 shutdown_connections 2024-09-21T01:42:08.397 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:08.378+0000 7f0cd65b7640 1 -- 172.21.15.83:0/1500793152 wait complete. 2024-09-21T01:42:08.397 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:08.378+0000 7f0cd65b7640 1 Processor -- start 2024-09-21T01:42:08.397 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:08.378+0000 7f0cd65b7640 1 -- start start 2024-09-21T01:42:08.397 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:08.379+0000 7f0cd65b7640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0cd0103bc0 0x7f0cd019a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:42:08.397 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:08.379+0000 7f0cd65b7640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0cd01094b0 0x7f0cd019a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:42:08.397 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:08.379+0000 7f0cd65b7640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0cd0109e00 0x7f0cd019fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:42:08.397 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:08.379+0000 7f0cd65b7640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f0cd01139c0 con 0x7f0cd0103bc0 2024-09-21T01:42:08.397 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:08.379+0000 7f0cd65b7640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f0cd0113840 con 0x7f0cd01094b0 2024-09-21T01:42:08.397 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:08.379+0000 7f0cd65b7640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f0cd0113b40 con 0x7f0cd0109e00 2024-09-21T01:42:08.397 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:08.379+0000 7f0ccffff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0cd0103bc0 0x7f0cd019a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:42:08.397 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:08.379+0000 7f0ccffff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0cd0103bc0 0x7f0cd019a3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:35026/0 (socket says 172.21.15.83:35026) 2024-09-21T01:42:08.398 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:08.379+0000 7f0ccffff640 1 -- 172.21.15.83:0/1832664552 learned_addr learned my addr 172.21.15.83:0/1832664552 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:42:08.398 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:08.379+0000 7f0ccf7fe640 1 --2- 172.21.15.83:0/1832664552 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0cd01094b0 0x7f0cd019a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:42:08.398 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:08.379+0000 7f0cd4b54640 1 --2- 172.21.15.83:0/1832664552 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0cd0109e00 0x7f0cd019fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:42:08.398 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:08.379+0000 7f0ccffff640 1 -- 172.21.15.83:0/1832664552 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0cd0109e00 msgr2=0x7f0cd019fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:42:08.398 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:08.379+0000 7f0ccffff640 1 --2- 172.21.15.83:0/1832664552 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0cd0109e00 0x7f0cd019fc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:42:08.398 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:08.379+0000 7f0ccffff640 1 -- 172.21.15.83:0/1832664552 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0cd01094b0 msgr2=0x7f0cd019a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:42:08.398 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:08.379+0000 7f0ccffff640 1 --2- 172.21.15.83:0/1832664552 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0cd01094b0 0x7f0cd019a970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:42:08.398 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:08.379+0000 7f0ccffff640 1 -- 172.21.15.83:0/1832664552 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cd01a0340 con 0x7f0cd0103bc0 2024-09-21T01:42:08.398 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:08.380+0000 7f0ccffff640 1 --2- 172.21.15.83:0/1832664552 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0cd0103bc0 0x7f0cd019a3d0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f0cc000c890 tx=0x7f0cc000cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:42:08.398 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:08.380+0000 7f0ccd7fa640 1 -- 172.21.15.83:0/1832664552 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cc0004220 con 0x7f0cd0103bc0 2024-09-21T01:42:08.398 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:08.380+0000 7f0cd65b7640 1 -- 172.21.15.83:0/1832664552 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0cd01a0630 con 0x7f0cd0103bc0 2024-09-21T01:42:08.398 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:08.380+0000 7f0ccd7fa640 1 -- 172.21.15.83:0/1832664552 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0cc0007e40 con 0x7f0cd0103bc0 2024-09-21T01:42:08.398 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:08.380+0000 7f0ccd7fa640 1 -- 172.21.15.83:0/1832664552 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cc0004a00 con 0x7f0cd0103bc0 2024-09-21T01:42:08.398 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:08.380+0000 7f0cd65b7640 1 -- 172.21.15.83:0/1832664552 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0cd01a6d90 con 0x7f0cd0103bc0 2024-09-21T01:42:08.399 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:08.381+0000 7f0cd65b7640 1 -- 172.21.15.83:0/1832664552 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0cd0103fd0 con 0x7f0cd0103bc0 2024-09-21T01:42:08.399 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:08.382+0000 7f0ccd7fa640 1 -- 172.21.15.83:0/1832664552 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7f0cc00079b0 con 0x7f0cd0103bc0 2024-09-21T01:42:08.399 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:08.383+0000 7f0ccd7fa640 1 --2- 172.21.15.83:0/1832664552 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f0cb80b6680 0x7f0cb80b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:42:08.399 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:08.383+0000 7f0ccf7fe640 1 --2- 172.21.15.83:0/1832664552 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f0cb80b6680 0x7f0cb80b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:42:08.399 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:08.383+0000 7f0ccd7fa640 1 -- 172.21.15.83:0/1832664552 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9315+0+0 (secure 0 0 0) 0x7f0cc00e7b60 con 0x7f0cd0103bc0 2024-09-21T01:42:08.399 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:08.384+0000 7f0ccf7fe640 1 --2- 172.21.15.83:0/1832664552 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f0cb80b6680 0x7f0cb80b8b90 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f0cd007beb0 tx=0x7f0cc400b410 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:42:08.399 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:08.386+0000 7f0ccd7fa640 1 -- 172.21.15.83:0/1832664552 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f0cc0014030 con 0x7f0cd0103bc0 2024-09-21T01:42:08.602 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:08.601+0000 7f0cd65b7640 1 -- 172.21.15.83:0/1832664552 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0cd019b500 con 0x7f0cd0103bc0 2024-09-21T01:42:08.603 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:08.602+0000 7f0ccd7fa640 1 -- 172.21.15.83:0/1832664552 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11857 (secure 0 0 0) 0x7f0cc00add90 con 0x7f0cd0103bc0 2024-09-21T01:42:08.603 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T01:42:08.603 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":21,"btime":"2024-09-21T01:40:27:947059+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14775,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6835/1105040204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":1105040204},{"type":"v1","addr":"172.21.15.83:6835","nonce":1105040204}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14787,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/2234789563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6836","nonce":2234789563},{"type":"v1","addr":"172.21.15.83:6837","nonce":2234789563}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14838,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6839/136258364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6838","nonce":136258364},{"type":"v1","addr":"172.21.15.83:6839","nonce":136258364}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14850,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6841/129439444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6840","nonce":129439444},{"type":"v1","addr":"172.21.15.83:6841","nonce":129439444}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24569,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/2839502433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":2839502433},{"type":"v1","addr":"172.21.15.119:6833","nonce":2839502433}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24580,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6833/2841606990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":2841606990},{"type":"v1","addr":"172.21.15.142:6833","nonce":2841606990}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24599,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/415902608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":415902608},{"type":"v1","addr":"172.21.15.119:6835","nonce":415902608}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24607,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/3009088510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":3009088510},{"type":"v1","addr":"172.21.15.142:6835","nonce":3009088510}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24613,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/3847200126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6836","nonce":3847200126},{"type":"v1","addr":"172.21.15.142:6837","nonce":3847200126}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24626,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/3619222976","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":3619222976},{"type":"v1","addr":"172.21.15.119:6837","nonce":3619222976}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T01:39:45.145124+0000","modified":"2024-09-21T01:40:27.664151+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24653},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24631":{"gid":24631,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.142:6839/1817880741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6838","nonce":1817880741},{"type":"v1","addr":"172.21.15.142:6839","nonce":1817880741}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24653":{"gid":24653,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.119:6839/3106757092","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":3106757092},{"type":"v1","addr":"172.21.15.119:6839","nonce":3106757092}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24653,"qdb_cluster":[24653]},"id":1}]} 2024-09-21T01:42:08.603 INFO:teuthology.orchestra.run.smithi083.stderr:dumped fsmap epoch 21 2024-09-21T01:42:08.605 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:08.604+0000 7f0cd65b7640 1 -- 172.21.15.83:0/1832664552 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f0cb80b6680 msgr2=0x7f0cb80b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:42:08.605 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:08.604+0000 7f0cd65b7640 1 --2- 172.21.15.83:0/1832664552 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f0cb80b6680 0x7f0cb80b8b90 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f0cd007beb0 tx=0x7f0cc400b410 comp rx=0 tx=0).stop 2024-09-21T01:42:08.605 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:08.604+0000 7f0cd65b7640 1 -- 172.21.15.83:0/1832664552 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0cd0103bc0 msgr2=0x7f0cd019a3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:42:08.606 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:08.604+0000 7f0cd65b7640 1 --2- 172.21.15.83:0/1832664552 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0cd0103bc0 0x7f0cd019a3d0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f0cc000c890 tx=0x7f0cc000cd50 comp rx=0 tx=0).stop 2024-09-21T01:42:08.606 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:08.604+0000 7f0cd65b7640 1 -- 172.21.15.83:0/1832664552 shutdown_connections 2024-09-21T01:42:08.606 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:08.604+0000 7f0cd65b7640 1 --2- 172.21.15.83:0/1832664552 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f0cb80b6680 0x7f0cb80b8b90 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:42:08.606 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:08.604+0000 7f0cd65b7640 1 --2- 172.21.15.83:0/1832664552 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0cd0109e00 0x7f0cd019fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:42:08.606 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:08.604+0000 7f0cd65b7640 1 --2- 172.21.15.83:0/1832664552 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0cd01094b0 0x7f0cd019a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:42:08.606 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:08.604+0000 7f0cd65b7640 1 --2- 172.21.15.83:0/1832664552 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0cd0103bc0 0x7f0cd019a3d0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:42:08.606 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:08.604+0000 7f0cd65b7640 1 -- 172.21.15.83:0/1832664552 >> 172.21.15.83:0/1832664552 conn(0x7f0cd007b910 msgr2=0x7f0cd01054c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:42:08.606 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:08.604+0000 7f0cd65b7640 1 -- 172.21.15.83:0/1832664552 shutdown_connections 2024-09-21T01:42:08.606 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:08.604+0000 7f0cd65b7640 1 -- 172.21.15.83:0/1832664552 wait complete. 2024-09-21T01:42:08.926 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:42:08 smithi083 ceph-mon[31370]: from='client.? 172.21.15.83:0/1832664552' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:42:08.964 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:42:08 smithi142 ceph-mon[34050]: from='client.? 172.21.15.83:0/1832664552' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:42:08.967 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:42:08 smithi119 ceph-mon[33693]: from='client.? 172.21.15.83:0/1832664552' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:42:09.229 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 21, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-21T01:39:45.145124+0000', 'modified': '2024-09-21T01:40:27.664151+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 24653}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24631': {'gid': 24631, 'name': 'i', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.142:6839/1817880741', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.142:6838', 'nonce': 1817880741}, {'type': 'v1', 'addr': '172.21.15.142:6839', 'nonce': 1817880741}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24653': {'gid': 24653, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.119:6839/3106757092', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.119:6838', 'nonce': 3106757092}, {'type': 'v1', 'addr': '172.21.15.119:6839', 'nonce': 3106757092}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24653, 'qdb_cluster': [24653]} 2024-09-21T01:42:09.229 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-21T01:42:09.229 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph tell mds.b status 2024-09-21T01:42:09.515 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:42:09.923 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:42:09 smithi083 ceph-mon[31370]: pgmap v342: 129 pgs: 129 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 124 KiB/s wr, 55 op/s 2024-09-21T01:42:09.964 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:42:09 smithi142 ceph-mon[34050]: pgmap v342: 129 pgs: 129 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 124 KiB/s wr, 55 op/s 2024-09-21T01:42:09.967 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:42:09 smithi119 ceph-mon[33693]: pgmap v342: 129 pgs: 129 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 124 KiB/s wr, 55 op/s 2024-09-21T01:42:10.031 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.012+0000 7f70382b5640 1 -- 172.21.15.83:0/2407063364 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7030102a80 msgr2=0x7f7030102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:42:10.031 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.012+0000 7f70382b5640 1 --2- 172.21.15.83:0/2407063364 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7030102a80 0x7f7030102e90 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f7020009ca0 tx=0x7f702002a8c0 comp rx=0 tx=0).stop 2024-09-21T01:42:10.031 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.012+0000 7f70382b5640 1 -- 172.21.15.83:0/2407063364 shutdown_connections 2024-09-21T01:42:10.031 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.012+0000 7f70382b5640 1 --2- 172.21.15.83:0/2407063364 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7030108d10 0x7f703010f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:42:10.031 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.012+0000 7f70382b5640 1 --2- 172.21.15.83:0/2407063364 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f70301083c0 0x7f70301087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:42:10.032 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.012+0000 7f70382b5640 1 --2- 172.21.15.83:0/2407063364 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7030102a80 0x7f7030102e90 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:42:10.032 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.012+0000 7f70382b5640 1 -- 172.21.15.83:0/2407063364 >> 172.21.15.83:0/2407063364 conn(0x7f7030079740 msgr2=0x7f7030079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:42:10.032 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.012+0000 7f70382b5640 1 -- 172.21.15.83:0/2407063364 shutdown_connections 2024-09-21T01:42:10.032 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.012+0000 7f70382b5640 1 -- 172.21.15.83:0/2407063364 wait complete. 2024-09-21T01:42:10.032 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.013+0000 7f70382b5640 1 Processor -- start 2024-09-21T01:42:10.032 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.013+0000 7f70382b5640 1 -- start start 2024-09-21T01:42:10.032 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.014+0000 7f70382b5640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7030102a80 0x7f70301992b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:42:10.032 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.014+0000 7f70382b5640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f70301083c0 0x7f7030199850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:42:10.032 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.014+0000 7f70382b5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7030108d10 0x7f703019eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:42:10.032 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.014+0000 7f70382b5640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f7030112880 con 0x7f70301083c0 2024-09-21T01:42:10.032 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.014+0000 7f70382b5640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f7030112700 con 0x7f7030102a80 2024-09-21T01:42:10.032 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.014+0000 7f70382b5640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f7030112a00 con 0x7f7030108d10 2024-09-21T01:42:10.032 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.014+0000 7f7035850640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f70301083c0 0x7f7030199850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:42:10.032 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.014+0000 7f7035850640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f70301083c0 0x7f7030199850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:35056/0 (socket says 172.21.15.83:35056) 2024-09-21T01:42:10.032 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.014+0000 7f7035850640 1 -- 172.21.15.83:0/783833064 learned_addr learned my addr 172.21.15.83:0/783833064 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:42:10.033 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.014+0000 7f7036852640 1 --2- 172.21.15.83:0/783833064 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7030108d10 0x7f703019eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:42:10.033 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.014+0000 7f7036051640 1 --2- 172.21.15.83:0/783833064 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7030102a80 0x7f70301992b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:42:10.033 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.014+0000 7f7035850640 1 -- 172.21.15.83:0/783833064 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7030108d10 msgr2=0x7f703019eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:42:10.033 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.014+0000 7f7035850640 1 --2- 172.21.15.83:0/783833064 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7030108d10 0x7f703019eaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:42:10.033 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.014+0000 7f7035850640 1 -- 172.21.15.83:0/783833064 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7030102a80 msgr2=0x7f70301992b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:42:10.033 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.014+0000 7f7035850640 1 --2- 172.21.15.83:0/783833064 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7030102a80 0x7f70301992b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:42:10.033 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.014+0000 7f7035850640 1 -- 172.21.15.83:0/783833064 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f703019f220 con 0x7f70301083c0 2024-09-21T01:42:10.033 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.014+0000 7f7036852640 1 --2- 172.21.15.83:0/783833064 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7030108d10 0x7f703019eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:42:10.033 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.014+0000 7f7036051640 1 --2- 172.21.15.83:0/783833064 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7030102a80 0x7f70301992b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:42:10.033 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.014+0000 7f7035850640 1 --2- 172.21.15.83:0/783833064 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f70301083c0 0x7f7030199850 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f702400c970 tx=0x7f702400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:42:10.033 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.014+0000 7f702f7fe640 1 -- 172.21.15.83:0/783833064 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7024007bb0 con 0x7f70301083c0 2024-09-21T01:42:10.033 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.014+0000 7f70382b5640 1 -- 172.21.15.83:0/783833064 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f703019f510 con 0x7f70301083c0 2024-09-21T01:42:10.033 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.014+0000 7f702f7fe640 1 -- 172.21.15.83:0/783833064 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7024007d50 con 0x7f70301083c0 2024-09-21T01:42:10.033 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.014+0000 7f702f7fe640 1 -- 172.21.15.83:0/783833064 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7024018660 con 0x7f70301083c0 2024-09-21T01:42:10.033 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.015+0000 7f70382b5640 1 -- 172.21.15.83:0/783833064 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70301a5c70 con 0x7f70301083c0 2024-09-21T01:42:10.033 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.017+0000 7f703e829740 1 Processor -- start 2024-09-21T01:42:10.034 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.017+0000 7f703e829740 1 -- start start 2024-09-21T01:42:10.034 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.017+0000 7f702f7fe640 1 -- 172.21.15.83:0/783833064 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7f702400f970 con 0x7f70301083c0 2024-09-21T01:42:10.034 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.017+0000 7f703e829740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557a8c5fff60 0x557a8c9a5f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:42:10.034 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.017+0000 7f703e829740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557a8c5d70a0 0x557a8c9a6440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:42:10.034 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.017+0000 7f703e829740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557a8c5df280 0x557a8c9a6980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:42:10.034 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.017+0000 7f703e829740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x557a8c91dc10 con 0x557a8c5fff60 2024-09-21T01:42:10.034 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.017+0000 7f703e829740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x557a8c90d040 con 0x557a8c5df280 2024-09-21T01:42:10.034 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.017+0000 7f703e829740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x557a8c910e50 con 0x557a8c5d70a0 2024-09-21T01:42:10.034 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.018+0000 7f7036852640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557a8c5fff60 0x557a8c9a5f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:42:10.034 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.018+0000 7f7036852640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557a8c5fff60 0x557a8c9a5f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:35058/0 (socket says 172.21.15.83:35058) 2024-09-21T01:42:10.034 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.018+0000 7f7036852640 1 -- 172.21.15.83:0/3225232562 learned_addr learned my addr 172.21.15.83:0/3225232562 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:42:10.034 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.018+0000 7f7036051640 1 --2- 172.21.15.83:0/3225232562 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557a8c5d70a0 0x557a8c9a6440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:42:10.034 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.018+0000 7f7035850640 1 --2- 172.21.15.83:0/3225232562 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557a8c5df280 0x557a8c9a6980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:42:10.035 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.018+0000 7f7036852640 1 -- 172.21.15.83:0/3225232562 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557a8c5d70a0 msgr2=0x557a8c9a6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:42:10.035 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.018+0000 7f7036852640 1 --2- 172.21.15.83:0/3225232562 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557a8c5d70a0 0x557a8c9a6440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:42:10.035 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.018+0000 7f7036852640 1 -- 172.21.15.83:0/3225232562 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557a8c5df280 msgr2=0x557a8c9a6980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:42:10.035 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.018+0000 7f7036852640 1 --2- 172.21.15.83:0/3225232562 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557a8c5df280 0x557a8c9a6980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:42:10.035 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.018+0000 7f7036852640 1 -- 172.21.15.83:0/3225232562 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557a8c66b540 con 0x557a8c5fff60 2024-09-21T01:42:10.035 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.018+0000 7f702f7fe640 1 --2- 172.21.15.83:0/783833064 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f70180b6680 0x7f70180b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:42:10.035 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.018+0000 7f7035850640 1 --2- 172.21.15.83:0/3225232562 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557a8c5df280 0x557a8c9a6980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:42:10.035 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.018+0000 7f7036051640 1 --2- 172.21.15.83:0/783833064 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f70180b6680 0x7f70180b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:42:10.035 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.018+0000 7f7036852640 1 --2- 172.21.15.83:0/3225232562 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557a8c5fff60 0x557a8c9a5f00 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f702800bcf0 tx=0x7f702800f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b2e63c098784bd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:42:10.035 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.018+0000 7f702f7fe640 1 -- 172.21.15.83:0/783833064 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9315+0+0 (secure 0 0 0) 0x7f70240e7b40 con 0x7f70301083c0 2024-09-21T01:42:10.035 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.018+0000 7f702cd9a640 1 -- 172.21.15.83:0/3225232562 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7028015070 con 0x557a8c5fff60 2024-09-21T01:42:10.035 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.018+0000 7f702cd9a640 1 -- 172.21.15.83:0/3225232562 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f70280118d0 con 0x557a8c5fff60 2024-09-21T01:42:10.035 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.018+0000 7f702cd9a640 1 -- 172.21.15.83:0/3225232562 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7028010750 con 0x557a8c5fff60 2024-09-21T01:42:10.035 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.019+0000 7f703e829740 1 -- 172.21.15.83:0/3225232562 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557a8c5fff60 msgr2=0x557a8c9a5f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:42:10.035 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.019+0000 7f7036051640 1 --2- 172.21.15.83:0/783833064 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f70180b6680 0x7f70180b8b90 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x557a8c9a4b80 tx=0x7f7020005d80 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:42:10.036 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.019+0000 7f703e829740 1 --2- 172.21.15.83:0/3225232562 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557a8c5fff60 0x557a8c9a5f00 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f702800bcf0 tx=0x7f702800f730 comp rx=0 tx=0).stop 2024-09-21T01:42:10.036 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.019+0000 7f703e829740 1 -- 172.21.15.83:0/3225232562 shutdown_connections 2024-09-21T01:42:10.036 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.019+0000 7f703e829740 1 --2- 172.21.15.83:0/3225232562 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557a8c5df280 0x557a8c9a6980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:42:10.036 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.019+0000 7f703e829740 1 --2- 172.21.15.83:0/3225232562 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557a8c5d70a0 0x557a8c9a6440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:42:10.036 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.019+0000 7f703e829740 1 --2- 172.21.15.83:0/3225232562 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557a8c5fff60 0x557a8c9a5f00 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:42:10.036 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.019+0000 7f703e829740 1 -- 172.21.15.83:0/3225232562 >> 172.21.15.83:0/3225232562 conn(0x557a8c5f4350 msgr2=0x557a8c9a3df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:42:10.036 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.020+0000 7f703e829740 1 -- 172.21.15.83:0/3225232562 shutdown_connections 2024-09-21T01:42:10.036 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.020+0000 7f703e829740 1 -- 172.21.15.83:0/3225232562 wait complete. 2024-09-21T01:42:10.036 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.020+0000 7f703e829740 1 -- start start 2024-09-21T01:42:10.036 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.020+0000 7f703e829740 1 Processor -- start 2024-09-21T01:42:10.036 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.020+0000 7f703e829740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557a8c5d70a0 0x557a8c9b1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:42:10.036 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.020+0000 7f703e829740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557a8c5df280 0x557a8c9b1f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:42:10.036 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.020+0000 7f703e829740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557a8c5fff60 0x557a8c9bda00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:42:10.036 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.020+0000 7f703e829740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x557a8c76e5f0 con 0x557a8c5fff60 2024-09-21T01:42:10.036 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.020+0000 7f703e829740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x557a8c8a8010 con 0x557a8c5d70a0 2024-09-21T01:42:10.036 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.020+0000 7f703e829740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x557a8c9b46e0 con 0x557a8c5df280 2024-09-21T01:42:10.037 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.020+0000 7f703e829740 10 client.0 _ll_register_callbacks cb 0x557a8c907340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:42:10.037 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.020+0000 7f7036852640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557a8c5fff60 0x557a8c9bda00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:42:10.037 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.020+0000 7f7036852640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557a8c5fff60 0x557a8c9bda00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:35070/0 (socket says 172.21.15.83:35070) 2024-09-21T01:42:10.037 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.020+0000 7f7036852640 1 -- 172.21.15.83:0/4074005224 learned_addr learned my addr 172.21.15.83:0/4074005224 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:42:10.037 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.021+0000 7f7036051640 1 --2- 172.21.15.83:0/4074005224 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557a8c5d70a0 0x557a8c9b1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:42:10.037 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.021+0000 7f7035850640 1 --2- 172.21.15.83:0/4074005224 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557a8c5df280 0x557a8c9b1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:42:10.037 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.021+0000 7f7036852640 1 -- 172.21.15.83:0/4074005224 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557a8c5df280 msgr2=0x557a8c9b1f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:42:10.037 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.021+0000 7f7036852640 1 --2- 172.21.15.83:0/4074005224 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557a8c5df280 0x557a8c9b1f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:42:10.037 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.021+0000 7f7036852640 1 -- 172.21.15.83:0/4074005224 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557a8c5d70a0 msgr2=0x557a8c9b1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:42:10.037 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.021+0000 7f7036852640 1 --2- 172.21.15.83:0/4074005224 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557a8c5d70a0 0x557a8c9b1a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:42:10.037 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.021+0000 7f7036852640 1 -- 172.21.15.83:0/4074005224 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557a8c8d5a00 con 0x557a8c5fff60 2024-09-21T01:42:10.037 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.021+0000 7f7035850640 1 --2- 172.21.15.83:0/4074005224 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557a8c5df280 0x557a8c9b1f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:42:10.037 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.021+0000 7f7036051640 1 --2- 172.21.15.83:0/4074005224 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557a8c5d70a0 0x557a8c9b1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:42:10.037 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.021+0000 7f7036852640 1 --2- 172.21.15.83:0/4074005224 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557a8c5fff60 0x557a8c9bda00 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f702800b840 tx=0x7f7028011670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af9d9de5eb5f17d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:42:10.037 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.021+0000 7f7015ffb640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-09-21T01:42:10.038 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.021+0000 7f7015ffb640 1 -- 172.21.15.83:0/4074005224 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7028029060 con 0x557a8c5fff60 2024-09-21T01:42:10.038 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.021+0000 7f7015ffb640 1 -- 172.21.15.83:0/4074005224 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9315+0+0 (secure 0 0 0) 0x7f7028011c90 con 0x557a8c5fff60 2024-09-21T01:42:10.038 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.021+0000 7f703e829740 1 -- 172.21.15.83:0/4074005224 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f70280118d0 con 0x557a8c5fff60 2024-09-21T01:42:10.038 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.021+0000 7f7015ffb640 1 -- 172.21.15.83:0/4074005224 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f7028030050 con 0x557a8c5fff60 2024-09-21T01:42:10.038 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.021+0000 7f703e829740 10 client.15489 fetch_fsmap learned FSMap version 21 2024-09-21T01:42:10.038 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.021+0000 7f703e829740 1 -- 172.21.15.83:0/4074005224 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x557a8c9c0630 con 0x557a8c5fff60 2024-09-21T01:42:10.038 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.022+0000 7f7015ffb640 1 -- 172.21.15.83:0/4074005224 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f70280118d0 con 0x557a8c5fff60 2024-09-21T01:42:10.038 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.022+0000 7f7015ffb640 1 -- 172.21.15.83:0/4074005224 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f70280049b0 con 0x557a8c5fff60 2024-09-21T01:42:10.038 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.022+0000 7f703e829740 10 client.15489 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T01:42:10.038 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.022+0000 7f703e829740 10 client.15489 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-21T01:42:10.038 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.022+0000 7f703e829740 20 client.15489 populate_metadata read hostname 'smithi083' 2024-09-21T01:42:10.038 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.022+0000 7f703e829740 1 --2- 172.21.15.83:0/4074005224 >> [v2:172.21.15.119:6838/3106757092,v1:172.21.15.119:6839/3106757092] conn(0x557a8c5be8e0 0x557a8c9c3cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:42:10.038 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.022+0000 7f703e829740 4 client.15489 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:42:10.038 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.022+0000 7f703e829740 1 -- 172.21.15.83:0/4074005224 --> [v2:172.21.15.119:6838/3106757092,v1:172.21.15.119:6839/3106757092] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557a8c91fb60 con 0x557a8c5be8e0 2024-09-21T01:42:10.039 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.022+0000 7f7036051640 1 --2- 172.21.15.83:0/4074005224 >> [v2:172.21.15.119:6838/3106757092,v1:172.21.15.119:6839/3106757092] conn(0x557a8c5be8e0 0x557a8c9c3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:42:10.039 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.023+0000 7f7036051640 1 --2- 172.21.15.83:0/4074005224 >> [v2:172.21.15.119:6838/3106757092,v1:172.21.15.119:6839/3106757092] conn(0x557a8c5be8e0 0x557a8c9c3cb0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ef06cc1d927070e server_cookie=c53610442bf6da6f in_seq=0 out_seq=0 2024-09-21T01:42:10.039 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.023+0000 7f7015ffb640 10 client.15489 ms_handle_connect on v2:172.21.15.119:6838/3106757092 2024-09-21T01:42:10.039 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.023+0000 7f7015ffb640 1 -- 172.21.15.83:0/4074005224 <== mds.0 v2:172.21.15.119:6838/3106757092 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557a8c91fb60 con 0x557a8c5be8e0 2024-09-21T01:42:10.039 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.023+0000 7f7015ffb640 10 client.15489 handle_command_reply: tid=0 2024-09-21T01:42:10.039 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.023+0000 7f703e829740 1 client.15489 shutdown 2024-09-21T01:42:10.039 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.023+0000 7f703e829740 1 -- 172.21.15.83:0/4074005224 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557a8c5fff60 msgr2=0x557a8c9bda00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:42:10.039 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.023+0000 7f703e829740 1 --2- 172.21.15.83:0/4074005224 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557a8c5fff60 0x557a8c9bda00 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f702800b840 tx=0x7f7028011670 comp rx=0 tx=0).stop 2024-09-21T01:42:10.039 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.024+0000 7f703e829740 1 -- 172.21.15.83:0/4074005224 shutdown_connections 2024-09-21T01:42:10.039 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.024+0000 7f703e829740 1 --2- 172.21.15.83:0/4074005224 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557a8c5fff60 0x557a8c9bda00 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:42:10.039 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.024+0000 7f703e829740 1 --2- 172.21.15.83:0/4074005224 >> [v2:172.21.15.119:6838/3106757092,v1:172.21.15.119:6839/3106757092] conn(0x557a8c5be8e0 0x557a8c9c3cb0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:42:10.039 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.024+0000 7f703e829740 1 --2- 172.21.15.83:0/4074005224 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557a8c5df280 0x557a8c9b1f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:42:10.039 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.024+0000 7f703e829740 1 --2- 172.21.15.83:0/4074005224 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557a8c5d70a0 0x557a8c9b1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:42:10.040 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.024+0000 7f7015ffb640 0 client.15489 ms_handle_reset on v2:172.21.15.119:6838/3106757092 2024-09-21T01:42:10.040 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.024+0000 7f703e829740 1 -- 172.21.15.83:0/4074005224 >> 172.21.15.83:0/4074005224 conn(0x557a8c5f4350 msgr2=0x557a8c9a90e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:42:10.040 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.024+0000 7f703e829740 1 -- 172.21.15.83:0/4074005224 shutdown_connections 2024-09-21T01:42:10.040 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.024+0000 7f703e829740 1 -- 172.21.15.83:0/4074005224 wait complete. 2024-09-21T01:42:10.040 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.024+0000 7f703e829740 20 client.15489 trim_cache size 0 max 16384 2024-09-21T01:42:10.044 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.041+0000 7f703e829740 1 Processor -- start 2024-09-21T01:42:10.044 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.042+0000 7f703e829740 1 -- start start 2024-09-21T01:42:10.044 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.042+0000 7f703e829740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557a8c5d70a0 0x557a8c9ac020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:42:10.044 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.042+0000 7f703e829740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557a8c5df280 0x557a8c9bd970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:42:10.044 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.042+0000 7f703e829740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557a8c5fff60 0x557a8c9bdeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:42:10.044 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.042+0000 7f703e829740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x557a8c9c1ff0 con 0x557a8c5d70a0 2024-09-21T01:42:10.044 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.042+0000 7f703e829740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x557a8c9c26c0 con 0x557a8c5df280 2024-09-21T01:42:10.044 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.042+0000 7f703e829740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x557a8c9c2d90 con 0x557a8c5fff60 2024-09-21T01:42:10.044 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.042+0000 7f7036051640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557a8c5d70a0 0x557a8c9ac020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:42:10.044 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.042+0000 7f7036051640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557a8c5d70a0 0x557a8c9ac020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:35082/0 (socket says 172.21.15.83:35082) 2024-09-21T01:42:10.044 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.042+0000 7f7036051640 1 -- 172.21.15.83:0/1798527538 learned_addr learned my addr 172.21.15.83:0/1798527538 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:42:10.045 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.042+0000 7f7036852640 1 --2- 172.21.15.83:0/1798527538 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557a8c5fff60 0x557a8c9bdeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:42:10.045 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.042+0000 7f7035850640 1 --2- 172.21.15.83:0/1798527538 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557a8c5df280 0x557a8c9bd970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:42:10.045 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.042+0000 7f7036051640 1 -- 172.21.15.83:0/1798527538 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557a8c5fff60 msgr2=0x557a8c9bdeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:42:10.045 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.042+0000 7f7036051640 1 --2- 172.21.15.83:0/1798527538 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557a8c5fff60 0x557a8c9bdeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:42:10.045 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.042+0000 7f7036051640 1 -- 172.21.15.83:0/1798527538 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557a8c5df280 msgr2=0x557a8c9bd970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:42:10.045 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.042+0000 7f7036051640 1 --2- 172.21.15.83:0/1798527538 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557a8c5df280 0x557a8c9bd970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:42:10.045 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.042+0000 7f7036051640 1 -- 172.21.15.83:0/1798527538 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557a8c9a8700 con 0x557a8c5d70a0 2024-09-21T01:42:10.045 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.042+0000 7f7036051640 1 --2- 172.21.15.83:0/1798527538 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557a8c5d70a0 0x557a8c9ac020 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f7020009ca0 tx=0x7f7020040000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f17f83d38f551f7d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:42:10.045 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.043+0000 7f7017fff640 1 -- 172.21.15.83:0/1798527538 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7020031c50 con 0x557a8c5d70a0 2024-09-21T01:42:10.045 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.043+0000 7f7017fff640 1 -- 172.21.15.83:0/1798527538 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7020036050 con 0x557a8c5d70a0 2024-09-21T01:42:10.045 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.043+0000 7f7017fff640 1 -- 172.21.15.83:0/1798527538 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7020048680 con 0x557a8c5d70a0 2024-09-21T01:42:10.049 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.043+0000 7f703e829740 1 -- 172.21.15.83:0/1798527538 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557a8c5d70a0 msgr2=0x557a8c9ac020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:42:10.049 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.043+0000 7f703e829740 1 --2- 172.21.15.83:0/1798527538 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557a8c5d70a0 0x557a8c9ac020 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f7020009ca0 tx=0x7f7020040000 comp rx=0 tx=0).stop 2024-09-21T01:42:10.049 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.043+0000 7f703e829740 1 -- 172.21.15.83:0/1798527538 shutdown_connections 2024-09-21T01:42:10.049 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.043+0000 7f703e829740 1 --2- 172.21.15.83:0/1798527538 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557a8c5fff60 0x557a8c9bdeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:42:10.049 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.043+0000 7f703e829740 1 --2- 172.21.15.83:0/1798527538 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557a8c5df280 0x557a8c9bd970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:42:10.049 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.043+0000 7f703e829740 1 --2- 172.21.15.83:0/1798527538 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557a8c5d70a0 0x557a8c9ac020 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:42:10.049 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.043+0000 7f703e829740 1 -- 172.21.15.83:0/1798527538 >> 172.21.15.83:0/1798527538 conn(0x557a8c5f4350 msgr2=0x557a8c9ac9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:42:10.049 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.044+0000 7f703e829740 1 -- 172.21.15.83:0/1798527538 shutdown_connections 2024-09-21T01:42:10.049 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.044+0000 7f703e829740 1 -- 172.21.15.83:0/1798527538 wait complete. 2024-09-21T01:42:10.049 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.044+0000 7f703e829740 1 -- start start 2024-09-21T01:42:10.050 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.044+0000 7f703e829740 1 Processor -- start 2024-09-21T01:42:10.050 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.044+0000 7f703e829740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557a8c5d70a0 0x557a8c9cc6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:42:10.050 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.044+0000 7f703e829740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557a8c5df280 0x557a8c9c5ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:42:10.050 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.044+0000 7f703e829740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557a8c5fff60 0x557a8c9c60e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:42:10.050 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.044+0000 7f703e829740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x557a8c9c3b30 con 0x557a8c5fff60 2024-09-21T01:42:10.050 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.044+0000 7f703e829740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x557a8c9c3460 con 0x557a8c5df280 2024-09-21T01:42:10.050 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.044+0000 7f703e829740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x557a8c9c4200 con 0x557a8c5d70a0 2024-09-21T01:42:10.050 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.044+0000 7f703e829740 10 client.0 _ll_register_callbacks cb 0x7f7020009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:42:10.050 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.045+0000 7f7036852640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557a8c5fff60 0x557a8c9c60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:42:10.050 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.045+0000 7f7036852640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557a8c5fff60 0x557a8c9c60e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:35090/0 (socket says 172.21.15.83:35090) 2024-09-21T01:42:10.050 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.045+0000 7f7036852640 1 -- 172.21.15.83:0/1465239651 learned_addr learned my addr 172.21.15.83:0/1465239651 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:42:10.051 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.045+0000 7f7035850640 1 --2- 172.21.15.83:0/1465239651 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557a8c5df280 0x557a8c9c5ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:42:10.051 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.045+0000 7f7036051640 1 --2- 172.21.15.83:0/1465239651 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557a8c5d70a0 0x557a8c9cc6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:42:10.051 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.045+0000 7f7036852640 1 -- 172.21.15.83:0/1465239651 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557a8c5d70a0 msgr2=0x557a8c9cc6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:42:10.051 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.045+0000 7f7036852640 1 --2- 172.21.15.83:0/1465239651 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557a8c5d70a0 0x557a8c9cc6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:42:10.051 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.045+0000 7f7036852640 1 -- 172.21.15.83:0/1465239651 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557a8c5df280 msgr2=0x557a8c9c5ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:42:10.051 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.045+0000 7f7036852640 1 --2- 172.21.15.83:0/1465239651 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557a8c5df280 0x557a8c9c5ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:42:10.051 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.045+0000 7f7036852640 1 -- 172.21.15.83:0/1465239651 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557a8c9c6820 con 0x557a8c5fff60 2024-09-21T01:42:10.051 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.045+0000 7f7036852640 1 --2- 172.21.15.83:0/1465239651 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557a8c5fff60 0x557a8c9c60e0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f7028000bc0 tx=0x7f702800bbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d8c84e6f2a20654 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:42:10.051 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.045+0000 7f7015ffb640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-09-21T01:42:10.051 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.045+0000 7f7015ffb640 1 -- 172.21.15.83:0/1465239651 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7028039060 con 0x557a8c5fff60 2024-09-21T01:42:10.051 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.045+0000 7f7015ffb640 1 -- 172.21.15.83:0/1465239651 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9315+0+0 (secure 0 0 0) 0x7f7028010570 con 0x557a8c5fff60 2024-09-21T01:42:10.051 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.045+0000 7f703e829740 1 -- 172.21.15.83:0/1465239651 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7020036050 con 0x557a8c5fff60 2024-09-21T01:42:10.051 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.045+0000 7f7015ffb640 1 -- 172.21.15.83:0/1465239651 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f7028040050 con 0x557a8c5fff60 2024-09-21T01:42:10.052 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.045+0000 7f703e829740 10 client.15495 fetch_fsmap learned FSMap version 21 2024-09-21T01:42:10.052 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.045+0000 7f703e829740 1 -- 172.21.15.83:0/1465239651 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x557a8ca2f180 con 0x557a8c5fff60 2024-09-21T01:42:10.052 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.046+0000 7f7015ffb640 1 -- 172.21.15.83:0/1465239651 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7020036050 con 0x557a8c5fff60 2024-09-21T01:42:10.052 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.046+0000 7f7015ffb640 1 -- 172.21.15.83:0/1465239651 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f70280050b0 con 0x557a8c5fff60 2024-09-21T01:42:10.052 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.046+0000 7f703e829740 10 client.15495 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T01:42:10.052 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.046+0000 7f703e829740 10 client.15495 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-21T01:42:10.052 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.046+0000 7f703e829740 20 client.15495 populate_metadata read hostname 'smithi083' 2024-09-21T01:42:10.052 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.046+0000 7f703e829740 1 --2- 172.21.15.83:0/1465239651 >> [v2:172.21.15.119:6838/3106757092,v1:172.21.15.119:6839/3106757092] conn(0x557a8c593c90 0x557a8ca32890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:42:10.052 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.046+0000 7f703e829740 4 client.15495 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T01:42:10.052 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.046+0000 7f703e829740 1 -- 172.21.15.83:0/1465239651 --> [v2:172.21.15.119:6838/3106757092,v1:172.21.15.119:6839/3106757092] -- command(tid 0: {"prefix": "status"}) -- 0x557a8c91b610 con 0x557a8c593c90 2024-09-21T01:42:10.052 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.046+0000 7f7036051640 1 --2- 172.21.15.83:0/1465239651 >> [v2:172.21.15.119:6838/3106757092,v1:172.21.15.119:6839/3106757092] conn(0x557a8c593c90 0x557a8ca32890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:42:10.052 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.047+0000 7f7036051640 1 --2- 172.21.15.83:0/1465239651 >> [v2:172.21.15.119:6838/3106757092,v1:172.21.15.119:6839/3106757092] conn(0x557a8c593c90 0x557a8ca32890 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c9dc9f1a3f33ab10 server_cookie=d6f763ac3b87825b in_seq=0 out_seq=0 2024-09-21T01:42:10.052 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.047+0000 7f7015ffb640 10 client.15495 ms_handle_connect on v2:172.21.15.119:6838/3106757092 2024-09-21T01:42:10.052 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.047+0000 7f7015ffb640 1 -- 172.21.15.83:0/1465239651 <== mds.0 v2:172.21.15.119:6838/3106757092 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x557a8c91b610 con 0x557a8c593c90 2024-09-21T01:42:10.053 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.047+0000 7f7015ffb640 10 client.15495 handle_command_reply: tid=0 2024-09-21T01:42:10.053 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.047+0000 7f703e829740 1 client.15495 shutdown 2024-09-21T01:42:10.053 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.047+0000 7f703e829740 1 -- 172.21.15.83:0/1465239651 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557a8c5fff60 msgr2=0x557a8c9c60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:42:10.053 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.047+0000 7f703e829740 1 --2- 172.21.15.83:0/1465239651 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557a8c5fff60 0x557a8c9c60e0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f7028000bc0 tx=0x7f702800bbc0 comp rx=0 tx=0).stop 2024-09-21T01:42:10.053 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.047+0000 7f703e829740 1 -- 172.21.15.83:0/1465239651 shutdown_connections 2024-09-21T01:42:10.053 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.047+0000 7f703e829740 1 --2- 172.21.15.83:0/1465239651 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x557a8c5fff60 0x557a8c9c60e0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:42:10.053 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.047+0000 7f703e829740 1 --2- 172.21.15.83:0/1465239651 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x557a8c5df280 0x557a8c9c5ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:42:10.053 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.047+0000 7f703e829740 1 --2- 172.21.15.83:0/1465239651 >> [v2:172.21.15.119:6838/3106757092,v1:172.21.15.119:6839/3106757092] conn(0x557a8c593c90 0x557a8ca32890 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:42:10.053 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.047+0000 7f703e829740 1 --2- 172.21.15.83:0/1465239651 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557a8c5d70a0 0x557a8c9cc6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:42:10.053 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.047+0000 7f703e829740 1 -- 172.21.15.83:0/1465239651 >> 172.21.15.83:0/1465239651 conn(0x557a8c5f4350 msgr2=0x557a8c9ac9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:42:10.053 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.047+0000 7f7015ffb640 0 client.15495 ms_handle_reset on v2:172.21.15.119:6838/3106757092 2024-09-21T01:42:10.053 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.047+0000 7f703e829740 1 -- 172.21.15.83:0/1465239651 shutdown_connections 2024-09-21T01:42:10.053 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.047+0000 7f703e829740 1 -- 172.21.15.83:0/1465239651 wait complete. 2024-09-21T01:42:10.053 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.047+0000 7f703e829740 20 client.15495 trim_cache size 0 max 16384 2024-09-21T01:42:10.054 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-09-21T01:42:10.054 INFO:teuthology.orchestra.run.smithi083.stdout: "cluster_fsid": "f7697ecc-77b8-11ef-baf5-efdc52797490", 2024-09-21T01:42:10.054 INFO:teuthology.orchestra.run.smithi083.stdout: "whoami": 0, 2024-09-21T01:42:10.054 INFO:teuthology.orchestra.run.smithi083.stdout: "id": 24653, 2024-09-21T01:42:10.054 INFO:teuthology.orchestra.run.smithi083.stdout: "want_state": "up:active", 2024-09-21T01:42:10.054 INFO:teuthology.orchestra.run.smithi083.stdout: "state": "up:active", 2024-09-21T01:42:10.054 INFO:teuthology.orchestra.run.smithi083.stdout: "fs_name": "cephfs", 2024-09-21T01:42:10.054 INFO:teuthology.orchestra.run.smithi083.stdout: "rank_uptime": 144.76781204400001, 2024-09-21T01:42:10.054 INFO:teuthology.orchestra.run.smithi083.stdout: "mdsmap_epoch": 21, 2024-09-21T01:42:10.054 INFO:teuthology.orchestra.run.smithi083.stdout: "osdmap_epoch": 84, 2024-09-21T01:42:10.054 INFO:teuthology.orchestra.run.smithi083.stdout: "osdmap_epoch_barrier": 82, 2024-09-21T01:42:10.055 INFO:teuthology.orchestra.run.smithi083.stdout: "uptime": 155.13687902000001 2024-09-21T01:42:10.055 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-09-21T01:42:10.055 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.048+0000 7f70382b5640 1 -- 172.21.15.83:0/783833064 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f70180b6680 msgr2=0x7f70180b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:42:10.055 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.048+0000 7f70382b5640 1 --2- 172.21.15.83:0/783833064 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f70180b6680 0x7f70180b8b90 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x557a8c9a4b80 tx=0x7f7020005d80 comp rx=0 tx=0).stop 2024-09-21T01:42:10.056 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.048+0000 7f70382b5640 1 -- 172.21.15.83:0/783833064 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f70301083c0 msgr2=0x7f7030199850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:42:10.056 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.048+0000 7f70382b5640 1 --2- 172.21.15.83:0/783833064 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f70301083c0 0x7f7030199850 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f702400c970 tx=0x7f702400ce30 comp rx=0 tx=0).stop 2024-09-21T01:42:10.056 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.048+0000 7f70382b5640 1 -- 172.21.15.83:0/783833064 shutdown_connections 2024-09-21T01:42:10.056 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.048+0000 7f70382b5640 1 --2- 172.21.15.83:0/783833064 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f70180b6680 0x7f70180b8b90 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:42:10.056 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.048+0000 7f70382b5640 1 --2- 172.21.15.83:0/783833064 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7030108d10 0x7f703019eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:42:10.056 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.048+0000 7f70382b5640 1 --2- 172.21.15.83:0/783833064 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f70301083c0 0x7f7030199850 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:42:10.056 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.048+0000 7f70382b5640 1 --2- 172.21.15.83:0/783833064 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7030102a80 0x7f70301992b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:42:10.056 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.048+0000 7f70382b5640 1 -- 172.21.15.83:0/783833064 >> 172.21.15.83:0/783833064 conn(0x7f7030079740 msgr2=0x7f7030101550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:42:10.056 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.048+0000 7f70382b5640 1 -- 172.21.15.83:0/783833064 shutdown_connections 2024-09-21T01:42:10.056 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:10.048+0000 7f70382b5640 1 -- 172.21.15.83:0/783833064 wait complete. 2024-09-21T01:42:10.764 INFO:tasks.quiescer:Ready to start quiesce thrashing; initial delay: 15 sec 2024-09-21T01:42:12.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:42:11 smithi142 ceph-mon[34050]: pgmap v343: 129 pgs: 129 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 125 KiB/s wr, 56 op/s 2024-09-21T01:42:12.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:42:11 smithi119 ceph-mon[33693]: pgmap v343: 129 pgs: 129 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 125 KiB/s wr, 56 op/s 2024-09-21T01:42:12.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:42:11 smithi083 ceph-mon[31370]: pgmap v343: 129 pgs: 129 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 125 KiB/s wr, 56 op/s 2024-09-21T01:42:14.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:42:13 smithi142 ceph-mon[34050]: pgmap v344: 129 pgs: 129 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 23 KiB/s wr, 17 op/s 2024-09-21T01:42:14.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:42:13 smithi119 ceph-mon[33693]: pgmap v344: 129 pgs: 129 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 23 KiB/s wr, 17 op/s 2024-09-21T01:42:14.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:42:13 smithi083 ceph-mon[31370]: pgmap v344: 129 pgs: 129 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 23 KiB/s wr, 17 op/s 2024-09-21T01:42:16.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:42:15 smithi142 ceph-mon[34050]: pgmap v345: 129 pgs: 129 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 12 KiB/s wr, 16 op/s 2024-09-21T01:42:16.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:42:15 smithi119 ceph-mon[33693]: pgmap v345: 129 pgs: 129 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 12 KiB/s wr, 16 op/s 2024-09-21T01:42:16.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:42:15 smithi083 ceph-mon[31370]: pgmap v345: 129 pgs: 129 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 12 KiB/s wr, 16 op/s 2024-09-21T01:42:18.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:42:17 smithi142 ceph-mon[34050]: pgmap v346: 129 pgs: 129 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-21T01:42:18.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:42:17 smithi119 ceph-mon[33693]: pgmap v346: 129 pgs: 129 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-21T01:42:18.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:42:17 smithi083 ceph-mon[31370]: pgmap v346: 129 pgs: 129 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 12 KiB/s wr, 15 op/s 2024-09-21T01:42:20.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:42:19 smithi142 ceph-mon[34050]: pgmap v347: 129 pgs: 129 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 938 B/s wr, 2 op/s 2024-09-21T01:42:20.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:42:19 smithi119 ceph-mon[33693]: pgmap v347: 129 pgs: 129 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 938 B/s wr, 2 op/s 2024-09-21T01:42:20.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:42:19 smithi083 ceph-mon[31370]: pgmap v347: 129 pgs: 129 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 938 B/s wr, 2 op/s 2024-09-21T01:42:22.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:42:21 smithi142 ceph-mon[34050]: pgmap v348: 129 pgs: 129 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-09-21T01:42:22.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:42:21 smithi119 ceph-mon[33693]: pgmap v348: 129 pgs: 129 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-09-21T01:42:22.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:42:21 smithi083 ceph-mon[31370]: pgmap v348: 129 pgs: 129 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-09-21T01:42:24.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:42:23 smithi142 ceph-mon[34050]: pgmap v349: 129 pgs: 129 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 853 B/s wr, 2 op/s 2024-09-21T01:42:24.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:42:23 smithi119 ceph-mon[33693]: pgmap v349: 129 pgs: 129 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 853 B/s wr, 2 op/s 2024-09-21T01:42:24.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:42:23 smithi083 ceph-mon[31370]: pgmap v349: 129 pgs: 129 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 853 B/s wr, 2 op/s 2024-09-21T01:42:25.764 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 14.5 2024-09-21T01:42:25.765 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T01:42:26.025 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:42:26.053 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:42:25 smithi083 ceph-mon[31370]: pgmap v350: 129 pgs: 129 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 853 B/s wr, 2 op/s 2024-09-21T01:42:26.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:42:25 smithi142 ceph-mon[34050]: pgmap v350: 129 pgs: 129 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 853 B/s wr, 2 op/s 2024-09-21T01:42:26.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:42:25 smithi119 ceph-mon[33693]: pgmap v350: 129 pgs: 129 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 853 B/s wr, 2 op/s 2024-09-21T01:42:26.592 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:26.579+0000 7f580e5b7640 1 -- 172.21.15.83:0/3684809557 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f58081062e0 msgr2=0x7f58081066f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:42:26.592 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:26.579+0000 7f580e5b7640 1 --2- 172.21.15.83:0/3684809557 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f58081062e0 0x7f58081066f0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f57fc009900 tx=0x7f57fc02a3f0 comp rx=0 tx=0).stop 2024-09-21T01:42:26.592 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:26.579+0000 7f580e5b7640 1 -- 172.21.15.83:0/3684809557 shutdown_connections 2024-09-21T01:42:26.592 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:26.579+0000 7f580e5b7640 1 --2- 172.21.15.83:0/3684809557 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5808106c30 0x7f5808110650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:42:26.592 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:26.579+0000 7f580e5b7640 1 --2- 172.21.15.83:0/3684809557 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f58081062e0 0x7f58081066f0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:42:26.592 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:26.579+0000 7f580e5b7640 1 --2- 172.21.15.83:0/3684809557 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f58081020f0 0x7f5808102500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:42:26.592 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:26.579+0000 7f580e5b7640 1 -- 172.21.15.83:0/3684809557 >> 172.21.15.83:0/3684809557 conn(0x7f5808077cc0 msgr2=0x7f5808078100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:42:26.592 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:26.579+0000 7f580e5b7640 1 -- 172.21.15.83:0/3684809557 shutdown_connections 2024-09-21T01:42:26.593 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:26.579+0000 7f580e5b7640 1 -- 172.21.15.83:0/3684809557 wait complete. 2024-09-21T01:42:26.593 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:26.580+0000 7f580e5b7640 1 Processor -- start 2024-09-21T01:42:26.593 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:26.580+0000 7f580e5b7640 1 -- start start 2024-09-21T01:42:26.593 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:26.580+0000 7f580e5b7640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f58081020f0 0x7f580819a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:42:26.593 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:26.580+0000 7f580e5b7640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f58081062e0 0x7f580819a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:42:26.593 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:26.580+0000 7f580e5b7640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5808106c30 0x7f580819fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:42:26.593 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:26.580+0000 7f580e5b7640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f5808113950 con 0x7f58081020f0 2024-09-21T01:42:26.593 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:26.580+0000 7f580e5b7640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f58081137d0 con 0x7f58081062e0 2024-09-21T01:42:26.593 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:26.580+0000 7f580e5b7640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f5808113ad0 con 0x7f5808106c30 2024-09-21T01:42:26.593 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:26.580+0000 7f5807fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f58081020f0 0x7f580819a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:42:26.593 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:26.580+0000 7f5807fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f58081020f0 0x7f580819a3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:44492/0 (socket says 172.21.15.83:44492) 2024-09-21T01:42:26.593 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:26.580+0000 7f5807fff640 1 -- 172.21.15.83:0/4221626751 learned_addr learned my addr 172.21.15.83:0/4221626751 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:42:26.594 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:26.581+0000 7f580cb54640 1 --2- 172.21.15.83:0/4221626751 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5808106c30 0x7f580819fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:42:26.594 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:26.581+0000 7f58077fe640 1 --2- 172.21.15.83:0/4221626751 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f58081062e0 0x7f580819a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:42:26.594 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:26.581+0000 7f5807fff640 1 -- 172.21.15.83:0/4221626751 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5808106c30 msgr2=0x7f580819fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:42:26.594 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:26.581+0000 7f5807fff640 1 --2- 172.21.15.83:0/4221626751 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5808106c30 0x7f580819fc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:42:26.594 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:26.581+0000 7f5807fff640 1 -- 172.21.15.83:0/4221626751 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f58081062e0 msgr2=0x7f580819a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:42:26.594 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:26.581+0000 7f5807fff640 1 --2- 172.21.15.83:0/4221626751 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f58081062e0 0x7f580819a960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:42:26.594 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:26.581+0000 7f5807fff640 1 -- 172.21.15.83:0/4221626751 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58081a0270 con 0x7f58081020f0 2024-09-21T01:42:26.594 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:26.581+0000 7f58077fe640 1 --2- 172.21.15.83:0/4221626751 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f58081062e0 0x7f580819a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:42:26.594 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:26.581+0000 7f5807fff640 1 --2- 172.21.15.83:0/4221626751 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f58081020f0 0x7f580819a3c0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f57f800c920 tx=0x7f57f800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:42:26.594 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:26.581+0000 7f58057fa640 1 -- 172.21.15.83:0/4221626751 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57f8007c70 con 0x7f58081020f0 2024-09-21T01:42:26.594 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:26.581+0000 7f580e5b7640 1 -- 172.21.15.83:0/4221626751 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58081a0560 con 0x7f58081020f0 2024-09-21T01:42:26.594 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:26.581+0000 7f58057fa640 1 -- 172.21.15.83:0/4221626751 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f57f8007e10 con 0x7f58081020f0 2024-09-21T01:42:26.594 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:26.582+0000 7f58057fa640 1 -- 172.21.15.83:0/4221626751 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57f80186f0 con 0x7f58081020f0 2024-09-21T01:42:26.595 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:26.582+0000 7f580e5b7640 1 -- 172.21.15.83:0/4221626751 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58081a6d80 con 0x7f58081020f0 2024-09-21T01:42:26.595 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:26.583+0000 7f580e5b7640 1 -- 172.21.15.83:0/4221626751 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5808102500 con 0x7f58081020f0 2024-09-21T01:42:26.595 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:26.585+0000 7f58057fa640 1 -- 172.21.15.83:0/4221626751 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7f57f800f450 con 0x7f58081020f0 2024-09-21T01:42:26.595 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:26.586+0000 7f58057fa640 1 --2- 172.21.15.83:0/4221626751 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f57f00b66b0 0x7f57f00b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:42:26.595 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:26.586+0000 7f58077fe640 1 --2- 172.21.15.83:0/4221626751 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f57f00b66b0 0x7f57f00b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:42:26.595 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:26.586+0000 7f58057fa640 1 -- 172.21.15.83:0/4221626751 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9315+0+0 (secure 0 0 0) 0x7f57f80e7e30 con 0x7f58081020f0 2024-09-21T01:42:26.595 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:26.587+0000 7f58077fe640 1 --2- 172.21.15.83:0/4221626751 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f57f00b66b0 0x7f57f00b8bc0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f57fc006010 tx=0x7f57fc005de0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:42:26.595 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:26.593+0000 7f58057fa640 1 -- 172.21.15.83:0/4221626751 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f57f8014030 con 0x7f58081020f0 2024-09-21T01:42:26.822 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:26.821+0000 7f580e5b7640 1 -- 172.21.15.83:0/4221626751 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f580819b4f0 con 0x7f58081020f0 2024-09-21T01:42:26.822 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:26.822+0000 7f58057fa640 1 -- 172.21.15.83:0/4221626751 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11857 (secure 0 0 0) 0x7f57f80ae0f0 con 0x7f58081020f0 2024-09-21T01:42:26.823 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T01:42:26.823 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":21,"btime":"2024-09-21T01:40:27:947059+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14775,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6835/1105040204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":1105040204},{"type":"v1","addr":"172.21.15.83:6835","nonce":1105040204}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14787,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/2234789563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6836","nonce":2234789563},{"type":"v1","addr":"172.21.15.83:6837","nonce":2234789563}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14838,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6839/136258364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6838","nonce":136258364},{"type":"v1","addr":"172.21.15.83:6839","nonce":136258364}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14850,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6841/129439444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6840","nonce":129439444},{"type":"v1","addr":"172.21.15.83:6841","nonce":129439444}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24569,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/2839502433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":2839502433},{"type":"v1","addr":"172.21.15.119:6833","nonce":2839502433}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24580,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6833/2841606990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":2841606990},{"type":"v1","addr":"172.21.15.142:6833","nonce":2841606990}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24599,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/415902608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":415902608},{"type":"v1","addr":"172.21.15.119:6835","nonce":415902608}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24607,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/3009088510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":3009088510},{"type":"v1","addr":"172.21.15.142:6835","nonce":3009088510}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24613,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/3847200126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6836","nonce":3847200126},{"type":"v1","addr":"172.21.15.142:6837","nonce":3847200126}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24626,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/3619222976","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":3619222976},{"type":"v1","addr":"172.21.15.119:6837","nonce":3619222976}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T01:39:45.145124+0000","modified":"2024-09-21T01:40:27.664151+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24653},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24631":{"gid":24631,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.142:6839/1817880741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6838","nonce":1817880741},{"type":"v1","addr":"172.21.15.142:6839","nonce":1817880741}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24653":{"gid":24653,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.119:6839/3106757092","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":3106757092},{"type":"v1","addr":"172.21.15.119:6839","nonce":3106757092}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24653,"qdb_cluster":[24653]},"id":1}]} 2024-09-21T01:42:26.823 INFO:teuthology.orchestra.run.smithi083.stderr:dumped fsmap epoch 21 2024-09-21T01:42:26.825 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:26.824+0000 7f580e5b7640 1 -- 172.21.15.83:0/4221626751 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f57f00b66b0 msgr2=0x7f57f00b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:42:26.825 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:26.824+0000 7f580e5b7640 1 --2- 172.21.15.83:0/4221626751 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f57f00b66b0 0x7f57f00b8bc0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f57fc006010 tx=0x7f57fc005de0 comp rx=0 tx=0).stop 2024-09-21T01:42:26.825 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:26.824+0000 7f580e5b7640 1 -- 172.21.15.83:0/4221626751 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f58081020f0 msgr2=0x7f580819a3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:42:26.825 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:26.824+0000 7f580e5b7640 1 --2- 172.21.15.83:0/4221626751 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f58081020f0 0x7f580819a3c0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f57f800c920 tx=0x7f57f800cde0 comp rx=0 tx=0).stop 2024-09-21T01:42:26.825 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:26.825+0000 7f580e5b7640 1 -- 172.21.15.83:0/4221626751 shutdown_connections 2024-09-21T01:42:26.825 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:26.825+0000 7f580e5b7640 1 --2- 172.21.15.83:0/4221626751 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f57f00b66b0 0x7f57f00b8bc0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:42:26.825 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:26.825+0000 7f580e5b7640 1 --2- 172.21.15.83:0/4221626751 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5808106c30 0x7f580819fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:42:26.825 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:26.825+0000 7f580e5b7640 1 --2- 172.21.15.83:0/4221626751 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f58081062e0 0x7f580819a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:42:26.825 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:26.825+0000 7f580e5b7640 1 --2- 172.21.15.83:0/4221626751 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f58081020f0 0x7f580819a3c0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:42:26.826 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:26.825+0000 7f580e5b7640 1 -- 172.21.15.83:0/4221626751 >> 172.21.15.83:0/4221626751 conn(0x7f5808077cc0 msgr2=0x7f5808109730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:42:26.826 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:26.825+0000 7f580e5b7640 1 -- 172.21.15.83:0/4221626751 shutdown_connections 2024-09-21T01:42:26.826 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:26.825+0000 7f580e5b7640 1 -- 172.21.15.83:0/4221626751 wait complete. 2024-09-21T01:42:27.053 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:42:26 smithi083 ceph-mon[31370]: from='client.? 172.21.15.83:0/4221626751' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:42:27.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:42:26 smithi142 ceph-mon[34050]: from='client.? 172.21.15.83:0/4221626751' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:42:27.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:42:26 smithi119 ceph-mon[33693]: from='client.? 172.21.15.83:0/4221626751' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:42:27.544 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24653 quiesce db / --timeout 90 --expiration 134.5 --await-for 45.0' 2024-09-21T01:42:27.545 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24653 quiesce db / --timeout 90 --expiration 134.5 --await-for 45.0 2024-09-21T01:42:27.811 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:42:28.092 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:42:27 smithi083 ceph-mon[31370]: pgmap v351: 129 pgs: 129 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 853 B/s wr, 2 op/s 2024-09-21T01:42:28.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:42:27 smithi142 ceph-mon[34050]: pgmap v351: 129 pgs: 129 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 853 B/s wr, 2 op/s 2024-09-21T01:42:28.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:42:27 smithi119 ceph-mon[33693]: pgmap v351: 129 pgs: 129 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 853 B/s wr, 2 op/s 2024-09-21T01:42:28.340 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.339+0000 7f9049f9e640 1 -- 172.21.15.83:0/4258541394 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f90441028c0 msgr2=0x7f9044102cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:42:28.340 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.339+0000 7f9049f9e640 1 --2- 172.21.15.83:0/4258541394 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f90441028c0 0x7f9044102cd0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f9038009900 tx=0x7f903802a3f0 comp rx=0 tx=0).stop 2024-09-21T01:42:28.340 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.339+0000 7f9049f9e640 1 -- 172.21.15.83:0/4258541394 shutdown_connections 2024-09-21T01:42:28.340 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.339+0000 7f9049f9e640 1 --2- 172.21.15.83:0/4258541394 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9044108b50 0x7f904410f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:42:28.340 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.339+0000 7f9049f9e640 1 --2- 172.21.15.83:0/4258541394 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9044108200 0x7f9044108610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:42:28.340 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.339+0000 7f9049f9e640 1 --2- 172.21.15.83:0/4258541394 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f90441028c0 0x7f9044102cd0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:42:28.340 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.339+0000 7f9049f9e640 1 -- 172.21.15.83:0/4258541394 >> 172.21.15.83:0/4258541394 conn(0x7f90440fe330 msgr2=0x7f9044100780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:42:28.340 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.339+0000 7f9049f9e640 1 -- 172.21.15.83:0/4258541394 shutdown_connections 2024-09-21T01:42:28.340 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.339+0000 7f9049f9e640 1 -- 172.21.15.83:0/4258541394 wait complete. 2024-09-21T01:42:28.341 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.340+0000 7f9049f9e640 1 Processor -- start 2024-09-21T01:42:28.341 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.340+0000 7f9049f9e640 1 -- start start 2024-09-21T01:42:28.342 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.341+0000 7f9049f9e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f90441028c0 0x7f904419a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:42:28.342 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.341+0000 7f9049f9e640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9044108200 0x7f904419a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:42:28.342 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.341+0000 7f9049f9e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9044108b50 0x7f904419fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:42:28.342 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.341+0000 7f9049f9e640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f90441126c0 con 0x7f9044108200 2024-09-21T01:42:28.342 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.341+0000 7f9049f9e640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f9044112540 con 0x7f90441028c0 2024-09-21T01:42:28.342 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.341+0000 7f9049f9e640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f9044112840 con 0x7f9044108b50 2024-09-21T01:42:28.342 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.341+0000 7f9043fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9044108200 0x7f904419a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:42:28.342 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.341+0000 7f9043fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9044108200 0x7f904419a820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:44508/0 (socket says 172.21.15.83:44508) 2024-09-21T01:42:28.342 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.341+0000 7f9043fff640 1 -- 172.21.15.83:0/3828098758 learned_addr learned my addr 172.21.15.83:0/3828098758 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:42:28.343 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.341+0000 7f9048f9c640 1 --2- 172.21.15.83:0/3828098758 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f90441028c0 0x7f904419a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:42:28.343 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.341+0000 7f904979d640 1 --2- 172.21.15.83:0/3828098758 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9044108b50 0x7f904419fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:42:28.343 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.341+0000 7f9043fff640 1 -- 172.21.15.83:0/3828098758 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9044108b50 msgr2=0x7f904419fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:42:28.343 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.341+0000 7f9043fff640 1 --2- 172.21.15.83:0/3828098758 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9044108b50 0x7f904419fac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:42:28.343 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.341+0000 7f9043fff640 1 -- 172.21.15.83:0/3828098758 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f90441028c0 msgr2=0x7f904419a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:42:28.343 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.341+0000 7f9043fff640 1 --2- 172.21.15.83:0/3828098758 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f90441028c0 0x7f904419a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:42:28.343 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.341+0000 7f9043fff640 1 -- 172.21.15.83:0/3828098758 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90441a01f0 con 0x7f9044108200 2024-09-21T01:42:28.343 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.341+0000 7f9043fff640 1 --2- 172.21.15.83:0/3828098758 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9044108200 0x7f904419a820 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f903000d950 tx=0x7f903000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:42:28.343 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.342+0000 7f9041ffb640 1 -- 172.21.15.83:0/3828098758 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9030017070 con 0x7f9044108200 2024-09-21T01:42:28.343 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.342+0000 7f9049f9e640 1 -- 172.21.15.83:0/3828098758 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90441a04e0 con 0x7f9044108200 2024-09-21T01:42:28.343 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.342+0000 7f9041ffb640 1 -- 172.21.15.83:0/3828098758 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9030009c30 con 0x7f9044108200 2024-09-21T01:42:28.343 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.342+0000 7f9041ffb640 1 -- 172.21.15.83:0/3828098758 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90300047a0 con 0x7f9044108200 2024-09-21T01:42:28.344 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.342+0000 7f9049f9e640 1 -- 172.21.15.83:0/3828098758 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90441a6c40 con 0x7f9044108200 2024-09-21T01:42:28.345 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.345+0000 7f9041ffb640 1 -- 172.21.15.83:0/3828098758 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7f9030004020 con 0x7f9044108200 2024-09-21T01:42:28.346 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.346+0000 7f9041ffb640 1 --2- 172.21.15.83:0/3828098758 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f90340b6670 0x7f90340b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:42:28.347 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.346+0000 7f9051774740 1 Processor -- start 2024-09-21T01:42:28.347 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.346+0000 7f9048f9c640 1 --2- 172.21.15.83:0/3828098758 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f90340b6670 0x7f90340b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:42:28.347 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.346+0000 7f9051774740 1 -- start start 2024-09-21T01:42:28.347 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.346+0000 7f9041ffb640 1 -- 172.21.15.83:0/3828098758 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9315+0+0 (secure 0 0 0) 0x7f90300e7800 con 0x7f9044108200 2024-09-21T01:42:28.347 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.346+0000 7f9051774740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559e09e1e840 0x559e0a1c57e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:42:28.347 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.346+0000 7f9051774740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559e09df5980 0x559e0a1c5d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:42:28.348 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.346+0000 7f9051774740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x559e09dfdb60 0x559e0a1c6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:42:28.348 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.346+0000 7f9051774740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x559e0a13bb90 con 0x559e09dfdb60 2024-09-21T01:42:28.348 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.346+0000 7f9051774740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x559e0a12afc0 con 0x559e09e1e840 2024-09-21T01:42:28.348 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.346+0000 7f9051774740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x559e0a12edd0 con 0x559e09df5980 2024-09-21T01:42:28.348 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.346+0000 7f904979d640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x559e09dfdb60 0x559e0a1c6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:42:28.348 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.346+0000 7f904979d640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x559e09dfdb60 0x559e0a1c6260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:44522/0 (socket says 172.21.15.83:44522) 2024-09-21T01:42:28.348 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.346+0000 7f904979d640 1 -- 172.21.15.83:0/1474786229 learned_addr learned my addr 172.21.15.83:0/1474786229 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:42:28.348 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.347+0000 7f9043fff640 1 --2- 172.21.15.83:0/1474786229 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559e09df5980 0x559e0a1c5d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:42:28.348 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.347+0000 7f9048f9c640 1 --2- 172.21.15.83:0/1474786229 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559e09e1e840 0x559e0a1c57e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:42:28.348 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.347+0000 7f904979d640 1 -- 172.21.15.83:0/1474786229 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559e09df5980 msgr2=0x559e0a1c5d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:42:28.348 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.347+0000 7f904979d640 1 --2- 172.21.15.83:0/1474786229 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559e09df5980 0x559e0a1c5d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:42:28.348 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.347+0000 7f904979d640 1 -- 172.21.15.83:0/1474786229 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559e09e1e840 msgr2=0x559e0a1c57e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:42:28.348 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.347+0000 7f904979d640 1 --2- 172.21.15.83:0/1474786229 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559e09e1e840 0x559e0a1c57e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:42:28.349 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.347+0000 7f904979d640 1 -- 172.21.15.83:0/1474786229 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e0a0b2060 con 0x559e09dfdb60 2024-09-21T01:42:28.351 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.347+0000 7f9048f9c640 1 --2- 172.21.15.83:0/3828098758 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f90340b6670 0x7f90340b8b80 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f90380057c0 tx=0x7f90380058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:42:28.351 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.347+0000 7f904979d640 1 --2- 172.21.15.83:0/1474786229 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x559e09dfdb60 0x559e0a1c6260 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f903c008d40 tx=0x7f903c00e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a32e8b61fcca24e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:42:28.351 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.347+0000 7f902effd640 1 -- 172.21.15.83:0/1474786229 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f903c014070 con 0x559e09dfdb60 2024-09-21T01:42:28.351 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.347+0000 7f902effd640 1 -- 172.21.15.83:0/1474786229 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f903c004020 con 0x559e09dfdb60 2024-09-21T01:42:28.351 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.347+0000 7f902effd640 1 -- 172.21.15.83:0/1474786229 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f903c010690 con 0x559e09dfdb60 2024-09-21T01:42:28.351 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.348+0000 7f9051774740 1 -- 172.21.15.83:0/1474786229 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x559e09dfdb60 msgr2=0x559e0a1c6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:42:28.352 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.348+0000 7f9051774740 1 --2- 172.21.15.83:0/1474786229 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x559e09dfdb60 0x559e0a1c6260 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f903c008d40 tx=0x7f903c00e720 comp rx=0 tx=0).stop 2024-09-21T01:42:28.352 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.348+0000 7f9051774740 1 -- 172.21.15.83:0/1474786229 shutdown_connections 2024-09-21T01:42:28.352 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.348+0000 7f9051774740 1 --2- 172.21.15.83:0/1474786229 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x559e09dfdb60 0x559e0a1c6260 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:42:28.352 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.348+0000 7f9051774740 1 --2- 172.21.15.83:0/1474786229 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559e09df5980 0x559e0a1c5d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:42:28.352 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.349+0000 7f9051774740 1 --2- 172.21.15.83:0/1474786229 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559e09e1e840 0x559e0a1c57e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:42:28.352 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.349+0000 7f9051774740 1 -- 172.21.15.83:0/1474786229 >> 172.21.15.83:0/1474786229 conn(0x559e09e12990 msgr2=0x559e0a1c36d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:42:28.352 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.349+0000 7f9051774740 1 -- 172.21.15.83:0/1474786229 shutdown_connections 2024-09-21T01:42:28.352 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.349+0000 7f9051774740 1 -- 172.21.15.83:0/1474786229 wait complete. 2024-09-21T01:42:28.352 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.349+0000 7f9051774740 1 -- start start 2024-09-21T01:42:28.352 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.349+0000 7f9051774740 1 Processor -- start 2024-09-21T01:42:28.352 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.349+0000 7f9051774740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559e09df5980 0x559e0a1d1310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:42:28.352 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.350+0000 7f9051774740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559e09dfdb60 0x559e0a1d1850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:42:28.352 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.350+0000 7f9051774740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x559e09e1e840 0x559e0a1dd2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:42:28.352 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.350+0000 7f9051774740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x559e09f8c7a0 con 0x559e09e1e840 2024-09-21T01:42:28.353 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.350+0000 7f9051774740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x559e0a0d00a0 con 0x559e09df5980 2024-09-21T01:42:28.353 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.350+0000 7f9051774740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x559e0a1d3fc0 con 0x559e09dfdb60 2024-09-21T01:42:28.353 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.350+0000 7f9051774740 10 client.0 _ll_register_callbacks cb 0x559e0a0ad3c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:42:28.353 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.350+0000 7f904979d640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x559e09e1e840 0x559e0a1dd2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:42:28.353 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.350+0000 7f9043fff640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559e09dfdb60 0x559e0a1d1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:42:28.353 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.350+0000 7f9043fff640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559e09dfdb60 0x559e0a1d1850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.83:54642/0 (socket says 172.21.15.83:54642) 2024-09-21T01:42:28.353 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.350+0000 7f904979d640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x559e09e1e840 0x559e0a1dd2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:44526/0 (socket says 172.21.15.83:44526) 2024-09-21T01:42:28.353 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.350+0000 7f9043fff640 1 -- 172.21.15.83:0/3184910713 learned_addr learned my addr 172.21.15.83:0/3184910713 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:42:28.353 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.350+0000 7f9048f9c640 1 --2- 172.21.15.83:0/3184910713 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559e09df5980 0x559e0a1d1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:42:28.353 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.350+0000 7f904979d640 1 -- 172.21.15.83:0/3184910713 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559e09dfdb60 msgr2=0x559e0a1d1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:42:28.353 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.350+0000 7f904979d640 1 --2- 172.21.15.83:0/3184910713 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559e09dfdb60 0x559e0a1d1850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:42:28.353 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.350+0000 7f904979d640 1 -- 172.21.15.83:0/3184910713 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559e09df5980 msgr2=0x559e0a1d1310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:42:28.353 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.350+0000 7f904979d640 1 --2- 172.21.15.83:0/3184910713 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559e09df5980 0x559e0a1d1310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:42:28.353 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.350+0000 7f904979d640 1 -- 172.21.15.83:0/3184910713 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559e0a0be880 con 0x559e09e1e840 2024-09-21T01:42:28.353 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.350+0000 7f904979d640 1 --2- 172.21.15.83:0/3184910713 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x559e09e1e840 0x559e0a1dd2b0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f903c008d40 tx=0x7f903c005ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f30af460dc42ff0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:42:28.354 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.350+0000 7f9023fff640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-09-21T01:42:28.354 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.351+0000 7f9023fff640 1 -- 172.21.15.83:0/3184910713 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f903c014070 con 0x559e09e1e840 2024-09-21T01:42:28.354 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.351+0000 7f9023fff640 1 -- 172.21.15.83:0/3184910713 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9315+0+0 (secure 0 0 0) 0x7f903c003970 con 0x559e09e1e840 2024-09-21T01:42:28.354 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.351+0000 7f9051774740 1 -- 172.21.15.83:0/3184910713 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f903c004020 con 0x559e09e1e840 2024-09-21T01:42:28.354 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.351+0000 7f9023fff640 1 -- 172.21.15.83:0/3184910713 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f903c02d050 con 0x559e09e1e840 2024-09-21T01:42:28.354 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.351+0000 7f9051774740 10 client.15513 fetch_fsmap learned FSMap version 21 2024-09-21T01:42:28.354 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.351+0000 7f9051774740 1 -- 172.21.15.83:0/3184910713 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x559e09e98b90 con 0x559e09e1e840 2024-09-21T01:42:28.354 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.351+0000 7f9023fff640 1 -- 172.21.15.83:0/3184910713 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f903c004020 con 0x559e09e1e840 2024-09-21T01:42:28.356 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.351+0000 7f9023fff640 1 -- 172.21.15.83:0/3184910713 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f903c005710 con 0x559e09e1e840 2024-09-21T01:42:28.356 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.351+0000 7f9051774740 10 client.15513 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T01:42:28.356 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.351+0000 7f9051774740 10 client.15513 resolve_mds: validated gid 24653 aka daemon mds.b 2024-09-21T01:42:28.356 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.351+0000 7f9051774740 20 client.15513 populate_metadata read hostname 'smithi083' 2024-09-21T01:42:28.356 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.351+0000 7f9051774740 1 --2- 172.21.15.83:0/3184910713 >> [v2:172.21.15.119:6838/3106757092,v1:172.21.15.119:6839/3106757092] conn(0x559e09ddd1c0 0x559e0a1e3190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:42:28.356 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.351+0000 7f9051774740 4 client.15513 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:42:28.356 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.351+0000 7f9051774740 1 -- 172.21.15.83:0/3184910713 --> [v2:172.21.15.119:6838/3106757092,v1:172.21.15.119:6839/3106757092] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559e0a13dae0 con 0x559e09ddd1c0 2024-09-21T01:42:28.356 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.352+0000 7f9048f9c640 1 --2- 172.21.15.83:0/3184910713 >> [v2:172.21.15.119:6838/3106757092,v1:172.21.15.119:6839/3106757092] conn(0x559e09ddd1c0 0x559e0a1e3190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:42:28.356 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.352+0000 7f9023fff640 10 client.15513 ms_handle_connect on v2:172.21.15.119:6838/3106757092 2024-09-21T01:42:28.356 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.352+0000 7f9048f9c640 1 --2- 172.21.15.83:0/3184910713 >> [v2:172.21.15.119:6838/3106757092,v1:172.21.15.119:6839/3106757092] conn(0x559e09ddd1c0 0x559e0a1e3190 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8eb585c4a3ee963a server_cookie=3f9d00fdbae507f9 in_seq=0 out_seq=0 2024-09-21T01:42:28.356 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.353+0000 7f9023fff640 1 -- 172.21.15.83:0/3184910713 <== mds.0 v2:172.21.15.119:6838/3106757092 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559e0a13dae0 con 0x559e09ddd1c0 2024-09-21T01:42:28.356 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.353+0000 7f9023fff640 10 client.15513 handle_command_reply: tid=0 2024-09-21T01:42:28.356 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.353+0000 7f9051774740 1 client.15513 shutdown 2024-09-21T01:42:28.357 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.353+0000 7f9051774740 1 -- 172.21.15.83:0/3184910713 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x559e09e1e840 msgr2=0x559e0a1dd2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:42:28.357 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.353+0000 7f9051774740 1 --2- 172.21.15.83:0/3184910713 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x559e09e1e840 0x559e0a1dd2b0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f903c008d40 tx=0x7f903c005ad0 comp rx=0 tx=0).stop 2024-09-21T01:42:28.357 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.353+0000 7f9051774740 1 -- 172.21.15.83:0/3184910713 shutdown_connections 2024-09-21T01:42:28.357 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.353+0000 7f9051774740 1 --2- 172.21.15.83:0/3184910713 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x559e09e1e840 0x559e0a1dd2b0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:42:28.357 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.353+0000 7f9051774740 1 --2- 172.21.15.83:0/3184910713 >> [v2:172.21.15.119:6838/3106757092,v1:172.21.15.119:6839/3106757092] conn(0x559e09ddd1c0 0x559e0a1e3190 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:42:28.357 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.354+0000 7f9051774740 1 --2- 172.21.15.83:0/3184910713 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559e09dfdb60 0x559e0a1d1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:42:28.357 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.354+0000 7f9051774740 1 --2- 172.21.15.83:0/3184910713 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559e09df5980 0x559e0a1d1310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:42:28.357 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.354+0000 7f9051774740 1 -- 172.21.15.83:0/3184910713 >> 172.21.15.83:0/3184910713 conn(0x559e09e12990 msgr2=0x559e0a1c89c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:42:28.357 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.354+0000 7f9023fff640 0 client.15513 ms_handle_reset on v2:172.21.15.119:6838/3106757092 2024-09-21T01:42:28.357 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.354+0000 7f9051774740 1 -- 172.21.15.83:0/3184910713 shutdown_connections 2024-09-21T01:42:28.357 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.354+0000 7f9051774740 1 -- 172.21.15.83:0/3184910713 wait complete. 2024-09-21T01:42:28.357 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.354+0000 7f9051774740 20 client.15513 trim_cache size 0 max 16384 2024-09-21T01:42:28.372 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.371+0000 7f9051774740 1 Processor -- start 2024-09-21T01:42:28.372 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.371+0000 7f9051774740 1 -- start start 2024-09-21T01:42:28.372 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.372+0000 7f9051774740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559e09df5980 0x559e0a1ca8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:42:28.372 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.372+0000 7f9051774740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559e09dfdb60 0x559e0a1cae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:42:28.373 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.372+0000 7f9051774740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x559e09e1e840 0x559e0a1c88e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:42:28.373 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.372+0000 7f9051774740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f90441aeb10 con 0x559e09e1e840 2024-09-21T01:42:28.373 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.372+0000 7f9051774740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f90441b1390 con 0x559e09dfdb60 2024-09-21T01:42:28.373 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.372+0000 7f9051774740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f90441af180 con 0x559e09df5980 2024-09-21T01:42:28.373 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.372+0000 7f904979d640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x559e09e1e840 0x559e0a1c88e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:42:28.373 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.372+0000 7f904979d640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x559e09e1e840 0x559e0a1c88e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:44530/0 (socket says 172.21.15.83:44530) 2024-09-21T01:42:28.373 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.372+0000 7f904979d640 1 -- 172.21.15.83:0/412235331 learned_addr learned my addr 172.21.15.83:0/412235331 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:42:28.373 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.372+0000 7f9048f9c640 1 --2- 172.21.15.83:0/412235331 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559e09df5980 0x559e0a1ca8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:42:28.373 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.372+0000 7f9043fff640 1 --2- 172.21.15.83:0/412235331 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559e09dfdb60 0x559e0a1cae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:42:28.373 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.372+0000 7f904979d640 1 -- 172.21.15.83:0/412235331 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559e09df5980 msgr2=0x559e0a1ca8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:42:28.373 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.372+0000 7f904979d640 1 --2- 172.21.15.83:0/412235331 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559e09df5980 0x559e0a1ca8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:42:28.373 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.372+0000 7f904979d640 1 -- 172.21.15.83:0/412235331 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559e09dfdb60 msgr2=0x559e0a1cae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:42:28.373 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.372+0000 7f904979d640 1 --2- 172.21.15.83:0/412235331 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559e09dfdb60 0x559e0a1cae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:42:28.373 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.372+0000 7f904979d640 1 -- 172.21.15.83:0/412235331 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e0a1beed0 con 0x559e09e1e840 2024-09-21T01:42:28.373 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.372+0000 7f904979d640 1 --2- 172.21.15.83:0/412235331 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x559e09e1e840 0x559e0a1c88e0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f903c008ad0 tx=0x7f903c0109a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d4a92bee0a6ea61 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:42:28.374 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.372+0000 7f902e7fc640 1 -- 172.21.15.83:0/412235331 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f903c035020 con 0x559e09e1e840 2024-09-21T01:42:28.374 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.372+0000 7f902e7fc640 1 -- 172.21.15.83:0/412235331 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f903c0046e0 con 0x559e09e1e840 2024-09-21T01:42:28.375 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.372+0000 7f902e7fc640 1 -- 172.21.15.83:0/412235331 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f903c014070 con 0x559e09e1e840 2024-09-21T01:42:28.375 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.373+0000 7f9051774740 1 -- 172.21.15.83:0/412235331 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x559e09e1e840 msgr2=0x559e0a1c88e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:42:28.375 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.373+0000 7f9051774740 1 --2- 172.21.15.83:0/412235331 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x559e09e1e840 0x559e0a1c88e0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f903c008ad0 tx=0x7f903c0109a0 comp rx=0 tx=0).stop 2024-09-21T01:42:28.375 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.373+0000 7f9051774740 1 -- 172.21.15.83:0/412235331 shutdown_connections 2024-09-21T01:42:28.375 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.373+0000 7f9051774740 1 --2- 172.21.15.83:0/412235331 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x559e09e1e840 0x559e0a1c88e0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:42:28.375 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.373+0000 7f9051774740 1 --2- 172.21.15.83:0/412235331 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559e09dfdb60 0x559e0a1cae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:42:28.375 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.373+0000 7f9051774740 1 --2- 172.21.15.83:0/412235331 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559e09df5980 0x559e0a1ca8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:42:28.375 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.373+0000 7f9051774740 1 -- 172.21.15.83:0/412235331 >> 172.21.15.83:0/412235331 conn(0x559e09e12990 msgr2=0x559e0a1cf990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:42:28.375 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.373+0000 7f9051774740 1 -- 172.21.15.83:0/412235331 shutdown_connections 2024-09-21T01:42:28.375 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.374+0000 7f9051774740 1 -- 172.21.15.83:0/412235331 wait complete. 2024-09-21T01:42:28.375 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.374+0000 7f9051774740 1 -- start start 2024-09-21T01:42:28.375 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.374+0000 7f9051774740 1 Processor -- start 2024-09-21T01:42:28.377 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.375+0000 7f9051774740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x559e09df5980 0x559e0a1e6730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:42:28.377 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.375+0000 7f9051774740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559e09dfdb60 0x559e0a1e4c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:42:28.377 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.375+0000 7f9051774740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559e09e1e840 0x559e0a1e5150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:42:28.377 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.375+0000 7f9051774740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f90441af850 con 0x559e09df5980 2024-09-21T01:42:28.378 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.375+0000 7f9051774740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f90441b0cc0 con 0x559e09e1e840 2024-09-21T01:42:28.378 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.375+0000 7f9051774740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f90441aff20 con 0x559e09dfdb60 2024-09-21T01:42:28.378 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.375+0000 7f9051774740 10 client.0 _ll_register_callbacks cb 0x7f90300050c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:42:28.378 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.375+0000 7f9048f9c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x559e09df5980 0x559e0a1e6730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:42:28.378 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.375+0000 7f9048f9c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x559e09df5980 0x559e0a1e6730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:44538/0 (socket says 172.21.15.83:44538) 2024-09-21T01:42:28.378 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.375+0000 7f9048f9c640 1 -- 172.21.15.83:0/1265341443 learned_addr learned my addr 172.21.15.83:0/1265341443 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:42:28.378 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.375+0000 7f9043fff640 1 --2- 172.21.15.83:0/1265341443 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559e09dfdb60 0x559e0a1e4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:42:28.378 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.375+0000 7f9048f9c640 1 -- 172.21.15.83:0/1265341443 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559e09dfdb60 msgr2=0x559e0a1e4c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:42:28.378 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.375+0000 7f9048f9c640 1 --2- 172.21.15.83:0/1265341443 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559e09dfdb60 0x559e0a1e4c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:42:28.378 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.375+0000 7f9048f9c640 1 -- 172.21.15.83:0/1265341443 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559e09e1e840 msgr2=0x559e0a1e5150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:42:28.378 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.375+0000 7f904979d640 1 --2- 172.21.15.83:0/1265341443 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559e09e1e840 0x559e0a1e5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:42:28.378 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.375+0000 7f9048f9c640 1 --2- 172.21.15.83:0/1265341443 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559e09e1e840 0x559e0a1e5150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:42:28.378 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.375+0000 7f9048f9c640 1 -- 172.21.15.83:0/1265341443 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559e0a1e5690 con 0x559e09df5980 2024-09-21T01:42:28.378 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.375+0000 7f904979d640 1 --2- 172.21.15.83:0/1265341443 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559e09e1e840 0x559e0a1e5150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:42:28.379 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.375+0000 7f9048f9c640 1 --2- 172.21.15.83:0/1265341443 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x559e09df5980 0x559e0a1e6730 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f9038009850 tx=0x7f903803e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33ac2df10b4852f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:42:28.379 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.375+0000 7f9023fff640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-09-21T01:42:28.379 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.375+0000 7f9023fff640 1 -- 172.21.15.83:0/1265341443 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9038035050 con 0x559e09df5980 2024-09-21T01:42:28.379 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.376+0000 7f9023fff640 1 -- 172.21.15.83:0/1265341443 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9315+0+0 (secure 0 0 0) 0x7f9038003a00 con 0x559e09df5980 2024-09-21T01:42:28.379 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.376+0000 7f9051774740 1 -- 172.21.15.83:0/1265341443 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f903c0046e0 con 0x559e09df5980 2024-09-21T01:42:28.379 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.376+0000 7f9023fff640 1 -- 172.21.15.83:0/1265341443 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f9038003c00 con 0x559e09df5980 2024-09-21T01:42:28.379 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.376+0000 7f9051774740 10 client.15519 fetch_fsmap learned FSMap version 21 2024-09-21T01:42:28.379 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.376+0000 7f9051774740 1 -- 172.21.15.83:0/1265341443 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x559e0a24e5f0 con 0x559e09df5980 2024-09-21T01:42:28.379 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.376+0000 7f9023fff640 1 -- 172.21.15.83:0/1265341443 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f903c0046e0 con 0x559e09df5980 2024-09-21T01:42:28.379 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.376+0000 7f9023fff640 1 -- 172.21.15.83:0/1265341443 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f903803c440 con 0x559e09df5980 2024-09-21T01:42:28.379 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.376+0000 7f9051774740 10 client.15519 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T01:42:28.379 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.376+0000 7f9051774740 10 client.15519 resolve_mds: validated gid 24653 aka daemon mds.b 2024-09-21T01:42:28.379 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.376+0000 7f9051774740 20 client.15519 populate_metadata read hostname 'smithi083' 2024-09-21T01:42:28.379 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.376+0000 7f9051774740 1 --2- 172.21.15.83:0/1265341443 >> [v2:172.21.15.119:6838/3106757092,v1:172.21.15.119:6839/3106757092] conn(0x559e09db2570 0x559e0a250dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:42:28.379 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.376+0000 7f9051774740 4 client.15519 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 134.5, "await_for": 45.0}] 2024-09-21T01:42:28.380 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.376+0000 7f9051774740 1 -- 172.21.15.83:0/1265341443 --> [v2:172.21.15.119:6838/3106757092,v1:172.21.15.119:6839/3106757092] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 134.5, "await_for": 45.0}) -- 0x559e0a139590 con 0x559e09db2570 2024-09-21T01:42:28.380 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.376+0000 7f9043fff640 1 --2- 172.21.15.83:0/1265341443 >> [v2:172.21.15.119:6838/3106757092,v1:172.21.15.119:6839/3106757092] conn(0x559e09db2570 0x559e0a250dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:42:28.380 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.377+0000 7f9043fff640 1 --2- 172.21.15.83:0/1265341443 >> [v2:172.21.15.119:6838/3106757092,v1:172.21.15.119:6839/3106757092] conn(0x559e09db2570 0x559e0a250dd0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=630bb88620d19693 server_cookie=2f1b35438a1fa3a1 in_seq=0 out_seq=0 2024-09-21T01:42:28.380 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.377+0000 7f9023fff640 10 client.15519 ms_handle_connect on v2:172.21.15.119:6838/3106757092 2024-09-21T01:42:28.384 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.383+0000 7f9023fff640 1 -- 172.21.15.83:0/1265341443 <== mds.0 v2:172.21.15.119:6838/3106757092 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x559e0a139590 con 0x559e09db2570 2024-09-21T01:42:28.384 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.383+0000 7f9023fff640 10 client.15519 handle_command_reply: tid=0 2024-09-21T01:42:28.384 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.383+0000 7f9051774740 1 client.15519 shutdown 2024-09-21T01:42:28.384 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.383+0000 7f9051774740 1 -- 172.21.15.83:0/1265341443 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x559e09df5980 msgr2=0x559e0a1e6730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:42:28.384 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.383+0000 7f9051774740 1 --2- 172.21.15.83:0/1265341443 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x559e09df5980 0x559e0a1e6730 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f9038009850 tx=0x7f903803e070 comp rx=0 tx=0).stop 2024-09-21T01:42:28.384 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.383+0000 7f9051774740 1 -- 172.21.15.83:0/1265341443 shutdown_connections 2024-09-21T01:42:28.384 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.383+0000 7f9051774740 1 --2- 172.21.15.83:0/1265341443 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x559e09e1e840 0x559e0a1e5150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:42:28.385 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.383+0000 7f9051774740 1 --2- 172.21.15.83:0/1265341443 >> [v2:172.21.15.119:6838/3106757092,v1:172.21.15.119:6839/3106757092] conn(0x559e09db2570 0x559e0a250dd0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:42:28.385 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.383+0000 7f9051774740 1 --2- 172.21.15.83:0/1265341443 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559e09dfdb60 0x559e0a1e4c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:42:28.385 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.383+0000 7f9051774740 1 --2- 172.21.15.83:0/1265341443 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x559e09df5980 0x559e0a1e6730 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:42:28.385 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.384+0000 7f9051774740 1 -- 172.21.15.83:0/1265341443 >> 172.21.15.83:0/1265341443 conn(0x559e09e12990 msgr2=0x559e0a1c88b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:42:28.385 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.384+0000 7f9023fff640 0 client.15519 ms_handle_reset on v2:172.21.15.119:6838/3106757092 2024-09-21T01:42:28.385 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.384+0000 7f9051774740 1 -- 172.21.15.83:0/1265341443 shutdown_connections 2024-09-21T01:42:28.385 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.384+0000 7f9051774740 1 -- 172.21.15.83:0/1265341443 wait complete. 2024-09-21T01:42:28.385 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.384+0000 7f9051774740 20 client.15519 trim_cache size 0 max 16384 2024-09-21T01:42:28.385 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-09-21T01:42:28.385 INFO:teuthology.orchestra.run.smithi083.stdout: "epoch": 21, 2024-09-21T01:42:28.385 INFO:teuthology.orchestra.run.smithi083.stdout: "leader": 24653, 2024-09-21T01:42:28.386 INFO:teuthology.orchestra.run.smithi083.stdout: "set_version": 2, 2024-09-21T01:42:28.386 INFO:teuthology.orchestra.run.smithi083.stdout: "sets": { 2024-09-21T01:42:28.386 INFO:teuthology.orchestra.run.smithi083.stdout: "a6e72891": { 2024-09-21T01:42:28.386 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 2, 2024-09-21T01:42:28.386 INFO:teuthology.orchestra.run.smithi083.stdout: "age_ref": 0.0, 2024-09-21T01:42:28.386 INFO:teuthology.orchestra.run.smithi083.stdout: "state": { 2024-09-21T01:42:28.386 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "QUIESCED", 2024-09-21T01:42:28.386 INFO:teuthology.orchestra.run.smithi083.stdout: "age": 0.0 2024-09-21T01:42:28.386 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:42:28.386 INFO:teuthology.orchestra.run.smithi083.stdout: "timeout": 90.0, 2024-09-21T01:42:28.386 INFO:teuthology.orchestra.run.smithi083.stdout: "expiration": 134.5, 2024-09-21T01:42:28.386 INFO:teuthology.orchestra.run.smithi083.stdout: "members": { 2024-09-21T01:42:28.386 INFO:teuthology.orchestra.run.smithi083.stdout: "file:/": { 2024-09-21T01:42:28.386 INFO:teuthology.orchestra.run.smithi083.stdout: "excluded": false, 2024-09-21T01:42:28.386 INFO:teuthology.orchestra.run.smithi083.stdout: "state": { 2024-09-21T01:42:28.387 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "QUIESCED", 2024-09-21T01:42:28.387 INFO:teuthology.orchestra.run.smithi083.stdout: "age": 0.0 2024-09-21T01:42:28.387 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:42:28.387 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:42:28.387 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:42:28.387 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:42:28.387 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:42:28.387 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-09-21T01:42:28.388 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.384+0000 7f9049f9e640 1 -- 172.21.15.83:0/3828098758 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f90340b6670 msgr2=0x7f90340b8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:42:28.388 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.384+0000 7f9049f9e640 1 --2- 172.21.15.83:0/3828098758 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f90340b6670 0x7f90340b8b80 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f90380057c0 tx=0x7f90380058d0 comp rx=0 tx=0).stop 2024-09-21T01:42:28.388 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.384+0000 7f9049f9e640 1 -- 172.21.15.83:0/3828098758 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9044108200 msgr2=0x7f904419a820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:42:28.388 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.384+0000 7f9049f9e640 1 --2- 172.21.15.83:0/3828098758 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9044108200 0x7f904419a820 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f903000d950 tx=0x7f903000de10 comp rx=0 tx=0).stop 2024-09-21T01:42:28.388 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.385+0000 7f9049f9e640 1 -- 172.21.15.83:0/3828098758 shutdown_connections 2024-09-21T01:42:28.388 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.385+0000 7f9049f9e640 1 --2- 172.21.15.83:0/3828098758 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f90340b6670 0x7f90340b8b80 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:42:28.388 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.385+0000 7f9049f9e640 1 --2- 172.21.15.83:0/3828098758 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9044108b50 0x7f904419fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:42:28.388 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.385+0000 7f9049f9e640 1 --2- 172.21.15.83:0/3828098758 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9044108200 0x7f904419a820 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:42:28.388 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.385+0000 7f9049f9e640 1 --2- 172.21.15.83:0/3828098758 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f90441028c0 0x7f904419a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:42:28.388 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.385+0000 7f9049f9e640 1 -- 172.21.15.83:0/3828098758 >> 172.21.15.83:0/3828098758 conn(0x7f90440fe330 msgr2=0x7f90441013c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:42:28.388 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.385+0000 7f9049f9e640 1 -- 172.21.15.83:0/3828098758 shutdown_connections 2024-09-21T01:42:28.388 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:28.385+0000 7f9049f9e640 1 -- 172.21.15.83:0/3828098758 wait complete. 2024-09-21T01:42:29.053 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:42:28 smithi083 ceph-mon[31370]: pgmap v352: 129 pgs: 129 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 767 B/s wr, 1 op/s 2024-09-21T01:42:29.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:42:28 smithi142 ceph-mon[34050]: pgmap v352: 129 pgs: 129 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 767 B/s wr, 1 op/s 2024-09-21T01:42:29.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:42:28 smithi119 ceph-mon[33693]: pgmap v352: 129 pgs: 129 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 767 B/s wr, 1 op/s 2024-09-21T01:42:29.221 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'a6e72891', quiesce took 3.5 seconds. Will release after: 11.0 2024-09-21T01:42:32.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:42:31 smithi142 ceph-mon[34050]: pgmap v353: 129 pgs: 129 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 767 B/s wr, 2 op/s 2024-09-21T01:42:32.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:42:31 smithi119 ceph-mon[33693]: pgmap v353: 129 pgs: 129 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 767 B/s wr, 2 op/s 2024-09-21T01:42:32.257 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:42:31 smithi083 ceph-mon[31370]: pgmap v353: 129 pgs: 129 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 767 B/s wr, 2 op/s 2024-09-21T01:42:34.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:42:33 smithi142 ceph-mon[34050]: pgmap v354: 129 pgs: 129 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 0 B/s wr, 1 op/s 2024-09-21T01:42:34.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:42:33 smithi119 ceph-mon[33693]: pgmap v354: 129 pgs: 129 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 0 B/s wr, 1 op/s 2024-09-21T01:42:34.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:42:33 smithi083 ceph-mon[31370]: pgmap v354: 129 pgs: 129 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 0 B/s wr, 1 op/s 2024-09-21T01:42:36.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:42:35 smithi142 ceph-mon[34050]: pgmap v355: 129 pgs: 129 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 0 B/s wr, 2 op/s 2024-09-21T01:42:36.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:42:35 smithi119 ceph-mon[33693]: pgmap v355: 129 pgs: 129 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 0 B/s wr, 2 op/s 2024-09-21T01:42:36.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:42:35 smithi083 ceph-mon[31370]: pgmap v355: 129 pgs: 129 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 0 B/s wr, 2 op/s 2024-09-21T01:42:38.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:42:37 smithi142 ceph-mon[34050]: pgmap v356: 129 pgs: 129 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 0 B/s wr, 1 op/s 2024-09-21T01:42:38.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:42:37 smithi119 ceph-mon[33693]: pgmap v356: 129 pgs: 129 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 0 B/s wr, 1 op/s 2024-09-21T01:42:38.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:42:37 smithi083 ceph-mon[31370]: pgmap v356: 129 pgs: 129 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 0 B/s wr, 1 op/s 2024-09-21T01:42:40.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:42:39 smithi142 ceph-mon[34050]: pgmap v357: 129 pgs: 129 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 0 B/s wr, 1 op/s 2024-09-21T01:42:40.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:42:39 smithi119 ceph-mon[33693]: pgmap v357: 129 pgs: 129 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 0 B/s wr, 1 op/s 2024-09-21T01:42:40.222 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T01:42:40.246 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:42:39 smithi083 ceph-mon[31370]: pgmap v357: 129 pgs: 129 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 0 B/s wr, 1 op/s 2024-09-21T01:42:40.529 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:42:41.029 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:41.013+0000 7f2e7ae3c640 1 -- 172.21.15.83:0/3114313146 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2e74108cf0 msgr2=0x7f2e7410f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:42:41.030 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:41.013+0000 7f2e7ae3c640 1 --2- 172.21.15.83:0/3114313146 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2e74108cf0 0x7f2e7410f520 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f2e6c009ca0 tx=0x7f2e6c02a8c0 comp rx=0 tx=0).stop 2024-09-21T01:42:41.030 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:41.013+0000 7f2e7ae3c640 1 -- 172.21.15.83:0/3114313146 shutdown_connections 2024-09-21T01:42:41.030 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:41.013+0000 7f2e7ae3c640 1 --2- 172.21.15.83:0/3114313146 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2e74108cf0 0x7f2e7410f520 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:42:41.030 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:41.013+0000 7f2e7ae3c640 1 --2- 172.21.15.83:0/3114313146 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2e741083a0 0x7f2e741087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:42:41.030 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:41.013+0000 7f2e7ae3c640 1 --2- 172.21.15.83:0/3114313146 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2e74102a60 0x7f2e74102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:42:41.030 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:41.013+0000 7f2e7ae3c640 1 -- 172.21.15.83:0/3114313146 >> 172.21.15.83:0/3114313146 conn(0x7f2e74079730 msgr2=0x7f2e74079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:42:41.030 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:41.013+0000 7f2e7ae3c640 1 -- 172.21.15.83:0/3114313146 shutdown_connections 2024-09-21T01:42:41.030 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:41.013+0000 7f2e7ae3c640 1 -- 172.21.15.83:0/3114313146 wait complete. 2024-09-21T01:42:41.030 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:41.014+0000 7f2e7ae3c640 1 Processor -- start 2024-09-21T01:42:41.030 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:41.014+0000 7f2e7ae3c640 1 -- start start 2024-09-21T01:42:41.030 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:41.014+0000 7f2e7ae3c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2e74102a60 0x7f2e74110240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:42:41.031 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:41.014+0000 7f2e7ae3c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2e741083a0 0x7f2e74110780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:42:41.031 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:41.014+0000 7f2e7ae3c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2e74108cf0 0x7f2e74110cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:42:41.031 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:41.014+0000 7f2e7ae3c640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f2e74113960 con 0x7f2e74102a60 2024-09-21T01:42:41.031 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:41.014+0000 7f2e7ae3c640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f2e741137e0 con 0x7f2e741083a0 2024-09-21T01:42:41.031 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:41.014+0000 7f2e7ae3c640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f2e74113ae0 con 0x7f2e74108cf0 2024-09-21T01:42:41.031 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:41.014+0000 7f2e78bd8640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2e74102a60 0x7f2e74110240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:42:41.031 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:41.014+0000 7f2e78bd8640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2e74102a60 0x7f2e74110240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:39144/0 (socket says 172.21.15.83:39144) 2024-09-21T01:42:41.031 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:41.014+0000 7f2e78bd8640 1 -- 172.21.15.83:0/1692000257 learned_addr learned my addr 172.21.15.83:0/1692000257 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:42:41.031 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:41.015+0000 7f2e73fff640 1 --2- 172.21.15.83:0/1692000257 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2e741083a0 0x7f2e74110780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:42:41.031 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:41.015+0000 7f2e793d9640 1 --2- 172.21.15.83:0/1692000257 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2e74108cf0 0x7f2e74110cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:42:41.031 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:41.015+0000 7f2e78bd8640 1 -- 172.21.15.83:0/1692000257 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2e74108cf0 msgr2=0x7f2e74110cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:42:41.031 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:41.015+0000 7f2e78bd8640 1 --2- 172.21.15.83:0/1692000257 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2e74108cf0 0x7f2e74110cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:42:41.031 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:41.015+0000 7f2e78bd8640 1 -- 172.21.15.83:0/1692000257 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2e741083a0 msgr2=0x7f2e74110780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:42:41.031 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:41.015+0000 7f2e78bd8640 1 --2- 172.21.15.83:0/1692000257 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2e741083a0 0x7f2e74110780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:42:41.031 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:41.015+0000 7f2e78bd8640 1 -- 172.21.15.83:0/1692000257 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e741a86b0 con 0x7f2e74102a60 2024-09-21T01:42:41.032 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:41.015+0000 7f2e78bd8640 1 --2- 172.21.15.83:0/1692000257 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2e74102a60 0x7f2e74110240 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f2e6800e9f0 tx=0x7f2e6800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:42:41.032 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:41.015+0000 7f2e71ffb640 1 -- 172.21.15.83:0/1692000257 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e6800cd80 con 0x7f2e74102a60 2024-09-21T01:42:41.032 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:41.015+0000 7f2e7ae3c640 1 -- 172.21.15.83:0/1692000257 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e741a89a0 con 0x7f2e74102a60 2024-09-21T01:42:41.032 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:41.015+0000 7f2e71ffb640 1 -- 172.21.15.83:0/1692000257 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2e680054b0 con 0x7f2e74102a60 2024-09-21T01:42:41.032 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:41.015+0000 7f2e71ffb640 1 -- 172.21.15.83:0/1692000257 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e68010430 con 0x7f2e74102a60 2024-09-21T01:42:41.032 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:41.016+0000 7f2e7ae3c640 1 -- 172.21.15.83:0/1692000257 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e741a8ee0 con 0x7f2e74102a60 2024-09-21T01:42:41.032 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:41.018+0000 7f2e7ae3c640 1 -- 172.21.15.83:0/1692000257 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e74102e70 con 0x7f2e74102a60 2024-09-21T01:42:41.032 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:41.019+0000 7f2e71ffb640 1 -- 172.21.15.83:0/1692000257 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7f2e680046c0 con 0x7f2e74102a60 2024-09-21T01:42:41.032 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:41.020+0000 7f2e71ffb640 1 --2- 172.21.15.83:0/1692000257 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f2e640b6680 0x7f2e640b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:42:41.032 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:41.020+0000 7f2e71ffb640 1 -- 172.21.15.83:0/1692000257 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9315+0+0 (secure 0 0 0) 0x7f2e680e7fb0 con 0x7f2e74102a60 2024-09-21T01:42:41.032 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:41.021+0000 7f2e73fff640 1 --2- 172.21.15.83:0/1692000257 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f2e640b6680 0x7f2e640b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:42:41.032 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:41.021+0000 7f2e73fff640 1 --2- 172.21.15.83:0/1692000257 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f2e640b6680 0x7f2e640b8b90 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f2e74105f10 tx=0x7f2e60005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:42:41.032 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:41.028+0000 7f2e71ffb640 1 -- 172.21.15.83:0/1692000257 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2e680ae1e0 con 0x7f2e74102a60 2024-09-21T01:42:41.339 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:41.339+0000 7f2e7ae3c640 1 -- 172.21.15.83:0/1692000257 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2e7410ab40 con 0x7f2e74102a60 2024-09-21T01:42:41.340 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:41.340+0000 7f2e71ffb640 1 -- 172.21.15.83:0/1692000257 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11857 (secure 0 0 0) 0x7f2e680b25c0 con 0x7f2e74102a60 2024-09-21T01:42:41.341 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T01:42:41.341 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":21,"btime":"2024-09-21T01:40:27:947059+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14775,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6835/1105040204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":1105040204},{"type":"v1","addr":"172.21.15.83:6835","nonce":1105040204}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14787,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/2234789563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6836","nonce":2234789563},{"type":"v1","addr":"172.21.15.83:6837","nonce":2234789563}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14838,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6839/136258364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6838","nonce":136258364},{"type":"v1","addr":"172.21.15.83:6839","nonce":136258364}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14850,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6841/129439444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6840","nonce":129439444},{"type":"v1","addr":"172.21.15.83:6841","nonce":129439444}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24569,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/2839502433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":2839502433},{"type":"v1","addr":"172.21.15.119:6833","nonce":2839502433}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24580,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6833/2841606990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":2841606990},{"type":"v1","addr":"172.21.15.142:6833","nonce":2841606990}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24599,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/415902608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":415902608},{"type":"v1","addr":"172.21.15.119:6835","nonce":415902608}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24607,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/3009088510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":3009088510},{"type":"v1","addr":"172.21.15.142:6835","nonce":3009088510}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24613,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/3847200126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6836","nonce":3847200126},{"type":"v1","addr":"172.21.15.142:6837","nonce":3847200126}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24626,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/3619222976","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":3619222976},{"type":"v1","addr":"172.21.15.119:6837","nonce":3619222976}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T01:39:45.145124+0000","modified":"2024-09-21T01:40:27.664151+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24653},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24631":{"gid":24631,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.142:6839/1817880741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6838","nonce":1817880741},{"type":"v1","addr":"172.21.15.142:6839","nonce":1817880741}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24653":{"gid":24653,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.119:6839/3106757092","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":3106757092},{"type":"v1","addr":"172.21.15.119:6839","nonce":3106757092}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24653,"qdb_cluster":[24653]},"id":1}]} 2024-09-21T01:42:41.341 INFO:teuthology.orchestra.run.smithi083.stderr:dumped fsmap epoch 21 2024-09-21T01:42:41.344 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:41.343+0000 7f2e7ae3c640 1 -- 172.21.15.83:0/1692000257 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f2e640b6680 msgr2=0x7f2e640b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:42:41.344 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:41.343+0000 7f2e7ae3c640 1 --2- 172.21.15.83:0/1692000257 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f2e640b6680 0x7f2e640b8b90 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f2e74105f10 tx=0x7f2e60005f90 comp rx=0 tx=0).stop 2024-09-21T01:42:41.344 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:41.343+0000 7f2e7ae3c640 1 -- 172.21.15.83:0/1692000257 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2e74102a60 msgr2=0x7f2e74110240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:42:41.344 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:41.343+0000 7f2e7ae3c640 1 --2- 172.21.15.83:0/1692000257 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2e74102a60 0x7f2e74110240 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f2e6800e9f0 tx=0x7f2e6800edf0 comp rx=0 tx=0).stop 2024-09-21T01:42:41.344 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:41.343+0000 7f2e7ae3c640 1 -- 172.21.15.83:0/1692000257 shutdown_connections 2024-09-21T01:42:41.344 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:41.343+0000 7f2e7ae3c640 1 --2- 172.21.15.83:0/1692000257 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f2e640b6680 0x7f2e640b8b90 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:42:41.344 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:41.343+0000 7f2e7ae3c640 1 --2- 172.21.15.83:0/1692000257 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2e74108cf0 0x7f2e74110cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:42:41.344 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:41.343+0000 7f2e7ae3c640 1 --2- 172.21.15.83:0/1692000257 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2e741083a0 0x7f2e74110780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:42:41.344 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:41.343+0000 7f2e7ae3c640 1 --2- 172.21.15.83:0/1692000257 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2e74102a60 0x7f2e74110240 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:42:41.344 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:41.343+0000 7f2e7ae3c640 1 -- 172.21.15.83:0/1692000257 >> 172.21.15.83:0/1692000257 conn(0x7f2e74079730 msgr2=0x7f2e74104410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:42:41.344 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:41.343+0000 7f2e7ae3c640 1 -- 172.21.15.83:0/1692000257 shutdown_connections 2024-09-21T01:42:41.344 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:41.343+0000 7f2e7ae3c640 1 -- 172.21.15.83:0/1692000257 wait complete. 2024-09-21T01:42:42.052 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:42:41 smithi083 ceph-mon[31370]: pgmap v358: 129 pgs: 129 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 0 B/s wr, 2 op/s 2024-09-21T01:42:42.052 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:42:41 smithi083 ceph-mon[31370]: from='client.? 172.21.15.83:0/1692000257' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:42:42.080 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24653 quiesce db --set-id a6e72891 --release --await' 2024-09-21T01:42:42.080 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24653 quiesce db --set-id a6e72891 --release --await 2024-09-21T01:42:42.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:42:41 smithi142 ceph-mon[34050]: pgmap v358: 129 pgs: 129 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 0 B/s wr, 2 op/s 2024-09-21T01:42:42.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:42:41 smithi142 ceph-mon[34050]: from='client.? 172.21.15.83:0/1692000257' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:42:42.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:42:41 smithi119 ceph-mon[33693]: pgmap v358: 129 pgs: 129 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 0 B/s wr, 2 op/s 2024-09-21T01:42:42.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:42:41 smithi119 ceph-mon[33693]: from='client.? 172.21.15.83:0/1692000257' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:42:42.447 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:42:42.958 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.952+0000 7f3db2926640 1 -- 172.21.15.83:0/1267952831 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3dac1083a0 msgr2=0x7f3dac1087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:42:42.958 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.952+0000 7f3db2926640 1 --2- 172.21.15.83:0/1267952831 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3dac1083a0 0x7f3dac1087b0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f3da0009900 tx=0x7f3da002a410 comp rx=0 tx=0).stop 2024-09-21T01:42:42.958 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.953+0000 7f3db2926640 1 -- 172.21.15.83:0/1267952831 shutdown_connections 2024-09-21T01:42:42.958 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.953+0000 7f3db2926640 1 --2- 172.21.15.83:0/1267952831 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3dac108cf0 0x7f3dac10f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:42:42.958 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.953+0000 7f3db2926640 1 --2- 172.21.15.83:0/1267952831 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3dac1083a0 0x7f3dac1087b0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:42:42.959 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.953+0000 7f3db2926640 1 --2- 172.21.15.83:0/1267952831 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3dac102a60 0x7f3dac102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:42:42.959 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.953+0000 7f3db2926640 1 -- 172.21.15.83:0/1267952831 >> 172.21.15.83:0/1267952831 conn(0x7f3dac079730 msgr2=0x7f3dac079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:42:42.959 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.953+0000 7f3db2926640 1 -- 172.21.15.83:0/1267952831 shutdown_connections 2024-09-21T01:42:42.959 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.953+0000 7f3db2926640 1 -- 172.21.15.83:0/1267952831 wait complete. 2024-09-21T01:42:42.959 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.953+0000 7f3db2926640 1 Processor -- start 2024-09-21T01:42:42.959 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.954+0000 7f3db2926640 1 -- start start 2024-09-21T01:42:42.959 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.954+0000 7f3db2926640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3dac102a60 0x7f3dac19a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:42:42.959 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.954+0000 7f3db2926640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3dac1083a0 0x7f3dac19aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:42:42.959 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.954+0000 7f3db2926640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3dac108cf0 0x7f3dac19fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:42:42.959 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.954+0000 7f3db2926640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f3dac113930 con 0x7f3dac1083a0 2024-09-21T01:42:42.959 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.954+0000 7f3db2926640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f3dac1137b0 con 0x7f3dac102a60 2024-09-21T01:42:42.959 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.954+0000 7f3db2926640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f3dac113ab0 con 0x7f3dac108cf0 2024-09-21T01:42:42.959 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.954+0000 7f3dab7fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3dac1083a0 0x7f3dac19aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:42:42.959 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.954+0000 7f3dab7fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3dac1083a0 0x7f3dac19aa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:39162/0 (socket says 172.21.15.83:39162) 2024-09-21T01:42:42.959 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.954+0000 7f3dab7fe640 1 -- 172.21.15.83:0/3902804591 learned_addr learned my addr 172.21.15.83:0/3902804591 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:42:42.960 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.955+0000 7f3dabfff640 1 --2- 172.21.15.83:0/3902804591 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3dac102a60 0x7f3dac19a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:42:42.960 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.955+0000 7f3dab7fe640 1 -- 172.21.15.83:0/3902804591 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3dac108cf0 msgr2=0x7f3dac19fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:42:42.960 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.955+0000 7f3dab7fe640 1 --2- 172.21.15.83:0/3902804591 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3dac108cf0 0x7f3dac19fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:42:42.960 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.955+0000 7f3dab7fe640 1 -- 172.21.15.83:0/3902804591 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3dac102a60 msgr2=0x7f3dac19a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:42:42.960 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.955+0000 7f3dab7fe640 1 --2- 172.21.15.83:0/3902804591 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3dac102a60 0x7f3dac19a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:42:42.960 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.955+0000 7f3dab7fe640 1 -- 172.21.15.83:0/3902804591 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3dac1a0450 con 0x7f3dac1083a0 2024-09-21T01:42:42.960 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.955+0000 7f3dab7fe640 1 --2- 172.21.15.83:0/3902804591 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3dac1083a0 0x7f3dac19aa80 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f3da0005940 tx=0x7f3da0004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:42:42.960 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.955+0000 7f3da97fa640 1 -- 172.21.15.83:0/3902804591 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3da003f030 con 0x7f3dac1083a0 2024-09-21T01:42:42.960 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.955+0000 7f3db2926640 1 -- 172.21.15.83:0/3902804591 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3dac1a06e0 con 0x7f3dac1083a0 2024-09-21T01:42:42.960 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.955+0000 7f3da97fa640 1 -- 172.21.15.83:0/3902804591 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3da0004440 con 0x7f3dac1083a0 2024-09-21T01:42:42.960 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.955+0000 7f3da97fa640 1 -- 172.21.15.83:0/3902804591 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3da0035070 con 0x7f3dac1083a0 2024-09-21T01:42:42.960 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.955+0000 7f3db2926640 1 -- 172.21.15.83:0/3902804591 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3dac1a6ea0 con 0x7f3dac1083a0 2024-09-21T01:42:42.961 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.960+0000 7f3da97fa640 1 -- 172.21.15.83:0/3902804591 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7f3da0042030 con 0x7f3dac1083a0 2024-09-21T01:42:42.961 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.960+0000 7f3db8e9a740 1 Processor -- start 2024-09-21T01:42:42.961 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.960+0000 7f3db8e9a740 1 -- start start 2024-09-21T01:42:42.961 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.961+0000 7f3db8e9a740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5629e171d520 0x5629e1ac3510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:42:42.961 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.961+0000 7f3db8e9a740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5629e16f4660 0x5629e1ac3a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:42:42.961 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.961+0000 7f3db8e9a740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5629e16fc840 0x5629e1ac3f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:42:42.962 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.961+0000 7f3db8e9a740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x5629e19aedc0 con 0x5629e171d520 2024-09-21T01:42:42.962 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.961+0000 7f3db8e9a740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5629e1a3b1f0 con 0x5629e16fc840 2024-09-21T01:42:42.962 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.961+0000 7f3db8e9a740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x5629e1a2a620 con 0x5629e16f4660 2024-09-21T01:42:42.962 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.961+0000 7f3dabfff640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5629e16f4660 0x5629e1ac3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:42:42.963 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.961+0000 7f3db0ec3640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5629e171d520 0x5629e1ac3510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:42:42.963 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.961+0000 7f3dabfff640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5629e16f4660 0x5629e1ac3a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.83:56868/0 (socket says 172.21.15.83:56868) 2024-09-21T01:42:42.963 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.961+0000 7f3dabfff640 1 -- 172.21.15.83:0/948633472 learned_addr learned my addr 172.21.15.83:0/948633472 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:42:42.963 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.961+0000 7f3dab7fe640 1 --2- 172.21.15.83:0/948633472 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5629e16fc840 0x5629e1ac3f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:42:42.963 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.961+0000 7f3da97fa640 1 --2- 172.21.15.83:0/3902804591 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f3d940b6680 0x7f3d940b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:42:42.963 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.962+0000 7f3dabfff640 1 -- 172.21.15.83:0/948633472 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5629e16fc840 msgr2=0x5629e1ac3f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:42:42.963 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.962+0000 7f3dabfff640 1 --2- 172.21.15.83:0/948633472 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5629e16fc840 0x5629e1ac3f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:42:42.963 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.962+0000 7f3dabfff640 1 -- 172.21.15.83:0/948633472 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5629e171d520 msgr2=0x5629e1ac3510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:42:42.963 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.962+0000 7f3dabfff640 1 --2- 172.21.15.83:0/948633472 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5629e171d520 0x5629e1ac3510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:42:42.963 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.962+0000 7f3dabfff640 1 -- 172.21.15.83:0/948633472 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5629e19f2fd0 con 0x5629e16f4660 2024-09-21T01:42:42.963 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.962+0000 7f3da97fa640 1 -- 172.21.15.83:0/3902804591 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9315+0+0 (secure 0 0 0) 0x7f3da0107ea0 con 0x7f3dac1083a0 2024-09-21T01:42:42.963 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.962+0000 7f3dab7fe640 1 --2- 172.21.15.83:0/948633472 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5629e16fc840 0x5629e1ac3f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:42:42.963 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.962+0000 7f3db0ec3640 1 --2- 172.21.15.83:0/948633472 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5629e171d520 0x5629e1ac3510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:42:42.963 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.962+0000 7f3dabfff640 1 --2- 172.21.15.83:0/948633472 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5629e16f4660 0x5629e1ac3a50 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f3d9c00bd10 tx=0x7f3d9c0107a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=66779d945437fa21 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:42:42.964 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.962+0000 7f3db0ec3640 1 --2- 172.21.15.83:0/3902804591 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f3d940b6680 0x7f3d940b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:42:42.964 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.963+0000 7f3d927fc640 1 -- 172.21.15.83:0/948633472 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d9c004030 con 0x5629e16f4660 2024-09-21T01:42:42.964 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.963+0000 7f3d927fc640 1 -- 172.21.15.83:0/948633472 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3d9c0035f0 con 0x5629e16f4660 2024-09-21T01:42:42.964 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.963+0000 7f3d927fc640 1 -- 172.21.15.83:0/948633472 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d9c011680 con 0x5629e16f4660 2024-09-21T01:42:42.964 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.964+0000 7f3db8e9a740 1 -- 172.21.15.83:0/948633472 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5629e16f4660 msgr2=0x5629e1ac3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:42:42.964 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.964+0000 7f3db8e9a740 1 --2- 172.21.15.83:0/948633472 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5629e16f4660 0x5629e1ac3a50 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f3d9c00bd10 tx=0x7f3d9c0107a0 comp rx=0 tx=0).stop 2024-09-21T01:42:42.965 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.964+0000 7f3db8e9a740 1 -- 172.21.15.83:0/948633472 shutdown_connections 2024-09-21T01:42:42.965 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.964+0000 7f3db8e9a740 1 --2- 172.21.15.83:0/948633472 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5629e16fc840 0x5629e1ac3f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:42:42.965 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.964+0000 7f3db8e9a740 1 --2- 172.21.15.83:0/948633472 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5629e16f4660 0x5629e1ac3a50 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:42:42.965 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.964+0000 7f3db8e9a740 1 --2- 172.21.15.83:0/948633472 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5629e171d520 0x5629e1ac3510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:42:42.965 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.964+0000 7f3db8e9a740 1 -- 172.21.15.83:0/948633472 >> 172.21.15.83:0/948633472 conn(0x5629e1711910 msgr2=0x5629e1ac1400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:42:42.965 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.964+0000 7f3db0ec3640 1 --2- 172.21.15.83:0/3902804591 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f3d940b6680 0x7f3d940b8b90 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f3da4005fd0 tx=0x7f3da4004a40 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:42:42.965 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.965+0000 7f3db8e9a740 1 -- 172.21.15.83:0/948633472 shutdown_connections 2024-09-21T01:42:42.965 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.965+0000 7f3db8e9a740 1 -- 172.21.15.83:0/948633472 wait complete. 2024-09-21T01:42:42.966 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.965+0000 7f3db8e9a740 1 -- start start 2024-09-21T01:42:42.967 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.965+0000 7f3db8e9a740 1 Processor -- start 2024-09-21T01:42:42.967 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.966+0000 7f3db8e9a740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5629e16f4660 0x5629e1ad2f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:42:42.967 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.966+0000 7f3db8e9a740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5629e16fc840 0x5629e1ad3480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:42:42.967 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.966+0000 7f3db8e9a740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5629e171d520 0x5629e1ad39c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:42:42.967 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.966+0000 7f3db8e9a740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x5629e19c5300 con 0x5629e16f4660 2024-09-21T01:42:42.967 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.966+0000 7f3db8e9a740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5629e1a2e430 con 0x5629e16fc840 2024-09-21T01:42:42.967 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.966+0000 7f3db8e9a740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x5629e188bbb0 con 0x5629e171d520 2024-09-21T01:42:42.967 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.966+0000 7f3db8e9a740 10 client.0 _ll_register_callbacks cb 0x5629e19df120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:42:42.967 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.966+0000 7f3dab7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5629e16fc840 0x5629e1ad3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:42:42.967 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.966+0000 7f3dabfff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5629e16f4660 0x5629e1ad2f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:42:42.967 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.966+0000 7f3dabfff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5629e16f4660 0x5629e1ad2f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:39176/0 (socket says 172.21.15.83:39176) 2024-09-21T01:42:42.967 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.966+0000 7f3dabfff640 1 -- 172.21.15.83:0/1550313759 learned_addr learned my addr 172.21.15.83:0/1550313759 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:42:42.967 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.966+0000 7f3db0ec3640 1 --2- 172.21.15.83:0/1550313759 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5629e171d520 0x5629e1ad39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:42:42.969 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.967+0000 7f3db0ec3640 1 -- 172.21.15.83:0/1550313759 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5629e16fc840 msgr2=0x5629e1ad3480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:42:42.969 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.967+0000 7f3db0ec3640 1 --2- 172.21.15.83:0/1550313759 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5629e16fc840 0x5629e1ad3480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:42:42.969 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.967+0000 7f3db0ec3640 1 -- 172.21.15.83:0/1550313759 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5629e16f4660 msgr2=0x5629e1ad2f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:42:42.969 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.967+0000 7f3db0ec3640 1 --2- 172.21.15.83:0/1550313759 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5629e16f4660 0x5629e1ad2f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:42:42.969 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.967+0000 7f3db0ec3640 1 -- 172.21.15.83:0/1550313759 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5629e19b4780 con 0x5629e171d520 2024-09-21T01:42:42.969 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.967+0000 7f3dabfff640 1 --2- 172.21.15.83:0/1550313759 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5629e16f4660 0x5629e1ad2f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:42:42.969 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.967+0000 7f3db0ec3640 1 --2- 172.21.15.83:0/1550313759 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5629e171d520 0x5629e1ad39c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f3da4012010 tx=0x7f3da4009500 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cf388bdd55ee2b93 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:42:42.969 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.967+0000 7f3d8b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.142:3300/0 2024-09-21T01:42:42.969 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.967+0000 7f3d8b7fe640 1 -- 172.21.15.83:0/1550313759 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3da400fb90 con 0x5629e171d520 2024-09-21T01:42:42.970 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.968+0000 7f3db8e9a740 1 -- 172.21.15.83:0/1550313759 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3d9c0035f0 con 0x5629e171d520 2024-09-21T01:42:42.970 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.968+0000 7f3d8b7fe640 1 -- 172.21.15.83:0/1550313759 <== mon.1 v2:172.21.15.142:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9315+0+0 (secure 0 0 0) 0x7f3da400fd30 con 0x5629e171d520 2024-09-21T01:42:42.970 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.968+0000 7f3d8b7fe640 1 -- 172.21.15.83:0/1550313759 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f3da4026470 con 0x5629e171d520 2024-09-21T01:42:42.970 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.968+0000 7f3db8e9a740 10 client.25141 fetch_fsmap learned FSMap version 21 2024-09-21T01:42:42.970 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.968+0000 7f3db8e9a740 1 -- 172.21.15.83:0/1550313759 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5629e1788b00 con 0x5629e171d520 2024-09-21T01:42:42.970 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.968+0000 7f3d8b7fe640 1 -- 172.21.15.83:0/1550313759 <== mon.1 v2:172.21.15.142:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3d9c0035f0 con 0x5629e171d520 2024-09-21T01:42:42.970 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.968+0000 7f3d8b7fe640 1 -- 172.21.15.83:0/1550313759 <== mon.1 v2:172.21.15.142:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f3da401c540 con 0x5629e171d520 2024-09-21T01:42:42.970 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.968+0000 7f3db8e9a740 10 client.25141 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T01:42:42.970 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.968+0000 7f3db8e9a740 10 client.25141 resolve_mds: validated gid 24653 aka daemon mds.b 2024-09-21T01:42:42.970 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.968+0000 7f3db8e9a740 20 client.25141 populate_metadata read hostname 'smithi083' 2024-09-21T01:42:42.970 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.968+0000 7f3db8e9a740 1 --2- 172.21.15.83:0/1550313759 >> [v2:172.21.15.119:6838/3106757092,v1:172.21.15.119:6839/3106757092] conn(0x5629e16dbea0 0x5629e1ae52d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:42:42.970 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.968+0000 7f3db8e9a740 4 client.25141 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:42:42.970 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.968+0000 7f3db8e9a740 1 -- 172.21.15.83:0/1550313759 --> [v2:172.21.15.119:6838/3106757092,v1:172.21.15.119:6839/3106757092] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5629e1a3d140 con 0x5629e16dbea0 2024-09-21T01:42:42.971 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.969+0000 7f3dabfff640 1 --2- 172.21.15.83:0/1550313759 >> [v2:172.21.15.119:6838/3106757092,v1:172.21.15.119:6839/3106757092] conn(0x5629e16dbea0 0x5629e1ae52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:42:42.971 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.970+0000 7f3d8b7fe640 10 client.25141 ms_handle_connect on v2:172.21.15.119:6838/3106757092 2024-09-21T01:42:42.971 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.970+0000 7f3dabfff640 1 --2- 172.21.15.83:0/1550313759 >> [v2:172.21.15.119:6838/3106757092,v1:172.21.15.119:6839/3106757092] conn(0x5629e16dbea0 0x5629e1ae52d0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a79bedc73dc249a3 server_cookie=5d69ad8394581a93 in_seq=0 out_seq=0 2024-09-21T01:42:42.971 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.970+0000 7f3d8b7fe640 1 -- 172.21.15.83:0/1550313759 <== mds.0 v2:172.21.15.119:6838/3106757092 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5629e1a3d140 con 0x5629e16dbea0 2024-09-21T01:42:42.971 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.970+0000 7f3d8b7fe640 10 client.25141 handle_command_reply: tid=0 2024-09-21T01:42:42.972 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.970+0000 7f3db8e9a740 1 client.25141 shutdown 2024-09-21T01:42:42.972 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.971+0000 7f3db8e9a740 1 -- 172.21.15.83:0/1550313759 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5629e171d520 msgr2=0x5629e1ad39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:42:42.972 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.971+0000 7f3db8e9a740 1 --2- 172.21.15.83:0/1550313759 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5629e171d520 0x5629e1ad39c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f3da4012010 tx=0x7f3da4009500 comp rx=0 tx=0).stop 2024-09-21T01:42:42.972 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.971+0000 7f3db8e9a740 1 -- 172.21.15.83:0/1550313759 shutdown_connections 2024-09-21T01:42:42.972 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.971+0000 7f3db8e9a740 1 --2- 172.21.15.83:0/1550313759 >> [v2:172.21.15.119:6838/3106757092,v1:172.21.15.119:6839/3106757092] conn(0x5629e16dbea0 0x5629e1ae52d0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:42:42.972 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.971+0000 7f3db8e9a740 1 --2- 172.21.15.83:0/1550313759 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5629e171d520 0x5629e1ad39c0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:42:42.972 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.971+0000 7f3db8e9a740 1 --2- 172.21.15.83:0/1550313759 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5629e16fc840 0x5629e1ad3480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:42:42.972 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.971+0000 7f3d8b7fe640 0 client.25141 ms_handle_reset on v2:172.21.15.119:6838/3106757092 2024-09-21T01:42:42.972 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.971+0000 7f3db8e9a740 1 --2- 172.21.15.83:0/1550313759 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5629e16f4660 0x5629e1ad2f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:42:42.972 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.971+0000 7f3db8e9a740 1 -- 172.21.15.83:0/1550313759 >> 172.21.15.83:0/1550313759 conn(0x5629e1711910 msgr2=0x5629e1ac4f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:42:42.973 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.971+0000 7f3db8e9a740 1 -- 172.21.15.83:0/1550313759 shutdown_connections 2024-09-21T01:42:42.973 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.971+0000 7f3db8e9a740 1 -- 172.21.15.83:0/1550313759 wait complete. 2024-09-21T01:42:42.973 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.971+0000 7f3db8e9a740 20 client.25141 trim_cache size 0 max 16384 2024-09-21T01:42:42.989 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.988+0000 7f3db8e9a740 1 Processor -- start 2024-09-21T01:42:42.989 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.989+0000 7f3db8e9a740 1 -- start start 2024-09-21T01:42:42.990 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.989+0000 7f3db8e9a740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5629e16dbea0 0x5629e1ac1290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:42:42.990 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.989+0000 7f3db8e9a740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5629e16f4660 0x5629e1ad2eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:42:42.990 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.989+0000 7f3db8e9a740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5629e16fc840 0x5629e1ad33f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:42:42.990 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.989+0000 7f3db8e9a740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f3dac1ac9d0 con 0x5629e16fc840 2024-09-21T01:42:42.990 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.989+0000 7f3db8e9a740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f3dac1af250 con 0x5629e16f4660 2024-09-21T01:42:42.990 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.989+0000 7f3db8e9a740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f3dac1ad040 con 0x5629e16dbea0 2024-09-21T01:42:42.990 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.989+0000 7f3db0ec3640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5629e16fc840 0x5629e1ad33f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:42:42.990 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.989+0000 7f3dab7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5629e16f4660 0x5629e1ad2eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:42:42.990 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.989+0000 7f3dab7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5629e16f4660 0x5629e1ad2eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.83:38144/0 (socket says 172.21.15.83:38144) 2024-09-21T01:42:42.990 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.989+0000 7f3dab7fe640 1 -- 172.21.15.83:0/661214679 learned_addr learned my addr 172.21.15.83:0/661214679 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:42:42.991 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.990+0000 7f3db0ec3640 1 -- 172.21.15.83:0/661214679 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5629e16dbea0 msgr2=0x5629e1ac1290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:42:42.991 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.990+0000 7f3dabfff640 1 --2- 172.21.15.83:0/661214679 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5629e16dbea0 0x5629e1ac1290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:42:42.991 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.990+0000 7f3db0ec3640 1 --2- 172.21.15.83:0/661214679 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5629e16dbea0 0x5629e1ac1290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:42:42.991 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.990+0000 7f3db0ec3640 1 -- 172.21.15.83:0/661214679 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5629e16f4660 msgr2=0x5629e1ad2eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:42:42.991 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.990+0000 7f3db0ec3640 1 --2- 172.21.15.83:0/661214679 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5629e16f4660 0x5629e1ad2eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:42:42.991 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.990+0000 7f3db0ec3640 1 -- 172.21.15.83:0/661214679 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5629e17ff960 con 0x5629e16fc840 2024-09-21T01:42:42.992 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.990+0000 7f3db0ec3640 1 --2- 172.21.15.83:0/661214679 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5629e16fc840 0x5629e1ad33f0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f3da401c960 tx=0x7f3da4009610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5faa163fb091ab1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:42:42.992 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.990+0000 7f3dabfff640 1 --2- 172.21.15.83:0/661214679 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5629e16dbea0 0x5629e1ac1290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:42:42.992 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.990+0000 7f3d91ffb640 1 -- 172.21.15.83:0/661214679 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3da401cdd0 con 0x5629e16fc840 2024-09-21T01:42:42.992 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.990+0000 7f3d91ffb640 1 -- 172.21.15.83:0/661214679 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3da4021070 con 0x5629e16fc840 2024-09-21T01:42:42.992 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.990+0000 7f3d91ffb640 1 -- 172.21.15.83:0/661214679 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3da40268e0 con 0x5629e16fc840 2024-09-21T01:42:42.993 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.991+0000 7f3db8e9a740 1 -- 172.21.15.83:0/661214679 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5629e16fc840 msgr2=0x5629e1ad33f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:42:42.993 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.991+0000 7f3db8e9a740 1 --2- 172.21.15.83:0/661214679 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5629e16fc840 0x5629e1ad33f0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f3da401c960 tx=0x7f3da4009610 comp rx=0 tx=0).stop 2024-09-21T01:42:42.993 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.991+0000 7f3db8e9a740 1 -- 172.21.15.83:0/661214679 shutdown_connections 2024-09-21T01:42:42.993 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.991+0000 7f3db8e9a740 1 --2- 172.21.15.83:0/661214679 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5629e16fc840 0x5629e1ad33f0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:42:42.993 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.991+0000 7f3db8e9a740 1 --2- 172.21.15.83:0/661214679 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5629e16f4660 0x5629e1ad2eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:42:42.993 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.991+0000 7f3db8e9a740 1 --2- 172.21.15.83:0/661214679 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5629e16dbea0 0x5629e1ac1290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:42:42.993 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.991+0000 7f3db8e9a740 1 -- 172.21.15.83:0/661214679 >> 172.21.15.83:0/661214679 conn(0x5629e1711910 msgr2=0x5629e1ac0b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:42:42.993 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.992+0000 7f3db8e9a740 1 -- 172.21.15.83:0/661214679 shutdown_connections 2024-09-21T01:42:42.993 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.992+0000 7f3db8e9a740 1 -- 172.21.15.83:0/661214679 wait complete. 2024-09-21T01:42:42.993 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.992+0000 7f3db8e9a740 1 -- start start 2024-09-21T01:42:42.993 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.992+0000 7f3db8e9a740 1 Processor -- start 2024-09-21T01:42:42.995 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.993+0000 7f3db8e9a740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5629e16dbea0 0x5629e1aca000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:42:42.995 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.993+0000 7f3db8e9a740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5629e16f4660 0x5629e1aca540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:42:42.995 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.993+0000 7f3db8e9a740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5629e16fc840 0x5629e1adb180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:42:42.995 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.993+0000 7f3db8e9a740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f3dac1ad710 con 0x5629e16fc840 2024-09-21T01:42:42.995 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.993+0000 7f3db8e9a740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f3dac1aeb80 con 0x5629e16f4660 2024-09-21T01:42:42.995 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.993+0000 7f3db8e9a740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f3dac1adde0 con 0x5629e16dbea0 2024-09-21T01:42:42.995 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.993+0000 7f3db8e9a740 10 client.0 _ll_register_callbacks cb 0x7f3da4009cc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:42:42.995 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.993+0000 7f3db0ec3640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5629e16fc840 0x5629e1adb180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:42:42.995 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.993+0000 7f3db0ec3640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5629e16fc840 0x5629e1adb180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:43278/0 (socket says 172.21.15.83:43278) 2024-09-21T01:42:42.996 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.993+0000 7f3db0ec3640 1 -- 172.21.15.83:0/4267921815 learned_addr learned my addr 172.21.15.83:0/4267921815 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:42:42.996 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.993+0000 7f3dab7fe640 1 --2- 172.21.15.83:0/4267921815 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5629e16f4660 0x5629e1aca540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:42:42.996 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.994+0000 7f3db0ec3640 1 -- 172.21.15.83:0/4267921815 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5629e16dbea0 msgr2=0x5629e1aca000 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T01:42:42.996 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.994+0000 7f3db0ec3640 1 --2- 172.21.15.83:0/4267921815 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5629e16dbea0 0x5629e1aca000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:42:42.996 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.994+0000 7f3db0ec3640 1 -- 172.21.15.83:0/4267921815 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5629e16f4660 msgr2=0x5629e1aca540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:42:42.996 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.994+0000 7f3db0ec3640 1 --2- 172.21.15.83:0/4267921815 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5629e16f4660 0x5629e1aca540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:42:42.996 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.994+0000 7f3db0ec3640 1 -- 172.21.15.83:0/4267921815 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5629e1acae10 con 0x5629e16fc840 2024-09-21T01:42:42.996 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.994+0000 7f3db0ec3640 1 --2- 172.21.15.83:0/4267921815 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5629e16fc840 0x5629e1adb180 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f3da4011ce0 tx=0x7f3da401c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20e7d0c8a2d99882 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:42:42.996 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.994+0000 7f3dab7fe640 1 --2- 172.21.15.83:0/4267921815 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5629e16f4660 0x5629e1aca540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:42:42.996 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.994+0000 7f3d8b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-09-21T01:42:42.996 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.994+0000 7f3d8b7fe640 1 -- 172.21.15.83:0/4267921815 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3da403f070 con 0x5629e16fc840 2024-09-21T01:42:42.996 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.994+0000 7f3d8b7fe640 1 -- 172.21.15.83:0/4267921815 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9315+0+0 (secure 0 0 0) 0x7f3da400fd20 con 0x5629e16fc840 2024-09-21T01:42:42.996 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.994+0000 7f3db8e9a740 1 -- 172.21.15.83:0/4267921815 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3da4021070 con 0x5629e16fc840 2024-09-21T01:42:42.996 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.994+0000 7f3d8b7fe640 1 -- 172.21.15.83:0/4267921815 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f3da4026680 con 0x5629e16fc840 2024-09-21T01:42:42.996 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.994+0000 7f3db8e9a740 10 client.15543 fetch_fsmap learned FSMap version 21 2024-09-21T01:42:42.996 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.995+0000 7f3db8e9a740 1 -- 172.21.15.83:0/4267921815 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5629e1b54ab0 con 0x5629e16fc840 2024-09-21T01:42:42.997 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.995+0000 7f3d8b7fe640 1 -- 172.21.15.83:0/4267921815 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3da4021070 con 0x5629e16fc840 2024-09-21T01:42:42.997 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.995+0000 7f3d8b7fe640 1 -- 172.21.15.83:0/4267921815 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f3da4033820 con 0x5629e16fc840 2024-09-21T01:42:42.997 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.995+0000 7f3db8e9a740 10 client.15543 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T01:42:42.997 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.995+0000 7f3db8e9a740 10 client.15543 resolve_mds: validated gid 24653 aka daemon mds.b 2024-09-21T01:42:42.997 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.995+0000 7f3db8e9a740 20 client.15543 populate_metadata read hostname 'smithi083' 2024-09-21T01:42:42.997 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.995+0000 7f3db8e9a740 1 --2- 172.21.15.83:0/4267921815 >> [v2:172.21.15.119:6838/3106757092,v1:172.21.15.119:6839/3106757092] conn(0x5629e171d520 0x5629e1b57160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:42:42.997 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.995+0000 7f3db8e9a740 4 client.15543 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "a6e72891", "release": true, "await": true}] 2024-09-21T01:42:42.998 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.995+0000 7f3db8e9a740 1 -- 172.21.15.83:0/4267921815 --> [v2:172.21.15.119:6838/3106757092,v1:172.21.15.119:6839/3106757092] -- command(tid 0: {"prefix": "quiesce db", "set_id": "a6e72891", "release": true, "await": true}) -- 0x5629e1a38bf0 con 0x5629e171d520 2024-09-21T01:42:42.998 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.995+0000 7f3dabfff640 1 --2- 172.21.15.83:0/4267921815 >> [v2:172.21.15.119:6838/3106757092,v1:172.21.15.119:6839/3106757092] conn(0x5629e171d520 0x5629e1b57160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:42:42.998 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.996+0000 7f3d8b7fe640 10 client.15543 ms_handle_connect on v2:172.21.15.119:6838/3106757092 2024-09-21T01:42:42.998 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.996+0000 7f3dabfff640 1 --2- 172.21.15.83:0/4267921815 >> [v2:172.21.15.119:6838/3106757092,v1:172.21.15.119:6839/3106757092] conn(0x5629e171d520 0x5629e1b57160 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f1b36aa8ad74d844 server_cookie=80896bf179f7d60d in_seq=0 out_seq=0 2024-09-21T01:42:42.999 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.998+0000 7f3d8b7fe640 1 -- 172.21.15.83:0/4267921815 <== mds.0 v2:172.21.15.119:6838/3106757092 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x5629e1a38bf0 con 0x5629e171d520 2024-09-21T01:42:42.999 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.998+0000 7f3d8b7fe640 10 client.15543 handle_command_reply: tid=0 2024-09-21T01:42:42.999 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.998+0000 7f3db8e9a740 1 client.15543 shutdown 2024-09-21T01:42:42.999 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.998+0000 7f3db8e9a740 1 -- 172.21.15.83:0/4267921815 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5629e16fc840 msgr2=0x5629e1adb180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:42:42.999 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.998+0000 7f3db8e9a740 1 --2- 172.21.15.83:0/4267921815 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5629e16fc840 0x5629e1adb180 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f3da4011ce0 tx=0x7f3da401c890 comp rx=0 tx=0).stop 2024-09-21T01:42:42.999 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.998+0000 7f3db8e9a740 1 -- 172.21.15.83:0/4267921815 shutdown_connections 2024-09-21T01:42:42.999 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.998+0000 7f3db8e9a740 1 --2- 172.21.15.83:0/4267921815 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5629e16fc840 0x5629e1adb180 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:42:42.999 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.998+0000 7f3db8e9a740 1 --2- 172.21.15.83:0/4267921815 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5629e16f4660 0x5629e1aca540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:42:43.000 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.998+0000 7f3db8e9a740 1 --2- 172.21.15.83:0/4267921815 >> [v2:172.21.15.119:6838/3106757092,v1:172.21.15.119:6839/3106757092] conn(0x5629e171d520 0x5629e1b57160 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:42:43.000 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.998+0000 7f3db8e9a740 1 --2- 172.21.15.83:0/4267921815 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5629e16dbea0 0x5629e1aca000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:42:43.001 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-09-21T01:42:43.001 INFO:teuthology.orchestra.run.smithi083.stdout: "epoch": 21, 2024-09-21T01:42:43.001 INFO:teuthology.orchestra.run.smithi083.stdout: "leader": 24653, 2024-09-21T01:42:43.001 INFO:teuthology.orchestra.run.smithi083.stdout: "set_version": 4, 2024-09-21T01:42:43.001 INFO:teuthology.orchestra.run.smithi083.stdout: "sets": { 2024-09-21T01:42:43.001 INFO:teuthology.orchestra.run.smithi083.stdout: "a6e72891": { 2024-09-21T01:42:43.001 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 4, 2024-09-21T01:42:43.001 INFO:teuthology.orchestra.run.smithi083.stdout: "age_ref": 0.0, 2024-09-21T01:42:43.001 INFO:teuthology.orchestra.run.smithi083.stdout: "state": { 2024-09-21T01:42:43.001 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "RELEASED", 2024-09-21T01:42:43.001 INFO:teuthology.orchestra.run.smithi083.stdout: "age": 0.0 2024-09-21T01:42:43.001 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:42:43.001 INFO:teuthology.orchestra.run.smithi083.stdout: "timeout": 90.0, 2024-09-21T01:42:43.002 INFO:teuthology.orchestra.run.smithi083.stdout: "expiration": 134.5, 2024-09-21T01:42:43.002 INFO:teuthology.orchestra.run.smithi083.stdout: "members": { 2024-09-21T01:42:43.002 INFO:teuthology.orchestra.run.smithi083.stdout: "file:/": { 2024-09-21T01:42:43.002 INFO:teuthology.orchestra.run.smithi083.stdout: "excluded": false, 2024-09-21T01:42:43.002 INFO:teuthology.orchestra.run.smithi083.stdout: "state": { 2024-09-21T01:42:43.002 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "RELEASED", 2024-09-21T01:42:43.002 INFO:teuthology.orchestra.run.smithi083.stdout: "age": 0.0 2024-09-21T01:42:43.002 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:42:43.002 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:42:43.002 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:42:43.002 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:42:43.002 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:42:43.002 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-09-21T01:42:43.003 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.998+0000 7f3db8e9a740 1 -- 172.21.15.83:0/4267921815 >> 172.21.15.83:0/4267921815 conn(0x5629e1711910 msgr2=0x5629e1abf930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:42:43.003 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.999+0000 7f3d8b7fe640 0 client.15543 ms_handle_reset on v2:172.21.15.119:6838/3106757092 2024-09-21T01:42:43.003 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.999+0000 7f3db8e9a740 1 -- 172.21.15.83:0/4267921815 shutdown_connections 2024-09-21T01:42:43.003 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.999+0000 7f3db8e9a740 1 -- 172.21.15.83:0/4267921815 wait complete. 2024-09-21T01:42:43.003 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.999+0000 7f3db8e9a740 20 client.15543 trim_cache size 0 max 16384 2024-09-21T01:42:43.003 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.999+0000 7f3db2926640 1 -- 172.21.15.83:0/3902804591 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f3d940b6680 msgr2=0x7f3d940b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:42:43.003 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.999+0000 7f3db2926640 1 --2- 172.21.15.83:0/3902804591 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f3d940b6680 0x7f3d940b8b90 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f3da4005fd0 tx=0x7f3da4004a40 comp rx=0 tx=0).stop 2024-09-21T01:42:43.003 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.999+0000 7f3db2926640 1 -- 172.21.15.83:0/3902804591 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3dac1083a0 msgr2=0x7f3dac19aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:42:43.003 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:42.999+0000 7f3db2926640 1 --2- 172.21.15.83:0/3902804591 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3dac1083a0 0x7f3dac19aa80 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f3da0005940 tx=0x7f3da0004040 comp rx=0 tx=0).stop 2024-09-21T01:42:43.003 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:43.000+0000 7f3db2926640 1 -- 172.21.15.83:0/3902804591 shutdown_connections 2024-09-21T01:42:43.003 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:43.000+0000 7f3db2926640 1 --2- 172.21.15.83:0/3902804591 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f3d940b6680 0x7f3d940b8b90 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:42:43.004 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:43.000+0000 7f3db2926640 1 --2- 172.21.15.83:0/3902804591 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3dac108cf0 0x7f3dac19fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:42:43.004 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:43.000+0000 7f3db2926640 1 --2- 172.21.15.83:0/3902804591 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3dac1083a0 0x7f3dac19aa80 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:42:43.004 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:43.000+0000 7f3db2926640 1 --2- 172.21.15.83:0/3902804591 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3dac102a60 0x7f3dac19a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:42:43.004 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:43.000+0000 7f3db2926640 1 -- 172.21.15.83:0/3902804591 >> 172.21.15.83:0/3902804591 conn(0x7f3dac079730 msgr2=0x7f3dac105440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:42:43.004 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:43.000+0000 7f3db2926640 1 -- 172.21.15.83:0/3902804591 shutdown_connections 2024-09-21T01:42:43.004 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:42:43.000+0000 7f3db2926640 1 -- 172.21.15.83:0/3902804591 wait complete. 2024-09-21T01:42:43.756 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'a6e72891', total seconds elapsed: 18.0 2024-09-21T01:42:44.053 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:42:43 smithi083 ceph-mon[31370]: pgmap v359: 129 pgs: 129 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:42:44.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:42:43 smithi142 ceph-mon[34050]: pgmap v359: 129 pgs: 129 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:42:44.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:42:43 smithi119 ceph-mon[33693]: pgmap v359: 129 pgs: 129 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:42:46.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:42:45 smithi142 ceph-mon[34050]: pgmap v360: 129 pgs: 129 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T01:42:46.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:42:45 smithi119 ceph-mon[33693]: pgmap v360: 129 pgs: 129 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T01:42:46.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:42:45 smithi083 ceph-mon[31370]: pgmap v360: 129 pgs: 129 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T01:42:48.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:42:47 smithi142 ceph-mon[34050]: pgmap v361: 129 pgs: 129 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:42:48.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:42:47 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:42:48.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:42:47 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:42:48.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:42:47 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:42:48.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:42:47 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:42:48.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:42:47 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:42:48.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:42:47 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:42:48.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:42:47 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:42:48.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:42:47 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:42:48.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:42:47 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:42:48.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:42:47 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:42:48.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:42:47 smithi119 ceph-mon[33693]: pgmap v361: 129 pgs: 129 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:42:48.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:42:47 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:42:48.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:42:47 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:42:48.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:42:47 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:42:48.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:42:47 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:42:48.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:42:47 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:42:48.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:42:47 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:42:48.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:42:47 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:42:48.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:42:47 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:42:48.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:42:47 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:42:48.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:42:47 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:42:48.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:42:47 smithi083 ceph-mon[31370]: pgmap v361: 129 pgs: 129 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:42:48.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:42:47 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:42:48.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:42:47 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:42:48.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:42:47 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:42:48.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:42:47 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:42:48.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:42:47 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:42:48.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:42:47 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:42:48.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:42:47 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:42:48.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:42:47 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:42:48.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:42:47 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:42:48.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:42:47 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:42:50.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:42:49 smithi142 ceph-mon[34050]: pgmap v362: 129 pgs: 129 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:42:50.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:42:49 smithi119 ceph-mon[33693]: pgmap v362: 129 pgs: 129 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:42:50.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:42:49 smithi083 ceph-mon[31370]: pgmap v362: 129 pgs: 129 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:42:52.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:42:51 smithi142 ceph-mon[34050]: pgmap v363: 129 pgs: 129 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T01:42:52.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:42:51 smithi119 ceph-mon[33693]: pgmap v363: 129 pgs: 129 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T01:42:52.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:42:51 smithi083 ceph-mon[31370]: pgmap v363: 129 pgs: 129 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T01:42:53.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:42:52 smithi142 ceph-mon[34050]: pgmap v364: 129 pgs: 129 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:42:53.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:42:52 smithi119 ceph-mon[33693]: pgmap v364: 129 pgs: 129 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:42:53.305 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:42:52 smithi083 ceph-mon[31370]: pgmap v364: 129 pgs: 129 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:42:56.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:42:55 smithi142 ceph-mon[34050]: pgmap v365: 129 pgs: 129 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T01:42:56.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:42:55 smithi119 ceph-mon[33693]: pgmap v365: 129 pgs: 129 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T01:42:56.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:42:55 smithi083 ceph-mon[31370]: pgmap v365: 129 pgs: 129 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T01:42:58.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:42:57 smithi142 ceph-mon[34050]: pgmap v366: 129 pgs: 129 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:42:58.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:42:57 smithi119 ceph-mon[33693]: pgmap v366: 129 pgs: 129 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:42:58.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:42:57 smithi083 ceph-mon[31370]: pgmap v366: 129 pgs: 129 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:43:00.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:42:59 smithi142 ceph-mon[34050]: pgmap v367: 129 pgs: 129 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:43:00.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:42:59 smithi119 ceph-mon[33693]: pgmap v367: 129 pgs: 129 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:43:00.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:42:59 smithi083 ceph-mon[31370]: pgmap v367: 129 pgs: 129 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:43:02.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:43:01 smithi142 ceph-mon[34050]: pgmap v368: 129 pgs: 129 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T01:43:02.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:43:01 smithi119 ceph-mon[33693]: pgmap v368: 129 pgs: 129 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T01:43:02.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:43:01 smithi083 ceph-mon[31370]: pgmap v368: 129 pgs: 129 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T01:43:04.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:43:03 smithi142 ceph-mon[34050]: pgmap v369: 129 pgs: 129 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 11 KiB/s wr, 3 op/s 2024-09-21T01:43:04.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:43:03 smithi119 ceph-mon[33693]: pgmap v369: 129 pgs: 129 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 11 KiB/s wr, 3 op/s 2024-09-21T01:43:04.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:43:03 smithi083 ceph-mon[31370]: pgmap v369: 129 pgs: 129 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 11 KiB/s wr, 3 op/s 2024-09-21T01:43:06.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:43:05 smithi142 ceph-mon[34050]: pgmap v370: 129 pgs: 129 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 11 KiB/s wr, 4 op/s 2024-09-21T01:43:06.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:43:05 smithi119 ceph-mon[33693]: pgmap v370: 129 pgs: 129 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 11 KiB/s wr, 4 op/s 2024-09-21T01:43:06.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:43:05 smithi083 ceph-mon[31370]: pgmap v370: 129 pgs: 129 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 11 KiB/s wr, 4 op/s 2024-09-21T01:43:08.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:43:07 smithi142 ceph-mon[34050]: pgmap v371: 129 pgs: 129 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-21T01:43:08.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:43:07 smithi119 ceph-mon[33693]: pgmap v371: 129 pgs: 129 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-21T01:43:08.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:43:07 smithi083 ceph-mon[31370]: pgmap v371: 129 pgs: 129 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-21T01:43:09.195 INFO:tasks.workunit.client.0.smithi083.stderr:Note: switching to '1843221895adccfb3b692060251dd6a0183bc410'. 2024-09-21T01:43:09.195 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-21T01:43:09.195 INFO:tasks.workunit.client.0.smithi083.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-21T01:43:09.196 INFO:tasks.workunit.client.0.smithi083.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-21T01:43:09.196 INFO:tasks.workunit.client.0.smithi083.stderr:state without impacting any branches by switching back to a branch. 2024-09-21T01:43:09.196 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-21T01:43:09.196 INFO:tasks.workunit.client.0.smithi083.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-21T01:43:09.196 INFO:tasks.workunit.client.0.smithi083.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-21T01:43:09.196 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-21T01:43:09.196 INFO:tasks.workunit.client.0.smithi083.stderr: git switch -c 2024-09-21T01:43:09.196 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-21T01:43:09.196 INFO:tasks.workunit.client.0.smithi083.stderr:Or undo this operation with: 2024-09-21T01:43:09.196 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-21T01:43:09.196 INFO:tasks.workunit.client.0.smithi083.stderr: git switch - 2024-09-21T01:43:09.196 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-21T01:43:09.196 INFO:tasks.workunit.client.0.smithi083.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-21T01:43:09.196 INFO:tasks.workunit.client.0.smithi083.stderr: 2024-09-21T01:43:09.196 INFO:tasks.workunit.client.0.smithi083.stderr:HEAD is now at 1843221895a Merge PR #56776 into wip-pdonnell-testing-20240920.212106-debug 2024-09-21T01:43:09.200 DEBUG:teuthology.orchestra.run.smithi083:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-21T01:43:09.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:43:08 smithi142 ceph-mon[34050]: pgmap v372: 129 pgs: 129 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-21T01:43:09.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:43:08 smithi119 ceph-mon[33693]: pgmap v372: 129 pgs: 129 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-21T01:43:09.224 INFO:tasks.workunit.client.0.smithi083.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-21T01:43:09.226 INFO:tasks.workunit.client.0.smithi083.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-21T01:43:09.226 INFO:tasks.workunit.client.0.smithi083.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-21T01:43:09.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:43:08 smithi083 ceph-mon[31370]: pgmap v372: 129 pgs: 129 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-21T01:43:09.894 INFO:tasks.workunit.client.0.smithi083.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-21T01:43:09.971 INFO:tasks.workunit.client.0.smithi083.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-21T01:43:10.013 INFO:tasks.workunit.client.0.smithi083.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-21T01:43:10.015 INFO:tasks.workunit.client.0.smithi083.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-21T01:43:10.015 INFO:tasks.workunit.client.0.smithi083.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-21T01:43:10.054 INFO:tasks.workunit.client.0.smithi083.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-21T01:43:10.057 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-09-21T01:43:10.058 DEBUG:teuthology.orchestra.run.smithi083:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-21T01:43:10.114 INFO:tasks.workunit:Running workunits matching direct_io on client.0... 2024-09-21T01:43:10.116 INFO:tasks.workunit:Running workunit direct_io/big.sh... 2024-09-21T01:43:10.116 DEBUG:teuthology.orchestra.run.smithi083:workunit test direct_io/big.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1843221895adccfb3b692060251dd6a0183bc410 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io/big.sh 2024-09-21T01:43:10.185 INFO:tasks.workunit.client.0.smithi083.stdout:test large (16MB) dio write 2024-09-21T01:43:10.185 INFO:tasks.workunit.client.0.smithi083.stderr:+ echo 'test large (16MB) dio write' 2024-09-21T01:43:10.185 INFO:tasks.workunit.client.0.smithi083.stderr:+ dd if=/dev/zero of=foo.big bs=16M count=1 oflag=direct 2024-09-21T01:43:10.452 INFO:tasks.workunit.client.0.smithi083.stderr:1+0 records in 2024-09-21T01:43:10.452 INFO:tasks.workunit.client.0.smithi083.stderr:1+0 records out 2024-09-21T01:43:10.452 INFO:tasks.workunit.client.0.smithi083.stderr:16777216 bytes (17 MB, 16 MiB) copied, 0.264208 s, 63.5 MB/s 2024-09-21T01:43:10.452 INFO:tasks.workunit.client.0.smithi083.stderr:+ echo OK 2024-09-21T01:43:10.453 INFO:tasks.workunit.client.0.smithi083.stdout:OK 2024-09-21T01:43:10.453 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-21T01:43:10.454 DEBUG:teuthology.orchestra.run.smithi083:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-21T01:43:10.531 INFO:tasks.workunit:Running workunit direct_io/direct_io_test... 2024-09-21T01:43:10.531 DEBUG:teuthology.orchestra.run.smithi083:workunit test direct_io/direct_io_test> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1843221895adccfb3b692060251dd6a0183bc410 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io/direct_io_test 2024-09-21T01:43:10.685 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 17.0 2024-09-21T01:43:10.686 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T01:43:10.977 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:43:11.484 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:11.473+0000 7f3dc2cd4640 1 -- 172.21.15.83:0/1152180061 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3dbc10de30 msgr2=0x7f3dbc110320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:43:11.484 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:11.473+0000 7f3dc2cd4640 1 --2- 172.21.15.83:0/1152180061 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3dbc10de30 0x7f3dbc110320 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f3db4009ca0 tx=0x7f3db402a8c0 comp rx=0 tx=0).stop 2024-09-21T01:43:11.485 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:11.473+0000 7f3dc2cd4640 1 -- 172.21.15.83:0/1152180061 shutdown_connections 2024-09-21T01:43:11.485 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:11.473+0000 7f3dc2cd4640 1 --2- 172.21.15.83:0/1152180061 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3dbc10de30 0x7f3dbc110320 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:43:11.485 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:11.473+0000 7f3dc2cd4640 1 --2- 172.21.15.83:0/1152180061 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3dbc105320 0x7f3dbc10d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:43:11.485 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:11.473+0000 7f3dc2cd4640 1 --2- 172.21.15.83:0/1152180061 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3dbc1049d0 0x7f3dbc104de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:43:11.485 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:11.473+0000 7f3dc2cd4640 1 -- 172.21.15.83:0/1152180061 >> 172.21.15.83:0/1152180061 conn(0x7f3dbc079740 msgr2=0x7f3dbc079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:43:11.485 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:11.473+0000 7f3dc2cd4640 1 -- 172.21.15.83:0/1152180061 shutdown_connections 2024-09-21T01:43:11.485 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:11.473+0000 7f3dc2cd4640 1 -- 172.21.15.83:0/1152180061 wait complete. 2024-09-21T01:43:11.485 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:11.473+0000 7f3dc2cd4640 1 Processor -- start 2024-09-21T01:43:11.485 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:11.474+0000 7f3dc2cd4640 1 -- start start 2024-09-21T01:43:11.485 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:11.474+0000 7f3dc2cd4640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3dbc1049d0 0x7f3dbc19a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:43:11.485 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:11.474+0000 7f3dc2cd4640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3dbc105320 0x7f3dbc19a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:43:11.485 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:11.474+0000 7f3dc2cd4640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3dbc10de30 0x7f3dbc19fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:43:11.485 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:11.474+0000 7f3dc2cd4640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f3dbc1139b0 con 0x7f3dbc105320 2024-09-21T01:43:11.486 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:11.474+0000 7f3dc2cd4640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f3dbc113830 con 0x7f3dbc10de30 2024-09-21T01:43:11.486 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:11.474+0000 7f3dc2cd4640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f3dbc113b30 con 0x7f3dbc1049d0 2024-09-21T01:43:11.486 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:11.474+0000 7f3dbbfff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3dbc105320 0x7f3dbc19a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:43:11.486 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:11.474+0000 7f3dbbfff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3dbc105320 0x7f3dbc19a9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:36122/0 (socket says 172.21.15.83:36122) 2024-09-21T01:43:11.486 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:11.474+0000 7f3dc0a70640 1 --2- 172.21.15.83:0/849821246 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3dbc1049d0 0x7f3dbc19a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:43:11.486 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:11.474+0000 7f3dbbfff640 1 -- 172.21.15.83:0/849821246 learned_addr learned my addr 172.21.15.83:0/849821246 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:43:11.486 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:11.474+0000 7f3dc1271640 1 --2- 172.21.15.83:0/849821246 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3dbc10de30 0x7f3dbc19fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:43:11.486 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:11.474+0000 7f3dbbfff640 1 -- 172.21.15.83:0/849821246 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3dbc1049d0 msgr2=0x7f3dbc19a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:43:11.486 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:11.474+0000 7f3dbbfff640 1 --2- 172.21.15.83:0/849821246 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3dbc1049d0 0x7f3dbc19a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:43:11.486 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:11.474+0000 7f3dbbfff640 1 -- 172.21.15.83:0/849821246 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3dbc10de30 msgr2=0x7f3dbc19fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:43:11.486 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:11.474+0000 7f3dbbfff640 1 --2- 172.21.15.83:0/849821246 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3dbc10de30 0x7f3dbc19fc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:43:11.486 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:11.474+0000 7f3dbbfff640 1 -- 172.21.15.83:0/849821246 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3dbc1a0390 con 0x7f3dbc105320 2024-09-21T01:43:11.486 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:11.474+0000 7f3dc1271640 1 --2- 172.21.15.83:0/849821246 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3dbc10de30 0x7f3dbc19fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:43:11.486 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:11.474+0000 7f3dc0a70640 1 --2- 172.21.15.83:0/849821246 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3dbc1049d0 0x7f3dbc19a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:43:11.487 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:11.474+0000 7f3dbbfff640 1 --2- 172.21.15.83:0/849821246 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3dbc105320 0x7f3dbc19a9c0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f3da800e9f0 tx=0x7f3da800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:43:11.487 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:11.475+0000 7f3db9ffb640 1 -- 172.21.15.83:0/849821246 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3da800ccc0 con 0x7f3dbc105320 2024-09-21T01:43:11.487 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:11.475+0000 7f3db9ffb640 1 -- 172.21.15.83:0/849821246 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3da80108c0 con 0x7f3dbc105320 2024-09-21T01:43:11.487 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:11.475+0000 7f3db9ffb640 1 -- 172.21.15.83:0/849821246 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3da8018750 con 0x7f3dbc105320 2024-09-21T01:43:11.487 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:11.475+0000 7f3dc2cd4640 1 -- 172.21.15.83:0/849821246 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3dbc1a0680 con 0x7f3dbc105320 2024-09-21T01:43:11.487 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:11.475+0000 7f3dc2cd4640 1 -- 172.21.15.83:0/849821246 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3dbc1a6de0 con 0x7f3dbc105320 2024-09-21T01:43:11.487 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:11.476+0000 7f3dc2cd4640 1 -- 172.21.15.83:0/849821246 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3dbc06c240 con 0x7f3dbc105320 2024-09-21T01:43:11.487 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:11.477+0000 7f3db9ffb640 1 -- 172.21.15.83:0/849821246 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7f3da8010430 con 0x7f3dbc105320 2024-09-21T01:43:11.487 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:11.478+0000 7f3db9ffb640 1 --2- 172.21.15.83:0/849821246 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f3dac0b6700 0x7f3dac0b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:43:11.487 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:11.478+0000 7f3dc0a70640 1 --2- 172.21.15.83:0/849821246 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f3dac0b6700 0x7f3dac0b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:43:11.487 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:11.478+0000 7f3db9ffb640 1 -- 172.21.15.83:0/849821246 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9315+0+0 (secure 0 0 0) 0x7f3da80e8210 con 0x7f3dbc105320 2024-09-21T01:43:11.487 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:11.479+0000 7f3dc0a70640 1 --2- 172.21.15.83:0/849821246 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f3dac0b6700 0x7f3dac0b8c10 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f3dbc06c940 tx=0x7f3db0005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:43:11.487 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:11.481+0000 7f3db9ffb640 1 -- 172.21.15.83:0/849821246 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3da80ae440 con 0x7f3dbc105320 2024-09-21T01:43:11.715 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:11.715+0000 7f3dc2cd4640 1 -- 172.21.15.83:0/849821246 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3dbc104de0 con 0x7f3dbc105320 2024-09-21T01:43:11.716 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:11.716+0000 7f3db9ffb640 1 -- 172.21.15.83:0/849821246 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11857 (secure 0 0 0) 0x7f3da80b2820 con 0x7f3dbc105320 2024-09-21T01:43:11.716 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T01:43:11.716 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":21,"btime":"2024-09-21T01:40:27:947059+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14775,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6835/1105040204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":1105040204},{"type":"v1","addr":"172.21.15.83:6835","nonce":1105040204}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14787,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/2234789563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6836","nonce":2234789563},{"type":"v1","addr":"172.21.15.83:6837","nonce":2234789563}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14838,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6839/136258364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6838","nonce":136258364},{"type":"v1","addr":"172.21.15.83:6839","nonce":136258364}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14850,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6841/129439444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6840","nonce":129439444},{"type":"v1","addr":"172.21.15.83:6841","nonce":129439444}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24569,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/2839502433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":2839502433},{"type":"v1","addr":"172.21.15.119:6833","nonce":2839502433}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24580,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6833/2841606990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":2841606990},{"type":"v1","addr":"172.21.15.142:6833","nonce":2841606990}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24599,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/415902608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":415902608},{"type":"v1","addr":"172.21.15.119:6835","nonce":415902608}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24607,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/3009088510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":3009088510},{"type":"v1","addr":"172.21.15.142:6835","nonce":3009088510}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24613,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/3847200126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6836","nonce":3847200126},{"type":"v1","addr":"172.21.15.142:6837","nonce":3847200126}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24626,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/3619222976","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":3619222976},{"type":"v1","addr":"172.21.15.119:6837","nonce":3619222976}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T01:39:45.145124+0000","modified":"2024-09-21T01:40:27.664151+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24653},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24631":{"gid":24631,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.142:6839/1817880741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6838","nonce":1817880741},{"type":"v1","addr":"172.21.15.142:6839","nonce":1817880741}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24653":{"gid":24653,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.119:6839/3106757092","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":3106757092},{"type":"v1","addr":"172.21.15.119:6839","nonce":3106757092}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24653,"qdb_cluster":[24653]},"id":1}]} 2024-09-21T01:43:11.717 INFO:teuthology.orchestra.run.smithi083.stderr:dumped fsmap epoch 21 2024-09-21T01:43:11.719 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:11.718+0000 7f3dc2cd4640 1 -- 172.21.15.83:0/849821246 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f3dac0b6700 msgr2=0x7f3dac0b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:43:11.719 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:11.718+0000 7f3dc2cd4640 1 --2- 172.21.15.83:0/849821246 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f3dac0b6700 0x7f3dac0b8c10 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f3dbc06c940 tx=0x7f3db0005f90 comp rx=0 tx=0).stop 2024-09-21T01:43:11.719 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:11.718+0000 7f3dc2cd4640 1 -- 172.21.15.83:0/849821246 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3dbc105320 msgr2=0x7f3dbc19a9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:43:11.719 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:11.718+0000 7f3dc2cd4640 1 --2- 172.21.15.83:0/849821246 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3dbc105320 0x7f3dbc19a9c0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f3da800e9f0 tx=0x7f3da800eeb0 comp rx=0 tx=0).stop 2024-09-21T01:43:11.719 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:11.718+0000 7f3dc2cd4640 1 -- 172.21.15.83:0/849821246 shutdown_connections 2024-09-21T01:43:11.719 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:11.718+0000 7f3dc2cd4640 1 --2- 172.21.15.83:0/849821246 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f3dac0b6700 0x7f3dac0b8c10 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:43:11.719 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:11.718+0000 7f3dc2cd4640 1 --2- 172.21.15.83:0/849821246 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3dbc10de30 0x7f3dbc19fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:43:11.720 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:11.718+0000 7f3dc2cd4640 1 --2- 172.21.15.83:0/849821246 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3dbc105320 0x7f3dbc19a9c0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:43:11.720 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:11.718+0000 7f3dc2cd4640 1 --2- 172.21.15.83:0/849821246 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3dbc1049d0 0x7f3dbc19a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:43:11.720 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:11.718+0000 7f3dc2cd4640 1 -- 172.21.15.83:0/849821246 >> 172.21.15.83:0/849821246 conn(0x7f3dbc079740 msgr2=0x7f3dbc106270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:43:11.720 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:11.719+0000 7f3dc2cd4640 1 -- 172.21.15.83:0/849821246 shutdown_connections 2024-09-21T01:43:11.720 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:11.719+0000 7f3dc2cd4640 1 -- 172.21.15.83:0/849821246 wait complete. 2024-09-21T01:43:12.053 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:43:11 smithi083 ceph-mon[31370]: pgmap v373: 129 pgs: 129 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-21T01:43:12.053 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:43:11 smithi083 ceph-mon[31370]: from='client.? 172.21.15.83:0/849821246' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:43:12.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:43:11 smithi142 ceph-mon[34050]: pgmap v373: 129 pgs: 129 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-21T01:43:12.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:43:11 smithi142 ceph-mon[34050]: from='client.? 172.21.15.83:0/849821246' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:43:12.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:43:11 smithi119 ceph-mon[33693]: pgmap v373: 129 pgs: 129 active+clean; 1.4 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-21T01:43:12.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:43:11 smithi119 ceph-mon[33693]: from='client.? 172.21.15.83:0/849821246' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:43:12.443 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24653 quiesce db / --timeout 90 --expiration 137.0 --await-for 45.0' 2024-09-21T01:43:12.444 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24653 quiesce db / --timeout 90 --expiration 137.0 --await-for 45.0 2024-09-21T01:43:12.711 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:43:13.207 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.206+0000 7f08cce97640 1 -- 172.21.15.83:0/3150824030 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f08c8109e30 msgr2=0x7f08c8110660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:43:13.207 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.206+0000 7f08cce97640 1 --2- 172.21.15.83:0/3150824030 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f08c8109e30 0x7f08c8110660 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f08c0009ca0 tx=0x7f08c002a8c0 comp rx=0 tx=0).stop 2024-09-21T01:43:13.207 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.206+0000 7f08cce97640 1 -- 172.21.15.83:0/3150824030 shutdown_connections 2024-09-21T01:43:13.207 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.206+0000 7f08cce97640 1 --2- 172.21.15.83:0/3150824030 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f08c8109e30 0x7f08c8110660 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:43:13.207 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.206+0000 7f08cce97640 1 --2- 172.21.15.83:0/3150824030 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f08c81094e0 0x7f08c81098f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:43:13.207 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.206+0000 7f08cce97640 1 --2- 172.21.15.83:0/3150824030 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f08c8103ba0 0x7f08c8103fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:43:13.207 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.206+0000 7f08cce97640 1 -- 172.21.15.83:0/3150824030 >> 172.21.15.83:0/3150824030 conn(0x7f08c80ff5f0 msgr2=0x7f08c8101a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:43:13.207 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.206+0000 7f08cce97640 1 -- 172.21.15.83:0/3150824030 shutdown_connections 2024-09-21T01:43:13.207 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.206+0000 7f08cce97640 1 -- 172.21.15.83:0/3150824030 wait complete. 2024-09-21T01:43:13.209 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.207+0000 7f08cce97640 1 Processor -- start 2024-09-21T01:43:13.209 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.207+0000 7f08cce97640 1 -- start start 2024-09-21T01:43:13.209 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.207+0000 7f08cce97640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f08c8103ba0 0x7f08c8075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:43:13.209 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.207+0000 7f08cce97640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f08c81094e0 0x7f08c8075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:43:13.209 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.207+0000 7f08cce97640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f08c8109e30 0x7f08c8076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:43:13.209 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.207+0000 7f08cce97640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f08c81139f0 con 0x7f08c8103ba0 2024-09-21T01:43:13.209 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.207+0000 7f08cce97640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f08c8113870 con 0x7f08c8109e30 2024-09-21T01:43:13.209 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.207+0000 7f08cce97640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f08c8113b70 con 0x7f08c81094e0 2024-09-21T01:43:13.209 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.207+0000 7f08c659c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f08c8103ba0 0x7f08c8075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:43:13.209 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.207+0000 7f08c5d9b640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f08c81094e0 0x7f08c8075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:43:13.209 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.207+0000 7f08c659c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f08c8103ba0 0x7f08c8075710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:60392/0 (socket says 172.21.15.83:60392) 2024-09-21T01:43:13.210 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.207+0000 7f08c659c640 1 -- 172.21.15.83:0/1791798319 learned_addr learned my addr 172.21.15.83:0/1791798319 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:43:13.210 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.208+0000 7f08c6d9d640 1 --2- 172.21.15.83:0/1791798319 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f08c8109e30 0x7f08c8076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:43:13.210 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.208+0000 7f08c659c640 1 -- 172.21.15.83:0/1791798319 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f08c81094e0 msgr2=0x7f08c8075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:43:13.210 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.208+0000 7f08c659c640 1 --2- 172.21.15.83:0/1791798319 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f08c81094e0 0x7f08c8075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:43:13.210 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.208+0000 7f08c659c640 1 -- 172.21.15.83:0/1791798319 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f08c8109e30 msgr2=0x7f08c8076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:43:13.210 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.208+0000 7f08c659c640 1 --2- 172.21.15.83:0/1791798319 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f08c8109e30 0x7f08c8076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:43:13.210 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.208+0000 7f08c659c640 1 -- 172.21.15.83:0/1791798319 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08c81a86c0 con 0x7f08c8103ba0 2024-09-21T01:43:13.210 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.208+0000 7f08c5d9b640 1 --2- 172.21.15.83:0/1791798319 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f08c81094e0 0x7f08c8075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:43:13.210 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.208+0000 7f08c659c640 1 --2- 172.21.15.83:0/1791798319 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f08c8103ba0 0x7f08c8075710 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f08b800e9f0 tx=0x7f08b800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:43:13.210 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.208+0000 7f08b77fe640 1 -- 172.21.15.83:0/1791798319 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08b800cd80 con 0x7f08c8103ba0 2024-09-21T01:43:13.210 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.208+0000 7f08cce97640 1 -- 172.21.15.83:0/1791798319 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08c81a89b0 con 0x7f08c8103ba0 2024-09-21T01:43:13.210 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.208+0000 7f08b77fe640 1 -- 172.21.15.83:0/1791798319 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f08b80054b0 con 0x7f08c8103ba0 2024-09-21T01:43:13.211 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.208+0000 7f08b77fe640 1 -- 172.21.15.83:0/1791798319 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08b8010430 con 0x7f08c8103ba0 2024-09-21T01:43:13.211 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.208+0000 7f08cce97640 1 -- 172.21.15.83:0/1791798319 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08c81a8ef0 con 0x7f08c8103ba0 2024-09-21T01:43:13.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.211+0000 7f08d340b740 1 Processor -- start 2024-09-21T01:43:13.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.211+0000 7f08d340b740 1 -- start start 2024-09-21T01:43:13.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.211+0000 7f08b77fe640 1 -- 172.21.15.83:0/1791798319 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7f08b80105f0 con 0x7f08c8103ba0 2024-09-21T01:43:13.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.211+0000 7f08d340b740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5557d7bf5840 0x5557d7f9c600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:43:13.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.211+0000 7f08d340b740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5557d7bcc980 0x5557d7f9cb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:43:13.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.211+0000 7f08d340b740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5557d7bd4b60 0x5557d7f9d080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:43:13.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.212+0000 7f08d340b740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x5557d7f12b90 con 0x5557d7bd4b60 2024-09-21T01:43:13.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.212+0000 7f08d340b740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5557d7f01fc0 con 0x5557d7bf5840 2024-09-21T01:43:13.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.212+0000 7f08c5d9b640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5557d7bd4b60 0x5557d7f9d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:43:13.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.212+0000 7f08c5d9b640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5557d7bd4b60 0x5557d7f9d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:60396/0 (socket says 172.21.15.83:60396) 2024-09-21T01:43:13.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.212+0000 7f08c5d9b640 1 -- 172.21.15.83:0/3922719126 learned_addr learned my addr 172.21.15.83:0/3922719126 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:43:13.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.212+0000 7f08d340b740 1 -- 172.21.15.83:0/3922719126 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x5557d7f05dd0 con 0x5557d7bcc980 2024-09-21T01:43:13.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.212+0000 7f08c659c640 1 --2- 172.21.15.83:0/3922719126 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5557d7bcc980 0x5557d7f9cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:43:13.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.212+0000 7f08c6d9d640 1 --2- 172.21.15.83:0/3922719126 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5557d7bf5840 0x5557d7f9c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:43:13.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.212+0000 7f08c659c640 1 -- 172.21.15.83:0/3922719126 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5557d7bf5840 msgr2=0x5557d7f9c600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:43:13.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.212+0000 7f08c659c640 1 --2- 172.21.15.83:0/3922719126 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5557d7bf5840 0x5557d7f9c600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:43:13.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.212+0000 7f08c659c640 1 -- 172.21.15.83:0/3922719126 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5557d7bd4b60 msgr2=0x5557d7f9d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:43:13.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.212+0000 7f08c659c640 1 --2- 172.21.15.83:0/3922719126 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5557d7bd4b60 0x5557d7f9d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:43:13.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.212+0000 7f08c659c640 1 -- 172.21.15.83:0/3922719126 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5557d7e89060 con 0x5557d7bcc980 2024-09-21T01:43:13.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.212+0000 7f08c5d9b640 1 --2- 172.21.15.83:0/3922719126 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5557d7bd4b60 0x5557d7f9d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:43:13.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.212+0000 7f08c659c640 1 --2- 172.21.15.83:0/3922719126 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5557d7bcc980 0x5557d7f9cb40 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f08b80e5300 tx=0x7f08b80ebf80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6edbdd178db2a940 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:43:13.215 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.212+0000 7f08b77fe640 1 --2- 172.21.15.83:0/1791798319 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f08b00b6680 0x7f08b00b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:43:13.215 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.213+0000 7f08b4ff9640 1 -- 172.21.15.83:0/3922719126 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08b80fb070 con 0x5557d7bcc980 2024-09-21T01:43:13.215 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.213+0000 7f08c6d9d640 1 --2- 172.21.15.83:0/1791798319 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f08b00b6680 0x7f08b00b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:43:13.215 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.213+0000 7f08b77fe640 1 -- 172.21.15.83:0/1791798319 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9315+0+0 (secure 0 0 0) 0x7f08b80e7ed0 con 0x7f08c8103ba0 2024-09-21T01:43:13.215 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.213+0000 7f08b4ff9640 1 -- 172.21.15.83:0/3922719126 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f08b80ad510 con 0x5557d7bcc980 2024-09-21T01:43:13.215 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.213+0000 7f08b4ff9640 1 -- 172.21.15.83:0/3922719126 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08b80aa050 con 0x5557d7bcc980 2024-09-21T01:43:13.217 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.214+0000 7f08d340b740 1 -- 172.21.15.83:0/3922719126 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5557d7bcc980 msgr2=0x5557d7f9cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:43:13.217 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.214+0000 7f08c6d9d640 1 --2- 172.21.15.83:0/1791798319 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f08b00b6680 0x7f08b00b8b90 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f08c0009a60 tx=0x7f08c0005c50 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:43:13.218 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.214+0000 7f08d340b740 1 --2- 172.21.15.83:0/3922719126 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5557d7bcc980 0x5557d7f9cb40 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f08b80e5300 tx=0x7f08b80ebf80 comp rx=0 tx=0).stop 2024-09-21T01:43:13.218 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.214+0000 7f08d340b740 1 -- 172.21.15.83:0/3922719126 shutdown_connections 2024-09-21T01:43:13.218 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.214+0000 7f08d340b740 1 --2- 172.21.15.83:0/3922719126 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5557d7bd4b60 0x5557d7f9d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:43:13.218 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.214+0000 7f08d340b740 1 --2- 172.21.15.83:0/3922719126 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5557d7bcc980 0x5557d7f9cb40 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:43:13.218 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.214+0000 7f08d340b740 1 --2- 172.21.15.83:0/3922719126 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5557d7bf5840 0x5557d7f9c600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:43:13.218 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.214+0000 7f08d340b740 1 -- 172.21.15.83:0/3922719126 >> 172.21.15.83:0/3922719126 conn(0x5557d7be9990 msgr2=0x5557d7f9a4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:43:13.218 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.214+0000 7f08d340b740 1 -- 172.21.15.83:0/3922719126 shutdown_connections 2024-09-21T01:43:13.218 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.214+0000 7f08d340b740 1 -- 172.21.15.83:0/3922719126 wait complete. 2024-09-21T01:43:13.218 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.214+0000 7f08d340b740 1 -- start start 2024-09-21T01:43:13.218 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.214+0000 7f08d340b740 1 Processor -- start 2024-09-21T01:43:13.219 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.215+0000 7f08d340b740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5557d7bcc980 0x5557d7fa8220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:43:13.219 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.215+0000 7f08d340b740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5557d7bd4b60 0x5557d7fa87c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:43:13.219 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.215+0000 7f08d340b740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5557d7bf5840 0x5557d7fb40d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:43:13.219 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.215+0000 7f08d340b740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x5557d7d637a0 con 0x5557d7bd4b60 2024-09-21T01:43:13.219 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.215+0000 7f08d340b740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5557d7ea70a0 con 0x5557d7bf5840 2024-09-21T01:43:13.219 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.215+0000 7f08d340b740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x5557d7faade0 con 0x5557d7bcc980 2024-09-21T01:43:13.219 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.215+0000 7f08d340b740 10 client.0 _ll_register_callbacks cb 0x5557d7e843c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:43:13.219 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.215+0000 7f08c5d9b640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5557d7bd4b60 0x5557d7fa87c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:43:13.219 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.215+0000 7f08c659c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5557d7bcc980 0x5557d7fa8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:43:13.219 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.215+0000 7f08c5d9b640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5557d7bd4b60 0x5557d7fa87c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:60404/0 (socket says 172.21.15.83:60404) 2024-09-21T01:43:13.220 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.215+0000 7f08c5d9b640 1 -- 172.21.15.83:0/1702121069 learned_addr learned my addr 172.21.15.83:0/1702121069 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:43:13.220 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.215+0000 7f08c6d9d640 1 --2- 172.21.15.83:0/1702121069 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5557d7bf5840 0x5557d7fb40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:43:13.220 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.215+0000 7f08c5d9b640 1 -- 172.21.15.83:0/1702121069 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5557d7bcc980 msgr2=0x5557d7fa8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:43:13.220 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.215+0000 7f08c5d9b640 1 --2- 172.21.15.83:0/1702121069 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5557d7bcc980 0x5557d7fa8220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:43:13.220 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.215+0000 7f08c5d9b640 1 -- 172.21.15.83:0/1702121069 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5557d7bf5840 msgr2=0x5557d7fb40d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:43:13.220 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.215+0000 7f08c5d9b640 1 --2- 172.21.15.83:0/1702121069 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5557d7bf5840 0x5557d7fb40d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:43:13.220 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.215+0000 7f08c5d9b640 1 -- 172.21.15.83:0/1702121069 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5557d7e95880 con 0x5557d7bd4b60 2024-09-21T01:43:13.220 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.215+0000 7f08c659c640 1 --2- 172.21.15.83:0/1702121069 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5557d7bcc980 0x5557d7fa8220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:43:13.220 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.215+0000 7f08c5d9b640 1 --2- 172.21.15.83:0/1702121069 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5557d7bd4b60 0x5557d7fa87c0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f08bc010f00 tx=0x7f08bc00f7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=812aceeabe441f52 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:43:13.220 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.215+0000 7f08adffb640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-09-21T01:43:13.220 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.215+0000 7f08adffb640 1 -- 172.21.15.83:0/1702121069 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08bc01e060 con 0x5557d7bd4b60 2024-09-21T01:43:13.220 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.216+0000 7f08adffb640 1 -- 172.21.15.83:0/1702121069 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9315+0+0 (secure 0 0 0) 0x7f08bc019410 con 0x5557d7bd4b60 2024-09-21T01:43:13.220 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.216+0000 7f08d340b740 1 -- 172.21.15.83:0/1702121069 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f08b80ad510 con 0x5557d7bd4b60 2024-09-21T01:43:13.220 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.216+0000 7f08adffb640 1 -- 172.21.15.83:0/1702121069 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f08bc025050 con 0x5557d7bd4b60 2024-09-21T01:43:13.221 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.216+0000 7f08d340b740 10 client.15561 fetch_fsmap learned FSMap version 21 2024-09-21T01:43:13.221 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.216+0000 7f08d340b740 1 -- 172.21.15.83:0/1702121069 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5557d7c6fb90 con 0x5557d7bd4b60 2024-09-21T01:43:13.221 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.216+0000 7f08adffb640 1 -- 172.21.15.83:0/1702121069 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f08b80ad510 con 0x5557d7bd4b60 2024-09-21T01:43:13.221 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.216+0000 7f08adffb640 1 -- 172.21.15.83:0/1702121069 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f08bc00e3b0 con 0x5557d7bd4b60 2024-09-21T01:43:13.221 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.216+0000 7f08d340b740 10 client.15561 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T01:43:13.221 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.216+0000 7f08d340b740 10 client.15561 resolve_mds: validated gid 24653 aka daemon mds.b 2024-09-21T01:43:13.221 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.216+0000 7f08d340b740 20 client.15561 populate_metadata read hostname 'smithi083' 2024-09-21T01:43:13.221 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.216+0000 7f08d340b740 1 --2- 172.21.15.83:0/1702121069 >> [v2:172.21.15.119:6838/3106757092,v1:172.21.15.119:6839/3106757092] conn(0x5557d7bb41c0 0x5557d7fba210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:43:13.221 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.216+0000 7f08d340b740 4 client.15561 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:43:13.221 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.216+0000 7f08d340b740 1 -- 172.21.15.83:0/1702121069 --> [v2:172.21.15.119:6838/3106757092,v1:172.21.15.119:6839/3106757092] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5557d7f14ae0 con 0x5557d7bb41c0 2024-09-21T01:43:13.221 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.217+0000 7f08c659c640 1 --2- 172.21.15.83:0/1702121069 >> [v2:172.21.15.119:6838/3106757092,v1:172.21.15.119:6839/3106757092] conn(0x5557d7bb41c0 0x5557d7fba210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:43:13.221 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.217+0000 7f08adffb640 10 client.15561 ms_handle_connect on v2:172.21.15.119:6838/3106757092 2024-09-21T01:43:13.221 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.217+0000 7f08c659c640 1 --2- 172.21.15.83:0/1702121069 >> [v2:172.21.15.119:6838/3106757092,v1:172.21.15.119:6839/3106757092] conn(0x5557d7bb41c0 0x5557d7fba210 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f4eee8708e048f65 server_cookie=4aa73b28a79e2661 in_seq=0 out_seq=0 2024-09-21T01:43:13.222 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.218+0000 7f08adffb640 1 -- 172.21.15.83:0/1702121069 <== mds.0 v2:172.21.15.119:6838/3106757092 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5557d7f14ae0 con 0x5557d7bb41c0 2024-09-21T01:43:13.222 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.218+0000 7f08adffb640 10 client.15561 handle_command_reply: tid=0 2024-09-21T01:43:13.223 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.218+0000 7f08d340b740 1 client.15561 shutdown 2024-09-21T01:43:13.223 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.218+0000 7f08d340b740 1 -- 172.21.15.83:0/1702121069 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5557d7bd4b60 msgr2=0x5557d7fa87c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:43:13.223 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.218+0000 7f08d340b740 1 --2- 172.21.15.83:0/1702121069 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5557d7bd4b60 0x5557d7fa87c0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f08bc010f00 tx=0x7f08bc00f7f0 comp rx=0 tx=0).stop 2024-09-21T01:43:13.223 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.218+0000 7f08d340b740 1 -- 172.21.15.83:0/1702121069 shutdown_connections 2024-09-21T01:43:13.223 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.218+0000 7f08d340b740 1 --2- 172.21.15.83:0/1702121069 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5557d7bf5840 0x5557d7fb40d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:43:13.223 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.218+0000 7f08d340b740 1 --2- 172.21.15.83:0/1702121069 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5557d7bd4b60 0x5557d7fa87c0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:43:13.223 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.218+0000 7f08d340b740 1 --2- 172.21.15.83:0/1702121069 >> [v2:172.21.15.119:6838/3106757092,v1:172.21.15.119:6839/3106757092] conn(0x5557d7bb41c0 0x5557d7fba210 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:43:13.223 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.218+0000 7f08d340b740 1 --2- 172.21.15.83:0/1702121069 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5557d7bcc980 0x5557d7fa8220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:43:13.223 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.218+0000 7f08d340b740 1 -- 172.21.15.83:0/1702121069 >> 172.21.15.83:0/1702121069 conn(0x5557d7be9990 msgr2=0x5557d7f9f7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:43:13.223 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.218+0000 7f08adffb640 0 client.15561 ms_handle_reset on v2:172.21.15.119:6838/3106757092 2024-09-21T01:43:13.223 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.218+0000 7f08d340b740 1 -- 172.21.15.83:0/1702121069 shutdown_connections 2024-09-21T01:43:13.223 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.218+0000 7f08d340b740 1 -- 172.21.15.83:0/1702121069 wait complete. 2024-09-21T01:43:13.223 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.218+0000 7f08d340b740 20 client.15561 trim_cache size 0 max 16384 2024-09-21T01:43:13.238 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.237+0000 7f08d340b740 1 Processor -- start 2024-09-21T01:43:13.238 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.237+0000 7f08d340b740 1 -- start start 2024-09-21T01:43:13.238 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.237+0000 7f08d340b740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5557d7bcc980 0x5557d7f9dff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:43:13.238 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.237+0000 7f08d340b740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5557d7bd4b60 0x5557d7fa9c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:43:13.238 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.237+0000 7f08d340b740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5557d7bf5840 0x5557d7f99aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:43:13.238 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.237+0000 7f08d340b740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f08c81b0dd0 con 0x5557d7bf5840 2024-09-21T01:43:13.238 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.237+0000 7f08d340b740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f08c81b3650 con 0x5557d7bd4b60 2024-09-21T01:43:13.239 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.237+0000 7f08d340b740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f08c81b1440 con 0x5557d7bcc980 2024-09-21T01:43:13.239 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.237+0000 7f08c6d9d640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5557d7bf5840 0x5557d7f99aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:43:13.239 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.237+0000 7f08c6d9d640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5557d7bf5840 0x5557d7f99aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:60410/0 (socket says 172.21.15.83:60410) 2024-09-21T01:43:13.239 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.237+0000 7f08c6d9d640 1 -- 172.21.15.83:0/3199500284 learned_addr learned my addr 172.21.15.83:0/3199500284 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:43:13.239 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.238+0000 7f08c659c640 1 --2- 172.21.15.83:0/3199500284 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5557d7bcc980 0x5557d7f9dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:43:13.239 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.238+0000 7f08c5d9b640 1 --2- 172.21.15.83:0/3199500284 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5557d7bd4b60 0x5557d7fa9c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:43:13.239 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.238+0000 7f08c6d9d640 1 -- 172.21.15.83:0/3199500284 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5557d7bcc980 msgr2=0x5557d7f9dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:43:13.239 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.238+0000 7f08c6d9d640 1 --2- 172.21.15.83:0/3199500284 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5557d7bcc980 0x5557d7f9dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:43:13.239 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.238+0000 7f08c6d9d640 1 -- 172.21.15.83:0/3199500284 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5557d7bd4b60 msgr2=0x5557d7fa9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:43:13.239 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.238+0000 7f08c6d9d640 1 --2- 172.21.15.83:0/3199500284 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5557d7bd4b60 0x5557d7fa9c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:43:13.239 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.238+0000 7f08c6d9d640 1 -- 172.21.15.83:0/3199500284 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5557d7f9ade0 con 0x5557d7bf5840 2024-09-21T01:43:13.239 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.238+0000 7f08c5d9b640 1 --2- 172.21.15.83:0/3199500284 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5557d7bd4b60 0x5557d7fa9c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:43:13.239 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.238+0000 7f08c6d9d640 1 --2- 172.21.15.83:0/3199500284 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5557d7bf5840 0x5557d7f99aa0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f08c0035000 tx=0x7f08c0041000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63385797031d44ab server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:43:13.242 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.238+0000 7f08affff640 1 -- 172.21.15.83:0/3199500284 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08c0032b10 con 0x5557d7bf5840 2024-09-21T01:43:13.242 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.238+0000 7f08affff640 1 -- 172.21.15.83:0/3199500284 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f08c0036040 con 0x5557d7bf5840 2024-09-21T01:43:13.242 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.238+0000 7f08affff640 1 -- 172.21.15.83:0/3199500284 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08c00305c0 con 0x5557d7bf5840 2024-09-21T01:43:13.242 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.239+0000 7f08d340b740 1 -- 172.21.15.83:0/3199500284 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5557d7bf5840 msgr2=0x5557d7f99aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:43:13.243 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.239+0000 7f08d340b740 1 --2- 172.21.15.83:0/3199500284 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5557d7bf5840 0x5557d7f99aa0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f08c0035000 tx=0x7f08c0041000 comp rx=0 tx=0).stop 2024-09-21T01:43:13.243 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.239+0000 7f08d340b740 1 -- 172.21.15.83:0/3199500284 shutdown_connections 2024-09-21T01:43:13.243 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.239+0000 7f08d340b740 1 --2- 172.21.15.83:0/3199500284 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5557d7bf5840 0x5557d7f99aa0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:43:13.243 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.239+0000 7f08d340b740 1 --2- 172.21.15.83:0/3199500284 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5557d7bd4b60 0x5557d7fa9c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:43:13.243 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.239+0000 7f08d340b740 1 --2- 172.21.15.83:0/3199500284 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5557d7bcc980 0x5557d7f9dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:43:13.243 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.239+0000 7f08d340b740 1 -- 172.21.15.83:0/3199500284 >> 172.21.15.83:0/3199500284 conn(0x5557d7be9990 msgr2=0x5557d7fa9540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:43:13.243 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.239+0000 7f08d340b740 1 -- 172.21.15.83:0/3199500284 shutdown_connections 2024-09-21T01:43:13.243 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.239+0000 7f08d340b740 1 -- 172.21.15.83:0/3199500284 wait complete. 2024-09-21T01:43:13.243 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.240+0000 7f08d340b740 1 -- start start 2024-09-21T01:43:13.243 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.240+0000 7f08d340b740 1 Processor -- start 2024-09-21T01:43:13.243 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.240+0000 7f08d340b740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5557d7bcc980 0x5557d7fab800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:43:13.243 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.240+0000 7f08d340b740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5557d7bd4b60 0x5557d7fabd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:43:13.244 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.240+0000 7f08d340b740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5557d7bf5840 0x5557d8024bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:43:13.244 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.240+0000 7f08d340b740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f08c81b1b10 con 0x5557d7bf5840 2024-09-21T01:43:13.244 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.240+0000 7f08d340b740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f08c81b2f80 con 0x5557d7bd4b60 2024-09-21T01:43:13.244 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.240+0000 7f08d340b740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f08c81b21e0 con 0x5557d7bcc980 2024-09-21T01:43:13.244 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.240+0000 7f08d340b740 10 client.0 _ll_register_callbacks cb 0x7f08bc00aaf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:43:13.244 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.240+0000 7f08c659c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5557d7bcc980 0x5557d7fab800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:43:13.244 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.240+0000 7f08c6d9d640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5557d7bf5840 0x5557d8024bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:43:13.244 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.240+0000 7f08c6d9d640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5557d7bf5840 0x5557d8024bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:60416/0 (socket says 172.21.15.83:60416) 2024-09-21T01:43:13.244 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.240+0000 7f08c6d9d640 1 -- 172.21.15.83:0/3528877793 learned_addr learned my addr 172.21.15.83:0/3528877793 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:43:13.244 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.240+0000 7f08c5d9b640 1 --2- 172.21.15.83:0/3528877793 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5557d7bd4b60 0x5557d7fabd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:43:13.244 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.241+0000 7f08c659c640 1 -- 172.21.15.83:0/3528877793 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5557d7bd4b60 msgr2=0x5557d7fabd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:43:13.244 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.241+0000 7f08c659c640 1 --2- 172.21.15.83:0/3528877793 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5557d7bd4b60 0x5557d7fabd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:43:13.245 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.241+0000 7f08c659c640 1 -- 172.21.15.83:0/3528877793 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5557d7bf5840 msgr2=0x5557d8024bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:43:13.245 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.241+0000 7f08c659c640 1 --2- 172.21.15.83:0/3528877793 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5557d7bf5840 0x5557d8024bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:43:13.245 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.241+0000 7f08c659c640 1 -- 172.21.15.83:0/3528877793 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5557d8025190 con 0x5557d7bcc980 2024-09-21T01:43:13.245 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.241+0000 7f08c6d9d640 1 --2- 172.21.15.83:0/3528877793 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5557d7bf5840 0x5557d8024bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:43:13.245 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.241+0000 7f08c659c640 1 --2- 172.21.15.83:0/3528877793 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5557d7bcc980 0x5557d7fab800 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f08b8009380 tx=0x7f08b800cf20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e9985d087da9ffb4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:43:13.245 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.241+0000 7f08adffb640 10 client.0 ms_handle_connect on v2:172.21.15.142:3300/0 2024-09-21T01:43:13.245 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.241+0000 7f08adffb640 1 -- 172.21.15.83:0/3528877793 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08b80ad170 con 0x5557d7bcc980 2024-09-21T01:43:13.245 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.241+0000 7f08adffb640 1 -- 172.21.15.83:0/3528877793 <== mon.1 v2:172.21.15.142:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9315+0+0 (secure 0 0 0) 0x7f08b80b6f90 con 0x5557d7bcc980 2024-09-21T01:43:13.245 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.241+0000 7f08d340b740 1 -- 172.21.15.83:0/3528877793 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f08c0036040 con 0x5557d7bcc980 2024-09-21T01:43:13.245 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.241+0000 7f08adffb640 1 -- 172.21.15.83:0/3528877793 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f08b80ad350 con 0x5557d7bcc980 2024-09-21T01:43:13.245 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.241+0000 7f08d340b740 10 client.25165 fetch_fsmap learned FSMap version 21 2024-09-21T01:43:13.245 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.241+0000 7f08d340b740 1 -- 172.21.15.83:0/3528877793 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5557d80263f0 con 0x5557d7bcc980 2024-09-21T01:43:13.245 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.241+0000 7f08adffb640 1 -- 172.21.15.83:0/3528877793 <== mon.1 v2:172.21.15.142:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f08c0036040 con 0x5557d7bcc980 2024-09-21T01:43:13.245 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.242+0000 7f08adffb640 1 -- 172.21.15.83:0/3528877793 <== mon.1 v2:172.21.15.142:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f08b80b2020 con 0x5557d7bcc980 2024-09-21T01:43:13.246 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.242+0000 7f08d340b740 10 client.25165 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T01:43:13.246 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.242+0000 7f08d340b740 10 client.25165 resolve_mds: validated gid 24653 aka daemon mds.b 2024-09-21T01:43:13.246 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.242+0000 7f08d340b740 20 client.25165 populate_metadata read hostname 'smithi083' 2024-09-21T01:43:13.246 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.242+0000 7f08d340b740 1 --2- 172.21.15.83:0/3528877793 >> [v2:172.21.15.119:6838/3106757092,v1:172.21.15.119:6839/3106757092] conn(0x5557d7b89570 0x5557d8028800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:43:13.246 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.242+0000 7f08d340b740 4 client.25165 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 137.0, "await_for": 45.0}] 2024-09-21T01:43:13.246 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.242+0000 7f08d340b740 1 -- 172.21.15.83:0/3528877793 --> [v2:172.21.15.119:6838/3106757092,v1:172.21.15.119:6839/3106757092] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 137.0, "await_for": 45.0}) -- 0x5557d7f10590 con 0x5557d7b89570 2024-09-21T01:43:13.246 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.242+0000 7f08c5d9b640 1 --2- 172.21.15.83:0/3528877793 >> [v2:172.21.15.119:6838/3106757092,v1:172.21.15.119:6839/3106757092] conn(0x5557d7b89570 0x5557d8028800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:43:13.246 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.242+0000 7f08c5d9b640 1 --2- 172.21.15.83:0/3528877793 >> [v2:172.21.15.119:6838/3106757092,v1:172.21.15.119:6839/3106757092] conn(0x5557d7b89570 0x5557d8028800 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=905591d3825dc13b server_cookie=574bc149ffd01d88 in_seq=0 out_seq=0 2024-09-21T01:43:13.246 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:13.242+0000 7f08adffb640 10 client.25165 ms_handle_connect on v2:172.21.15.119:6838/3106757092 2024-09-21T01:43:14.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:43:13 smithi142 ceph-mon[34050]: pgmap v374: 129 pgs: 129 active+clean; 18 MiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 173 KiB/s rd, 1.4 MiB/s wr, 68 op/s 2024-09-21T01:43:14.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:43:13 smithi119 ceph-mon[33693]: pgmap v374: 129 pgs: 129 active+clean; 18 MiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 173 KiB/s rd, 1.4 MiB/s wr, 68 op/s 2024-09-21T01:43:14.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:43:13 smithi083 ceph-mon[31370]: pgmap v374: 129 pgs: 129 active+clean; 18 MiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 173 KiB/s rd, 1.4 MiB/s wr, 68 op/s 2024-09-21T01:43:14.927 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:14.926+0000 7f08adffb640 1 -- 172.21.15.83:0/3528877793 <== mds.0 v2:172.21.15.119:6838/3106757092 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x5557d7f10590 con 0x5557d7b89570 2024-09-21T01:43:14.927 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:14.926+0000 7f08adffb640 10 client.25165 handle_command_reply: tid=0 2024-09-21T01:43:14.927 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:14.926+0000 7f08d340b740 1 client.25165 shutdown 2024-09-21T01:43:14.927 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:14.926+0000 7f08d340b740 1 -- 172.21.15.83:0/3528877793 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5557d7bcc980 msgr2=0x5557d7fab800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:43:14.927 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:14.926+0000 7f08d340b740 1 --2- 172.21.15.83:0/3528877793 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5557d7bcc980 0x5557d7fab800 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f08b8009380 tx=0x7f08b800cf20 comp rx=0 tx=0).stop 2024-09-21T01:43:14.928 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:14.926+0000 7f08d340b740 1 -- 172.21.15.83:0/3528877793 shutdown_connections 2024-09-21T01:43:14.928 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:14.926+0000 7f08d340b740 1 --2- 172.21.15.83:0/3528877793 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5557d7bf5840 0x5557d8024bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:43:14.928 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:14.926+0000 7f08d340b740 1 --2- 172.21.15.83:0/3528877793 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5557d7bd4b60 0x5557d7fabd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:43:14.928 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:14.926+0000 7f08d340b740 1 --2- 172.21.15.83:0/3528877793 >> [v2:172.21.15.119:6838/3106757092,v1:172.21.15.119:6839/3106757092] conn(0x5557d7b89570 0x5557d8028800 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:43:14.928 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:14.926+0000 7f08d340b740 1 --2- 172.21.15.83:0/3528877793 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5557d7bcc980 0x5557d7fab800 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:43:14.928 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:14.926+0000 7f08adffb640 0 client.25165 ms_handle_reset on v2:172.21.15.119:6838/3106757092 2024-09-21T01:43:14.928 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:14.926+0000 7f08d340b740 1 -- 172.21.15.83:0/3528877793 >> 172.21.15.83:0/3528877793 conn(0x5557d7be9990 msgr2=0x5557d7f9ddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:43:14.928 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:14.927+0000 7f08d340b740 1 -- 172.21.15.83:0/3528877793 shutdown_connections 2024-09-21T01:43:14.928 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:14.927+0000 7f08d340b740 1 -- 172.21.15.83:0/3528877793 wait complete. 2024-09-21T01:43:14.928 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:14.927+0000 7f08d340b740 20 client.25165 trim_cache size 0 max 16384 2024-09-21T01:43:14.929 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-09-21T01:43:14.929 INFO:teuthology.orchestra.run.smithi083.stdout: "epoch": 21, 2024-09-21T01:43:14.929 INFO:teuthology.orchestra.run.smithi083.stdout: "leader": 24653, 2024-09-21T01:43:14.929 INFO:teuthology.orchestra.run.smithi083.stdout: "set_version": 6, 2024-09-21T01:43:14.929 INFO:teuthology.orchestra.run.smithi083.stdout: "sets": { 2024-09-21T01:43:14.929 INFO:teuthology.orchestra.run.smithi083.stdout: "47f710f1": { 2024-09-21T01:43:14.929 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 6, 2024-09-21T01:43:14.929 INFO:teuthology.orchestra.run.smithi083.stdout: "age_ref": 0.0, 2024-09-21T01:43:14.929 INFO:teuthology.orchestra.run.smithi083.stdout: "state": { 2024-09-21T01:43:14.929 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "QUIESCED", 2024-09-21T01:43:14.929 INFO:teuthology.orchestra.run.smithi083.stdout: "age": 0.0 2024-09-21T01:43:14.929 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:43:14.929 INFO:teuthology.orchestra.run.smithi083.stdout: "timeout": 90.0, 2024-09-21T01:43:14.930 INFO:teuthology.orchestra.run.smithi083.stdout: "expiration": 137.0, 2024-09-21T01:43:14.930 INFO:teuthology.orchestra.run.smithi083.stdout: "members": { 2024-09-21T01:43:14.930 INFO:teuthology.orchestra.run.smithi083.stdout: "file:/": { 2024-09-21T01:43:14.930 INFO:teuthology.orchestra.run.smithi083.stdout: "excluded": false, 2024-09-21T01:43:14.930 INFO:teuthology.orchestra.run.smithi083.stdout: "state": { 2024-09-21T01:43:14.930 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "QUIESCED", 2024-09-21T01:43:14.930 INFO:teuthology.orchestra.run.smithi083.stdout: "age": 0.0 2024-09-21T01:43:14.930 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:43:14.930 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:43:14.930 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:43:14.930 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:43:14.930 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:43:14.930 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-09-21T01:43:14.931 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:14.927+0000 7f08cce97640 1 -- 172.21.15.83:0/1791798319 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f08b00b6680 msgr2=0x7f08b00b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:43:14.931 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:14.927+0000 7f08cce97640 1 --2- 172.21.15.83:0/1791798319 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f08b00b6680 0x7f08b00b8b90 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f08c0009a60 tx=0x7f08c0005c50 comp rx=0 tx=0).stop 2024-09-21T01:43:14.931 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:14.927+0000 7f08cce97640 1 -- 172.21.15.83:0/1791798319 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f08c8103ba0 msgr2=0x7f08c8075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:43:14.931 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:14.927+0000 7f08cce97640 1 --2- 172.21.15.83:0/1791798319 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f08c8103ba0 0x7f08c8075710 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f08b800e9f0 tx=0x7f08b800edf0 comp rx=0 tx=0).stop 2024-09-21T01:43:14.931 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:14.927+0000 7f08cce97640 1 -- 172.21.15.83:0/1791798319 shutdown_connections 2024-09-21T01:43:14.931 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:14.927+0000 7f08cce97640 1 --2- 172.21.15.83:0/1791798319 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f08b00b6680 0x7f08b00b8b90 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:43:14.931 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:14.927+0000 7f08cce97640 1 --2- 172.21.15.83:0/1791798319 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f08c8109e30 0x7f08c8076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:43:14.931 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:14.927+0000 7f08cce97640 1 --2- 172.21.15.83:0/1791798319 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f08c81094e0 0x7f08c8075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:43:14.931 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:14.927+0000 7f08cce97640 1 --2- 172.21.15.83:0/1791798319 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f08c8103ba0 0x7f08c8075710 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:43:14.931 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:14.927+0000 7f08cce97640 1 -- 172.21.15.83:0/1791798319 >> 172.21.15.83:0/1791798319 conn(0x7f08c80ff5f0 msgr2=0x7f08c8101a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:43:14.932 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:14.928+0000 7f08cce97640 1 -- 172.21.15.83:0/1791798319 shutdown_connections 2024-09-21T01:43:14.932 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:14.928+0000 7f08cce97640 1 -- 172.21.15.83:0/1791798319 wait complete. 2024-09-21T01:43:15.577 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '47f710f1', quiesce took 4.9 seconds. Will release after: 12.1 2024-09-21T01:43:16.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:43:15 smithi142 ceph-mon[34050]: pgmap v375: 129 pgs: 129 active+clean; 18 MiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 174 KiB/s rd, 1.4 MiB/s wr, 68 op/s 2024-09-21T01:43:16.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:43:15 smithi119 ceph-mon[33693]: pgmap v375: 129 pgs: 129 active+clean; 18 MiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 174 KiB/s rd, 1.4 MiB/s wr, 68 op/s 2024-09-21T01:43:16.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:43:15 smithi083 ceph-mon[31370]: pgmap v375: 129 pgs: 129 active+clean; 18 MiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 174 KiB/s rd, 1.4 MiB/s wr, 68 op/s 2024-09-21T01:43:18.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:43:17 smithi142 ceph-mon[34050]: pgmap v376: 129 pgs: 129 active+clean; 5.8 MiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 402 op/s 2024-09-21T01:43:18.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:43:17 smithi119 ceph-mon[33693]: pgmap v376: 129 pgs: 129 active+clean; 5.8 MiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 402 op/s 2024-09-21T01:43:18.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:43:17 smithi083 ceph-mon[31370]: pgmap v376: 129 pgs: 129 active+clean; 5.8 MiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 402 op/s 2024-09-21T01:43:20.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:43:19 smithi142 ceph-mon[34050]: pgmap v377: 129 pgs: 129 active+clean; 1.8 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 390 op/s 2024-09-21T01:43:20.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:43:19 smithi119 ceph-mon[33693]: pgmap v377: 129 pgs: 129 active+clean; 1.8 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 390 op/s 2024-09-21T01:43:20.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:43:19 smithi083 ceph-mon[31370]: pgmap v377: 129 pgs: 129 active+clean; 1.8 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 390 op/s 2024-09-21T01:43:21.000 INFO:tasks.workunit.client.0.smithi083.stdout:...... 2024-09-21T01:43:21.001 INFO:tasks.workunit.client.0.smithi083.stdout:do_o_direct_reads: SUCCESS 2024-09-21T01:43:22.053 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:43:21 smithi083 ceph-mon[31370]: pgmap v378: 129 pgs: 129 active+clean; 1.8 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 391 op/s 2024-09-21T01:43:22.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:43:21 smithi142 ceph-mon[34050]: pgmap v378: 129 pgs: 129 active+clean; 1.8 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 391 op/s 2024-09-21T01:43:22.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:43:21 smithi119 ceph-mon[33693]: pgmap v378: 129 pgs: 129 active+clean; 1.8 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 391 op/s 2024-09-21T01:43:24.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:43:23 smithi142 ceph-mon[34050]: pgmap v379: 129 pgs: 129 active+clean; 1.8 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.4 MiB/s wr, 501 op/s 2024-09-21T01:43:24.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:43:23 smithi119 ceph-mon[33693]: pgmap v379: 129 pgs: 129 active+clean; 1.8 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.4 MiB/s wr, 501 op/s 2024-09-21T01:43:24.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:43:23 smithi083 ceph-mon[31370]: pgmap v379: 129 pgs: 129 active+clean; 1.8 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.4 MiB/s wr, 501 op/s 2024-09-21T01:43:25.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:43:24 smithi142 ceph-mon[34050]: pgmap v380: 129 pgs: 129 active+clean; 1.9 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 7.2 KiB/s wr, 451 op/s 2024-09-21T01:43:25.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:43:24 smithi119 ceph-mon[33693]: pgmap v380: 129 pgs: 129 active+clean; 1.9 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 7.2 KiB/s wr, 451 op/s 2024-09-21T01:43:25.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:43:24 smithi083 ceph-mon[31370]: pgmap v380: 129 pgs: 129 active+clean; 1.9 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 7.2 KiB/s wr, 451 op/s 2024-09-21T01:43:27.678 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T01:43:27.939 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:43:28.053 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:43:27 smithi083 ceph-mon[31370]: pgmap v381: 129 pgs: 129 active+clean; 1.9 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.7 KiB/s wr, 449 op/s 2024-09-21T01:43:28.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:43:27 smithi142 ceph-mon[34050]: pgmap v381: 129 pgs: 129 active+clean; 1.9 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.7 KiB/s wr, 449 op/s 2024-09-21T01:43:28.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:43:27 smithi119 ceph-mon[33693]: pgmap v381: 129 pgs: 129 active+clean; 1.9 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.7 KiB/s wr, 449 op/s 2024-09-21T01:43:28.715 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:28.423+0000 7f4763fdd640 1 -- 172.21.15.83:0/2964804838 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f475c108cf0 msgr2=0x7f475c10f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:43:28.716 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:28.423+0000 7f4763fdd640 1 --2- 172.21.15.83:0/2964804838 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f475c108cf0 0x7f475c10f520 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f4754009ca0 tx=0x7f475402a8c0 comp rx=0 tx=0).stop 2024-09-21T01:43:28.716 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:28.423+0000 7f4763fdd640 1 -- 172.21.15.83:0/2964804838 shutdown_connections 2024-09-21T01:43:28.716 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:28.423+0000 7f4763fdd640 1 --2- 172.21.15.83:0/2964804838 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f475c108cf0 0x7f475c10f520 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:43:28.716 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:28.423+0000 7f4763fdd640 1 --2- 172.21.15.83:0/2964804838 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f475c1083a0 0x7f475c1087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:43:28.716 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:28.423+0000 7f4763fdd640 1 --2- 172.21.15.83:0/2964804838 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f475c102a60 0x7f475c102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:43:28.716 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:28.423+0000 7f4763fdd640 1 -- 172.21.15.83:0/2964804838 >> 172.21.15.83:0/2964804838 conn(0x7f475c079730 msgr2=0x7f475c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:43:28.716 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:28.423+0000 7f4763fdd640 1 -- 172.21.15.83:0/2964804838 shutdown_connections 2024-09-21T01:43:28.716 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:28.423+0000 7f4763fdd640 1 -- 172.21.15.83:0/2964804838 wait complete. 2024-09-21T01:43:28.716 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:28.424+0000 7f4763fdd640 1 Processor -- start 2024-09-21T01:43:28.716 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:28.424+0000 7f4763fdd640 1 -- start start 2024-09-21T01:43:28.716 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:28.424+0000 7f4763fdd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f475c102a60 0x7f475c199210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:43:28.716 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:28.424+0000 7f4763fdd640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f475c1083a0 0x7f475c1997b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:43:28.716 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:28.424+0000 7f4763fdd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f475c108cf0 0x7f475c19ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:43:28.716 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:28.424+0000 7f4763fdd640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f475c112860 con 0x7f475c102a60 2024-09-21T01:43:28.716 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:28.424+0000 7f4763fdd640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f475c1126e0 con 0x7f475c108cf0 2024-09-21T01:43:28.717 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:28.424+0000 7f4763fdd640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f475c1129e0 con 0x7f475c1083a0 2024-09-21T01:43:28.717 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:28.424+0000 7f4761d79640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f475c102a60 0x7f475c199210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:43:28.717 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:28.424+0000 7f4761d79640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f475c102a60 0x7f475c199210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:53908/0 (socket says 172.21.15.83:53908) 2024-09-21T01:43:28.717 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:28.424+0000 7f4761d79640 1 -- 172.21.15.83:0/3466655069 learned_addr learned my addr 172.21.15.83:0/3466655069 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:43:28.717 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T01:43:28.717 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":21,"btime":"2024-09-21T01:40:27:947059+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14775,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6835/1105040204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":1105040204},{"type":"v1","addr":"172.21.15.83:6835","nonce":1105040204}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14787,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/2234789563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6836","nonce":2234789563},{"type":"v1","addr":"172.21.15.83:6837","nonce":2234789563}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14838,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6839/136258364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6838","nonce":136258364},{"type":"v1","addr":"172.21.15.83:6839","nonce":136258364}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14850,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6841/129439444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6840","nonce":129439444},{"type":"v1","addr":"172.21.15.83:6841","nonce":129439444}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24569,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/2839502433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":2839502433},{"type":"v1","addr":"172.21.15.119:6833","nonce":2839502433}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24580,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6833/2841606990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":2841606990},{"type":"v1","addr":"172.21.15.142:6833","nonce":2841606990}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24599,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/415902608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":415902608},{"type":"v1","addr":"172.21.15.119:6835","nonce":415902608}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24607,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/3009088510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":3009088510},{"type":"v1","addr":"172.21.15.142:6835","nonce":3009088510}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24613,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/3847200126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6836","nonce":3847200126},{"type":"v1","addr":"172.21.15.142:6837","nonce":3847200126}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24626,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/3619222976","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":3619222976},{"type":"v1","addr":"172.21.15.119:6837","nonce":3619222976}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T01:39:45.145124+0000","modified":"2024-09-21T01:40:27.664151+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24653},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24631":{"gid":24631,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.142:6839/1817880741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6838","nonce":1817880741},{"type":"v1","addr":"172.21.15.142:6839","nonce":1817880741}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24653":{"gid":24653,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.119:6839/3106757092","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":3106757092},{"type":"v1","addr":"172.21.15.119:6839","nonce":3106757092}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24653,"qdb_cluster":[24653]},"id":1}]} 2024-09-21T01:43:28.717 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:28.425+0000 7f476257a640 1 --2- 172.21.15.83:0/3466655069 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f475c108cf0 0x7f475c19ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:43:28.718 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:28.425+0000 7f4761578640 1 --2- 172.21.15.83:0/3466655069 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f475c1083a0 0x7f475c1997b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:43:28.718 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:28.425+0000 7f4761d79640 1 -- 172.21.15.83:0/3466655069 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f475c1083a0 msgr2=0x7f475c1997b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:43:28.718 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:28.425+0000 7f4761d79640 1 --2- 172.21.15.83:0/3466655069 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f475c1083a0 0x7f475c1997b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:43:28.718 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:28.425+0000 7f4761d79640 1 -- 172.21.15.83:0/3466655069 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f475c108cf0 msgr2=0x7f475c19ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:43:28.718 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:28.425+0000 7f4761d79640 1 --2- 172.21.15.83:0/3466655069 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f475c108cf0 0x7f475c19ea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:43:28.718 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:28.425+0000 7f4761d79640 1 -- 172.21.15.83:0/3466655069 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f475c19f0c0 con 0x7f475c102a60 2024-09-21T01:43:28.718 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:28.425+0000 7f476257a640 1 --2- 172.21.15.83:0/3466655069 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f475c108cf0 0x7f475c19ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:43:28.718 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:28.425+0000 7f4761d79640 1 --2- 172.21.15.83:0/3466655069 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f475c102a60 0x7f475c199210 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f474c00c920 tx=0x7f474c00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:43:28.718 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:28.425+0000 7f4752ffd640 1 -- 172.21.15.83:0/3466655069 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f474c007c70 con 0x7f475c102a60 2024-09-21T01:43:28.718 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:28.425+0000 7f4752ffd640 1 -- 172.21.15.83:0/3466655069 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f474c007e10 con 0x7f475c102a60 2024-09-21T01:43:28.718 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:28.425+0000 7f4763fdd640 1 -- 172.21.15.83:0/3466655069 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f475c19f3b0 con 0x7f475c102a60 2024-09-21T01:43:28.718 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:28.425+0000 7f4752ffd640 1 -- 172.21.15.83:0/3466655069 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f474c018710 con 0x7f475c102a60 2024-09-21T01:43:28.718 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:28.425+0000 7f4763fdd640 1 -- 172.21.15.83:0/3466655069 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f475c1a5bd0 con 0x7f475c102a60 2024-09-21T01:43:28.718 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:28.426+0000 7f4763fdd640 1 -- 172.21.15.83:0/3466655069 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f475c102e70 con 0x7f475c102a60 2024-09-21T01:43:28.719 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:28.428+0000 7f4752ffd640 1 -- 172.21.15.83:0/3466655069 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7f474c00f450 con 0x7f475c102a60 2024-09-21T01:43:28.719 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:28.428+0000 7f4752ffd640 1 --2- 172.21.15.83:0/3466655069 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f47480b6730 0x7f47480b8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:43:28.719 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:28.428+0000 7f4761578640 1 --2- 172.21.15.83:0/3466655069 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f47480b6730 0x7f47480b8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:43:28.719 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:28.428+0000 7f4752ffd640 1 -- 172.21.15.83:0/3466655069 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9315+0+0 (secure 0 0 0) 0x7f474c0e7e70 con 0x7f475c102a60 2024-09-21T01:43:28.719 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:28.429+0000 7f4761578640 1 --2- 172.21.15.83:0/3466655069 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f47480b6730 0x7f47480b8c40 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f4758005fd0 tx=0x7f4758005850 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:43:28.719 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:28.431+0000 7f4752ffd640 1 -- 172.21.15.83:0/3466655069 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f474c014030 con 0x7f475c102a60 2024-09-21T01:43:28.719 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:28.648+0000 7f4763fdd640 1 -- 172.21.15.83:0/3466655069 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f475c19a340 con 0x7f475c102a60 2024-09-21T01:43:28.719 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:28.649+0000 7f4752ffd640 1 -- 172.21.15.83:0/3466655069 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11857 (secure 0 0 0) 0x7f474c0a9020 con 0x7f475c102a60 2024-09-21T01:43:28.719 INFO:teuthology.orchestra.run.smithi083.stderr:dumped fsmap epoch 21 2024-09-21T01:43:28.719 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:28.651+0000 7f4763fdd640 1 -- 172.21.15.83:0/3466655069 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f47480b6730 msgr2=0x7f47480b8c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:43:28.719 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:28.651+0000 7f4763fdd640 1 --2- 172.21.15.83:0/3466655069 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f47480b6730 0x7f47480b8c40 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f4758005fd0 tx=0x7f4758005850 comp rx=0 tx=0).stop 2024-09-21T01:43:28.719 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:28.651+0000 7f4763fdd640 1 -- 172.21.15.83:0/3466655069 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f475c102a60 msgr2=0x7f475c199210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:43:28.719 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:28.651+0000 7f4763fdd640 1 --2- 172.21.15.83:0/3466655069 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f475c102a60 0x7f475c199210 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f474c00c920 tx=0x7f474c00cde0 comp rx=0 tx=0).stop 2024-09-21T01:43:28.719 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:28.651+0000 7f4763fdd640 1 -- 172.21.15.83:0/3466655069 shutdown_connections 2024-09-21T01:43:28.719 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:28.651+0000 7f4763fdd640 1 --2- 172.21.15.83:0/3466655069 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f47480b6730 0x7f47480b8c40 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:43:28.719 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:28.651+0000 7f4763fdd640 1 --2- 172.21.15.83:0/3466655069 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f475c108cf0 0x7f475c19ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:43:28.720 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:28.651+0000 7f4763fdd640 1 --2- 172.21.15.83:0/3466655069 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f475c1083a0 0x7f475c1997b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:43:28.720 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:28.651+0000 7f4763fdd640 1 --2- 172.21.15.83:0/3466655069 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f475c102a60 0x7f475c199210 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:43:28.720 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:28.651+0000 7f4763fdd640 1 -- 172.21.15.83:0/3466655069 >> 172.21.15.83:0/3466655069 conn(0x7f475c079730 msgr2=0x7f475c1043d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:43:28.720 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:28.651+0000 7f4763fdd640 1 -- 172.21.15.83:0/3466655069 shutdown_connections 2024-09-21T01:43:28.720 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:28.651+0000 7f4763fdd640 1 -- 172.21.15.83:0/3466655069 wait complete. 2024-09-21T01:43:29.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:43:28 smithi083 ceph-mon[31370]: from='client.? 172.21.15.83:0/3466655069' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:43:29.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:43:28 smithi142 ceph-mon[34050]: from='client.? 172.21.15.83:0/3466655069' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:43:29.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:43:28 smithi119 ceph-mon[33693]: from='client.? 172.21.15.83:0/3466655069' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:43:29.349 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24653 quiesce db --set-id 47f710f1 --release --await' 2024-09-21T01:43:29.349 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24653 quiesce db --set-id 47f710f1 --release --await 2024-09-21T01:43:29.597 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:43:30.031 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:43:29 smithi083 ceph-mon[31370]: pgmap v382: 129 pgs: 129 active+clean; 1.9 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 446 KiB/s rd, 4.3 KiB/s wr, 113 op/s 2024-09-21T01:43:30.130 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.127+0000 7f5a6fcbd640 1 -- 172.21.15.83:0/797063146 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5a68108d10 msgr2=0x7f5a6810f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:43:30.130 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.127+0000 7f5a6fcbd640 1 --2- 172.21.15.83:0/797063146 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5a68108d10 0x7f5a6810f540 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f5a60009ca0 tx=0x7f5a6002a8c0 comp rx=0 tx=0).stop 2024-09-21T01:43:30.130 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.127+0000 7f5a6fcbd640 1 -- 172.21.15.83:0/797063146 shutdown_connections 2024-09-21T01:43:30.130 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.127+0000 7f5a6fcbd640 1 --2- 172.21.15.83:0/797063146 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5a68108d10 0x7f5a6810f540 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:43:30.130 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.127+0000 7f5a6fcbd640 1 --2- 172.21.15.83:0/797063146 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5a681083c0 0x7f5a681087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:43:30.130 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.127+0000 7f5a6fcbd640 1 --2- 172.21.15.83:0/797063146 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5a68102a80 0x7f5a68102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:43:30.131 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.127+0000 7f5a6fcbd640 1 -- 172.21.15.83:0/797063146 >> 172.21.15.83:0/797063146 conn(0x7f5a68079740 msgr2=0x7f5a68079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:43:30.131 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.127+0000 7f5a6fcbd640 1 -- 172.21.15.83:0/797063146 shutdown_connections 2024-09-21T01:43:30.131 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.127+0000 7f5a6fcbd640 1 -- 172.21.15.83:0/797063146 wait complete. 2024-09-21T01:43:30.131 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.128+0000 7f5a6fcbd640 1 Processor -- start 2024-09-21T01:43:30.131 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.128+0000 7f5a6fcbd640 1 -- start start 2024-09-21T01:43:30.131 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.128+0000 7f5a6fcbd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5a68102a80 0x7f5a6819b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:43:30.131 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.128+0000 7f5a6fcbd640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5a681083c0 0x7f5a6819b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:43:30.131 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.128+0000 7f5a6fcbd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5a68108d10 0x7f5a6819bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:43:30.131 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.128+0000 7f5a6fcbd640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f5a68112880 con 0x7f5a68108d10 2024-09-21T01:43:30.131 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.128+0000 7f5a6fcbd640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f5a68112700 con 0x7f5a68102a80 2024-09-21T01:43:30.131 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.128+0000 7f5a6fcbd640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f5a68112a00 con 0x7f5a681083c0 2024-09-21T01:43:30.131 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.128+0000 7f5a6e25a640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5a68108d10 0x7f5a6819bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:43:30.131 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.128+0000 7f5a6da59640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5a68102a80 0x7f5a6819b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:43:30.131 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.128+0000 7f5a6e25a640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5a68108d10 0x7f5a6819bbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:53932/0 (socket says 172.21.15.83:53932) 2024-09-21T01:43:30.131 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.128+0000 7f5a6e25a640 1 -- 172.21.15.83:0/3719240171 learned_addr learned my addr 172.21.15.83:0/3719240171 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:43:30.132 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.128+0000 7f5a6d258640 1 --2- 172.21.15.83:0/3719240171 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5a681083c0 0x7f5a6819b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:43:30.132 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.129+0000 7f5a6e25a640 1 -- 172.21.15.83:0/3719240171 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5a681083c0 msgr2=0x7f5a6819b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:43:30.132 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.129+0000 7f5a6e25a640 1 --2- 172.21.15.83:0/3719240171 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5a681083c0 0x7f5a6819b670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:43:30.132 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.129+0000 7f5a6e25a640 1 -- 172.21.15.83:0/3719240171 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5a68102a80 msgr2=0x7f5a6819b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:43:30.132 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.129+0000 7f5a6e25a640 1 --2- 172.21.15.83:0/3719240171 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5a68102a80 0x7f5a6819b130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:43:30.132 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.129+0000 7f5a6e25a640 1 -- 172.21.15.83:0/3719240171 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a681a63f0 con 0x7f5a68108d10 2024-09-21T01:43:30.132 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.129+0000 7f5a6e25a640 1 --2- 172.21.15.83:0/3719240171 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5a68108d10 0x7f5a6819bbb0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f5a60031040 tx=0x7f5a60032bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:43:30.132 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.129+0000 7f5a5effd640 1 -- 172.21.15.83:0/3719240171 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a60004040 con 0x7f5a68108d10 2024-09-21T01:43:30.133 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.129+0000 7f5a5effd640 1 -- 172.21.15.83:0/3719240171 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5a60004670 con 0x7f5a68108d10 2024-09-21T01:43:30.133 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.129+0000 7f5a5effd640 1 -- 172.21.15.83:0/3719240171 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a60030bb0 con 0x7f5a68108d10 2024-09-21T01:43:30.133 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.129+0000 7f5a6fcbd640 1 -- 172.21.15.83:0/3719240171 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a68198f20 con 0x7f5a68108d10 2024-09-21T01:43:30.133 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.129+0000 7f5a6fcbd640 1 -- 172.21.15.83:0/3719240171 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a68199410 con 0x7f5a68108d10 2024-09-21T01:43:30.133 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.132+0000 7f5a76231740 1 Processor -- start 2024-09-21T01:43:30.133 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.132+0000 7f5a5effd640 1 -- 172.21.15.83:0/3719240171 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7f5a600041e0 con 0x7f5a68108d10 2024-09-21T01:43:30.135 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.132+0000 7f5a76231740 1 -- start start 2024-09-21T01:43:30.136 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.132+0000 7f5a76231740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55cb4bfe4520 0x55cb4c38a510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:43:30.136 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.132+0000 7f5a76231740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55cb4bfbb660 0x55cb4c38aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:43:30.136 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.132+0000 7f5a76231740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55cb4bfc3840 0x55cb4c38af90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:43:30.136 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.132+0000 7f5a76231740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55cb4c275dc0 con 0x55cb4bfc3840 2024-09-21T01:43:30.136 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.132+0000 7f5a76231740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55cb4c3021f0 con 0x55cb4bfe4520 2024-09-21T01:43:30.136 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.132+0000 7f5a76231740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55cb4c2f1620 con 0x55cb4bfbb660 2024-09-21T01:43:30.136 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.132+0000 7f5a6d258640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55cb4bfc3840 0x55cb4c38af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:43:30.136 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.132+0000 7f5a6d258640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55cb4bfc3840 0x55cb4c38af90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:53934/0 (socket says 172.21.15.83:53934) 2024-09-21T01:43:30.136 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.132+0000 7f5a6d258640 1 -- 172.21.15.83:0/4153144088 learned_addr learned my addr 172.21.15.83:0/4153144088 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:43:30.136 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.133+0000 7f5a6d258640 1 --2- 172.21.15.83:0/4153144088 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55cb4bfe4520 0x55cb4c38a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:43:30.136 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.133+0000 7f5a6da59640 1 --2- 172.21.15.83:0/4153144088 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55cb4bfbb660 0x55cb4c38aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:43:30.136 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.133+0000 7f5a5effd640 1 --2- 172.21.15.83:0/3719240171 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f5a540b6680 0x7f5a540b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:43:30.136 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.133+0000 7f5a6d258640 1 -- 172.21.15.83:0/4153144088 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55cb4bfbb660 msgr2=0x55cb4c38aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:43:30.137 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.133+0000 7f5a6d258640 1 --2- 172.21.15.83:0/4153144088 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55cb4bfbb660 0x55cb4c38aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:43:30.137 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.133+0000 7f5a6d258640 1 -- 172.21.15.83:0/4153144088 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55cb4bfe4520 msgr2=0x55cb4c38a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:43:30.137 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.133+0000 7f5a6d258640 1 --2- 172.21.15.83:0/4153144088 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55cb4bfe4520 0x55cb4c38a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:43:30.137 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.133+0000 7f5a6d258640 1 -- 172.21.15.83:0/4153144088 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cb4c2b9fd0 con 0x55cb4bfc3840 2024-09-21T01:43:30.137 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.133+0000 7f5a6da59640 1 --2- 172.21.15.83:0/4153144088 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55cb4bfbb660 0x55cb4c38aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:43:30.137 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.133+0000 7f5a6e25a640 1 --2- 172.21.15.83:0/3719240171 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f5a540b6680 0x7f5a540b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:43:30.137 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.133+0000 7f5a5effd640 1 -- 172.21.15.83:0/3719240171 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9315+0+0 (secure 0 0 0) 0x7f5a60108da0 con 0x7f5a68108d10 2024-09-21T01:43:30.137 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.133+0000 7f5a6d258640 1 --2- 172.21.15.83:0/4153144088 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55cb4bfc3840 0x55cb4c38af90 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f5a58005880 tx=0x7f5a58004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4135385315360a7a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:43:30.137 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.133+0000 7f5a53fff640 1 -- 172.21.15.83:0/4153144088 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a58012ce0 con 0x55cb4bfc3840 2024-09-21T01:43:30.137 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.133+0000 7f5a6e25a640 1 --2- 172.21.15.83:0/3719240171 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f5a540b6680 0x7f5a540b8b90 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f5a600ce5d0 tx=0x7f5a60037e60 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:43:30.137 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.133+0000 7f5a53fff640 1 -- 172.21.15.83:0/4153144088 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5a580044c0 con 0x55cb4bfc3840 2024-09-21T01:43:30.137 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.133+0000 7f5a53fff640 1 -- 172.21.15.83:0/4153144088 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a580047a0 con 0x55cb4bfc3840 2024-09-21T01:43:30.137 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.134+0000 7f5a76231740 1 -- 172.21.15.83:0/4153144088 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55cb4bfc3840 msgr2=0x55cb4c38af90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:43:30.137 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.134+0000 7f5a76231740 1 --2- 172.21.15.83:0/4153144088 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55cb4bfc3840 0x55cb4c38af90 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f5a58005880 tx=0x7f5a58004730 comp rx=0 tx=0).stop 2024-09-21T01:43:30.138 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.134+0000 7f5a76231740 1 -- 172.21.15.83:0/4153144088 shutdown_connections 2024-09-21T01:43:30.138 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.134+0000 7f5a76231740 1 --2- 172.21.15.83:0/4153144088 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55cb4bfc3840 0x55cb4c38af90 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:43:30.138 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.134+0000 7f5a76231740 1 --2- 172.21.15.83:0/4153144088 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55cb4bfbb660 0x55cb4c38aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:43:30.138 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.134+0000 7f5a76231740 1 --2- 172.21.15.83:0/4153144088 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55cb4bfe4520 0x55cb4c38a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:43:30.138 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.134+0000 7f5a76231740 1 -- 172.21.15.83:0/4153144088 >> 172.21.15.83:0/4153144088 conn(0x55cb4bfd8910 msgr2=0x55cb4c388400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:43:30.138 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.134+0000 7f5a76231740 1 -- 172.21.15.83:0/4153144088 shutdown_connections 2024-09-21T01:43:30.138 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.135+0000 7f5a76231740 1 -- 172.21.15.83:0/4153144088 wait complete. 2024-09-21T01:43:30.141 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.135+0000 7f5a76231740 1 -- start start 2024-09-21T01:43:30.141 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.135+0000 7f5a76231740 1 Processor -- start 2024-09-21T01:43:30.141 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.135+0000 7f5a76231740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55cb4bfbb660 0x55cb4c395c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:43:30.141 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.135+0000 7f5a76231740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55cb4bfc3840 0x55cb4c396150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:43:30.141 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.135+0000 7f5a76231740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55cb4bfe4520 0x55cb4c3a1e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:43:30.141 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.135+0000 7f5a76231740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55cb4c28c300 con 0x55cb4bfbb660 2024-09-21T01:43:30.142 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.135+0000 7f5a76231740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55cb4c2f5430 con 0x55cb4bfc3840 2024-09-21T01:43:30.142 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.135+0000 7f5a76231740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55cb4c152bb0 con 0x55cb4bfe4520 2024-09-21T01:43:30.142 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.136+0000 7f5a76231740 10 client.0 _ll_register_callbacks cb 0x55cb4c2a6120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:43:30.142 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.136+0000 7f5a6d258640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55cb4bfbb660 0x55cb4c395c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:43:30.142 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.136+0000 7f5a6d258640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55cb4bfbb660 0x55cb4c395c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:53946/0 (socket says 172.21.15.83:53946) 2024-09-21T01:43:30.142 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.136+0000 7f5a6d258640 1 -- 172.21.15.83:0/163864003 learned_addr learned my addr 172.21.15.83:0/163864003 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:43:30.142 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.136+0000 7f5a6d258640 1 -- 172.21.15.83:0/163864003 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55cb4bfe4520 msgr2=0x55cb4c3a1e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:43:30.142 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.136+0000 7f5a6da59640 1 --2- 172.21.15.83:0/163864003 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55cb4bfc3840 0x55cb4c396150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:43:30.142 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.136+0000 7f5a6d258640 1 --2- 172.21.15.83:0/163864003 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55cb4bfe4520 0x55cb4c3a1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:43:30.142 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.136+0000 7f5a6d258640 1 -- 172.21.15.83:0/163864003 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55cb4bfc3840 msgr2=0x55cb4c396150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:43:30.142 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.136+0000 7f5a6d258640 1 --2- 172.21.15.83:0/163864003 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55cb4bfc3840 0x55cb4c396150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:43:30.143 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.136+0000 7f5a6d258640 1 -- 172.21.15.83:0/163864003 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cb4c27b780 con 0x55cb4bfbb660 2024-09-21T01:43:30.143 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.136+0000 7f5a6d258640 1 --2- 172.21.15.83:0/163864003 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55cb4bfbb660 0x55cb4c395c10 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f5a58005480 tx=0x7f5a58012f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efd186a68a7be7c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:43:30.143 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.136+0000 7f5a517fa640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-09-21T01:43:30.143 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.136+0000 7f5a517fa640 1 -- 172.21.15.83:0/163864003 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a580049a0 con 0x55cb4bfbb660 2024-09-21T01:43:30.143 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.136+0000 7f5a517fa640 1 -- 172.21.15.83:0/163864003 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9315+0+0 (secure 0 0 0) 0x7f5a58004b40 con 0x55cb4bfbb660 2024-09-21T01:43:30.143 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.136+0000 7f5a76231740 1 -- 172.21.15.83:0/163864003 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55cb4c304140 con 0x55cb4bfbb660 2024-09-21T01:43:30.143 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.136+0000 7f5a517fa640 1 -- 172.21.15.83:0/163864003 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f5a58004d40 con 0x55cb4bfbb660 2024-09-21T01:43:30.143 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.136+0000 7f5a76231740 10 client.15585 fetch_fsmap learned FSMap version 21 2024-09-21T01:43:30.143 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.136+0000 7f5a76231740 1 -- 172.21.15.83:0/163864003 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55cb4c04fb00 con 0x55cb4bfbb660 2024-09-21T01:43:30.143 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.137+0000 7f5a517fa640 1 -- 172.21.15.83:0/163864003 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55cb4c304140 con 0x55cb4bfbb660 2024-09-21T01:43:30.143 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.137+0000 7f5a517fa640 1 -- 172.21.15.83:0/163864003 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f5a5801f5b0 con 0x55cb4bfbb660 2024-09-21T01:43:30.143 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.137+0000 7f5a76231740 10 client.15585 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T01:43:30.143 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.137+0000 7f5a76231740 10 client.15585 resolve_mds: validated gid 24653 aka daemon mds.b 2024-09-21T01:43:30.143 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.137+0000 7f5a76231740 20 client.15585 populate_metadata read hostname 'smithi083' 2024-09-21T01:43:30.143 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.137+0000 7f5a76231740 1 --2- 172.21.15.83:0/163864003 >> [v2:172.21.15.119:6838/3106757092,v1:172.21.15.119:6839/3106757092] conn(0x55cb4bfa2ea0 0x55cb4c3a7e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:43:30.144 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.137+0000 7f5a76231740 4 client.15585 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:43:30.144 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.137+0000 7f5a76231740 1 -- 172.21.15.83:0/163864003 --> [v2:172.21.15.119:6838/3106757092,v1:172.21.15.119:6839/3106757092] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cb4c2ffbf0 con 0x55cb4bfa2ea0 2024-09-21T01:43:30.144 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.137+0000 7f5a6da59640 1 --2- 172.21.15.83:0/163864003 >> [v2:172.21.15.119:6838/3106757092,v1:172.21.15.119:6839/3106757092] conn(0x55cb4bfa2ea0 0x55cb4c3a7e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:43:30.144 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.138+0000 7f5a6da59640 1 --2- 172.21.15.83:0/163864003 >> [v2:172.21.15.119:6838/3106757092,v1:172.21.15.119:6839/3106757092] conn(0x55cb4bfa2ea0 0x55cb4c3a7e00 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d947a064f5cb7b8f server_cookie=d9b3a368da8f6726 in_seq=0 out_seq=0 2024-09-21T01:43:30.144 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.138+0000 7f5a517fa640 10 client.15585 ms_handle_connect on v2:172.21.15.119:6838/3106757092 2024-09-21T01:43:30.144 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.138+0000 7f5a517fa640 1 -- 172.21.15.83:0/163864003 <== mds.0 v2:172.21.15.119:6838/3106757092 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55cb4c2ffbf0 con 0x55cb4bfa2ea0 2024-09-21T01:43:30.144 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.138+0000 7f5a517fa640 10 client.15585 handle_command_reply: tid=0 2024-09-21T01:43:30.144 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.138+0000 7f5a76231740 1 client.15585 shutdown 2024-09-21T01:43:30.144 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.138+0000 7f5a76231740 1 -- 172.21.15.83:0/163864003 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55cb4bfbb660 msgr2=0x55cb4c395c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:43:30.144 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.138+0000 7f5a76231740 1 --2- 172.21.15.83:0/163864003 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55cb4bfbb660 0x55cb4c395c10 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f5a58005480 tx=0x7f5a58012f10 comp rx=0 tx=0).stop 2024-09-21T01:43:30.144 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.139+0000 7f5a76231740 1 -- 172.21.15.83:0/163864003 shutdown_connections 2024-09-21T01:43:30.144 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.139+0000 7f5a76231740 1 --2- 172.21.15.83:0/163864003 >> [v2:172.21.15.119:6838/3106757092,v1:172.21.15.119:6839/3106757092] conn(0x55cb4bfa2ea0 0x55cb4c3a7e00 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:43:30.144 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.139+0000 7f5a76231740 1 --2- 172.21.15.83:0/163864003 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55cb4bfe4520 0x55cb4c3a1e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:43:30.144 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.139+0000 7f5a76231740 1 --2- 172.21.15.83:0/163864003 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55cb4bfc3840 0x55cb4c396150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:43:30.144 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.139+0000 7f5a76231740 1 --2- 172.21.15.83:0/163864003 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55cb4bfbb660 0x55cb4c395c10 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:43:30.145 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.139+0000 7f5a76231740 1 -- 172.21.15.83:0/163864003 >> 172.21.15.83:0/163864003 conn(0x55cb4bfd8910 msgr2=0x55cb4c38d6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:43:30.145 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.139+0000 7f5a517fa640 0 client.15585 ms_handle_reset on v2:172.21.15.119:6838/3106757092 2024-09-21T01:43:30.145 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.139+0000 7f5a76231740 1 -- 172.21.15.83:0/163864003 shutdown_connections 2024-09-21T01:43:30.145 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.139+0000 7f5a76231740 1 -- 172.21.15.83:0/163864003 wait complete. 2024-09-21T01:43:30.145 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.139+0000 7f5a76231740 20 client.15585 trim_cache size 0 max 16384 2024-09-21T01:43:30.158 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.156+0000 7f5a76231740 1 Processor -- start 2024-09-21T01:43:30.158 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.156+0000 7f5a76231740 1 -- start start 2024-09-21T01:43:30.158 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.156+0000 7f5a76231740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55cb4bfbb660 0x55cb4c38beb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:43:30.158 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.156+0000 7f5a76231740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55cb4bfc3840 0x55cb4c392e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:43:30.158 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.156+0000 7f5a76231740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55cb4bfe4520 0x55cb4c393340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:43:30.158 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.156+0000 7f5a76231740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f5a681b0da0 con 0x55cb4bfc3840 2024-09-21T01:43:30.158 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.156+0000 7f5a76231740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f5a681b3620 con 0x55cb4bfe4520 2024-09-21T01:43:30.158 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.156+0000 7f5a76231740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f5a681b1410 con 0x55cb4bfbb660 2024-09-21T01:43:30.158 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.156+0000 7f5a6da59640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55cb4bfc3840 0x55cb4c392e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:43:30.158 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.156+0000 7f5a6da59640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55cb4bfc3840 0x55cb4c392e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:53952/0 (socket says 172.21.15.83:53952) 2024-09-21T01:43:30.158 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.156+0000 7f5a6da59640 1 -- 172.21.15.83:0/2995104629 learned_addr learned my addr 172.21.15.83:0/2995104629 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:43:30.158 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.156+0000 7f5a6d258640 1 --2- 172.21.15.83:0/2995104629 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55cb4bfbb660 0x55cb4c38beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:43:30.159 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.156+0000 7f5a6da59640 1 -- 172.21.15.83:0/2995104629 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55cb4bfbb660 msgr2=0x55cb4c38beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:43:30.159 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.156+0000 7f5a6da59640 1 --2- 172.21.15.83:0/2995104629 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55cb4bfbb660 0x55cb4c38beb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:43:30.159 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.156+0000 7f5a6da59640 1 -- 172.21.15.83:0/2995104629 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55cb4bfe4520 msgr2=0x55cb4c393340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:43:30.159 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.156+0000 7f5a6da59640 1 --2- 172.21.15.83:0/2995104629 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55cb4bfe4520 0x55cb4c393340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:43:30.159 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.156+0000 7f5a6da59640 1 -- 172.21.15.83:0/2995104629 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cb4c38cda0 con 0x55cb4bfc3840 2024-09-21T01:43:30.159 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.156+0000 7f5a6da59640 1 --2- 172.21.15.83:0/2995104629 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55cb4bfc3840 0x55cb4c392e00 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f5a6806c3a0 tx=0x7f5a6400af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=889ee4a04cee4dee server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:43:30.159 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.157+0000 7f5a537fe640 1 -- 172.21.15.83:0/2995104629 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a6400fa80 con 0x55cb4bfc3840 2024-09-21T01:43:30.159 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.157+0000 7f5a537fe640 1 -- 172.21.15.83:0/2995104629 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5a640054b0 con 0x55cb4bfc3840 2024-09-21T01:43:30.159 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.157+0000 7f5a537fe640 1 -- 172.21.15.83:0/2995104629 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a64004da0 con 0x55cb4bfc3840 2024-09-21T01:43:30.162 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.157+0000 7f5a76231740 1 -- 172.21.15.83:0/2995104629 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55cb4bfc3840 msgr2=0x55cb4c392e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:43:30.162 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.157+0000 7f5a76231740 1 --2- 172.21.15.83:0/2995104629 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55cb4bfc3840 0x55cb4c392e00 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f5a6806c3a0 tx=0x7f5a6400af40 comp rx=0 tx=0).stop 2024-09-21T01:43:30.162 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.157+0000 7f5a76231740 1 -- 172.21.15.83:0/2995104629 shutdown_connections 2024-09-21T01:43:30.162 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.157+0000 7f5a76231740 1 --2- 172.21.15.83:0/2995104629 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55cb4bfe4520 0x55cb4c393340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:43:30.162 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.157+0000 7f5a76231740 1 --2- 172.21.15.83:0/2995104629 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55cb4bfc3840 0x55cb4c392e00 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:43:30.162 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.157+0000 7f5a76231740 1 --2- 172.21.15.83:0/2995104629 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55cb4bfbb660 0x55cb4c38beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:43:30.162 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.157+0000 7f5a76231740 1 -- 172.21.15.83:0/2995104629 >> 172.21.15.83:0/2995104629 conn(0x55cb4bfd8910 msgr2=0x55cb4c397130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:43:30.162 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.157+0000 7f5a76231740 1 -- 172.21.15.83:0/2995104629 shutdown_connections 2024-09-21T01:43:30.162 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.157+0000 7f5a76231740 1 -- 172.21.15.83:0/2995104629 wait complete. 2024-09-21T01:43:30.162 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.158+0000 7f5a76231740 1 -- start start 2024-09-21T01:43:30.162 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.158+0000 7f5a76231740 1 Processor -- start 2024-09-21T01:43:30.162 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.158+0000 7f5a76231740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55cb4bfbb660 0x55cb4c39a000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:43:30.163 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.158+0000 7f5a76231740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55cb4bfc3840 0x55cb4c39a540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:43:30.163 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.158+0000 7f5a76231740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55cb4bfe4520 0x55cb4c411600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:43:30.163 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.158+0000 7f5a76231740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f5a681b1ae0 con 0x55cb4bfc3840 2024-09-21T01:43:30.163 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.158+0000 7f5a76231740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f5a681b2f50 con 0x55cb4bfe4520 2024-09-21T01:43:30.163 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.158+0000 7f5a76231740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f5a681b21b0 con 0x55cb4bfbb660 2024-09-21T01:43:30.163 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.158+0000 7f5a76231740 10 client.0 _ll_register_callbacks cb 0x7f5a5800be80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:43:30.163 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.158+0000 7f5a6da59640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55cb4bfc3840 0x55cb4c39a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:43:30.163 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.159+0000 7f5a6da59640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55cb4bfc3840 0x55cb4c39a540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:53956/0 (socket says 172.21.15.83:53956) 2024-09-21T01:43:30.163 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.159+0000 7f5a6da59640 1 -- 172.21.15.83:0/4062441882 learned_addr learned my addr 172.21.15.83:0/4062441882 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:43:30.163 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.159+0000 7f5a6d258640 1 --2- 172.21.15.83:0/4062441882 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55cb4bfbb660 0x55cb4c39a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:43:30.163 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.159+0000 7f5a6d258640 1 --2- 172.21.15.83:0/4062441882 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55cb4bfe4520 0x55cb4c411600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:43:30.163 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.159+0000 7f5a6da59640 1 -- 172.21.15.83:0/4062441882 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55cb4bfbb660 msgr2=0x55cb4c39a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:43:30.163 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.159+0000 7f5a6da59640 1 --2- 172.21.15.83:0/4062441882 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55cb4bfbb660 0x55cb4c39a000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:43:30.163 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.159+0000 7f5a6da59640 1 -- 172.21.15.83:0/4062441882 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55cb4bfe4520 msgr2=0x55cb4c411600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:43:30.163 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.159+0000 7f5a6da59640 1 --2- 172.21.15.83:0/4062441882 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55cb4bfe4520 0x55cb4c411600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:43:30.164 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.159+0000 7f5a6da59640 1 -- 172.21.15.83:0/4062441882 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cb4c0c6960 con 0x55cb4bfc3840 2024-09-21T01:43:30.164 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.159+0000 7f5a6d258640 1 --2- 172.21.15.83:0/4062441882 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55cb4bfe4520 0x55cb4c411600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:43:30.164 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.159+0000 7f5a6da59640 1 --2- 172.21.15.83:0/4062441882 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55cb4bfc3840 0x55cb4c39a540 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f5a64004a80 tx=0x7f5a64005250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e694edafdcb141e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:43:30.164 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.159+0000 7f5a517fa640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-09-21T01:43:30.164 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.159+0000 7f5a517fa640 1 -- 172.21.15.83:0/4062441882 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a64004d30 con 0x55cb4bfc3840 2024-09-21T01:43:30.164 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.159+0000 7f5a517fa640 1 -- 172.21.15.83:0/4062441882 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9315+0+0 (secure 0 0 0) 0x7f5a6400fa80 con 0x55cb4bfc3840 2024-09-21T01:43:30.164 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.159+0000 7f5a76231740 1 -- 172.21.15.83:0/4062441882 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5a640054b0 con 0x55cb4bfc3840 2024-09-21T01:43:30.164 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.159+0000 7f5a517fa640 1 -- 172.21.15.83:0/4062441882 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f5a6400fc80 con 0x55cb4bfc3840 2024-09-21T01:43:30.164 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.160+0000 7f5a76231740 10 client.15591 fetch_fsmap learned FSMap version 21 2024-09-21T01:43:30.164 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.160+0000 7f5a76231740 1 -- 172.21.15.83:0/4062441882 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55cb4c412950 con 0x55cb4bfc3840 2024-09-21T01:43:30.164 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.160+0000 7f5a517fa640 1 -- 172.21.15.83:0/4062441882 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5a640054b0 con 0x55cb4bfc3840 2024-09-21T01:43:30.164 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.160+0000 7f5a517fa640 1 -- 172.21.15.83:0/4062441882 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f5a6402d420 con 0x55cb4bfc3840 2024-09-21T01:43:30.164 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.160+0000 7f5a76231740 10 client.15591 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T01:43:30.164 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.160+0000 7f5a76231740 10 client.15591 resolve_mds: validated gid 24653 aka daemon mds.b 2024-09-21T01:43:30.164 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.160+0000 7f5a76231740 20 client.15591 populate_metadata read hostname 'smithi083' 2024-09-21T01:43:30.164 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.160+0000 7f5a76231740 1 --2- 172.21.15.83:0/4062441882 >> [v2:172.21.15.119:6838/3106757092,v1:172.21.15.119:6839/3106757092] conn(0x55cb4bf78250 0x55cb4c4150d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:43:30.165 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.160+0000 7f5a76231740 4 client.15591 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "47f710f1", "release": true, "await": true}] 2024-09-21T01:43:30.165 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.160+0000 7f5a76231740 1 -- 172.21.15.83:0/4062441882 --> [v2:172.21.15.119:6838/3106757092,v1:172.21.15.119:6839/3106757092] -- command(tid 0: {"prefix": "quiesce db", "set_id": "47f710f1", "release": true, "await": true}) -- 0x55cb4c2fd020 con 0x55cb4bf78250 2024-09-21T01:43:30.165 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.160+0000 7f5a6d258640 1 --2- 172.21.15.83:0/4062441882 >> [v2:172.21.15.119:6838/3106757092,v1:172.21.15.119:6839/3106757092] conn(0x55cb4bf78250 0x55cb4c4150d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:43:30.165 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.161+0000 7f5a6d258640 1 --2- 172.21.15.83:0/4062441882 >> [v2:172.21.15.119:6838/3106757092,v1:172.21.15.119:6839/3106757092] conn(0x55cb4bf78250 0x55cb4c4150d0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=34ea5b8e38991c45 server_cookie=a39cc86b05e364f2 in_seq=0 out_seq=0 2024-09-21T01:43:30.165 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.161+0000 7f5a517fa640 10 client.15591 ms_handle_connect on v2:172.21.15.119:6838/3106757092 2024-09-21T01:43:30.166 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.164+0000 7f5a517fa640 1 -- 172.21.15.83:0/4062441882 <== mds.0 v2:172.21.15.119:6838/3106757092 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x55cb4c2fd020 con 0x55cb4bf78250 2024-09-21T01:43:30.166 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.164+0000 7f5a517fa640 10 client.15591 handle_command_reply: tid=0 2024-09-21T01:43:30.166 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.164+0000 7f5a76231740 1 client.15591 shutdown 2024-09-21T01:43:30.166 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.165+0000 7f5a76231740 1 -- 172.21.15.83:0/4062441882 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55cb4bfc3840 msgr2=0x55cb4c39a540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:43:30.166 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.165+0000 7f5a76231740 1 --2- 172.21.15.83:0/4062441882 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55cb4bfc3840 0x55cb4c39a540 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f5a64004a80 tx=0x7f5a64005250 comp rx=0 tx=0).stop 2024-09-21T01:43:30.167 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.165+0000 7f5a76231740 1 -- 172.21.15.83:0/4062441882 shutdown_connections 2024-09-21T01:43:30.167 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.165+0000 7f5a76231740 1 --2- 172.21.15.83:0/4062441882 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55cb4bfe4520 0x55cb4c411600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:43:30.167 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.165+0000 7f5a76231740 1 --2- 172.21.15.83:0/4062441882 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55cb4bfc3840 0x55cb4c39a540 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:43:30.167 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.165+0000 7f5a76231740 1 --2- 172.21.15.83:0/4062441882 >> [v2:172.21.15.119:6838/3106757092,v1:172.21.15.119:6839/3106757092] conn(0x55cb4bf78250 0x55cb4c4150d0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:43:30.167 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.165+0000 7f5a76231740 1 --2- 172.21.15.83:0/4062441882 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55cb4bfbb660 0x55cb4c39a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:43:30.167 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.165+0000 7f5a517fa640 0 client.15591 ms_handle_reset on v2:172.21.15.119:6838/3106757092 2024-09-21T01:43:30.167 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.165+0000 7f5a76231740 1 -- 172.21.15.83:0/4062441882 >> 172.21.15.83:0/4062441882 conn(0x55cb4bfd8910 msgr2=0x55cb4c394490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:43:30.168 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-21T01:43:30.168 DEBUG:teuthology.orchestra.run.smithi083:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-21T01:43:30.168 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.165+0000 7f5a76231740 1 -- 172.21.15.83:0/4062441882 shutdown_connections 2024-09-21T01:43:30.169 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.165+0000 7f5a76231740 1 -- 172.21.15.83:0/4062441882 wait complete. 2024-09-21T01:43:30.169 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.165+0000 7f5a76231740 20 client.15591 trim_cache size 0 max 16384 2024-09-21T01:43:30.169 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-09-21T01:43:30.169 INFO:teuthology.orchestra.run.smithi083.stdout: "epoch": 21, 2024-09-21T01:43:30.169 INFO:teuthology.orchestra.run.smithi083.stdout: "leader": 24653, 2024-09-21T01:43:30.169 INFO:teuthology.orchestra.run.smithi083.stdout: "set_version": 8, 2024-09-21T01:43:30.169 INFO:teuthology.orchestra.run.smithi083.stdout: "sets": { 2024-09-21T01:43:30.169 INFO:teuthology.orchestra.run.smithi083.stdout: "47f710f1": { 2024-09-21T01:43:30.169 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 8, 2024-09-21T01:43:30.169 INFO:teuthology.orchestra.run.smithi083.stdout: "age_ref": 0.0, 2024-09-21T01:43:30.170 INFO:teuthology.orchestra.run.smithi083.stdout: "state": { 2024-09-21T01:43:30.170 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "RELEASED", 2024-09-21T01:43:30.170 INFO:teuthology.orchestra.run.smithi083.stdout: "age": 0.0 2024-09-21T01:43:30.170 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:43:30.170 INFO:teuthology.orchestra.run.smithi083.stdout: "timeout": 90.0, 2024-09-21T01:43:30.170 INFO:teuthology.orchestra.run.smithi083.stdout: "expiration": 137.0, 2024-09-21T01:43:30.170 INFO:teuthology.orchestra.run.smithi083.stdout: "members": { 2024-09-21T01:43:30.170 INFO:teuthology.orchestra.run.smithi083.stdout: "file:/": { 2024-09-21T01:43:30.170 INFO:teuthology.orchestra.run.smithi083.stdout: "excluded": false, 2024-09-21T01:43:30.170 INFO:teuthology.orchestra.run.smithi083.stdout: "state": { 2024-09-21T01:43:30.170 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "RELEASED", 2024-09-21T01:43:30.170 INFO:teuthology.orchestra.run.smithi083.stdout: "age": 0.0 2024-09-21T01:43:30.170 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:43:30.170 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:43:30.170 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:43:30.171 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:43:30.171 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:43:30.171 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-09-21T01:43:30.171 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.166+0000 7f5a6fcbd640 1 -- 172.21.15.83:0/3719240171 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f5a540b6680 msgr2=0x7f5a540b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:43:30.171 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.166+0000 7f5a6fcbd640 1 --2- 172.21.15.83:0/3719240171 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f5a540b6680 0x7f5a540b8b90 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f5a600ce5d0 tx=0x7f5a60037e60 comp rx=0 tx=0).stop 2024-09-21T01:43:30.172 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.166+0000 7f5a6fcbd640 1 -- 172.21.15.83:0/3719240171 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5a68108d10 msgr2=0x7f5a6819bbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:43:30.172 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.166+0000 7f5a6fcbd640 1 --2- 172.21.15.83:0/3719240171 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5a68108d10 0x7f5a6819bbb0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f5a60031040 tx=0x7f5a60032bc0 comp rx=0 tx=0).stop 2024-09-21T01:43:30.172 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.166+0000 7f5a6fcbd640 1 -- 172.21.15.83:0/3719240171 shutdown_connections 2024-09-21T01:43:30.172 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.166+0000 7f5a6fcbd640 1 --2- 172.21.15.83:0/3719240171 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f5a540b6680 0x7f5a540b8b90 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:43:30.172 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.166+0000 7f5a6fcbd640 1 --2- 172.21.15.83:0/3719240171 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5a68108d10 0x7f5a6819bbb0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:43:30.172 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.166+0000 7f5a6fcbd640 1 --2- 172.21.15.83:0/3719240171 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5a681083c0 0x7f5a6819b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:43:30.172 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.166+0000 7f5a6fcbd640 1 --2- 172.21.15.83:0/3719240171 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5a68102a80 0x7f5a6819b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:43:30.172 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.166+0000 7f5a6fcbd640 1 -- 172.21.15.83:0/3719240171 >> 172.21.15.83:0/3719240171 conn(0x7f5a68079740 msgr2=0x7f5a681043d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:43:30.172 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.166+0000 7f5a6fcbd640 1 -- 172.21.15.83:0/3719240171 shutdown_connections 2024-09-21T01:43:30.172 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:43:30.166+0000 7f5a6fcbd640 1 -- 172.21.15.83:0/3719240171 wait complete. 2024-09-21T01:43:30.209 INFO:tasks.workunit:Running workunit direct_io/misc.sh... 2024-09-21T01:43:30.210 DEBUG:teuthology.orchestra.run.smithi083:workunit test direct_io/misc.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1843221895adccfb3b692060251dd6a0183bc410 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io/misc.sh 2024-09-21T01:43:30.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:43:29 smithi142 ceph-mon[34050]: pgmap v382: 129 pgs: 129 active+clean; 1.9 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 446 KiB/s rd, 4.3 KiB/s wr, 113 op/s 2024-09-21T01:43:30.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:43:29 smithi119 ceph-mon[33693]: pgmap v382: 129 pgs: 129 active+clean; 1.9 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 446 KiB/s rd, 4.3 KiB/s wr, 113 op/s 2024-09-21T01:43:30.274 INFO:tasks.workunit.client.0.smithi083.stdout:test read from hole 2024-09-21T01:43:30.275 INFO:tasks.workunit.client.0.smithi083.stderr:+ echo 'test read from hole' 2024-09-21T01:43:30.275 INFO:tasks.workunit.client.0.smithi083.stderr:+ dd if=/dev/zero of=dd3 bs=1 seek=1048576 count=0 2024-09-21T01:43:30.278 INFO:tasks.workunit.client.0.smithi083.stderr:0+0 records in 2024-09-21T01:43:30.278 INFO:tasks.workunit.client.0.smithi083.stderr:0+0 records out 2024-09-21T01:43:30.278 INFO:tasks.workunit.client.0.smithi083.stderr:0 bytes copied, 6.2545e-05 s, 0.0 kB/s 2024-09-21T01:43:30.278 INFO:tasks.workunit.client.0.smithi083.stderr:+ dd if=dd3 of=/tmp/ddout1 skip=8 bs=512 count=2 iflag=direct 2024-09-21T01:43:30.280 INFO:tasks.workunit.client.0.smithi083.stderr:2+0 records in 2024-09-21T01:43:30.281 INFO:tasks.workunit.client.0.smithi083.stderr:2+0 records out 2024-09-21T01:43:30.281 INFO:tasks.workunit.client.0.smithi083.stderr:1024 bytes (1.0 kB, 1.0 KiB) copied, 0.00172449 s, 594 kB/s 2024-09-21T01:43:30.281 INFO:tasks.workunit.client.0.smithi083.stderr:+ dd if=/dev/zero of=/tmp/dd3 bs=512 count=2 2024-09-21T01:43:30.281 INFO:tasks.workunit.client.0.smithi083.stderr:2+0 records in 2024-09-21T01:43:30.281 INFO:tasks.workunit.client.0.smithi083.stderr:2+0 records out 2024-09-21T01:43:30.281 INFO:tasks.workunit.client.0.smithi083.stderr:1024 bytes (1.0 kB, 1.0 KiB) copied, 3.9419e-05 s, 26.0 MB/s 2024-09-21T01:43:30.281 INFO:tasks.workunit.client.0.smithi083.stderr:+ cmp /tmp/dd3 /tmp/ddout1 2024-09-21T01:43:30.282 INFO:tasks.workunit.client.0.smithi083.stdout:other thing 2024-09-21T01:43:30.282 INFO:tasks.workunit.client.0.smithi083.stderr:+ echo 'other thing' 2024-09-21T01:43:30.282 INFO:tasks.workunit.client.0.smithi083.stderr:+ dd if=/dev/urandom of=/tmp/dd10 bs=500 count=1 2024-09-21T01:43:30.283 INFO:tasks.workunit.client.0.smithi083.stderr:1+0 records in 2024-09-21T01:43:30.283 INFO:tasks.workunit.client.0.smithi083.stderr:1+0 records out 2024-09-21T01:43:30.283 INFO:tasks.workunit.client.0.smithi083.stderr:500 bytes copied, 3.9171e-05 s, 12.8 MB/s 2024-09-21T01:43:30.283 INFO:tasks.workunit.client.0.smithi083.stderr:+ dd if=/tmp/dd10 of=dd10 bs=512 seek=8388 count=1 2024-09-21T01:43:30.291 INFO:tasks.workunit.client.0.smithi083.stderr:0+1 records in 2024-09-21T01:43:30.291 INFO:tasks.workunit.client.0.smithi083.stderr:0+1 records out 2024-09-21T01:43:30.292 INFO:tasks.workunit.client.0.smithi083.stderr:500 bytes copied, 0.00580289 s, 86.2 kB/s 2024-09-21T01:43:30.292 INFO:tasks.workunit.client.0.smithi083.stderr:+ dd if=dd10 of=/tmp/dd10out bs=512 skip=8388 count=1 iflag=direct 2024-09-21T01:43:30.298 INFO:tasks.workunit.client.0.smithi083.stderr:0+1 records in 2024-09-21T01:43:30.298 INFO:tasks.workunit.client.0.smithi083.stderr:0+1 records out 2024-09-21T01:43:30.298 INFO:tasks.workunit.client.0.smithi083.stderr:500 bytes copied, 0.00567949 s, 88.0 kB/s 2024-09-21T01:43:30.298 INFO:tasks.workunit.client.0.smithi083.stderr:+ cmp /tmp/dd10 /tmp/dd10out 2024-09-21T01:43:30.299 INFO:tasks.workunit.client.0.smithi083.stdout:OK 2024-09-21T01:43:30.299 INFO:tasks.workunit.client.0.smithi083.stderr:+ echo OK 2024-09-21T01:43:30.299 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-21T01:43:30.300 DEBUG:teuthology.orchestra.run.smithi083:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-21T01:43:30.380 INFO:tasks.workunit:Running workunit direct_io/test_short_dio_read... 2024-09-21T01:43:30.380 DEBUG:teuthology.orchestra.run.smithi083:workunit test direct_io/test_short_dio_read> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1843221895adccfb3b692060251dd6a0183bc410 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io/test_short_dio_read 2024-09-21T01:43:30.453 INFO:tasks.workunit.client.0.smithi083.stdout:writing first 3 bytes of 10k file 2024-09-21T01:43:30.453 INFO:tasks.workunit.client.0.smithi083.stdout:reading O_DIRECT 2024-09-21T01:43:30.454 INFO:tasks.workunit.client.0.smithi083.stdout:got 10000 2024-09-21T01:43:30.454 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-21T01:43:30.454 DEBUG:teuthology.orchestra.run.smithi083:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-21T01:43:30.531 INFO:tasks.workunit:Running workunit direct_io/test_sync_io... 2024-09-21T01:43:30.531 DEBUG:teuthology.orchestra.run.smithi083:workunit test direct_io/test_sync_io> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1843221895adccfb3b692060251dd6a0183bc410 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io/test_sync_io 2024-09-21T01:43:30.850 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '47f710f1', total seconds elapsed: 20.2 2024-09-21T01:43:32.204 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:43:31 smithi083 ceph-mon[31370]: pgmap v383: 129 pgs: 129 active+clean; 1.9 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 446 KiB/s rd, 4.2 KiB/s wr, 114 op/s 2024-09-21T01:43:32.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:43:31 smithi142 ceph-mon[34050]: pgmap v383: 129 pgs: 129 active+clean; 1.9 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 446 KiB/s rd, 4.2 KiB/s wr, 114 op/s 2024-09-21T01:43:32.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:43:31 smithi119 ceph-mon[33693]: pgmap v383: 129 pgs: 129 active+clean; 1.9 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 446 KiB/s rd, 4.2 KiB/s wr, 114 op/s 2024-09-21T01:43:34.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:43:33 smithi142 ceph-mon[34050]: pgmap v384: 129 pgs: 129 active+clean; 2.0 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 445 KiB/s rd, 3.4 KiB/s wr, 113 op/s 2024-09-21T01:43:34.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:43:33 smithi119 ceph-mon[33693]: pgmap v384: 129 pgs: 129 active+clean; 2.0 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 445 KiB/s rd, 3.4 KiB/s wr, 113 op/s 2024-09-21T01:43:34.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:43:33 smithi083 ceph-mon[31370]: pgmap v384: 129 pgs: 129 active+clean; 2.0 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 445 KiB/s rd, 3.4 KiB/s wr, 113 op/s 2024-09-21T01:43:36.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:43:35 smithi142 ceph-mon[34050]: pgmap v385: 129 pgs: 129 active+clean; 2.0 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 8.6 KiB/s wr, 4 op/s 2024-09-21T01:43:36.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:43:35 smithi119 ceph-mon[33693]: pgmap v385: 129 pgs: 129 active+clean; 2.0 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 8.6 KiB/s wr, 4 op/s 2024-09-21T01:43:36.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:43:35 smithi083 ceph-mon[31370]: pgmap v385: 129 pgs: 129 active+clean; 2.0 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 8.6 KiB/s wr, 4 op/s 2024-09-21T01:43:38.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:43:37 smithi142 ceph-mon[34050]: pgmap v386: 129 pgs: 129 active+clean; 1.5 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 6.1 KiB/s wr, 4 op/s 2024-09-21T01:43:38.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:43:37 smithi119 ceph-mon[33693]: pgmap v386: 129 pgs: 129 active+clean; 1.5 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 6.1 KiB/s wr, 4 op/s 2024-09-21T01:43:38.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:43:37 smithi083 ceph-mon[31370]: pgmap v386: 129 pgs: 129 active+clean; 1.5 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 6.1 KiB/s wr, 4 op/s 2024-09-21T01:43:40.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:43:39 smithi142 ceph-mon[34050]: pgmap v387: 129 pgs: 129 active+clean; 1.5 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 6.2 KiB/s wr, 4 op/s 2024-09-21T01:43:40.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:43:39 smithi119 ceph-mon[33693]: pgmap v387: 129 pgs: 129 active+clean; 1.5 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 6.2 KiB/s wr, 4 op/s 2024-09-21T01:43:40.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:43:39 smithi083 ceph-mon[31370]: pgmap v387: 129 pgs: 129 active+clean; 1.5 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 6.2 KiB/s wr, 4 op/s 2024-09-21T01:43:41.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:43:40 smithi142 ceph-mon[34050]: pgmap v388: 129 pgs: 129 active+clean; 1.5 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 7.5 KiB/s wr, 5 op/s 2024-09-21T01:43:41.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:43:40 smithi119 ceph-mon[33693]: pgmap v388: 129 pgs: 129 active+clean; 1.5 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 7.5 KiB/s wr, 5 op/s 2024-09-21T01:43:41.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:43:40 smithi083 ceph-mon[31370]: pgmap v388: 129 pgs: 129 active+clean; 1.5 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 7.5 KiB/s wr, 5 op/s 2024-09-21T01:43:44.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:43:43 smithi142 ceph-mon[34050]: pgmap v389: 129 pgs: 129 active+clean; 1.5 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 7.6 KiB/s wr, 5 op/s 2024-09-21T01:43:44.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:43:43 smithi119 ceph-mon[33693]: pgmap v389: 129 pgs: 129 active+clean; 1.5 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 7.6 KiB/s wr, 5 op/s 2024-09-21T01:43:44.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:43:43 smithi083 ceph-mon[31370]: pgmap v389: 129 pgs: 129 active+clean; 1.5 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 7.6 KiB/s wr, 5 op/s 2024-09-21T01:43:46.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:43:45 smithi142 ceph-mon[34050]: pgmap v390: 129 pgs: 129 active+clean; 1.6 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 9.6 KiB/s wr, 6 op/s 2024-09-21T01:43:46.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:43:45 smithi119 ceph-mon[33693]: pgmap v390: 129 pgs: 129 active+clean; 1.6 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 9.6 KiB/s wr, 6 op/s 2024-09-21T01:43:46.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:43:45 smithi083 ceph-mon[31370]: pgmap v390: 129 pgs: 129 active+clean; 1.6 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 9.6 KiB/s wr, 6 op/s 2024-09-21T01:43:48.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:43:47 smithi142 ceph-mon[34050]: pgmap v391: 129 pgs: 129 active+clean; 1.6 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 4.3 KiB/s wr, 4 op/s 2024-09-21T01:43:48.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:43:47 smithi119 ceph-mon[33693]: pgmap v391: 129 pgs: 129 active+clean; 1.6 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 4.3 KiB/s wr, 4 op/s 2024-09-21T01:43:48.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:43:47 smithi083 ceph-mon[31370]: pgmap v391: 129 pgs: 129 active+clean; 1.6 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 4.3 KiB/s wr, 4 op/s 2024-09-21T01:43:49.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:43:48 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:43:49.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:43:48 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:43:49.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:43:48 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:43:49.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:43:48 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:43:49.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:43:48 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:43:49.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:43:48 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:43:49.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:43:48 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:43:49.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:43:48 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:43:49.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:43:48 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:43:49.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:43:48 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:43:49.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:43:48 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:43:49.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:43:48 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:43:50.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:43:49 smithi142 ceph-mon[34050]: pgmap v392: 129 pgs: 129 active+clean; 1.6 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 3.8 KiB/s wr, 3 op/s 2024-09-21T01:43:50.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:43:49 smithi119 ceph-mon[33693]: pgmap v392: 129 pgs: 129 active+clean; 1.6 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 3.8 KiB/s wr, 3 op/s 2024-09-21T01:43:50.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:43:49 smithi083 ceph-mon[31370]: pgmap v392: 129 pgs: 129 active+clean; 1.6 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 3.8 KiB/s wr, 3 op/s 2024-09-21T01:43:52.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:43:51 smithi142 ceph-mon[34050]: pgmap v393: 129 pgs: 129 active+clean; 1.6 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 3.7 KiB/s wr, 3 op/s 2024-09-21T01:43:52.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:43:51 smithi119 ceph-mon[33693]: pgmap v393: 129 pgs: 129 active+clean; 1.6 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 3.7 KiB/s wr, 3 op/s 2024-09-21T01:43:52.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:43:51 smithi083 ceph-mon[31370]: pgmap v393: 129 pgs: 129 active+clean; 1.6 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 3.7 KiB/s wr, 3 op/s 2024-09-21T01:43:54.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:43:53 smithi142 ceph-mon[34050]: pgmap v394: 129 pgs: 129 active+clean; 1.6 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 2.4 KiB/s wr, 2 op/s 2024-09-21T01:43:54.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:43:53 smithi119 ceph-mon[33693]: pgmap v394: 129 pgs: 129 active+clean; 1.6 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 2.4 KiB/s wr, 2 op/s 2024-09-21T01:43:54.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:43:53 smithi083 ceph-mon[31370]: pgmap v394: 129 pgs: 129 active+clean; 1.6 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 2.4 KiB/s wr, 2 op/s 2024-09-21T01:43:56.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:43:55 smithi142 ceph-mon[34050]: pgmap v395: 129 pgs: 129 active+clean; 1.6 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 2.9 KiB/s wr, 3 op/s 2024-09-21T01:43:56.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:43:55 smithi119 ceph-mon[33693]: pgmap v395: 129 pgs: 129 active+clean; 1.6 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 2.9 KiB/s wr, 3 op/s 2024-09-21T01:43:56.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:43:55 smithi083 ceph-mon[31370]: pgmap v395: 129 pgs: 129 active+clean; 1.6 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 2.9 KiB/s wr, 3 op/s 2024-09-21T01:43:58.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:43:57 smithi142 ceph-mon[34050]: pgmap v396: 129 pgs: 129 active+clean; 1.6 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 597 B/s wr, 1 op/s 2024-09-21T01:43:58.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:43:57 smithi119 ceph-mon[33693]: pgmap v396: 129 pgs: 129 active+clean; 1.6 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 597 B/s wr, 1 op/s 2024-09-21T01:43:58.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:43:57 smithi083 ceph-mon[31370]: pgmap v396: 129 pgs: 129 active+clean; 1.6 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 597 B/s wr, 1 op/s 2024-09-21T01:43:59.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:43:58 smithi142 ceph-mon[34050]: pgmap v397: 129 pgs: 129 active+clean; 1.6 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 597 B/s wr, 1 op/s 2024-09-21T01:43:59.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:43:58 smithi119 ceph-mon[33693]: pgmap v397: 129 pgs: 129 active+clean; 1.6 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 597 B/s wr, 1 op/s 2024-09-21T01:43:59.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:43:58 smithi083 ceph-mon[31370]: pgmap v397: 129 pgs: 129 active+clean; 1.6 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 597 B/s wr, 1 op/s 2024-09-21T01:44:02.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:44:01 smithi142 ceph-mon[34050]: pgmap v398: 129 pgs: 129 active+clean; 1.6 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 597 B/s wr, 2 op/s 2024-09-21T01:44:02.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:44:01 smithi119 ceph-mon[33693]: pgmap v398: 129 pgs: 129 active+clean; 1.6 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 597 B/s wr, 2 op/s 2024-09-21T01:44:02.281 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:44:01 smithi083 ceph-mon[31370]: pgmap v398: 129 pgs: 129 active+clean; 1.6 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 597 B/s wr, 2 op/s 2024-09-21T01:44:02.422 INFO:tasks.quiescer.fs.[cephfs]:Total duration (55.6) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-09-21T01:44:02.423 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 27.8 2024-09-21T01:44:02.423 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T01:44:02.698 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:44:03.170 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:03.169+0000 7fbd26dee640 1 -- 172.21.15.83:0/3684891579 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbd201083a0 msgr2=0x7fbd201087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:44:03.170 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:03.169+0000 7fbd26dee640 1 --2- 172.21.15.83:0/3684891579 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbd201083a0 0x7fbd201087b0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fbd0c009900 tx=0x7fbd0c02a410 comp rx=0 tx=0).stop 2024-09-21T01:44:03.170 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:03.169+0000 7fbd26dee640 1 -- 172.21.15.83:0/3684891579 shutdown_connections 2024-09-21T01:44:03.170 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:03.169+0000 7fbd26dee640 1 --2- 172.21.15.83:0/3684891579 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbd20108cf0 0x7fbd2010f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:44:03.171 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:03.169+0000 7fbd26dee640 1 --2- 172.21.15.83:0/3684891579 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbd201083a0 0x7fbd201087b0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:44:03.171 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:03.169+0000 7fbd26dee640 1 --2- 172.21.15.83:0/3684891579 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbd20102a60 0x7fbd20102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:44:03.171 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:03.169+0000 7fbd26dee640 1 -- 172.21.15.83:0/3684891579 >> 172.21.15.83:0/3684891579 conn(0x7fbd20079730 msgr2=0x7fbd20079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:44:03.171 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:03.169+0000 7fbd26dee640 1 -- 172.21.15.83:0/3684891579 shutdown_connections 2024-09-21T01:44:03.171 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:03.169+0000 7fbd26dee640 1 -- 172.21.15.83:0/3684891579 wait complete. 2024-09-21T01:44:03.171 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:03.170+0000 7fbd26dee640 1 Processor -- start 2024-09-21T01:44:03.171 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:03.170+0000 7fbd26dee640 1 -- start start 2024-09-21T01:44:03.172 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:03.170+0000 7fbd26dee640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbd20102a60 0x7fbd20199320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:44:03.173 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:03.170+0000 7fbd26dee640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbd201083a0 0x7fbd201998c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:44:03.173 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:03.170+0000 7fbd26dee640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbd20108cf0 0x7fbd2019eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:44:03.173 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:03.170+0000 7fbd26dee640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fbd20112810 con 0x7fbd20102a60 2024-09-21T01:44:03.173 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:03.170+0000 7fbd26dee640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fbd20112690 con 0x7fbd20108cf0 2024-09-21T01:44:03.173 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:03.170+0000 7fbd26dee640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fbd20112990 con 0x7fbd201083a0 2024-09-21T01:44:03.173 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:03.170+0000 7fbd24b8a640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbd20102a60 0x7fbd20199320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:44:03.173 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:03.170+0000 7fbd24b8a640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbd20102a60 0x7fbd20199320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:59832/0 (socket says 172.21.15.83:59832) 2024-09-21T01:44:03.173 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:03.170+0000 7fbd24b8a640 1 -- 172.21.15.83:0/3253056509 learned_addr learned my addr 172.21.15.83:0/3253056509 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:44:03.173 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:03.171+0000 7fbd2538b640 1 --2- 172.21.15.83:0/3253056509 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbd20108cf0 0x7fbd2019eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:44:03.173 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:03.171+0000 7fbd1ffff640 1 --2- 172.21.15.83:0/3253056509 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbd201083a0 0x7fbd201998c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:44:03.173 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:03.171+0000 7fbd24b8a640 1 -- 172.21.15.83:0/3253056509 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbd201083a0 msgr2=0x7fbd201998c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:44:03.173 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:03.171+0000 7fbd24b8a640 1 --2- 172.21.15.83:0/3253056509 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbd201083a0 0x7fbd201998c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:44:03.173 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:03.171+0000 7fbd24b8a640 1 -- 172.21.15.83:0/3253056509 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbd20108cf0 msgr2=0x7fbd2019eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:44:03.173 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:03.171+0000 7fbd24b8a640 1 --2- 172.21.15.83:0/3253056509 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbd20108cf0 0x7fbd2019eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:44:03.174 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:03.171+0000 7fbd24b8a640 1 -- 172.21.15.83:0/3253056509 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd2019f290 con 0x7fbd20102a60 2024-09-21T01:44:03.174 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:03.171+0000 7fbd24b8a640 1 --2- 172.21.15.83:0/3253056509 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbd20102a60 0x7fbd20199320 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fbd14009970 tx=0x7fbd14009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:44:03.174 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:03.171+0000 7fbd1dffb640 1 -- 172.21.15.83:0/3253056509 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd1400d020 con 0x7fbd20102a60 2024-09-21T01:44:03.174 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:03.171+0000 7fbd1dffb640 1 -- 172.21.15.83:0/3253056509 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbd1400d1c0 con 0x7fbd20102a60 2024-09-21T01:44:03.174 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:03.171+0000 7fbd26dee640 1 -- 172.21.15.83:0/3253056509 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd2019f580 con 0x7fbd20102a60 2024-09-21T01:44:03.174 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:03.172+0000 7fbd1dffb640 1 -- 172.21.15.83:0/3253056509 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd1400cb40 con 0x7fbd20102a60 2024-09-21T01:44:03.174 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:03.172+0000 7fbd26dee640 1 -- 172.21.15.83:0/3253056509 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd2006ae60 con 0x7fbd20102a60 2024-09-21T01:44:03.174 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:03.173+0000 7fbd26dee640 1 -- 172.21.15.83:0/3253056509 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd20102e70 con 0x7fbd20102a60 2024-09-21T01:44:03.175 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:03.175+0000 7fbd1dffb640 1 -- 172.21.15.83:0/3253056509 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7fbd1400cce0 con 0x7fbd20102a60 2024-09-21T01:44:03.176 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:03.176+0000 7fbd1dffb640 1 --2- 172.21.15.83:0/3253056509 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fbd100b6700 0x7fbd100b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:44:03.176 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:03.176+0000 7fbd1ffff640 1 --2- 172.21.15.83:0/3253056509 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fbd100b6700 0x7fbd100b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:44:03.176 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:03.176+0000 7fbd1dffb640 1 -- 172.21.15.83:0/3253056509 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9315+0+0 (secure 0 0 0) 0x7fbd140e8e70 con 0x7fbd20102a60 2024-09-21T01:44:03.177 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:03.177+0000 7fbd1ffff640 1 --2- 172.21.15.83:0/3253056509 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fbd100b6700 0x7fbd100b8c10 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fbd0c006010 tx=0x7fbd0c032ba0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:44:03.182 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:03.182+0000 7fbd1dffb640 1 -- 172.21.15.83:0/3253056509 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fbd140af0a0 con 0x7fbd20102a60 2024-09-21T01:44:03.434 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:03.434+0000 7fbd26dee640 1 -- 172.21.15.83:0/3253056509 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbd2006b990 con 0x7fbd20102a60 2024-09-21T01:44:03.435 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:03.435+0000 7fbd1dffb640 1 -- 172.21.15.83:0/3253056509 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11857 (secure 0 0 0) 0x7fbd140b3480 con 0x7fbd20102a60 2024-09-21T01:44:03.435 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T01:44:03.436 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":21,"btime":"2024-09-21T01:40:27:947059+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14775,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6835/1105040204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":1105040204},{"type":"v1","addr":"172.21.15.83:6835","nonce":1105040204}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14787,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/2234789563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6836","nonce":2234789563},{"type":"v1","addr":"172.21.15.83:6837","nonce":2234789563}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14838,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6839/136258364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6838","nonce":136258364},{"type":"v1","addr":"172.21.15.83:6839","nonce":136258364}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14850,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6841/129439444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6840","nonce":129439444},{"type":"v1","addr":"172.21.15.83:6841","nonce":129439444}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24569,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/2839502433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":2839502433},{"type":"v1","addr":"172.21.15.119:6833","nonce":2839502433}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24580,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6833/2841606990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":2841606990},{"type":"v1","addr":"172.21.15.142:6833","nonce":2841606990}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24599,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/415902608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":415902608},{"type":"v1","addr":"172.21.15.119:6835","nonce":415902608}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24607,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/3009088510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":3009088510},{"type":"v1","addr":"172.21.15.142:6835","nonce":3009088510}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24613,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/3847200126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6836","nonce":3847200126},{"type":"v1","addr":"172.21.15.142:6837","nonce":3847200126}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24626,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/3619222976","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":3619222976},{"type":"v1","addr":"172.21.15.119:6837","nonce":3619222976}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T01:39:45.145124+0000","modified":"2024-09-21T01:40:27.664151+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24653},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24631":{"gid":24631,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.142:6839/1817880741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6838","nonce":1817880741},{"type":"v1","addr":"172.21.15.142:6839","nonce":1817880741}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24653":{"gid":24653,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.119:6839/3106757092","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":3106757092},{"type":"v1","addr":"172.21.15.119:6839","nonce":3106757092}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24653,"qdb_cluster":[24653]},"id":1}]} 2024-09-21T01:44:03.436 INFO:teuthology.orchestra.run.smithi083.stderr:dumped fsmap epoch 21 2024-09-21T01:44:03.438 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:03.437+0000 7fbd26dee640 1 -- 172.21.15.83:0/3253056509 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fbd100b6700 msgr2=0x7fbd100b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:44:03.438 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:03.437+0000 7fbd26dee640 1 --2- 172.21.15.83:0/3253056509 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fbd100b6700 0x7fbd100b8c10 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fbd0c006010 tx=0x7fbd0c032ba0 comp rx=0 tx=0).stop 2024-09-21T01:44:03.438 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:03.437+0000 7fbd26dee640 1 -- 172.21.15.83:0/3253056509 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbd20102a60 msgr2=0x7fbd20199320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:44:03.438 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:03.437+0000 7fbd26dee640 1 --2- 172.21.15.83:0/3253056509 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbd20102a60 0x7fbd20199320 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fbd14009970 tx=0x7fbd14009e30 comp rx=0 tx=0).stop 2024-09-21T01:44:03.438 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:03.437+0000 7fbd26dee640 1 -- 172.21.15.83:0/3253056509 shutdown_connections 2024-09-21T01:44:03.438 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:03.437+0000 7fbd26dee640 1 --2- 172.21.15.83:0/3253056509 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fbd100b6700 0x7fbd100b8c10 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:44:03.438 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:03.437+0000 7fbd26dee640 1 --2- 172.21.15.83:0/3253056509 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbd20108cf0 0x7fbd2019eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:44:03.438 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:03.437+0000 7fbd26dee640 1 --2- 172.21.15.83:0/3253056509 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbd201083a0 0x7fbd201998c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:44:03.438 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:03.437+0000 7fbd26dee640 1 --2- 172.21.15.83:0/3253056509 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbd20102a60 0x7fbd20199320 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:44:03.439 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:03.437+0000 7fbd26dee640 1 -- 172.21.15.83:0/3253056509 >> 172.21.15.83:0/3253056509 conn(0x7fbd20079730 msgr2=0x7fbd20104530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:44:03.439 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:03.437+0000 7fbd26dee640 1 -- 172.21.15.83:0/3253056509 shutdown_connections 2024-09-21T01:44:03.439 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:03.438+0000 7fbd26dee640 1 -- 172.21.15.83:0/3253056509 wait complete. 2024-09-21T01:44:04.173 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:44:03 smithi083 ceph-mon[31370]: pgmap v399: 129 pgs: 129 active+clean; 3.6 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 182 KiB/s wr, 3 op/s 2024-09-21T01:44:04.173 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:44:03 smithi083 ceph-mon[31370]: from='client.? 172.21.15.83:0/3253056509' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:44:04.201 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24653 quiesce db / --timeout 90 --expiration 147.8 --await-for 45.0' 2024-09-21T01:44:04.201 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24653 quiesce db / --timeout 90 --expiration 147.8 --await-for 45.0 2024-09-21T01:44:04.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:44:03 smithi142 ceph-mon[34050]: pgmap v399: 129 pgs: 129 active+clean; 3.6 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 182 KiB/s wr, 3 op/s 2024-09-21T01:44:04.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:44:03 smithi142 ceph-mon[34050]: from='client.? 172.21.15.83:0/3253056509' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:44:04.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:44:03 smithi119 ceph-mon[33693]: pgmap v399: 129 pgs: 129 active+clean; 3.6 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 182 KiB/s wr, 3 op/s 2024-09-21T01:44:04.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:44:03 smithi119 ceph-mon[33693]: from='client.? 172.21.15.83:0/3253056509' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:44:04.467 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:44:05.016 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.015+0000 7f58ed728640 1 -- 172.21.15.83:0/2347026904 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f58e8102a80 msgr2=0x7f58e8102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:44:05.016 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.015+0000 7f58ed728640 1 --2- 172.21.15.83:0/2347026904 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f58e8102a80 0x7f58e8102e90 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f58d8009900 tx=0x7f58d802a410 comp rx=0 tx=0).stop 2024-09-21T01:44:05.016 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.015+0000 7f58ed728640 1 -- 172.21.15.83:0/2347026904 shutdown_connections 2024-09-21T01:44:05.016 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.015+0000 7f58ed728640 1 --2- 172.21.15.83:0/2347026904 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f58e8108d10 0x7f58e810f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:44:05.016 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.015+0000 7f58ed728640 1 --2- 172.21.15.83:0/2347026904 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f58e81083c0 0x7f58e81087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:44:05.016 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.015+0000 7f58ed728640 1 --2- 172.21.15.83:0/2347026904 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f58e8102a80 0x7f58e8102e90 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:44:05.016 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.015+0000 7f58ed728640 1 -- 172.21.15.83:0/2347026904 >> 172.21.15.83:0/2347026904 conn(0x7f58e8079730 msgr2=0x7f58e8079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:44:05.016 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.015+0000 7f58ed728640 1 -- 172.21.15.83:0/2347026904 shutdown_connections 2024-09-21T01:44:05.016 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.015+0000 7f58ed728640 1 -- 172.21.15.83:0/2347026904 wait complete. 2024-09-21T01:44:05.017 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.016+0000 7f58ed728640 1 Processor -- start 2024-09-21T01:44:05.018 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.016+0000 7f58ed728640 1 -- start start 2024-09-21T01:44:05.018 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.016+0000 7f58ed728640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f58e8102a80 0x7f58e8199330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:44:05.018 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.016+0000 7f58ed728640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f58e81083c0 0x7f58e81998d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:44:05.018 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.016+0000 7f58ed728640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f58e8108d10 0x7f58e819eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:44:05.018 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.016+0000 7f58ed728640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f58e8112880 con 0x7f58e81083c0 2024-09-21T01:44:05.018 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.016+0000 7f58ed728640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f58e8112700 con 0x7f58e8102a80 2024-09-21T01:44:05.018 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.016+0000 7f58ed728640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f58e8112a00 con 0x7f58e8108d10 2024-09-21T01:44:05.018 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.016+0000 7f58de7fc640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f58e81083c0 0x7f58e81998d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:44:05.018 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.016+0000 7f58de7fc640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f58e81083c0 0x7f58e81998d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:59842/0 (socket says 172.21.15.83:59842) 2024-09-21T01:44:05.018 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.017+0000 7f58de7fc640 1 -- 172.21.15.83:0/1244494850 learned_addr learned my addr 172.21.15.83:0/1244494850 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:44:05.018 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.017+0000 7f58e77fe640 1 --2- 172.21.15.83:0/1244494850 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f58e8108d10 0x7f58e819eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:44:05.018 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.017+0000 7f58e6ffd640 1 --2- 172.21.15.83:0/1244494850 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f58e8102a80 0x7f58e8199330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:44:05.019 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.017+0000 7f58de7fc640 1 -- 172.21.15.83:0/1244494850 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f58e8108d10 msgr2=0x7f58e819eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:44:05.019 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.017+0000 7f58de7fc640 1 --2- 172.21.15.83:0/1244494850 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f58e8108d10 0x7f58e819eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:44:05.019 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.017+0000 7f58de7fc640 1 -- 172.21.15.83:0/1244494850 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f58e8102a80 msgr2=0x7f58e8199330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:44:05.019 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.017+0000 7f58de7fc640 1 --2- 172.21.15.83:0/1244494850 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f58e8102a80 0x7f58e8199330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:44:05.019 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.017+0000 7f58de7fc640 1 -- 172.21.15.83:0/1244494850 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58e819f2a0 con 0x7f58e81083c0 2024-09-21T01:44:05.019 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.017+0000 7f58de7fc640 1 --2- 172.21.15.83:0/1244494850 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f58e81083c0 0x7f58e81998d0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f58d000d750 tx=0x7f58d000dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:44:05.020 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.017+0000 7f58e4ff9640 1 -- 172.21.15.83:0/1244494850 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58d0017070 con 0x7f58e81083c0 2024-09-21T01:44:05.020 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.017+0000 7f58ed728640 1 -- 172.21.15.83:0/1244494850 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58e819f590 con 0x7f58e81083c0 2024-09-21T01:44:05.020 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.017+0000 7f58e4ff9640 1 -- 172.21.15.83:0/1244494850 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f58d00054b0 con 0x7f58e81083c0 2024-09-21T01:44:05.020 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.017+0000 7f58e4ff9640 1 -- 172.21.15.83:0/1244494850 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58d0004bc0 con 0x7f58e81083c0 2024-09-21T01:44:05.020 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.018+0000 7f58ed728640 1 -- 172.21.15.83:0/1244494850 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58e806bae0 con 0x7f58e81083c0 2024-09-21T01:44:05.020 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.020+0000 7f58f3c9c740 1 Processor -- start 2024-09-21T01:44:05.021 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.020+0000 7f58f3c9c740 1 -- start start 2024-09-21T01:44:05.021 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.021+0000 7f58e4ff9640 1 -- 172.21.15.83:0/1244494850 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7f58d0009c30 con 0x7f58e81083c0 2024-09-21T01:44:05.021 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.021+0000 7f58f3c9c740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ad8c1f6840 0x55ad8c59d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:44:05.021 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.021+0000 7f58f3c9c740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ad8c1cd980 0x55ad8c59db40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:44:05.022 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.021+0000 7f58f3c9c740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ad8c1d5b60 0x55ad8c59e080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:44:05.022 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.021+0000 7f58f3c9c740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55ad8c513b90 con 0x55ad8c1f6840 2024-09-21T01:44:05.022 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.021+0000 7f58e77fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ad8c1f6840 0x55ad8c59d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:44:05.022 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.021+0000 7f58f3c9c740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55ad8c502fc0 con 0x55ad8c1cd980 2024-09-21T01:44:05.022 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.021+0000 7f58f3c9c740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55ad8c506dd0 con 0x55ad8c1d5b60 2024-09-21T01:44:05.022 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.021+0000 7f58e77fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ad8c1f6840 0x55ad8c59d600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:59854/0 (socket says 172.21.15.83:59854) 2024-09-21T01:44:05.022 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.021+0000 7f58e77fe640 1 -- 172.21.15.83:0/2330759968 learned_addr learned my addr 172.21.15.83:0/2330759968 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:44:05.022 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.021+0000 7f58e6ffd640 1 --2- 172.21.15.83:0/2330759968 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ad8c1cd980 0x55ad8c59db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:44:05.022 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.021+0000 7f58de7fc640 1 --2- 172.21.15.83:0/2330759968 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ad8c1d5b60 0x55ad8c59e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:44:05.023 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.022+0000 7f58e6ffd640 1 -- 172.21.15.83:0/2330759968 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ad8c1d5b60 msgr2=0x55ad8c59e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:44:05.023 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.022+0000 7f58e6ffd640 1 --2- 172.21.15.83:0/2330759968 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ad8c1d5b60 0x55ad8c59e080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:44:05.023 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.022+0000 7f58e6ffd640 1 -- 172.21.15.83:0/2330759968 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ad8c1f6840 msgr2=0x55ad8c59d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:44:05.023 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.022+0000 7f58e6ffd640 1 --2- 172.21.15.83:0/2330759968 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ad8c1f6840 0x55ad8c59d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:44:05.024 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.022+0000 7f58e6ffd640 1 -- 172.21.15.83:0/2330759968 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad8c48a060 con 0x55ad8c1cd980 2024-09-21T01:44:05.024 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.022+0000 7f58e4ff9640 1 --2- 172.21.15.83:0/1244494850 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f58d40b6680 0x7f58d40b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:44:05.024 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.022+0000 7f58e6ffd640 1 --2- 172.21.15.83:0/2330759968 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ad8c1cd980 0x55ad8c59db40 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f58d8005940 tx=0x7f58d8031ba0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1c56d4fd2017a880 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:44:05.024 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.022+0000 7f58e77fe640 1 --2- 172.21.15.83:0/1244494850 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f58d40b6680 0x7f58d40b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:44:05.024 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.022+0000 7f58e4ff9640 1 -- 172.21.15.83:0/1244494850 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9315+0+0 (secure 0 0 0) 0x7f58d00e7400 con 0x7f58e81083c0 2024-09-21T01:44:05.024 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.022+0000 7f58dd7fa640 1 -- 172.21.15.83:0/2330759968 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58d8035030 con 0x55ad8c1cd980 2024-09-21T01:44:05.024 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.022+0000 7f58dd7fa640 1 -- 172.21.15.83:0/2330759968 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f58d8040070 con 0x55ad8c1cd980 2024-09-21T01:44:05.024 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.022+0000 7f58dd7fa640 1 -- 172.21.15.83:0/2330759968 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58d80038e0 con 0x55ad8c1cd980 2024-09-21T01:44:05.026 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.023+0000 7f58f3c9c740 1 -- 172.21.15.83:0/2330759968 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ad8c1cd980 msgr2=0x55ad8c59db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:44:05.026 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.023+0000 7f58f3c9c740 1 --2- 172.21.15.83:0/2330759968 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ad8c1cd980 0x55ad8c59db40 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f58d8005940 tx=0x7f58d8031ba0 comp rx=0 tx=0).stop 2024-09-21T01:44:05.026 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.023+0000 7f58e77fe640 1 --2- 172.21.15.83:0/1244494850 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f58d40b6680 0x7f58d40b8b90 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f58e0005f40 tx=0x7f58e0009600 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:44:05.026 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.024+0000 7f58f3c9c740 1 -- 172.21.15.83:0/2330759968 shutdown_connections 2024-09-21T01:44:05.027 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.024+0000 7f58f3c9c740 1 --2- 172.21.15.83:0/2330759968 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ad8c1d5b60 0x55ad8c59e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:44:05.027 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.024+0000 7f58f3c9c740 1 --2- 172.21.15.83:0/2330759968 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ad8c1cd980 0x55ad8c59db40 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:44:05.027 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.024+0000 7f58f3c9c740 1 --2- 172.21.15.83:0/2330759968 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ad8c1f6840 0x55ad8c59d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:44:05.027 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.024+0000 7f58f3c9c740 1 -- 172.21.15.83:0/2330759968 >> 172.21.15.83:0/2330759968 conn(0x55ad8c1ea990 msgr2=0x55ad8c59b4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:44:05.027 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.024+0000 7f58f3c9c740 1 -- 172.21.15.83:0/2330759968 shutdown_connections 2024-09-21T01:44:05.027 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.024+0000 7f58f3c9c740 1 -- 172.21.15.83:0/2330759968 wait complete. 2024-09-21T01:44:05.027 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.024+0000 7f58f3c9c740 1 -- start start 2024-09-21T01:44:05.027 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.024+0000 7f58f3c9c740 1 Processor -- start 2024-09-21T01:44:05.027 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.025+0000 7f58f3c9c740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ad8c1cd980 0x55ad8c5ad600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:44:05.027 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.025+0000 7f58f3c9c740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ad8c1d5b60 0x55ad8c5adb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:44:05.027 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.025+0000 7f58f3c9c740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ad8c1f6840 0x55ad8c5b93b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:44:05.027 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.025+0000 7f58f3c9c740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55ad8c3647a0 con 0x55ad8c1f6840 2024-09-21T01:44:05.027 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.025+0000 7f58f3c9c740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55ad8c4a80a0 con 0x55ad8c1d5b60 2024-09-21T01:44:05.028 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.025+0000 7f58f3c9c740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55ad8c5b0080 con 0x55ad8c1cd980 2024-09-21T01:44:05.028 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.025+0000 7f58f3c9c740 10 client.0 _ll_register_callbacks cb 0x55ad8c4853c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:44:05.028 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.025+0000 7f58e77fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ad8c1f6840 0x55ad8c5b93b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:44:05.028 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.025+0000 7f58e77fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ad8c1f6840 0x55ad8c5b93b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:59856/0 (socket says 172.21.15.83:59856) 2024-09-21T01:44:05.028 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.025+0000 7f58e77fe640 1 -- 172.21.15.83:0/527949203 learned_addr learned my addr 172.21.15.83:0/527949203 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:44:05.028 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.025+0000 7f58de7fc640 1 --2- 172.21.15.83:0/527949203 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ad8c1d5b60 0x55ad8c5adb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:44:05.028 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.025+0000 7f58e6ffd640 1 --2- 172.21.15.83:0/527949203 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ad8c1cd980 0x55ad8c5ad600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:44:05.028 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.025+0000 7f58e77fe640 1 -- 172.21.15.83:0/527949203 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ad8c1cd980 msgr2=0x55ad8c5ad600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:44:05.028 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.025+0000 7f58e77fe640 1 --2- 172.21.15.83:0/527949203 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ad8c1cd980 0x55ad8c5ad600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:44:05.028 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.025+0000 7f58e77fe640 1 -- 172.21.15.83:0/527949203 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ad8c1d5b60 msgr2=0x55ad8c5adb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:44:05.028 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.025+0000 7f58e77fe640 1 --2- 172.21.15.83:0/527949203 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ad8c1d5b60 0x55ad8c5adb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:44:05.028 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.025+0000 7f58e77fe640 1 -- 172.21.15.83:0/527949203 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ad8c496880 con 0x55ad8c1f6840 2024-09-21T01:44:05.028 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.025+0000 7f58e77fe640 1 --2- 172.21.15.83:0/527949203 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ad8c1f6840 0x55ad8c5b93b0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f58e00092f0 tx=0x7f58e0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7b5325af3287ca5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:44:05.028 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.025+0000 7f58ce7fc640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-09-21T01:44:05.028 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.026+0000 7f58ce7fc640 1 -- 172.21.15.83:0/527949203 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58e0020620 con 0x55ad8c1f6840 2024-09-21T01:44:05.029 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.026+0000 7f58ce7fc640 1 -- 172.21.15.83:0/527949203 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9315+0+0 (secure 0 0 0) 0x7f58e00207c0 con 0x55ad8c1f6840 2024-09-21T01:44:05.029 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.026+0000 7f58f3c9c740 1 -- 172.21.15.83:0/527949203 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f58d8040070 con 0x55ad8c1f6840 2024-09-21T01:44:05.029 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.026+0000 7f58ce7fc640 1 -- 172.21.15.83:0/527949203 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f58e0033050 con 0x55ad8c1f6840 2024-09-21T01:44:05.029 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.026+0000 7f58f3c9c740 10 client.15609 fetch_fsmap learned FSMap version 21 2024-09-21T01:44:05.029 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.026+0000 7f58f3c9c740 1 -- 172.21.15.83:0/527949203 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55ad8c270b90 con 0x55ad8c1f6840 2024-09-21T01:44:05.029 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.026+0000 7f58ce7fc640 1 -- 172.21.15.83:0/527949203 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f58d8040070 con 0x55ad8c1f6840 2024-09-21T01:44:05.031 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.026+0000 7f58ce7fc640 1 -- 172.21.15.83:0/527949203 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f58e000f040 con 0x55ad8c1f6840 2024-09-21T01:44:05.031 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.026+0000 7f58f3c9c740 10 client.15609 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T01:44:05.031 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.026+0000 7f58f3c9c740 10 client.15609 resolve_mds: validated gid 24653 aka daemon mds.b 2024-09-21T01:44:05.031 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.026+0000 7f58f3c9c740 20 client.15609 populate_metadata read hostname 'smithi083' 2024-09-21T01:44:05.031 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.026+0000 7f58f3c9c740 1 --2- 172.21.15.83:0/527949203 >> [v2:172.21.15.119:6838/3106757092,v1:172.21.15.119:6839/3106757092] conn(0x55ad8c1b51c0 0x55ad8c5bf500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:44:05.031 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.027+0000 7f58f3c9c740 4 client.15609 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:44:05.032 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.027+0000 7f58f3c9c740 1 -- 172.21.15.83:0/527949203 --> [v2:172.21.15.119:6838/3106757092,v1:172.21.15.119:6839/3106757092] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ad8c515ae0 con 0x55ad8c1b51c0 2024-09-21T01:44:05.032 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.027+0000 7f58e6ffd640 1 --2- 172.21.15.83:0/527949203 >> [v2:172.21.15.119:6838/3106757092,v1:172.21.15.119:6839/3106757092] conn(0x55ad8c1b51c0 0x55ad8c5bf500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:44:05.032 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.027+0000 7f58e6ffd640 1 --2- 172.21.15.83:0/527949203 >> [v2:172.21.15.119:6838/3106757092,v1:172.21.15.119:6839/3106757092] conn(0x55ad8c1b51c0 0x55ad8c5bf500 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=215f3588ddeaf87c server_cookie=a989d77c8b1fba95 in_seq=0 out_seq=0 2024-09-21T01:44:05.032 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.027+0000 7f58ce7fc640 10 client.15609 ms_handle_connect on v2:172.21.15.119:6838/3106757092 2024-09-21T01:44:05.032 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.028+0000 7f58ce7fc640 1 -- 172.21.15.83:0/527949203 <== mds.0 v2:172.21.15.119:6838/3106757092 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ad8c515ae0 con 0x55ad8c1b51c0 2024-09-21T01:44:05.032 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.028+0000 7f58ce7fc640 10 client.15609 handle_command_reply: tid=0 2024-09-21T01:44:05.032 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.028+0000 7f58f3c9c740 1 client.15609 shutdown 2024-09-21T01:44:05.032 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.028+0000 7f58f3c9c740 1 -- 172.21.15.83:0/527949203 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ad8c1f6840 msgr2=0x55ad8c5b93b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:44:05.032 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.028+0000 7f58f3c9c740 1 --2- 172.21.15.83:0/527949203 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ad8c1f6840 0x55ad8c5b93b0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f58e00092f0 tx=0x7f58e0004a40 comp rx=0 tx=0).stop 2024-09-21T01:44:05.032 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.028+0000 7f58f3c9c740 1 -- 172.21.15.83:0/527949203 shutdown_connections 2024-09-21T01:44:05.032 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.028+0000 7f58f3c9c740 1 --2- 172.21.15.83:0/527949203 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ad8c1f6840 0x55ad8c5b93b0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:44:05.033 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.028+0000 7f58f3c9c740 1 --2- 172.21.15.83:0/527949203 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ad8c1d5b60 0x55ad8c5adb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:44:05.033 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.028+0000 7f58f3c9c740 1 --2- 172.21.15.83:0/527949203 >> [v2:172.21.15.119:6838/3106757092,v1:172.21.15.119:6839/3106757092] conn(0x55ad8c1b51c0 0x55ad8c5bf500 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:44:05.033 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.028+0000 7f58ce7fc640 0 client.15609 ms_handle_reset on v2:172.21.15.119:6838/3106757092 2024-09-21T01:44:05.033 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.028+0000 7f58f3c9c740 1 --2- 172.21.15.83:0/527949203 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ad8c1cd980 0x55ad8c5ad600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:44:05.033 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.028+0000 7f58f3c9c740 1 -- 172.21.15.83:0/527949203 >> 172.21.15.83:0/527949203 conn(0x55ad8c1ea990 msgr2=0x55ad8c59eff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:44:05.033 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.028+0000 7f58f3c9c740 1 -- 172.21.15.83:0/527949203 shutdown_connections 2024-09-21T01:44:05.033 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.028+0000 7f58f3c9c740 1 -- 172.21.15.83:0/527949203 wait complete. 2024-09-21T01:44:05.033 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.029+0000 7f58f3c9c740 20 client.15609 trim_cache size 0 max 16384 2024-09-21T01:44:05.050 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.049+0000 7f58f3c9c740 1 Processor -- start 2024-09-21T01:44:05.050 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.049+0000 7f58f3c9c740 1 -- start start 2024-09-21T01:44:05.050 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.049+0000 7f58f3c9c740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ad8c1ea990 0x55ad8c5b92b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:44:05.050 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.049+0000 7f58f3c9c740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ad8c1b51c0 0x55ad8c5aa5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:44:05.050 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.049+0000 7f58f3c9c740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ad8c1cd980 0x55ad8c5aab30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:44:05.050 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.049+0000 7f58f3c9c740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f58e81ac9c0 con 0x55ad8c1b51c0 2024-09-21T01:44:05.050 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.049+0000 7f58f3c9c740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f58e81af240 con 0x55ad8c1ea990 2024-09-21T01:44:05.050 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.049+0000 7f58f3c9c740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f58e81ad030 con 0x55ad8c1cd980 2024-09-21T01:44:05.050 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.049+0000 7f58de7fc640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ad8c1b51c0 0x55ad8c5aa5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:44:05.051 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.049+0000 7f58de7fc640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ad8c1b51c0 0x55ad8c5aa5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:59868/0 (socket says 172.21.15.83:59868) 2024-09-21T01:44:05.051 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.049+0000 7f58de7fc640 1 -- 172.21.15.83:0/1793101832 learned_addr learned my addr 172.21.15.83:0/1793101832 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:44:05.051 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.049+0000 7f58e77fe640 1 --2- 172.21.15.83:0/1793101832 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ad8c1cd980 0x55ad8c5aab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:44:05.051 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.049+0000 7f58e6ffd640 1 --2- 172.21.15.83:0/1793101832 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ad8c1ea990 0x55ad8c5b92b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:44:05.051 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.050+0000 7f58de7fc640 1 -- 172.21.15.83:0/1793101832 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ad8c1cd980 msgr2=0x55ad8c5aab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:44:05.051 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.050+0000 7f58de7fc640 1 --2- 172.21.15.83:0/1793101832 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ad8c1cd980 0x55ad8c5aab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:44:05.051 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.050+0000 7f58de7fc640 1 -- 172.21.15.83:0/1793101832 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ad8c1ea990 msgr2=0x55ad8c5b92b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:44:05.051 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.050+0000 7f58de7fc640 1 --2- 172.21.15.83:0/1793101832 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ad8c1ea990 0x55ad8c5b92b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:44:05.051 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.050+0000 7f58de7fc640 1 -- 172.21.15.83:0/1793101832 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad8c59e440 con 0x55ad8c1b51c0 2024-09-21T01:44:05.053 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.050+0000 7f58de7fc640 1 --2- 172.21.15.83:0/1793101832 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ad8c1b51c0 0x55ad8c5aa5f0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f58d00e4e30 tx=0x7f58d00d0040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aeeb5754fdba7e2f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:44:05.053 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.050+0000 7f58dcff9640 1 -- 172.21.15.83:0/1793101832 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58d0020040 con 0x55ad8c1b51c0 2024-09-21T01:44:05.053 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.050+0000 7f58dcff9640 1 -- 172.21.15.83:0/1793101832 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f58d00acaf0 con 0x55ad8c1b51c0 2024-09-21T01:44:05.053 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.050+0000 7f58dcff9640 1 -- 172.21.15.83:0/1793101832 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58d00ac750 con 0x55ad8c1b51c0 2024-09-21T01:44:05.054 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.051+0000 7f58f3c9c740 1 -- 172.21.15.83:0/1793101832 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ad8c1b51c0 msgr2=0x55ad8c5aa5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:44:05.054 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.051+0000 7f58f3c9c740 1 --2- 172.21.15.83:0/1793101832 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ad8c1b51c0 0x55ad8c5aa5f0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f58d00e4e30 tx=0x7f58d00d0040 comp rx=0 tx=0).stop 2024-09-21T01:44:05.054 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.051+0000 7f58f3c9c740 1 -- 172.21.15.83:0/1793101832 shutdown_connections 2024-09-21T01:44:05.054 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.051+0000 7f58f3c9c740 1 --2- 172.21.15.83:0/1793101832 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ad8c1cd980 0x55ad8c5aab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:44:05.054 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.051+0000 7f58f3c9c740 1 --2- 172.21.15.83:0/1793101832 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ad8c1b51c0 0x55ad8c5aa5f0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:44:05.054 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.051+0000 7f58f3c9c740 1 --2- 172.21.15.83:0/1793101832 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ad8c1ea990 0x55ad8c5b92b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:44:05.054 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.051+0000 7f58f3c9c740 1 -- 172.21.15.83:0/1793101832 >> 172.21.15.83:0/1793101832 conn(0x55ad8c5a8d50 msgr2=0x55ad8c59eff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:44:05.054 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.051+0000 7f58f3c9c740 1 -- 172.21.15.83:0/1793101832 shutdown_connections 2024-09-21T01:44:05.054 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.051+0000 7f58f3c9c740 1 -- 172.21.15.83:0/1793101832 wait complete. 2024-09-21T01:44:05.054 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.052+0000 7f58f3c9c740 1 -- start start 2024-09-21T01:44:05.054 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.052+0000 7f58f3c9c740 1 Processor -- start 2024-09-21T01:44:05.054 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.052+0000 7f58f3c9c740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ad8c1b51c0 0x55ad8c5b2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:44:05.054 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.052+0000 7f58f3c9c740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ad8c1cd980 0x55ad8c5b32c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:44:05.054 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.052+0000 7f58f3c9c740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ad8c1ea990 0x55ad8c623ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:44:05.055 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.052+0000 7f58f3c9c740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f58e81ad700 con 0x55ad8c1b51c0 2024-09-21T01:44:05.055 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.052+0000 7f58f3c9c740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f58e81aeb70 con 0x55ad8c1ea990 2024-09-21T01:44:05.055 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.052+0000 7f58f3c9c740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f58e81addd0 con 0x55ad8c1cd980 2024-09-21T01:44:05.055 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.052+0000 7f58e6ffd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ad8c1b51c0 0x55ad8c5b2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:44:05.055 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.052+0000 7f58f3c9c740 10 client.0 _ll_register_callbacks cb 0x7f58e0011a30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:44:05.055 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.053+0000 7f58e6ffd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ad8c1b51c0 0x55ad8c5b2ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:59884/0 (socket says 172.21.15.83:59884) 2024-09-21T01:44:05.055 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.053+0000 7f58e6ffd640 1 -- 172.21.15.83:0/4167860152 learned_addr learned my addr 172.21.15.83:0/4167860152 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:44:05.055 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.053+0000 7f58e77fe640 1 --2- 172.21.15.83:0/4167860152 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ad8c1ea990 0x55ad8c623ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:44:05.055 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.053+0000 7f58de7fc640 1 --2- 172.21.15.83:0/4167860152 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ad8c1cd980 0x55ad8c5b32c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:44:05.055 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.053+0000 7f58e6ffd640 1 -- 172.21.15.83:0/4167860152 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ad8c1cd980 msgr2=0x55ad8c5b32c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:44:05.055 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.053+0000 7f58e6ffd640 1 --2- 172.21.15.83:0/4167860152 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ad8c1cd980 0x55ad8c5b32c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:44:05.055 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.053+0000 7f58e6ffd640 1 -- 172.21.15.83:0/4167860152 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ad8c1ea990 msgr2=0x55ad8c623ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:44:05.055 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.053+0000 7f58e6ffd640 1 --2- 172.21.15.83:0/4167860152 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ad8c1ea990 0x55ad8c623ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:44:05.055 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.053+0000 7f58e6ffd640 1 -- 172.21.15.83:0/4167860152 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ad8c624510 con 0x55ad8c1b51c0 2024-09-21T01:44:05.056 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.053+0000 7f58e6ffd640 1 --2- 172.21.15.83:0/4167860152 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ad8c1b51c0 0x55ad8c5b2ce0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f58d8005f70 tx=0x7f58d8031400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fef208278c48c68 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:44:05.056 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.053+0000 7f58ce7fc640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-09-21T01:44:05.057 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.053+0000 7f58ce7fc640 1 -- 172.21.15.83:0/4167860152 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58d8035040 con 0x55ad8c1b51c0 2024-09-21T01:44:05.057 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.053+0000 7f58ce7fc640 1 -- 172.21.15.83:0/4167860152 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9315+0+0 (secure 0 0 0) 0x7f58d8004230 con 0x55ad8c1b51c0 2024-09-21T01:44:05.057 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.053+0000 7f58f3c9c740 1 -- 172.21.15.83:0/4167860152 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f58d00acaf0 con 0x55ad8c1b51c0 2024-09-21T01:44:05.057 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.054+0000 7f58ce7fc640 1 -- 172.21.15.83:0/4167860152 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f58d8004430 con 0x55ad8c1b51c0 2024-09-21T01:44:05.057 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.054+0000 7f58f3c9c740 10 client.15615 fetch_fsmap learned FSMap version 21 2024-09-21T01:44:05.057 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.054+0000 7f58f3c9c740 1 -- 172.21.15.83:0/4167860152 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55ad8c62b920 con 0x55ad8c1b51c0 2024-09-21T01:44:05.057 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.054+0000 7f58ce7fc640 1 -- 172.21.15.83:0/4167860152 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f58d00acaf0 con 0x55ad8c1b51c0 2024-09-21T01:44:05.057 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.054+0000 7f58ce7fc640 1 -- 172.21.15.83:0/4167860152 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f58d803c790 con 0x55ad8c1b51c0 2024-09-21T01:44:05.057 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.054+0000 7f58f3c9c740 10 client.15615 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T01:44:05.057 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.054+0000 7f58f3c9c740 10 client.15615 resolve_mds: validated gid 24653 aka daemon mds.b 2024-09-21T01:44:05.057 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.054+0000 7f58f3c9c740 20 client.15615 populate_metadata read hostname 'smithi083' 2024-09-21T01:44:05.057 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.054+0000 7f58f3c9c740 1 --2- 172.21.15.83:0/4167860152 >> [v2:172.21.15.119:6838/3106757092,v1:172.21.15.119:6839/3106757092] conn(0x55ad8c1d5b60 0x55ad8c62dda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:44:05.058 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.054+0000 7f58f3c9c740 4 client.15615 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 147.8, "await_for": 45.0}] 2024-09-21T01:44:05.058 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.054+0000 7f58f3c9c740 1 -- 172.21.15.83:0/4167860152 --> [v2:172.21.15.119:6838/3106757092,v1:172.21.15.119:6839/3106757092] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 147.8, "await_for": 45.0}) -- 0x55ad8c511590 con 0x55ad8c1d5b60 2024-09-21T01:44:05.058 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.055+0000 7f58de7fc640 1 --2- 172.21.15.83:0/4167860152 >> [v2:172.21.15.119:6838/3106757092,v1:172.21.15.119:6839/3106757092] conn(0x55ad8c1d5b60 0x55ad8c62dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:44:05.058 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.055+0000 7f58de7fc640 1 --2- 172.21.15.83:0/4167860152 >> [v2:172.21.15.119:6838/3106757092,v1:172.21.15.119:6839/3106757092] conn(0x55ad8c1d5b60 0x55ad8c62dda0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3ea0e0a46d75e097 server_cookie=4f982b8de047994a in_seq=0 out_seq=0 2024-09-21T01:44:05.058 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.055+0000 7f58ce7fc640 10 client.15615 ms_handle_connect on v2:172.21.15.119:6838/3106757092 2024-09-21T01:44:05.066 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.066+0000 7f58ce7fc640 1 -- 172.21.15.83:0/4167860152 <== mds.0 v2:172.21.15.119:6838/3106757092 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55ad8c511590 con 0x55ad8c1d5b60 2024-09-21T01:44:05.066 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.066+0000 7f58ce7fc640 10 client.15615 handle_command_reply: tid=0 2024-09-21T01:44:05.067 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.066+0000 7f58f3c9c740 1 client.15615 shutdown 2024-09-21T01:44:05.067 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.066+0000 7f58f3c9c740 1 -- 172.21.15.83:0/4167860152 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ad8c1b51c0 msgr2=0x55ad8c5b2ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:44:05.067 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.066+0000 7f58f3c9c740 1 --2- 172.21.15.83:0/4167860152 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ad8c1b51c0 0x55ad8c5b2ce0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f58d8005f70 tx=0x7f58d8031400 comp rx=0 tx=0).stop 2024-09-21T01:44:05.067 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.066+0000 7f58f3c9c740 1 -- 172.21.15.83:0/4167860152 shutdown_connections 2024-09-21T01:44:05.067 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.066+0000 7f58f3c9c740 1 --2- 172.21.15.83:0/4167860152 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ad8c1ea990 0x55ad8c623ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:44:05.067 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.066+0000 7f58f3c9c740 1 --2- 172.21.15.83:0/4167860152 >> [v2:172.21.15.119:6838/3106757092,v1:172.21.15.119:6839/3106757092] conn(0x55ad8c1d5b60 0x55ad8c62dda0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:44:05.067 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.066+0000 7f58f3c9c740 1 --2- 172.21.15.83:0/4167860152 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ad8c1cd980 0x55ad8c5b32c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:44:05.067 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.066+0000 7f58f3c9c740 1 --2- 172.21.15.83:0/4167860152 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ad8c1b51c0 0x55ad8c5b2ce0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:44:05.067 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.066+0000 7f58f3c9c740 1 -- 172.21.15.83:0/4167860152 >> 172.21.15.83:0/4167860152 conn(0x55ad8c5a8d50 msgr2=0x55ad8c59edc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:44:05.067 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.066+0000 7f58ce7fc640 0 client.15615 ms_handle_reset on v2:172.21.15.119:6838/3106757092 2024-09-21T01:44:05.067 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.066+0000 7f58f3c9c740 1 -- 172.21.15.83:0/4167860152 shutdown_connections 2024-09-21T01:44:05.067 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.066+0000 7f58f3c9c740 1 -- 172.21.15.83:0/4167860152 wait complete. 2024-09-21T01:44:05.067 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.066+0000 7f58f3c9c740 20 client.15615 trim_cache size 0 max 16384 2024-09-21T01:44:05.068 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-09-21T01:44:05.068 INFO:teuthology.orchestra.run.smithi083.stdout: "epoch": 21, 2024-09-21T01:44:05.068 INFO:teuthology.orchestra.run.smithi083.stdout: "leader": 24653, 2024-09-21T01:44:05.068 INFO:teuthology.orchestra.run.smithi083.stdout: "set_version": 10, 2024-09-21T01:44:05.068 INFO:teuthology.orchestra.run.smithi083.stdout: "sets": { 2024-09-21T01:44:05.068 INFO:teuthology.orchestra.run.smithi083.stdout: "82fdba2f": { 2024-09-21T01:44:05.068 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 10, 2024-09-21T01:44:05.068 INFO:teuthology.orchestra.run.smithi083.stdout: "age_ref": 0.0, 2024-09-21T01:44:05.068 INFO:teuthology.orchestra.run.smithi083.stdout: "state": { 2024-09-21T01:44:05.068 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "QUIESCED", 2024-09-21T01:44:05.068 INFO:teuthology.orchestra.run.smithi083.stdout: "age": 0.0 2024-09-21T01:44:05.069 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:44:05.069 INFO:teuthology.orchestra.run.smithi083.stdout: "timeout": 90.0, 2024-09-21T01:44:05.069 INFO:teuthology.orchestra.run.smithi083.stdout: "expiration": 147.8, 2024-09-21T01:44:05.069 INFO:teuthology.orchestra.run.smithi083.stdout: "members": { 2024-09-21T01:44:05.069 INFO:teuthology.orchestra.run.smithi083.stdout: "file:/": { 2024-09-21T01:44:05.069 INFO:teuthology.orchestra.run.smithi083.stdout: "excluded": false, 2024-09-21T01:44:05.069 INFO:teuthology.orchestra.run.smithi083.stdout: "state": { 2024-09-21T01:44:05.069 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "QUIESCED", 2024-09-21T01:44:05.069 INFO:teuthology.orchestra.run.smithi083.stdout: "age": 0.0 2024-09-21T01:44:05.069 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:44:05.069 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:44:05.069 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:44:05.069 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:44:05.069 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:44:05.069 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-09-21T01:44:05.070 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.067+0000 7f58ed728640 1 -- 172.21.15.83:0/1244494850 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f58d40b6680 msgr2=0x7f58d40b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:44:05.070 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.067+0000 7f58ed728640 1 --2- 172.21.15.83:0/1244494850 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f58d40b6680 0x7f58d40b8b90 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f58e0005f40 tx=0x7f58e0009600 comp rx=0 tx=0).stop 2024-09-21T01:44:05.070 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.067+0000 7f58ed728640 1 -- 172.21.15.83:0/1244494850 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f58e81083c0 msgr2=0x7f58e81998d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:44:05.070 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.067+0000 7f58ed728640 1 --2- 172.21.15.83:0/1244494850 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f58e81083c0 0x7f58e81998d0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f58d000d750 tx=0x7f58d000dc10 comp rx=0 tx=0).stop 2024-09-21T01:44:05.070 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.067+0000 7f58ed728640 1 -- 172.21.15.83:0/1244494850 shutdown_connections 2024-09-21T01:44:05.070 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.067+0000 7f58ed728640 1 --2- 172.21.15.83:0/1244494850 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f58d40b6680 0x7f58d40b8b90 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:44:05.070 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.067+0000 7f58ed728640 1 --2- 172.21.15.83:0/1244494850 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f58e8108d10 0x7f58e819eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:44:05.070 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.067+0000 7f58ed728640 1 --2- 172.21.15.83:0/1244494850 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f58e81083c0 0x7f58e81998d0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:44:05.071 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.067+0000 7f58ed728640 1 --2- 172.21.15.83:0/1244494850 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f58e8102a80 0x7f58e8199330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:44:05.071 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.067+0000 7f58ed728640 1 -- 172.21.15.83:0/1244494850 >> 172.21.15.83:0/1244494850 conn(0x7f58e8079730 msgr2=0x7f58e8106510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:44:05.071 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.067+0000 7f58ed728640 1 -- 172.21.15.83:0/1244494850 shutdown_connections 2024-09-21T01:44:05.071 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:05.067+0000 7f58ed728640 1 -- 172.21.15.83:0/1244494850 wait complete. 2024-09-21T01:44:05.775 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '82fdba2f', quiesce took 3.4 seconds. Will release after: 24.400000000000002 2024-09-21T01:44:06.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:44:05 smithi083 ceph-mon[31370]: pgmap v400: 129 pgs: 129 active+clean; 3.6 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 184 KiB/s wr, 4 op/s 2024-09-21T01:44:06.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:44:05 smithi142 ceph-mon[34050]: pgmap v400: 129 pgs: 129 active+clean; 3.6 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 184 KiB/s wr, 4 op/s 2024-09-21T01:44:06.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:44:05 smithi119 ceph-mon[33693]: pgmap v400: 129 pgs: 129 active+clean; 3.6 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 184 KiB/s wr, 4 op/s 2024-09-21T01:44:08.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:44:07 smithi142 ceph-mon[34050]: pgmap v401: 129 pgs: 129 active+clean; 3.6 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 194 KiB/s wr, 16 op/s 2024-09-21T01:44:08.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:44:07 smithi119 ceph-mon[33693]: pgmap v401: 129 pgs: 129 active+clean; 3.6 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 194 KiB/s wr, 16 op/s 2024-09-21T01:44:08.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:44:07 smithi083 ceph-mon[31370]: pgmap v401: 129 pgs: 129 active+clean; 3.6 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 194 KiB/s wr, 16 op/s 2024-09-21T01:44:10.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:44:09 smithi142 ceph-mon[34050]: pgmap v402: 129 pgs: 129 active+clean; 3.6 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 194 KiB/s wr, 16 op/s 2024-09-21T01:44:10.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:44:09 smithi119 ceph-mon[33693]: pgmap v402: 129 pgs: 129 active+clean; 3.6 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 194 KiB/s wr, 16 op/s 2024-09-21T01:44:10.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:44:09 smithi083 ceph-mon[31370]: pgmap v402: 129 pgs: 129 active+clean; 3.6 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 194 KiB/s wr, 16 op/s 2024-09-21T01:44:12.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:44:11 smithi142 ceph-mon[34050]: pgmap v403: 129 pgs: 129 active+clean; 3.6 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 196 KiB/s wr, 17 op/s 2024-09-21T01:44:12.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:44:11 smithi119 ceph-mon[33693]: pgmap v403: 129 pgs: 129 active+clean; 3.6 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 196 KiB/s wr, 17 op/s 2024-09-21T01:44:12.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:44:11 smithi083 ceph-mon[31370]: pgmap v403: 129 pgs: 129 active+clean; 3.6 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 196 KiB/s wr, 17 op/s 2024-09-21T01:44:14.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:44:13 smithi142 ceph-mon[34050]: pgmap v404: 129 pgs: 129 active+clean; 3.9 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 218 KiB/s wr, 17 op/s 2024-09-21T01:44:14.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:44:13 smithi119 ceph-mon[33693]: pgmap v404: 129 pgs: 129 active+clean; 3.9 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 218 KiB/s wr, 17 op/s 2024-09-21T01:44:14.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:44:13 smithi083 ceph-mon[31370]: pgmap v404: 129 pgs: 129 active+clean; 3.9 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 218 KiB/s wr, 17 op/s 2024-09-21T01:44:15.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:44:14 smithi142 ceph-mon[34050]: pgmap v405: 129 pgs: 129 active+clean; 3.9 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 38 KiB/s wr, 16 op/s 2024-09-21T01:44:15.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:44:14 smithi119 ceph-mon[33693]: pgmap v405: 129 pgs: 129 active+clean; 3.9 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 38 KiB/s wr, 16 op/s 2024-09-21T01:44:15.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:44:14 smithi083 ceph-mon[31370]: pgmap v405: 129 pgs: 129 active+clean; 3.9 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 38 KiB/s wr, 16 op/s 2024-09-21T01:44:18.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:44:17 smithi142 ceph-mon[34050]: pgmap v406: 129 pgs: 129 active+clean; 3.9 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 36 KiB/s wr, 15 op/s 2024-09-21T01:44:18.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:44:17 smithi119 ceph-mon[33693]: pgmap v406: 129 pgs: 129 active+clean; 3.9 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 36 KiB/s wr, 15 op/s 2024-09-21T01:44:18.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:44:17 smithi083 ceph-mon[31370]: pgmap v406: 129 pgs: 129 active+clean; 3.9 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 36 KiB/s wr, 15 op/s 2024-09-21T01:44:20.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:44:19 smithi142 ceph-mon[34050]: pgmap v407: 129 pgs: 129 active+clean; 3.9 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 25 KiB/s wr, 2 op/s 2024-09-21T01:44:20.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:44:19 smithi119 ceph-mon[33693]: pgmap v407: 129 pgs: 129 active+clean; 3.9 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 25 KiB/s wr, 2 op/s 2024-09-21T01:44:20.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:44:19 smithi083 ceph-mon[31370]: pgmap v407: 129 pgs: 129 active+clean; 3.9 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 25 KiB/s wr, 2 op/s 2024-09-21T01:44:22.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:44:21 smithi142 ceph-mon[34050]: pgmap v408: 129 pgs: 129 active+clean; 3.9 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 25 KiB/s wr, 3 op/s 2024-09-21T01:44:22.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:44:21 smithi119 ceph-mon[33693]: pgmap v408: 129 pgs: 129 active+clean; 3.9 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 25 KiB/s wr, 3 op/s 2024-09-21T01:44:22.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:44:21 smithi083 ceph-mon[31370]: pgmap v408: 129 pgs: 129 active+clean; 3.9 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 25 KiB/s wr, 3 op/s 2024-09-21T01:44:24.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:44:23 smithi142 ceph-mon[34050]: pgmap v409: 129 pgs: 129 active+clean; 3.9 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 24 KiB/s wr, 1 op/s 2024-09-21T01:44:24.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:44:23 smithi119 ceph-mon[33693]: pgmap v409: 129 pgs: 129 active+clean; 3.9 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 24 KiB/s wr, 1 op/s 2024-09-21T01:44:24.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:44:23 smithi083 ceph-mon[31370]: pgmap v409: 129 pgs: 129 active+clean; 3.9 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 24 KiB/s wr, 1 op/s 2024-09-21T01:44:26.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:44:25 smithi142 ceph-mon[34050]: pgmap v410: 129 pgs: 129 active+clean; 3.9 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-09-21T01:44:26.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:44:25 smithi119 ceph-mon[33693]: pgmap v410: 129 pgs: 129 active+clean; 3.9 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-09-21T01:44:26.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:44:25 smithi083 ceph-mon[31370]: pgmap v410: 129 pgs: 129 active+clean; 3.9 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-09-21T01:44:28.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:44:27 smithi142 ceph-mon[34050]: pgmap v411: 129 pgs: 129 active+clean; 3.9 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:44:28.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:44:27 smithi119 ceph-mon[33693]: pgmap v411: 129 pgs: 129 active+clean; 3.9 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:44:28.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:44:27 smithi083 ceph-mon[31370]: pgmap v411: 129 pgs: 129 active+clean; 3.9 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:44:29.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:44:28 smithi142 ceph-mon[34050]: pgmap v412: 129 pgs: 129 active+clean; 3.9 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:44:29.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:44:28 smithi119 ceph-mon[33693]: pgmap v412: 129 pgs: 129 active+clean; 3.9 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:44:29.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:44:28 smithi083 ceph-mon[31370]: pgmap v412: 129 pgs: 129 active+clean; 3.9 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:44:30.177 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T01:44:30.440 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:44:30.943 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:30.940+0000 7f5772a5f640 1 -- 172.21.15.83:0/3679144943 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f576c1094a0 msgr2=0x7f576c1098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:44:30.944 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:30.940+0000 7f5772a5f640 1 --2- 172.21.15.83:0/3679144943 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f576c1094a0 0x7f576c1098b0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f5760009900 tx=0x7f576002a410 comp rx=0 tx=0).stop 2024-09-21T01:44:30.944 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:30.940+0000 7f5772a5f640 1 -- 172.21.15.83:0/3679144943 shutdown_connections 2024-09-21T01:44:30.944 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:30.940+0000 7f5772a5f640 1 --2- 172.21.15.83:0/3679144943 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f576c109df0 0x7f576c110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:44:30.944 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:30.940+0000 7f5772a5f640 1 --2- 172.21.15.83:0/3679144943 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f576c1094a0 0x7f576c1098b0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:44:30.944 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:30.940+0000 7f5772a5f640 1 --2- 172.21.15.83:0/3679144943 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f576c103b60 0x7f576c103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:44:30.944 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:30.940+0000 7f5772a5f640 1 -- 172.21.15.83:0/3679144943 >> 172.21.15.83:0/3679144943 conn(0x7f576c07b850 msgr2=0x7f576c07bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:44:30.944 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:30.940+0000 7f5772a5f640 1 -- 172.21.15.83:0/3679144943 shutdown_connections 2024-09-21T01:44:30.944 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:30.940+0000 7f5772a5f640 1 -- 172.21.15.83:0/3679144943 wait complete. 2024-09-21T01:44:30.944 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:30.940+0000 7f5772a5f640 1 Processor -- start 2024-09-21T01:44:30.944 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:30.940+0000 7f5772a5f640 1 -- start start 2024-09-21T01:44:30.945 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:30.941+0000 7f5772a5f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f576c103b60 0x7f576c19a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:44:30.945 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:30.941+0000 7f5772a5f640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f576c1094a0 0x7f576c19a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:44:30.945 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:30.941+0000 7f5772a5f640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f576c109df0 0x7f576c19fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:44:30.945 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:30.941+0000 7f5772a5f640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f576c113960 con 0x7f576c1094a0 2024-09-21T01:44:30.945 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:30.941+0000 7f5772a5f640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f576c1137e0 con 0x7f576c103b60 2024-09-21T01:44:30.945 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:30.941+0000 7f5772a5f640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f576c113ae0 con 0x7f576c109df0 2024-09-21T01:44:30.945 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:30.941+0000 7f576b7fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f576c1094a0 0x7f576c19a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:44:30.945 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:30.941+0000 7f576b7fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f576c1094a0 0x7f576c19a9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:44424/0 (socket says 172.21.15.83:44424) 2024-09-21T01:44:30.945 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:30.941+0000 7f576b7fe640 1 -- 172.21.15.83:0/1125518138 learned_addr learned my addr 172.21.15.83:0/1125518138 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:44:30.945 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:30.941+0000 7f5770ffc640 1 --2- 172.21.15.83:0/1125518138 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f576c109df0 0x7f576c19fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:44:30.945 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:30.941+0000 7f576bfff640 1 --2- 172.21.15.83:0/1125518138 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f576c103b60 0x7f576c19a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:44:30.945 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:30.941+0000 7f576b7fe640 1 -- 172.21.15.83:0/1125518138 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f576c109df0 msgr2=0x7f576c19fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:44:30.945 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:30.941+0000 7f576b7fe640 1 --2- 172.21.15.83:0/1125518138 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f576c109df0 0x7f576c19fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:44:30.945 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:30.941+0000 7f576b7fe640 1 -- 172.21.15.83:0/1125518138 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f576c103b60 msgr2=0x7f576c19a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:44:30.946 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:30.941+0000 7f576b7fe640 1 --2- 172.21.15.83:0/1125518138 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f576c103b60 0x7f576c19a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:44:30.946 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:30.941+0000 7f576b7fe640 1 -- 172.21.15.83:0/1125518138 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f576c1a03a0 con 0x7f576c1094a0 2024-09-21T01:44:30.946 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:30.941+0000 7f576bfff640 1 --2- 172.21.15.83:0/1125518138 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f576c103b60 0x7f576c19a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:44:30.946 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:30.942+0000 7f576b7fe640 1 --2- 172.21.15.83:0/1125518138 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f576c1094a0 0x7f576c19a9d0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f5760005940 tx=0x7f57600040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:44:30.946 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:30.942+0000 7f57697fa640 1 -- 172.21.15.83:0/1125518138 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f576003f030 con 0x7f576c1094a0 2024-09-21T01:44:30.946 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:30.942+0000 7f5772a5f640 1 -- 172.21.15.83:0/1125518138 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f576c1a0630 con 0x7f576c1094a0 2024-09-21T01:44:30.946 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:30.942+0000 7f57697fa640 1 -- 172.21.15.83:0/1125518138 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5760003a80 con 0x7f576c1094a0 2024-09-21T01:44:30.946 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:30.942+0000 7f57697fa640 1 -- 172.21.15.83:0/1125518138 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5760035070 con 0x7f576c1094a0 2024-09-21T01:44:30.946 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:30.942+0000 7f5772a5f640 1 -- 172.21.15.83:0/1125518138 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f576c1a6df0 con 0x7f576c1094a0 2024-09-21T01:44:30.946 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:30.943+0000 7f5772a5f640 1 -- 172.21.15.83:0/1125518138 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f576c103f70 con 0x7f576c1094a0 2024-09-21T01:44:30.947 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:30.946+0000 7f57697fa640 1 -- 172.21.15.83:0/1125518138 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7f5760042030 con 0x7f576c1094a0 2024-09-21T01:44:30.947 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:30.946+0000 7f57697fa640 1 --2- 172.21.15.83:0/1125518138 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f57540b6680 0x7f57540b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:44:30.947 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:30.947+0000 7f576bfff640 1 --2- 172.21.15.83:0/1125518138 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f57540b6680 0x7f57540b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:44:30.947 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:30.947+0000 7f57697fa640 1 -- 172.21.15.83:0/1125518138 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9315+0+0 (secure 0 0 0) 0x7f57601083c0 con 0x7f576c1094a0 2024-09-21T01:44:30.947 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:30.947+0000 7f576bfff640 1 --2- 172.21.15.83:0/1125518138 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f57540b6680 0x7f57540b8b90 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f575c0058c0 tx=0x7f575c005850 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:44:30.950 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:30.950+0000 7f57697fa640 1 -- 172.21.15.83:0/1125518138 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f57600ce5f0 con 0x7f576c1094a0 2024-09-21T01:44:31.164 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:31.163+0000 7f5772a5f640 1 -- 172.21.15.83:0/1125518138 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f576c10bbf0 con 0x7f576c1094a0 2024-09-21T01:44:31.164 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:31.164+0000 7f57697fa640 1 -- 172.21.15.83:0/1125518138 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11857 (secure 0 0 0) 0x7f57600d29d0 con 0x7f576c1094a0 2024-09-21T01:44:31.164 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T01:44:31.165 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":21,"btime":"2024-09-21T01:40:27:947059+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14775,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6835/1105040204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":1105040204},{"type":"v1","addr":"172.21.15.83:6835","nonce":1105040204}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14787,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/2234789563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6836","nonce":2234789563},{"type":"v1","addr":"172.21.15.83:6837","nonce":2234789563}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14838,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6839/136258364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6838","nonce":136258364},{"type":"v1","addr":"172.21.15.83:6839","nonce":136258364}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14850,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6841/129439444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6840","nonce":129439444},{"type":"v1","addr":"172.21.15.83:6841","nonce":129439444}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24569,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/2839502433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":2839502433},{"type":"v1","addr":"172.21.15.119:6833","nonce":2839502433}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24580,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6833/2841606990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":2841606990},{"type":"v1","addr":"172.21.15.142:6833","nonce":2841606990}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24599,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/415902608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":415902608},{"type":"v1","addr":"172.21.15.119:6835","nonce":415902608}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24607,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/3009088510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":3009088510},{"type":"v1","addr":"172.21.15.142:6835","nonce":3009088510}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24613,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/3847200126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6836","nonce":3847200126},{"type":"v1","addr":"172.21.15.142:6837","nonce":3847200126}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24626,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/3619222976","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":3619222976},{"type":"v1","addr":"172.21.15.119:6837","nonce":3619222976}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T01:39:45.145124+0000","modified":"2024-09-21T01:40:27.664151+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24653},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24631":{"gid":24631,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.142:6839/1817880741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6838","nonce":1817880741},{"type":"v1","addr":"172.21.15.142:6839","nonce":1817880741}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24653":{"gid":24653,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.119:6839/3106757092","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":3106757092},{"type":"v1","addr":"172.21.15.119:6839","nonce":3106757092}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24653,"qdb_cluster":[24653]},"id":1}]} 2024-09-21T01:44:31.165 INFO:teuthology.orchestra.run.smithi083.stderr:dumped fsmap epoch 21 2024-09-21T01:44:31.167 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:31.166+0000 7f5772a5f640 1 -- 172.21.15.83:0/1125518138 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f57540b6680 msgr2=0x7f57540b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:44:31.167 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:31.166+0000 7f5772a5f640 1 --2- 172.21.15.83:0/1125518138 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f57540b6680 0x7f57540b8b90 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f575c0058c0 tx=0x7f575c005850 comp rx=0 tx=0).stop 2024-09-21T01:44:31.167 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:31.166+0000 7f5772a5f640 1 -- 172.21.15.83:0/1125518138 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f576c1094a0 msgr2=0x7f576c19a9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:44:31.167 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:31.166+0000 7f5772a5f640 1 --2- 172.21.15.83:0/1125518138 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f576c1094a0 0x7f576c19a9d0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f5760005940 tx=0x7f57600040e0 comp rx=0 tx=0).stop 2024-09-21T01:44:31.167 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:31.166+0000 7f5772a5f640 1 -- 172.21.15.83:0/1125518138 shutdown_connections 2024-09-21T01:44:31.168 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:31.167+0000 7f5772a5f640 1 --2- 172.21.15.83:0/1125518138 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f57540b6680 0x7f57540b8b90 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:44:31.168 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:31.167+0000 7f5772a5f640 1 --2- 172.21.15.83:0/1125518138 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f576c109df0 0x7f576c19fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:44:31.168 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:31.167+0000 7f5772a5f640 1 --2- 172.21.15.83:0/1125518138 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f576c1094a0 0x7f576c19a9d0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:44:31.168 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:31.167+0000 7f5772a5f640 1 --2- 172.21.15.83:0/1125518138 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f576c103b60 0x7f576c19a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:44:31.168 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:31.167+0000 7f5772a5f640 1 -- 172.21.15.83:0/1125518138 >> 172.21.15.83:0/1125518138 conn(0x7f576c07b850 msgr2=0x7f576c1055c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:44:31.168 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:31.167+0000 7f5772a5f640 1 -- 172.21.15.83:0/1125518138 shutdown_connections 2024-09-21T01:44:31.168 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:31.167+0000 7f5772a5f640 1 -- 172.21.15.83:0/1125518138 wait complete. 2024-09-21T01:44:31.968 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24653 quiesce db --set-id 82fdba2f --release --await' 2024-09-21T01:44:31.968 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24653 quiesce db --set-id 82fdba2f --release --await 2024-09-21T01:44:32.213 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:44:32.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:44:31 smithi142 ceph-mon[34050]: pgmap v413: 129 pgs: 129 active+clean; 3.9 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T01:44:32.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:44:31 smithi142 ceph-mon[34050]: from='client.? 172.21.15.83:0/1125518138' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:44:32.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:44:31 smithi119 ceph-mon[33693]: pgmap v413: 129 pgs: 129 active+clean; 3.9 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T01:44:32.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:44:31 smithi119 ceph-mon[33693]: from='client.? 172.21.15.83:0/1125518138' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:44:32.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:44:31 smithi083 ceph-mon[31370]: pgmap v413: 129 pgs: 129 active+clean; 3.9 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T01:44:32.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:44:31 smithi083 ceph-mon[31370]: from='client.? 172.21.15.83:0/1125518138' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:44:32.717 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.716+0000 7eff7c394640 1 -- 172.21.15.83:0/2957524467 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7eff74109df0 msgr2=0x7eff74110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:44:32.717 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.716+0000 7eff7c394640 1 --2- 172.21.15.83:0/2957524467 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7eff74109df0 0x7eff74110620 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7eff6c009ca0 tx=0x7eff6c02a8e0 comp rx=0 tx=0).stop 2024-09-21T01:44:32.717 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.716+0000 7eff7c394640 1 -- 172.21.15.83:0/2957524467 shutdown_connections 2024-09-21T01:44:32.717 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.716+0000 7eff7c394640 1 --2- 172.21.15.83:0/2957524467 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7eff74109df0 0x7eff74110620 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:44:32.717 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.716+0000 7eff7c394640 1 --2- 172.21.15.83:0/2957524467 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7eff741094a0 0x7eff741098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:44:32.717 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.716+0000 7eff7c394640 1 --2- 172.21.15.83:0/2957524467 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7eff74103b60 0x7eff74103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:44:32.717 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.716+0000 7eff7c394640 1 -- 172.21.15.83:0/2957524467 >> 172.21.15.83:0/2957524467 conn(0x7eff7407b850 msgr2=0x7eff7407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:44:32.717 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.716+0000 7eff7c394640 1 -- 172.21.15.83:0/2957524467 shutdown_connections 2024-09-21T01:44:32.717 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.716+0000 7eff7c394640 1 -- 172.21.15.83:0/2957524467 wait complete. 2024-09-21T01:44:32.719 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.717+0000 7eff7c394640 1 Processor -- start 2024-09-21T01:44:32.719 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.717+0000 7eff7c394640 1 -- start start 2024-09-21T01:44:32.719 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.717+0000 7eff7c394640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7eff74103b60 0x7eff7419a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:44:32.719 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.717+0000 7eff7c394640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7eff741094a0 0x7eff7419aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:44:32.719 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.717+0000 7eff7c394640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7eff74109df0 0x7eff7419fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:44:32.719 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.717+0000 7eff7c394640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7eff74113a20 con 0x7eff74109df0 2024-09-21T01:44:32.719 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.717+0000 7eff7c394640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7eff741138a0 con 0x7eff741094a0 2024-09-21T01:44:32.720 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.717+0000 7eff7c394640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7eff74113ba0 con 0x7eff74103b60 2024-09-21T01:44:32.720 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.718+0000 7eff7a931640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7eff74109df0 0x7eff7419fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:44:32.720 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.718+0000 7eff7a931640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7eff74109df0 0x7eff7419fd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:44440/0 (socket says 172.21.15.83:44440) 2024-09-21T01:44:32.720 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.718+0000 7eff7a931640 1 -- 172.21.15.83:0/1007774109 learned_addr learned my addr 172.21.15.83:0/1007774109 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:44:32.720 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.718+0000 7eff7a130640 1 --2- 172.21.15.83:0/1007774109 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7eff74103b60 0x7eff7419a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:44:32.720 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.718+0000 7eff7992f640 1 --2- 172.21.15.83:0/1007774109 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7eff741094a0 0x7eff7419aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:44:32.720 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.718+0000 7eff7a931640 1 -- 172.21.15.83:0/1007774109 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7eff74103b60 msgr2=0x7eff7419a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:44:32.720 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.718+0000 7eff7a931640 1 --2- 172.21.15.83:0/1007774109 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7eff74103b60 0x7eff7419a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:44:32.720 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.718+0000 7eff7a931640 1 -- 172.21.15.83:0/1007774109 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7eff741094a0 msgr2=0x7eff7419aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:44:32.720 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.718+0000 7eff7a931640 1 --2- 172.21.15.83:0/1007774109 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7eff741094a0 0x7eff7419aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:44:32.720 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.718+0000 7eff7a931640 1 -- 172.21.15.83:0/1007774109 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff741a04a0 con 0x7eff74109df0 2024-09-21T01:44:32.720 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.718+0000 7eff7992f640 1 --2- 172.21.15.83:0/1007774109 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7eff741094a0 0x7eff7419aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:44:32.720 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.718+0000 7eff7a931640 1 --2- 172.21.15.83:0/1007774109 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7eff74109df0 0x7eff7419fd70 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7eff6c006010 tx=0x7eff6c003c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:44:32.720 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.718+0000 7eff677fe640 1 -- 172.21.15.83:0/1007774109 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff6c004240 con 0x7eff74109df0 2024-09-21T01:44:32.720 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.718+0000 7eff7c394640 1 -- 172.21.15.83:0/1007774109 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff741a0730 con 0x7eff74109df0 2024-09-21T01:44:32.721 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.718+0000 7eff677fe640 1 -- 172.21.15.83:0/1007774109 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7eff6c0305e0 con 0x7eff74109df0 2024-09-21T01:44:32.721 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.718+0000 7eff677fe640 1 -- 172.21.15.83:0/1007774109 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff6c03b660 con 0x7eff74109df0 2024-09-21T01:44:32.721 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.719+0000 7eff7c394640 1 -- 172.21.15.83:0/1007774109 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff741a6ef0 con 0x7eff74109df0 2024-09-21T01:44:32.721 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.721+0000 7eff82908740 1 Processor -- start 2024-09-21T01:44:32.721 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.721+0000 7eff677fe640 1 -- 172.21.15.83:0/1007774109 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7eff6c030ad0 con 0x7eff74109df0 2024-09-21T01:44:32.723 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.722+0000 7eff82908740 1 -- start start 2024-09-21T01:44:32.723 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.722+0000 7eff82908740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5570bcc4b520 0x5570bcff1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:44:32.723 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.722+0000 7eff82908740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5570bcc22660 0x5570bcff1a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:44:32.723 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.722+0000 7eff82908740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5570bcc2a840 0x5570bcff1f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:44:32.723 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.722+0000 7eff82908740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x5570bcedcdc0 con 0x5570bcc4b520 2024-09-21T01:44:32.723 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.722+0000 7eff82908740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5570bcf691f0 con 0x5570bcc2a840 2024-09-21T01:44:32.723 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.722+0000 7eff82908740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x5570bcf58620 con 0x5570bcc22660 2024-09-21T01:44:32.723 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.722+0000 7eff7992f640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5570bcc4b520 0x5570bcff1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:44:32.723 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.722+0000 7eff7992f640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5570bcc4b520 0x5570bcff1510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:44446/0 (socket says 172.21.15.83:44446) 2024-09-21T01:44:32.723 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.722+0000 7eff7992f640 1 -- 172.21.15.83:0/1136845462 learned_addr learned my addr 172.21.15.83:0/1136845462 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:44:32.723 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.722+0000 7eff7a130640 1 --2- 172.21.15.83:0/1136845462 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5570bcc22660 0x5570bcff1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:44:32.723 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.722+0000 7eff677fe640 1 --2- 172.21.15.83:0/1007774109 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7eff600b6680 0x7eff600b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:44:32.724 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.722+0000 7eff7992f640 1 --2- 172.21.15.83:0/1136845462 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5570bcc2a840 0x5570bcff1f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:44:32.724 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.722+0000 7eff7992f640 1 -- 172.21.15.83:0/1136845462 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5570bcc22660 msgr2=0x5570bcff1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:44:32.724 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.722+0000 7eff7992f640 1 --2- 172.21.15.83:0/1136845462 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5570bcc22660 0x5570bcff1a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:44:32.724 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.722+0000 7eff7992f640 1 -- 172.21.15.83:0/1136845462 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5570bcc2a840 msgr2=0x5570bcff1f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:44:32.724 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.722+0000 7eff7992f640 1 --2- 172.21.15.83:0/1136845462 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5570bcc2a840 0x5570bcff1f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:44:32.724 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.722+0000 7eff7992f640 1 -- 172.21.15.83:0/1136845462 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5570bcf20fd0 con 0x5570bcc4b520 2024-09-21T01:44:32.724 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.722+0000 7eff7a130640 1 --2- 172.21.15.83:0/1136845462 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5570bcc22660 0x5570bcff1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:44:32.724 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.722+0000 7eff7a931640 1 --2- 172.21.15.83:0/1007774109 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7eff600b6680 0x7eff600b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:44:32.724 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.723+0000 7eff677fe640 1 -- 172.21.15.83:0/1007774109 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9315+0+0 (secure 0 0 0) 0x7eff6c108e80 con 0x7eff74109df0 2024-09-21T01:44:32.724 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.723+0000 7eff7992f640 1 --2- 172.21.15.83:0/1136845462 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5570bcc4b520 0x5570bcff1510 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7eff68007ed0 tx=0x7eff680073c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a7068ffca39c72f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:44:32.727 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.723+0000 7eff64d9a640 1 -- 172.21.15.83:0/1136845462 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff6801c070 con 0x5570bcc4b520 2024-09-21T01:44:32.727 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.723+0000 7eff64d9a640 1 -- 172.21.15.83:0/1136845462 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7eff68010040 con 0x5570bcc4b520 2024-09-21T01:44:32.727 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.723+0000 7eff64d9a640 1 -- 172.21.15.83:0/1136845462 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff680145b0 con 0x5570bcc4b520 2024-09-21T01:44:32.727 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.724+0000 7eff82908740 1 -- 172.21.15.83:0/1136845462 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5570bcc4b520 msgr2=0x5570bcff1510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:44:32.727 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.724+0000 7eff7a931640 1 --2- 172.21.15.83:0/1007774109 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7eff600b6680 0x7eff600b8b90 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7eff6c0ce6b0 tx=0x7eff6c0f2040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:44:32.727 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.724+0000 7eff82908740 1 --2- 172.21.15.83:0/1136845462 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5570bcc4b520 0x5570bcff1510 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7eff68007ed0 tx=0x7eff680073c0 comp rx=0 tx=0).stop 2024-09-21T01:44:32.727 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.724+0000 7eff82908740 1 -- 172.21.15.83:0/1136845462 shutdown_connections 2024-09-21T01:44:32.727 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.724+0000 7eff82908740 1 --2- 172.21.15.83:0/1136845462 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5570bcc2a840 0x5570bcff1f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:44:32.727 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.724+0000 7eff82908740 1 --2- 172.21.15.83:0/1136845462 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5570bcc22660 0x5570bcff1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:44:32.727 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.724+0000 7eff82908740 1 --2- 172.21.15.83:0/1136845462 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5570bcc4b520 0x5570bcff1510 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:44:32.728 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.724+0000 7eff82908740 1 -- 172.21.15.83:0/1136845462 >> 172.21.15.83:0/1136845462 conn(0x5570bcc3f910 msgr2=0x5570bcfef400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:44:32.728 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.724+0000 7eff82908740 1 -- 172.21.15.83:0/1136845462 shutdown_connections 2024-09-21T01:44:32.728 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.724+0000 7eff82908740 1 -- 172.21.15.83:0/1136845462 wait complete. 2024-09-21T01:44:32.728 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.724+0000 7eff82908740 1 -- start start 2024-09-21T01:44:32.728 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.724+0000 7eff82908740 1 Processor -- start 2024-09-21T01:44:32.728 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.725+0000 7eff82908740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5570bcc22660 0x5570bcffcc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:44:32.728 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.725+0000 7eff82908740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5570bcc2a840 0x5570bcffd180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:44:32.728 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.725+0000 7eff82908740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5570bcc4b520 0x5570bd008e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:44:32.728 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.725+0000 7eff82908740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x5570bcef3300 con 0x5570bcc4b520 2024-09-21T01:44:32.728 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.725+0000 7eff82908740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5570bcf5c430 con 0x5570bcc22660 2024-09-21T01:44:32.728 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.725+0000 7eff82908740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x5570bcdb9bb0 con 0x5570bcc2a840 2024-09-21T01:44:32.728 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.725+0000 7eff82908740 10 client.0 _ll_register_callbacks cb 0x5570bcf0d120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:44:32.728 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.725+0000 7eff7992f640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5570bcc4b520 0x5570bd008e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:44:32.728 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.725+0000 7eff7992f640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5570bcc4b520 0x5570bd008e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:44462/0 (socket says 172.21.15.83:44462) 2024-09-21T01:44:32.728 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.725+0000 7eff7992f640 1 -- 172.21.15.83:0/490328761 learned_addr learned my addr 172.21.15.83:0/490328761 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:44:32.729 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.725+0000 7eff7992f640 1 --2- 172.21.15.83:0/490328761 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5570bcc22660 0x5570bcffcc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:44:32.729 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.725+0000 7eff7a130640 1 --2- 172.21.15.83:0/490328761 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5570bcc2a840 0x5570bcffd180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:44:32.729 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.725+0000 7eff7992f640 1 -- 172.21.15.83:0/490328761 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5570bcc2a840 msgr2=0x5570bcffd180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:44:32.729 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.725+0000 7eff7992f640 1 --2- 172.21.15.83:0/490328761 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5570bcc2a840 0x5570bcffd180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:44:32.729 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.725+0000 7eff7992f640 1 -- 172.21.15.83:0/490328761 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5570bcc22660 msgr2=0x5570bcffcc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:44:32.729 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.725+0000 7eff7992f640 1 --2- 172.21.15.83:0/490328761 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5570bcc22660 0x5570bcffcc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:44:32.729 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.725+0000 7eff7992f640 1 -- 172.21.15.83:0/490328761 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5570bcee2780 con 0x5570bcc4b520 2024-09-21T01:44:32.729 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.725+0000 7eff7992f640 1 --2- 172.21.15.83:0/490328761 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5570bcc4b520 0x5570bd008e90 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7eff68017fd0 tx=0x7eff68017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecf07a318c0e6bfc server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:44:32.729 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.725+0000 7eff5dffb640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-09-21T01:44:32.729 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.726+0000 7eff5dffb640 1 -- 172.21.15.83:0/490328761 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff6802c060 con 0x5570bcc4b520 2024-09-21T01:44:32.729 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.726+0000 7eff5dffb640 1 -- 172.21.15.83:0/490328761 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9315+0+0 (secure 0 0 0) 0x7eff68017810 con 0x5570bcc4b520 2024-09-21T01:44:32.729 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.726+0000 7eff82908740 1 -- 172.21.15.83:0/490328761 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7eff68010040 con 0x5570bcc4b520 2024-09-21T01:44:32.729 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.726+0000 7eff5dffb640 1 -- 172.21.15.83:0/490328761 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7eff68033050 con 0x5570bcc4b520 2024-09-21T01:44:32.729 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.726+0000 7eff82908740 10 client.15633 fetch_fsmap learned FSMap version 21 2024-09-21T01:44:32.729 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.726+0000 7eff82908740 1 -- 172.21.15.83:0/490328761 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5570bccb6b00 con 0x5570bcc4b520 2024-09-21T01:44:32.730 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.726+0000 7eff5dffb640 1 -- 172.21.15.83:0/490328761 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7eff68010040 con 0x5570bcc4b520 2024-09-21T01:44:32.730 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.726+0000 7eff5dffb640 1 -- 172.21.15.83:0/490328761 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7eff68025570 con 0x5570bcc4b520 2024-09-21T01:44:32.730 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.726+0000 7eff82908740 10 client.15633 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T01:44:32.730 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.726+0000 7eff82908740 10 client.15633 resolve_mds: validated gid 24653 aka daemon mds.b 2024-09-21T01:44:32.730 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.726+0000 7eff82908740 20 client.15633 populate_metadata read hostname 'smithi083' 2024-09-21T01:44:32.730 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.726+0000 7eff82908740 1 --2- 172.21.15.83:0/490328761 >> [v2:172.21.15.119:6838/3106757092,v1:172.21.15.119:6839/3106757092] conn(0x5570bcc09ea0 0x5570bd00ef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:44:32.730 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.726+0000 7eff82908740 4 client.15633 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:44:32.730 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.726+0000 7eff82908740 1 -- 172.21.15.83:0/490328761 --> [v2:172.21.15.119:6838/3106757092,v1:172.21.15.119:6839/3106757092] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5570bcf6b140 con 0x5570bcc09ea0 2024-09-21T01:44:32.730 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.727+0000 7eff7a130640 1 --2- 172.21.15.83:0/490328761 >> [v2:172.21.15.119:6838/3106757092,v1:172.21.15.119:6839/3106757092] conn(0x5570bcc09ea0 0x5570bd00ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:44:32.731 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.727+0000 7eff5dffb640 10 client.15633 ms_handle_connect on v2:172.21.15.119:6838/3106757092 2024-09-21T01:44:32.731 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.727+0000 7eff7a130640 1 --2- 172.21.15.83:0/490328761 >> [v2:172.21.15.119:6838/3106757092,v1:172.21.15.119:6839/3106757092] conn(0x5570bcc09ea0 0x5570bd00ef40 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=97965992c14e8487 server_cookie=955604c12f4ec929 in_seq=0 out_seq=0 2024-09-21T01:44:32.731 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.728+0000 7eff5dffb640 1 -- 172.21.15.83:0/490328761 <== mds.0 v2:172.21.15.119:6838/3106757092 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5570bcf6b140 con 0x5570bcc09ea0 2024-09-21T01:44:32.731 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.728+0000 7eff5dffb640 10 client.15633 handle_command_reply: tid=0 2024-09-21T01:44:32.732 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.728+0000 7eff82908740 1 client.15633 shutdown 2024-09-21T01:44:32.732 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.728+0000 7eff82908740 1 -- 172.21.15.83:0/490328761 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5570bcc4b520 msgr2=0x5570bd008e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:44:32.732 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.728+0000 7eff82908740 1 --2- 172.21.15.83:0/490328761 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5570bcc4b520 0x5570bd008e90 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7eff68017fd0 tx=0x7eff68017e30 comp rx=0 tx=0).stop 2024-09-21T01:44:32.732 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.728+0000 7eff82908740 1 -- 172.21.15.83:0/490328761 shutdown_connections 2024-09-21T01:44:32.732 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.728+0000 7eff82908740 1 --2- 172.21.15.83:0/490328761 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5570bcc4b520 0x5570bd008e90 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:44:32.732 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.728+0000 7eff82908740 1 --2- 172.21.15.83:0/490328761 >> [v2:172.21.15.119:6838/3106757092,v1:172.21.15.119:6839/3106757092] conn(0x5570bcc09ea0 0x5570bd00ef40 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:44:32.732 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.728+0000 7eff82908740 1 --2- 172.21.15.83:0/490328761 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5570bcc2a840 0x5570bcffd180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:44:32.732 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.728+0000 7eff82908740 1 --2- 172.21.15.83:0/490328761 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5570bcc22660 0x5570bcffcc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:44:32.732 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.728+0000 7eff5dffb640 0 client.15633 ms_handle_reset on v2:172.21.15.119:6838/3106757092 2024-09-21T01:44:32.732 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.728+0000 7eff82908740 1 -- 172.21.15.83:0/490328761 >> 172.21.15.83:0/490328761 conn(0x5570bcc3f910 msgr2=0x5570bcff46f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:44:32.732 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.728+0000 7eff82908740 1 -- 172.21.15.83:0/490328761 shutdown_connections 2024-09-21T01:44:32.732 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.728+0000 7eff82908740 1 -- 172.21.15.83:0/490328761 wait complete. 2024-09-21T01:44:32.732 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.728+0000 7eff82908740 20 client.15633 trim_cache size 0 max 16384 2024-09-21T01:44:32.747 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.745+0000 7eff82908740 1 Processor -- start 2024-09-21T01:44:32.747 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.745+0000 7eff82908740 1 -- start start 2024-09-21T01:44:32.747 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.745+0000 7eff82908740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5570bcc22660 0x5570bcffd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:44:32.747 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.745+0000 7eff82908740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5570bcc2a840 0x5570bcff2f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:44:32.748 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.745+0000 7eff82908740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5570bcc4b520 0x5570bcff65f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:44:32.748 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.745+0000 7eff82908740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7eff741aec90 con 0x5570bcc22660 2024-09-21T01:44:32.748 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.745+0000 7eff82908740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7eff741b1510 con 0x5570bcc4b520 2024-09-21T01:44:32.748 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.745+0000 7eff82908740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7eff741af300 con 0x5570bcc2a840 2024-09-21T01:44:32.748 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.745+0000 7eff7992f640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5570bcc22660 0x5570bcffd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:44:32.748 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.745+0000 7eff7992f640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5570bcc22660 0x5570bcffd1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:44468/0 (socket says 172.21.15.83:44468) 2024-09-21T01:44:32.748 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.745+0000 7eff7992f640 1 -- 172.21.15.83:0/3990930720 learned_addr learned my addr 172.21.15.83:0/3990930720 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:44:32.748 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.745+0000 7eff7a130640 1 --2- 172.21.15.83:0/3990930720 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5570bcc2a840 0x5570bcff2f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:44:32.748 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.745+0000 7eff7992f640 1 -- 172.21.15.83:0/3990930720 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5570bcc2a840 msgr2=0x5570bcff2f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:44:32.748 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.745+0000 7eff7992f640 1 --2- 172.21.15.83:0/3990930720 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5570bcc2a840 0x5570bcff2f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:44:32.748 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.746+0000 7eff7992f640 1 -- 172.21.15.83:0/3990930720 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5570bcc4b520 msgr2=0x5570bcff65f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:44:32.748 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.746+0000 7eff7992f640 1 --2- 172.21.15.83:0/3990930720 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5570bcc4b520 0x5570bcff65f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:44:32.748 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.746+0000 7eff7992f640 1 -- 172.21.15.83:0/3990930720 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5570bcd2d960 con 0x5570bcc22660 2024-09-21T01:44:32.748 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.746+0000 7eff7a130640 1 --2- 172.21.15.83:0/3990930720 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5570bcc2a840 0x5570bcff2f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:44:32.748 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.746+0000 7eff7992f640 1 --2- 172.21.15.83:0/3990930720 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5570bcc22660 0x5570bcffd1c0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7eff68006b50 tx=0x7eff68007b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38f1bc68294aad6b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:44:32.748 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.746+0000 7eff5ffff640 1 -- 172.21.15.83:0/3990930720 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff6802c070 con 0x5570bcc22660 2024-09-21T01:44:32.749 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.746+0000 7eff5ffff640 1 -- 172.21.15.83:0/3990930720 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7eff6801d040 con 0x5570bcc22660 2024-09-21T01:44:32.749 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.746+0000 7eff5ffff640 1 -- 172.21.15.83:0/3990930720 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff6801c050 con 0x5570bcc22660 2024-09-21T01:44:32.749 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.747+0000 7eff82908740 1 -- 172.21.15.83:0/3990930720 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5570bcc22660 msgr2=0x5570bcffd1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:44:32.749 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.747+0000 7eff82908740 1 --2- 172.21.15.83:0/3990930720 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5570bcc22660 0x5570bcffd1c0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7eff68006b50 tx=0x7eff68007b90 comp rx=0 tx=0).stop 2024-09-21T01:44:32.749 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.747+0000 7eff82908740 1 -- 172.21.15.83:0/3990930720 shutdown_connections 2024-09-21T01:44:32.749 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.747+0000 7eff82908740 1 --2- 172.21.15.83:0/3990930720 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5570bcc4b520 0x5570bcff65f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:44:32.749 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.747+0000 7eff82908740 1 --2- 172.21.15.83:0/3990930720 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5570bcc2a840 0x5570bcff2f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:44:32.749 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.747+0000 7eff82908740 1 --2- 172.21.15.83:0/3990930720 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5570bcc22660 0x5570bcffd1c0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:44:32.749 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.747+0000 7eff82908740 1 -- 172.21.15.83:0/3990930720 >> 172.21.15.83:0/3990930720 conn(0x5570bcc3f910 msgr2=0x5570bcff4c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:44:32.749 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.747+0000 7eff82908740 1 -- 172.21.15.83:0/3990930720 shutdown_connections 2024-09-21T01:44:32.749 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.747+0000 7eff82908740 1 -- 172.21.15.83:0/3990930720 wait complete. 2024-09-21T01:44:32.749 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.747+0000 7eff82908740 1 -- start start 2024-09-21T01:44:32.749 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.747+0000 7eff82908740 1 Processor -- start 2024-09-21T01:44:32.752 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.747+0000 7eff82908740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5570bcc22660 0x5570bd005780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:44:32.752 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.747+0000 7eff82908740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5570bcc2a840 0x5570bd000c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:44:32.752 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.747+0000 7eff82908740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5570bcc4b520 0x5570bd001370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:44:32.752 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.747+0000 7eff82908740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7eff741af9d0 con 0x5570bcc22660 2024-09-21T01:44:32.752 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.747+0000 7eff82908740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7eff741b0e40 con 0x5570bcc2a840 2024-09-21T01:44:32.752 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.747+0000 7eff82908740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7eff741b00a0 con 0x5570bcc4b520 2024-09-21T01:44:32.752 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.747+0000 7eff82908740 10 client.0 _ll_register_callbacks cb 0x7eff6801a070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:44:32.752 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.748+0000 7eff7992f640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5570bcc22660 0x5570bd005780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:44:32.752 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.748+0000 7eff7992f640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5570bcc22660 0x5570bd005780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:44480/0 (socket says 172.21.15.83:44480) 2024-09-21T01:44:32.753 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.748+0000 7eff7992f640 1 -- 172.21.15.83:0/2157260273 learned_addr learned my addr 172.21.15.83:0/2157260273 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:44:32.753 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.748+0000 7eff7992f640 1 --2- 172.21.15.83:0/2157260273 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5570bcc4b520 0x5570bd001370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:44:32.753 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.748+0000 7eff7a130640 1 --2- 172.21.15.83:0/2157260273 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5570bcc2a840 0x5570bd000c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:44:32.753 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.748+0000 7eff7992f640 1 -- 172.21.15.83:0/2157260273 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5570bcc4b520 msgr2=0x5570bd001370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:44:32.753 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.748+0000 7eff7992f640 1 --2- 172.21.15.83:0/2157260273 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5570bcc4b520 0x5570bd001370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:44:32.753 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.748+0000 7eff7992f640 1 -- 172.21.15.83:0/2157260273 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5570bcc2a840 msgr2=0x5570bd000c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:44:32.753 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.748+0000 7eff7992f640 1 --2- 172.21.15.83:0/2157260273 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5570bcc2a840 0x5570bd000c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:44:32.753 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.748+0000 7eff7992f640 1 -- 172.21.15.83:0/2157260273 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5570bd078710 con 0x5570bcc22660 2024-09-21T01:44:32.753 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.748+0000 7eff7992f640 1 --2- 172.21.15.83:0/2157260273 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5570bcc22660 0x5570bd005780 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7eff6800fab0 tx=0x7eff68025c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=218075b06b5bba89 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:44:32.753 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.748+0000 7eff5dffb640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-09-21T01:44:32.753 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.748+0000 7eff5dffb640 1 -- 172.21.15.83:0/2157260273 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff6801c070 con 0x5570bcc22660 2024-09-21T01:44:32.753 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.748+0000 7eff5dffb640 1 -- 172.21.15.83:0/2157260273 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9315+0+0 (secure 0 0 0) 0x7eff68017610 con 0x5570bcc22660 2024-09-21T01:44:32.753 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.748+0000 7eff82908740 1 -- 172.21.15.83:0/2157260273 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7eff6801d040 con 0x5570bcc22660 2024-09-21T01:44:32.753 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.748+0000 7eff5dffb640 1 -- 172.21.15.83:0/2157260273 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7eff6804a050 con 0x5570bcc22660 2024-09-21T01:44:32.753 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.748+0000 7eff82908740 10 client.15639 fetch_fsmap learned FSMap version 21 2024-09-21T01:44:32.754 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.748+0000 7eff82908740 1 -- 172.21.15.83:0/2157260273 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5570bd079840 con 0x5570bcc22660 2024-09-21T01:44:32.754 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.749+0000 7eff5dffb640 1 -- 172.21.15.83:0/2157260273 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7eff6801d040 con 0x5570bcc22660 2024-09-21T01:44:32.754 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.749+0000 7eff5dffb640 1 -- 172.21.15.83:0/2157260273 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7eff68014c60 con 0x5570bcc22660 2024-09-21T01:44:32.754 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.749+0000 7eff82908740 10 client.15639 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T01:44:32.754 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.749+0000 7eff82908740 10 client.15639 resolve_mds: validated gid 24653 aka daemon mds.b 2024-09-21T01:44:32.754 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.749+0000 7eff82908740 20 client.15639 populate_metadata read hostname 'smithi083' 2024-09-21T01:44:32.754 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.749+0000 7eff82908740 1 --2- 172.21.15.83:0/2157260273 >> [v2:172.21.15.119:6838/3106757092,v1:172.21.15.119:6839/3106757092] conn(0x5570bcbdf250 0x5570bd07bf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:44:32.754 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.749+0000 7eff82908740 4 client.15639 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "82fdba2f", "release": true, "await": true}] 2024-09-21T01:44:32.754 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.749+0000 7eff82908740 1 -- 172.21.15.83:0/2157260273 --> [v2:172.21.15.119:6838/3106757092,v1:172.21.15.119:6839/3106757092] -- command(tid 0: {"prefix": "quiesce db", "set_id": "82fdba2f", "release": true, "await": true}) -- 0x5570bcf66bf0 con 0x5570bcbdf250 2024-09-21T01:44:32.754 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.749+0000 7eff7a130640 1 --2- 172.21.15.83:0/2157260273 >> [v2:172.21.15.119:6838/3106757092,v1:172.21.15.119:6839/3106757092] conn(0x5570bcbdf250 0x5570bd07bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:44:32.754 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.749+0000 7eff7a130640 1 --2- 172.21.15.83:0/2157260273 >> [v2:172.21.15.119:6838/3106757092,v1:172.21.15.119:6839/3106757092] conn(0x5570bcbdf250 0x5570bd07bf10 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=afc2d766028e36f6 server_cookie=605bf296e7b8ce16 in_seq=0 out_seq=0 2024-09-21T01:44:32.754 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.749+0000 7eff5dffb640 10 client.15639 ms_handle_connect on v2:172.21.15.119:6838/3106757092 2024-09-21T01:44:32.754 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.751+0000 7eff5dffb640 1 -- 172.21.15.83:0/2157260273 <== mds.0 v2:172.21.15.119:6838/3106757092 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x5570bcf66bf0 con 0x5570bcbdf250 2024-09-21T01:44:32.754 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.751+0000 7eff5dffb640 10 client.15639 handle_command_reply: tid=0 2024-09-21T01:44:32.754 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.751+0000 7eff82908740 1 client.15639 shutdown 2024-09-21T01:44:32.755 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.751+0000 7eff82908740 1 -- 172.21.15.83:0/2157260273 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5570bcc22660 msgr2=0x5570bd005780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:44:32.755 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.751+0000 7eff82908740 1 --2- 172.21.15.83:0/2157260273 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5570bcc22660 0x5570bd005780 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7eff6800fab0 tx=0x7eff68025c20 comp rx=0 tx=0).stop 2024-09-21T01:44:32.755 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.751+0000 7eff82908740 1 -- 172.21.15.83:0/2157260273 shutdown_connections 2024-09-21T01:44:32.755 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.751+0000 7eff82908740 1 --2- 172.21.15.83:0/2157260273 >> [v2:172.21.15.119:6838/3106757092,v1:172.21.15.119:6839/3106757092] conn(0x5570bcbdf250 0x5570bd07bf10 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:44:32.755 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.751+0000 7eff82908740 1 --2- 172.21.15.83:0/2157260273 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5570bcc4b520 0x5570bd001370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:44:32.755 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.751+0000 7eff82908740 1 --2- 172.21.15.83:0/2157260273 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5570bcc2a840 0x5570bd000c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:44:32.755 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.751+0000 7eff82908740 1 --2- 172.21.15.83:0/2157260273 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5570bcc22660 0x5570bd005780 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:44:32.755 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.751+0000 7eff82908740 1 -- 172.21.15.83:0/2157260273 >> 172.21.15.83:0/2157260273 conn(0x5570bcc3f910 msgr2=0x5570bcff4c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:44:32.755 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.751+0000 7eff5dffb640 0 client.15639 ms_handle_reset on v2:172.21.15.119:6838/3106757092 2024-09-21T01:44:32.755 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.751+0000 7eff82908740 1 -- 172.21.15.83:0/2157260273 shutdown_connections 2024-09-21T01:44:32.755 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.751+0000 7eff82908740 1 -- 172.21.15.83:0/2157260273 wait complete. 2024-09-21T01:44:32.755 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.751+0000 7eff82908740 20 client.15639 trim_cache size 0 max 16384 2024-09-21T01:44:32.755 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-09-21T01:44:32.756 INFO:teuthology.orchestra.run.smithi083.stdout: "epoch": 21, 2024-09-21T01:44:32.756 INFO:teuthology.orchestra.run.smithi083.stdout: "leader": 24653, 2024-09-21T01:44:32.756 INFO:teuthology.orchestra.run.smithi083.stdout: "set_version": 12, 2024-09-21T01:44:32.756 INFO:teuthology.orchestra.run.smithi083.stdout: "sets": { 2024-09-21T01:44:32.756 INFO:teuthology.orchestra.run.smithi083.stdout: "82fdba2f": { 2024-09-21T01:44:32.756 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 12, 2024-09-21T01:44:32.756 INFO:teuthology.orchestra.run.smithi083.stdout: "age_ref": 0.0, 2024-09-21T01:44:32.756 INFO:teuthology.orchestra.run.smithi083.stdout: "state": { 2024-09-21T01:44:32.756 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "RELEASED", 2024-09-21T01:44:32.756 INFO:teuthology.orchestra.run.smithi083.stdout: "age": 0.0 2024-09-21T01:44:32.756 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:44:32.756 INFO:teuthology.orchestra.run.smithi083.stdout: "timeout": 90.0, 2024-09-21T01:44:32.756 INFO:teuthology.orchestra.run.smithi083.stdout: "expiration": 147.8, 2024-09-21T01:44:32.756 INFO:teuthology.orchestra.run.smithi083.stdout: "members": { 2024-09-21T01:44:32.757 INFO:teuthology.orchestra.run.smithi083.stdout: "file:/": { 2024-09-21T01:44:32.757 INFO:teuthology.orchestra.run.smithi083.stdout: "excluded": false, 2024-09-21T01:44:32.757 INFO:teuthology.orchestra.run.smithi083.stdout: "state": { 2024-09-21T01:44:32.757 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "RELEASED", 2024-09-21T01:44:32.757 INFO:teuthology.orchestra.run.smithi083.stdout: "age": 0.0 2024-09-21T01:44:32.757 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:44:32.757 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:44:32.757 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:44:32.757 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:44:32.757 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:44:32.757 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-09-21T01:44:32.758 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.752+0000 7eff7c394640 1 -- 172.21.15.83:0/1007774109 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7eff600b6680 msgr2=0x7eff600b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:44:32.758 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.752+0000 7eff7c394640 1 --2- 172.21.15.83:0/1007774109 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7eff600b6680 0x7eff600b8b90 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7eff6c0ce6b0 tx=0x7eff6c0f2040 comp rx=0 tx=0).stop 2024-09-21T01:44:32.758 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.752+0000 7eff7c394640 1 -- 172.21.15.83:0/1007774109 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7eff74109df0 msgr2=0x7eff7419fd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:44:32.758 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.752+0000 7eff7c394640 1 --2- 172.21.15.83:0/1007774109 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7eff74109df0 0x7eff7419fd70 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7eff6c006010 tx=0x7eff6c003c90 comp rx=0 tx=0).stop 2024-09-21T01:44:32.758 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.752+0000 7eff7c394640 1 -- 172.21.15.83:0/1007774109 shutdown_connections 2024-09-21T01:44:32.758 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.752+0000 7eff7c394640 1 --2- 172.21.15.83:0/1007774109 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7eff600b6680 0x7eff600b8b90 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:44:32.758 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.752+0000 7eff7c394640 1 --2- 172.21.15.83:0/1007774109 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7eff74109df0 0x7eff7419fd70 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:44:32.758 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.752+0000 7eff7c394640 1 --2- 172.21.15.83:0/1007774109 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7eff741094a0 0x7eff7419aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:44:32.758 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.752+0000 7eff7c394640 1 --2- 172.21.15.83:0/1007774109 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7eff74103b60 0x7eff7419a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:44:32.758 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.752+0000 7eff7c394640 1 -- 172.21.15.83:0/1007774109 >> 172.21.15.83:0/1007774109 conn(0x7eff7407b850 msgr2=0x7eff74107640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:44:32.758 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.752+0000 7eff7c394640 1 -- 172.21.15.83:0/1007774109 shutdown_connections 2024-09-21T01:44:32.759 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:32.752+0000 7eff7c394640 1 -- 172.21.15.83:0/1007774109 wait complete. 2024-09-21T01:44:33.599 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '82fdba2f', total seconds elapsed: 31.2 2024-09-21T01:44:33.599 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 27.8 2024-09-21T01:44:33.599 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T01:44:33.888 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:44:34.147 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:44:33 smithi083 ceph-mon[31370]: pgmap v414: 129 pgs: 129 active+clean; 3.9 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:44:34.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:44:33 smithi142 ceph-mon[34050]: pgmap v414: 129 pgs: 129 active+clean; 3.9 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:44:34.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:44:33 smithi119 ceph-mon[33693]: pgmap v414: 129 pgs: 129 active+clean; 3.9 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:44:34.402 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:34.380+0000 7f07427b0640 1 -- 172.21.15.83:0/1407919573 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f073c102a60 msgr2=0x7f073c102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:44:34.402 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:34.380+0000 7f07427b0640 1 --2- 172.21.15.83:0/1407919573 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f073c102a60 0x7f073c102e70 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f072c009900 tx=0x7f072c02a410 comp rx=0 tx=0).stop 2024-09-21T01:44:34.402 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:34.380+0000 7f07427b0640 1 -- 172.21.15.83:0/1407919573 shutdown_connections 2024-09-21T01:44:34.403 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:34.380+0000 7f07427b0640 1 --2- 172.21.15.83:0/1407919573 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f073c108cf0 0x7f073c10f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:44:34.403 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:34.380+0000 7f07427b0640 1 --2- 172.21.15.83:0/1407919573 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f073c1083a0 0x7f073c1087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:44:34.403 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:34.380+0000 7f07427b0640 1 --2- 172.21.15.83:0/1407919573 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f073c102a60 0x7f073c102e70 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:44:34.403 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:34.380+0000 7f07427b0640 1 -- 172.21.15.83:0/1407919573 >> 172.21.15.83:0/1407919573 conn(0x7f073c079730 msgr2=0x7f073c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:44:34.403 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:34.380+0000 7f07427b0640 1 -- 172.21.15.83:0/1407919573 shutdown_connections 2024-09-21T01:44:34.403 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:34.380+0000 7f07427b0640 1 -- 172.21.15.83:0/1407919573 wait complete. 2024-09-21T01:44:34.403 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:34.381+0000 7f07427b0640 1 Processor -- start 2024-09-21T01:44:34.403 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:34.381+0000 7f07427b0640 1 -- start start 2024-09-21T01:44:34.403 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:34.381+0000 7f07427b0640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f073c102a60 0x7f073c104250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:44:34.403 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:34.381+0000 7f07427b0640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f073c1083a0 0x7f073c104790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:44:34.403 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:34.381+0000 7f07427b0640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f073c108cf0 0x7f073c104cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:44:34.403 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:34.381+0000 7f07427b0640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f073c112810 con 0x7f073c1083a0 2024-09-21T01:44:34.403 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:34.381+0000 7f07427b0640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f073c112690 con 0x7f073c108cf0 2024-09-21T01:44:34.404 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:34.381+0000 7f07427b0640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f073c112990 con 0x7f073c102a60 2024-09-21T01:44:34.404 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:34.381+0000 7f073b7fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f073c1083a0 0x7f073c104790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:44:34.404 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:34.381+0000 7f073b7fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f073c1083a0 0x7f073c104790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:54300/0 (socket says 172.21.15.83:54300) 2024-09-21T01:44:34.404 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:34.381+0000 7f073b7fe640 1 -- 172.21.15.83:0/1773291684 learned_addr learned my addr 172.21.15.83:0/1773291684 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:44:34.404 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:34.382+0000 7f073bfff640 1 --2- 172.21.15.83:0/1773291684 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f073c102a60 0x7f073c104250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:44:34.404 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:34.382+0000 7f0740d4d640 1 --2- 172.21.15.83:0/1773291684 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f073c108cf0 0x7f073c104cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:44:34.404 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:34.382+0000 7f073b7fe640 1 -- 172.21.15.83:0/1773291684 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f073c102a60 msgr2=0x7f073c104250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:44:34.404 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:34.382+0000 7f073b7fe640 1 --2- 172.21.15.83:0/1773291684 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f073c102a60 0x7f073c104250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:44:34.404 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:34.382+0000 7f073b7fe640 1 -- 172.21.15.83:0/1773291684 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f073c108cf0 msgr2=0x7f073c104cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:44:34.404 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:34.382+0000 7f073b7fe640 1 --2- 172.21.15.83:0/1773291684 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f073c108cf0 0x7f073c104cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:44:34.404 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:34.382+0000 7f073b7fe640 1 -- 172.21.15.83:0/1773291684 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f073c1a8630 con 0x7f073c1083a0 2024-09-21T01:44:34.404 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:34.382+0000 7f0740d4d640 1 --2- 172.21.15.83:0/1773291684 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f073c108cf0 0x7f073c104cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:44:34.404 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:34.382+0000 7f073bfff640 1 --2- 172.21.15.83:0/1773291684 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f073c102a60 0x7f073c104250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:44:34.404 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:34.382+0000 7f073b7fe640 1 --2- 172.21.15.83:0/1773291684 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f073c1083a0 0x7f073c104790 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f073000d770 tx=0x7f073000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:44:34.405 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:34.382+0000 7f07397fa640 1 -- 172.21.15.83:0/1773291684 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0730017070 con 0x7f073c1083a0 2024-09-21T01:44:34.405 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:34.382+0000 7f07427b0640 1 -- 172.21.15.83:0/1773291684 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f073c1a8920 con 0x7f073c1083a0 2024-09-21T01:44:34.405 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:34.382+0000 7f07427b0640 1 -- 172.21.15.83:0/1773291684 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f073c1a8eb0 con 0x7f073c1083a0 2024-09-21T01:44:34.405 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:34.382+0000 7f07397fa640 1 -- 172.21.15.83:0/1773291684 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0730009c30 con 0x7f073c1083a0 2024-09-21T01:44:34.405 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:34.382+0000 7f07397fa640 1 -- 172.21.15.83:0/1773291684 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f073000f620 con 0x7f073c1083a0 2024-09-21T01:44:34.405 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:34.384+0000 7f07427b0640 1 -- 172.21.15.83:0/1773291684 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f073c102e70 con 0x7f073c1083a0 2024-09-21T01:44:34.405 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:34.385+0000 7f07397fa640 1 -- 172.21.15.83:0/1773291684 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7f073001a070 con 0x7f073c1083a0 2024-09-21T01:44:34.405 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:34.386+0000 7f07397fa640 1 --2- 172.21.15.83:0/1773291684 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f07240b6700 0x7f07240b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:44:34.405 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:34.387+0000 7f073bfff640 1 --2- 172.21.15.83:0/1773291684 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f07240b6700 0x7f07240b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:44:34.405 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:34.387+0000 7f07397fa640 1 -- 172.21.15.83:0/1773291684 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9315+0+0 (secure 0 0 0) 0x7f07300e7550 con 0x7f073c1083a0 2024-09-21T01:44:34.405 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:34.387+0000 7f073bfff640 1 --2- 172.21.15.83:0/1773291684 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f07240b6700 0x7f07240b8c10 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f072c006010 tx=0x7f072c005a20 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:44:34.405 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:34.390+0000 7f07397fa640 1 -- 172.21.15.83:0/1773291684 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f0730009de0 con 0x7f073c1083a0 2024-09-21T01:44:34.655 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:34.655+0000 7f07427b0640 1 -- 172.21.15.83:0/1773291684 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f073c105550 con 0x7f073c1083a0 2024-09-21T01:44:34.656 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:34.656+0000 7f07397fa640 1 -- 172.21.15.83:0/1773291684 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11857 (secure 0 0 0) 0x7f073c105550 con 0x7f073c1083a0 2024-09-21T01:44:34.657 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T01:44:34.657 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":21,"btime":"2024-09-21T01:40:27:947059+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14775,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6835/1105040204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":1105040204},{"type":"v1","addr":"172.21.15.83:6835","nonce":1105040204}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14787,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/2234789563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6836","nonce":2234789563},{"type":"v1","addr":"172.21.15.83:6837","nonce":2234789563}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14838,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6839/136258364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6838","nonce":136258364},{"type":"v1","addr":"172.21.15.83:6839","nonce":136258364}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14850,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6841/129439444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6840","nonce":129439444},{"type":"v1","addr":"172.21.15.83:6841","nonce":129439444}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24569,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/2839502433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":2839502433},{"type":"v1","addr":"172.21.15.119:6833","nonce":2839502433}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24580,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6833/2841606990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":2841606990},{"type":"v1","addr":"172.21.15.142:6833","nonce":2841606990}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24599,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/415902608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":415902608},{"type":"v1","addr":"172.21.15.119:6835","nonce":415902608}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24607,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/3009088510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":3009088510},{"type":"v1","addr":"172.21.15.142:6835","nonce":3009088510}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24613,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/3847200126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6836","nonce":3847200126},{"type":"v1","addr":"172.21.15.142:6837","nonce":3847200126}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24626,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/3619222976","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":3619222976},{"type":"v1","addr":"172.21.15.119:6837","nonce":3619222976}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T01:39:45.145124+0000","modified":"2024-09-21T01:40:27.664151+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24653},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24631":{"gid":24631,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.142:6839/1817880741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6838","nonce":1817880741},{"type":"v1","addr":"172.21.15.142:6839","nonce":1817880741}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24653":{"gid":24653,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.119:6839/3106757092","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":3106757092},{"type":"v1","addr":"172.21.15.119:6839","nonce":3106757092}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24653,"qdb_cluster":[24653]},"id":1}]} 2024-09-21T01:44:34.657 INFO:teuthology.orchestra.run.smithi083.stderr:dumped fsmap epoch 21 2024-09-21T01:44:34.660 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:34.659+0000 7f07427b0640 1 -- 172.21.15.83:0/1773291684 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f07240b6700 msgr2=0x7f07240b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:44:34.660 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:34.659+0000 7f07427b0640 1 --2- 172.21.15.83:0/1773291684 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f07240b6700 0x7f07240b8c10 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f072c006010 tx=0x7f072c005a20 comp rx=0 tx=0).stop 2024-09-21T01:44:34.660 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:34.659+0000 7f07427b0640 1 -- 172.21.15.83:0/1773291684 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f073c1083a0 msgr2=0x7f073c104790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:44:34.661 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:34.659+0000 7f07427b0640 1 --2- 172.21.15.83:0/1773291684 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f073c1083a0 0x7f073c104790 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f073000d770 tx=0x7f073000dc30 comp rx=0 tx=0).stop 2024-09-21T01:44:34.661 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:34.659+0000 7f07427b0640 1 -- 172.21.15.83:0/1773291684 shutdown_connections 2024-09-21T01:44:34.661 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:34.659+0000 7f07427b0640 1 --2- 172.21.15.83:0/1773291684 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f07240b6700 0x7f07240b8c10 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:44:34.661 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:34.659+0000 7f07427b0640 1 --2- 172.21.15.83:0/1773291684 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f073c108cf0 0x7f073c104cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:44:34.661 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:34.659+0000 7f07427b0640 1 --2- 172.21.15.83:0/1773291684 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f073c1083a0 0x7f073c104790 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:44:34.661 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:34.659+0000 7f07427b0640 1 --2- 172.21.15.83:0/1773291684 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f073c102a60 0x7f073c104250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:44:34.661 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:34.659+0000 7f07427b0640 1 -- 172.21.15.83:0/1773291684 >> 172.21.15.83:0/1773291684 conn(0x7f073c079730 msgr2=0x7f073c101b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:44:34.661 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:34.659+0000 7f07427b0640 1 -- 172.21.15.83:0/1773291684 shutdown_connections 2024-09-21T01:44:34.662 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:34.659+0000 7f07427b0640 1 -- 172.21.15.83:0/1773291684 wait complete. 2024-09-21T01:44:35.031 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:44:34 smithi083 ceph-mon[31370]: from='client.? 172.21.15.83:0/1773291684' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:44:35.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:44:34 smithi142 ceph-mon[34050]: from='client.? 172.21.15.83:0/1773291684' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:44:35.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:44:34 smithi119 ceph-mon[33693]: from='client.? 172.21.15.83:0/1773291684' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:44:35.325 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24653 quiesce db / --timeout 90 --expiration 147.8 --await-for 45.0' 2024-09-21T01:44:35.325 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24653 quiesce db / --timeout 90 --expiration 147.8 --await-for 45.0 2024-09-21T01:44:35.597 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:44:36.025 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:44:35 smithi083 ceph-mon[31370]: pgmap v415: 129 pgs: 129 active+clean; 3.9 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T01:44:36.132 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.131+0000 7fa1d6e7d640 1 -- 172.21.15.83:0/3321323110 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa1d0102a80 msgr2=0x7fa1d0102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:44:36.132 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.131+0000 7fa1d6e7d640 1 --2- 172.21.15.83:0/3321323110 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa1d0102a80 0x7fa1d0102e90 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fa1c4009900 tx=0x7fa1c402a410 comp rx=0 tx=0).stop 2024-09-21T01:44:36.132 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.132+0000 7fa1d6e7d640 1 -- 172.21.15.83:0/3321323110 shutdown_connections 2024-09-21T01:44:36.132 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.132+0000 7fa1d6e7d640 1 --2- 172.21.15.83:0/3321323110 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa1d0108d10 0x7fa1d010f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:44:36.132 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.132+0000 7fa1d6e7d640 1 --2- 172.21.15.83:0/3321323110 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa1d01083c0 0x7fa1d01087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:44:36.133 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.132+0000 7fa1d6e7d640 1 --2- 172.21.15.83:0/3321323110 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa1d0102a80 0x7fa1d0102e90 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:44:36.133 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.132+0000 7fa1d6e7d640 1 -- 172.21.15.83:0/3321323110 >> 172.21.15.83:0/3321323110 conn(0x7fa1d0079760 msgr2=0x7fa1d0079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:44:36.133 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.132+0000 7fa1d6e7d640 1 -- 172.21.15.83:0/3321323110 shutdown_connections 2024-09-21T01:44:36.133 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.132+0000 7fa1d6e7d640 1 -- 172.21.15.83:0/3321323110 wait complete. 2024-09-21T01:44:36.134 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.132+0000 7fa1d6e7d640 1 Processor -- start 2024-09-21T01:44:36.134 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.133+0000 7fa1d6e7d640 1 -- start start 2024-09-21T01:44:36.134 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.133+0000 7fa1d6e7d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa1d0102a80 0x7fa1d019a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:44:36.135 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.133+0000 7fa1d6e7d640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa1d01083c0 0x7fa1d019a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:44:36.135 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.133+0000 7fa1d6e7d640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa1d0108d10 0x7fa1d019fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:44:36.135 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.133+0000 7fa1d6e7d640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fa1d0112880 con 0x7fa1d0108d10 2024-09-21T01:44:36.135 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.133+0000 7fa1d6e7d640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fa1d0112700 con 0x7fa1d0102a80 2024-09-21T01:44:36.135 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.133+0000 7fa1d6e7d640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fa1d0112a00 con 0x7fa1d01083c0 2024-09-21T01:44:36.135 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.133+0000 7fa1d541a640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa1d0108d10 0x7fa1d019fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:44:36.135 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.133+0000 7fa1d4c19640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa1d0102a80 0x7fa1d019a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:44:36.135 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.133+0000 7fa1d4c19640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa1d0102a80 0x7fa1d019a360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.83:52500/0 (socket says 172.21.15.83:52500) 2024-09-21T01:44:36.135 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.133+0000 7fa1d541a640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa1d0108d10 0x7fa1d019fba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:54316/0 (socket says 172.21.15.83:54316) 2024-09-21T01:44:36.135 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.133+0000 7fa1d4c19640 1 -- 172.21.15.83:0/2960400321 learned_addr learned my addr 172.21.15.83:0/2960400321 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:44:36.135 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.133+0000 7fa1cffff640 1 --2- 172.21.15.83:0/2960400321 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa1d01083c0 0x7fa1d019a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:44:36.135 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.134+0000 7fa1d541a640 1 -- 172.21.15.83:0/2960400321 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa1d01083c0 msgr2=0x7fa1d019a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:44:36.136 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.134+0000 7fa1d541a640 1 --2- 172.21.15.83:0/2960400321 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa1d01083c0 0x7fa1d019a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:44:36.136 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.134+0000 7fa1d541a640 1 -- 172.21.15.83:0/2960400321 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa1d0102a80 msgr2=0x7fa1d019a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:44:36.136 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.134+0000 7fa1d541a640 1 --2- 172.21.15.83:0/2960400321 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa1d0102a80 0x7fa1d019a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:44:36.136 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.134+0000 7fa1d541a640 1 -- 172.21.15.83:0/2960400321 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1d01a02d0 con 0x7fa1d0108d10 2024-09-21T01:44:36.136 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.134+0000 7fa1d541a640 1 --2- 172.21.15.83:0/2960400321 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa1d0108d10 0x7fa1d019fba0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fa1c8009d10 tx=0x7fa1c8007590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:44:36.136 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.134+0000 7fa1cdffb640 1 -- 172.21.15.83:0/2960400321 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1c8009e60 con 0x7fa1d0108d10 2024-09-21T01:44:36.136 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.134+0000 7fa1cdffb640 1 -- 172.21.15.83:0/2960400321 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa1c80100d0 con 0x7fa1d0108d10 2024-09-21T01:44:36.136 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.134+0000 7fa1d6e7d640 1 -- 172.21.15.83:0/2960400321 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1d01a0560 con 0x7fa1d0108d10 2024-09-21T01:44:36.136 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.134+0000 7fa1cdffb640 1 -- 172.21.15.83:0/2960400321 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1c800ec40 con 0x7fa1d0108d10 2024-09-21T01:44:36.136 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.134+0000 7fa1d6e7d640 1 -- 172.21.15.83:0/2960400321 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1d0104150 con 0x7fa1d0108d10 2024-09-21T01:44:36.137 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.137+0000 7fa1cdffb640 1 -- 172.21.15.83:0/2960400321 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7fa1c8005000 con 0x7fa1d0108d10 2024-09-21T01:44:36.138 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.137+0000 7fa1dd3f1740 1 Processor -- start 2024-09-21T01:44:36.138 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.137+0000 7fa1dd3f1740 1 -- start start 2024-09-21T01:44:36.138 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.138+0000 7fa1dd3f1740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562f10570840 0x562f10917600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:44:36.140 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.138+0000 7fa1dd3f1740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562f10547980 0x562f10917b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:44:36.140 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.138+0000 7fa1dd3f1740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562f1054fb60 0x562f10918080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:44:36.140 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.138+0000 7fa1dd3f1740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x562f1088db90 con 0x562f10570840 2024-09-21T01:44:36.140 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.138+0000 7fa1dd3f1740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x562f1087cfc0 con 0x562f1054fb60 2024-09-21T01:44:36.141 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.138+0000 7fa1dd3f1740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x562f10880dd0 con 0x562f10547980 2024-09-21T01:44:36.141 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.138+0000 7fa1cffff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562f10570840 0x562f10917600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:44:36.141 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.138+0000 7fa1cdffb640 1 --2- 172.21.15.83:0/2960400321 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fa1c00b6680 0x7fa1c00b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:44:36.141 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.138+0000 7fa1cffff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562f10570840 0x562f10917600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:54330/0 (socket says 172.21.15.83:54330) 2024-09-21T01:44:36.141 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.138+0000 7fa1cffff640 1 -- 172.21.15.83:0/3151858759 learned_addr learned my addr 172.21.15.83:0/3151858759 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:44:36.141 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.138+0000 7fa1d4c19640 1 --2- 172.21.15.83:0/3151858759 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562f10547980 0x562f10917b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:44:36.141 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.138+0000 7fa1cffff640 1 --2- 172.21.15.83:0/3151858759 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562f1054fb60 0x562f10918080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:44:36.141 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.138+0000 7fa1cdffb640 1 -- 172.21.15.83:0/2960400321 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9315+0+0 (secure 0 0 0) 0x7fa1c80eaf90 con 0x7fa1d0108d10 2024-09-21T01:44:36.141 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.138+0000 7fa1cffff640 1 -- 172.21.15.83:0/3151858759 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562f10547980 msgr2=0x562f10917b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:44:36.141 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.138+0000 7fa1cffff640 1 --2- 172.21.15.83:0/3151858759 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562f10547980 0x562f10917b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:44:36.141 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.138+0000 7fa1cffff640 1 -- 172.21.15.83:0/3151858759 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562f1054fb60 msgr2=0x562f10918080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:44:36.141 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.138+0000 7fa1cffff640 1 --2- 172.21.15.83:0/3151858759 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562f1054fb60 0x562f10918080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:44:36.141 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.138+0000 7fa1cffff640 1 -- 172.21.15.83:0/3151858759 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562f10804060 con 0x562f10570840 2024-09-21T01:44:36.141 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.138+0000 7fa1d4c19640 1 --2- 172.21.15.83:0/3151858759 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562f10547980 0x562f10917b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:44:36.142 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.138+0000 7fa1d541a640 1 --2- 172.21.15.83:0/2960400321 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fa1c00b6680 0x7fa1c00b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:44:36.142 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.139+0000 7fa1cffff640 1 --2- 172.21.15.83:0/3151858759 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562f10570840 0x562f10917600 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fa1bc00bfd0 tx=0x7fa1bc00b650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63b6e8f1ec1498d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:44:36.142 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.139+0000 7fa1baffd640 1 -- 172.21.15.83:0/3151858759 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1bc012d40 con 0x562f10570840 2024-09-21T01:44:36.142 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.139+0000 7fa1baffd640 1 -- 172.21.15.83:0/3151858759 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa1bc0120d0 con 0x562f10570840 2024-09-21T01:44:36.142 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.139+0000 7fa1baffd640 1 -- 172.21.15.83:0/3151858759 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1bc005320 con 0x562f10570840 2024-09-21T01:44:36.145 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.140+0000 7fa1dd3f1740 1 -- 172.21.15.83:0/3151858759 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562f10570840 msgr2=0x562f10917600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:44:36.145 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.140+0000 7fa1dd3f1740 1 --2- 172.21.15.83:0/3151858759 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562f10570840 0x562f10917600 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fa1bc00bfd0 tx=0x7fa1bc00b650 comp rx=0 tx=0).stop 2024-09-21T01:44:36.145 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.140+0000 7fa1d541a640 1 --2- 172.21.15.83:0/2960400321 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fa1c00b6680 0x7fa1c00b8b90 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fa1c80e8420 tx=0x7fa1c80eb290 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:44:36.145 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.140+0000 7fa1dd3f1740 1 -- 172.21.15.83:0/3151858759 shutdown_connections 2024-09-21T01:44:36.145 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.140+0000 7fa1dd3f1740 1 --2- 172.21.15.83:0/3151858759 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562f1054fb60 0x562f10918080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:44:36.145 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.140+0000 7fa1dd3f1740 1 --2- 172.21.15.83:0/3151858759 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562f10547980 0x562f10917b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:44:36.145 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.140+0000 7fa1dd3f1740 1 --2- 172.21.15.83:0/3151858759 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562f10570840 0x562f10917600 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:44:36.145 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.140+0000 7fa1dd3f1740 1 -- 172.21.15.83:0/3151858759 >> 172.21.15.83:0/3151858759 conn(0x562f10564990 msgr2=0x562f109154f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:44:36.146 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.141+0000 7fa1dd3f1740 1 -- 172.21.15.83:0/3151858759 shutdown_connections 2024-09-21T01:44:36.146 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.141+0000 7fa1dd3f1740 1 -- 172.21.15.83:0/3151858759 wait complete. 2024-09-21T01:44:36.146 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.141+0000 7fa1dd3f1740 1 -- start start 2024-09-21T01:44:36.146 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.141+0000 7fa1dd3f1740 1 Processor -- start 2024-09-21T01:44:36.146 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.142+0000 7fa1dd3f1740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562f10547980 0x562f10923300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:44:36.146 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.142+0000 7fa1dd3f1740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562f1054fb60 0x562f109238e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:44:36.146 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.142+0000 7fa1dd3f1740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562f1052f1c0 0x562f10929040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:44:36.146 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.142+0000 7fa1dd3f1740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x562f106de7a0 con 0x562f1054fb60 2024-09-21T01:44:36.146 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.142+0000 7fa1dd3f1740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x562f108220a0 con 0x562f1052f1c0 2024-09-21T01:44:36.146 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.142+0000 7fa1dd3f1740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x562f10925d80 con 0x562f10547980 2024-09-21T01:44:36.147 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.142+0000 7fa1dd3f1740 10 client.0 _ll_register_callbacks cb 0x562f107ff3c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:44:36.147 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.142+0000 7fa1d4c19640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562f1054fb60 0x562f109238e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:44:36.147 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.142+0000 7fa1d4c19640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562f1054fb60 0x562f109238e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:54342/0 (socket says 172.21.15.83:54342) 2024-09-21T01:44:36.147 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.142+0000 7fa1d4c19640 1 -- 172.21.15.83:0/2330044014 learned_addr learned my addr 172.21.15.83:0/2330044014 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:44:36.147 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.142+0000 7fa1cffff640 1 --2- 172.21.15.83:0/2330044014 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562f10547980 0x562f10923300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:44:36.147 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.142+0000 7fa1cffff640 1 --2- 172.21.15.83:0/2330044014 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562f1052f1c0 0x562f10929040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:44:36.147 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.142+0000 7fa1d4c19640 1 -- 172.21.15.83:0/2330044014 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562f10547980 msgr2=0x562f10923300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:44:36.147 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.142+0000 7fa1d4c19640 1 --2- 172.21.15.83:0/2330044014 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562f10547980 0x562f10923300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:44:36.147 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.142+0000 7fa1d4c19640 1 -- 172.21.15.83:0/2330044014 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562f1052f1c0 msgr2=0x562f10929040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:44:36.147 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.142+0000 7fa1d4c19640 1 --2- 172.21.15.83:0/2330044014 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562f1052f1c0 0x562f10929040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:44:36.147 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.142+0000 7fa1d4c19640 1 -- 172.21.15.83:0/2330044014 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562f10810880 con 0x562f1054fb60 2024-09-21T01:44:36.147 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.142+0000 7fa1cffff640 1 --2- 172.21.15.83:0/2330044014 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562f1052f1c0 0x562f10929040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:44:36.147 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.142+0000 7fa1d4c19640 1 --2- 172.21.15.83:0/2330044014 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562f1054fb60 0x562f109238e0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fa1c4004580 tx=0x7fa1c40045b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e769af22f92f48a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:44:36.148 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.142+0000 7fa1affff640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-09-21T01:44:36.148 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.143+0000 7fa1affff640 1 -- 172.21.15.83:0/2330044014 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1c4035040 con 0x562f1054fb60 2024-09-21T01:44:36.148 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.143+0000 7fa1affff640 1 -- 172.21.15.83:0/2330044014 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9315+0+0 (secure 0 0 0) 0x7fa1c4005230 con 0x562f1054fb60 2024-09-21T01:44:36.148 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.143+0000 7fa1dd3f1740 1 -- 172.21.15.83:0/2330044014 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa1bc0120d0 con 0x562f1054fb60 2024-09-21T01:44:36.148 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.143+0000 7fa1affff640 1 -- 172.21.15.83:0/2330044014 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fa1c404d050 con 0x562f1054fb60 2024-09-21T01:44:36.148 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.143+0000 7fa1dd3f1740 10 client.15657 fetch_fsmap learned FSMap version 21 2024-09-21T01:44:36.148 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.143+0000 7fa1dd3f1740 1 -- 172.21.15.83:0/2330044014 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x562f105eab90 con 0x562f1054fb60 2024-09-21T01:44:36.148 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.143+0000 7fa1affff640 1 -- 172.21.15.83:0/2330044014 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa1c4005450 con 0x562f1054fb60 2024-09-21T01:44:36.148 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.143+0000 7fa1affff640 1 -- 172.21.15.83:0/2330044014 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fa1c40049f0 con 0x562f1054fb60 2024-09-21T01:44:36.148 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.143+0000 7fa1dd3f1740 10 client.15657 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T01:44:36.148 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.144+0000 7fa1dd3f1740 10 client.15657 resolve_mds: validated gid 24653 aka daemon mds.b 2024-09-21T01:44:36.148 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.144+0000 7fa1dd3f1740 20 client.15657 populate_metadata read hostname 'smithi083' 2024-09-21T01:44:36.148 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.144+0000 7fa1dd3f1740 1 --2- 172.21.15.83:0/2330044014 >> [v2:172.21.15.119:6838/3106757092,v1:172.21.15.119:6839/3106757092] conn(0x562f10504570 0x562f109351f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:44:36.148 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.144+0000 7fa1dd3f1740 4 client.15657 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:44:36.149 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.144+0000 7fa1dd3f1740 1 -- 172.21.15.83:0/2330044014 --> [v2:172.21.15.119:6838/3106757092,v1:172.21.15.119:6839/3106757092] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fa1bc0120d0 con 0x562f10504570 2024-09-21T01:44:36.149 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.144+0000 7fa1cffff640 1 --2- 172.21.15.83:0/2330044014 >> [v2:172.21.15.119:6838/3106757092,v1:172.21.15.119:6839/3106757092] conn(0x562f10504570 0x562f109351f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:44:36.149 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.144+0000 7fa1affff640 10 client.15657 ms_handle_connect on v2:172.21.15.119:6838/3106757092 2024-09-21T01:44:36.149 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.144+0000 7fa1cffff640 1 --2- 172.21.15.83:0/2330044014 >> [v2:172.21.15.119:6838/3106757092,v1:172.21.15.119:6839/3106757092] conn(0x562f10504570 0x562f109351f0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7c53abafc10c78a6 server_cookie=65ab0d93eb665950 in_seq=0 out_seq=0 2024-09-21T01:44:36.150 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.145+0000 7fa1affff640 1 -- 172.21.15.83:0/2330044014 <== mds.0 v2:172.21.15.119:6838/3106757092 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7fa1bc0120d0 con 0x562f10504570 2024-09-21T01:44:36.150 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.145+0000 7fa1affff640 10 client.15657 handle_command_reply: tid=0 2024-09-21T01:44:36.150 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.145+0000 7fa1dd3f1740 1 client.15657 shutdown 2024-09-21T01:44:36.150 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.146+0000 7fa1dd3f1740 1 -- 172.21.15.83:0/2330044014 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562f1054fb60 msgr2=0x562f109238e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:44:36.150 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.146+0000 7fa1dd3f1740 1 --2- 172.21.15.83:0/2330044014 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562f1054fb60 0x562f109238e0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fa1c4004580 tx=0x7fa1c40045b0 comp rx=0 tx=0).stop 2024-09-21T01:44:36.150 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.146+0000 7fa1dd3f1740 1 -- 172.21.15.83:0/2330044014 shutdown_connections 2024-09-21T01:44:36.150 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.146+0000 7fa1dd3f1740 1 --2- 172.21.15.83:0/2330044014 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562f1052f1c0 0x562f10929040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:44:36.150 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.146+0000 7fa1dd3f1740 1 --2- 172.21.15.83:0/2330044014 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562f1054fb60 0x562f109238e0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:44:36.150 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.146+0000 7fa1dd3f1740 1 --2- 172.21.15.83:0/2330044014 >> [v2:172.21.15.119:6838/3106757092,v1:172.21.15.119:6839/3106757092] conn(0x562f10504570 0x562f109351f0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:44:36.151 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.146+0000 7fa1affff640 0 client.15657 ms_handle_reset on v2:172.21.15.119:6838/3106757092 2024-09-21T01:44:36.151 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.146+0000 7fa1dd3f1740 1 --2- 172.21.15.83:0/2330044014 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562f10547980 0x562f10923300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:44:36.151 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.146+0000 7fa1dd3f1740 1 -- 172.21.15.83:0/2330044014 >> 172.21.15.83:0/2330044014 conn(0x562f10564990 msgr2=0x562f1091a7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:44:36.151 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.146+0000 7fa1dd3f1740 1 -- 172.21.15.83:0/2330044014 shutdown_connections 2024-09-21T01:44:36.151 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.146+0000 7fa1dd3f1740 1 -- 172.21.15.83:0/2330044014 wait complete. 2024-09-21T01:44:36.151 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.146+0000 7fa1dd3f1740 20 client.15657 trim_cache size 0 max 16384 2024-09-21T01:44:36.165 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.164+0000 7fa1dd3f1740 1 Processor -- start 2024-09-21T01:44:36.165 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.164+0000 7fa1dd3f1740 1 -- start start 2024-09-21T01:44:36.165 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.164+0000 7fa1dd3f1740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562f10504570 0x562f10914450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:44:36.165 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.164+0000 7fa1dd3f1740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562f1052f1c0 0x562f10928fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:44:36.165 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.164+0000 7fa1dd3f1740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562f10547980 0x562f109294f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:44:36.165 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.164+0000 7fa1dd3f1740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fa1d01ac8e0 con 0x562f1052f1c0 2024-09-21T01:44:36.165 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.164+0000 7fa1dd3f1740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fa1d01af160 con 0x562f10504570 2024-09-21T01:44:36.165 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.164+0000 7fa1dd3f1740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fa1d01acf50 con 0x562f10547980 2024-09-21T01:44:36.165 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.164+0000 7fa1d4c19640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562f1052f1c0 0x562f10928fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:44:36.165 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.164+0000 7fa1d4c19640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562f1052f1c0 0x562f10928fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:54344/0 (socket says 172.21.15.83:54344) 2024-09-21T01:44:36.165 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.164+0000 7fa1d4c19640 1 -- 172.21.15.83:0/893069454 learned_addr learned my addr 172.21.15.83:0/893069454 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:44:36.165 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.164+0000 7fa1cffff640 1 --2- 172.21.15.83:0/893069454 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562f10504570 0x562f10914450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:44:36.165 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.165+0000 7fa1cffff640 1 --2- 172.21.15.83:0/893069454 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562f10547980 0x562f109294f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:44:36.167 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.165+0000 7fa1d4c19640 1 -- 172.21.15.83:0/893069454 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562f10547980 msgr2=0x562f109294f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:44:36.167 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.165+0000 7fa1d4c19640 1 --2- 172.21.15.83:0/893069454 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562f10547980 0x562f109294f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:44:36.167 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.165+0000 7fa1d4c19640 1 -- 172.21.15.83:0/893069454 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562f10504570 msgr2=0x562f10914450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:44:36.167 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.165+0000 7fa1d4c19640 1 --2- 172.21.15.83:0/893069454 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562f10504570 0x562f10914450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:44:36.167 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.165+0000 7fa1d4c19640 1 -- 172.21.15.83:0/893069454 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562f10910870 con 0x562f1052f1c0 2024-09-21T01:44:36.167 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.165+0000 7fa1cffff640 1 --2- 172.21.15.83:0/893069454 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562f10504570 0x562f10914450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:44:36.167 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.165+0000 7fa1d4c19640 1 --2- 172.21.15.83:0/893069454 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562f1052f1c0 0x562f10928fb0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fa1c403d730 tx=0x7fa1c402a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4557d7707ea425bf server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:44:36.167 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.165+0000 7fa1ba7fc640 1 -- 172.21.15.83:0/893069454 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1c4035030 con 0x562f1052f1c0 2024-09-21T01:44:36.167 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.165+0000 7fa1ba7fc640 1 -- 172.21.15.83:0/893069454 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa1c4005850 con 0x562f1052f1c0 2024-09-21T01:44:36.167 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.165+0000 7fa1ba7fc640 1 -- 172.21.15.83:0/893069454 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1c4000e60 con 0x562f1052f1c0 2024-09-21T01:44:36.167 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.166+0000 7fa1dd3f1740 1 -- 172.21.15.83:0/893069454 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562f1052f1c0 msgr2=0x562f10928fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:44:36.168 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.166+0000 7fa1dd3f1740 1 --2- 172.21.15.83:0/893069454 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562f1052f1c0 0x562f10928fb0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fa1c403d730 tx=0x7fa1c402a410 comp rx=0 tx=0).stop 2024-09-21T01:44:36.168 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.166+0000 7fa1dd3f1740 1 -- 172.21.15.83:0/893069454 shutdown_connections 2024-09-21T01:44:36.168 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.166+0000 7fa1dd3f1740 1 --2- 172.21.15.83:0/893069454 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562f10547980 0x562f109294f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:44:36.168 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.166+0000 7fa1dd3f1740 1 --2- 172.21.15.83:0/893069454 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562f1052f1c0 0x562f10928fb0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:44:36.168 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.166+0000 7fa1dd3f1740 1 --2- 172.21.15.83:0/893069454 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562f10504570 0x562f10914450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:44:36.168 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.166+0000 7fa1dd3f1740 1 -- 172.21.15.83:0/893069454 >> 172.21.15.83:0/893069454 conn(0x562f10564990 msgr2=0x562f10915350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:44:36.168 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.166+0000 7fa1dd3f1740 1 -- 172.21.15.83:0/893069454 shutdown_connections 2024-09-21T01:44:36.168 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.166+0000 7fa1dd3f1740 1 -- 172.21.15.83:0/893069454 wait complete. 2024-09-21T01:44:36.168 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.167+0000 7fa1dd3f1740 1 -- start start 2024-09-21T01:44:36.170 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.167+0000 7fa1dd3f1740 1 Processor -- start 2024-09-21T01:44:36.170 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.167+0000 7fa1dd3f1740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562f10504570 0x562f1092c660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:44:36.170 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.167+0000 7fa1dd3f1740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562f1052f1c0 0x562f1092cba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:44:36.170 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.167+0000 7fa1dd3f1740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562f10547980 0x562f1092d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:44:36.170 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.167+0000 7fa1dd3f1740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fa1d01ad620 con 0x562f10504570 2024-09-21T01:44:36.171 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.167+0000 7fa1dd3f1740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fa1d01aea90 con 0x562f1052f1c0 2024-09-21T01:44:36.171 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.167+0000 7fa1dd3f1740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fa1d01adcf0 con 0x562f10547980 2024-09-21T01:44:36.171 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.167+0000 7fa1dd3f1740 10 client.0 _ll_register_callbacks cb 0x7fa1c4009640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:44:36.171 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.167+0000 7fa1cffff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562f10504570 0x562f1092c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:44:36.171 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.167+0000 7fa1cffff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562f10504570 0x562f1092c660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:54350/0 (socket says 172.21.15.83:54350) 2024-09-21T01:44:36.171 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.167+0000 7fa1cffff640 1 -- 172.21.15.83:0/2096285894 learned_addr learned my addr 172.21.15.83:0/2096285894 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:44:36.171 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.168+0000 7fa1cffff640 1 -- 172.21.15.83:0/2096285894 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562f10547980 msgr2=0x562f1092d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:44:36.171 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.168+0000 7fa1cffff640 1 --2- 172.21.15.83:0/2096285894 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562f10547980 0x562f1092d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:44:36.171 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.168+0000 7fa1cffff640 1 -- 172.21.15.83:0/2096285894 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562f1052f1c0 msgr2=0x562f1092cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:44:36.171 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.168+0000 7fa1d4c19640 1 --2- 172.21.15.83:0/2096285894 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562f1052f1c0 0x562f1092cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:44:36.171 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.168+0000 7fa1cffff640 1 --2- 172.21.15.83:0/2096285894 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562f1052f1c0 0x562f1092cba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:44:36.171 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.168+0000 7fa1cffff640 1 -- 172.21.15.83:0/2096285894 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562f1099fda0 con 0x562f10504570 2024-09-21T01:44:36.171 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.168+0000 7fa1d4c19640 1 --2- 172.21.15.83:0/2096285894 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562f1052f1c0 0x562f1092cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:44:36.171 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.168+0000 7fa1cffff640 1 --2- 172.21.15.83:0/2096285894 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562f10504570 0x562f1092c660 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fa1bc01c040 tx=0x7fa1bc00b410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b24e84a3b8bafb8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:44:36.172 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.168+0000 7fa1affff640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-09-21T01:44:36.172 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.168+0000 7fa1affff640 1 -- 172.21.15.83:0/2096285894 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1bc02f070 con 0x562f10504570 2024-09-21T01:44:36.172 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.168+0000 7fa1affff640 1 -- 172.21.15.83:0/2096285894 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9315+0+0 (secure 0 0 0) 0x7fa1bc0122d0 con 0x562f10504570 2024-09-21T01:44:36.172 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.168+0000 7fa1dd3f1740 1 -- 172.21.15.83:0/2096285894 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa1c4005850 con 0x562f10504570 2024-09-21T01:44:36.172 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.168+0000 7fa1affff640 1 -- 172.21.15.83:0/2096285894 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fa1bc00b920 con 0x562f10504570 2024-09-21T01:44:36.172 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.168+0000 7fa1dd3f1740 10 client.15663 fetch_fsmap learned FSMap version 21 2024-09-21T01:44:36.172 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.168+0000 7fa1dd3f1740 1 -- 172.21.15.83:0/2096285894 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x562f109a1000 con 0x562f10504570 2024-09-21T01:44:36.172 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.169+0000 7fa1affff640 1 -- 172.21.15.83:0/2096285894 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa1c4005850 con 0x562f10504570 2024-09-21T01:44:36.172 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.169+0000 7fa1affff640 1 -- 172.21.15.83:0/2096285894 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fa1bc005090 con 0x562f10504570 2024-09-21T01:44:36.172 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.169+0000 7fa1dd3f1740 10 client.15663 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T01:44:36.172 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.169+0000 7fa1dd3f1740 10 client.15663 resolve_mds: validated gid 24653 aka daemon mds.b 2024-09-21T01:44:36.172 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.169+0000 7fa1dd3f1740 20 client.15663 populate_metadata read hostname 'smithi083' 2024-09-21T01:44:36.172 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.169+0000 7fa1dd3f1740 1 --2- 172.21.15.83:0/2096285894 >> [v2:172.21.15.119:6838/3106757092,v1:172.21.15.119:6839/3106757092] conn(0x562f1054fb60 0x562f109a3670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:44:36.172 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.169+0000 7fa1dd3f1740 4 client.15663 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 147.8, "await_for": 45.0}] 2024-09-21T01:44:36.173 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.169+0000 7fa1dd3f1740 1 -- 172.21.15.83:0/2096285894 --> [v2:172.21.15.119:6838/3106757092,v1:172.21.15.119:6839/3106757092] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 147.8, "await_for": 45.0}) -- 0x562f1088fae0 con 0x562f1054fb60 2024-09-21T01:44:36.173 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.170+0000 7fa1d4c19640 1 --2- 172.21.15.83:0/2096285894 >> [v2:172.21.15.119:6838/3106757092,v1:172.21.15.119:6839/3106757092] conn(0x562f1054fb60 0x562f109a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:44:36.173 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.170+0000 7fa1affff640 10 client.15663 ms_handle_connect on v2:172.21.15.119:6838/3106757092 2024-09-21T01:44:36.173 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.170+0000 7fa1d4c19640 1 --2- 172.21.15.83:0/2096285894 >> [v2:172.21.15.119:6838/3106757092,v1:172.21.15.119:6839/3106757092] conn(0x562f1054fb60 0x562f109a3670 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8d7a5b20020213ea server_cookie=e87509af15cee5c in_seq=0 out_seq=0 2024-09-21T01:44:36.181 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.180+0000 7fa1affff640 1 -- 172.21.15.83:0/2096285894 <== mds.0 v2:172.21.15.119:6838/3106757092 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x562f1088fae0 con 0x562f1054fb60 2024-09-21T01:44:36.181 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.180+0000 7fa1affff640 10 client.15663 handle_command_reply: tid=0 2024-09-21T01:44:36.181 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.180+0000 7fa1dd3f1740 1 client.15663 shutdown 2024-09-21T01:44:36.181 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.180+0000 7fa1dd3f1740 1 -- 172.21.15.83:0/2096285894 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562f10504570 msgr2=0x562f1092c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:44:36.181 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.180+0000 7fa1dd3f1740 1 --2- 172.21.15.83:0/2096285894 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562f10504570 0x562f1092c660 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fa1bc01c040 tx=0x7fa1bc00b410 comp rx=0 tx=0).stop 2024-09-21T01:44:36.181 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.180+0000 7fa1dd3f1740 1 -- 172.21.15.83:0/2096285894 shutdown_connections 2024-09-21T01:44:36.181 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.180+0000 7fa1dd3f1740 1 --2- 172.21.15.83:0/2096285894 >> [v2:172.21.15.119:6838/3106757092,v1:172.21.15.119:6839/3106757092] conn(0x562f1054fb60 0x562f109a3670 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:44:36.181 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.180+0000 7fa1dd3f1740 1 --2- 172.21.15.83:0/2096285894 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562f10547980 0x562f1092d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:44:36.181 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.180+0000 7fa1dd3f1740 1 --2- 172.21.15.83:0/2096285894 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x562f1052f1c0 0x562f1092cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:44:36.181 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.180+0000 7fa1dd3f1740 1 --2- 172.21.15.83:0/2096285894 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x562f10504570 0x562f1092c660 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:44:36.181 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.180+0000 7fa1affff640 0 client.15663 ms_handle_reset on v2:172.21.15.119:6838/3106757092 2024-09-21T01:44:36.182 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.180+0000 7fa1dd3f1740 1 -- 172.21.15.83:0/2096285894 >> 172.21.15.83:0/2096285894 conn(0x562f10564990 msgr2=0x562f10914220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:44:36.182 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.180+0000 7fa1dd3f1740 1 -- 172.21.15.83:0/2096285894 shutdown_connections 2024-09-21T01:44:36.182 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.180+0000 7fa1dd3f1740 1 -- 172.21.15.83:0/2096285894 wait complete. 2024-09-21T01:44:36.182 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.180+0000 7fa1dd3f1740 20 client.15663 trim_cache size 0 max 16384 2024-09-21T01:44:36.182 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-09-21T01:44:36.182 INFO:teuthology.orchestra.run.smithi083.stdout: "epoch": 21, 2024-09-21T01:44:36.182 INFO:teuthology.orchestra.run.smithi083.stdout: "leader": 24653, 2024-09-21T01:44:36.182 INFO:teuthology.orchestra.run.smithi083.stdout: "set_version": 14, 2024-09-21T01:44:36.182 INFO:teuthology.orchestra.run.smithi083.stdout: "sets": { 2024-09-21T01:44:36.183 INFO:teuthology.orchestra.run.smithi083.stdout: "be126fd1": { 2024-09-21T01:44:36.183 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 14, 2024-09-21T01:44:36.183 INFO:teuthology.orchestra.run.smithi083.stdout: "age_ref": 0.0, 2024-09-21T01:44:36.183 INFO:teuthology.orchestra.run.smithi083.stdout: "state": { 2024-09-21T01:44:36.183 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "QUIESCED", 2024-09-21T01:44:36.183 INFO:teuthology.orchestra.run.smithi083.stdout: "age": 0.0 2024-09-21T01:44:36.183 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:44:36.183 INFO:teuthology.orchestra.run.smithi083.stdout: "timeout": 90.0, 2024-09-21T01:44:36.183 INFO:teuthology.orchestra.run.smithi083.stdout: "expiration": 147.8, 2024-09-21T01:44:36.183 INFO:teuthology.orchestra.run.smithi083.stdout: "members": { 2024-09-21T01:44:36.183 INFO:teuthology.orchestra.run.smithi083.stdout: "file:/": { 2024-09-21T01:44:36.183 INFO:teuthology.orchestra.run.smithi083.stdout: "excluded": false, 2024-09-21T01:44:36.183 INFO:teuthology.orchestra.run.smithi083.stdout: "state": { 2024-09-21T01:44:36.184 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "QUIESCED", 2024-09-21T01:44:36.184 INFO:teuthology.orchestra.run.smithi083.stdout: "age": 0.0 2024-09-21T01:44:36.184 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:44:36.184 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:44:36.184 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:44:36.184 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:44:36.184 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:44:36.184 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-09-21T01:44:36.185 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.181+0000 7fa1d6e7d640 1 -- 172.21.15.83:0/2960400321 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fa1c00b6680 msgr2=0x7fa1c00b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:44:36.185 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.181+0000 7fa1d6e7d640 1 --2- 172.21.15.83:0/2960400321 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fa1c00b6680 0x7fa1c00b8b90 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fa1c80e8420 tx=0x7fa1c80eb290 comp rx=0 tx=0).stop 2024-09-21T01:44:36.185 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.181+0000 7fa1d6e7d640 1 -- 172.21.15.83:0/2960400321 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa1d0108d10 msgr2=0x7fa1d019fba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:44:36.185 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.181+0000 7fa1d6e7d640 1 --2- 172.21.15.83:0/2960400321 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa1d0108d10 0x7fa1d019fba0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fa1c8009d10 tx=0x7fa1c8007590 comp rx=0 tx=0).stop 2024-09-21T01:44:36.185 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.181+0000 7fa1d6e7d640 1 -- 172.21.15.83:0/2960400321 shutdown_connections 2024-09-21T01:44:36.185 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.181+0000 7fa1d6e7d640 1 --2- 172.21.15.83:0/2960400321 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fa1c00b6680 0x7fa1c00b8b90 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:44:36.185 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.181+0000 7fa1d6e7d640 1 --2- 172.21.15.83:0/2960400321 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa1d0108d10 0x7fa1d019fba0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:44:36.185 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.181+0000 7fa1d6e7d640 1 --2- 172.21.15.83:0/2960400321 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa1d01083c0 0x7fa1d019a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:44:36.185 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.181+0000 7fa1d6e7d640 1 --2- 172.21.15.83:0/2960400321 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa1d0102a80 0x7fa1d019a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:44:36.185 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.181+0000 7fa1d6e7d640 1 -- 172.21.15.83:0/2960400321 >> 172.21.15.83:0/2960400321 conn(0x7fa1d0079760 msgr2=0x7fa1d0101ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:44:36.185 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.181+0000 7fa1d6e7d640 1 -- 172.21.15.83:0/2960400321 shutdown_connections 2024-09-21T01:44:36.185 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:44:36.181+0000 7fa1d6e7d640 1 -- 172.21.15.83:0/2960400321 wait complete. 2024-09-21T01:44:36.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:44:35 smithi142 ceph-mon[34050]: pgmap v415: 129 pgs: 129 active+clean; 3.9 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T01:44:36.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:44:35 smithi119 ceph-mon[33693]: pgmap v415: 129 pgs: 129 active+clean; 3.9 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T01:44:37.008 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'be126fd1', quiesce took 3.4 seconds. Will release after: 24.400000000000002 2024-09-21T01:44:37.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:44:36 smithi142 ceph-mon[34050]: pgmap v416: 129 pgs: 129 active+clean; 3.9 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:44:37.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:44:36 smithi119 ceph-mon[33693]: pgmap v416: 129 pgs: 129 active+clean; 3.9 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:44:37.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:44:36 smithi083 ceph-mon[31370]: pgmap v416: 129 pgs: 129 active+clean; 3.9 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:44:40.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:44:39 smithi142 ceph-mon[34050]: pgmap v417: 129 pgs: 129 active+clean; 3.9 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:44:40.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:44:39 smithi119 ceph-mon[33693]: pgmap v417: 129 pgs: 129 active+clean; 3.9 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:44:40.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:44:39 smithi083 ceph-mon[31370]: pgmap v417: 129 pgs: 129 active+clean; 3.9 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:44:42.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:44:41 smithi142 ceph-mon[34050]: pgmap v418: 129 pgs: 129 active+clean; 3.9 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 1.4 KiB/s wr, 2 op/s 2024-09-21T01:44:42.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:44:41 smithi119 ceph-mon[33693]: pgmap v418: 129 pgs: 129 active+clean; 3.9 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 1.4 KiB/s wr, 2 op/s 2024-09-21T01:44:42.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:44:41 smithi083 ceph-mon[31370]: pgmap v418: 129 pgs: 129 active+clean; 3.9 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 1.4 KiB/s wr, 2 op/s 2024-09-21T01:44:44.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:44:43 smithi142 ceph-mon[34050]: pgmap v419: 129 pgs: 129 active+clean; 4.1 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 19 KiB/s wr, 1 op/s 2024-09-21T01:44:44.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:44:43 smithi119 ceph-mon[33693]: pgmap v419: 129 pgs: 129 active+clean; 4.1 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 19 KiB/s wr, 1 op/s 2024-09-21T01:44:44.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:44:43 smithi083 ceph-mon[31370]: pgmap v419: 129 pgs: 129 active+clean; 4.1 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 19 KiB/s wr, 1 op/s 2024-09-21T01:44:46.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:44:45 smithi142 ceph-mon[34050]: pgmap v420: 129 pgs: 129 active+clean; 4.1 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 19 KiB/s wr, 2 op/s 2024-09-21T01:44:46.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:44:45 smithi119 ceph-mon[33693]: pgmap v420: 129 pgs: 129 active+clean; 4.1 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 19 KiB/s wr, 2 op/s 2024-09-21T01:44:46.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:44:45 smithi083 ceph-mon[31370]: pgmap v420: 129 pgs: 129 active+clean; 4.1 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 19 KiB/s wr, 2 op/s 2024-09-21T01:44:48.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:44:47 smithi142 ceph-mon[34050]: pgmap v421: 129 pgs: 129 active+clean; 4.1 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 19 KiB/s wr, 1 op/s 2024-09-21T01:44:48.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:44:47 smithi119 ceph-mon[33693]: pgmap v421: 129 pgs: 129 active+clean; 4.1 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 19 KiB/s wr, 1 op/s 2024-09-21T01:44:48.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:44:47 smithi083 ceph-mon[31370]: pgmap v421: 129 pgs: 129 active+clean; 4.1 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 19 KiB/s wr, 1 op/s 2024-09-21T01:44:49.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:44:48 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:44:49.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:44:48 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:44:49.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:44:48 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:44:49.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:44:48 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:44:49.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:44:48 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:44:49.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:44:48 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:44:49.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:44:48 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:44:49.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:44:48 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:44:49.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:44:48 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:44:49.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:44:48 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:44:49.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:44:48 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:44:49.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:44:48 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:44:50.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:44:49 smithi142 ceph-mon[34050]: pgmap v422: 129 pgs: 129 active+clean; 4.1 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 19 KiB/s wr, 1 op/s 2024-09-21T01:44:50.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:44:49 smithi119 ceph-mon[33693]: pgmap v422: 129 pgs: 129 active+clean; 4.1 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 19 KiB/s wr, 1 op/s 2024-09-21T01:44:50.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:44:49 smithi083 ceph-mon[31370]: pgmap v422: 129 pgs: 129 active+clean; 4.1 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 19 KiB/s wr, 1 op/s 2024-09-21T01:44:51.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:44:50 smithi142 ceph-mon[34050]: pgmap v423: 129 pgs: 129 active+clean; 4.1 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 19 KiB/s wr, 2 op/s 2024-09-21T01:44:51.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:44:50 smithi119 ceph-mon[33693]: pgmap v423: 129 pgs: 129 active+clean; 4.1 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 19 KiB/s wr, 2 op/s 2024-09-21T01:44:51.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:44:50 smithi083 ceph-mon[31370]: pgmap v423: 129 pgs: 129 active+clean; 4.1 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 19 KiB/s wr, 2 op/s 2024-09-21T01:44:54.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:44:53 smithi142 ceph-mon[34050]: pgmap v424: 129 pgs: 129 active+clean; 4.1 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 18 KiB/s wr, 1 op/s 2024-09-21T01:44:54.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:44:53 smithi119 ceph-mon[33693]: pgmap v424: 129 pgs: 129 active+clean; 4.1 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 18 KiB/s wr, 1 op/s 2024-09-21T01:44:54.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:44:53 smithi083 ceph-mon[31370]: pgmap v424: 129 pgs: 129 active+clean; 4.1 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 18 KiB/s wr, 1 op/s 2024-09-21T01:44:56.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:44:55 smithi142 ceph-mon[34050]: pgmap v425: 129 pgs: 129 active+clean; 4.1 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T01:44:56.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:44:55 smithi119 ceph-mon[33693]: pgmap v425: 129 pgs: 129 active+clean; 4.1 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T01:44:56.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:44:55 smithi083 ceph-mon[31370]: pgmap v425: 129 pgs: 129 active+clean; 4.1 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T01:44:58.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:44:57 smithi142 ceph-mon[34050]: pgmap v426: 129 pgs: 129 active+clean; 4.1 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:44:58.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:44:57 smithi119 ceph-mon[33693]: pgmap v426: 129 pgs: 129 active+clean; 4.1 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:44:58.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:44:57 smithi083 ceph-mon[31370]: pgmap v426: 129 pgs: 129 active+clean; 4.1 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:44:59.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:44:58 smithi142 ceph-mon[34050]: pgmap v427: 129 pgs: 129 active+clean; 4.1 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:44:59.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:44:58 smithi119 ceph-mon[33693]: pgmap v427: 129 pgs: 129 active+clean; 4.1 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:44:59.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:44:58 smithi083 ceph-mon[31370]: pgmap v427: 129 pgs: 129 active+clean; 4.1 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:45:01.409 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T01:45:01.661 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:45:02.034 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:45:01 smithi083 ceph-mon[31370]: pgmap v428: 129 pgs: 129 active+clean; 4.1 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T01:45:02.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:45:01 smithi142 ceph-mon[34050]: pgmap v428: 129 pgs: 129 active+clean; 4.1 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T01:45:02.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:45:01 smithi119 ceph-mon[33693]: pgmap v428: 129 pgs: 129 active+clean; 4.1 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T01:45:02.252 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:02.241+0000 7fd2bd02e640 1 -- 172.21.15.83:0/1566052345 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd2b8103b60 msgr2=0x7fd2b8103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:45:02.252 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:02.241+0000 7fd2bd02e640 1 --2- 172.21.15.83:0/1566052345 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd2b8103b60 0x7fd2b8103f70 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fd2a8009900 tx=0x7fd2a802a410 comp rx=0 tx=0).stop 2024-09-21T01:45:02.252 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:02.241+0000 7fd2bd02e640 1 -- 172.21.15.83:0/1566052345 shutdown_connections 2024-09-21T01:45:02.252 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:02.241+0000 7fd2bd02e640 1 --2- 172.21.15.83:0/1566052345 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd2b8109df0 0x7fd2b8110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:45:02.252 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:02.241+0000 7fd2bd02e640 1 --2- 172.21.15.83:0/1566052345 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd2b81094a0 0x7fd2b81098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:45:02.252 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:02.241+0000 7fd2bd02e640 1 --2- 172.21.15.83:0/1566052345 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd2b8103b60 0x7fd2b8103f70 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:45:02.253 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:02.241+0000 7fd2bd02e640 1 -- 172.21.15.83:0/1566052345 >> 172.21.15.83:0/1566052345 conn(0x7fd2b807b850 msgr2=0x7fd2b807bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:45:02.253 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:02.241+0000 7fd2bd02e640 1 -- 172.21.15.83:0/1566052345 shutdown_connections 2024-09-21T01:45:02.253 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:02.241+0000 7fd2bd02e640 1 -- 172.21.15.83:0/1566052345 wait complete. 2024-09-21T01:45:02.253 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:02.242+0000 7fd2bd02e640 1 Processor -- start 2024-09-21T01:45:02.253 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:02.242+0000 7fd2bd02e640 1 -- start start 2024-09-21T01:45:02.253 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:02.243+0000 7fd2bd02e640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd2b8103b60 0x7fd2b819a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:45:02.253 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:02.243+0000 7fd2bd02e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd2b81094a0 0x7fd2b819a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:45:02.253 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:02.243+0000 7fd2bd02e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd2b8109df0 0x7fd2b819fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:45:02.253 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:02.243+0000 7fd2bd02e640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fd2b8113960 con 0x7fd2b8103b60 2024-09-21T01:45:02.253 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:02.243+0000 7fd2bd02e640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fd2b81137e0 con 0x7fd2b8109df0 2024-09-21T01:45:02.253 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:02.243+0000 7fd2bd02e640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fd2b8113ae0 con 0x7fd2b81094a0 2024-09-21T01:45:02.253 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:02.243+0000 7fd2b6d9d640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd2b8103b60 0x7fd2b819a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:45:02.253 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:02.243+0000 7fd2b6d9d640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd2b8103b60 0x7fd2b819a430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:52174/0 (socket says 172.21.15.83:52174) 2024-09-21T01:45:02.253 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:02.243+0000 7fd2b6d9d640 1 -- 172.21.15.83:0/347804556 learned_addr learned my addr 172.21.15.83:0/347804556 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:45:02.253 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:02.243+0000 7fd2b659c640 1 --2- 172.21.15.83:0/347804556 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd2b81094a0 0x7fd2b819a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:45:02.254 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:02.243+0000 7fd2b759e640 1 --2- 172.21.15.83:0/347804556 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd2b8109df0 0x7fd2b819fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:45:02.254 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:02.243+0000 7fd2b6d9d640 1 -- 172.21.15.83:0/347804556 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd2b81094a0 msgr2=0x7fd2b819a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:45:02.254 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:02.243+0000 7fd2b6d9d640 1 --2- 172.21.15.83:0/347804556 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd2b81094a0 0x7fd2b819a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:45:02.254 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:02.243+0000 7fd2b6d9d640 1 -- 172.21.15.83:0/347804556 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd2b8109df0 msgr2=0x7fd2b819fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:45:02.254 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:02.243+0000 7fd2b6d9d640 1 --2- 172.21.15.83:0/347804556 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd2b8109df0 0x7fd2b819fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:45:02.254 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:02.243+0000 7fd2b6d9d640 1 -- 172.21.15.83:0/347804556 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2b81a02e0 con 0x7fd2b8103b60 2024-09-21T01:45:02.254 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:02.243+0000 7fd2b759e640 1 --2- 172.21.15.83:0/347804556 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd2b8109df0 0x7fd2b819fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:45:02.254 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:02.243+0000 7fd2b6d9d640 1 --2- 172.21.15.83:0/347804556 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd2b8103b60 0x7fd2b819a430 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fd2a8009230 tx=0x7fd2a8004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:45:02.254 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:02.243+0000 7fd29ffff640 1 -- 172.21.15.83:0/347804556 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2a803f030 con 0x7fd2b8103b60 2024-09-21T01:45:02.254 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:02.244+0000 7fd2bd02e640 1 -- 172.21.15.83:0/347804556 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2b81a0570 con 0x7fd2b8103b60 2024-09-21T01:45:02.254 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:02.244+0000 7fd29ffff640 1 -- 172.21.15.83:0/347804556 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd2a8003a80 con 0x7fd2b8103b60 2024-09-21T01:45:02.254 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:02.244+0000 7fd29ffff640 1 -- 172.21.15.83:0/347804556 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2a8035070 con 0x7fd2b8103b60 2024-09-21T01:45:02.254 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:02.244+0000 7fd2bd02e640 1 -- 172.21.15.83:0/347804556 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2b81a0aa0 con 0x7fd2b8103b60 2024-09-21T01:45:02.255 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:02.245+0000 7fd2bd02e640 1 -- 172.21.15.83:0/347804556 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2b8103f70 con 0x7fd2b8103b60 2024-09-21T01:45:02.255 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:02.246+0000 7fd29ffff640 1 -- 172.21.15.83:0/347804556 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7fd2a8042030 con 0x7fd2b8103b60 2024-09-21T01:45:02.255 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:02.247+0000 7fd29ffff640 1 --2- 172.21.15.83:0/347804556 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fd2a00b6730 0x7fd2a00b8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:45:02.255 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:02.247+0000 7fd2b659c640 1 --2- 172.21.15.83:0/347804556 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fd2a00b6730 0x7fd2a00b8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:45:02.255 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:02.247+0000 7fd29ffff640 1 -- 172.21.15.83:0/347804556 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9315+0+0 (secure 0 0 0) 0x7fd2a8108550 con 0x7fd2b8103b60 2024-09-21T01:45:02.255 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:02.247+0000 7fd2b659c640 1 --2- 172.21.15.83:0/347804556 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fd2a00b6730 0x7fd2a00b8c40 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fd2b8106530 tx=0x7fd2ac00a2d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:45:02.255 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:02.250+0000 7fd29ffff640 1 -- 172.21.15.83:0/347804556 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd2b81a0aa0 con 0x7fd2b8103b60 2024-09-21T01:45:02.465 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:02.464+0000 7fd2bd02e640 1 -- 172.21.15.83:0/347804556 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd2b819b560 con 0x7fd2b8103b60 2024-09-21T01:45:02.465 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:02.465+0000 7fd29ffff640 1 -- 172.21.15.83:0/347804556 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11857 (secure 0 0 0) 0x7fd2a80ce780 con 0x7fd2b8103b60 2024-09-21T01:45:02.466 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T01:45:02.466 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":21,"btime":"2024-09-21T01:40:27:947059+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14775,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6835/1105040204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":1105040204},{"type":"v1","addr":"172.21.15.83:6835","nonce":1105040204}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14787,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/2234789563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6836","nonce":2234789563},{"type":"v1","addr":"172.21.15.83:6837","nonce":2234789563}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14838,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6839/136258364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6838","nonce":136258364},{"type":"v1","addr":"172.21.15.83:6839","nonce":136258364}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14850,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6841/129439444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6840","nonce":129439444},{"type":"v1","addr":"172.21.15.83:6841","nonce":129439444}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24569,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/2839502433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":2839502433},{"type":"v1","addr":"172.21.15.119:6833","nonce":2839502433}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24580,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6833/2841606990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":2841606990},{"type":"v1","addr":"172.21.15.142:6833","nonce":2841606990}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24599,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/415902608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":415902608},{"type":"v1","addr":"172.21.15.119:6835","nonce":415902608}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24607,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/3009088510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":3009088510},{"type":"v1","addr":"172.21.15.142:6835","nonce":3009088510}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24613,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/3847200126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6836","nonce":3847200126},{"type":"v1","addr":"172.21.15.142:6837","nonce":3847200126}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24626,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/3619222976","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":3619222976},{"type":"v1","addr":"172.21.15.119:6837","nonce":3619222976}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T01:39:45.145124+0000","modified":"2024-09-21T01:40:27.664151+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24653},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24631":{"gid":24631,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.142:6839/1817880741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6838","nonce":1817880741},{"type":"v1","addr":"172.21.15.142:6839","nonce":1817880741}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24653":{"gid":24653,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.119:6839/3106757092","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":3106757092},{"type":"v1","addr":"172.21.15.119:6839","nonce":3106757092}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24653,"qdb_cluster":[24653]},"id":1}]} 2024-09-21T01:45:02.466 INFO:teuthology.orchestra.run.smithi083.stderr:dumped fsmap epoch 21 2024-09-21T01:45:02.468 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:02.467+0000 7fd2bd02e640 1 -- 172.21.15.83:0/347804556 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fd2a00b6730 msgr2=0x7fd2a00b8c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:45:02.468 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:02.467+0000 7fd2bd02e640 1 --2- 172.21.15.83:0/347804556 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fd2a00b6730 0x7fd2a00b8c40 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fd2b8106530 tx=0x7fd2ac00a2d0 comp rx=0 tx=0).stop 2024-09-21T01:45:02.468 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:02.467+0000 7fd2bd02e640 1 -- 172.21.15.83:0/347804556 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd2b8103b60 msgr2=0x7fd2b819a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:45:02.468 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:02.467+0000 7fd2bd02e640 1 --2- 172.21.15.83:0/347804556 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd2b8103b60 0x7fd2b819a430 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fd2a8009230 tx=0x7fd2a8004270 comp rx=0 tx=0).stop 2024-09-21T01:45:02.468 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:02.467+0000 7fd2bd02e640 1 -- 172.21.15.83:0/347804556 shutdown_connections 2024-09-21T01:45:02.468 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:02.467+0000 7fd2bd02e640 1 --2- 172.21.15.83:0/347804556 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fd2a00b6730 0x7fd2a00b8c40 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:45:02.468 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:02.467+0000 7fd2bd02e640 1 --2- 172.21.15.83:0/347804556 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd2b8109df0 0x7fd2b819fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:45:02.468 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:02.467+0000 7fd2bd02e640 1 --2- 172.21.15.83:0/347804556 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd2b81094a0 0x7fd2b819a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:45:02.468 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:02.467+0000 7fd2bd02e640 1 --2- 172.21.15.83:0/347804556 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd2b8103b60 0x7fd2b819a430 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:45:02.468 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:02.467+0000 7fd2bd02e640 1 -- 172.21.15.83:0/347804556 >> 172.21.15.83:0/347804556 conn(0x7fd2b807b850 msgr2=0x7fd2b8107640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:45:02.468 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:02.467+0000 7fd2bd02e640 1 -- 172.21.15.83:0/347804556 shutdown_connections 2024-09-21T01:45:02.468 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:02.467+0000 7fd2bd02e640 1 -- 172.21.15.83:0/347804556 wait complete. 2024-09-21T01:45:03.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:45:02 smithi083 ceph-mon[31370]: from='client.? 172.21.15.83:0/347804556' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:45:03.213 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24653 quiesce db --set-id be126fd1 --release --await' 2024-09-21T01:45:03.214 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24653 quiesce db --set-id be126fd1 --release --await 2024-09-21T01:45:03.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:45:02 smithi142 ceph-mon[34050]: from='client.? 172.21.15.83:0/347804556' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:45:03.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:45:02 smithi119 ceph-mon[33693]: from='client.? 172.21.15.83:0/347804556' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:45:03.476 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:45:04.006 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:03.995+0000 7f7b158a0640 1 -- 172.21.15.83:0/992844709 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7b1010ddf0 msgr2=0x7f7b10110300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:45:04.006 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:03.995+0000 7f7b158a0640 1 --2- 172.21.15.83:0/992844709 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7b1010ddf0 0x7f7b10110300 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f7b08009900 tx=0x7f7b0802a410 comp rx=0 tx=0).stop 2024-09-21T01:45:04.006 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:03.995+0000 7f7b158a0640 1 -- 172.21.15.83:0/992844709 shutdown_connections 2024-09-21T01:45:04.006 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:03.995+0000 7f7b158a0640 1 --2- 172.21.15.83:0/992844709 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7b1010ddf0 0x7f7b10110300 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:45:04.006 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:03.995+0000 7f7b158a0640 1 --2- 172.21.15.83:0/992844709 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7b10105270 0x7f7b1010d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:45:04.006 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:03.995+0000 7f7b158a0640 1 --2- 172.21.15.83:0/992844709 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7b10104840 0x7f7b10104c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:45:04.006 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:03.995+0000 7f7b158a0640 1 -- 172.21.15.83:0/992844709 >> 172.21.15.83:0/992844709 conn(0x7f7b10079730 msgr2=0x7f7b10079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:45:04.006 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:03.995+0000 7f7b158a0640 1 -- 172.21.15.83:0/992844709 shutdown_connections 2024-09-21T01:45:04.006 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:03.995+0000 7f7b158a0640 1 -- 172.21.15.83:0/992844709 wait complete. 2024-09-21T01:45:04.007 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:03.996+0000 7f7b158a0640 1 Processor -- start 2024-09-21T01:45:04.007 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:03.996+0000 7f7b158a0640 1 -- start start 2024-09-21T01:45:04.007 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:03.996+0000 7f7b158a0640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7b10104840 0x7f7b1019a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:45:04.007 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:03.996+0000 7f7b158a0640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7b10105270 0x7f7b1019a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:45:04.007 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:03.996+0000 7f7b158a0640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7b1010ddf0 0x7f7b1019fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:45:04.007 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:03.996+0000 7f7b158a0640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f7b10113940 con 0x7f7b1010ddf0 2024-09-21T01:45:04.007 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:03.996+0000 7f7b158a0640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f7b101137c0 con 0x7f7b10105270 2024-09-21T01:45:04.007 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:03.996+0000 7f7b158a0640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f7b10113ac0 con 0x7f7b10104840 2024-09-21T01:45:04.007 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:03.996+0000 7f7b0f7fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7b1010ddf0 0x7f7b1019fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:45:04.007 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:03.996+0000 7f7b0effd640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7b10104840 0x7f7b1019a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:45:04.007 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:03.996+0000 7f7b0f7fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7b1010ddf0 0x7f7b1019fc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:33202/0 (socket says 172.21.15.83:33202) 2024-09-21T01:45:04.007 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:03.996+0000 7f7b0f7fe640 1 -- 172.21.15.83:0/3602459199 learned_addr learned my addr 172.21.15.83:0/3602459199 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:45:04.007 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:03.996+0000 7f7b0e7fc640 1 --2- 172.21.15.83:0/3602459199 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7b10105270 0x7f7b1019a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:45:04.007 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:03.997+0000 7f7b0f7fe640 1 -- 172.21.15.83:0/3602459199 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7b10104840 msgr2=0x7f7b1019a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:45:04.008 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:03.997+0000 7f7b0f7fe640 1 --2- 172.21.15.83:0/3602459199 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7b10104840 0x7f7b1019a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:45:04.008 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:03.997+0000 7f7b0f7fe640 1 -- 172.21.15.83:0/3602459199 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7b10105270 msgr2=0x7f7b1019a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:45:04.008 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:03.997+0000 7f7b0f7fe640 1 --2- 172.21.15.83:0/3602459199 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7b10105270 0x7f7b1019a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:45:04.008 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:03.997+0000 7f7b0f7fe640 1 -- 172.21.15.83:0/3602459199 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b101a03a0 con 0x7f7b1010ddf0 2024-09-21T01:45:04.008 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:03.997+0000 7f7b0effd640 1 --2- 172.21.15.83:0/3602459199 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7b10104840 0x7f7b1019a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:45:04.008 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:03.997+0000 7f7b0f7fe640 1 --2- 172.21.15.83:0/3602459199 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7b1010ddf0 0x7f7b1019fc70 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f7b08005ab0 tx=0x7f7b080040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:45:04.008 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:03.997+0000 7f7b1489e640 1 -- 172.21.15.83:0/3602459199 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b0803f030 con 0x7f7b1010ddf0 2024-09-21T01:45:04.008 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:03.997+0000 7f7b1489e640 1 -- 172.21.15.83:0/3602459199 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7b08003a80 con 0x7f7b1010ddf0 2024-09-21T01:45:04.008 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:03.997+0000 7f7b158a0640 1 -- 172.21.15.83:0/3602459199 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b101a0630 con 0x7f7b1010ddf0 2024-09-21T01:45:04.008 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:03.997+0000 7f7b1489e640 1 -- 172.21.15.83:0/3602459199 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b08035070 con 0x7f7b1010ddf0 2024-09-21T01:45:04.008 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:03.997+0000 7f7b158a0640 1 -- 172.21.15.83:0/3602459199 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b101a6df0 con 0x7f7b1010ddf0 2024-09-21T01:45:04.008 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.000+0000 7f7b1be14740 1 Processor -- start 2024-09-21T01:45:04.008 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.000+0000 7f7b1489e640 1 -- 172.21.15.83:0/3602459199 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7f7b08042030 con 0x7f7b1010ddf0 2024-09-21T01:45:04.008 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.000+0000 7f7b1be14740 1 -- start start 2024-09-21T01:45:04.009 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.000+0000 7f7b1be14740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ea95c8c520 0x55ea96032510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:45:04.009 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.000+0000 7f7b1be14740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ea95c63660 0x55ea96032a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:45:04.009 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.000+0000 7f7b1be14740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ea95c6b840 0x55ea96032f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:45:04.009 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.000+0000 7f7b1be14740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55ea95f1ddc0 con 0x55ea95c63660 2024-09-21T01:45:04.009 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.000+0000 7f7b1be14740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55ea95faa1f0 con 0x55ea95c8c520 2024-09-21T01:45:04.009 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.000+0000 7f7b1be14740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55ea95f99620 con 0x55ea95c6b840 2024-09-21T01:45:04.009 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.000+0000 7f7b0effd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ea95c63660 0x55ea96032a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:45:04.009 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.000+0000 7f7b0effd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ea95c63660 0x55ea96032a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:33206/0 (socket says 172.21.15.83:33206) 2024-09-21T01:45:04.009 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.000+0000 7f7b0effd640 1 -- 172.21.15.83:0/1887831094 learned_addr learned my addr 172.21.15.83:0/1887831094 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:45:04.009 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.000+0000 7f7b0e7fc640 1 --2- 172.21.15.83:0/1887831094 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ea95c6b840 0x55ea96032f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:45:04.009 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.001+0000 7f7b0e7fc640 1 --2- 172.21.15.83:0/1887831094 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ea95c8c520 0x55ea96032510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:45:04.009 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.001+0000 7f7b0effd640 1 -- 172.21.15.83:0/1887831094 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ea95c6b840 msgr2=0x55ea96032f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:45:04.009 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.001+0000 7f7b0effd640 1 --2- 172.21.15.83:0/1887831094 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ea95c6b840 0x55ea96032f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:45:04.010 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.001+0000 7f7b0effd640 1 -- 172.21.15.83:0/1887831094 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ea95c8c520 msgr2=0x55ea96032510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:45:04.010 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.001+0000 7f7b0effd640 1 --2- 172.21.15.83:0/1887831094 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ea95c8c520 0x55ea96032510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:45:04.010 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.001+0000 7f7b1489e640 1 --2- 172.21.15.83:0/3602459199 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f7afc0b6680 0x7f7afc0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:45:04.010 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.001+0000 7f7b0effd640 1 -- 172.21.15.83:0/1887831094 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea95f61fd0 con 0x55ea95c63660 2024-09-21T01:45:04.010 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.001+0000 7f7b0e7fc640 1 --2- 172.21.15.83:0/1887831094 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ea95c8c520 0x55ea96032510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:45:04.010 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.001+0000 7f7b0e7fc640 1 --2- 172.21.15.83:0/3602459199 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f7afc0b6680 0x7f7afc0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:45:04.010 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.001+0000 7f7b0effd640 1 --2- 172.21.15.83:0/1887831094 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ea95c63660 0x55ea96032a50 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f7b0000f6b0 tx=0x7f7b0000fb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdea7af782b795c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:45:04.010 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.001+0000 7f7b1489e640 1 -- 172.21.15.83:0/3602459199 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9315+0+0 (secure 0 0 0) 0x7f7b08107f30 con 0x7f7b1010ddf0 2024-09-21T01:45:04.010 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.001+0000 7f7b05ffb640 1 -- 172.21.15.83:0/1887831094 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b00004d20 con 0x55ea95c63660 2024-09-21T01:45:04.010 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.001+0000 7f7b05ffb640 1 -- 172.21.15.83:0/1887831094 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7b0000ddb0 con 0x55ea95c63660 2024-09-21T01:45:04.010 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.001+0000 7f7b05ffb640 1 -- 172.21.15.83:0/1887831094 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b00018c30 con 0x55ea95c63660 2024-09-21T01:45:04.010 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.002+0000 7f7b1be14740 1 -- 172.21.15.83:0/1887831094 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ea95c63660 msgr2=0x55ea96032a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:45:04.010 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.002+0000 7f7b0e7fc640 1 --2- 172.21.15.83:0/3602459199 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f7afc0b6680 0x7f7afc0b8b90 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f7af800bfd0 tx=0x7f7af800b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:45:04.010 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.002+0000 7f7b1be14740 1 --2- 172.21.15.83:0/1887831094 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ea95c63660 0x55ea96032a50 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f7b0000f6b0 tx=0x7f7b0000fb70 comp rx=0 tx=0).stop 2024-09-21T01:45:04.011 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.002+0000 7f7b1be14740 1 -- 172.21.15.83:0/1887831094 shutdown_connections 2024-09-21T01:45:04.011 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.002+0000 7f7b1be14740 1 --2- 172.21.15.83:0/1887831094 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ea95c6b840 0x55ea96032f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:45:04.011 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.002+0000 7f7b1be14740 1 --2- 172.21.15.83:0/1887831094 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ea95c63660 0x55ea96032a50 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:45:04.011 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.002+0000 7f7b1be14740 1 --2- 172.21.15.83:0/1887831094 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ea95c8c520 0x55ea96032510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:45:04.011 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.002+0000 7f7b1be14740 1 -- 172.21.15.83:0/1887831094 >> 172.21.15.83:0/1887831094 conn(0x55ea95c80910 msgr2=0x55ea96030400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:45:04.011 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.002+0000 7f7b1be14740 1 -- 172.21.15.83:0/1887831094 shutdown_connections 2024-09-21T01:45:04.011 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.002+0000 7f7b1be14740 1 -- 172.21.15.83:0/1887831094 wait complete. 2024-09-21T01:45:04.011 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.003+0000 7f7b1be14740 1 -- start start 2024-09-21T01:45:04.011 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.003+0000 7f7b1be14740 1 Processor -- start 2024-09-21T01:45:04.011 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.003+0000 7f7b1be14740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ea95c63660 0x55ea9603dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:45:04.011 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.003+0000 7f7b1be14740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ea95c6b840 0x55ea9603e010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:45:04.011 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.003+0000 7f7b1be14740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ea95c8c520 0x55ea9603e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:45:04.011 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.003+0000 7f7b1be14740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55ea95f34300 con 0x55ea95c63660 2024-09-21T01:45:04.011 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.003+0000 7f7b1be14740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55ea95f9d430 con 0x55ea95c6b840 2024-09-21T01:45:04.012 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.003+0000 7f7b1be14740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55ea95dfabb0 con 0x55ea95c8c520 2024-09-21T01:45:04.012 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.003+0000 7f7b1be14740 10 client.0 _ll_register_callbacks cb 0x55ea95f4e120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:45:04.012 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.003+0000 7f7b0effd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ea95c63660 0x55ea9603dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:45:04.012 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.003+0000 7f7b0effd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ea95c63660 0x55ea9603dad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:33220/0 (socket says 172.21.15.83:33220) 2024-09-21T01:45:04.012 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.003+0000 7f7b0effd640 1 -- 172.21.15.83:0/3789999600 learned_addr learned my addr 172.21.15.83:0/3789999600 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:45:04.012 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.003+0000 7f7b0e7fc640 1 --2- 172.21.15.83:0/3789999600 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ea95c6b840 0x55ea9603e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:45:04.012 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.003+0000 7f7b0f7fe640 1 --2- 172.21.15.83:0/3789999600 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ea95c8c520 0x55ea9603e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:45:04.012 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.004+0000 7f7b0effd640 1 -- 172.21.15.83:0/3789999600 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ea95c8c520 msgr2=0x55ea9603e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:45:04.012 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.004+0000 7f7b0effd640 1 --2- 172.21.15.83:0/3789999600 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ea95c8c520 0x55ea9603e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:45:04.012 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.004+0000 7f7b0effd640 1 -- 172.21.15.83:0/3789999600 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ea95c6b840 msgr2=0x55ea9603e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:45:04.012 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.004+0000 7f7b0effd640 1 --2- 172.21.15.83:0/3789999600 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ea95c6b840 0x55ea9603e010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:45:04.012 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.004+0000 7f7b0effd640 1 -- 172.21.15.83:0/3789999600 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ea95f23780 con 0x55ea95c63660 2024-09-21T01:45:04.012 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.004+0000 7f7b0effd640 1 --2- 172.21.15.83:0/3789999600 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ea95c63660 0x55ea9603dad0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f7b00000f80 tx=0x7f7b00018c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efa167355c7bfde7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:45:04.012 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.004+0000 7f7aeeffd640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-09-21T01:45:04.013 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.004+0000 7f7aeeffd640 1 -- 172.21.15.83:0/3789999600 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b00026030 con 0x55ea95c63660 2024-09-21T01:45:04.013 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.004+0000 7f7b1be14740 1 -- 172.21.15.83:0/3789999600 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7b0000ddb0 con 0x55ea95c63660 2024-09-21T01:45:04.013 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.004+0000 7f7aeeffd640 1 -- 172.21.15.83:0/3789999600 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9315+0+0 (secure 0 0 0) 0x7f7b00004a40 con 0x55ea95c63660 2024-09-21T01:45:04.013 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.004+0000 7f7aeeffd640 1 -- 172.21.15.83:0/3789999600 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f7b00030050 con 0x55ea95c63660 2024-09-21T01:45:04.013 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.004+0000 7f7b1be14740 10 client.15681 fetch_fsmap learned FSMap version 21 2024-09-21T01:45:04.013 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.004+0000 7f7b1be14740 1 -- 172.21.15.83:0/3789999600 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55ea95cf7b00 con 0x55ea95c63660 2024-09-21T01:45:04.013 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.004+0000 7f7aeeffd640 1 -- 172.21.15.83:0/3789999600 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7b0000ddb0 con 0x55ea95c63660 2024-09-21T01:45:04.013 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.005+0000 7f7aeeffd640 1 -- 172.21.15.83:0/3789999600 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f7b000228f0 con 0x55ea95c63660 2024-09-21T01:45:04.013 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.005+0000 7f7b1be14740 10 client.15681 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T01:45:04.013 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.005+0000 7f7b1be14740 10 client.15681 resolve_mds: validated gid 24653 aka daemon mds.b 2024-09-21T01:45:04.013 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.005+0000 7f7b1be14740 20 client.15681 populate_metadata read hostname 'smithi083' 2024-09-21T01:45:04.013 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.005+0000 7f7b1be14740 1 --2- 172.21.15.83:0/3789999600 >> [v2:172.21.15.119:6838/3106757092,v1:172.21.15.119:6839/3106757092] conn(0x55ea95c4aea0 0x55ea9604fd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:45:04.013 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.005+0000 7f7b1be14740 4 client.15681 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:45:04.013 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.005+0000 7f7b1be14740 1 -- 172.21.15.83:0/3789999600 --> [v2:172.21.15.119:6838/3106757092,v1:172.21.15.119:6839/3106757092] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ea95fac140 con 0x55ea95c4aea0 2024-09-21T01:45:04.014 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.005+0000 7f7b0e7fc640 1 --2- 172.21.15.83:0/3789999600 >> [v2:172.21.15.119:6838/3106757092,v1:172.21.15.119:6839/3106757092] conn(0x55ea95c4aea0 0x55ea9604fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:45:04.014 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.006+0000 7f7aeeffd640 10 client.15681 ms_handle_connect on v2:172.21.15.119:6838/3106757092 2024-09-21T01:45:04.014 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.006+0000 7f7b0e7fc640 1 --2- 172.21.15.83:0/3789999600 >> [v2:172.21.15.119:6838/3106757092,v1:172.21.15.119:6839/3106757092] conn(0x55ea95c4aea0 0x55ea9604fd30 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=19731c8bc2e2403a server_cookie=f4fea3509f313435 in_seq=0 out_seq=0 2024-09-21T01:45:04.015 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.006+0000 7f7aeeffd640 1 -- 172.21.15.83:0/3789999600 <== mds.0 v2:172.21.15.119:6838/3106757092 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ea95fac140 con 0x55ea95c4aea0 2024-09-21T01:45:04.015 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.006+0000 7f7aeeffd640 10 client.15681 handle_command_reply: tid=0 2024-09-21T01:45:04.015 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.006+0000 7f7b1be14740 1 client.15681 shutdown 2024-09-21T01:45:04.015 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.006+0000 7f7b1be14740 1 -- 172.21.15.83:0/3789999600 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ea95c63660 msgr2=0x55ea9603dad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:45:04.015 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.006+0000 7f7b1be14740 1 --2- 172.21.15.83:0/3789999600 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ea95c63660 0x55ea9603dad0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f7b00000f80 tx=0x7f7b00018c00 comp rx=0 tx=0).stop 2024-09-21T01:45:04.015 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.007+0000 7f7b1be14740 1 -- 172.21.15.83:0/3789999600 shutdown_connections 2024-09-21T01:45:04.015 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.007+0000 7f7b1be14740 1 --2- 172.21.15.83:0/3789999600 >> [v2:172.21.15.119:6838/3106757092,v1:172.21.15.119:6839/3106757092] conn(0x55ea95c4aea0 0x55ea9604fd30 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:45:04.015 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.007+0000 7f7b1be14740 1 --2- 172.21.15.83:0/3789999600 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ea95c8c520 0x55ea9603e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:45:04.015 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.007+0000 7f7b1be14740 1 --2- 172.21.15.83:0/3789999600 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ea95c6b840 0x55ea9603e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:45:04.015 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.007+0000 7f7b1be14740 1 --2- 172.21.15.83:0/3789999600 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ea95c63660 0x55ea9603dad0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:45:04.015 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.007+0000 7f7aeeffd640 0 client.15681 ms_handle_reset on v2:172.21.15.119:6838/3106757092 2024-09-21T01:45:04.015 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.007+0000 7f7b1be14740 1 -- 172.21.15.83:0/3789999600 >> 172.21.15.83:0/3789999600 conn(0x55ea95c80910 msgr2=0x55ea960356a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:45:04.016 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.007+0000 7f7b1be14740 1 -- 172.21.15.83:0/3789999600 shutdown_connections 2024-09-21T01:45:04.016 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.007+0000 7f7b1be14740 1 -- 172.21.15.83:0/3789999600 wait complete. 2024-09-21T01:45:04.016 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.007+0000 7f7b1be14740 20 client.15681 trim_cache size 0 max 16384 2024-09-21T01:45:04.025 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.024+0000 7f7b1be14740 1 Processor -- start 2024-09-21T01:45:04.025 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.024+0000 7f7b1be14740 1 -- start start 2024-09-21T01:45:04.025 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.024+0000 7f7b1be14740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ea95c63660 0x55ea96033de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:45:04.025 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.024+0000 7f7b1be14740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ea95c6b840 0x55ea9603acc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:45:04.025 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.024+0000 7f7b1be14740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ea95c8c520 0x55ea9603b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:45:04.025 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.024+0000 7f7b1be14740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f7b101aec20 con 0x55ea95c8c520 2024-09-21T01:45:04.025 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.024+0000 7f7b1be14740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f7b101b14a0 con 0x55ea95c6b840 2024-09-21T01:45:04.026 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.024+0000 7f7b1be14740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f7b101af290 con 0x55ea95c63660 2024-09-21T01:45:04.026 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.024+0000 7f7b0f7fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ea95c8c520 0x55ea9603b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:45:04.026 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.024+0000 7f7b0f7fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ea95c8c520 0x55ea9603b200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:33230/0 (socket says 172.21.15.83:33230) 2024-09-21T01:45:04.026 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.024+0000 7f7b0f7fe640 1 -- 172.21.15.83:0/3457944929 learned_addr learned my addr 172.21.15.83:0/3457944929 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:45:04.026 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.024+0000 7f7b0effd640 1 --2- 172.21.15.83:0/3457944929 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ea95c63660 0x55ea96033de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:45:04.026 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.024+0000 7f7b0e7fc640 1 --2- 172.21.15.83:0/3457944929 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ea95c6b840 0x55ea9603acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:45:04.026 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.024+0000 7f7b0f7fe640 1 -- 172.21.15.83:0/3457944929 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ea95c63660 msgr2=0x55ea96033de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:45:04.026 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.024+0000 7f7b0f7fe640 1 --2- 172.21.15.83:0/3457944929 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ea95c63660 0x55ea96033de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:45:04.026 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.024+0000 7f7b0f7fe640 1 -- 172.21.15.83:0/3457944929 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ea95c6b840 msgr2=0x55ea9603acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:45:04.026 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.025+0000 7f7b0f7fe640 1 --2- 172.21.15.83:0/3457944929 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ea95c6b840 0x55ea9603acc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:45:04.026 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.025+0000 7f7b0f7fe640 1 -- 172.21.15.83:0/3457944929 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea95d6e960 con 0x55ea95c8c520 2024-09-21T01:45:04.026 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.025+0000 7f7b0f7fe640 1 --2- 172.21.15.83:0/3457944929 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ea95c8c520 0x55ea9603b200 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f7b080ca0e0 tx=0x7f7b080b5040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1035cc50371e2a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:45:04.026 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.025+0000 7f7b057fa640 1 -- 172.21.15.83:0/3457944929 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b080d2070 con 0x55ea95c8c520 2024-09-21T01:45:04.026 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.025+0000 7f7b057fa640 1 -- 172.21.15.83:0/3457944929 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7b080cd620 con 0x55ea95c8c520 2024-09-21T01:45:04.027 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.025+0000 7f7b057fa640 1 -- 172.21.15.83:0/3457944929 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b08049070 con 0x55ea95c8c520 2024-09-21T01:45:04.029 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.026+0000 7f7b1be14740 1 -- 172.21.15.83:0/3457944929 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ea95c8c520 msgr2=0x55ea9603b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:45:04.029 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.026+0000 7f7b1be14740 1 --2- 172.21.15.83:0/3457944929 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ea95c8c520 0x55ea9603b200 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f7b080ca0e0 tx=0x7f7b080b5040 comp rx=0 tx=0).stop 2024-09-21T01:45:04.029 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.026+0000 7f7b1be14740 1 -- 172.21.15.83:0/3457944929 shutdown_connections 2024-09-21T01:45:04.029 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.026+0000 7f7b1be14740 1 --2- 172.21.15.83:0/3457944929 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ea95c8c520 0x55ea9603b200 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:45:04.030 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.026+0000 7f7b1be14740 1 --2- 172.21.15.83:0/3457944929 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ea95c6b840 0x55ea9603acc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:45:04.030 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.026+0000 7f7b1be14740 1 --2- 172.21.15.83:0/3457944929 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ea95c63660 0x55ea96033de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:45:04.030 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.026+0000 7f7b1be14740 1 -- 172.21.15.83:0/3457944929 >> 172.21.15.83:0/3457944929 conn(0x55ea95c80910 msgr2=0x55ea96049770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:45:04.030 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.026+0000 7f7b1be14740 1 -- 172.21.15.83:0/3457944929 shutdown_connections 2024-09-21T01:45:04.030 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.026+0000 7f7b1be14740 1 -- 172.21.15.83:0/3457944929 wait complete. 2024-09-21T01:45:04.030 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.026+0000 7f7b1be14740 1 -- start start 2024-09-21T01:45:04.030 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.026+0000 7f7b1be14740 1 Processor -- start 2024-09-21T01:45:04.030 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.027+0000 7f7b1be14740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ea95c63660 0x55ea96043e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:45:04.030 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.027+0000 7f7b1be14740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ea95c6b840 0x55ea96044390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:45:04.030 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.027+0000 7f7b1be14740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ea95c8c520 0x55ea960448d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:45:04.030 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.027+0000 7f7b1be14740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f7b101af960 con 0x55ea95c63660 2024-09-21T01:45:04.030 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.027+0000 7f7b1be14740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f7b101b0dd0 con 0x55ea95c6b840 2024-09-21T01:45:04.031 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.027+0000 7f7b1be14740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f7b101b0030 con 0x55ea95c8c520 2024-09-21T01:45:04.031 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.027+0000 7f7b1be14740 10 client.0 _ll_register_callbacks cb 0x7f7af800b9d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:45:04.031 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.027+0000 7f7b0effd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ea95c63660 0x55ea96043e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:45:04.031 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.027+0000 7f7b0effd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ea95c63660 0x55ea96043e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:33238/0 (socket says 172.21.15.83:33238) 2024-09-21T01:45:04.031 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.027+0000 7f7b0effd640 1 -- 172.21.15.83:0/4172368178 learned_addr learned my addr 172.21.15.83:0/4172368178 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:45:04.031 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.027+0000 7f7b0f7fe640 1 --2- 172.21.15.83:0/4172368178 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ea95c8c520 0x55ea960448d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:45:04.031 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.027+0000 7f7b0e7fc640 1 --2- 172.21.15.83:0/4172368178 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ea95c6b840 0x55ea96044390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:45:04.031 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.027+0000 7f7b0effd640 1 -- 172.21.15.83:0/4172368178 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ea95c8c520 msgr2=0x55ea960448d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:45:04.031 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.027+0000 7f7b0effd640 1 --2- 172.21.15.83:0/4172368178 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ea95c8c520 0x55ea960448d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:45:04.031 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.027+0000 7f7b0effd640 1 -- 172.21.15.83:0/4172368178 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ea95c6b840 msgr2=0x55ea96044390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:45:04.031 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.027+0000 7f7b0effd640 1 --2- 172.21.15.83:0/4172368178 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ea95c6b840 0x55ea96044390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:45:04.032 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.027+0000 7f7b0effd640 1 -- 172.21.15.83:0/4172368178 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ea960b94e0 con 0x55ea95c63660 2024-09-21T01:45:04.032 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.027+0000 7f7b0e7fc640 1 --2- 172.21.15.83:0/4172368178 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ea95c6b840 0x55ea96044390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:45:04.032 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.027+0000 7f7b0effd640 1 --2- 172.21.15.83:0/4172368178 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ea95c63660 0x55ea96043e50 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f7b0000f6b0 tx=0x7f7b0000f420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb39ba56a90e35fb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:45:04.032 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.027+0000 7f7aeeffd640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-09-21T01:45:04.032 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.027+0000 7f7aeeffd640 1 -- 172.21.15.83:0/4172368178 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b00026040 con 0x55ea95c63660 2024-09-21T01:45:04.032 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.027+0000 7f7aeeffd640 1 -- 172.21.15.83:0/4172368178 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9315+0+0 (secure 0 0 0) 0x7f7b00018440 con 0x55ea95c63660 2024-09-21T01:45:04.032 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.027+0000 7f7b1be14740 1 -- 172.21.15.83:0/4172368178 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7b080cd620 con 0x55ea95c63660 2024-09-21T01:45:04.032 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.028+0000 7f7aeeffd640 1 -- 172.21.15.83:0/4172368178 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f7b0000ae60 con 0x55ea95c63660 2024-09-21T01:45:04.032 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.028+0000 7f7b1be14740 10 client.15687 fetch_fsmap learned FSMap version 21 2024-09-21T01:45:04.032 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.028+0000 7f7b1be14740 1 -- 172.21.15.83:0/4172368178 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55ea960ba780 con 0x55ea95c63660 2024-09-21T01:45:04.032 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.028+0000 7f7aeeffd640 1 -- 172.21.15.83:0/4172368178 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7b080cd620 con 0x55ea95c63660 2024-09-21T01:45:04.032 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.028+0000 7f7aeeffd640 1 -- 172.21.15.83:0/4172368178 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f7b00010430 con 0x55ea95c63660 2024-09-21T01:45:04.032 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.028+0000 7f7b1be14740 10 client.15687 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T01:45:04.032 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.028+0000 7f7b1be14740 10 client.15687 resolve_mds: validated gid 24653 aka daemon mds.b 2024-09-21T01:45:04.032 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.028+0000 7f7b1be14740 20 client.15687 populate_metadata read hostname 'smithi083' 2024-09-21T01:45:04.033 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.028+0000 7f7b1be14740 1 --2- 172.21.15.83:0/4172368178 >> [v2:172.21.15.119:6838/3106757092,v1:172.21.15.119:6839/3106757092] conn(0x55ea95c20250 0x55ea960bceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:45:04.033 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.028+0000 7f7b1be14740 4 client.15687 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "be126fd1", "release": true, "await": true}] 2024-09-21T01:45:04.033 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.028+0000 7f7b1be14740 1 -- 172.21.15.83:0/4172368178 --> [v2:172.21.15.119:6838/3106757092,v1:172.21.15.119:6839/3106757092] -- command(tid 0: {"prefix": "quiesce db", "set_id": "be126fd1", "release": true, "await": true}) -- 0x55ea95fa7bf0 con 0x55ea95c20250 2024-09-21T01:45:04.033 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.029+0000 7f7b0e7fc640 1 --2- 172.21.15.83:0/4172368178 >> [v2:172.21.15.119:6838/3106757092,v1:172.21.15.119:6839/3106757092] conn(0x55ea95c20250 0x55ea960bceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:45:04.033 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.029+0000 7f7b0e7fc640 1 --2- 172.21.15.83:0/4172368178 >> [v2:172.21.15.119:6838/3106757092,v1:172.21.15.119:6839/3106757092] conn(0x55ea95c20250 0x55ea960bceb0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d56bf36beec80ca0 server_cookie=bd2ec5451e7a65d6 in_seq=0 out_seq=0 2024-09-21T01:45:04.033 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.029+0000 7f7aeeffd640 10 client.15687 ms_handle_connect on v2:172.21.15.119:6838/3106757092 2024-09-21T01:45:04.034 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.030+0000 7f7aeeffd640 1 -- 172.21.15.83:0/4172368178 <== mds.0 v2:172.21.15.119:6838/3106757092 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55ea95fa7bf0 con 0x55ea95c20250 2024-09-21T01:45:04.034 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.030+0000 7f7aeeffd640 10 client.15687 handle_command_reply: tid=0 2024-09-21T01:45:04.034 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.030+0000 7f7b1be14740 1 client.15687 shutdown 2024-09-21T01:45:04.034 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.031+0000 7f7b1be14740 1 -- 172.21.15.83:0/4172368178 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ea95c63660 msgr2=0x55ea96043e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:45:04.034 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.031+0000 7f7b1be14740 1 --2- 172.21.15.83:0/4172368178 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ea95c63660 0x55ea96043e50 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f7b0000f6b0 tx=0x7f7b0000f420 comp rx=0 tx=0).stop 2024-09-21T01:45:04.034 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.031+0000 7f7b1be14740 1 -- 172.21.15.83:0/4172368178 shutdown_connections 2024-09-21T01:45:04.034 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.031+0000 7f7b1be14740 1 --2- 172.21.15.83:0/4172368178 >> [v2:172.21.15.119:6838/3106757092,v1:172.21.15.119:6839/3106757092] conn(0x55ea95c20250 0x55ea960bceb0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:45:04.034 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.031+0000 7f7b1be14740 1 --2- 172.21.15.83:0/4172368178 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ea95c8c520 0x55ea960448d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:45:04.035 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.031+0000 7f7aeeffd640 0 client.15687 ms_handle_reset on v2:172.21.15.119:6838/3106757092 2024-09-21T01:45:04.035 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.031+0000 7f7b1be14740 1 --2- 172.21.15.83:0/4172368178 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55ea95c6b840 0x55ea96044390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:45:04.035 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.031+0000 7f7b1be14740 1 --2- 172.21.15.83:0/4172368178 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55ea95c63660 0x55ea96043e50 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:45:04.035 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.031+0000 7f7b1be14740 1 -- 172.21.15.83:0/4172368178 >> 172.21.15.83:0/4172368178 conn(0x55ea95c80910 msgr2=0x55ea96048db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:45:04.035 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.031+0000 7f7b1be14740 1 -- 172.21.15.83:0/4172368178 shutdown_connections 2024-09-21T01:45:04.035 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.031+0000 7f7b1be14740 1 -- 172.21.15.83:0/4172368178 wait complete. 2024-09-21T01:45:04.035 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.031+0000 7f7b1be14740 20 client.15687 trim_cache size 0 max 16384 2024-09-21T01:45:04.035 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-09-21T01:45:04.035 INFO:teuthology.orchestra.run.smithi083.stdout: "epoch": 21, 2024-09-21T01:45:04.035 INFO:teuthology.orchestra.run.smithi083.stdout: "leader": 24653, 2024-09-21T01:45:04.035 INFO:teuthology.orchestra.run.smithi083.stdout: "set_version": 16, 2024-09-21T01:45:04.036 INFO:teuthology.orchestra.run.smithi083.stdout: "sets": { 2024-09-21T01:45:04.036 INFO:teuthology.orchestra.run.smithi083.stdout: "be126fd1": { 2024-09-21T01:45:04.036 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 16, 2024-09-21T01:45:04.036 INFO:teuthology.orchestra.run.smithi083.stdout: "age_ref": 0.0, 2024-09-21T01:45:04.036 INFO:teuthology.orchestra.run.smithi083.stdout: "state": { 2024-09-21T01:45:04.036 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "RELEASED", 2024-09-21T01:45:04.036 INFO:teuthology.orchestra.run.smithi083.stdout: "age": 0.0 2024-09-21T01:45:04.036 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:45:04.036 INFO:teuthology.orchestra.run.smithi083.stdout: "timeout": 90.0, 2024-09-21T01:45:04.036 INFO:teuthology.orchestra.run.smithi083.stdout: "expiration": 147.8, 2024-09-21T01:45:04.036 INFO:teuthology.orchestra.run.smithi083.stdout: "members": { 2024-09-21T01:45:04.036 INFO:teuthology.orchestra.run.smithi083.stdout: "file:/": { 2024-09-21T01:45:04.036 INFO:teuthology.orchestra.run.smithi083.stdout: "excluded": false, 2024-09-21T01:45:04.036 INFO:teuthology.orchestra.run.smithi083.stdout: "state": { 2024-09-21T01:45:04.036 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "RELEASED", 2024-09-21T01:45:04.037 INFO:teuthology.orchestra.run.smithi083.stdout: "age": 0.0 2024-09-21T01:45:04.037 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:45:04.037 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:45:04.037 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:45:04.037 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:45:04.037 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:45:04.037 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-09-21T01:45:04.037 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.031+0000 7f7b158a0640 1 -- 172.21.15.83:0/3602459199 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f7afc0b6680 msgr2=0x7f7afc0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:45:04.038 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.031+0000 7f7b158a0640 1 --2- 172.21.15.83:0/3602459199 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f7afc0b6680 0x7f7afc0b8b90 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f7af800bfd0 tx=0x7f7af800b390 comp rx=0 tx=0).stop 2024-09-21T01:45:04.038 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.031+0000 7f7b158a0640 1 -- 172.21.15.83:0/3602459199 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7b1010ddf0 msgr2=0x7f7b1019fc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:45:04.038 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.031+0000 7f7b158a0640 1 --2- 172.21.15.83:0/3602459199 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7b1010ddf0 0x7f7b1019fc70 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f7b08005ab0 tx=0x7f7b080040e0 comp rx=0 tx=0).stop 2024-09-21T01:45:04.038 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.032+0000 7f7b158a0640 1 -- 172.21.15.83:0/3602459199 shutdown_connections 2024-09-21T01:45:04.038 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.032+0000 7f7b158a0640 1 --2- 172.21.15.83:0/3602459199 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f7afc0b6680 0x7f7afc0b8b90 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:45:04.038 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.032+0000 7f7b158a0640 1 --2- 172.21.15.83:0/3602459199 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7b1010ddf0 0x7f7b1019fc70 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:45:04.038 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.032+0000 7f7b158a0640 1 --2- 172.21.15.83:0/3602459199 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7b10105270 0x7f7b1019a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:45:04.038 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.032+0000 7f7b158a0640 1 --2- 172.21.15.83:0/3602459199 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7b10104840 0x7f7b1019a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:45:04.038 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.032+0000 7f7b158a0640 1 -- 172.21.15.83:0/3602459199 >> 172.21.15.83:0/3602459199 conn(0x7f7b10079730 msgr2=0x7f7b101068f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:45:04.038 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.032+0000 7f7b158a0640 1 -- 172.21.15.83:0/3602459199 shutdown_connections 2024-09-21T01:45:04.038 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:45:04.032+0000 7f7b158a0640 1 -- 172.21.15.83:0/3602459199 wait complete. 2024-09-21T01:45:04.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:45:03 smithi142 ceph-mon[34050]: pgmap v429: 129 pgs: 129 active+clean; 4.1 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 11 KiB/s wr, 3 op/s 2024-09-21T01:45:04.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:45:03 smithi119 ceph-mon[33693]: pgmap v429: 129 pgs: 129 active+clean; 4.1 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 11 KiB/s wr, 3 op/s 2024-09-21T01:45:04.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:45:03 smithi083 ceph-mon[31370]: pgmap v429: 129 pgs: 129 active+clean; 4.1 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 11 KiB/s wr, 3 op/s 2024-09-21T01:45:04.850 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'be126fd1', total seconds elapsed: 31.3 2024-09-21T01:45:05.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:45:04 smithi142 ceph-mon[34050]: pgmap v430: 129 pgs: 129 active+clean; 4.1 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 12 KiB/s wr, 4 op/s 2024-09-21T01:45:05.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:45:04 smithi119 ceph-mon[33693]: pgmap v430: 129 pgs: 129 active+clean; 4.1 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 12 KiB/s wr, 4 op/s 2024-09-21T01:45:05.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:45:04 smithi083 ceph-mon[31370]: pgmap v430: 129 pgs: 129 active+clean; 4.1 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 12 KiB/s wr, 4 op/s 2024-09-21T01:45:08.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:45:07 smithi142 ceph-mon[34050]: pgmap v431: 129 pgs: 129 active+clean; 4.1 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-21T01:45:08.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:45:07 smithi119 ceph-mon[33693]: pgmap v431: 129 pgs: 129 active+clean; 4.1 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-21T01:45:08.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:45:07 smithi083 ceph-mon[31370]: pgmap v431: 129 pgs: 129 active+clean; 4.1 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-21T01:45:10.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:45:09 smithi142 ceph-mon[34050]: pgmap v432: 129 pgs: 129 active+clean; 4.1 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-21T01:45:10.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:45:09 smithi119 ceph-mon[33693]: pgmap v432: 129 pgs: 129 active+clean; 4.1 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-21T01:45:10.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:45:09 smithi083 ceph-mon[31370]: pgmap v432: 129 pgs: 129 active+clean; 4.1 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-21T01:45:12.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:45:11 smithi142 ceph-mon[34050]: pgmap v433: 129 pgs: 129 active+clean; 4.1 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-21T01:45:12.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:45:11 smithi119 ceph-mon[33693]: pgmap v433: 129 pgs: 129 active+clean; 4.1 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-21T01:45:12.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:45:11 smithi083 ceph-mon[31370]: pgmap v433: 129 pgs: 129 active+clean; 4.1 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-21T01:45:13.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:45:12 smithi119 ceph-mon[33693]: pgmap v434: 129 pgs: 129 active+clean; 4.1 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-21T01:45:13.225 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:45:12 smithi083 ceph-mon[31370]: pgmap v434: 129 pgs: 129 active+clean; 4.1 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-21T01:45:13.464 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:45:12 smithi142 ceph-mon[34050]: pgmap v434: 129 pgs: 129 active+clean; 4.1 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-21T01:45:16.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:45:15 smithi142 ceph-mon[34050]: pgmap v435: 129 pgs: 129 active+clean; 4.1 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 11 KiB/s wr, 16 op/s 2024-09-21T01:45:16.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:45:15 smithi119 ceph-mon[33693]: pgmap v435: 129 pgs: 129 active+clean; 4.1 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 11 KiB/s wr, 16 op/s 2024-09-21T01:45:16.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:45:15 smithi083 ceph-mon[31370]: pgmap v435: 129 pgs: 129 active+clean; 4.1 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 11 KiB/s wr, 16 op/s 2024-09-21T01:45:18.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:45:17 smithi142 ceph-mon[34050]: pgmap v436: 129 pgs: 129 active+clean; 4.1 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 11 KiB/s wr, 14 op/s 2024-09-21T01:45:18.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:45:17 smithi119 ceph-mon[33693]: pgmap v436: 129 pgs: 129 active+clean; 4.1 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 11 KiB/s wr, 14 op/s 2024-09-21T01:45:18.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:45:17 smithi083 ceph-mon[31370]: pgmap v436: 129 pgs: 129 active+clean; 4.1 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 11 KiB/s wr, 14 op/s 2024-09-21T01:45:20.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:45:19 smithi142 ceph-mon[34050]: pgmap v437: 129 pgs: 129 active+clean; 4.1 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 170 B/s wr, 1 op/s 2024-09-21T01:45:20.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:45:19 smithi119 ceph-mon[33693]: pgmap v437: 129 pgs: 129 active+clean; 4.1 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 170 B/s wr, 1 op/s 2024-09-21T01:45:20.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:45:19 smithi083 ceph-mon[31370]: pgmap v437: 129 pgs: 129 active+clean; 4.1 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 170 B/s wr, 1 op/s 2024-09-21T01:45:21.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:45:20 smithi142 ceph-mon[34050]: pgmap v438: 129 pgs: 129 active+clean; 4.1 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-21T01:45:21.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:45:20 smithi119 ceph-mon[33693]: pgmap v438: 129 pgs: 129 active+clean; 4.1 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-21T01:45:21.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:45:20 smithi083 ceph-mon[31370]: pgmap v438: 129 pgs: 129 active+clean; 4.1 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-21T01:45:24.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:45:23 smithi142 ceph-mon[34050]: pgmap v439: 129 pgs: 129 active+clean; 4.1 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 85 B/s wr, 1 op/s 2024-09-21T01:45:24.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:45:23 smithi119 ceph-mon[33693]: pgmap v439: 129 pgs: 129 active+clean; 4.1 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 85 B/s wr, 1 op/s 2024-09-21T01:45:24.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:45:23 smithi083 ceph-mon[31370]: pgmap v439: 129 pgs: 129 active+clean; 4.1 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 85 B/s wr, 1 op/s 2024-09-21T01:45:25.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:45:24 smithi119 ceph-mon[33693]: pgmap v440: 129 pgs: 129 active+clean; 4.1 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-21T01:45:25.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:45:24 smithi083 ceph-mon[31370]: pgmap v440: 129 pgs: 129 active+clean; 4.1 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-21T01:45:25.464 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:45:24 smithi142 ceph-mon[34050]: pgmap v440: 129 pgs: 129 active+clean; 4.1 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-21T01:45:28.168 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:45:27 smithi142 ceph-mon[34050]: pgmap v441: 129 pgs: 129 active+clean; 4.1 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:45:28.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:45:27 smithi119 ceph-mon[33693]: pgmap v441: 129 pgs: 129 active+clean; 4.1 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:45:28.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:45:27 smithi083 ceph-mon[31370]: pgmap v441: 129 pgs: 129 active+clean; 4.1 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:45:30.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:45:29 smithi142 ceph-mon[34050]: pgmap v442: 129 pgs: 129 active+clean; 4.1 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:45:30.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:45:29 smithi119 ceph-mon[33693]: pgmap v442: 129 pgs: 129 active+clean; 4.1 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:45:30.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:45:29 smithi083 ceph-mon[31370]: pgmap v442: 129 pgs: 129 active+clean; 4.1 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:45:31.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:45:30 smithi142 ceph-mon[34050]: pgmap v443: 129 pgs: 129 active+clean; 4.1 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T01:45:31.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:45:30 smithi119 ceph-mon[33693]: pgmap v443: 129 pgs: 129 active+clean; 4.1 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T01:45:31.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:45:30 smithi083 ceph-mon[31370]: pgmap v443: 129 pgs: 129 active+clean; 4.1 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T01:45:34.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:45:33 smithi142 ceph-mon[34050]: pgmap v444: 129 pgs: 129 active+clean; 4.1 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:45:34.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:45:33 smithi119 ceph-mon[33693]: pgmap v444: 129 pgs: 129 active+clean; 4.1 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:45:34.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:45:33 smithi083 ceph-mon[31370]: pgmap v444: 129 pgs: 129 active+clean; 4.1 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:45:35.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:45:34 smithi119 ceph-mon[33693]: pgmap v445: 129 pgs: 129 active+clean; 4.1 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T01:45:35.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:45:34 smithi083 ceph-mon[31370]: pgmap v445: 129 pgs: 129 active+clean; 4.1 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T01:45:35.464 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:45:34 smithi142 ceph-mon[34050]: pgmap v445: 129 pgs: 129 active+clean; 4.1 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T01:45:38.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:45:37 smithi142 ceph-mon[34050]: pgmap v446: 129 pgs: 129 active+clean; 5.6 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 131 KiB/s wr, 1 op/s 2024-09-21T01:45:38.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:45:37 smithi119 ceph-mon[33693]: pgmap v446: 129 pgs: 129 active+clean; 5.6 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 131 KiB/s wr, 1 op/s 2024-09-21T01:45:38.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:45:37 smithi083 ceph-mon[31370]: pgmap v446: 129 pgs: 129 active+clean; 5.6 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 131 KiB/s wr, 1 op/s 2024-09-21T01:45:39.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:45:38 smithi083 ceph-mon[31370]: pgmap v447: 129 pgs: 129 active+clean; 5.6 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 131 KiB/s wr, 1 op/s 2024-09-21T01:45:39.464 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:45:38 smithi142 ceph-mon[34050]: pgmap v447: 129 pgs: 129 active+clean; 5.6 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 131 KiB/s wr, 1 op/s 2024-09-21T01:45:39.467 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:45:38 smithi119 ceph-mon[33693]: pgmap v447: 129 pgs: 129 active+clean; 5.6 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 131 KiB/s wr, 1 op/s 2024-09-21T01:45:42.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:45:41 smithi142 ceph-mon[34050]: pgmap v448: 129 pgs: 129 active+clean; 5.6 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 131 KiB/s wr, 2 op/s 2024-09-21T01:45:42.236 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:45:41 smithi119 ceph-mon[33693]: pgmap v448: 129 pgs: 129 active+clean; 5.6 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 131 KiB/s wr, 2 op/s 2024-09-21T01:45:42.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:45:41 smithi083 ceph-mon[31370]: pgmap v448: 129 pgs: 129 active+clean; 5.6 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 131 KiB/s wr, 2 op/s 2024-09-21T01:45:43.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:45:42 smithi142 ceph-mon[34050]: pgmap v449: 129 pgs: 129 active+clean; 5.6 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 131 KiB/s wr, 1 op/s 2024-09-21T01:45:43.219 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:45:42 smithi119 ceph-mon[33693]: pgmap v449: 129 pgs: 129 active+clean; 5.6 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 131 KiB/s wr, 1 op/s 2024-09-21T01:45:43.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:45:42 smithi083 ceph-mon[31370]: pgmap v449: 129 pgs: 129 active+clean; 5.6 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 131 KiB/s wr, 1 op/s 2024-09-21T01:45:45.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:45:44 smithi119 ceph-mon[33693]: pgmap v450: 129 pgs: 129 active+clean; 5.6 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 131 KiB/s wr, 2 op/s 2024-09-21T01:45:45.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:45:44 smithi083 ceph-mon[31370]: pgmap v450: 129 pgs: 129 active+clean; 5.6 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 131 KiB/s wr, 2 op/s 2024-09-21T01:45:45.464 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:45:44 smithi142 ceph-mon[34050]: pgmap v450: 129 pgs: 129 active+clean; 5.6 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 131 KiB/s wr, 2 op/s 2024-09-21T01:45:47.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:45:46 smithi119 ceph-mon[33693]: pgmap v451: 129 pgs: 129 active+clean; 5.6 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 131 KiB/s wr, 1 op/s 2024-09-21T01:45:47.305 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:45:46 smithi083 ceph-mon[31370]: pgmap v451: 129 pgs: 129 active+clean; 5.6 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 131 KiB/s wr, 1 op/s 2024-09-21T01:45:47.464 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:45:46 smithi142 ceph-mon[34050]: pgmap v451: 129 pgs: 129 active+clean; 5.6 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 131 KiB/s wr, 1 op/s 2024-09-21T01:45:49.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:45:48 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:45:49.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:45:48 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:45:49.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:45:48 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:45:50.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:45:49 smithi142 ceph-mon[34050]: pgmap v452: 129 pgs: 129 active+clean; 5.6 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:45:50.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:45:49 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:45:50.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:45:49 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:45:50.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:45:49 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:45:50.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:45:49 smithi119 ceph-mon[33693]: pgmap v452: 129 pgs: 129 active+clean; 5.6 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:45:50.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:45:49 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:45:50.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:45:49 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:45:50.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:45:49 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:45:50.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:45:49 smithi083 ceph-mon[31370]: pgmap v452: 129 pgs: 129 active+clean; 5.6 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:45:50.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:45:49 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:45:50.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:45:49 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:45:50.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:45:49 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:45:52.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:45:51 smithi142 ceph-mon[34050]: pgmap v453: 129 pgs: 129 active+clean; 5.7 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 1.7 KiB/s wr, 2 op/s 2024-09-21T01:45:52.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:45:51 smithi119 ceph-mon[33693]: pgmap v453: 129 pgs: 129 active+clean; 5.7 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 1.7 KiB/s wr, 2 op/s 2024-09-21T01:45:52.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:45:51 smithi083 ceph-mon[31370]: pgmap v453: 129 pgs: 129 active+clean; 5.7 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 1.7 KiB/s wr, 2 op/s 2024-09-21T01:45:54.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:45:53 smithi142 ceph-mon[34050]: pgmap v454: 129 pgs: 129 active+clean; 5.7 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 1.7 KiB/s wr, 1 op/s 2024-09-21T01:45:54.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:45:53 smithi119 ceph-mon[33693]: pgmap v454: 129 pgs: 129 active+clean; 5.7 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 1.7 KiB/s wr, 1 op/s 2024-09-21T01:45:54.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:45:53 smithi083 ceph-mon[31370]: pgmap v454: 129 pgs: 129 active+clean; 5.7 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 1.7 KiB/s wr, 1 op/s 2024-09-21T01:45:56.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:45:55 smithi142 ceph-mon[34050]: pgmap v455: 129 pgs: 129 active+clean; 5.7 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 1.7 KiB/s wr, 2 op/s 2024-09-21T01:45:56.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:45:55 smithi119 ceph-mon[33693]: pgmap v455: 129 pgs: 129 active+clean; 5.7 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 1.7 KiB/s wr, 2 op/s 2024-09-21T01:45:56.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:45:55 smithi083 ceph-mon[31370]: pgmap v455: 129 pgs: 129 active+clean; 5.7 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 1.7 KiB/s wr, 2 op/s 2024-09-21T01:45:58.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:45:57 smithi142 ceph-mon[34050]: pgmap v456: 129 pgs: 129 active+clean; 5.7 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 1.7 KiB/s wr, 1 op/s 2024-09-21T01:45:58.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:45:57 smithi119 ceph-mon[33693]: pgmap v456: 129 pgs: 129 active+clean; 5.7 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 1.7 KiB/s wr, 1 op/s 2024-09-21T01:45:58.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:45:57 smithi083 ceph-mon[31370]: pgmap v456: 129 pgs: 129 active+clean; 5.7 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 1.7 KiB/s wr, 1 op/s 2024-09-21T01:46:00.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:45:59 smithi142 ceph-mon[34050]: pgmap v457: 129 pgs: 129 active+clean; 5.7 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 1.7 KiB/s wr, 1 op/s 2024-09-21T01:46:00.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:45:59 smithi119 ceph-mon[33693]: pgmap v457: 129 pgs: 129 active+clean; 5.7 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 1.7 KiB/s wr, 1 op/s 2024-09-21T01:46:00.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:45:59 smithi083 ceph-mon[31370]: pgmap v457: 129 pgs: 129 active+clean; 5.7 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 1.7 KiB/s wr, 1 op/s 2024-09-21T01:46:02.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:46:01 smithi142 ceph-mon[34050]: pgmap v458: 129 pgs: 129 active+clean; 5.7 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 1.7 KiB/s wr, 2 op/s 2024-09-21T01:46:02.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:46:01 smithi119 ceph-mon[33693]: pgmap v458: 129 pgs: 129 active+clean; 5.7 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 1.7 KiB/s wr, 2 op/s 2024-09-21T01:46:02.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:46:01 smithi083 ceph-mon[31370]: pgmap v458: 129 pgs: 129 active+clean; 5.7 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 1.7 KiB/s wr, 2 op/s 2024-09-21T01:46:04.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:46:03 smithi142 ceph-mon[34050]: pgmap v459: 129 pgs: 129 active+clean; 5.7 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 11 KiB/s wr, 3 op/s 2024-09-21T01:46:04.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:46:03 smithi119 ceph-mon[33693]: pgmap v459: 129 pgs: 129 active+clean; 5.7 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 11 KiB/s wr, 3 op/s 2024-09-21T01:46:04.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:46:03 smithi083 ceph-mon[31370]: pgmap v459: 129 pgs: 129 active+clean; 5.7 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 11 KiB/s wr, 3 op/s 2024-09-21T01:46:06.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:46:05 smithi142 ceph-mon[34050]: pgmap v460: 129 pgs: 129 active+clean; 5.7 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 13 KiB/s wr, 4 op/s 2024-09-21T01:46:06.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:46:05 smithi119 ceph-mon[33693]: pgmap v460: 129 pgs: 129 active+clean; 5.7 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 13 KiB/s wr, 4 op/s 2024-09-21T01:46:06.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:46:05 smithi083 ceph-mon[31370]: pgmap v460: 129 pgs: 129 active+clean; 5.7 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 13 KiB/s wr, 4 op/s 2024-09-21T01:46:08.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:46:07 smithi142 ceph-mon[34050]: pgmap v461: 129 pgs: 129 active+clean; 7.8 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 201 KiB/s wr, 16 op/s 2024-09-21T01:46:08.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:46:07 smithi119 ceph-mon[33693]: pgmap v461: 129 pgs: 129 active+clean; 7.8 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 201 KiB/s wr, 16 op/s 2024-09-21T01:46:08.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:46:07 smithi083 ceph-mon[31370]: pgmap v461: 129 pgs: 129 active+clean; 7.8 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 201 KiB/s wr, 16 op/s 2024-09-21T01:46:10.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:46:09 smithi142 ceph-mon[34050]: pgmap v462: 129 pgs: 129 active+clean; 7.8 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 201 KiB/s wr, 16 op/s 2024-09-21T01:46:10.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:46:09 smithi119 ceph-mon[33693]: pgmap v462: 129 pgs: 129 active+clean; 7.8 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 201 KiB/s wr, 16 op/s 2024-09-21T01:46:10.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:46:09 smithi083 ceph-mon[31370]: pgmap v462: 129 pgs: 129 active+clean; 7.8 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 201 KiB/s wr, 16 op/s 2024-09-21T01:46:12.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:46:11 smithi142 ceph-mon[34050]: pgmap v463: 129 pgs: 129 active+clean; 7.8 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 202 KiB/s wr, 17 op/s 2024-09-21T01:46:12.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:46:11 smithi119 ceph-mon[33693]: pgmap v463: 129 pgs: 129 active+clean; 7.8 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 202 KiB/s wr, 17 op/s 2024-09-21T01:46:12.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:46:11 smithi083 ceph-mon[31370]: pgmap v463: 129 pgs: 129 active+clean; 7.8 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 202 KiB/s wr, 17 op/s 2024-09-21T01:46:14.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:46:13 smithi142 ceph-mon[34050]: pgmap v464: 129 pgs: 129 active+clean; 7.8 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 202 KiB/s wr, 16 op/s 2024-09-21T01:46:14.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:46:13 smithi119 ceph-mon[33693]: pgmap v464: 129 pgs: 129 active+clean; 7.8 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 202 KiB/s wr, 16 op/s 2024-09-21T01:46:14.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:46:13 smithi083 ceph-mon[31370]: pgmap v464: 129 pgs: 129 active+clean; 7.8 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 202 KiB/s wr, 16 op/s 2024-09-21T01:46:16.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:46:15 smithi142 ceph-mon[34050]: pgmap v465: 129 pgs: 129 active+clean; 7.8 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 192 KiB/s wr, 16 op/s 2024-09-21T01:46:16.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:46:15 smithi119 ceph-mon[33693]: pgmap v465: 129 pgs: 129 active+clean; 7.8 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 192 KiB/s wr, 16 op/s 2024-09-21T01:46:16.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:46:15 smithi083 ceph-mon[31370]: pgmap v465: 129 pgs: 129 active+clean; 7.8 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 192 KiB/s wr, 16 op/s 2024-09-21T01:46:18.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:46:17 smithi142 ceph-mon[34050]: pgmap v466: 129 pgs: 129 active+clean; 7.8 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 190 KiB/s wr, 15 op/s 2024-09-21T01:46:18.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:46:17 smithi119 ceph-mon[33693]: pgmap v466: 129 pgs: 129 active+clean; 7.8 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 190 KiB/s wr, 15 op/s 2024-09-21T01:46:18.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:46:17 smithi083 ceph-mon[31370]: pgmap v466: 129 pgs: 129 active+clean; 7.8 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 190 KiB/s wr, 15 op/s 2024-09-21T01:46:19.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:46:18 smithi142 ceph-mon[34050]: pgmap v467: 129 pgs: 129 active+clean; 7.8 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 2.2 KiB/s wr, 2 op/s 2024-09-21T01:46:19.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:46:18 smithi119 ceph-mon[33693]: pgmap v467: 129 pgs: 129 active+clean; 7.8 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 2.2 KiB/s wr, 2 op/s 2024-09-21T01:46:19.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:46:18 smithi083 ceph-mon[31370]: pgmap v467: 129 pgs: 129 active+clean; 7.8 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 2.2 KiB/s wr, 2 op/s 2024-09-21T01:46:21.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:46:20 smithi083 ceph-mon[31370]: pgmap v468: 129 pgs: 129 active+clean; 7.8 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 2.2 KiB/s wr, 2 op/s 2024-09-21T01:46:21.464 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:46:20 smithi142 ceph-mon[34050]: pgmap v468: 129 pgs: 129 active+clean; 7.8 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 2.2 KiB/s wr, 2 op/s 2024-09-21T01:46:21.467 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:46:20 smithi119 ceph-mon[33693]: pgmap v468: 129 pgs: 129 active+clean; 7.8 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 2.2 KiB/s wr, 2 op/s 2024-09-21T01:46:23.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:46:22 smithi083 ceph-mon[31370]: pgmap v469: 129 pgs: 129 active+clean; 7.8 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 1.7 KiB/s wr, 1 op/s 2024-09-21T01:46:23.465 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:46:22 smithi142 ceph-mon[34050]: pgmap v469: 129 pgs: 129 active+clean; 7.8 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 1.7 KiB/s wr, 1 op/s 2024-09-21T01:46:23.468 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:46:22 smithi119 ceph-mon[33693]: pgmap v469: 129 pgs: 129 active+clean; 7.8 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 1.7 KiB/s wr, 1 op/s 2024-09-21T01:46:25.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:46:24 smithi083 ceph-mon[31370]: pgmap v470: 129 pgs: 129 active+clean; 7.8 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 1.7 KiB/s wr, 2 op/s 2024-09-21T01:46:25.464 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:46:24 smithi142 ceph-mon[34050]: pgmap v470: 129 pgs: 129 active+clean; 7.8 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 1.7 KiB/s wr, 2 op/s 2024-09-21T01:46:25.467 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:46:24 smithi119 ceph-mon[33693]: pgmap v470: 129 pgs: 129 active+clean; 7.8 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 1.7 KiB/s wr, 2 op/s 2024-09-21T01:46:27.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:46:26 smithi083 ceph-mon[31370]: pgmap v471: 129 pgs: 129 active+clean; 7.8 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:46:27.464 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:46:26 smithi142 ceph-mon[34050]: pgmap v471: 129 pgs: 129 active+clean; 7.8 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:46:27.467 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:46:26 smithi119 ceph-mon[33693]: pgmap v471: 129 pgs: 129 active+clean; 7.8 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:46:29.267 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:46:28 smithi142 ceph-mon[34050]: pgmap v472: 129 pgs: 129 active+clean; 7.8 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:46:29.270 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:46:28 smithi119 ceph-mon[33693]: pgmap v472: 129 pgs: 129 active+clean; 7.8 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:46:29.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:46:28 smithi083 ceph-mon[31370]: pgmap v472: 129 pgs: 129 active+clean; 7.8 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:46:30.001 INFO:tasks.workunit.client.0.smithi083.stdout:writing pattern 2024-09-21T01:46:30.001 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 0 offset 4190208 len 1024 2024-09-21T01:46:30.001 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 0 offset 4190208 len 1024 2024-09-21T01:46:30.001 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 0 offset 4190208 len 1024 2024-09-21T01:46:30.001 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 0 offset 4190208 len 1024 2024-09-21T01:46:30.002 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 0 offset 4190208 len 2048 2024-09-21T01:46:30.002 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 0 offset 4190208 len 2048 2024-09-21T01:46:30.002 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 0 offset 4190208 len 2048 2024-09-21T01:46:30.002 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 0 offset 4190208 len 2048 2024-09-21T01:46:30.002 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 0 offset 4190208 len 4096 2024-09-21T01:46:30.002 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 0 offset 4190208 len 4096 2024-09-21T01:46:30.002 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 0 offset 4190208 len 4096 2024-09-21T01:46:30.002 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 0 offset 4190208 len 4096 2024-09-21T01:46:30.002 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 0 offset 4190208 len 8192 2024-09-21T01:46:30.002 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 0 offset 4190208 len 8192 2024-09-21T01:46:30.002 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 0 offset 4190208 len 8192 2024-09-21T01:46:30.002 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 0 offset 4190208 len 8192 2024-09-21T01:46:30.002 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 0 offset 4190208 len 16384 2024-09-21T01:46:30.002 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 0 offset 4190208 len 16384 2024-09-21T01:46:30.002 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 0 offset 4190208 len 16384 2024-09-21T01:46:30.003 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 0 offset 4190208 len 16384 2024-09-21T01:46:30.003 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 0 offset 4190720 len 1024 2024-09-21T01:46:30.003 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 0 offset 4190720 len 1024 2024-09-21T01:46:30.003 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 0 offset 4190720 len 1024 2024-09-21T01:46:30.003 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 0 offset 4190720 len 1024 2024-09-21T01:46:30.003 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 0 offset 4190720 len 2048 2024-09-21T01:46:30.003 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 0 offset 4190720 len 2048 2024-09-21T01:46:30.003 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 0 offset 4190720 len 2048 2024-09-21T01:46:30.003 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 0 offset 4190720 len 2048 2024-09-21T01:46:30.003 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 0 offset 4190720 len 4096 2024-09-21T01:46:30.003 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 0 offset 4190720 len 4096 2024-09-21T01:46:30.003 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 0 offset 4190720 len 4096 2024-09-21T01:46:30.003 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 0 offset 4190720 len 4096 2024-09-21T01:46:30.003 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 0 offset 4190720 len 8192 2024-09-21T01:46:30.003 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 0 offset 4190720 len 8192 2024-09-21T01:46:30.004 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 0 offset 4190720 len 8192 2024-09-21T01:46:30.004 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 0 offset 4190720 len 8192 2024-09-21T01:46:30.004 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 0 offset 4190720 len 16384 2024-09-21T01:46:30.004 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 0 offset 4190720 len 16384 2024-09-21T01:46:30.004 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 0 offset 4190720 len 16384 2024-09-21T01:46:30.004 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 0 offset 4190720 len 16384 2024-09-21T01:46:30.004 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 0 offset 4191232 len 1024 2024-09-21T01:46:30.004 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 0 offset 4191232 len 1024 2024-09-21T01:46:30.004 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 0 offset 4191232 len 1024 2024-09-21T01:46:30.004 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 0 offset 4191232 len 1024 2024-09-21T01:46:30.004 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 0 offset 4191232 len 2048 2024-09-21T01:46:30.004 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 0 offset 4191232 len 2048 2024-09-21T01:46:30.004 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 0 offset 4191232 len 2048 2024-09-21T01:46:30.004 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 0 offset 4191232 len 2048 2024-09-21T01:46:30.005 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 0 offset 4191232 len 4096 2024-09-21T01:46:30.005 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 0 offset 4191232 len 4096 2024-09-21T01:46:30.005 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 0 offset 4191232 len 4096 2024-09-21T01:46:30.005 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 0 offset 4191232 len 4096 2024-09-21T01:46:30.005 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 0 offset 4191232 len 8192 2024-09-21T01:46:30.005 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 0 offset 4191232 len 8192 2024-09-21T01:46:30.005 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 0 offset 4191232 len 8192 2024-09-21T01:46:30.005 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 0 offset 4191232 len 8192 2024-09-21T01:46:30.005 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 0 offset 4191232 len 16384 2024-09-21T01:46:30.005 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 0 offset 4191232 len 16384 2024-09-21T01:46:30.005 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 0 offset 4191232 len 16384 2024-09-21T01:46:30.005 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 0 offset 4191232 len 16384 2024-09-21T01:46:30.005 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 0 offset 4191744 len 1024 2024-09-21T01:46:30.005 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 0 offset 4191744 len 1024 2024-09-21T01:46:30.005 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 0 offset 4191744 len 1024 2024-09-21T01:46:30.006 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 0 offset 4191744 len 1024 2024-09-21T01:46:30.006 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 0 offset 4191744 len 2048 2024-09-21T01:46:30.006 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 0 offset 4191744 len 2048 2024-09-21T01:46:30.006 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 0 offset 4191744 len 2048 2024-09-21T01:46:30.006 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 0 offset 4191744 len 2048 2024-09-21T01:46:30.006 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 0 offset 4191744 len 4096 2024-09-21T01:46:30.006 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 0 offset 4191744 len 4096 2024-09-21T01:46:30.006 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 0 offset 4191744 len 4096 2024-09-21T01:46:30.006 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 0 offset 4191744 len 4096 2024-09-21T01:46:30.006 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 0 offset 4191744 len 8192 2024-09-21T01:46:30.006 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 0 offset 4191744 len 8192 2024-09-21T01:46:30.006 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 0 offset 4191744 len 8192 2024-09-21T01:46:30.006 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 0 offset 4191744 len 8192 2024-09-21T01:46:30.006 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 0 offset 4191744 len 16384 2024-09-21T01:46:30.007 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 0 offset 4191744 len 16384 2024-09-21T01:46:30.007 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 0 offset 4191744 len 16384 2024-09-21T01:46:30.007 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 0 offset 4191744 len 16384 2024-09-21T01:46:30.007 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 0 offset 4192256 len 1024 2024-09-21T01:46:30.007 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 0 offset 4192256 len 1024 2024-09-21T01:46:30.007 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 0 offset 4192256 len 1024 2024-09-21T01:46:30.007 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 0 offset 4192256 len 1024 2024-09-21T01:46:30.007 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 0 offset 4192256 len 2048 2024-09-21T01:46:30.007 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 0 offset 4192256 len 2048 2024-09-21T01:46:30.007 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 0 offset 4192256 len 2048 2024-09-21T01:46:30.032 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 0 offset 4192256 len 2048 2024-09-21T01:46:30.033 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 0 offset 4192256 len 4096 2024-09-21T01:46:30.033 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 0 offset 4192256 len 4096 2024-09-21T01:46:30.033 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 0 offset 4192256 len 4096 2024-09-21T01:46:30.033 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 0 offset 4192256 len 4096 2024-09-21T01:46:30.033 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 0 offset 4192256 len 8192 2024-09-21T01:46:30.033 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 0 offset 4192256 len 8192 2024-09-21T01:46:30.033 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 0 offset 4192256 len 8192 2024-09-21T01:46:30.033 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 0 offset 4192256 len 8192 2024-09-21T01:46:30.033 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 0 offset 4192256 len 16384 2024-09-21T01:46:30.033 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 0 offset 4192256 len 16384 2024-09-21T01:46:30.033 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 0 offset 4192256 len 16384 2024-09-21T01:46:30.034 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 0 offset 4192256 len 16384 2024-09-21T01:46:30.034 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 0 offset 4192768 len 1024 2024-09-21T01:46:30.034 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 0 offset 4192768 len 1024 2024-09-21T01:46:30.034 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 0 offset 4192768 len 1024 2024-09-21T01:46:30.034 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 0 offset 4192768 len 1024 2024-09-21T01:46:30.034 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 0 offset 4192768 len 2048 2024-09-21T01:46:30.034 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 0 offset 4192768 len 2048 2024-09-21T01:46:30.034 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 0 offset 4192768 len 2048 2024-09-21T01:46:30.034 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 0 offset 4192768 len 2048 2024-09-21T01:46:30.034 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 0 offset 4192768 len 4096 2024-09-21T01:46:30.034 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 0 offset 4192768 len 4096 2024-09-21T01:46:30.034 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 0 offset 4192768 len 4096 2024-09-21T01:46:30.034 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 0 offset 4192768 len 4096 2024-09-21T01:46:30.034 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 0 offset 4192768 len 8192 2024-09-21T01:46:30.034 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 0 offset 4192768 len 8192 2024-09-21T01:46:30.035 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 0 offset 4192768 len 8192 2024-09-21T01:46:30.035 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 0 offset 4192768 len 8192 2024-09-21T01:46:30.035 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 0 offset 4192768 len 16384 2024-09-21T01:46:30.035 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 0 offset 4192768 len 16384 2024-09-21T01:46:30.035 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 0 offset 4192768 len 16384 2024-09-21T01:46:30.035 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 0 offset 4192768 len 16384 2024-09-21T01:46:30.035 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 0 offset 4193280 len 1024 2024-09-21T01:46:30.035 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 0 offset 4193280 len 1024 2024-09-21T01:46:30.035 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 0 offset 4193280 len 1024 2024-09-21T01:46:30.035 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 0 offset 4193280 len 1024 2024-09-21T01:46:30.035 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 0 offset 4193280 len 2048 2024-09-21T01:46:30.035 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 0 offset 4193280 len 2048 2024-09-21T01:46:30.035 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 0 offset 4193280 len 2048 2024-09-21T01:46:30.035 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 0 offset 4193280 len 2048 2024-09-21T01:46:30.035 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 0 offset 4193280 len 4096 2024-09-21T01:46:30.036 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 0 offset 4193280 len 4096 2024-09-21T01:46:30.036 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 0 offset 4193280 len 4096 2024-09-21T01:46:30.036 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 0 offset 4193280 len 4096 2024-09-21T01:46:30.036 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 0 offset 4193280 len 8192 2024-09-21T01:46:30.036 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 0 offset 4193280 len 8192 2024-09-21T01:46:30.036 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 0 offset 4193280 len 8192 2024-09-21T01:46:30.036 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 0 offset 4193280 len 8192 2024-09-21T01:46:30.036 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 0 offset 4193280 len 16384 2024-09-21T01:46:30.036 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 0 offset 4193280 len 16384 2024-09-21T01:46:30.036 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 0 offset 4193280 len 16384 2024-09-21T01:46:30.036 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 0 offset 4193280 len 16384 2024-09-21T01:46:30.036 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 0 offset 4193792 len 1024 2024-09-21T01:46:30.036 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 0 offset 4193792 len 1024 2024-09-21T01:46:30.036 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 0 offset 4193792 len 1024 2024-09-21T01:46:30.036 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 0 offset 4193792 len 1024 2024-09-21T01:46:30.037 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 0 offset 4193792 len 2048 2024-09-21T01:46:30.037 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 0 offset 4193792 len 2048 2024-09-21T01:46:30.037 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 0 offset 4193792 len 2048 2024-09-21T01:46:30.037 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 0 offset 4193792 len 2048 2024-09-21T01:46:30.037 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 0 offset 4193792 len 4096 2024-09-21T01:46:30.037 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 0 offset 4193792 len 4096 2024-09-21T01:46:30.037 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 0 offset 4193792 len 4096 2024-09-21T01:46:30.037 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 0 offset 4193792 len 4096 2024-09-21T01:46:30.037 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 0 offset 4193792 len 8192 2024-09-21T01:46:30.037 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 0 offset 4193792 len 8192 2024-09-21T01:46:30.037 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 0 offset 4193792 len 8192 2024-09-21T01:46:30.037 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 0 offset 4193792 len 8192 2024-09-21T01:46:30.037 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 0 offset 4193792 len 16384 2024-09-21T01:46:30.037 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 0 offset 4193792 len 16384 2024-09-21T01:46:30.038 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 0 offset 4193792 len 16384 2024-09-21T01:46:30.038 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 0 offset 4193792 len 16384 2024-09-21T01:46:30.038 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 0 offset 4194304 len 1024 2024-09-21T01:46:30.038 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 0 offset 4194304 len 1024 2024-09-21T01:46:30.038 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 0 offset 4194304 len 1024 2024-09-21T01:46:30.038 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 0 offset 4194304 len 1024 2024-09-21T01:46:30.038 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 0 offset 4194304 len 2048 2024-09-21T01:46:30.038 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 0 offset 4194304 len 2048 2024-09-21T01:46:30.038 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 0 offset 4194304 len 2048 2024-09-21T01:46:30.038 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 0 offset 4194304 len 2048 2024-09-21T01:46:30.038 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 0 offset 4194304 len 4096 2024-09-21T01:46:30.038 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 0 offset 4194304 len 4096 2024-09-21T01:46:30.038 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 0 offset 4194304 len 4096 2024-09-21T01:46:30.038 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 0 offset 4194304 len 4096 2024-09-21T01:46:30.039 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 0 offset 4194304 len 8192 2024-09-21T01:46:30.039 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 0 offset 4194304 len 8192 2024-09-21T01:46:30.039 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 0 offset 4194304 len 8192 2024-09-21T01:46:30.063 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 0 offset 4194304 len 8192 2024-09-21T01:46:30.063 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 0 offset 4194304 len 16384 2024-09-21T01:46:30.063 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 0 offset 4194304 len 16384 2024-09-21T01:46:30.063 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 0 offset 4194304 len 16384 2024-09-21T01:46:30.063 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 0 offset 4194304 len 16384 2024-09-21T01:46:30.064 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 0 offset 4194816 len 1024 2024-09-21T01:46:30.064 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 0 offset 4194816 len 1024 2024-09-21T01:46:30.064 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 0 offset 4194816 len 1024 2024-09-21T01:46:30.064 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 0 offset 4194816 len 1024 2024-09-21T01:46:30.064 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 0 offset 4194816 len 2048 2024-09-21T01:46:30.064 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 0 offset 4194816 len 2048 2024-09-21T01:46:30.064 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 0 offset 4194816 len 2048 2024-09-21T01:46:30.064 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 0 offset 4194816 len 2048 2024-09-21T01:46:30.064 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 0 offset 4194816 len 4096 2024-09-21T01:46:30.064 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 0 offset 4194816 len 4096 2024-09-21T01:46:30.064 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 0 offset 4194816 len 4096 2024-09-21T01:46:30.064 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 0 offset 4194816 len 4096 2024-09-21T01:46:30.064 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 0 offset 4194816 len 8192 2024-09-21T01:46:30.064 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 0 offset 4194816 len 8192 2024-09-21T01:46:30.065 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 0 offset 4194816 len 8192 2024-09-21T01:46:30.065 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 0 offset 4194816 len 8192 2024-09-21T01:46:30.065 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 0 offset 4194816 len 16384 2024-09-21T01:46:30.065 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 0 offset 4194816 len 16384 2024-09-21T01:46:30.065 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 0 offset 4194816 len 16384 2024-09-21T01:46:30.065 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 0 offset 4194816 len 16384 2024-09-21T01:46:30.065 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 0 offset 4195328 len 1024 2024-09-21T01:46:30.065 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 0 offset 4195328 len 1024 2024-09-21T01:46:30.065 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 0 offset 4195328 len 1024 2024-09-21T01:46:30.065 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 0 offset 4195328 len 1024 2024-09-21T01:46:30.065 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 0 offset 4195328 len 2048 2024-09-21T01:46:30.065 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 0 offset 4195328 len 2048 2024-09-21T01:46:30.065 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 0 offset 4195328 len 2048 2024-09-21T01:46:30.066 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 0 offset 4195328 len 2048 2024-09-21T01:46:30.066 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 0 offset 4195328 len 4096 2024-09-21T01:46:30.066 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 0 offset 4195328 len 4096 2024-09-21T01:46:30.066 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 0 offset 4195328 len 4096 2024-09-21T01:46:30.066 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 0 offset 4195328 len 4096 2024-09-21T01:46:30.066 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 0 offset 4195328 len 8192 2024-09-21T01:46:30.066 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 0 offset 4195328 len 8192 2024-09-21T01:46:30.066 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 0 offset 4195328 len 8192 2024-09-21T01:46:30.066 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 0 offset 4195328 len 8192 2024-09-21T01:46:30.066 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 0 offset 4195328 len 16384 2024-09-21T01:46:30.066 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 0 offset 4195328 len 16384 2024-09-21T01:46:30.066 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 0 offset 4195328 len 16384 2024-09-21T01:46:30.066 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 0 offset 4195328 len 16384 2024-09-21T01:46:30.066 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 0 offset 4195840 len 1024 2024-09-21T01:46:30.067 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 0 offset 4195840 len 1024 2024-09-21T01:46:30.067 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 0 offset 4195840 len 1024 2024-09-21T01:46:30.067 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 0 offset 4195840 len 1024 2024-09-21T01:46:30.067 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 0 offset 4195840 len 2048 2024-09-21T01:46:30.067 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 0 offset 4195840 len 2048 2024-09-21T01:46:30.067 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 0 offset 4195840 len 2048 2024-09-21T01:46:30.067 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 0 offset 4195840 len 2048 2024-09-21T01:46:30.067 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 0 offset 4195840 len 4096 2024-09-21T01:46:30.067 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 0 offset 4195840 len 4096 2024-09-21T01:46:30.067 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 0 offset 4195840 len 4096 2024-09-21T01:46:30.067 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 0 offset 4195840 len 4096 2024-09-21T01:46:30.067 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 0 offset 4195840 len 8192 2024-09-21T01:46:30.067 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 0 offset 4195840 len 8192 2024-09-21T01:46:30.067 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 0 offset 4195840 len 8192 2024-09-21T01:46:30.068 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 0 offset 4195840 len 8192 2024-09-21T01:46:30.068 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 0 offset 4195840 len 16384 2024-09-21T01:46:30.068 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 0 offset 4195840 len 16384 2024-09-21T01:46:30.068 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 0 offset 4195840 len 16384 2024-09-21T01:46:30.068 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 0 offset 4195840 len 16384 2024-09-21T01:46:30.068 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 0 offset 4196352 len 1024 2024-09-21T01:46:30.068 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 0 offset 4196352 len 1024 2024-09-21T01:46:30.068 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 0 offset 4196352 len 1024 2024-09-21T01:46:30.068 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 0 offset 4196352 len 1024 2024-09-21T01:46:30.068 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 0 offset 4196352 len 2048 2024-09-21T01:46:30.068 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 0 offset 4196352 len 2048 2024-09-21T01:46:30.068 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 0 offset 4196352 len 2048 2024-09-21T01:46:30.068 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 0 offset 4196352 len 2048 2024-09-21T01:46:30.068 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 0 offset 4196352 len 4096 2024-09-21T01:46:30.068 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 0 offset 4196352 len 4096 2024-09-21T01:46:30.069 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 0 offset 4196352 len 4096 2024-09-21T01:46:30.069 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 0 offset 4196352 len 4096 2024-09-21T01:46:30.069 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 0 offset 4196352 len 8192 2024-09-21T01:46:30.069 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 0 offset 4196352 len 8192 2024-09-21T01:46:30.069 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 0 offset 4196352 len 8192 2024-09-21T01:46:30.069 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 0 offset 4196352 len 8192 2024-09-21T01:46:30.069 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 0 offset 4196352 len 16384 2024-09-21T01:46:30.069 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 0 offset 4196352 len 16384 2024-09-21T01:46:30.069 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 0 offset 4196352 len 16384 2024-09-21T01:46:30.069 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 0 offset 4196352 len 16384 2024-09-21T01:46:30.069 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 0 offset 4196864 len 1024 2024-09-21T01:46:30.069 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 0 offset 4196864 len 1024 2024-09-21T01:46:30.092 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 0 offset 4196864 len 1024 2024-09-21T01:46:30.092 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 0 offset 4196864 len 1024 2024-09-21T01:46:30.092 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 0 offset 4196864 len 2048 2024-09-21T01:46:30.092 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 0 offset 4196864 len 2048 2024-09-21T01:46:30.092 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 0 offset 4196864 len 2048 2024-09-21T01:46:30.093 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 0 offset 4196864 len 2048 2024-09-21T01:46:30.093 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 0 offset 4196864 len 4096 2024-09-21T01:46:30.093 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 0 offset 4196864 len 4096 2024-09-21T01:46:30.093 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 0 offset 4196864 len 4096 2024-09-21T01:46:30.093 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 0 offset 4196864 len 4096 2024-09-21T01:46:30.093 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 0 offset 4196864 len 8192 2024-09-21T01:46:30.093 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 0 offset 4196864 len 8192 2024-09-21T01:46:30.093 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 0 offset 4196864 len 8192 2024-09-21T01:46:30.093 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 0 offset 4196864 len 8192 2024-09-21T01:46:30.093 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 0 offset 4196864 len 16384 2024-09-21T01:46:30.093 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 0 offset 4196864 len 16384 2024-09-21T01:46:30.093 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 0 offset 4196864 len 16384 2024-09-21T01:46:30.093 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 0 offset 4196864 len 16384 2024-09-21T01:46:30.094 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 0 offset 4197376 len 1024 2024-09-21T01:46:30.094 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 0 offset 4197376 len 1024 2024-09-21T01:46:30.094 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 0 offset 4197376 len 1024 2024-09-21T01:46:30.094 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 0 offset 4197376 len 1024 2024-09-21T01:46:30.094 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 0 offset 4197376 len 2048 2024-09-21T01:46:30.094 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 0 offset 4197376 len 2048 2024-09-21T01:46:30.094 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 0 offset 4197376 len 2048 2024-09-21T01:46:30.094 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 0 offset 4197376 len 2048 2024-09-21T01:46:30.094 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 0 offset 4197376 len 4096 2024-09-21T01:46:30.094 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 0 offset 4197376 len 4096 2024-09-21T01:46:30.094 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 0 offset 4197376 len 4096 2024-09-21T01:46:30.094 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 0 offset 4197376 len 4096 2024-09-21T01:46:30.094 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 0 offset 4197376 len 8192 2024-09-21T01:46:30.094 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 0 offset 4197376 len 8192 2024-09-21T01:46:30.095 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 0 offset 4197376 len 8192 2024-09-21T01:46:30.095 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 0 offset 4197376 len 8192 2024-09-21T01:46:30.095 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 0 offset 4197376 len 16384 2024-09-21T01:46:30.095 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 0 offset 4197376 len 16384 2024-09-21T01:46:30.095 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 0 offset 4197376 len 16384 2024-09-21T01:46:30.095 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 0 offset 4197376 len 16384 2024-09-21T01:46:30.095 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 0 offset 4197888 len 1024 2024-09-21T01:46:30.095 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 0 offset 4197888 len 1024 2024-09-21T01:46:30.095 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 0 offset 4197888 len 1024 2024-09-21T01:46:30.095 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 0 offset 4197888 len 1024 2024-09-21T01:46:30.095 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 0 offset 4197888 len 2048 2024-09-21T01:46:30.095 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 0 offset 4197888 len 2048 2024-09-21T01:46:30.095 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 0 offset 4197888 len 2048 2024-09-21T01:46:30.095 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 0 offset 4197888 len 2048 2024-09-21T01:46:30.096 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 0 offset 4197888 len 4096 2024-09-21T01:46:30.096 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 0 offset 4197888 len 4096 2024-09-21T01:46:30.096 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 0 offset 4197888 len 4096 2024-09-21T01:46:30.096 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 0 offset 4197888 len 4096 2024-09-21T01:46:30.096 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 0 offset 4197888 len 8192 2024-09-21T01:46:30.096 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 0 offset 4197888 len 8192 2024-09-21T01:46:30.096 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 0 offset 4197888 len 8192 2024-09-21T01:46:30.096 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 0 offset 4197888 len 8192 2024-09-21T01:46:30.096 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 0 offset 4197888 len 16384 2024-09-21T01:46:30.096 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 0 offset 4197888 len 16384 2024-09-21T01:46:30.096 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 0 offset 4197888 len 16384 2024-09-21T01:46:30.096 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 0 offset 4197888 len 16384 2024-09-21T01:46:30.096 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 512 offset 4190208 len 1024 2024-09-21T01:46:30.096 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 512 offset 4190208 len 1024 2024-09-21T01:46:30.097 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 512 offset 4190208 len 1024 2024-09-21T01:46:30.097 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 512 offset 4190208 len 1024 2024-09-21T01:46:30.097 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 512 offset 4190208 len 2048 2024-09-21T01:46:30.097 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 512 offset 4190208 len 2048 2024-09-21T01:46:30.097 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 512 offset 4190208 len 2048 2024-09-21T01:46:30.097 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 512 offset 4190208 len 2048 2024-09-21T01:46:30.097 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 512 offset 4190208 len 4096 2024-09-21T01:46:30.097 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 512 offset 4190208 len 4096 2024-09-21T01:46:30.097 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 512 offset 4190208 len 4096 2024-09-21T01:46:30.097 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 512 offset 4190208 len 4096 2024-09-21T01:46:30.097 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 512 offset 4190208 len 8192 2024-09-21T01:46:30.097 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 512 offset 4190208 len 8192 2024-09-21T01:46:30.097 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 512 offset 4190208 len 8192 2024-09-21T01:46:30.097 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 512 offset 4190208 len 8192 2024-09-21T01:46:30.098 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 512 offset 4190208 len 16384 2024-09-21T01:46:30.098 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 512 offset 4190208 len 16384 2024-09-21T01:46:30.098 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 512 offset 4190208 len 16384 2024-09-21T01:46:30.098 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 512 offset 4190208 len 16384 2024-09-21T01:46:30.098 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 512 offset 4190720 len 1024 2024-09-21T01:46:30.098 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 512 offset 4190720 len 1024 2024-09-21T01:46:30.098 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 512 offset 4190720 len 1024 2024-09-21T01:46:30.098 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 512 offset 4190720 len 1024 2024-09-21T01:46:30.098 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 512 offset 4190720 len 2048 2024-09-21T01:46:30.098 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 512 offset 4190720 len 2048 2024-09-21T01:46:30.098 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 512 offset 4190720 len 2048 2024-09-21T01:46:30.098 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 512 offset 4190720 len 2048 2024-09-21T01:46:30.098 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 512 offset 4190720 len 4096 2024-09-21T01:46:30.122 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 512 offset 4190720 len 4096 2024-09-21T01:46:30.122 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 512 offset 4190720 len 4096 2024-09-21T01:46:30.122 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 512 offset 4190720 len 4096 2024-09-21T01:46:30.122 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 512 offset 4190720 len 8192 2024-09-21T01:46:30.122 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 512 offset 4190720 len 8192 2024-09-21T01:46:30.122 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 512 offset 4190720 len 8192 2024-09-21T01:46:30.122 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 512 offset 4190720 len 8192 2024-09-21T01:46:30.122 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 512 offset 4190720 len 16384 2024-09-21T01:46:30.122 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 512 offset 4190720 len 16384 2024-09-21T01:46:30.122 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 512 offset 4190720 len 16384 2024-09-21T01:46:30.122 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 512 offset 4190720 len 16384 2024-09-21T01:46:30.122 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 512 offset 4191232 len 1024 2024-09-21T01:46:30.122 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 512 offset 4191232 len 1024 2024-09-21T01:46:30.122 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 512 offset 4191232 len 1024 2024-09-21T01:46:30.123 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 512 offset 4191232 len 1024 2024-09-21T01:46:30.123 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 512 offset 4191232 len 2048 2024-09-21T01:46:30.123 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 512 offset 4191232 len 2048 2024-09-21T01:46:30.123 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 512 offset 4191232 len 2048 2024-09-21T01:46:30.123 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 512 offset 4191232 len 2048 2024-09-21T01:46:30.123 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 512 offset 4191232 len 4096 2024-09-21T01:46:30.123 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 512 offset 4191232 len 4096 2024-09-21T01:46:30.123 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 512 offset 4191232 len 4096 2024-09-21T01:46:30.123 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 512 offset 4191232 len 4096 2024-09-21T01:46:30.123 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 512 offset 4191232 len 8192 2024-09-21T01:46:30.123 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 512 offset 4191232 len 8192 2024-09-21T01:46:30.123 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 512 offset 4191232 len 8192 2024-09-21T01:46:30.123 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 512 offset 4191232 len 8192 2024-09-21T01:46:30.124 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 512 offset 4191232 len 16384 2024-09-21T01:46:30.124 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 512 offset 4191232 len 16384 2024-09-21T01:46:30.124 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 512 offset 4191232 len 16384 2024-09-21T01:46:30.124 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 512 offset 4191232 len 16384 2024-09-21T01:46:30.124 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 512 offset 4191744 len 1024 2024-09-21T01:46:30.124 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 512 offset 4191744 len 1024 2024-09-21T01:46:30.124 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 512 offset 4191744 len 1024 2024-09-21T01:46:30.124 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 512 offset 4191744 len 1024 2024-09-21T01:46:30.124 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 512 offset 4191744 len 2048 2024-09-21T01:46:30.124 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 512 offset 4191744 len 2048 2024-09-21T01:46:30.124 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 512 offset 4191744 len 2048 2024-09-21T01:46:30.124 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 512 offset 4191744 len 2048 2024-09-21T01:46:30.124 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 512 offset 4191744 len 4096 2024-09-21T01:46:30.124 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 512 offset 4191744 len 4096 2024-09-21T01:46:30.124 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 512 offset 4191744 len 4096 2024-09-21T01:46:30.124 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 512 offset 4191744 len 4096 2024-09-21T01:46:30.125 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 512 offset 4191744 len 8192 2024-09-21T01:46:30.125 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 512 offset 4191744 len 8192 2024-09-21T01:46:30.125 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 512 offset 4191744 len 8192 2024-09-21T01:46:30.125 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 512 offset 4191744 len 8192 2024-09-21T01:46:30.125 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 512 offset 4191744 len 16384 2024-09-21T01:46:30.125 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 512 offset 4191744 len 16384 2024-09-21T01:46:30.125 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 512 offset 4191744 len 16384 2024-09-21T01:46:30.125 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 512 offset 4191744 len 16384 2024-09-21T01:46:30.125 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 512 offset 4192256 len 1024 2024-09-21T01:46:30.125 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 512 offset 4192256 len 1024 2024-09-21T01:46:30.125 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 512 offset 4192256 len 1024 2024-09-21T01:46:30.125 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 512 offset 4192256 len 1024 2024-09-21T01:46:30.125 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 512 offset 4192256 len 2048 2024-09-21T01:46:30.125 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 512 offset 4192256 len 2048 2024-09-21T01:46:30.126 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 512 offset 4192256 len 2048 2024-09-21T01:46:30.126 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 512 offset 4192256 len 2048 2024-09-21T01:46:30.126 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 512 offset 4192256 len 4096 2024-09-21T01:46:30.126 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 512 offset 4192256 len 4096 2024-09-21T01:46:30.126 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 512 offset 4192256 len 4096 2024-09-21T01:46:30.126 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 512 offset 4192256 len 4096 2024-09-21T01:46:30.126 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 512 offset 4192256 len 8192 2024-09-21T01:46:30.126 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 512 offset 4192256 len 8192 2024-09-21T01:46:30.126 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 512 offset 4192256 len 8192 2024-09-21T01:46:30.126 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 512 offset 4192256 len 8192 2024-09-21T01:46:30.126 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 512 offset 4192256 len 16384 2024-09-21T01:46:30.126 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 512 offset 4192256 len 16384 2024-09-21T01:46:30.126 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 512 offset 4192256 len 16384 2024-09-21T01:46:30.126 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 512 offset 4192256 len 16384 2024-09-21T01:46:30.127 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 512 offset 4192768 len 1024 2024-09-21T01:46:30.127 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 512 offset 4192768 len 1024 2024-09-21T01:46:30.127 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 512 offset 4192768 len 1024 2024-09-21T01:46:30.127 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 512 offset 4192768 len 1024 2024-09-21T01:46:30.127 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 512 offset 4192768 len 2048 2024-09-21T01:46:30.127 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 512 offset 4192768 len 2048 2024-09-21T01:46:30.127 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 512 offset 4192768 len 2048 2024-09-21T01:46:30.127 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 512 offset 4192768 len 2048 2024-09-21T01:46:30.127 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 512 offset 4192768 len 4096 2024-09-21T01:46:30.127 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 512 offset 4192768 len 4096 2024-09-21T01:46:30.127 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 512 offset 4192768 len 4096 2024-09-21T01:46:30.128 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 512 offset 4192768 len 4096 2024-09-21T01:46:30.128 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 512 offset 4192768 len 8192 2024-09-21T01:46:30.149 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 512 offset 4192768 len 8192 2024-09-21T01:46:30.150 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 512 offset 4192768 len 8192 2024-09-21T01:46:30.150 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 512 offset 4192768 len 8192 2024-09-21T01:46:30.150 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 512 offset 4192768 len 16384 2024-09-21T01:46:30.150 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 512 offset 4192768 len 16384 2024-09-21T01:46:30.150 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 512 offset 4192768 len 16384 2024-09-21T01:46:30.150 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 512 offset 4192768 len 16384 2024-09-21T01:46:30.150 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 512 offset 4193280 len 1024 2024-09-21T01:46:30.150 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 512 offset 4193280 len 1024 2024-09-21T01:46:30.150 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 512 offset 4193280 len 1024 2024-09-21T01:46:30.150 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 512 offset 4193280 len 1024 2024-09-21T01:46:30.150 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 512 offset 4193280 len 2048 2024-09-21T01:46:30.150 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 512 offset 4193280 len 2048 2024-09-21T01:46:30.151 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 512 offset 4193280 len 2048 2024-09-21T01:46:30.151 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 512 offset 4193280 len 2048 2024-09-21T01:46:30.151 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 512 offset 4193280 len 4096 2024-09-21T01:46:30.151 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 512 offset 4193280 len 4096 2024-09-21T01:46:30.151 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 512 offset 4193280 len 4096 2024-09-21T01:46:30.151 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 512 offset 4193280 len 4096 2024-09-21T01:46:30.151 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 512 offset 4193280 len 8192 2024-09-21T01:46:30.151 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 512 offset 4193280 len 8192 2024-09-21T01:46:30.151 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 512 offset 4193280 len 8192 2024-09-21T01:46:30.151 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 512 offset 4193280 len 8192 2024-09-21T01:46:30.151 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 512 offset 4193280 len 16384 2024-09-21T01:46:30.151 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 512 offset 4193280 len 16384 2024-09-21T01:46:30.151 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 512 offset 4193280 len 16384 2024-09-21T01:46:30.151 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 512 offset 4193280 len 16384 2024-09-21T01:46:30.151 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 512 offset 4193792 len 1024 2024-09-21T01:46:30.152 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 512 offset 4193792 len 1024 2024-09-21T01:46:30.152 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 512 offset 4193792 len 1024 2024-09-21T01:46:30.152 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 512 offset 4193792 len 1024 2024-09-21T01:46:30.152 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 512 offset 4193792 len 2048 2024-09-21T01:46:30.152 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 512 offset 4193792 len 2048 2024-09-21T01:46:30.152 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 512 offset 4193792 len 2048 2024-09-21T01:46:30.152 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 512 offset 4193792 len 2048 2024-09-21T01:46:30.152 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 512 offset 4193792 len 4096 2024-09-21T01:46:30.152 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 512 offset 4193792 len 4096 2024-09-21T01:46:30.152 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 512 offset 4193792 len 4096 2024-09-21T01:46:30.152 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 512 offset 4193792 len 4096 2024-09-21T01:46:30.152 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 512 offset 4193792 len 8192 2024-09-21T01:46:30.152 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 512 offset 4193792 len 8192 2024-09-21T01:46:30.152 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 512 offset 4193792 len 8192 2024-09-21T01:46:30.153 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 512 offset 4193792 len 8192 2024-09-21T01:46:30.153 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 512 offset 4193792 len 16384 2024-09-21T01:46:30.153 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 512 offset 4193792 len 16384 2024-09-21T01:46:30.153 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 512 offset 4193792 len 16384 2024-09-21T01:46:30.153 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 512 offset 4193792 len 16384 2024-09-21T01:46:30.153 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 512 offset 4194304 len 1024 2024-09-21T01:46:30.153 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 512 offset 4194304 len 1024 2024-09-21T01:46:30.153 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 512 offset 4194304 len 1024 2024-09-21T01:46:30.153 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 512 offset 4194304 len 1024 2024-09-21T01:46:30.153 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 512 offset 4194304 len 2048 2024-09-21T01:46:30.153 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 512 offset 4194304 len 2048 2024-09-21T01:46:30.153 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 512 offset 4194304 len 2048 2024-09-21T01:46:30.153 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 512 offset 4194304 len 2048 2024-09-21T01:46:30.153 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 512 offset 4194304 len 4096 2024-09-21T01:46:30.153 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 512 offset 4194304 len 4096 2024-09-21T01:46:30.154 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 512 offset 4194304 len 4096 2024-09-21T01:46:30.154 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 512 offset 4194304 len 4096 2024-09-21T01:46:30.154 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 512 offset 4194304 len 8192 2024-09-21T01:46:30.154 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 512 offset 4194304 len 8192 2024-09-21T01:46:30.154 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 512 offset 4194304 len 8192 2024-09-21T01:46:30.154 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 512 offset 4194304 len 8192 2024-09-21T01:46:30.154 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 512 offset 4194304 len 16384 2024-09-21T01:46:30.154 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 512 offset 4194304 len 16384 2024-09-21T01:46:30.154 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 512 offset 4194304 len 16384 2024-09-21T01:46:30.154 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 512 offset 4194304 len 16384 2024-09-21T01:46:30.154 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 512 offset 4194816 len 1024 2024-09-21T01:46:30.154 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 512 offset 4194816 len 1024 2024-09-21T01:46:30.154 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 512 offset 4194816 len 1024 2024-09-21T01:46:30.154 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 512 offset 4194816 len 1024 2024-09-21T01:46:30.154 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 512 offset 4194816 len 2048 2024-09-21T01:46:30.155 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 512 offset 4194816 len 2048 2024-09-21T01:46:30.155 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 512 offset 4194816 len 2048 2024-09-21T01:46:30.155 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 512 offset 4194816 len 2048 2024-09-21T01:46:30.155 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 512 offset 4194816 len 4096 2024-09-21T01:46:30.155 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 512 offset 4194816 len 4096 2024-09-21T01:46:30.155 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 512 offset 4194816 len 4096 2024-09-21T01:46:30.155 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 512 offset 4194816 len 4096 2024-09-21T01:46:30.155 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 512 offset 4194816 len 8192 2024-09-21T01:46:30.155 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 512 offset 4194816 len 8192 2024-09-21T01:46:30.155 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 512 offset 4194816 len 8192 2024-09-21T01:46:30.155 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 512 offset 4194816 len 8192 2024-09-21T01:46:30.155 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 512 offset 4194816 len 16384 2024-09-21T01:46:30.177 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 512 offset 4194816 len 16384 2024-09-21T01:46:30.177 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 512 offset 4194816 len 16384 2024-09-21T01:46:30.177 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 512 offset 4194816 len 16384 2024-09-21T01:46:30.177 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 512 offset 4195328 len 1024 2024-09-21T01:46:30.177 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 512 offset 4195328 len 1024 2024-09-21T01:46:30.178 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 512 offset 4195328 len 1024 2024-09-21T01:46:30.178 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 512 offset 4195328 len 1024 2024-09-21T01:46:30.178 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 512 offset 4195328 len 2048 2024-09-21T01:46:30.178 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 512 offset 4195328 len 2048 2024-09-21T01:46:30.178 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 512 offset 4195328 len 2048 2024-09-21T01:46:30.178 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 512 offset 4195328 len 2048 2024-09-21T01:46:30.178 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 512 offset 4195328 len 4096 2024-09-21T01:46:30.178 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 512 offset 4195328 len 4096 2024-09-21T01:46:30.179 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 512 offset 4195328 len 4096 2024-09-21T01:46:30.179 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 512 offset 4195328 len 4096 2024-09-21T01:46:30.179 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 512 offset 4195328 len 8192 2024-09-21T01:46:30.179 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 512 offset 4195328 len 8192 2024-09-21T01:46:30.179 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 512 offset 4195328 len 8192 2024-09-21T01:46:30.179 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 512 offset 4195328 len 8192 2024-09-21T01:46:30.179 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 512 offset 4195328 len 16384 2024-09-21T01:46:30.179 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 512 offset 4195328 len 16384 2024-09-21T01:46:30.179 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 512 offset 4195328 len 16384 2024-09-21T01:46:30.179 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 512 offset 4195328 len 16384 2024-09-21T01:46:30.179 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 512 offset 4195840 len 1024 2024-09-21T01:46:30.179 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 512 offset 4195840 len 1024 2024-09-21T01:46:30.179 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 512 offset 4195840 len 1024 2024-09-21T01:46:30.179 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 512 offset 4195840 len 1024 2024-09-21T01:46:30.180 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 512 offset 4195840 len 2048 2024-09-21T01:46:30.180 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 512 offset 4195840 len 2048 2024-09-21T01:46:30.180 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 512 offset 4195840 len 2048 2024-09-21T01:46:30.180 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 512 offset 4195840 len 2048 2024-09-21T01:46:30.180 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 512 offset 4195840 len 4096 2024-09-21T01:46:30.180 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 512 offset 4195840 len 4096 2024-09-21T01:46:30.180 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 512 offset 4195840 len 4096 2024-09-21T01:46:30.180 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 512 offset 4195840 len 4096 2024-09-21T01:46:30.180 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 512 offset 4195840 len 8192 2024-09-21T01:46:30.180 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 512 offset 4195840 len 8192 2024-09-21T01:46:30.180 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 512 offset 4195840 len 8192 2024-09-21T01:46:30.180 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 512 offset 4195840 len 8192 2024-09-21T01:46:30.180 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 512 offset 4195840 len 16384 2024-09-21T01:46:30.180 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 512 offset 4195840 len 16384 2024-09-21T01:46:30.180 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 512 offset 4195840 len 16384 2024-09-21T01:46:30.181 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 512 offset 4195840 len 16384 2024-09-21T01:46:30.181 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 512 offset 4196352 len 1024 2024-09-21T01:46:30.181 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 512 offset 4196352 len 1024 2024-09-21T01:46:30.181 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 512 offset 4196352 len 1024 2024-09-21T01:46:30.181 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 512 offset 4196352 len 1024 2024-09-21T01:46:30.181 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 512 offset 4196352 len 2048 2024-09-21T01:46:30.181 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 512 offset 4196352 len 2048 2024-09-21T01:46:30.181 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 512 offset 4196352 len 2048 2024-09-21T01:46:30.181 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 512 offset 4196352 len 2048 2024-09-21T01:46:30.181 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 512 offset 4196352 len 4096 2024-09-21T01:46:30.181 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 512 offset 4196352 len 4096 2024-09-21T01:46:30.181 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 512 offset 4196352 len 4096 2024-09-21T01:46:30.181 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 512 offset 4196352 len 4096 2024-09-21T01:46:30.181 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 512 offset 4196352 len 8192 2024-09-21T01:46:30.181 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 512 offset 4196352 len 8192 2024-09-21T01:46:30.182 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 512 offset 4196352 len 8192 2024-09-21T01:46:30.182 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 512 offset 4196352 len 8192 2024-09-21T01:46:30.182 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 512 offset 4196352 len 16384 2024-09-21T01:46:30.182 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 512 offset 4196352 len 16384 2024-09-21T01:46:30.182 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 512 offset 4196352 len 16384 2024-09-21T01:46:30.182 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 512 offset 4196352 len 16384 2024-09-21T01:46:30.182 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 512 offset 4196864 len 1024 2024-09-21T01:46:30.182 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 512 offset 4196864 len 1024 2024-09-21T01:46:30.182 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 512 offset 4196864 len 1024 2024-09-21T01:46:30.182 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 512 offset 4196864 len 1024 2024-09-21T01:46:30.182 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 512 offset 4196864 len 2048 2024-09-21T01:46:30.182 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 512 offset 4196864 len 2048 2024-09-21T01:46:30.182 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 512 offset 4196864 len 2048 2024-09-21T01:46:30.182 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 512 offset 4196864 len 2048 2024-09-21T01:46:30.182 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 512 offset 4196864 len 4096 2024-09-21T01:46:30.183 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 512 offset 4196864 len 4096 2024-09-21T01:46:30.183 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 512 offset 4196864 len 4096 2024-09-21T01:46:30.183 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 512 offset 4196864 len 4096 2024-09-21T01:46:30.183 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 512 offset 4196864 len 8192 2024-09-21T01:46:30.183 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 512 offset 4196864 len 8192 2024-09-21T01:46:30.183 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 512 offset 4196864 len 8192 2024-09-21T01:46:30.183 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 512 offset 4196864 len 8192 2024-09-21T01:46:30.183 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 512 offset 4196864 len 16384 2024-09-21T01:46:30.183 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 512 offset 4196864 len 16384 2024-09-21T01:46:30.184 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 512 offset 4196864 len 16384 2024-09-21T01:46:30.184 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 512 offset 4196864 len 16384 2024-09-21T01:46:30.184 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 512 offset 4197376 len 1024 2024-09-21T01:46:30.206 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 512 offset 4197376 len 1024 2024-09-21T01:46:30.206 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 512 offset 4197376 len 1024 2024-09-21T01:46:30.206 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 512 offset 4197376 len 1024 2024-09-21T01:46:30.206 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 512 offset 4197376 len 2048 2024-09-21T01:46:30.206 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 512 offset 4197376 len 2048 2024-09-21T01:46:30.206 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 512 offset 4197376 len 2048 2024-09-21T01:46:30.206 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 512 offset 4197376 len 2048 2024-09-21T01:46:30.206 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 512 offset 4197376 len 4096 2024-09-21T01:46:30.206 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 512 offset 4197376 len 4096 2024-09-21T01:46:30.206 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 512 offset 4197376 len 4096 2024-09-21T01:46:30.206 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 512 offset 4197376 len 4096 2024-09-21T01:46:30.207 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 512 offset 4197376 len 8192 2024-09-21T01:46:30.207 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 512 offset 4197376 len 8192 2024-09-21T01:46:30.207 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 512 offset 4197376 len 8192 2024-09-21T01:46:30.207 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 512 offset 4197376 len 8192 2024-09-21T01:46:30.207 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 512 offset 4197376 len 16384 2024-09-21T01:46:30.207 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 512 offset 4197376 len 16384 2024-09-21T01:46:30.207 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 512 offset 4197376 len 16384 2024-09-21T01:46:30.207 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 512 offset 4197376 len 16384 2024-09-21T01:46:30.207 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 512 offset 4197888 len 1024 2024-09-21T01:46:30.207 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 512 offset 4197888 len 1024 2024-09-21T01:46:30.207 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 512 offset 4197888 len 1024 2024-09-21T01:46:30.207 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 512 offset 4197888 len 1024 2024-09-21T01:46:30.207 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 512 offset 4197888 len 2048 2024-09-21T01:46:30.207 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 512 offset 4197888 len 2048 2024-09-21T01:46:30.208 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 512 offset 4197888 len 2048 2024-09-21T01:46:30.208 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 512 offset 4197888 len 2048 2024-09-21T01:46:30.208 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 512 offset 4197888 len 4096 2024-09-21T01:46:30.208 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 512 offset 4197888 len 4096 2024-09-21T01:46:30.208 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 512 offset 4197888 len 4096 2024-09-21T01:46:30.208 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 512 offset 4197888 len 4096 2024-09-21T01:46:30.208 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 512 offset 4197888 len 8192 2024-09-21T01:46:30.208 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 512 offset 4197888 len 8192 2024-09-21T01:46:30.208 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 512 offset 4197888 len 8192 2024-09-21T01:46:30.208 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 512 offset 4197888 len 8192 2024-09-21T01:46:30.208 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 512 offset 4197888 len 16384 2024-09-21T01:46:30.208 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 512 offset 4197888 len 16384 2024-09-21T01:46:30.208 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 512 offset 4197888 len 16384 2024-09-21T01:46:30.208 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 512 offset 4197888 len 16384 2024-09-21T01:46:30.208 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 1024 offset 4190208 len 1024 2024-09-21T01:46:30.209 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1024 offset 4190208 len 1024 2024-09-21T01:46:30.209 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 1024 offset 4190208 len 1024 2024-09-21T01:46:30.209 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1024 offset 4190208 len 1024 2024-09-21T01:46:30.209 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 1024 offset 4190208 len 2048 2024-09-21T01:46:30.209 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1024 offset 4190208 len 2048 2024-09-21T01:46:30.209 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 1024 offset 4190208 len 2048 2024-09-21T01:46:30.209 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1024 offset 4190208 len 2048 2024-09-21T01:46:30.209 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 1024 offset 4190208 len 4096 2024-09-21T01:46:30.209 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1024 offset 4190208 len 4096 2024-09-21T01:46:30.209 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 1024 offset 4190208 len 4096 2024-09-21T01:46:30.209 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1024 offset 4190208 len 4096 2024-09-21T01:46:30.209 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 1024 offset 4190208 len 8192 2024-09-21T01:46:30.209 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1024 offset 4190208 len 8192 2024-09-21T01:46:30.210 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 1024 offset 4190208 len 8192 2024-09-21T01:46:30.210 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1024 offset 4190208 len 8192 2024-09-21T01:46:30.210 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 1024 offset 4190208 len 16384 2024-09-21T01:46:30.210 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1024 offset 4190208 len 16384 2024-09-21T01:46:30.210 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 1024 offset 4190208 len 16384 2024-09-21T01:46:30.210 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1024 offset 4190208 len 16384 2024-09-21T01:46:30.210 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 1024 offset 4190720 len 1024 2024-09-21T01:46:30.210 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1024 offset 4190720 len 1024 2024-09-21T01:46:30.210 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 1024 offset 4190720 len 1024 2024-09-21T01:46:30.210 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1024 offset 4190720 len 1024 2024-09-21T01:46:30.210 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 1024 offset 4190720 len 2048 2024-09-21T01:46:30.210 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1024 offset 4190720 len 2048 2024-09-21T01:46:30.210 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 1024 offset 4190720 len 2048 2024-09-21T01:46:30.210 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1024 offset 4190720 len 2048 2024-09-21T01:46:30.211 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 1024 offset 4190720 len 4096 2024-09-21T01:46:30.211 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1024 offset 4190720 len 4096 2024-09-21T01:46:30.211 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 1024 offset 4190720 len 4096 2024-09-21T01:46:30.211 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1024 offset 4190720 len 4096 2024-09-21T01:46:30.211 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 1024 offset 4190720 len 8192 2024-09-21T01:46:30.211 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1024 offset 4190720 len 8192 2024-09-21T01:46:30.211 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 1024 offset 4190720 len 8192 2024-09-21T01:46:30.211 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1024 offset 4190720 len 8192 2024-09-21T01:46:30.211 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 1024 offset 4190720 len 16384 2024-09-21T01:46:30.211 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1024 offset 4190720 len 16384 2024-09-21T01:46:30.211 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 1024 offset 4190720 len 16384 2024-09-21T01:46:30.211 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1024 offset 4190720 len 16384 2024-09-21T01:46:30.212 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 1024 offset 4191232 len 1024 2024-09-21T01:46:30.212 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1024 offset 4191232 len 1024 2024-09-21T01:46:30.212 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 1024 offset 4191232 len 1024 2024-09-21T01:46:30.212 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1024 offset 4191232 len 1024 2024-09-21T01:46:30.234 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 1024 offset 4191232 len 2048 2024-09-21T01:46:30.234 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1024 offset 4191232 len 2048 2024-09-21T01:46:30.234 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 1024 offset 4191232 len 2048 2024-09-21T01:46:30.234 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1024 offset 4191232 len 2048 2024-09-21T01:46:30.234 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 1024 offset 4191232 len 4096 2024-09-21T01:46:30.234 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1024 offset 4191232 len 4096 2024-09-21T01:46:30.234 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 1024 offset 4191232 len 4096 2024-09-21T01:46:30.234 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1024 offset 4191232 len 4096 2024-09-21T01:46:30.234 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 1024 offset 4191232 len 8192 2024-09-21T01:46:30.234 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1024 offset 4191232 len 8192 2024-09-21T01:46:30.235 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 1024 offset 4191232 len 8192 2024-09-21T01:46:30.235 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1024 offset 4191232 len 8192 2024-09-21T01:46:30.235 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 1024 offset 4191232 len 16384 2024-09-21T01:46:30.235 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1024 offset 4191232 len 16384 2024-09-21T01:46:30.235 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 1024 offset 4191232 len 16384 2024-09-21T01:46:30.235 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1024 offset 4191232 len 16384 2024-09-21T01:46:30.235 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 1024 offset 4191744 len 1024 2024-09-21T01:46:30.235 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1024 offset 4191744 len 1024 2024-09-21T01:46:30.235 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 1024 offset 4191744 len 1024 2024-09-21T01:46:30.235 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1024 offset 4191744 len 1024 2024-09-21T01:46:30.235 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 1024 offset 4191744 len 2048 2024-09-21T01:46:30.235 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1024 offset 4191744 len 2048 2024-09-21T01:46:30.235 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 1024 offset 4191744 len 2048 2024-09-21T01:46:30.235 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1024 offset 4191744 len 2048 2024-09-21T01:46:30.235 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 1024 offset 4191744 len 4096 2024-09-21T01:46:30.236 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1024 offset 4191744 len 4096 2024-09-21T01:46:30.236 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 1024 offset 4191744 len 4096 2024-09-21T01:46:30.236 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1024 offset 4191744 len 4096 2024-09-21T01:46:30.236 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 1024 offset 4191744 len 8192 2024-09-21T01:46:30.236 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1024 offset 4191744 len 8192 2024-09-21T01:46:30.236 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 1024 offset 4191744 len 8192 2024-09-21T01:46:30.236 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1024 offset 4191744 len 8192 2024-09-21T01:46:30.236 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 1024 offset 4191744 len 16384 2024-09-21T01:46:30.236 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1024 offset 4191744 len 16384 2024-09-21T01:46:30.236 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 1024 offset 4191744 len 16384 2024-09-21T01:46:30.236 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1024 offset 4191744 len 16384 2024-09-21T01:46:30.236 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 1024 offset 4192256 len 1024 2024-09-21T01:46:30.236 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1024 offset 4192256 len 1024 2024-09-21T01:46:30.236 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 1024 offset 4192256 len 1024 2024-09-21T01:46:30.237 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1024 offset 4192256 len 1024 2024-09-21T01:46:30.237 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 1024 offset 4192256 len 2048 2024-09-21T01:46:30.237 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1024 offset 4192256 len 2048 2024-09-21T01:46:30.237 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 1024 offset 4192256 len 2048 2024-09-21T01:46:30.237 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1024 offset 4192256 len 2048 2024-09-21T01:46:30.237 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 1024 offset 4192256 len 4096 2024-09-21T01:46:30.237 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1024 offset 4192256 len 4096 2024-09-21T01:46:30.237 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 1024 offset 4192256 len 4096 2024-09-21T01:46:30.237 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1024 offset 4192256 len 4096 2024-09-21T01:46:30.237 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 1024 offset 4192256 len 8192 2024-09-21T01:46:30.237 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1024 offset 4192256 len 8192 2024-09-21T01:46:30.237 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 1024 offset 4192256 len 8192 2024-09-21T01:46:30.237 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1024 offset 4192256 len 8192 2024-09-21T01:46:30.237 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 1024 offset 4192256 len 16384 2024-09-21T01:46:30.237 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1024 offset 4192256 len 16384 2024-09-21T01:46:30.237 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 1024 offset 4192256 len 16384 2024-09-21T01:46:30.238 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1024 offset 4192256 len 16384 2024-09-21T01:46:30.238 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 1024 offset 4192768 len 1024 2024-09-21T01:46:30.238 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1024 offset 4192768 len 1024 2024-09-21T01:46:30.238 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 1024 offset 4192768 len 1024 2024-09-21T01:46:30.238 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1024 offset 4192768 len 1024 2024-09-21T01:46:30.238 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 1024 offset 4192768 len 2048 2024-09-21T01:46:30.238 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1024 offset 4192768 len 2048 2024-09-21T01:46:30.238 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 1024 offset 4192768 len 2048 2024-09-21T01:46:30.238 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1024 offset 4192768 len 2048 2024-09-21T01:46:30.238 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 1024 offset 4192768 len 4096 2024-09-21T01:46:30.238 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1024 offset 4192768 len 4096 2024-09-21T01:46:30.238 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 1024 offset 4192768 len 4096 2024-09-21T01:46:30.238 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1024 offset 4192768 len 4096 2024-09-21T01:46:30.238 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 1024 offset 4192768 len 8192 2024-09-21T01:46:30.239 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1024 offset 4192768 len 8192 2024-09-21T01:46:30.239 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 1024 offset 4192768 len 8192 2024-09-21T01:46:30.239 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1024 offset 4192768 len 8192 2024-09-21T01:46:30.239 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 1024 offset 4192768 len 16384 2024-09-21T01:46:30.239 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1024 offset 4192768 len 16384 2024-09-21T01:46:30.239 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 1024 offset 4192768 len 16384 2024-09-21T01:46:30.239 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1024 offset 4192768 len 16384 2024-09-21T01:46:30.239 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 1024 offset 4193280 len 1024 2024-09-21T01:46:30.239 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1024 offset 4193280 len 1024 2024-09-21T01:46:30.239 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 1024 offset 4193280 len 1024 2024-09-21T01:46:30.239 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1024 offset 4193280 len 1024 2024-09-21T01:46:30.239 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 1024 offset 4193280 len 2048 2024-09-21T01:46:30.239 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1024 offset 4193280 len 2048 2024-09-21T01:46:30.239 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 1024 offset 4193280 len 2048 2024-09-21T01:46:30.261 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1024 offset 4193280 len 2048 2024-09-21T01:46:30.261 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 1024 offset 4193280 len 4096 2024-09-21T01:46:30.261 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1024 offset 4193280 len 4096 2024-09-21T01:46:30.261 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 1024 offset 4193280 len 4096 2024-09-21T01:46:30.261 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1024 offset 4193280 len 4096 2024-09-21T01:46:30.261 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 1024 offset 4193280 len 8192 2024-09-21T01:46:30.262 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1024 offset 4193280 len 8192 2024-09-21T01:46:30.262 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 1024 offset 4193280 len 8192 2024-09-21T01:46:30.262 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1024 offset 4193280 len 8192 2024-09-21T01:46:30.262 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 1024 offset 4193280 len 16384 2024-09-21T01:46:30.262 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1024 offset 4193280 len 16384 2024-09-21T01:46:30.262 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 1024 offset 4193280 len 16384 2024-09-21T01:46:30.262 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1024 offset 4193280 len 16384 2024-09-21T01:46:30.262 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 1024 offset 4193792 len 1024 2024-09-21T01:46:30.262 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1024 offset 4193792 len 1024 2024-09-21T01:46:30.262 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 1024 offset 4193792 len 1024 2024-09-21T01:46:30.262 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1024 offset 4193792 len 1024 2024-09-21T01:46:30.262 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 1024 offset 4193792 len 2048 2024-09-21T01:46:30.262 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1024 offset 4193792 len 2048 2024-09-21T01:46:30.263 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 1024 offset 4193792 len 2048 2024-09-21T01:46:30.263 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1024 offset 4193792 len 2048 2024-09-21T01:46:30.263 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 1024 offset 4193792 len 4096 2024-09-21T01:46:30.263 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1024 offset 4193792 len 4096 2024-09-21T01:46:30.263 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 1024 offset 4193792 len 4096 2024-09-21T01:46:30.263 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1024 offset 4193792 len 4096 2024-09-21T01:46:30.263 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 1024 offset 4193792 len 8192 2024-09-21T01:46:30.263 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1024 offset 4193792 len 8192 2024-09-21T01:46:30.263 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 1024 offset 4193792 len 8192 2024-09-21T01:46:30.263 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1024 offset 4193792 len 8192 2024-09-21T01:46:30.263 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 1024 offset 4193792 len 16384 2024-09-21T01:46:30.263 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1024 offset 4193792 len 16384 2024-09-21T01:46:30.263 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 1024 offset 4193792 len 16384 2024-09-21T01:46:30.263 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1024 offset 4193792 len 16384 2024-09-21T01:46:30.263 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 1024 offset 4194304 len 1024 2024-09-21T01:46:30.264 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1024 offset 4194304 len 1024 2024-09-21T01:46:30.264 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 1024 offset 4194304 len 1024 2024-09-21T01:46:30.264 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1024 offset 4194304 len 1024 2024-09-21T01:46:30.264 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 1024 offset 4194304 len 2048 2024-09-21T01:46:30.264 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1024 offset 4194304 len 2048 2024-09-21T01:46:30.264 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 1024 offset 4194304 len 2048 2024-09-21T01:46:30.264 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1024 offset 4194304 len 2048 2024-09-21T01:46:30.264 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 1024 offset 4194304 len 4096 2024-09-21T01:46:30.264 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1024 offset 4194304 len 4096 2024-09-21T01:46:30.264 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 1024 offset 4194304 len 4096 2024-09-21T01:46:30.264 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1024 offset 4194304 len 4096 2024-09-21T01:46:30.264 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 1024 offset 4194304 len 8192 2024-09-21T01:46:30.264 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1024 offset 4194304 len 8192 2024-09-21T01:46:30.264 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 1024 offset 4194304 len 8192 2024-09-21T01:46:30.264 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1024 offset 4194304 len 8192 2024-09-21T01:46:30.265 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 1024 offset 4194304 len 16384 2024-09-21T01:46:30.265 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1024 offset 4194304 len 16384 2024-09-21T01:46:30.265 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 1024 offset 4194304 len 16384 2024-09-21T01:46:30.265 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1024 offset 4194304 len 16384 2024-09-21T01:46:30.265 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 1024 offset 4194816 len 1024 2024-09-21T01:46:30.265 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1024 offset 4194816 len 1024 2024-09-21T01:46:30.265 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 1024 offset 4194816 len 1024 2024-09-21T01:46:30.265 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1024 offset 4194816 len 1024 2024-09-21T01:46:30.265 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 1024 offset 4194816 len 2048 2024-09-21T01:46:30.265 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1024 offset 4194816 len 2048 2024-09-21T01:46:30.265 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 1024 offset 4194816 len 2048 2024-09-21T01:46:30.265 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1024 offset 4194816 len 2048 2024-09-21T01:46:30.265 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 1024 offset 4194816 len 4096 2024-09-21T01:46:30.265 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1024 offset 4194816 len 4096 2024-09-21T01:46:30.265 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 1024 offset 4194816 len 4096 2024-09-21T01:46:30.266 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1024 offset 4194816 len 4096 2024-09-21T01:46:30.266 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 1024 offset 4194816 len 8192 2024-09-21T01:46:30.266 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1024 offset 4194816 len 8192 2024-09-21T01:46:30.266 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 1024 offset 4194816 len 8192 2024-09-21T01:46:30.266 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1024 offset 4194816 len 8192 2024-09-21T01:46:30.266 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 1024 offset 4194816 len 16384 2024-09-21T01:46:30.266 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1024 offset 4194816 len 16384 2024-09-21T01:46:30.266 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 1024 offset 4194816 len 16384 2024-09-21T01:46:30.266 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1024 offset 4194816 len 16384 2024-09-21T01:46:30.266 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 1024 offset 4195328 len 1024 2024-09-21T01:46:30.266 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1024 offset 4195328 len 1024 2024-09-21T01:46:30.266 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 1024 offset 4195328 len 1024 2024-09-21T01:46:30.266 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1024 offset 4195328 len 1024 2024-09-21T01:46:30.266 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 1024 offset 4195328 len 2048 2024-09-21T01:46:30.267 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1024 offset 4195328 len 2048 2024-09-21T01:46:30.267 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 1024 offset 4195328 len 2048 2024-09-21T01:46:30.267 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1024 offset 4195328 len 2048 2024-09-21T01:46:30.267 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 1024 offset 4195328 len 4096 2024-09-21T01:46:30.289 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1024 offset 4195328 len 4096 2024-09-21T01:46:30.289 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 1024 offset 4195328 len 4096 2024-09-21T01:46:30.290 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1024 offset 4195328 len 4096 2024-09-21T01:46:30.290 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 1024 offset 4195328 len 8192 2024-09-21T01:46:30.290 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1024 offset 4195328 len 8192 2024-09-21T01:46:30.290 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 1024 offset 4195328 len 8192 2024-09-21T01:46:30.290 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1024 offset 4195328 len 8192 2024-09-21T01:46:30.290 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 1024 offset 4195328 len 16384 2024-09-21T01:46:30.290 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1024 offset 4195328 len 16384 2024-09-21T01:46:30.290 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 1024 offset 4195328 len 16384 2024-09-21T01:46:30.290 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1024 offset 4195328 len 16384 2024-09-21T01:46:30.290 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 1024 offset 4195840 len 1024 2024-09-21T01:46:30.290 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1024 offset 4195840 len 1024 2024-09-21T01:46:30.290 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 1024 offset 4195840 len 1024 2024-09-21T01:46:30.290 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1024 offset 4195840 len 1024 2024-09-21T01:46:30.290 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 1024 offset 4195840 len 2048 2024-09-21T01:46:30.291 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1024 offset 4195840 len 2048 2024-09-21T01:46:30.291 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 1024 offset 4195840 len 2048 2024-09-21T01:46:30.291 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1024 offset 4195840 len 2048 2024-09-21T01:46:30.291 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 1024 offset 4195840 len 4096 2024-09-21T01:46:30.291 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1024 offset 4195840 len 4096 2024-09-21T01:46:30.291 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 1024 offset 4195840 len 4096 2024-09-21T01:46:30.291 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1024 offset 4195840 len 4096 2024-09-21T01:46:30.291 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 1024 offset 4195840 len 8192 2024-09-21T01:46:30.291 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1024 offset 4195840 len 8192 2024-09-21T01:46:30.291 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 1024 offset 4195840 len 8192 2024-09-21T01:46:30.291 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1024 offset 4195840 len 8192 2024-09-21T01:46:30.291 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 1024 offset 4195840 len 16384 2024-09-21T01:46:30.291 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1024 offset 4195840 len 16384 2024-09-21T01:46:30.291 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 1024 offset 4195840 len 16384 2024-09-21T01:46:30.292 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1024 offset 4195840 len 16384 2024-09-21T01:46:30.292 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 1024 offset 4196352 len 1024 2024-09-21T01:46:30.292 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1024 offset 4196352 len 1024 2024-09-21T01:46:30.292 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 1024 offset 4196352 len 1024 2024-09-21T01:46:30.292 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1024 offset 4196352 len 1024 2024-09-21T01:46:30.292 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 1024 offset 4196352 len 2048 2024-09-21T01:46:30.292 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1024 offset 4196352 len 2048 2024-09-21T01:46:30.292 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 1024 offset 4196352 len 2048 2024-09-21T01:46:30.292 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1024 offset 4196352 len 2048 2024-09-21T01:46:30.292 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 1024 offset 4196352 len 4096 2024-09-21T01:46:30.292 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1024 offset 4196352 len 4096 2024-09-21T01:46:30.292 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 1024 offset 4196352 len 4096 2024-09-21T01:46:30.292 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1024 offset 4196352 len 4096 2024-09-21T01:46:30.292 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 1024 offset 4196352 len 8192 2024-09-21T01:46:30.292 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1024 offset 4196352 len 8192 2024-09-21T01:46:30.293 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 1024 offset 4196352 len 8192 2024-09-21T01:46:30.293 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1024 offset 4196352 len 8192 2024-09-21T01:46:30.293 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 1024 offset 4196352 len 16384 2024-09-21T01:46:30.293 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1024 offset 4196352 len 16384 2024-09-21T01:46:30.293 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 1024 offset 4196352 len 16384 2024-09-21T01:46:30.293 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1024 offset 4196352 len 16384 2024-09-21T01:46:30.293 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 1024 offset 4196864 len 1024 2024-09-21T01:46:30.293 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1024 offset 4196864 len 1024 2024-09-21T01:46:30.293 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 1024 offset 4196864 len 1024 2024-09-21T01:46:30.293 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1024 offset 4196864 len 1024 2024-09-21T01:46:30.293 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 1024 offset 4196864 len 2048 2024-09-21T01:46:30.293 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1024 offset 4196864 len 2048 2024-09-21T01:46:30.293 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 1024 offset 4196864 len 2048 2024-09-21T01:46:30.293 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1024 offset 4196864 len 2048 2024-09-21T01:46:30.293 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 1024 offset 4196864 len 4096 2024-09-21T01:46:30.293 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1024 offset 4196864 len 4096 2024-09-21T01:46:30.294 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 1024 offset 4196864 len 4096 2024-09-21T01:46:30.294 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1024 offset 4196864 len 4096 2024-09-21T01:46:30.294 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 1024 offset 4196864 len 8192 2024-09-21T01:46:30.294 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1024 offset 4196864 len 8192 2024-09-21T01:46:30.294 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 1024 offset 4196864 len 8192 2024-09-21T01:46:30.294 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1024 offset 4196864 len 8192 2024-09-21T01:46:30.294 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 1024 offset 4196864 len 16384 2024-09-21T01:46:30.294 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1024 offset 4196864 len 16384 2024-09-21T01:46:30.294 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 1024 offset 4196864 len 16384 2024-09-21T01:46:30.294 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1024 offset 4196864 len 16384 2024-09-21T01:46:30.294 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 1024 offset 4197376 len 1024 2024-09-21T01:46:30.294 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1024 offset 4197376 len 1024 2024-09-21T01:46:30.294 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 1024 offset 4197376 len 1024 2024-09-21T01:46:30.294 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1024 offset 4197376 len 1024 2024-09-21T01:46:30.294 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 1024 offset 4197376 len 2048 2024-09-21T01:46:30.295 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1024 offset 4197376 len 2048 2024-09-21T01:46:30.295 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 1024 offset 4197376 len 2048 2024-09-21T01:46:30.295 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1024 offset 4197376 len 2048 2024-09-21T01:46:30.295 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 1024 offset 4197376 len 4096 2024-09-21T01:46:30.295 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1024 offset 4197376 len 4096 2024-09-21T01:46:30.295 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 1024 offset 4197376 len 4096 2024-09-21T01:46:30.295 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1024 offset 4197376 len 4096 2024-09-21T01:46:30.320 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 1024 offset 4197376 len 8192 2024-09-21T01:46:30.320 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1024 offset 4197376 len 8192 2024-09-21T01:46:30.320 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 1024 offset 4197376 len 8192 2024-09-21T01:46:30.320 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1024 offset 4197376 len 8192 2024-09-21T01:46:30.321 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 1024 offset 4197376 len 16384 2024-09-21T01:46:30.321 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1024 offset 4197376 len 16384 2024-09-21T01:46:30.321 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 1024 offset 4197376 len 16384 2024-09-21T01:46:30.321 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1024 offset 4197376 len 16384 2024-09-21T01:46:30.321 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 1024 offset 4197888 len 1024 2024-09-21T01:46:30.321 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1024 offset 4197888 len 1024 2024-09-21T01:46:30.321 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 1024 offset 4197888 len 1024 2024-09-21T01:46:30.321 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1024 offset 4197888 len 1024 2024-09-21T01:46:30.321 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 1024 offset 4197888 len 2048 2024-09-21T01:46:30.321 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1024 offset 4197888 len 2048 2024-09-21T01:46:30.321 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 1024 offset 4197888 len 2048 2024-09-21T01:46:30.321 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1024 offset 4197888 len 2048 2024-09-21T01:46:30.321 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 1024 offset 4197888 len 4096 2024-09-21T01:46:30.321 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1024 offset 4197888 len 4096 2024-09-21T01:46:30.321 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 1024 offset 4197888 len 4096 2024-09-21T01:46:30.322 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1024 offset 4197888 len 4096 2024-09-21T01:46:30.322 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 1024 offset 4197888 len 8192 2024-09-21T01:46:30.322 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1024 offset 4197888 len 8192 2024-09-21T01:46:30.322 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 1024 offset 4197888 len 8192 2024-09-21T01:46:30.322 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1024 offset 4197888 len 8192 2024-09-21T01:46:30.322 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 1024 offset 4197888 len 16384 2024-09-21T01:46:30.322 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1024 offset 4197888 len 16384 2024-09-21T01:46:30.322 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 1024 offset 4197888 len 16384 2024-09-21T01:46:30.322 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1024 offset 4197888 len 16384 2024-09-21T01:46:30.322 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 1536 offset 4190208 len 1024 2024-09-21T01:46:30.322 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1536 offset 4190208 len 1024 2024-09-21T01:46:30.322 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 1536 offset 4190208 len 1024 2024-09-21T01:46:30.322 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1536 offset 4190208 len 1024 2024-09-21T01:46:30.322 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 1536 offset 4190208 len 2048 2024-09-21T01:46:30.322 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1536 offset 4190208 len 2048 2024-09-21T01:46:30.323 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 1536 offset 4190208 len 2048 2024-09-21T01:46:30.323 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1536 offset 4190208 len 2048 2024-09-21T01:46:30.323 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 1536 offset 4190208 len 4096 2024-09-21T01:46:30.323 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1536 offset 4190208 len 4096 2024-09-21T01:46:30.323 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 1536 offset 4190208 len 4096 2024-09-21T01:46:30.323 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1536 offset 4190208 len 4096 2024-09-21T01:46:30.323 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 1536 offset 4190208 len 8192 2024-09-21T01:46:30.323 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1536 offset 4190208 len 8192 2024-09-21T01:46:30.323 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 1536 offset 4190208 len 8192 2024-09-21T01:46:30.323 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1536 offset 4190208 len 8192 2024-09-21T01:46:30.323 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 1536 offset 4190208 len 16384 2024-09-21T01:46:30.323 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1536 offset 4190208 len 16384 2024-09-21T01:46:30.323 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 1536 offset 4190208 len 16384 2024-09-21T01:46:30.323 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1536 offset 4190208 len 16384 2024-09-21T01:46:30.324 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 1536 offset 4190720 len 1024 2024-09-21T01:46:30.324 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1536 offset 4190720 len 1024 2024-09-21T01:46:30.324 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 1536 offset 4190720 len 1024 2024-09-21T01:46:30.324 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1536 offset 4190720 len 1024 2024-09-21T01:46:30.324 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 1536 offset 4190720 len 2048 2024-09-21T01:46:30.324 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1536 offset 4190720 len 2048 2024-09-21T01:46:30.324 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 1536 offset 4190720 len 2048 2024-09-21T01:46:30.324 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1536 offset 4190720 len 2048 2024-09-21T01:46:30.324 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 1536 offset 4190720 len 4096 2024-09-21T01:46:30.324 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1536 offset 4190720 len 4096 2024-09-21T01:46:30.324 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 1536 offset 4190720 len 4096 2024-09-21T01:46:30.324 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1536 offset 4190720 len 4096 2024-09-21T01:46:30.324 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 1536 offset 4190720 len 8192 2024-09-21T01:46:30.324 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1536 offset 4190720 len 8192 2024-09-21T01:46:30.325 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 1536 offset 4190720 len 8192 2024-09-21T01:46:30.325 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1536 offset 4190720 len 8192 2024-09-21T01:46:30.325 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 1536 offset 4190720 len 16384 2024-09-21T01:46:30.325 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1536 offset 4190720 len 16384 2024-09-21T01:46:30.325 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 1536 offset 4190720 len 16384 2024-09-21T01:46:30.325 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1536 offset 4190720 len 16384 2024-09-21T01:46:30.325 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 1536 offset 4191232 len 1024 2024-09-21T01:46:30.325 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1536 offset 4191232 len 1024 2024-09-21T01:46:30.325 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 1536 offset 4191232 len 1024 2024-09-21T01:46:30.325 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1536 offset 4191232 len 1024 2024-09-21T01:46:30.325 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 1536 offset 4191232 len 2048 2024-09-21T01:46:30.325 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1536 offset 4191232 len 2048 2024-09-21T01:46:30.325 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 1536 offset 4191232 len 2048 2024-09-21T01:46:30.325 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1536 offset 4191232 len 2048 2024-09-21T01:46:30.325 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 1536 offset 4191232 len 4096 2024-09-21T01:46:30.325 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1536 offset 4191232 len 4096 2024-09-21T01:46:30.326 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 1536 offset 4191232 len 4096 2024-09-21T01:46:30.326 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1536 offset 4191232 len 4096 2024-09-21T01:46:30.326 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 1536 offset 4191232 len 8192 2024-09-21T01:46:30.326 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1536 offset 4191232 len 8192 2024-09-21T01:46:30.348 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 1536 offset 4191232 len 8192 2024-09-21T01:46:30.348 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1536 offset 4191232 len 8192 2024-09-21T01:46:30.348 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 1536 offset 4191232 len 16384 2024-09-21T01:46:30.348 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1536 offset 4191232 len 16384 2024-09-21T01:46:30.348 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 1536 offset 4191232 len 16384 2024-09-21T01:46:30.348 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1536 offset 4191232 len 16384 2024-09-21T01:46:30.348 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 1536 offset 4191744 len 1024 2024-09-21T01:46:30.348 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1536 offset 4191744 len 1024 2024-09-21T01:46:30.348 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 1536 offset 4191744 len 1024 2024-09-21T01:46:30.349 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1536 offset 4191744 len 1024 2024-09-21T01:46:30.349 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 1536 offset 4191744 len 2048 2024-09-21T01:46:30.349 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1536 offset 4191744 len 2048 2024-09-21T01:46:30.349 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 1536 offset 4191744 len 2048 2024-09-21T01:46:30.349 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1536 offset 4191744 len 2048 2024-09-21T01:46:30.349 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 1536 offset 4191744 len 4096 2024-09-21T01:46:30.349 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1536 offset 4191744 len 4096 2024-09-21T01:46:30.349 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 1536 offset 4191744 len 4096 2024-09-21T01:46:30.349 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1536 offset 4191744 len 4096 2024-09-21T01:46:30.349 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 1536 offset 4191744 len 8192 2024-09-21T01:46:30.349 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1536 offset 4191744 len 8192 2024-09-21T01:46:30.349 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 1536 offset 4191744 len 8192 2024-09-21T01:46:30.349 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1536 offset 4191744 len 8192 2024-09-21T01:46:30.349 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 1536 offset 4191744 len 16384 2024-09-21T01:46:30.350 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1536 offset 4191744 len 16384 2024-09-21T01:46:30.350 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 1536 offset 4191744 len 16384 2024-09-21T01:46:30.350 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1536 offset 4191744 len 16384 2024-09-21T01:46:30.350 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 1536 offset 4192256 len 1024 2024-09-21T01:46:30.350 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1536 offset 4192256 len 1024 2024-09-21T01:46:30.350 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 1536 offset 4192256 len 1024 2024-09-21T01:46:30.350 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1536 offset 4192256 len 1024 2024-09-21T01:46:30.350 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 1536 offset 4192256 len 2048 2024-09-21T01:46:30.350 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1536 offset 4192256 len 2048 2024-09-21T01:46:30.350 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 1536 offset 4192256 len 2048 2024-09-21T01:46:30.350 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1536 offset 4192256 len 2048 2024-09-21T01:46:30.350 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 1536 offset 4192256 len 4096 2024-09-21T01:46:30.350 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1536 offset 4192256 len 4096 2024-09-21T01:46:30.350 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 1536 offset 4192256 len 4096 2024-09-21T01:46:30.351 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1536 offset 4192256 len 4096 2024-09-21T01:46:30.351 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 1536 offset 4192256 len 8192 2024-09-21T01:46:30.351 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1536 offset 4192256 len 8192 2024-09-21T01:46:30.351 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 1536 offset 4192256 len 8192 2024-09-21T01:46:30.351 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1536 offset 4192256 len 8192 2024-09-21T01:46:30.351 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 1536 offset 4192256 len 16384 2024-09-21T01:46:30.351 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1536 offset 4192256 len 16384 2024-09-21T01:46:30.351 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 1536 offset 4192256 len 16384 2024-09-21T01:46:30.351 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1536 offset 4192256 len 16384 2024-09-21T01:46:30.351 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 1536 offset 4192768 len 1024 2024-09-21T01:46:30.351 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1536 offset 4192768 len 1024 2024-09-21T01:46:30.351 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 1536 offset 4192768 len 1024 2024-09-21T01:46:30.351 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1536 offset 4192768 len 1024 2024-09-21T01:46:30.351 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 1536 offset 4192768 len 2048 2024-09-21T01:46:30.352 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1536 offset 4192768 len 2048 2024-09-21T01:46:30.352 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 1536 offset 4192768 len 2048 2024-09-21T01:46:30.352 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1536 offset 4192768 len 2048 2024-09-21T01:46:30.352 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 1536 offset 4192768 len 4096 2024-09-21T01:46:30.352 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1536 offset 4192768 len 4096 2024-09-21T01:46:30.352 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 1536 offset 4192768 len 4096 2024-09-21T01:46:30.352 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1536 offset 4192768 len 4096 2024-09-21T01:46:30.352 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 1536 offset 4192768 len 8192 2024-09-21T01:46:30.352 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1536 offset 4192768 len 8192 2024-09-21T01:46:30.352 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 1536 offset 4192768 len 8192 2024-09-21T01:46:30.352 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1536 offset 4192768 len 8192 2024-09-21T01:46:30.352 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 1536 offset 4192768 len 16384 2024-09-21T01:46:30.352 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1536 offset 4192768 len 16384 2024-09-21T01:46:30.352 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 1536 offset 4192768 len 16384 2024-09-21T01:46:30.352 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1536 offset 4192768 len 16384 2024-09-21T01:46:30.353 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 1536 offset 4193280 len 1024 2024-09-21T01:46:30.353 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1536 offset 4193280 len 1024 2024-09-21T01:46:30.353 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 1536 offset 4193280 len 1024 2024-09-21T01:46:30.353 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1536 offset 4193280 len 1024 2024-09-21T01:46:30.353 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 1536 offset 4193280 len 2048 2024-09-21T01:46:30.353 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1536 offset 4193280 len 2048 2024-09-21T01:46:30.353 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 1536 offset 4193280 len 2048 2024-09-21T01:46:30.353 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1536 offset 4193280 len 2048 2024-09-21T01:46:30.353 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 1536 offset 4193280 len 4096 2024-09-21T01:46:30.353 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1536 offset 4193280 len 4096 2024-09-21T01:46:30.353 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 1536 offset 4193280 len 4096 2024-09-21T01:46:30.353 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1536 offset 4193280 len 4096 2024-09-21T01:46:30.353 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 1536 offset 4193280 len 8192 2024-09-21T01:46:30.353 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1536 offset 4193280 len 8192 2024-09-21T01:46:30.354 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 1536 offset 4193280 len 8192 2024-09-21T01:46:30.354 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1536 offset 4193280 len 8192 2024-09-21T01:46:30.374 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 1536 offset 4193280 len 16384 2024-09-21T01:46:30.374 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1536 offset 4193280 len 16384 2024-09-21T01:46:30.374 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 1536 offset 4193280 len 16384 2024-09-21T01:46:30.374 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1536 offset 4193280 len 16384 2024-09-21T01:46:30.375 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 1536 offset 4193792 len 1024 2024-09-21T01:46:30.375 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1536 offset 4193792 len 1024 2024-09-21T01:46:30.375 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 1536 offset 4193792 len 1024 2024-09-21T01:46:30.375 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1536 offset 4193792 len 1024 2024-09-21T01:46:30.375 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 1536 offset 4193792 len 2048 2024-09-21T01:46:30.375 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1536 offset 4193792 len 2048 2024-09-21T01:46:30.375 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 1536 offset 4193792 len 2048 2024-09-21T01:46:30.375 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1536 offset 4193792 len 2048 2024-09-21T01:46:30.375 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 1536 offset 4193792 len 4096 2024-09-21T01:46:30.375 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1536 offset 4193792 len 4096 2024-09-21T01:46:30.375 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 1536 offset 4193792 len 4096 2024-09-21T01:46:30.375 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1536 offset 4193792 len 4096 2024-09-21T01:46:30.375 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 1536 offset 4193792 len 8192 2024-09-21T01:46:30.375 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1536 offset 4193792 len 8192 2024-09-21T01:46:30.376 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 1536 offset 4193792 len 8192 2024-09-21T01:46:30.376 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1536 offset 4193792 len 8192 2024-09-21T01:46:30.376 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 1536 offset 4193792 len 16384 2024-09-21T01:46:30.376 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1536 offset 4193792 len 16384 2024-09-21T01:46:30.376 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 1536 offset 4193792 len 16384 2024-09-21T01:46:30.376 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1536 offset 4193792 len 16384 2024-09-21T01:46:30.376 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 1536 offset 4194304 len 1024 2024-09-21T01:46:30.376 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1536 offset 4194304 len 1024 2024-09-21T01:46:30.376 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 1536 offset 4194304 len 1024 2024-09-21T01:46:30.376 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1536 offset 4194304 len 1024 2024-09-21T01:46:30.376 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 1536 offset 4194304 len 2048 2024-09-21T01:46:30.376 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1536 offset 4194304 len 2048 2024-09-21T01:46:30.376 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 1536 offset 4194304 len 2048 2024-09-21T01:46:30.376 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1536 offset 4194304 len 2048 2024-09-21T01:46:30.376 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 1536 offset 4194304 len 4096 2024-09-21T01:46:30.377 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1536 offset 4194304 len 4096 2024-09-21T01:46:30.377 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 1536 offset 4194304 len 4096 2024-09-21T01:46:30.377 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1536 offset 4194304 len 4096 2024-09-21T01:46:30.377 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 1536 offset 4194304 len 8192 2024-09-21T01:46:30.377 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1536 offset 4194304 len 8192 2024-09-21T01:46:30.377 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 1536 offset 4194304 len 8192 2024-09-21T01:46:30.377 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1536 offset 4194304 len 8192 2024-09-21T01:46:30.377 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 1536 offset 4194304 len 16384 2024-09-21T01:46:30.377 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1536 offset 4194304 len 16384 2024-09-21T01:46:30.377 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 1536 offset 4194304 len 16384 2024-09-21T01:46:30.377 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1536 offset 4194304 len 16384 2024-09-21T01:46:30.377 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 1536 offset 4194816 len 1024 2024-09-21T01:46:30.377 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1536 offset 4194816 len 1024 2024-09-21T01:46:30.377 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 1536 offset 4194816 len 1024 2024-09-21T01:46:30.378 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1536 offset 4194816 len 1024 2024-09-21T01:46:30.378 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 1536 offset 4194816 len 2048 2024-09-21T01:46:30.378 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1536 offset 4194816 len 2048 2024-09-21T01:46:30.378 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 1536 offset 4194816 len 2048 2024-09-21T01:46:30.378 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1536 offset 4194816 len 2048 2024-09-21T01:46:30.378 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 1536 offset 4194816 len 4096 2024-09-21T01:46:30.378 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1536 offset 4194816 len 4096 2024-09-21T01:46:30.378 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 1536 offset 4194816 len 4096 2024-09-21T01:46:30.378 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1536 offset 4194816 len 4096 2024-09-21T01:46:30.378 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 1536 offset 4194816 len 8192 2024-09-21T01:46:30.378 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1536 offset 4194816 len 8192 2024-09-21T01:46:30.378 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 1536 offset 4194816 len 8192 2024-09-21T01:46:30.378 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1536 offset 4194816 len 8192 2024-09-21T01:46:30.378 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 1536 offset 4194816 len 16384 2024-09-21T01:46:30.378 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1536 offset 4194816 len 16384 2024-09-21T01:46:30.379 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 1536 offset 4194816 len 16384 2024-09-21T01:46:30.379 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1536 offset 4194816 len 16384 2024-09-21T01:46:30.379 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 1536 offset 4195328 len 1024 2024-09-21T01:46:30.379 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1536 offset 4195328 len 1024 2024-09-21T01:46:30.379 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 1536 offset 4195328 len 1024 2024-09-21T01:46:30.379 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1536 offset 4195328 len 1024 2024-09-21T01:46:30.379 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 1536 offset 4195328 len 2048 2024-09-21T01:46:30.379 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1536 offset 4195328 len 2048 2024-09-21T01:46:30.379 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 1536 offset 4195328 len 2048 2024-09-21T01:46:30.379 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1536 offset 4195328 len 2048 2024-09-21T01:46:30.379 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 1536 offset 4195328 len 4096 2024-09-21T01:46:30.379 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1536 offset 4195328 len 4096 2024-09-21T01:46:30.379 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 1536 offset 4195328 len 4096 2024-09-21T01:46:30.379 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1536 offset 4195328 len 4096 2024-09-21T01:46:30.379 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 1536 offset 4195328 len 8192 2024-09-21T01:46:30.380 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1536 offset 4195328 len 8192 2024-09-21T01:46:30.380 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 1536 offset 4195328 len 8192 2024-09-21T01:46:30.380 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1536 offset 4195328 len 8192 2024-09-21T01:46:30.380 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 1536 offset 4195328 len 16384 2024-09-21T01:46:30.380 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1536 offset 4195328 len 16384 2024-09-21T01:46:30.380 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 1536 offset 4195328 len 16384 2024-09-21T01:46:30.400 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1536 offset 4195328 len 16384 2024-09-21T01:46:30.400 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 1536 offset 4195840 len 1024 2024-09-21T01:46:30.401 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1536 offset 4195840 len 1024 2024-09-21T01:46:30.401 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 1536 offset 4195840 len 1024 2024-09-21T01:46:30.401 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1536 offset 4195840 len 1024 2024-09-21T01:46:30.401 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 1536 offset 4195840 len 2048 2024-09-21T01:46:30.401 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1536 offset 4195840 len 2048 2024-09-21T01:46:30.401 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 1536 offset 4195840 len 2048 2024-09-21T01:46:30.401 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1536 offset 4195840 len 2048 2024-09-21T01:46:30.401 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 1536 offset 4195840 len 4096 2024-09-21T01:46:30.401 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1536 offset 4195840 len 4096 2024-09-21T01:46:30.401 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 1536 offset 4195840 len 4096 2024-09-21T01:46:30.401 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1536 offset 4195840 len 4096 2024-09-21T01:46:30.401 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 1536 offset 4195840 len 8192 2024-09-21T01:46:30.401 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1536 offset 4195840 len 8192 2024-09-21T01:46:30.401 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 1536 offset 4195840 len 8192 2024-09-21T01:46:30.402 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1536 offset 4195840 len 8192 2024-09-21T01:46:30.402 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 1536 offset 4195840 len 16384 2024-09-21T01:46:30.402 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1536 offset 4195840 len 16384 2024-09-21T01:46:30.402 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 1536 offset 4195840 len 16384 2024-09-21T01:46:30.402 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1536 offset 4195840 len 16384 2024-09-21T01:46:30.402 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 1536 offset 4196352 len 1024 2024-09-21T01:46:30.402 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1536 offset 4196352 len 1024 2024-09-21T01:46:30.402 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 1536 offset 4196352 len 1024 2024-09-21T01:46:30.402 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1536 offset 4196352 len 1024 2024-09-21T01:46:30.402 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 1536 offset 4196352 len 2048 2024-09-21T01:46:30.402 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1536 offset 4196352 len 2048 2024-09-21T01:46:30.402 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 1536 offset 4196352 len 2048 2024-09-21T01:46:30.402 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1536 offset 4196352 len 2048 2024-09-21T01:46:30.402 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 1536 offset 4196352 len 4096 2024-09-21T01:46:30.403 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1536 offset 4196352 len 4096 2024-09-21T01:46:30.403 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 1536 offset 4196352 len 4096 2024-09-21T01:46:30.403 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1536 offset 4196352 len 4096 2024-09-21T01:46:30.403 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 1536 offset 4196352 len 8192 2024-09-21T01:46:30.403 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1536 offset 4196352 len 8192 2024-09-21T01:46:30.403 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 1536 offset 4196352 len 8192 2024-09-21T01:46:30.403 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1536 offset 4196352 len 8192 2024-09-21T01:46:30.403 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 1536 offset 4196352 len 16384 2024-09-21T01:46:30.403 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1536 offset 4196352 len 16384 2024-09-21T01:46:30.403 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 1536 offset 4196352 len 16384 2024-09-21T01:46:30.403 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1536 offset 4196352 len 16384 2024-09-21T01:46:30.403 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 1536 offset 4196864 len 1024 2024-09-21T01:46:30.403 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1536 offset 4196864 len 1024 2024-09-21T01:46:30.403 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 1536 offset 4196864 len 1024 2024-09-21T01:46:30.403 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1536 offset 4196864 len 1024 2024-09-21T01:46:30.404 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 1536 offset 4196864 len 2048 2024-09-21T01:46:30.404 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1536 offset 4196864 len 2048 2024-09-21T01:46:30.404 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 1536 offset 4196864 len 2048 2024-09-21T01:46:30.404 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1536 offset 4196864 len 2048 2024-09-21T01:46:30.404 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 1536 offset 4196864 len 4096 2024-09-21T01:46:30.404 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1536 offset 4196864 len 4096 2024-09-21T01:46:30.404 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 1536 offset 4196864 len 4096 2024-09-21T01:46:30.404 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1536 offset 4196864 len 4096 2024-09-21T01:46:30.404 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 1536 offset 4196864 len 8192 2024-09-21T01:46:30.404 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1536 offset 4196864 len 8192 2024-09-21T01:46:30.404 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 1536 offset 4196864 len 8192 2024-09-21T01:46:30.404 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1536 offset 4196864 len 8192 2024-09-21T01:46:30.404 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 1536 offset 4196864 len 16384 2024-09-21T01:46:30.404 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1536 offset 4196864 len 16384 2024-09-21T01:46:30.404 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 1536 offset 4196864 len 16384 2024-09-21T01:46:30.405 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1536 offset 4196864 len 16384 2024-09-21T01:46:30.405 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 1536 offset 4197376 len 1024 2024-09-21T01:46:30.405 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1536 offset 4197376 len 1024 2024-09-21T01:46:30.405 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 1536 offset 4197376 len 1024 2024-09-21T01:46:30.405 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1536 offset 4197376 len 1024 2024-09-21T01:46:30.405 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 1536 offset 4197376 len 2048 2024-09-21T01:46:30.405 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1536 offset 4197376 len 2048 2024-09-21T01:46:30.405 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 1536 offset 4197376 len 2048 2024-09-21T01:46:30.405 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1536 offset 4197376 len 2048 2024-09-21T01:46:30.405 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 1536 offset 4197376 len 4096 2024-09-21T01:46:30.405 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1536 offset 4197376 len 4096 2024-09-21T01:46:30.405 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 1536 offset 4197376 len 4096 2024-09-21T01:46:30.405 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1536 offset 4197376 len 4096 2024-09-21T01:46:30.405 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 1536 offset 4197376 len 8192 2024-09-21T01:46:30.405 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1536 offset 4197376 len 8192 2024-09-21T01:46:30.406 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 1536 offset 4197376 len 8192 2024-09-21T01:46:30.406 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1536 offset 4197376 len 8192 2024-09-21T01:46:30.406 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 1536 offset 4197376 len 16384 2024-09-21T01:46:30.406 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1536 offset 4197376 len 16384 2024-09-21T01:46:30.406 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 1536 offset 4197376 len 16384 2024-09-21T01:46:30.406 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1536 offset 4197376 len 16384 2024-09-21T01:46:30.406 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 1536 offset 4197888 len 1024 2024-09-21T01:46:30.428 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1536 offset 4197888 len 1024 2024-09-21T01:46:30.429 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 1536 offset 4197888 len 1024 2024-09-21T01:46:30.429 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1536 offset 4197888 len 1024 2024-09-21T01:46:30.429 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 1536 offset 4197888 len 2048 2024-09-21T01:46:30.429 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1536 offset 4197888 len 2048 2024-09-21T01:46:30.429 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 1536 offset 4197888 len 2048 2024-09-21T01:46:30.429 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1536 offset 4197888 len 2048 2024-09-21T01:46:30.429 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 1536 offset 4197888 len 4096 2024-09-21T01:46:30.429 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1536 offset 4197888 len 4096 2024-09-21T01:46:30.429 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 1536 offset 4197888 len 4096 2024-09-21T01:46:30.429 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1536 offset 4197888 len 4096 2024-09-21T01:46:30.429 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 1536 offset 4197888 len 8192 2024-09-21T01:46:30.429 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1536 offset 4197888 len 8192 2024-09-21T01:46:30.429 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 1536 offset 4197888 len 8192 2024-09-21T01:46:30.429 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1536 offset 4197888 len 8192 2024-09-21T01:46:30.429 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 1536 offset 4197888 len 16384 2024-09-21T01:46:30.430 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1536 offset 4197888 len 16384 2024-09-21T01:46:30.430 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 1536 offset 4197888 len 16384 2024-09-21T01:46:30.430 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 1536 offset 4197888 len 16384 2024-09-21T01:46:30.430 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 2048 offset 4190208 len 1024 2024-09-21T01:46:30.430 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2048 offset 4190208 len 1024 2024-09-21T01:46:30.430 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 2048 offset 4190208 len 1024 2024-09-21T01:46:30.430 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2048 offset 4190208 len 1024 2024-09-21T01:46:30.430 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 2048 offset 4190208 len 2048 2024-09-21T01:46:30.430 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2048 offset 4190208 len 2048 2024-09-21T01:46:30.430 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 2048 offset 4190208 len 2048 2024-09-21T01:46:30.430 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2048 offset 4190208 len 2048 2024-09-21T01:46:30.430 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 2048 offset 4190208 len 4096 2024-09-21T01:46:30.430 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2048 offset 4190208 len 4096 2024-09-21T01:46:30.430 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 2048 offset 4190208 len 4096 2024-09-21T01:46:30.431 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2048 offset 4190208 len 4096 2024-09-21T01:46:30.431 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 2048 offset 4190208 len 8192 2024-09-21T01:46:30.431 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2048 offset 4190208 len 8192 2024-09-21T01:46:30.431 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 2048 offset 4190208 len 8192 2024-09-21T01:46:30.431 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2048 offset 4190208 len 8192 2024-09-21T01:46:30.431 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 2048 offset 4190208 len 16384 2024-09-21T01:46:30.431 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2048 offset 4190208 len 16384 2024-09-21T01:46:30.431 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 2048 offset 4190208 len 16384 2024-09-21T01:46:30.431 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2048 offset 4190208 len 16384 2024-09-21T01:46:30.431 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 2048 offset 4190720 len 1024 2024-09-21T01:46:30.431 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2048 offset 4190720 len 1024 2024-09-21T01:46:30.431 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 2048 offset 4190720 len 1024 2024-09-21T01:46:30.431 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2048 offset 4190720 len 1024 2024-09-21T01:46:30.431 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 2048 offset 4190720 len 2048 2024-09-21T01:46:30.431 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2048 offset 4190720 len 2048 2024-09-21T01:46:30.432 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 2048 offset 4190720 len 2048 2024-09-21T01:46:30.432 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2048 offset 4190720 len 2048 2024-09-21T01:46:30.432 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 2048 offset 4190720 len 4096 2024-09-21T01:46:30.432 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2048 offset 4190720 len 4096 2024-09-21T01:46:30.432 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 2048 offset 4190720 len 4096 2024-09-21T01:46:30.432 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2048 offset 4190720 len 4096 2024-09-21T01:46:30.432 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 2048 offset 4190720 len 8192 2024-09-21T01:46:30.432 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2048 offset 4190720 len 8192 2024-09-21T01:46:30.432 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 2048 offset 4190720 len 8192 2024-09-21T01:46:30.432 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2048 offset 4190720 len 8192 2024-09-21T01:46:30.432 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 2048 offset 4190720 len 16384 2024-09-21T01:46:30.432 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2048 offset 4190720 len 16384 2024-09-21T01:46:30.432 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 2048 offset 4190720 len 16384 2024-09-21T01:46:30.432 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2048 offset 4190720 len 16384 2024-09-21T01:46:30.432 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 2048 offset 4191232 len 1024 2024-09-21T01:46:30.433 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2048 offset 4191232 len 1024 2024-09-21T01:46:30.433 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 2048 offset 4191232 len 1024 2024-09-21T01:46:30.433 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2048 offset 4191232 len 1024 2024-09-21T01:46:30.433 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 2048 offset 4191232 len 2048 2024-09-21T01:46:30.433 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2048 offset 4191232 len 2048 2024-09-21T01:46:30.433 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 2048 offset 4191232 len 2048 2024-09-21T01:46:30.433 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2048 offset 4191232 len 2048 2024-09-21T01:46:30.433 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 2048 offset 4191232 len 4096 2024-09-21T01:46:30.433 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2048 offset 4191232 len 4096 2024-09-21T01:46:30.433 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 2048 offset 4191232 len 4096 2024-09-21T01:46:30.433 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2048 offset 4191232 len 4096 2024-09-21T01:46:30.433 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 2048 offset 4191232 len 8192 2024-09-21T01:46:30.433 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2048 offset 4191232 len 8192 2024-09-21T01:46:30.433 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 2048 offset 4191232 len 8192 2024-09-21T01:46:30.433 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2048 offset 4191232 len 8192 2024-09-21T01:46:30.434 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 2048 offset 4191232 len 16384 2024-09-21T01:46:30.434 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2048 offset 4191232 len 16384 2024-09-21T01:46:30.434 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 2048 offset 4191232 len 16384 2024-09-21T01:46:30.434 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2048 offset 4191232 len 16384 2024-09-21T01:46:30.434 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 2048 offset 4191744 len 1024 2024-09-21T01:46:30.434 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2048 offset 4191744 len 1024 2024-09-21T01:46:30.434 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 2048 offset 4191744 len 1024 2024-09-21T01:46:30.434 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2048 offset 4191744 len 1024 2024-09-21T01:46:30.458 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 2048 offset 4191744 len 2048 2024-09-21T01:46:30.458 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2048 offset 4191744 len 2048 2024-09-21T01:46:30.458 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 2048 offset 4191744 len 2048 2024-09-21T01:46:30.458 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2048 offset 4191744 len 2048 2024-09-21T01:46:30.458 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 2048 offset 4191744 len 4096 2024-09-21T01:46:30.458 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2048 offset 4191744 len 4096 2024-09-21T01:46:30.458 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 2048 offset 4191744 len 4096 2024-09-21T01:46:30.458 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2048 offset 4191744 len 4096 2024-09-21T01:46:30.458 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 2048 offset 4191744 len 8192 2024-09-21T01:46:30.459 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2048 offset 4191744 len 8192 2024-09-21T01:46:30.459 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 2048 offset 4191744 len 8192 2024-09-21T01:46:30.459 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2048 offset 4191744 len 8192 2024-09-21T01:46:30.459 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 2048 offset 4191744 len 16384 2024-09-21T01:46:30.459 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2048 offset 4191744 len 16384 2024-09-21T01:46:30.459 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 2048 offset 4191744 len 16384 2024-09-21T01:46:30.459 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2048 offset 4191744 len 16384 2024-09-21T01:46:30.459 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 2048 offset 4192256 len 1024 2024-09-21T01:46:30.459 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2048 offset 4192256 len 1024 2024-09-21T01:46:30.459 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 2048 offset 4192256 len 1024 2024-09-21T01:46:30.459 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2048 offset 4192256 len 1024 2024-09-21T01:46:30.459 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 2048 offset 4192256 len 2048 2024-09-21T01:46:30.459 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2048 offset 4192256 len 2048 2024-09-21T01:46:30.460 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 2048 offset 4192256 len 2048 2024-09-21T01:46:30.460 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2048 offset 4192256 len 2048 2024-09-21T01:46:30.460 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 2048 offset 4192256 len 4096 2024-09-21T01:46:30.460 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2048 offset 4192256 len 4096 2024-09-21T01:46:30.460 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 2048 offset 4192256 len 4096 2024-09-21T01:46:30.460 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2048 offset 4192256 len 4096 2024-09-21T01:46:30.460 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 2048 offset 4192256 len 8192 2024-09-21T01:46:30.460 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2048 offset 4192256 len 8192 2024-09-21T01:46:30.460 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 2048 offset 4192256 len 8192 2024-09-21T01:46:30.460 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2048 offset 4192256 len 8192 2024-09-21T01:46:30.460 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 2048 offset 4192256 len 16384 2024-09-21T01:46:30.460 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2048 offset 4192256 len 16384 2024-09-21T01:46:30.460 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 2048 offset 4192256 len 16384 2024-09-21T01:46:30.460 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2048 offset 4192256 len 16384 2024-09-21T01:46:30.460 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 2048 offset 4192768 len 1024 2024-09-21T01:46:30.461 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2048 offset 4192768 len 1024 2024-09-21T01:46:30.461 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 2048 offset 4192768 len 1024 2024-09-21T01:46:30.461 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2048 offset 4192768 len 1024 2024-09-21T01:46:30.461 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 2048 offset 4192768 len 2048 2024-09-21T01:46:30.461 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2048 offset 4192768 len 2048 2024-09-21T01:46:30.461 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 2048 offset 4192768 len 2048 2024-09-21T01:46:30.461 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2048 offset 4192768 len 2048 2024-09-21T01:46:30.461 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 2048 offset 4192768 len 4096 2024-09-21T01:46:30.461 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2048 offset 4192768 len 4096 2024-09-21T01:46:30.461 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 2048 offset 4192768 len 4096 2024-09-21T01:46:30.461 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2048 offset 4192768 len 4096 2024-09-21T01:46:30.461 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 2048 offset 4192768 len 8192 2024-09-21T01:46:30.461 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2048 offset 4192768 len 8192 2024-09-21T01:46:30.461 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 2048 offset 4192768 len 8192 2024-09-21T01:46:30.461 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2048 offset 4192768 len 8192 2024-09-21T01:46:30.462 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 2048 offset 4192768 len 16384 2024-09-21T01:46:30.462 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2048 offset 4192768 len 16384 2024-09-21T01:46:30.462 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 2048 offset 4192768 len 16384 2024-09-21T01:46:30.462 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2048 offset 4192768 len 16384 2024-09-21T01:46:30.462 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 2048 offset 4193280 len 1024 2024-09-21T01:46:30.462 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2048 offset 4193280 len 1024 2024-09-21T01:46:30.462 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 2048 offset 4193280 len 1024 2024-09-21T01:46:30.462 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2048 offset 4193280 len 1024 2024-09-21T01:46:30.462 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 2048 offset 4193280 len 2048 2024-09-21T01:46:30.462 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2048 offset 4193280 len 2048 2024-09-21T01:46:30.462 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 2048 offset 4193280 len 2048 2024-09-21T01:46:30.462 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2048 offset 4193280 len 2048 2024-09-21T01:46:30.462 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 2048 offset 4193280 len 4096 2024-09-21T01:46:30.463 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2048 offset 4193280 len 4096 2024-09-21T01:46:30.463 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 2048 offset 4193280 len 4096 2024-09-21T01:46:30.463 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2048 offset 4193280 len 4096 2024-09-21T01:46:30.463 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 2048 offset 4193280 len 8192 2024-09-21T01:46:30.463 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2048 offset 4193280 len 8192 2024-09-21T01:46:30.463 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 2048 offset 4193280 len 8192 2024-09-21T01:46:30.463 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2048 offset 4193280 len 8192 2024-09-21T01:46:30.463 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 2048 offset 4193280 len 16384 2024-09-21T01:46:30.463 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2048 offset 4193280 len 16384 2024-09-21T01:46:30.463 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 2048 offset 4193280 len 16384 2024-09-21T01:46:30.463 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2048 offset 4193280 len 16384 2024-09-21T01:46:30.463 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 2048 offset 4193792 len 1024 2024-09-21T01:46:30.463 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2048 offset 4193792 len 1024 2024-09-21T01:46:30.463 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 2048 offset 4193792 len 1024 2024-09-21T01:46:30.463 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2048 offset 4193792 len 1024 2024-09-21T01:46:30.464 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 2048 offset 4193792 len 2048 2024-09-21T01:46:30.464 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2048 offset 4193792 len 2048 2024-09-21T01:46:30.483 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 2048 offset 4193792 len 2048 2024-09-21T01:46:30.483 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2048 offset 4193792 len 2048 2024-09-21T01:46:30.483 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 2048 offset 4193792 len 4096 2024-09-21T01:46:30.483 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2048 offset 4193792 len 4096 2024-09-21T01:46:30.483 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 2048 offset 4193792 len 4096 2024-09-21T01:46:30.483 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2048 offset 4193792 len 4096 2024-09-21T01:46:30.483 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 2048 offset 4193792 len 8192 2024-09-21T01:46:30.483 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2048 offset 4193792 len 8192 2024-09-21T01:46:30.484 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 2048 offset 4193792 len 8192 2024-09-21T01:46:30.484 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2048 offset 4193792 len 8192 2024-09-21T01:46:30.484 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 2048 offset 4193792 len 16384 2024-09-21T01:46:30.484 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2048 offset 4193792 len 16384 2024-09-21T01:46:30.484 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 2048 offset 4193792 len 16384 2024-09-21T01:46:30.484 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2048 offset 4193792 len 16384 2024-09-21T01:46:30.484 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 2048 offset 4194304 len 1024 2024-09-21T01:46:30.484 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2048 offset 4194304 len 1024 2024-09-21T01:46:30.484 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 2048 offset 4194304 len 1024 2024-09-21T01:46:30.484 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2048 offset 4194304 len 1024 2024-09-21T01:46:30.484 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 2048 offset 4194304 len 2048 2024-09-21T01:46:30.484 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2048 offset 4194304 len 2048 2024-09-21T01:46:30.484 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 2048 offset 4194304 len 2048 2024-09-21T01:46:30.484 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2048 offset 4194304 len 2048 2024-09-21T01:46:30.485 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 2048 offset 4194304 len 4096 2024-09-21T01:46:30.485 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2048 offset 4194304 len 4096 2024-09-21T01:46:30.485 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 2048 offset 4194304 len 4096 2024-09-21T01:46:30.485 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2048 offset 4194304 len 4096 2024-09-21T01:46:30.485 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 2048 offset 4194304 len 8192 2024-09-21T01:46:30.485 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2048 offset 4194304 len 8192 2024-09-21T01:46:30.485 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 2048 offset 4194304 len 8192 2024-09-21T01:46:30.485 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2048 offset 4194304 len 8192 2024-09-21T01:46:30.485 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 2048 offset 4194304 len 16384 2024-09-21T01:46:30.485 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2048 offset 4194304 len 16384 2024-09-21T01:46:30.485 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 2048 offset 4194304 len 16384 2024-09-21T01:46:30.485 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2048 offset 4194304 len 16384 2024-09-21T01:46:30.485 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 2048 offset 4194816 len 1024 2024-09-21T01:46:30.485 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2048 offset 4194816 len 1024 2024-09-21T01:46:30.485 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 2048 offset 4194816 len 1024 2024-09-21T01:46:30.486 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2048 offset 4194816 len 1024 2024-09-21T01:46:30.486 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 2048 offset 4194816 len 2048 2024-09-21T01:46:30.486 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2048 offset 4194816 len 2048 2024-09-21T01:46:30.486 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 2048 offset 4194816 len 2048 2024-09-21T01:46:30.486 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2048 offset 4194816 len 2048 2024-09-21T01:46:30.486 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 2048 offset 4194816 len 4096 2024-09-21T01:46:30.486 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2048 offset 4194816 len 4096 2024-09-21T01:46:30.486 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 2048 offset 4194816 len 4096 2024-09-21T01:46:30.486 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2048 offset 4194816 len 4096 2024-09-21T01:46:30.486 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 2048 offset 4194816 len 8192 2024-09-21T01:46:30.486 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2048 offset 4194816 len 8192 2024-09-21T01:46:30.486 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 2048 offset 4194816 len 8192 2024-09-21T01:46:30.486 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2048 offset 4194816 len 8192 2024-09-21T01:46:30.487 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 2048 offset 4194816 len 16384 2024-09-21T01:46:30.487 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2048 offset 4194816 len 16384 2024-09-21T01:46:30.487 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 2048 offset 4194816 len 16384 2024-09-21T01:46:30.487 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2048 offset 4194816 len 16384 2024-09-21T01:46:30.487 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 2048 offset 4195328 len 1024 2024-09-21T01:46:30.487 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2048 offset 4195328 len 1024 2024-09-21T01:46:30.487 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 2048 offset 4195328 len 1024 2024-09-21T01:46:30.487 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2048 offset 4195328 len 1024 2024-09-21T01:46:30.487 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 2048 offset 4195328 len 2048 2024-09-21T01:46:30.487 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2048 offset 4195328 len 2048 2024-09-21T01:46:30.487 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 2048 offset 4195328 len 2048 2024-09-21T01:46:30.487 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2048 offset 4195328 len 2048 2024-09-21T01:46:30.487 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 2048 offset 4195328 len 4096 2024-09-21T01:46:30.487 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2048 offset 4195328 len 4096 2024-09-21T01:46:30.487 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 2048 offset 4195328 len 4096 2024-09-21T01:46:30.488 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2048 offset 4195328 len 4096 2024-09-21T01:46:30.488 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 2048 offset 4195328 len 8192 2024-09-21T01:46:30.488 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2048 offset 4195328 len 8192 2024-09-21T01:46:30.488 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 2048 offset 4195328 len 8192 2024-09-21T01:46:30.488 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2048 offset 4195328 len 8192 2024-09-21T01:46:30.488 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 2048 offset 4195328 len 16384 2024-09-21T01:46:30.488 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2048 offset 4195328 len 16384 2024-09-21T01:46:30.488 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 2048 offset 4195328 len 16384 2024-09-21T01:46:30.488 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2048 offset 4195328 len 16384 2024-09-21T01:46:30.488 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 2048 offset 4195840 len 1024 2024-09-21T01:46:30.488 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2048 offset 4195840 len 1024 2024-09-21T01:46:30.488 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 2048 offset 4195840 len 1024 2024-09-21T01:46:30.488 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2048 offset 4195840 len 1024 2024-09-21T01:46:30.488 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 2048 offset 4195840 len 2048 2024-09-21T01:46:30.488 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2048 offset 4195840 len 2048 2024-09-21T01:46:30.489 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 2048 offset 4195840 len 2048 2024-09-21T01:46:30.489 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2048 offset 4195840 len 2048 2024-09-21T01:46:30.511 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 2048 offset 4195840 len 4096 2024-09-21T01:46:30.511 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2048 offset 4195840 len 4096 2024-09-21T01:46:30.511 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 2048 offset 4195840 len 4096 2024-09-21T01:46:30.511 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2048 offset 4195840 len 4096 2024-09-21T01:46:30.511 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 2048 offset 4195840 len 8192 2024-09-21T01:46:30.511 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2048 offset 4195840 len 8192 2024-09-21T01:46:30.511 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 2048 offset 4195840 len 8192 2024-09-21T01:46:30.511 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2048 offset 4195840 len 8192 2024-09-21T01:46:30.512 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 2048 offset 4195840 len 16384 2024-09-21T01:46:30.512 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2048 offset 4195840 len 16384 2024-09-21T01:46:30.512 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 2048 offset 4195840 len 16384 2024-09-21T01:46:30.512 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2048 offset 4195840 len 16384 2024-09-21T01:46:30.512 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 2048 offset 4196352 len 1024 2024-09-21T01:46:30.512 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2048 offset 4196352 len 1024 2024-09-21T01:46:30.512 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 2048 offset 4196352 len 1024 2024-09-21T01:46:30.512 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2048 offset 4196352 len 1024 2024-09-21T01:46:30.512 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 2048 offset 4196352 len 2048 2024-09-21T01:46:30.512 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2048 offset 4196352 len 2048 2024-09-21T01:46:30.512 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 2048 offset 4196352 len 2048 2024-09-21T01:46:30.512 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2048 offset 4196352 len 2048 2024-09-21T01:46:30.512 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 2048 offset 4196352 len 4096 2024-09-21T01:46:30.512 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2048 offset 4196352 len 4096 2024-09-21T01:46:30.512 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 2048 offset 4196352 len 4096 2024-09-21T01:46:30.513 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2048 offset 4196352 len 4096 2024-09-21T01:46:30.513 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 2048 offset 4196352 len 8192 2024-09-21T01:46:30.513 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2048 offset 4196352 len 8192 2024-09-21T01:46:30.513 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 2048 offset 4196352 len 8192 2024-09-21T01:46:30.513 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2048 offset 4196352 len 8192 2024-09-21T01:46:30.513 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 2048 offset 4196352 len 16384 2024-09-21T01:46:30.513 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2048 offset 4196352 len 16384 2024-09-21T01:46:30.513 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 2048 offset 4196352 len 16384 2024-09-21T01:46:30.513 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2048 offset 4196352 len 16384 2024-09-21T01:46:30.513 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 2048 offset 4196864 len 1024 2024-09-21T01:46:30.513 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2048 offset 4196864 len 1024 2024-09-21T01:46:30.513 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 2048 offset 4196864 len 1024 2024-09-21T01:46:30.513 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2048 offset 4196864 len 1024 2024-09-21T01:46:30.513 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 2048 offset 4196864 len 2048 2024-09-21T01:46:30.513 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2048 offset 4196864 len 2048 2024-09-21T01:46:30.514 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 2048 offset 4196864 len 2048 2024-09-21T01:46:30.514 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2048 offset 4196864 len 2048 2024-09-21T01:46:30.514 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 2048 offset 4196864 len 4096 2024-09-21T01:46:30.514 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2048 offset 4196864 len 4096 2024-09-21T01:46:30.514 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 2048 offset 4196864 len 4096 2024-09-21T01:46:30.514 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2048 offset 4196864 len 4096 2024-09-21T01:46:30.514 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 2048 offset 4196864 len 8192 2024-09-21T01:46:30.514 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2048 offset 4196864 len 8192 2024-09-21T01:46:30.514 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 2048 offset 4196864 len 8192 2024-09-21T01:46:30.515 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2048 offset 4196864 len 8192 2024-09-21T01:46:30.515 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 2048 offset 4196864 len 16384 2024-09-21T01:46:30.515 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2048 offset 4196864 len 16384 2024-09-21T01:46:30.515 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 2048 offset 4196864 len 16384 2024-09-21T01:46:30.515 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2048 offset 4196864 len 16384 2024-09-21T01:46:30.515 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 2048 offset 4197376 len 1024 2024-09-21T01:46:30.515 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2048 offset 4197376 len 1024 2024-09-21T01:46:30.515 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 2048 offset 4197376 len 1024 2024-09-21T01:46:30.515 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2048 offset 4197376 len 1024 2024-09-21T01:46:30.515 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 2048 offset 4197376 len 2048 2024-09-21T01:46:30.515 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2048 offset 4197376 len 2048 2024-09-21T01:46:30.515 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 2048 offset 4197376 len 2048 2024-09-21T01:46:30.515 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2048 offset 4197376 len 2048 2024-09-21T01:46:30.515 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 2048 offset 4197376 len 4096 2024-09-21T01:46:30.515 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2048 offset 4197376 len 4096 2024-09-21T01:46:30.516 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 2048 offset 4197376 len 4096 2024-09-21T01:46:30.516 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2048 offset 4197376 len 4096 2024-09-21T01:46:30.516 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 2048 offset 4197376 len 8192 2024-09-21T01:46:30.516 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2048 offset 4197376 len 8192 2024-09-21T01:46:30.516 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 2048 offset 4197376 len 8192 2024-09-21T01:46:30.516 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2048 offset 4197376 len 8192 2024-09-21T01:46:30.516 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 2048 offset 4197376 len 16384 2024-09-21T01:46:30.516 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2048 offset 4197376 len 16384 2024-09-21T01:46:30.516 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 2048 offset 4197376 len 16384 2024-09-21T01:46:30.516 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2048 offset 4197376 len 16384 2024-09-21T01:46:30.517 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 2048 offset 4197888 len 1024 2024-09-21T01:46:30.517 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2048 offset 4197888 len 1024 2024-09-21T01:46:30.517 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 2048 offset 4197888 len 1024 2024-09-21T01:46:30.517 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2048 offset 4197888 len 1024 2024-09-21T01:46:30.517 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 2048 offset 4197888 len 2048 2024-09-21T01:46:30.517 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2048 offset 4197888 len 2048 2024-09-21T01:46:30.517 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 2048 offset 4197888 len 2048 2024-09-21T01:46:30.517 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2048 offset 4197888 len 2048 2024-09-21T01:46:30.517 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 2048 offset 4197888 len 4096 2024-09-21T01:46:30.517 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2048 offset 4197888 len 4096 2024-09-21T01:46:30.517 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 2048 offset 4197888 len 4096 2024-09-21T01:46:30.541 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2048 offset 4197888 len 4096 2024-09-21T01:46:30.541 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 2048 offset 4197888 len 8192 2024-09-21T01:46:30.541 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2048 offset 4197888 len 8192 2024-09-21T01:46:30.541 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 2048 offset 4197888 len 8192 2024-09-21T01:46:30.541 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2048 offset 4197888 len 8192 2024-09-21T01:46:30.541 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 2048 offset 4197888 len 16384 2024-09-21T01:46:30.541 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2048 offset 4197888 len 16384 2024-09-21T01:46:30.541 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 2048 offset 4197888 len 16384 2024-09-21T01:46:30.541 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2048 offset 4197888 len 16384 2024-09-21T01:46:30.541 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 2560 offset 4190208 len 1024 2024-09-21T01:46:30.542 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2560 offset 4190208 len 1024 2024-09-21T01:46:30.542 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 2560 offset 4190208 len 1024 2024-09-21T01:46:30.542 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2560 offset 4190208 len 1024 2024-09-21T01:46:30.542 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 2560 offset 4190208 len 2048 2024-09-21T01:46:30.542 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2560 offset 4190208 len 2048 2024-09-21T01:46:30.542 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 2560 offset 4190208 len 2048 2024-09-21T01:46:30.542 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2560 offset 4190208 len 2048 2024-09-21T01:46:30.542 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 2560 offset 4190208 len 4096 2024-09-21T01:46:30.542 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2560 offset 4190208 len 4096 2024-09-21T01:46:30.542 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 2560 offset 4190208 len 4096 2024-09-21T01:46:30.542 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2560 offset 4190208 len 4096 2024-09-21T01:46:30.542 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 2560 offset 4190208 len 8192 2024-09-21T01:46:30.542 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2560 offset 4190208 len 8192 2024-09-21T01:46:30.543 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 2560 offset 4190208 len 8192 2024-09-21T01:46:30.543 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2560 offset 4190208 len 8192 2024-09-21T01:46:30.543 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 2560 offset 4190208 len 16384 2024-09-21T01:46:30.543 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2560 offset 4190208 len 16384 2024-09-21T01:46:30.543 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 2560 offset 4190208 len 16384 2024-09-21T01:46:30.543 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2560 offset 4190208 len 16384 2024-09-21T01:46:30.543 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 2560 offset 4190720 len 1024 2024-09-21T01:46:30.543 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2560 offset 4190720 len 1024 2024-09-21T01:46:30.543 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 2560 offset 4190720 len 1024 2024-09-21T01:46:30.543 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2560 offset 4190720 len 1024 2024-09-21T01:46:30.543 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 2560 offset 4190720 len 2048 2024-09-21T01:46:30.543 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2560 offset 4190720 len 2048 2024-09-21T01:46:30.543 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 2560 offset 4190720 len 2048 2024-09-21T01:46:30.543 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2560 offset 4190720 len 2048 2024-09-21T01:46:30.543 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 2560 offset 4190720 len 4096 2024-09-21T01:46:30.544 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2560 offset 4190720 len 4096 2024-09-21T01:46:30.544 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 2560 offset 4190720 len 4096 2024-09-21T01:46:30.544 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2560 offset 4190720 len 4096 2024-09-21T01:46:30.544 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 2560 offset 4190720 len 8192 2024-09-21T01:46:30.544 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2560 offset 4190720 len 8192 2024-09-21T01:46:30.544 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 2560 offset 4190720 len 8192 2024-09-21T01:46:30.544 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2560 offset 4190720 len 8192 2024-09-21T01:46:30.544 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 2560 offset 4190720 len 16384 2024-09-21T01:46:30.544 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2560 offset 4190720 len 16384 2024-09-21T01:46:30.544 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 2560 offset 4190720 len 16384 2024-09-21T01:46:30.544 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2560 offset 4190720 len 16384 2024-09-21T01:46:30.544 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 2560 offset 4191232 len 1024 2024-09-21T01:46:30.544 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2560 offset 4191232 len 1024 2024-09-21T01:46:30.544 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 2560 offset 4191232 len 1024 2024-09-21T01:46:30.544 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2560 offset 4191232 len 1024 2024-09-21T01:46:30.545 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 2560 offset 4191232 len 2048 2024-09-21T01:46:30.545 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2560 offset 4191232 len 2048 2024-09-21T01:46:30.545 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 2560 offset 4191232 len 2048 2024-09-21T01:46:30.545 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2560 offset 4191232 len 2048 2024-09-21T01:46:30.545 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 2560 offset 4191232 len 4096 2024-09-21T01:46:30.545 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2560 offset 4191232 len 4096 2024-09-21T01:46:30.545 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 2560 offset 4191232 len 4096 2024-09-21T01:46:30.545 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2560 offset 4191232 len 4096 2024-09-21T01:46:30.545 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 2560 offset 4191232 len 8192 2024-09-21T01:46:30.545 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2560 offset 4191232 len 8192 2024-09-21T01:46:30.545 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 2560 offset 4191232 len 8192 2024-09-21T01:46:30.545 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2560 offset 4191232 len 8192 2024-09-21T01:46:30.545 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 2560 offset 4191232 len 16384 2024-09-21T01:46:30.545 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2560 offset 4191232 len 16384 2024-09-21T01:46:30.545 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 2560 offset 4191232 len 16384 2024-09-21T01:46:30.546 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2560 offset 4191232 len 16384 2024-09-21T01:46:30.546 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 2560 offset 4191744 len 1024 2024-09-21T01:46:30.546 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2560 offset 4191744 len 1024 2024-09-21T01:46:30.546 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 2560 offset 4191744 len 1024 2024-09-21T01:46:30.546 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2560 offset 4191744 len 1024 2024-09-21T01:46:30.546 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 2560 offset 4191744 len 2048 2024-09-21T01:46:30.546 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2560 offset 4191744 len 2048 2024-09-21T01:46:30.546 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 2560 offset 4191744 len 2048 2024-09-21T01:46:30.546 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2560 offset 4191744 len 2048 2024-09-21T01:46:30.546 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 2560 offset 4191744 len 4096 2024-09-21T01:46:30.546 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2560 offset 4191744 len 4096 2024-09-21T01:46:30.546 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 2560 offset 4191744 len 4096 2024-09-21T01:46:30.546 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2560 offset 4191744 len 4096 2024-09-21T01:46:30.546 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 2560 offset 4191744 len 8192 2024-09-21T01:46:30.571 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2560 offset 4191744 len 8192 2024-09-21T01:46:30.571 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 2560 offset 4191744 len 8192 2024-09-21T01:46:30.571 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2560 offset 4191744 len 8192 2024-09-21T01:46:30.571 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 2560 offset 4191744 len 16384 2024-09-21T01:46:30.571 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2560 offset 4191744 len 16384 2024-09-21T01:46:30.571 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 2560 offset 4191744 len 16384 2024-09-21T01:46:30.571 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2560 offset 4191744 len 16384 2024-09-21T01:46:30.572 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 2560 offset 4192256 len 1024 2024-09-21T01:46:30.572 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2560 offset 4192256 len 1024 2024-09-21T01:46:30.572 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 2560 offset 4192256 len 1024 2024-09-21T01:46:30.572 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2560 offset 4192256 len 1024 2024-09-21T01:46:30.572 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 2560 offset 4192256 len 2048 2024-09-21T01:46:30.572 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2560 offset 4192256 len 2048 2024-09-21T01:46:30.572 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 2560 offset 4192256 len 2048 2024-09-21T01:46:30.572 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2560 offset 4192256 len 2048 2024-09-21T01:46:30.572 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 2560 offset 4192256 len 4096 2024-09-21T01:46:30.572 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2560 offset 4192256 len 4096 2024-09-21T01:46:30.572 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 2560 offset 4192256 len 4096 2024-09-21T01:46:30.572 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2560 offset 4192256 len 4096 2024-09-21T01:46:30.572 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 2560 offset 4192256 len 8192 2024-09-21T01:46:30.572 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2560 offset 4192256 len 8192 2024-09-21T01:46:30.573 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 2560 offset 4192256 len 8192 2024-09-21T01:46:30.573 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2560 offset 4192256 len 8192 2024-09-21T01:46:30.573 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 2560 offset 4192256 len 16384 2024-09-21T01:46:30.573 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2560 offset 4192256 len 16384 2024-09-21T01:46:30.573 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 2560 offset 4192256 len 16384 2024-09-21T01:46:30.573 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2560 offset 4192256 len 16384 2024-09-21T01:46:30.573 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 2560 offset 4192768 len 1024 2024-09-21T01:46:30.573 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2560 offset 4192768 len 1024 2024-09-21T01:46:30.573 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 2560 offset 4192768 len 1024 2024-09-21T01:46:30.573 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2560 offset 4192768 len 1024 2024-09-21T01:46:30.573 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 2560 offset 4192768 len 2048 2024-09-21T01:46:30.573 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2560 offset 4192768 len 2048 2024-09-21T01:46:30.573 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 2560 offset 4192768 len 2048 2024-09-21T01:46:30.573 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2560 offset 4192768 len 2048 2024-09-21T01:46:30.573 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 2560 offset 4192768 len 4096 2024-09-21T01:46:30.574 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2560 offset 4192768 len 4096 2024-09-21T01:46:30.574 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 2560 offset 4192768 len 4096 2024-09-21T01:46:30.574 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2560 offset 4192768 len 4096 2024-09-21T01:46:30.574 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 2560 offset 4192768 len 8192 2024-09-21T01:46:30.574 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2560 offset 4192768 len 8192 2024-09-21T01:46:30.574 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 2560 offset 4192768 len 8192 2024-09-21T01:46:30.574 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2560 offset 4192768 len 8192 2024-09-21T01:46:30.574 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 2560 offset 4192768 len 16384 2024-09-21T01:46:30.574 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2560 offset 4192768 len 16384 2024-09-21T01:46:30.574 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 2560 offset 4192768 len 16384 2024-09-21T01:46:30.574 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2560 offset 4192768 len 16384 2024-09-21T01:46:30.574 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 2560 offset 4193280 len 1024 2024-09-21T01:46:30.574 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2560 offset 4193280 len 1024 2024-09-21T01:46:30.574 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 2560 offset 4193280 len 1024 2024-09-21T01:46:30.575 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2560 offset 4193280 len 1024 2024-09-21T01:46:30.575 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 2560 offset 4193280 len 2048 2024-09-21T01:46:30.575 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2560 offset 4193280 len 2048 2024-09-21T01:46:30.575 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 2560 offset 4193280 len 2048 2024-09-21T01:46:30.575 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2560 offset 4193280 len 2048 2024-09-21T01:46:30.575 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 2560 offset 4193280 len 4096 2024-09-21T01:46:30.575 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2560 offset 4193280 len 4096 2024-09-21T01:46:30.575 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 2560 offset 4193280 len 4096 2024-09-21T01:46:30.575 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2560 offset 4193280 len 4096 2024-09-21T01:46:30.575 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 2560 offset 4193280 len 8192 2024-09-21T01:46:30.575 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2560 offset 4193280 len 8192 2024-09-21T01:46:30.575 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 2560 offset 4193280 len 8192 2024-09-21T01:46:30.575 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2560 offset 4193280 len 8192 2024-09-21T01:46:30.575 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 2560 offset 4193280 len 16384 2024-09-21T01:46:30.576 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2560 offset 4193280 len 16384 2024-09-21T01:46:30.576 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 2560 offset 4193280 len 16384 2024-09-21T01:46:30.576 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2560 offset 4193280 len 16384 2024-09-21T01:46:30.576 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 2560 offset 4193792 len 1024 2024-09-21T01:46:30.576 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2560 offset 4193792 len 1024 2024-09-21T01:46:30.576 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 2560 offset 4193792 len 1024 2024-09-21T01:46:30.576 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2560 offset 4193792 len 1024 2024-09-21T01:46:30.576 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 2560 offset 4193792 len 2048 2024-09-21T01:46:30.576 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2560 offset 4193792 len 2048 2024-09-21T01:46:30.576 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 2560 offset 4193792 len 2048 2024-09-21T01:46:30.576 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2560 offset 4193792 len 2048 2024-09-21T01:46:30.576 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 2560 offset 4193792 len 4096 2024-09-21T01:46:30.576 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2560 offset 4193792 len 4096 2024-09-21T01:46:30.576 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 2560 offset 4193792 len 4096 2024-09-21T01:46:30.576 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2560 offset 4193792 len 4096 2024-09-21T01:46:30.577 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 2560 offset 4193792 len 8192 2024-09-21T01:46:30.577 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2560 offset 4193792 len 8192 2024-09-21T01:46:30.577 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 2560 offset 4193792 len 8192 2024-09-21T01:46:30.577 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2560 offset 4193792 len 8192 2024-09-21T01:46:30.595 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 2560 offset 4193792 len 16384 2024-09-21T01:46:30.595 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2560 offset 4193792 len 16384 2024-09-21T01:46:30.595 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 2560 offset 4193792 len 16384 2024-09-21T01:46:30.595 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2560 offset 4193792 len 16384 2024-09-21T01:46:30.595 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 2560 offset 4194304 len 1024 2024-09-21T01:46:30.596 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2560 offset 4194304 len 1024 2024-09-21T01:46:30.596 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 2560 offset 4194304 len 1024 2024-09-21T01:46:30.596 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2560 offset 4194304 len 1024 2024-09-21T01:46:30.596 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 2560 offset 4194304 len 2048 2024-09-21T01:46:30.596 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2560 offset 4194304 len 2048 2024-09-21T01:46:30.596 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 2560 offset 4194304 len 2048 2024-09-21T01:46:30.596 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2560 offset 4194304 len 2048 2024-09-21T01:46:30.596 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 2560 offset 4194304 len 4096 2024-09-21T01:46:30.596 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2560 offset 4194304 len 4096 2024-09-21T01:46:30.596 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 2560 offset 4194304 len 4096 2024-09-21T01:46:30.596 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2560 offset 4194304 len 4096 2024-09-21T01:46:30.596 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 2560 offset 4194304 len 8192 2024-09-21T01:46:30.596 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2560 offset 4194304 len 8192 2024-09-21T01:46:30.597 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 2560 offset 4194304 len 8192 2024-09-21T01:46:30.597 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2560 offset 4194304 len 8192 2024-09-21T01:46:30.597 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 2560 offset 4194304 len 16384 2024-09-21T01:46:30.597 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2560 offset 4194304 len 16384 2024-09-21T01:46:30.597 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 2560 offset 4194304 len 16384 2024-09-21T01:46:30.597 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2560 offset 4194304 len 16384 2024-09-21T01:46:30.597 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 2560 offset 4194816 len 1024 2024-09-21T01:46:30.597 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2560 offset 4194816 len 1024 2024-09-21T01:46:30.597 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 2560 offset 4194816 len 1024 2024-09-21T01:46:30.597 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2560 offset 4194816 len 1024 2024-09-21T01:46:30.597 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 2560 offset 4194816 len 2048 2024-09-21T01:46:30.597 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2560 offset 4194816 len 2048 2024-09-21T01:46:30.597 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 2560 offset 4194816 len 2048 2024-09-21T01:46:30.597 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2560 offset 4194816 len 2048 2024-09-21T01:46:30.597 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 2560 offset 4194816 len 4096 2024-09-21T01:46:30.598 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2560 offset 4194816 len 4096 2024-09-21T01:46:30.598 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 2560 offset 4194816 len 4096 2024-09-21T01:46:30.598 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2560 offset 4194816 len 4096 2024-09-21T01:46:30.598 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 2560 offset 4194816 len 8192 2024-09-21T01:46:30.598 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2560 offset 4194816 len 8192 2024-09-21T01:46:30.598 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 2560 offset 4194816 len 8192 2024-09-21T01:46:30.598 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2560 offset 4194816 len 8192 2024-09-21T01:46:30.598 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 2560 offset 4194816 len 16384 2024-09-21T01:46:30.598 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2560 offset 4194816 len 16384 2024-09-21T01:46:30.598 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 2560 offset 4194816 len 16384 2024-09-21T01:46:30.598 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2560 offset 4194816 len 16384 2024-09-21T01:46:30.598 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 2560 offset 4195328 len 1024 2024-09-21T01:46:30.598 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2560 offset 4195328 len 1024 2024-09-21T01:46:30.599 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 2560 offset 4195328 len 1024 2024-09-21T01:46:30.599 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2560 offset 4195328 len 1024 2024-09-21T01:46:30.599 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 2560 offset 4195328 len 2048 2024-09-21T01:46:30.599 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2560 offset 4195328 len 2048 2024-09-21T01:46:30.599 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 2560 offset 4195328 len 2048 2024-09-21T01:46:30.599 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2560 offset 4195328 len 2048 2024-09-21T01:46:30.599 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 2560 offset 4195328 len 4096 2024-09-21T01:46:30.599 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2560 offset 4195328 len 4096 2024-09-21T01:46:30.599 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 2560 offset 4195328 len 4096 2024-09-21T01:46:30.599 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2560 offset 4195328 len 4096 2024-09-21T01:46:30.599 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 2560 offset 4195328 len 8192 2024-09-21T01:46:30.599 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2560 offset 4195328 len 8192 2024-09-21T01:46:30.599 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 2560 offset 4195328 len 8192 2024-09-21T01:46:30.599 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2560 offset 4195328 len 8192 2024-09-21T01:46:30.600 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 2560 offset 4195328 len 16384 2024-09-21T01:46:30.600 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2560 offset 4195328 len 16384 2024-09-21T01:46:30.600 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 2560 offset 4195328 len 16384 2024-09-21T01:46:30.600 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2560 offset 4195328 len 16384 2024-09-21T01:46:30.600 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 2560 offset 4195840 len 1024 2024-09-21T01:46:30.600 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2560 offset 4195840 len 1024 2024-09-21T01:46:30.600 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 2560 offset 4195840 len 1024 2024-09-21T01:46:30.600 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2560 offset 4195840 len 1024 2024-09-21T01:46:30.600 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 2560 offset 4195840 len 2048 2024-09-21T01:46:30.600 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2560 offset 4195840 len 2048 2024-09-21T01:46:30.600 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 2560 offset 4195840 len 2048 2024-09-21T01:46:30.600 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2560 offset 4195840 len 2048 2024-09-21T01:46:30.600 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 2560 offset 4195840 len 4096 2024-09-21T01:46:30.600 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2560 offset 4195840 len 4096 2024-09-21T01:46:30.600 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 2560 offset 4195840 len 4096 2024-09-21T01:46:30.601 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2560 offset 4195840 len 4096 2024-09-21T01:46:30.601 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 2560 offset 4195840 len 8192 2024-09-21T01:46:30.601 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2560 offset 4195840 len 8192 2024-09-21T01:46:30.601 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 2560 offset 4195840 len 8192 2024-09-21T01:46:30.601 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2560 offset 4195840 len 8192 2024-09-21T01:46:30.601 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 2560 offset 4195840 len 16384 2024-09-21T01:46:30.601 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2560 offset 4195840 len 16384 2024-09-21T01:46:30.620 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 2560 offset 4195840 len 16384 2024-09-21T01:46:30.620 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2560 offset 4195840 len 16384 2024-09-21T01:46:30.620 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 2560 offset 4196352 len 1024 2024-09-21T01:46:30.620 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2560 offset 4196352 len 1024 2024-09-21T01:46:30.620 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 2560 offset 4196352 len 1024 2024-09-21T01:46:30.620 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2560 offset 4196352 len 1024 2024-09-21T01:46:30.620 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 2560 offset 4196352 len 2048 2024-09-21T01:46:30.620 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2560 offset 4196352 len 2048 2024-09-21T01:46:30.620 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 2560 offset 4196352 len 2048 2024-09-21T01:46:30.620 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2560 offset 4196352 len 2048 2024-09-21T01:46:30.620 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 2560 offset 4196352 len 4096 2024-09-21T01:46:30.620 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2560 offset 4196352 len 4096 2024-09-21T01:46:30.620 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 2560 offset 4196352 len 4096 2024-09-21T01:46:30.621 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2560 offset 4196352 len 4096 2024-09-21T01:46:30.621 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 2560 offset 4196352 len 8192 2024-09-21T01:46:30.621 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2560 offset 4196352 len 8192 2024-09-21T01:46:30.621 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 2560 offset 4196352 len 8192 2024-09-21T01:46:30.621 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2560 offset 4196352 len 8192 2024-09-21T01:46:30.621 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 2560 offset 4196352 len 16384 2024-09-21T01:46:30.621 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2560 offset 4196352 len 16384 2024-09-21T01:46:30.621 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 2560 offset 4196352 len 16384 2024-09-21T01:46:30.621 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2560 offset 4196352 len 16384 2024-09-21T01:46:30.621 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 2560 offset 4196864 len 1024 2024-09-21T01:46:30.621 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2560 offset 4196864 len 1024 2024-09-21T01:46:30.621 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 2560 offset 4196864 len 1024 2024-09-21T01:46:30.621 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2560 offset 4196864 len 1024 2024-09-21T01:46:30.621 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 2560 offset 4196864 len 2048 2024-09-21T01:46:30.621 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2560 offset 4196864 len 2048 2024-09-21T01:46:30.621 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 2560 offset 4196864 len 2048 2024-09-21T01:46:30.622 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2560 offset 4196864 len 2048 2024-09-21T01:46:30.622 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 2560 offset 4196864 len 4096 2024-09-21T01:46:30.622 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2560 offset 4196864 len 4096 2024-09-21T01:46:30.622 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 2560 offset 4196864 len 4096 2024-09-21T01:46:30.622 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2560 offset 4196864 len 4096 2024-09-21T01:46:30.622 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 2560 offset 4196864 len 8192 2024-09-21T01:46:30.622 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2560 offset 4196864 len 8192 2024-09-21T01:46:30.622 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 2560 offset 4196864 len 8192 2024-09-21T01:46:30.622 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2560 offset 4196864 len 8192 2024-09-21T01:46:30.622 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 2560 offset 4196864 len 16384 2024-09-21T01:46:30.622 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2560 offset 4196864 len 16384 2024-09-21T01:46:30.622 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 2560 offset 4196864 len 16384 2024-09-21T01:46:30.622 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2560 offset 4196864 len 16384 2024-09-21T01:46:30.623 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 2560 offset 4197376 len 1024 2024-09-21T01:46:30.623 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2560 offset 4197376 len 1024 2024-09-21T01:46:30.623 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 2560 offset 4197376 len 1024 2024-09-21T01:46:30.623 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2560 offset 4197376 len 1024 2024-09-21T01:46:30.623 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 2560 offset 4197376 len 2048 2024-09-21T01:46:30.623 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2560 offset 4197376 len 2048 2024-09-21T01:46:30.623 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 2560 offset 4197376 len 2048 2024-09-21T01:46:30.623 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2560 offset 4197376 len 2048 2024-09-21T01:46:30.623 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 2560 offset 4197376 len 4096 2024-09-21T01:46:30.623 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2560 offset 4197376 len 4096 2024-09-21T01:46:30.623 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 2560 offset 4197376 len 4096 2024-09-21T01:46:30.623 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2560 offset 4197376 len 4096 2024-09-21T01:46:30.623 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 2560 offset 4197376 len 8192 2024-09-21T01:46:30.623 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2560 offset 4197376 len 8192 2024-09-21T01:46:30.623 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 2560 offset 4197376 len 8192 2024-09-21T01:46:30.624 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2560 offset 4197376 len 8192 2024-09-21T01:46:30.624 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 2560 offset 4197376 len 16384 2024-09-21T01:46:30.624 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2560 offset 4197376 len 16384 2024-09-21T01:46:30.624 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 2560 offset 4197376 len 16384 2024-09-21T01:46:30.624 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2560 offset 4197376 len 16384 2024-09-21T01:46:30.624 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 2560 offset 4197888 len 1024 2024-09-21T01:46:30.624 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2560 offset 4197888 len 1024 2024-09-21T01:46:30.624 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 2560 offset 4197888 len 1024 2024-09-21T01:46:30.624 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2560 offset 4197888 len 1024 2024-09-21T01:46:30.624 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 2560 offset 4197888 len 2048 2024-09-21T01:46:30.624 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2560 offset 4197888 len 2048 2024-09-21T01:46:30.624 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 2560 offset 4197888 len 2048 2024-09-21T01:46:30.624 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2560 offset 4197888 len 2048 2024-09-21T01:46:30.624 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 2560 offset 4197888 len 4096 2024-09-21T01:46:30.624 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2560 offset 4197888 len 4096 2024-09-21T01:46:30.625 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 2560 offset 4197888 len 4096 2024-09-21T01:46:30.625 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2560 offset 4197888 len 4096 2024-09-21T01:46:30.625 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 2560 offset 4197888 len 8192 2024-09-21T01:46:30.625 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2560 offset 4197888 len 8192 2024-09-21T01:46:30.625 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 2560 offset 4197888 len 8192 2024-09-21T01:46:30.625 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2560 offset 4197888 len 8192 2024-09-21T01:46:30.625 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 2560 offset 4197888 len 16384 2024-09-21T01:46:30.625 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2560 offset 4197888 len 16384 2024-09-21T01:46:30.625 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 2560 offset 4197888 len 16384 2024-09-21T01:46:30.625 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 2560 offset 4197888 len 16384 2024-09-21T01:46:30.646 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 3072 offset 4190208 len 1024 2024-09-21T01:46:30.646 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3072 offset 4190208 len 1024 2024-09-21T01:46:30.646 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 3072 offset 4190208 len 1024 2024-09-21T01:46:30.646 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3072 offset 4190208 len 1024 2024-09-21T01:46:30.646 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 3072 offset 4190208 len 2048 2024-09-21T01:46:30.646 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3072 offset 4190208 len 2048 2024-09-21T01:46:30.646 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 3072 offset 4190208 len 2048 2024-09-21T01:46:30.646 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3072 offset 4190208 len 2048 2024-09-21T01:46:30.647 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 3072 offset 4190208 len 4096 2024-09-21T01:46:30.647 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3072 offset 4190208 len 4096 2024-09-21T01:46:30.647 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 3072 offset 4190208 len 4096 2024-09-21T01:46:30.647 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3072 offset 4190208 len 4096 2024-09-21T01:46:30.647 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 3072 offset 4190208 len 8192 2024-09-21T01:46:30.647 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3072 offset 4190208 len 8192 2024-09-21T01:46:30.647 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 3072 offset 4190208 len 8192 2024-09-21T01:46:30.647 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3072 offset 4190208 len 8192 2024-09-21T01:46:30.647 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 3072 offset 4190208 len 16384 2024-09-21T01:46:30.647 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3072 offset 4190208 len 16384 2024-09-21T01:46:30.647 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 3072 offset 4190208 len 16384 2024-09-21T01:46:30.647 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3072 offset 4190208 len 16384 2024-09-21T01:46:30.647 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 3072 offset 4190720 len 1024 2024-09-21T01:46:30.647 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3072 offset 4190720 len 1024 2024-09-21T01:46:30.647 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 3072 offset 4190720 len 1024 2024-09-21T01:46:30.648 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3072 offset 4190720 len 1024 2024-09-21T01:46:30.648 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 3072 offset 4190720 len 2048 2024-09-21T01:46:30.648 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3072 offset 4190720 len 2048 2024-09-21T01:46:30.648 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 3072 offset 4190720 len 2048 2024-09-21T01:46:30.648 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3072 offset 4190720 len 2048 2024-09-21T01:46:30.648 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 3072 offset 4190720 len 4096 2024-09-21T01:46:30.648 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3072 offset 4190720 len 4096 2024-09-21T01:46:30.648 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 3072 offset 4190720 len 4096 2024-09-21T01:46:30.648 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3072 offset 4190720 len 4096 2024-09-21T01:46:30.648 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 3072 offset 4190720 len 8192 2024-09-21T01:46:30.648 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3072 offset 4190720 len 8192 2024-09-21T01:46:30.648 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 3072 offset 4190720 len 8192 2024-09-21T01:46:30.648 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3072 offset 4190720 len 8192 2024-09-21T01:46:30.648 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 3072 offset 4190720 len 16384 2024-09-21T01:46:30.649 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3072 offset 4190720 len 16384 2024-09-21T01:46:30.649 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 3072 offset 4190720 len 16384 2024-09-21T01:46:30.649 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3072 offset 4190720 len 16384 2024-09-21T01:46:30.649 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 3072 offset 4191232 len 1024 2024-09-21T01:46:30.649 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3072 offset 4191232 len 1024 2024-09-21T01:46:30.649 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 3072 offset 4191232 len 1024 2024-09-21T01:46:30.649 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3072 offset 4191232 len 1024 2024-09-21T01:46:30.649 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 3072 offset 4191232 len 2048 2024-09-21T01:46:30.649 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3072 offset 4191232 len 2048 2024-09-21T01:46:30.649 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 3072 offset 4191232 len 2048 2024-09-21T01:46:30.649 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3072 offset 4191232 len 2048 2024-09-21T01:46:30.649 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 3072 offset 4191232 len 4096 2024-09-21T01:46:30.649 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3072 offset 4191232 len 4096 2024-09-21T01:46:30.649 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 3072 offset 4191232 len 4096 2024-09-21T01:46:30.650 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3072 offset 4191232 len 4096 2024-09-21T01:46:30.650 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 3072 offset 4191232 len 8192 2024-09-21T01:46:30.650 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3072 offset 4191232 len 8192 2024-09-21T01:46:30.650 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 3072 offset 4191232 len 8192 2024-09-21T01:46:30.650 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3072 offset 4191232 len 8192 2024-09-21T01:46:30.650 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 3072 offset 4191232 len 16384 2024-09-21T01:46:30.650 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3072 offset 4191232 len 16384 2024-09-21T01:46:30.650 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 3072 offset 4191232 len 16384 2024-09-21T01:46:30.650 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3072 offset 4191232 len 16384 2024-09-21T01:46:30.650 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 3072 offset 4191744 len 1024 2024-09-21T01:46:30.650 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3072 offset 4191744 len 1024 2024-09-21T01:46:30.650 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 3072 offset 4191744 len 1024 2024-09-21T01:46:30.650 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3072 offset 4191744 len 1024 2024-09-21T01:46:30.650 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 3072 offset 4191744 len 2048 2024-09-21T01:46:30.650 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3072 offset 4191744 len 2048 2024-09-21T01:46:30.651 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 3072 offset 4191744 len 2048 2024-09-21T01:46:30.651 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3072 offset 4191744 len 2048 2024-09-21T01:46:30.651 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 3072 offset 4191744 len 4096 2024-09-21T01:46:30.651 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3072 offset 4191744 len 4096 2024-09-21T01:46:30.651 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 3072 offset 4191744 len 4096 2024-09-21T01:46:30.651 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3072 offset 4191744 len 4096 2024-09-21T01:46:30.651 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 3072 offset 4191744 len 8192 2024-09-21T01:46:30.651 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3072 offset 4191744 len 8192 2024-09-21T01:46:30.651 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 3072 offset 4191744 len 8192 2024-09-21T01:46:30.651 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3072 offset 4191744 len 8192 2024-09-21T01:46:30.651 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 3072 offset 4191744 len 16384 2024-09-21T01:46:30.651 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3072 offset 4191744 len 16384 2024-09-21T01:46:30.651 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 3072 offset 4191744 len 16384 2024-09-21T01:46:30.651 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3072 offset 4191744 len 16384 2024-09-21T01:46:30.651 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 3072 offset 4192256 len 1024 2024-09-21T01:46:30.651 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3072 offset 4192256 len 1024 2024-09-21T01:46:30.652 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 3072 offset 4192256 len 1024 2024-09-21T01:46:30.674 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3072 offset 4192256 len 1024 2024-09-21T01:46:30.674 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 3072 offset 4192256 len 2048 2024-09-21T01:46:30.674 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3072 offset 4192256 len 2048 2024-09-21T01:46:30.674 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 3072 offset 4192256 len 2048 2024-09-21T01:46:30.674 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3072 offset 4192256 len 2048 2024-09-21T01:46:30.674 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 3072 offset 4192256 len 4096 2024-09-21T01:46:30.674 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3072 offset 4192256 len 4096 2024-09-21T01:46:30.674 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 3072 offset 4192256 len 4096 2024-09-21T01:46:30.674 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3072 offset 4192256 len 4096 2024-09-21T01:46:30.675 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 3072 offset 4192256 len 8192 2024-09-21T01:46:30.675 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3072 offset 4192256 len 8192 2024-09-21T01:46:30.675 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 3072 offset 4192256 len 8192 2024-09-21T01:46:30.675 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3072 offset 4192256 len 8192 2024-09-21T01:46:30.675 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 3072 offset 4192256 len 16384 2024-09-21T01:46:30.675 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3072 offset 4192256 len 16384 2024-09-21T01:46:30.675 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 3072 offset 4192256 len 16384 2024-09-21T01:46:30.675 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3072 offset 4192256 len 16384 2024-09-21T01:46:30.675 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 3072 offset 4192768 len 1024 2024-09-21T01:46:30.675 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3072 offset 4192768 len 1024 2024-09-21T01:46:30.675 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 3072 offset 4192768 len 1024 2024-09-21T01:46:30.675 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3072 offset 4192768 len 1024 2024-09-21T01:46:30.675 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 3072 offset 4192768 len 2048 2024-09-21T01:46:30.675 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3072 offset 4192768 len 2048 2024-09-21T01:46:30.675 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 3072 offset 4192768 len 2048 2024-09-21T01:46:30.676 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3072 offset 4192768 len 2048 2024-09-21T01:46:30.676 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 3072 offset 4192768 len 4096 2024-09-21T01:46:30.676 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3072 offset 4192768 len 4096 2024-09-21T01:46:30.676 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 3072 offset 4192768 len 4096 2024-09-21T01:46:30.676 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3072 offset 4192768 len 4096 2024-09-21T01:46:30.676 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 3072 offset 4192768 len 8192 2024-09-21T01:46:30.676 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3072 offset 4192768 len 8192 2024-09-21T01:46:30.676 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 3072 offset 4192768 len 8192 2024-09-21T01:46:30.676 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3072 offset 4192768 len 8192 2024-09-21T01:46:30.676 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 3072 offset 4192768 len 16384 2024-09-21T01:46:30.676 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3072 offset 4192768 len 16384 2024-09-21T01:46:30.676 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 3072 offset 4192768 len 16384 2024-09-21T01:46:30.676 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3072 offset 4192768 len 16384 2024-09-21T01:46:30.676 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 3072 offset 4193280 len 1024 2024-09-21T01:46:30.676 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3072 offset 4193280 len 1024 2024-09-21T01:46:30.677 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 3072 offset 4193280 len 1024 2024-09-21T01:46:30.677 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3072 offset 4193280 len 1024 2024-09-21T01:46:30.677 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 3072 offset 4193280 len 2048 2024-09-21T01:46:30.677 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3072 offset 4193280 len 2048 2024-09-21T01:46:30.677 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 3072 offset 4193280 len 2048 2024-09-21T01:46:30.677 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3072 offset 4193280 len 2048 2024-09-21T01:46:30.677 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 3072 offset 4193280 len 4096 2024-09-21T01:46:30.677 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3072 offset 4193280 len 4096 2024-09-21T01:46:30.677 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 3072 offset 4193280 len 4096 2024-09-21T01:46:30.677 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3072 offset 4193280 len 4096 2024-09-21T01:46:30.677 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 3072 offset 4193280 len 8192 2024-09-21T01:46:30.677 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3072 offset 4193280 len 8192 2024-09-21T01:46:30.677 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 3072 offset 4193280 len 8192 2024-09-21T01:46:30.678 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3072 offset 4193280 len 8192 2024-09-21T01:46:30.678 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 3072 offset 4193280 len 16384 2024-09-21T01:46:30.678 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3072 offset 4193280 len 16384 2024-09-21T01:46:30.678 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 3072 offset 4193280 len 16384 2024-09-21T01:46:30.678 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3072 offset 4193280 len 16384 2024-09-21T01:46:30.678 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 3072 offset 4193792 len 1024 2024-09-21T01:46:30.678 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3072 offset 4193792 len 1024 2024-09-21T01:46:30.678 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 3072 offset 4193792 len 1024 2024-09-21T01:46:30.678 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3072 offset 4193792 len 1024 2024-09-21T01:46:30.678 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 3072 offset 4193792 len 2048 2024-09-21T01:46:30.678 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3072 offset 4193792 len 2048 2024-09-21T01:46:30.678 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 3072 offset 4193792 len 2048 2024-09-21T01:46:30.678 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3072 offset 4193792 len 2048 2024-09-21T01:46:30.678 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 3072 offset 4193792 len 4096 2024-09-21T01:46:30.678 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3072 offset 4193792 len 4096 2024-09-21T01:46:30.679 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 3072 offset 4193792 len 4096 2024-09-21T01:46:30.679 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3072 offset 4193792 len 4096 2024-09-21T01:46:30.679 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 3072 offset 4193792 len 8192 2024-09-21T01:46:30.679 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3072 offset 4193792 len 8192 2024-09-21T01:46:30.679 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 3072 offset 4193792 len 8192 2024-09-21T01:46:30.679 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3072 offset 4193792 len 8192 2024-09-21T01:46:30.679 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 3072 offset 4193792 len 16384 2024-09-21T01:46:30.679 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3072 offset 4193792 len 16384 2024-09-21T01:46:30.679 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 3072 offset 4193792 len 16384 2024-09-21T01:46:30.679 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3072 offset 4193792 len 16384 2024-09-21T01:46:30.679 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 3072 offset 4194304 len 1024 2024-09-21T01:46:30.679 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3072 offset 4194304 len 1024 2024-09-21T01:46:30.679 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 3072 offset 4194304 len 1024 2024-09-21T01:46:30.679 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3072 offset 4194304 len 1024 2024-09-21T01:46:30.680 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 3072 offset 4194304 len 2048 2024-09-21T01:46:30.700 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3072 offset 4194304 len 2048 2024-09-21T01:46:30.700 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 3072 offset 4194304 len 2048 2024-09-21T01:46:30.700 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3072 offset 4194304 len 2048 2024-09-21T01:46:30.700 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 3072 offset 4194304 len 4096 2024-09-21T01:46:30.700 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3072 offset 4194304 len 4096 2024-09-21T01:46:30.700 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 3072 offset 4194304 len 4096 2024-09-21T01:46:30.700 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3072 offset 4194304 len 4096 2024-09-21T01:46:30.700 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 3072 offset 4194304 len 8192 2024-09-21T01:46:30.700 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3072 offset 4194304 len 8192 2024-09-21T01:46:30.700 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 3072 offset 4194304 len 8192 2024-09-21T01:46:30.701 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3072 offset 4194304 len 8192 2024-09-21T01:46:30.701 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 3072 offset 4194304 len 16384 2024-09-21T01:46:30.701 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3072 offset 4194304 len 16384 2024-09-21T01:46:30.701 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 3072 offset 4194304 len 16384 2024-09-21T01:46:30.701 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3072 offset 4194304 len 16384 2024-09-21T01:46:30.701 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 3072 offset 4194816 len 1024 2024-09-21T01:46:30.701 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3072 offset 4194816 len 1024 2024-09-21T01:46:30.701 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 3072 offset 4194816 len 1024 2024-09-21T01:46:30.701 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3072 offset 4194816 len 1024 2024-09-21T01:46:30.701 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 3072 offset 4194816 len 2048 2024-09-21T01:46:30.701 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3072 offset 4194816 len 2048 2024-09-21T01:46:30.701 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 3072 offset 4194816 len 2048 2024-09-21T01:46:30.701 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3072 offset 4194816 len 2048 2024-09-21T01:46:30.701 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 3072 offset 4194816 len 4096 2024-09-21T01:46:30.701 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3072 offset 4194816 len 4096 2024-09-21T01:46:30.702 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 3072 offset 4194816 len 4096 2024-09-21T01:46:30.702 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3072 offset 4194816 len 4096 2024-09-21T01:46:30.702 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 3072 offset 4194816 len 8192 2024-09-21T01:46:30.702 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3072 offset 4194816 len 8192 2024-09-21T01:46:30.702 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 3072 offset 4194816 len 8192 2024-09-21T01:46:30.702 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3072 offset 4194816 len 8192 2024-09-21T01:46:30.702 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 3072 offset 4194816 len 16384 2024-09-21T01:46:30.702 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3072 offset 4194816 len 16384 2024-09-21T01:46:30.702 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 3072 offset 4194816 len 16384 2024-09-21T01:46:30.702 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3072 offset 4194816 len 16384 2024-09-21T01:46:30.702 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 3072 offset 4195328 len 1024 2024-09-21T01:46:30.702 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3072 offset 4195328 len 1024 2024-09-21T01:46:30.702 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 3072 offset 4195328 len 1024 2024-09-21T01:46:30.702 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3072 offset 4195328 len 1024 2024-09-21T01:46:30.703 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 3072 offset 4195328 len 2048 2024-09-21T01:46:30.703 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3072 offset 4195328 len 2048 2024-09-21T01:46:30.703 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 3072 offset 4195328 len 2048 2024-09-21T01:46:30.703 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3072 offset 4195328 len 2048 2024-09-21T01:46:30.703 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 3072 offset 4195328 len 4096 2024-09-21T01:46:30.703 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3072 offset 4195328 len 4096 2024-09-21T01:46:30.703 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 3072 offset 4195328 len 4096 2024-09-21T01:46:30.703 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3072 offset 4195328 len 4096 2024-09-21T01:46:30.703 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 3072 offset 4195328 len 8192 2024-09-21T01:46:30.703 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3072 offset 4195328 len 8192 2024-09-21T01:46:30.703 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 3072 offset 4195328 len 8192 2024-09-21T01:46:30.703 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3072 offset 4195328 len 8192 2024-09-21T01:46:30.703 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 3072 offset 4195328 len 16384 2024-09-21T01:46:30.703 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3072 offset 4195328 len 16384 2024-09-21T01:46:30.703 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 3072 offset 4195328 len 16384 2024-09-21T01:46:30.704 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3072 offset 4195328 len 16384 2024-09-21T01:46:30.704 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 3072 offset 4195840 len 1024 2024-09-21T01:46:30.704 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3072 offset 4195840 len 1024 2024-09-21T01:46:30.704 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 3072 offset 4195840 len 1024 2024-09-21T01:46:30.704 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3072 offset 4195840 len 1024 2024-09-21T01:46:30.704 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 3072 offset 4195840 len 2048 2024-09-21T01:46:30.704 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3072 offset 4195840 len 2048 2024-09-21T01:46:30.704 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 3072 offset 4195840 len 2048 2024-09-21T01:46:30.704 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3072 offset 4195840 len 2048 2024-09-21T01:46:30.704 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 3072 offset 4195840 len 4096 2024-09-21T01:46:30.704 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3072 offset 4195840 len 4096 2024-09-21T01:46:30.704 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 3072 offset 4195840 len 4096 2024-09-21T01:46:30.704 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3072 offset 4195840 len 4096 2024-09-21T01:46:30.704 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 3072 offset 4195840 len 8192 2024-09-21T01:46:30.704 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3072 offset 4195840 len 8192 2024-09-21T01:46:30.705 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 3072 offset 4195840 len 8192 2024-09-21T01:46:30.705 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3072 offset 4195840 len 8192 2024-09-21T01:46:30.705 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 3072 offset 4195840 len 16384 2024-09-21T01:46:30.705 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3072 offset 4195840 len 16384 2024-09-21T01:46:30.705 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 3072 offset 4195840 len 16384 2024-09-21T01:46:30.705 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3072 offset 4195840 len 16384 2024-09-21T01:46:30.705 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 3072 offset 4196352 len 1024 2024-09-21T01:46:30.705 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3072 offset 4196352 len 1024 2024-09-21T01:46:30.705 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 3072 offset 4196352 len 1024 2024-09-21T01:46:30.705 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3072 offset 4196352 len 1024 2024-09-21T01:46:30.705 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 3072 offset 4196352 len 2048 2024-09-21T01:46:30.705 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3072 offset 4196352 len 2048 2024-09-21T01:46:30.705 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 3072 offset 4196352 len 2048 2024-09-21T01:46:30.705 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3072 offset 4196352 len 2048 2024-09-21T01:46:30.728 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 3072 offset 4196352 len 4096 2024-09-21T01:46:30.728 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3072 offset 4196352 len 4096 2024-09-21T01:46:30.728 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 3072 offset 4196352 len 4096 2024-09-21T01:46:30.729 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3072 offset 4196352 len 4096 2024-09-21T01:46:30.729 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 3072 offset 4196352 len 8192 2024-09-21T01:46:30.729 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3072 offset 4196352 len 8192 2024-09-21T01:46:30.729 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 3072 offset 4196352 len 8192 2024-09-21T01:46:30.729 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3072 offset 4196352 len 8192 2024-09-21T01:46:30.729 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 3072 offset 4196352 len 16384 2024-09-21T01:46:30.729 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3072 offset 4196352 len 16384 2024-09-21T01:46:30.729 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 3072 offset 4196352 len 16384 2024-09-21T01:46:30.729 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3072 offset 4196352 len 16384 2024-09-21T01:46:30.729 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 3072 offset 4196864 len 1024 2024-09-21T01:46:30.729 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3072 offset 4196864 len 1024 2024-09-21T01:46:30.729 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 3072 offset 4196864 len 1024 2024-09-21T01:46:30.729 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3072 offset 4196864 len 1024 2024-09-21T01:46:30.729 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 3072 offset 4196864 len 2048 2024-09-21T01:46:30.729 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3072 offset 4196864 len 2048 2024-09-21T01:46:30.730 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 3072 offset 4196864 len 2048 2024-09-21T01:46:30.730 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3072 offset 4196864 len 2048 2024-09-21T01:46:30.730 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 3072 offset 4196864 len 4096 2024-09-21T01:46:30.730 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3072 offset 4196864 len 4096 2024-09-21T01:46:30.730 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 3072 offset 4196864 len 4096 2024-09-21T01:46:30.730 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3072 offset 4196864 len 4096 2024-09-21T01:46:30.730 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 3072 offset 4196864 len 8192 2024-09-21T01:46:30.730 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3072 offset 4196864 len 8192 2024-09-21T01:46:30.730 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 3072 offset 4196864 len 8192 2024-09-21T01:46:30.730 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3072 offset 4196864 len 8192 2024-09-21T01:46:30.730 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 3072 offset 4196864 len 16384 2024-09-21T01:46:30.730 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3072 offset 4196864 len 16384 2024-09-21T01:46:30.730 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 3072 offset 4196864 len 16384 2024-09-21T01:46:30.730 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3072 offset 4196864 len 16384 2024-09-21T01:46:30.731 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 3072 offset 4197376 len 1024 2024-09-21T01:46:30.731 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3072 offset 4197376 len 1024 2024-09-21T01:46:30.731 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 3072 offset 4197376 len 1024 2024-09-21T01:46:30.731 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3072 offset 4197376 len 1024 2024-09-21T01:46:30.731 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 3072 offset 4197376 len 2048 2024-09-21T01:46:30.731 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3072 offset 4197376 len 2048 2024-09-21T01:46:30.731 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 3072 offset 4197376 len 2048 2024-09-21T01:46:30.731 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3072 offset 4197376 len 2048 2024-09-21T01:46:30.731 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 3072 offset 4197376 len 4096 2024-09-21T01:46:30.731 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3072 offset 4197376 len 4096 2024-09-21T01:46:30.731 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 3072 offset 4197376 len 4096 2024-09-21T01:46:30.731 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3072 offset 4197376 len 4096 2024-09-21T01:46:30.731 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 3072 offset 4197376 len 8192 2024-09-21T01:46:30.731 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3072 offset 4197376 len 8192 2024-09-21T01:46:30.731 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 3072 offset 4197376 len 8192 2024-09-21T01:46:30.732 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3072 offset 4197376 len 8192 2024-09-21T01:46:30.732 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 3072 offset 4197376 len 16384 2024-09-21T01:46:30.732 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3072 offset 4197376 len 16384 2024-09-21T01:46:30.732 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 3072 offset 4197376 len 16384 2024-09-21T01:46:30.732 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3072 offset 4197376 len 16384 2024-09-21T01:46:30.732 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 3072 offset 4197888 len 1024 2024-09-21T01:46:30.732 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3072 offset 4197888 len 1024 2024-09-21T01:46:30.732 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 3072 offset 4197888 len 1024 2024-09-21T01:46:30.732 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3072 offset 4197888 len 1024 2024-09-21T01:46:30.732 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 3072 offset 4197888 len 2048 2024-09-21T01:46:30.732 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3072 offset 4197888 len 2048 2024-09-21T01:46:30.732 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 3072 offset 4197888 len 2048 2024-09-21T01:46:30.732 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3072 offset 4197888 len 2048 2024-09-21T01:46:30.732 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 3072 offset 4197888 len 4096 2024-09-21T01:46:30.732 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3072 offset 4197888 len 4096 2024-09-21T01:46:30.733 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 3072 offset 4197888 len 4096 2024-09-21T01:46:30.733 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3072 offset 4197888 len 4096 2024-09-21T01:46:30.733 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 3072 offset 4197888 len 8192 2024-09-21T01:46:30.733 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3072 offset 4197888 len 8192 2024-09-21T01:46:30.733 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 3072 offset 4197888 len 8192 2024-09-21T01:46:30.733 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3072 offset 4197888 len 8192 2024-09-21T01:46:30.733 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 3072 offset 4197888 len 16384 2024-09-21T01:46:30.733 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3072 offset 4197888 len 16384 2024-09-21T01:46:30.733 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 3072 offset 4197888 len 16384 2024-09-21T01:46:30.733 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3072 offset 4197888 len 16384 2024-09-21T01:46:30.733 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 3584 offset 4190208 len 1024 2024-09-21T01:46:30.733 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3584 offset 4190208 len 1024 2024-09-21T01:46:30.733 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 3584 offset 4190208 len 1024 2024-09-21T01:46:30.733 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3584 offset 4190208 len 1024 2024-09-21T01:46:30.733 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 3584 offset 4190208 len 2048 2024-09-21T01:46:30.734 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3584 offset 4190208 len 2048 2024-09-21T01:46:30.734 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 3584 offset 4190208 len 2048 2024-09-21T01:46:30.734 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3584 offset 4190208 len 2048 2024-09-21T01:46:30.734 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 3584 offset 4190208 len 4096 2024-09-21T01:46:30.734 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3584 offset 4190208 len 4096 2024-09-21T01:46:30.758 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 3584 offset 4190208 len 4096 2024-09-21T01:46:30.758 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3584 offset 4190208 len 4096 2024-09-21T01:46:30.758 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 3584 offset 4190208 len 8192 2024-09-21T01:46:30.759 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3584 offset 4190208 len 8192 2024-09-21T01:46:30.759 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 3584 offset 4190208 len 8192 2024-09-21T01:46:30.759 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3584 offset 4190208 len 8192 2024-09-21T01:46:30.759 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 3584 offset 4190208 len 16384 2024-09-21T01:46:30.759 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3584 offset 4190208 len 16384 2024-09-21T01:46:30.759 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 3584 offset 4190208 len 16384 2024-09-21T01:46:30.759 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3584 offset 4190208 len 16384 2024-09-21T01:46:30.759 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 3584 offset 4190720 len 1024 2024-09-21T01:46:30.759 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3584 offset 4190720 len 1024 2024-09-21T01:46:30.759 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 3584 offset 4190720 len 1024 2024-09-21T01:46:30.759 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3584 offset 4190720 len 1024 2024-09-21T01:46:30.759 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 3584 offset 4190720 len 2048 2024-09-21T01:46:30.759 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3584 offset 4190720 len 2048 2024-09-21T01:46:30.759 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 3584 offset 4190720 len 2048 2024-09-21T01:46:30.759 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3584 offset 4190720 len 2048 2024-09-21T01:46:30.760 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 3584 offset 4190720 len 4096 2024-09-21T01:46:30.760 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3584 offset 4190720 len 4096 2024-09-21T01:46:30.760 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 3584 offset 4190720 len 4096 2024-09-21T01:46:30.760 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3584 offset 4190720 len 4096 2024-09-21T01:46:30.760 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 3584 offset 4190720 len 8192 2024-09-21T01:46:30.760 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3584 offset 4190720 len 8192 2024-09-21T01:46:30.760 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 3584 offset 4190720 len 8192 2024-09-21T01:46:30.760 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3584 offset 4190720 len 8192 2024-09-21T01:46:30.760 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 3584 offset 4190720 len 16384 2024-09-21T01:46:30.760 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3584 offset 4190720 len 16384 2024-09-21T01:46:30.760 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 3584 offset 4190720 len 16384 2024-09-21T01:46:30.760 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3584 offset 4190720 len 16384 2024-09-21T01:46:30.760 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 3584 offset 4191232 len 1024 2024-09-21T01:46:30.760 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3584 offset 4191232 len 1024 2024-09-21T01:46:30.760 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 3584 offset 4191232 len 1024 2024-09-21T01:46:30.761 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3584 offset 4191232 len 1024 2024-09-21T01:46:30.761 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 3584 offset 4191232 len 2048 2024-09-21T01:46:30.761 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3584 offset 4191232 len 2048 2024-09-21T01:46:30.761 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 3584 offset 4191232 len 2048 2024-09-21T01:46:30.761 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3584 offset 4191232 len 2048 2024-09-21T01:46:30.761 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 3584 offset 4191232 len 4096 2024-09-21T01:46:30.761 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3584 offset 4191232 len 4096 2024-09-21T01:46:30.761 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 3584 offset 4191232 len 4096 2024-09-21T01:46:30.761 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3584 offset 4191232 len 4096 2024-09-21T01:46:30.761 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 3584 offset 4191232 len 8192 2024-09-21T01:46:30.761 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3584 offset 4191232 len 8192 2024-09-21T01:46:30.761 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 3584 offset 4191232 len 8192 2024-09-21T01:46:30.761 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3584 offset 4191232 len 8192 2024-09-21T01:46:30.761 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 3584 offset 4191232 len 16384 2024-09-21T01:46:30.761 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3584 offset 4191232 len 16384 2024-09-21T01:46:30.762 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 3584 offset 4191232 len 16384 2024-09-21T01:46:30.762 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3584 offset 4191232 len 16384 2024-09-21T01:46:30.762 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 3584 offset 4191744 len 1024 2024-09-21T01:46:30.762 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3584 offset 4191744 len 1024 2024-09-21T01:46:30.762 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 3584 offset 4191744 len 1024 2024-09-21T01:46:30.762 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3584 offset 4191744 len 1024 2024-09-21T01:46:30.762 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 3584 offset 4191744 len 2048 2024-09-21T01:46:30.762 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3584 offset 4191744 len 2048 2024-09-21T01:46:30.762 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 3584 offset 4191744 len 2048 2024-09-21T01:46:30.762 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3584 offset 4191744 len 2048 2024-09-21T01:46:30.762 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 3584 offset 4191744 len 4096 2024-09-21T01:46:30.762 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3584 offset 4191744 len 4096 2024-09-21T01:46:30.762 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 3584 offset 4191744 len 4096 2024-09-21T01:46:30.762 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3584 offset 4191744 len 4096 2024-09-21T01:46:30.762 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 3584 offset 4191744 len 8192 2024-09-21T01:46:30.763 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3584 offset 4191744 len 8192 2024-09-21T01:46:30.763 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 3584 offset 4191744 len 8192 2024-09-21T01:46:30.763 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3584 offset 4191744 len 8192 2024-09-21T01:46:30.763 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 3584 offset 4191744 len 16384 2024-09-21T01:46:30.763 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3584 offset 4191744 len 16384 2024-09-21T01:46:30.763 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 3584 offset 4191744 len 16384 2024-09-21T01:46:30.763 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3584 offset 4191744 len 16384 2024-09-21T01:46:30.763 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 3584 offset 4192256 len 1024 2024-09-21T01:46:30.763 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3584 offset 4192256 len 1024 2024-09-21T01:46:30.763 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 3584 offset 4192256 len 1024 2024-09-21T01:46:30.763 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3584 offset 4192256 len 1024 2024-09-21T01:46:30.763 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 3584 offset 4192256 len 2048 2024-09-21T01:46:30.763 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3584 offset 4192256 len 2048 2024-09-21T01:46:30.763 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 3584 offset 4192256 len 2048 2024-09-21T01:46:30.763 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3584 offset 4192256 len 2048 2024-09-21T01:46:30.764 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 3584 offset 4192256 len 4096 2024-09-21T01:46:30.764 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3584 offset 4192256 len 4096 2024-09-21T01:46:30.764 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 3584 offset 4192256 len 4096 2024-09-21T01:46:30.764 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3584 offset 4192256 len 4096 2024-09-21T01:46:30.764 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 3584 offset 4192256 len 8192 2024-09-21T01:46:30.787 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3584 offset 4192256 len 8192 2024-09-21T01:46:30.787 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 3584 offset 4192256 len 8192 2024-09-21T01:46:30.788 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3584 offset 4192256 len 8192 2024-09-21T01:46:30.788 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 3584 offset 4192256 len 16384 2024-09-21T01:46:30.788 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3584 offset 4192256 len 16384 2024-09-21T01:46:30.788 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 3584 offset 4192256 len 16384 2024-09-21T01:46:30.788 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3584 offset 4192256 len 16384 2024-09-21T01:46:30.788 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 3584 offset 4192768 len 1024 2024-09-21T01:46:30.788 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3584 offset 4192768 len 1024 2024-09-21T01:46:30.788 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 3584 offset 4192768 len 1024 2024-09-21T01:46:30.788 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3584 offset 4192768 len 1024 2024-09-21T01:46:30.788 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 3584 offset 4192768 len 2048 2024-09-21T01:46:30.789 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3584 offset 4192768 len 2048 2024-09-21T01:46:30.789 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 3584 offset 4192768 len 2048 2024-09-21T01:46:30.789 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3584 offset 4192768 len 2048 2024-09-21T01:46:30.789 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 3584 offset 4192768 len 4096 2024-09-21T01:46:30.789 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3584 offset 4192768 len 4096 2024-09-21T01:46:30.789 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 3584 offset 4192768 len 4096 2024-09-21T01:46:30.789 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3584 offset 4192768 len 4096 2024-09-21T01:46:30.789 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 3584 offset 4192768 len 8192 2024-09-21T01:46:30.789 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3584 offset 4192768 len 8192 2024-09-21T01:46:30.789 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 3584 offset 4192768 len 8192 2024-09-21T01:46:30.789 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3584 offset 4192768 len 8192 2024-09-21T01:46:30.789 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 3584 offset 4192768 len 16384 2024-09-21T01:46:30.789 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3584 offset 4192768 len 16384 2024-09-21T01:46:30.789 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 3584 offset 4192768 len 16384 2024-09-21T01:46:30.790 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3584 offset 4192768 len 16384 2024-09-21T01:46:30.790 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 3584 offset 4193280 len 1024 2024-09-21T01:46:30.790 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3584 offset 4193280 len 1024 2024-09-21T01:46:30.790 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 3584 offset 4193280 len 1024 2024-09-21T01:46:30.790 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3584 offset 4193280 len 1024 2024-09-21T01:46:30.790 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 3584 offset 4193280 len 2048 2024-09-21T01:46:30.790 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3584 offset 4193280 len 2048 2024-09-21T01:46:30.790 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 3584 offset 4193280 len 2048 2024-09-21T01:46:30.790 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3584 offset 4193280 len 2048 2024-09-21T01:46:30.790 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 3584 offset 4193280 len 4096 2024-09-21T01:46:30.790 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3584 offset 4193280 len 4096 2024-09-21T01:46:30.790 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 3584 offset 4193280 len 4096 2024-09-21T01:46:30.790 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3584 offset 4193280 len 4096 2024-09-21T01:46:30.791 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 3584 offset 4193280 len 8192 2024-09-21T01:46:30.791 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3584 offset 4193280 len 8192 2024-09-21T01:46:30.791 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 3584 offset 4193280 len 8192 2024-09-21T01:46:30.791 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3584 offset 4193280 len 8192 2024-09-21T01:46:30.791 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 3584 offset 4193280 len 16384 2024-09-21T01:46:30.791 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3584 offset 4193280 len 16384 2024-09-21T01:46:30.791 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 3584 offset 4193280 len 16384 2024-09-21T01:46:30.791 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3584 offset 4193280 len 16384 2024-09-21T01:46:30.791 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 3584 offset 4193792 len 1024 2024-09-21T01:46:30.791 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3584 offset 4193792 len 1024 2024-09-21T01:46:30.791 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 3584 offset 4193792 len 1024 2024-09-21T01:46:30.791 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3584 offset 4193792 len 1024 2024-09-21T01:46:30.791 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 3584 offset 4193792 len 2048 2024-09-21T01:46:30.792 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3584 offset 4193792 len 2048 2024-09-21T01:46:30.792 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 3584 offset 4193792 len 2048 2024-09-21T01:46:30.792 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3584 offset 4193792 len 2048 2024-09-21T01:46:30.792 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 3584 offset 4193792 len 4096 2024-09-21T01:46:30.792 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3584 offset 4193792 len 4096 2024-09-21T01:46:30.792 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 3584 offset 4193792 len 4096 2024-09-21T01:46:30.792 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3584 offset 4193792 len 4096 2024-09-21T01:46:30.792 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 3584 offset 4193792 len 8192 2024-09-21T01:46:30.792 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3584 offset 4193792 len 8192 2024-09-21T01:46:30.792 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 3584 offset 4193792 len 8192 2024-09-21T01:46:30.792 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3584 offset 4193792 len 8192 2024-09-21T01:46:30.792 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 3584 offset 4193792 len 16384 2024-09-21T01:46:30.792 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3584 offset 4193792 len 16384 2024-09-21T01:46:30.793 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 3584 offset 4193792 len 16384 2024-09-21T01:46:30.793 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3584 offset 4193792 len 16384 2024-09-21T01:46:30.793 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 3584 offset 4194304 len 1024 2024-09-21T01:46:30.793 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3584 offset 4194304 len 1024 2024-09-21T01:46:30.793 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 3584 offset 4194304 len 1024 2024-09-21T01:46:30.793 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3584 offset 4194304 len 1024 2024-09-21T01:46:30.793 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 3584 offset 4194304 len 2048 2024-09-21T01:46:30.793 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3584 offset 4194304 len 2048 2024-09-21T01:46:30.793 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 3584 offset 4194304 len 2048 2024-09-21T01:46:30.793 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3584 offset 4194304 len 2048 2024-09-21T01:46:30.793 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 3584 offset 4194304 len 4096 2024-09-21T01:46:30.793 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3584 offset 4194304 len 4096 2024-09-21T01:46:30.794 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 3584 offset 4194304 len 4096 2024-09-21T01:46:30.794 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3584 offset 4194304 len 4096 2024-09-21T01:46:30.794 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 3584 offset 4194304 len 8192 2024-09-21T01:46:30.794 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3584 offset 4194304 len 8192 2024-09-21T01:46:30.794 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 3584 offset 4194304 len 8192 2024-09-21T01:46:30.813 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3584 offset 4194304 len 8192 2024-09-21T01:46:30.813 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 3584 offset 4194304 len 16384 2024-09-21T01:46:30.813 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3584 offset 4194304 len 16384 2024-09-21T01:46:30.813 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 3584 offset 4194304 len 16384 2024-09-21T01:46:30.813 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3584 offset 4194304 len 16384 2024-09-21T01:46:30.813 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 3584 offset 4194816 len 1024 2024-09-21T01:46:30.813 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3584 offset 4194816 len 1024 2024-09-21T01:46:30.813 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 3584 offset 4194816 len 1024 2024-09-21T01:46:30.814 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3584 offset 4194816 len 1024 2024-09-21T01:46:30.814 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 3584 offset 4194816 len 2048 2024-09-21T01:46:30.814 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3584 offset 4194816 len 2048 2024-09-21T01:46:30.814 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 3584 offset 4194816 len 2048 2024-09-21T01:46:30.814 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3584 offset 4194816 len 2048 2024-09-21T01:46:30.814 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 3584 offset 4194816 len 4096 2024-09-21T01:46:30.814 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3584 offset 4194816 len 4096 2024-09-21T01:46:30.814 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 3584 offset 4194816 len 4096 2024-09-21T01:46:30.814 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3584 offset 4194816 len 4096 2024-09-21T01:46:30.814 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 3584 offset 4194816 len 8192 2024-09-21T01:46:30.814 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3584 offset 4194816 len 8192 2024-09-21T01:46:30.814 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 3584 offset 4194816 len 8192 2024-09-21T01:46:30.814 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3584 offset 4194816 len 8192 2024-09-21T01:46:30.814 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 3584 offset 4194816 len 16384 2024-09-21T01:46:30.815 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3584 offset 4194816 len 16384 2024-09-21T01:46:30.815 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 3584 offset 4194816 len 16384 2024-09-21T01:46:30.815 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3584 offset 4194816 len 16384 2024-09-21T01:46:30.815 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 3584 offset 4195328 len 1024 2024-09-21T01:46:30.815 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3584 offset 4195328 len 1024 2024-09-21T01:46:30.815 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 3584 offset 4195328 len 1024 2024-09-21T01:46:30.815 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3584 offset 4195328 len 1024 2024-09-21T01:46:30.815 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 3584 offset 4195328 len 2048 2024-09-21T01:46:30.816 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3584 offset 4195328 len 2048 2024-09-21T01:46:30.816 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 3584 offset 4195328 len 2048 2024-09-21T01:46:30.816 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3584 offset 4195328 len 2048 2024-09-21T01:46:30.816 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 3584 offset 4195328 len 4096 2024-09-21T01:46:30.816 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3584 offset 4195328 len 4096 2024-09-21T01:46:30.816 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 3584 offset 4195328 len 4096 2024-09-21T01:46:30.816 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3584 offset 4195328 len 4096 2024-09-21T01:46:30.816 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 3584 offset 4195328 len 8192 2024-09-21T01:46:30.816 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3584 offset 4195328 len 8192 2024-09-21T01:46:30.816 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 3584 offset 4195328 len 8192 2024-09-21T01:46:30.816 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3584 offset 4195328 len 8192 2024-09-21T01:46:30.817 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 3584 offset 4195328 len 16384 2024-09-21T01:46:30.817 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3584 offset 4195328 len 16384 2024-09-21T01:46:30.817 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 3584 offset 4195328 len 16384 2024-09-21T01:46:30.817 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3584 offset 4195328 len 16384 2024-09-21T01:46:30.817 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 3584 offset 4195840 len 1024 2024-09-21T01:46:30.817 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3584 offset 4195840 len 1024 2024-09-21T01:46:30.817 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 3584 offset 4195840 len 1024 2024-09-21T01:46:30.817 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3584 offset 4195840 len 1024 2024-09-21T01:46:30.817 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 3584 offset 4195840 len 2048 2024-09-21T01:46:30.817 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3584 offset 4195840 len 2048 2024-09-21T01:46:30.817 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 3584 offset 4195840 len 2048 2024-09-21T01:46:30.817 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3584 offset 4195840 len 2048 2024-09-21T01:46:30.817 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 3584 offset 4195840 len 4096 2024-09-21T01:46:30.818 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3584 offset 4195840 len 4096 2024-09-21T01:46:30.818 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 3584 offset 4195840 len 4096 2024-09-21T01:46:30.818 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3584 offset 4195840 len 4096 2024-09-21T01:46:30.818 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 3584 offset 4195840 len 8192 2024-09-21T01:46:30.818 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3584 offset 4195840 len 8192 2024-09-21T01:46:30.818 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 3584 offset 4195840 len 8192 2024-09-21T01:46:30.818 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3584 offset 4195840 len 8192 2024-09-21T01:46:30.818 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 3584 offset 4195840 len 16384 2024-09-21T01:46:30.818 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3584 offset 4195840 len 16384 2024-09-21T01:46:30.818 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 3584 offset 4195840 len 16384 2024-09-21T01:46:30.818 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3584 offset 4195840 len 16384 2024-09-21T01:46:30.818 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 3584 offset 4196352 len 1024 2024-09-21T01:46:30.818 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3584 offset 4196352 len 1024 2024-09-21T01:46:30.818 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 3584 offset 4196352 len 1024 2024-09-21T01:46:30.819 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3584 offset 4196352 len 1024 2024-09-21T01:46:30.819 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 3584 offset 4196352 len 2048 2024-09-21T01:46:30.819 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3584 offset 4196352 len 2048 2024-09-21T01:46:30.819 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 3584 offset 4196352 len 2048 2024-09-21T01:46:30.819 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3584 offset 4196352 len 2048 2024-09-21T01:46:30.819 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 3584 offset 4196352 len 4096 2024-09-21T01:46:30.819 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3584 offset 4196352 len 4096 2024-09-21T01:46:30.819 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 3584 offset 4196352 len 4096 2024-09-21T01:46:30.819 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3584 offset 4196352 len 4096 2024-09-21T01:46:30.819 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 3584 offset 4196352 len 8192 2024-09-21T01:46:30.819 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3584 offset 4196352 len 8192 2024-09-21T01:46:30.819 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 3584 offset 4196352 len 8192 2024-09-21T01:46:30.819 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3584 offset 4196352 len 8192 2024-09-21T01:46:30.819 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 3584 offset 4196352 len 16384 2024-09-21T01:46:31.037 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3584 offset 4196352 len 16384 2024-09-21T01:46:31.037 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 3584 offset 4196352 len 16384 2024-09-21T01:46:31.037 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3584 offset 4196352 len 16384 2024-09-21T01:46:31.037 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 3584 offset 4196864 len 1024 2024-09-21T01:46:31.037 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3584 offset 4196864 len 1024 2024-09-21T01:46:31.037 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 3584 offset 4196864 len 1024 2024-09-21T01:46:31.037 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3584 offset 4196864 len 1024 2024-09-21T01:46:31.037 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 3584 offset 4196864 len 2048 2024-09-21T01:46:31.037 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3584 offset 4196864 len 2048 2024-09-21T01:46:31.038 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 3584 offset 4196864 len 2048 2024-09-21T01:46:31.038 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3584 offset 4196864 len 2048 2024-09-21T01:46:31.038 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 3584 offset 4196864 len 4096 2024-09-21T01:46:31.038 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3584 offset 4196864 len 4096 2024-09-21T01:46:31.038 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 3584 offset 4196864 len 4096 2024-09-21T01:46:31.038 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3584 offset 4196864 len 4096 2024-09-21T01:46:31.038 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 3584 offset 4196864 len 8192 2024-09-21T01:46:31.038 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3584 offset 4196864 len 8192 2024-09-21T01:46:31.038 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 3584 offset 4196864 len 8192 2024-09-21T01:46:31.038 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3584 offset 4196864 len 8192 2024-09-21T01:46:31.038 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 3584 offset 4196864 len 16384 2024-09-21T01:46:31.038 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3584 offset 4196864 len 16384 2024-09-21T01:46:31.038 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 3584 offset 4196864 len 16384 2024-09-21T01:46:31.038 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3584 offset 4196864 len 16384 2024-09-21T01:46:31.039 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 3584 offset 4197376 len 1024 2024-09-21T01:46:31.039 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3584 offset 4197376 len 1024 2024-09-21T01:46:31.039 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 3584 offset 4197376 len 1024 2024-09-21T01:46:31.039 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3584 offset 4197376 len 1024 2024-09-21T01:46:31.039 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 3584 offset 4197376 len 2048 2024-09-21T01:46:31.039 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3584 offset 4197376 len 2048 2024-09-21T01:46:31.039 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 3584 offset 4197376 len 2048 2024-09-21T01:46:31.039 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3584 offset 4197376 len 2048 2024-09-21T01:46:31.039 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 3584 offset 4197376 len 4096 2024-09-21T01:46:31.039 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3584 offset 4197376 len 4096 2024-09-21T01:46:31.039 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 3584 offset 4197376 len 4096 2024-09-21T01:46:31.039 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3584 offset 4197376 len 4096 2024-09-21T01:46:31.039 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 3584 offset 4197376 len 8192 2024-09-21T01:46:31.039 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3584 offset 4197376 len 8192 2024-09-21T01:46:31.039 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 3584 offset 4197376 len 8192 2024-09-21T01:46:31.040 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3584 offset 4197376 len 8192 2024-09-21T01:46:31.040 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 3584 offset 4197376 len 16384 2024-09-21T01:46:31.040 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3584 offset 4197376 len 16384 2024-09-21T01:46:31.040 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 3584 offset 4197376 len 16384 2024-09-21T01:46:31.040 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3584 offset 4197376 len 16384 2024-09-21T01:46:31.040 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 3584 offset 4197888 len 1024 2024-09-21T01:46:31.040 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3584 offset 4197888 len 1024 2024-09-21T01:46:31.040 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 3584 offset 4197888 len 1024 2024-09-21T01:46:31.040 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3584 offset 4197888 len 1024 2024-09-21T01:46:31.040 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 3584 offset 4197888 len 2048 2024-09-21T01:46:31.040 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3584 offset 4197888 len 2048 2024-09-21T01:46:31.040 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 3584 offset 4197888 len 2048 2024-09-21T01:46:31.040 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3584 offset 4197888 len 2048 2024-09-21T01:46:31.040 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 3584 offset 4197888 len 4096 2024-09-21T01:46:31.041 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3584 offset 4197888 len 4096 2024-09-21T01:46:31.041 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 3584 offset 4197888 len 4096 2024-09-21T01:46:31.041 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3584 offset 4197888 len 4096 2024-09-21T01:46:31.041 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 3584 offset 4197888 len 8192 2024-09-21T01:46:31.041 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3584 offset 4197888 len 8192 2024-09-21T01:46:31.041 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 3584 offset 4197888 len 8192 2024-09-21T01:46:31.041 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3584 offset 4197888 len 8192 2024-09-21T01:46:31.041 INFO:tasks.workunit.client.0.smithi083.stdout:read_direct buf_align 3584 offset 4197888 len 16384 2024-09-21T01:46:31.041 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3584 offset 4197888 len 16384 2024-09-21T01:46:31.041 INFO:tasks.workunit.client.0.smithi083.stdout:read_sync buf_align 3584 offset 4197888 len 16384 2024-09-21T01:46:31.041 INFO:tasks.workunit.client.0.smithi083.stdout:read_file buf_align 3584 offset 4197888 len 16384 2024-09-21T01:46:31.041 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 0 offset 4190720 len 1024 2024-09-21T01:46:31.041 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 0 offset 4190720 len 1024 2024-09-21T01:46:31.041 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 0 offset 4190720 len 1024 2024-09-21T01:46:31.041 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 0 offset 4190720 len 1024 2024-09-21T01:46:31.042 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 0 offset 4190720 len 2048 2024-09-21T01:46:31.042 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 0 offset 4190720 len 2048 2024-09-21T01:46:31.042 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 0 offset 4190720 len 2048 2024-09-21T01:46:31.042 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 0 offset 4190720 len 2048 2024-09-21T01:46:31.042 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 0 offset 4190720 len 4096 2024-09-21T01:46:31.042 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 0 offset 4190720 len 4096 2024-09-21T01:46:31.042 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 0 offset 4190720 len 4096 2024-09-21T01:46:31.042 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 0 offset 4190720 len 4096 2024-09-21T01:46:31.042 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 0 offset 4190720 len 8192 2024-09-21T01:46:31.042 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 0 offset 4190720 len 8192 2024-09-21T01:46:31.042 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 0 offset 4190720 len 8192 2024-09-21T01:46:31.042 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 0 offset 4190720 len 8192 2024-09-21T01:46:31.042 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 0 offset 4190720 len 16384 2024-09-21T01:46:31.042 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 0 offset 4190720 len 16384 2024-09-21T01:46:31.043 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 0 offset 4190720 len 16384 2024-09-21T01:46:31.043 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 0 offset 4190720 len 16384 2024-09-21T01:46:31.043 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 0 offset 4191232 len 1024 2024-09-21T01:46:31.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:46:30 smithi083 ceph-mon[31370]: pgmap v473: 129 pgs: 129 active+clean; 7.8 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T01:46:31.464 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:46:30 smithi142 ceph-mon[34050]: pgmap v473: 129 pgs: 129 active+clean; 7.8 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T01:46:31.467 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:46:30 smithi119 ceph-mon[33693]: pgmap v473: 129 pgs: 129 active+clean; 7.8 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T01:46:31.837 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 0 offset 4191232 len 1024 2024-09-21T01:46:31.837 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 0 offset 4191232 len 1024 2024-09-21T01:46:31.837 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 0 offset 4191232 len 1024 2024-09-21T01:46:31.838 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 0 offset 4191232 len 2048 2024-09-21T01:46:31.838 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 0 offset 4191232 len 2048 2024-09-21T01:46:31.838 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 0 offset 4191232 len 2048 2024-09-21T01:46:31.838 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 0 offset 4191232 len 2048 2024-09-21T01:46:31.838 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 0 offset 4191232 len 4096 2024-09-21T01:46:31.838 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 0 offset 4191232 len 4096 2024-09-21T01:46:31.838 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 0 offset 4191232 len 4096 2024-09-21T01:46:31.838 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 0 offset 4191232 len 4096 2024-09-21T01:46:31.838 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 0 offset 4191232 len 8192 2024-09-21T01:46:31.838 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 0 offset 4191232 len 8192 2024-09-21T01:46:31.838 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 0 offset 4191232 len 8192 2024-09-21T01:46:31.838 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 0 offset 4191232 len 8192 2024-09-21T01:46:31.838 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 0 offset 4191232 len 16384 2024-09-21T01:46:31.838 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 0 offset 4191232 len 16384 2024-09-21T01:46:31.839 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 0 offset 4191232 len 16384 2024-09-21T01:46:31.839 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 0 offset 4191232 len 16384 2024-09-21T01:46:31.839 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 0 offset 4191744 len 1024 2024-09-21T01:46:31.839 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 0 offset 4191744 len 1024 2024-09-21T01:46:31.839 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 0 offset 4191744 len 1024 2024-09-21T01:46:31.839 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 0 offset 4191744 len 1024 2024-09-21T01:46:31.839 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 0 offset 4191744 len 2048 2024-09-21T01:46:31.839 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 0 offset 4191744 len 2048 2024-09-21T01:46:31.839 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 0 offset 4191744 len 2048 2024-09-21T01:46:31.839 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 0 offset 4191744 len 2048 2024-09-21T01:46:31.839 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 0 offset 4191744 len 4096 2024-09-21T01:46:31.839 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 0 offset 4191744 len 4096 2024-09-21T01:46:31.839 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 0 offset 4191744 len 4096 2024-09-21T01:46:31.839 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 0 offset 4191744 len 4096 2024-09-21T01:46:31.840 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 0 offset 4191744 len 8192 2024-09-21T01:46:31.840 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 0 offset 4191744 len 8192 2024-09-21T01:46:31.840 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 0 offset 4191744 len 8192 2024-09-21T01:46:31.840 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 0 offset 4191744 len 8192 2024-09-21T01:46:31.840 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 0 offset 4191744 len 16384 2024-09-21T01:46:31.840 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 0 offset 4191744 len 16384 2024-09-21T01:46:31.840 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 0 offset 4191744 len 16384 2024-09-21T01:46:31.840 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 0 offset 4191744 len 16384 2024-09-21T01:46:31.840 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 0 offset 4192256 len 1024 2024-09-21T01:46:31.840 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 0 offset 4192256 len 1024 2024-09-21T01:46:31.840 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 0 offset 4192256 len 1024 2024-09-21T01:46:31.840 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 0 offset 4192256 len 1024 2024-09-21T01:46:31.840 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 0 offset 4192256 len 2048 2024-09-21T01:46:31.840 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 0 offset 4192256 len 2048 2024-09-21T01:46:31.840 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 0 offset 4192256 len 2048 2024-09-21T01:46:31.841 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 0 offset 4192256 len 2048 2024-09-21T01:46:31.841 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 0 offset 4192256 len 4096 2024-09-21T01:46:31.841 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 0 offset 4192256 len 4096 2024-09-21T01:46:31.841 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 0 offset 4192256 len 4096 2024-09-21T01:46:31.841 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 0 offset 4192256 len 4096 2024-09-21T01:46:31.841 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 0 offset 4192256 len 8192 2024-09-21T01:46:31.841 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 0 offset 4192256 len 8192 2024-09-21T01:46:31.841 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 0 offset 4192256 len 8192 2024-09-21T01:46:31.841 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 0 offset 4192256 len 8192 2024-09-21T01:46:31.841 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 0 offset 4192256 len 16384 2024-09-21T01:46:31.841 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 0 offset 4192256 len 16384 2024-09-21T01:46:31.841 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 0 offset 4192256 len 16384 2024-09-21T01:46:31.841 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 0 offset 4192256 len 16384 2024-09-21T01:46:31.841 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 0 offset 4192768 len 1024 2024-09-21T01:46:31.841 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 0 offset 4192768 len 1024 2024-09-21T01:46:31.842 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 0 offset 4192768 len 1024 2024-09-21T01:46:31.842 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 0 offset 4192768 len 1024 2024-09-21T01:46:31.842 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 0 offset 4192768 len 2048 2024-09-21T01:46:31.842 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 0 offset 4192768 len 2048 2024-09-21T01:46:31.842 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 0 offset 4192768 len 2048 2024-09-21T01:46:31.842 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 0 offset 4192768 len 2048 2024-09-21T01:46:31.842 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 0 offset 4192768 len 4096 2024-09-21T01:46:31.842 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 0 offset 4192768 len 4096 2024-09-21T01:46:31.842 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 0 offset 4192768 len 4096 2024-09-21T01:46:31.842 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 0 offset 4192768 len 4096 2024-09-21T01:46:31.842 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 0 offset 4192768 len 8192 2024-09-21T01:46:31.842 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 0 offset 4192768 len 8192 2024-09-21T01:46:31.842 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 0 offset 4192768 len 8192 2024-09-21T01:46:31.842 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 0 offset 4192768 len 8192 2024-09-21T01:46:31.843 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 0 offset 4192768 len 16384 2024-09-21T01:46:31.843 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 0 offset 4192768 len 16384 2024-09-21T01:46:31.843 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 0 offset 4192768 len 16384 2024-09-21T01:46:31.843 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 0 offset 4192768 len 16384 2024-09-21T01:46:31.843 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 0 offset 4193280 len 1024 2024-09-21T01:46:31.843 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 0 offset 4193280 len 1024 2024-09-21T01:46:31.843 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 0 offset 4193280 len 1024 2024-09-21T01:46:31.843 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 0 offset 4193280 len 1024 2024-09-21T01:46:31.843 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 0 offset 4193280 len 2048 2024-09-21T01:46:31.843 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 0 offset 4193280 len 2048 2024-09-21T01:46:31.843 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 0 offset 4193280 len 2048 2024-09-21T01:46:32.454 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 0 offset 4193280 len 2048 2024-09-21T01:46:32.455 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 0 offset 4193280 len 4096 2024-09-21T01:46:32.455 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 0 offset 4193280 len 4096 2024-09-21T01:46:32.455 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 0 offset 4193280 len 4096 2024-09-21T01:46:32.455 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 0 offset 4193280 len 4096 2024-09-21T01:46:32.455 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 0 offset 4193280 len 8192 2024-09-21T01:46:32.455 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 0 offset 4193280 len 8192 2024-09-21T01:46:32.455 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 0 offset 4193280 len 8192 2024-09-21T01:46:32.455 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 0 offset 4193280 len 8192 2024-09-21T01:46:32.455 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 0 offset 4193280 len 16384 2024-09-21T01:46:32.455 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 0 offset 4193280 len 16384 2024-09-21T01:46:32.455 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 0 offset 4193280 len 16384 2024-09-21T01:46:32.456 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 0 offset 4193280 len 16384 2024-09-21T01:46:32.456 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 0 offset 4193792 len 1024 2024-09-21T01:46:32.456 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 0 offset 4193792 len 1024 2024-09-21T01:46:32.456 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 0 offset 4193792 len 1024 2024-09-21T01:46:32.456 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 0 offset 4193792 len 1024 2024-09-21T01:46:32.456 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 0 offset 4193792 len 2048 2024-09-21T01:46:32.456 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 0 offset 4193792 len 2048 2024-09-21T01:46:32.456 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 0 offset 4193792 len 2048 2024-09-21T01:46:32.456 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 0 offset 4193792 len 2048 2024-09-21T01:46:32.456 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 0 offset 4193792 len 4096 2024-09-21T01:46:32.456 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 0 offset 4193792 len 4096 2024-09-21T01:46:32.456 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 0 offset 4193792 len 4096 2024-09-21T01:46:32.456 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 0 offset 4193792 len 4096 2024-09-21T01:46:32.456 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 0 offset 4193792 len 8192 2024-09-21T01:46:32.456 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 0 offset 4193792 len 8192 2024-09-21T01:46:32.456 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 0 offset 4193792 len 8192 2024-09-21T01:46:32.457 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 0 offset 4193792 len 8192 2024-09-21T01:46:32.457 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 0 offset 4193792 len 16384 2024-09-21T01:46:32.457 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 0 offset 4193792 len 16384 2024-09-21T01:46:32.457 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 0 offset 4193792 len 16384 2024-09-21T01:46:32.457 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 0 offset 4193792 len 16384 2024-09-21T01:46:32.457 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 0 offset 4194304 len 1024 2024-09-21T01:46:32.457 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 0 offset 4194304 len 1024 2024-09-21T01:46:32.457 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 0 offset 4194304 len 1024 2024-09-21T01:46:32.457 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 0 offset 4194304 len 1024 2024-09-21T01:46:32.457 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 0 offset 4194304 len 2048 2024-09-21T01:46:32.457 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 0 offset 4194304 len 2048 2024-09-21T01:46:32.457 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 0 offset 4194304 len 2048 2024-09-21T01:46:32.457 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 0 offset 4194304 len 2048 2024-09-21T01:46:32.457 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 0 offset 4194304 len 4096 2024-09-21T01:46:32.458 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 0 offset 4194304 len 4096 2024-09-21T01:46:32.458 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 0 offset 4194304 len 4096 2024-09-21T01:46:32.458 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 0 offset 4194304 len 4096 2024-09-21T01:46:32.458 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 0 offset 4194304 len 8192 2024-09-21T01:46:32.458 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 0 offset 4194304 len 8192 2024-09-21T01:46:32.458 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 0 offset 4194304 len 8192 2024-09-21T01:46:32.458 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 0 offset 4194304 len 8192 2024-09-21T01:46:32.458 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 0 offset 4194304 len 16384 2024-09-21T01:46:32.458 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 0 offset 4194304 len 16384 2024-09-21T01:46:32.458 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 0 offset 4194304 len 16384 2024-09-21T01:46:32.458 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 0 offset 4194304 len 16384 2024-09-21T01:46:32.458 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 0 offset 4194816 len 1024 2024-09-21T01:46:32.458 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 0 offset 4194816 len 1024 2024-09-21T01:46:32.458 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 0 offset 4194816 len 1024 2024-09-21T01:46:32.459 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 0 offset 4194816 len 1024 2024-09-21T01:46:32.459 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 0 offset 4194816 len 2048 2024-09-21T01:46:32.459 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 0 offset 4194816 len 2048 2024-09-21T01:46:32.459 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 0 offset 4194816 len 2048 2024-09-21T01:46:32.459 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 0 offset 4194816 len 2048 2024-09-21T01:46:32.459 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 0 offset 4194816 len 4096 2024-09-21T01:46:32.459 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 0 offset 4194816 len 4096 2024-09-21T01:46:32.459 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 0 offset 4194816 len 4096 2024-09-21T01:46:32.459 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 0 offset 4194816 len 4096 2024-09-21T01:46:32.459 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 0 offset 4194816 len 8192 2024-09-21T01:46:32.459 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 0 offset 4194816 len 8192 2024-09-21T01:46:32.459 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 0 offset 4194816 len 8192 2024-09-21T01:46:32.459 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 0 offset 4194816 len 8192 2024-09-21T01:46:32.459 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 0 offset 4194816 len 16384 2024-09-21T01:46:32.460 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 0 offset 4194816 len 16384 2024-09-21T01:46:32.460 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 0 offset 4194816 len 16384 2024-09-21T01:46:32.460 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 0 offset 4194816 len 16384 2024-09-21T01:46:32.460 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 0 offset 4195328 len 1024 2024-09-21T01:46:32.460 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 0 offset 4195328 len 1024 2024-09-21T01:46:32.460 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 0 offset 4195328 len 1024 2024-09-21T01:46:32.460 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 0 offset 4195328 len 1024 2024-09-21T01:46:32.460 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 0 offset 4195328 len 2048 2024-09-21T01:46:32.460 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 0 offset 4195328 len 2048 2024-09-21T01:46:32.460 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 0 offset 4195328 len 2048 2024-09-21T01:46:32.460 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 0 offset 4195328 len 2048 2024-09-21T01:46:32.460 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 0 offset 4195328 len 4096 2024-09-21T01:46:32.460 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 0 offset 4195328 len 4096 2024-09-21T01:46:32.460 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 0 offset 4195328 len 4096 2024-09-21T01:46:32.460 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 0 offset 4195328 len 4096 2024-09-21T01:46:32.954 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 0 offset 4195328 len 8192 2024-09-21T01:46:32.954 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 0 offset 4195328 len 8192 2024-09-21T01:46:32.954 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 0 offset 4195328 len 8192 2024-09-21T01:46:32.954 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 0 offset 4195328 len 8192 2024-09-21T01:46:32.954 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 0 offset 4195328 len 16384 2024-09-21T01:46:32.954 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 0 offset 4195328 len 16384 2024-09-21T01:46:32.954 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 0 offset 4195328 len 16384 2024-09-21T01:46:32.954 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 0 offset 4195328 len 16384 2024-09-21T01:46:32.954 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 0 offset 4195840 len 1024 2024-09-21T01:46:32.954 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 0 offset 4195840 len 1024 2024-09-21T01:46:32.954 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 0 offset 4195840 len 1024 2024-09-21T01:46:32.955 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 0 offset 4195840 len 1024 2024-09-21T01:46:32.955 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 0 offset 4195840 len 2048 2024-09-21T01:46:32.955 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 0 offset 4195840 len 2048 2024-09-21T01:46:32.955 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 0 offset 4195840 len 2048 2024-09-21T01:46:32.955 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 0 offset 4195840 len 2048 2024-09-21T01:46:32.955 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 0 offset 4195840 len 4096 2024-09-21T01:46:32.955 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 0 offset 4195840 len 4096 2024-09-21T01:46:32.955 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 0 offset 4195840 len 4096 2024-09-21T01:46:32.955 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 0 offset 4195840 len 4096 2024-09-21T01:46:32.955 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 0 offset 4195840 len 8192 2024-09-21T01:46:32.955 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 0 offset 4195840 len 8192 2024-09-21T01:46:32.955 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 0 offset 4195840 len 8192 2024-09-21T01:46:32.955 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 0 offset 4195840 len 8192 2024-09-21T01:46:32.955 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 0 offset 4195840 len 16384 2024-09-21T01:46:32.955 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 0 offset 4195840 len 16384 2024-09-21T01:46:32.956 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 0 offset 4195840 len 16384 2024-09-21T01:46:32.956 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 0 offset 4195840 len 16384 2024-09-21T01:46:32.956 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 0 offset 4196352 len 1024 2024-09-21T01:46:32.956 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 0 offset 4196352 len 1024 2024-09-21T01:46:32.956 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 0 offset 4196352 len 1024 2024-09-21T01:46:32.956 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 0 offset 4196352 len 1024 2024-09-21T01:46:32.956 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 0 offset 4196352 len 2048 2024-09-21T01:46:32.956 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 0 offset 4196352 len 2048 2024-09-21T01:46:32.956 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 0 offset 4196352 len 2048 2024-09-21T01:46:32.956 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 0 offset 4196352 len 2048 2024-09-21T01:46:32.956 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 0 offset 4196352 len 4096 2024-09-21T01:46:32.956 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 0 offset 4196352 len 4096 2024-09-21T01:46:32.956 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 0 offset 4196352 len 4096 2024-09-21T01:46:32.956 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 0 offset 4196352 len 4096 2024-09-21T01:46:32.956 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 0 offset 4196352 len 8192 2024-09-21T01:46:32.956 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 0 offset 4196352 len 8192 2024-09-21T01:46:32.957 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 0 offset 4196352 len 8192 2024-09-21T01:46:32.957 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 0 offset 4196352 len 8192 2024-09-21T01:46:32.957 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 0 offset 4196352 len 16384 2024-09-21T01:46:32.957 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 0 offset 4196352 len 16384 2024-09-21T01:46:32.957 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 0 offset 4196352 len 16384 2024-09-21T01:46:32.957 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 0 offset 4196352 len 16384 2024-09-21T01:46:32.957 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 0 offset 4196864 len 1024 2024-09-21T01:46:32.957 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 0 offset 4196864 len 1024 2024-09-21T01:46:32.957 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 0 offset 4196864 len 1024 2024-09-21T01:46:32.957 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 0 offset 4196864 len 1024 2024-09-21T01:46:32.957 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 0 offset 4196864 len 2048 2024-09-21T01:46:32.957 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 0 offset 4196864 len 2048 2024-09-21T01:46:32.957 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 0 offset 4196864 len 2048 2024-09-21T01:46:32.957 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 0 offset 4196864 len 2048 2024-09-21T01:46:32.957 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 0 offset 4196864 len 4096 2024-09-21T01:46:32.958 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 0 offset 4196864 len 4096 2024-09-21T01:46:32.958 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 0 offset 4196864 len 4096 2024-09-21T01:46:32.958 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 0 offset 4196864 len 4096 2024-09-21T01:46:32.958 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 0 offset 4196864 len 8192 2024-09-21T01:46:32.958 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 0 offset 4196864 len 8192 2024-09-21T01:46:32.958 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 0 offset 4196864 len 8192 2024-09-21T01:46:32.958 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 0 offset 4196864 len 8192 2024-09-21T01:46:32.958 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 0 offset 4196864 len 16384 2024-09-21T01:46:32.958 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 0 offset 4196864 len 16384 2024-09-21T01:46:32.958 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 0 offset 4196864 len 16384 2024-09-21T01:46:32.958 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 0 offset 4196864 len 16384 2024-09-21T01:46:32.958 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 0 offset 4197376 len 1024 2024-09-21T01:46:32.958 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 0 offset 4197376 len 1024 2024-09-21T01:46:32.958 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 0 offset 4197376 len 1024 2024-09-21T01:46:32.958 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 0 offset 4197376 len 1024 2024-09-21T01:46:32.959 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 0 offset 4197376 len 2048 2024-09-21T01:46:32.959 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 0 offset 4197376 len 2048 2024-09-21T01:46:32.959 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 0 offset 4197376 len 2048 2024-09-21T01:46:32.959 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 0 offset 4197376 len 2048 2024-09-21T01:46:32.959 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 0 offset 4197376 len 4096 2024-09-21T01:46:32.959 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 0 offset 4197376 len 4096 2024-09-21T01:46:32.959 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 0 offset 4197376 len 4096 2024-09-21T01:46:32.959 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 0 offset 4197376 len 4096 2024-09-21T01:46:32.959 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 0 offset 4197376 len 8192 2024-09-21T01:46:32.959 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 0 offset 4197376 len 8192 2024-09-21T01:46:32.959 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 0 offset 4197376 len 8192 2024-09-21T01:46:32.959 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 0 offset 4197376 len 8192 2024-09-21T01:46:32.959 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 0 offset 4197376 len 16384 2024-09-21T01:46:32.959 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 0 offset 4197376 len 16384 2024-09-21T01:46:33.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:46:32 smithi083 ceph-mon[31370]: pgmap v474: 129 pgs: 129 active+clean; 152 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 17 KiB/s wr, 37 op/s 2024-09-21T01:46:33.464 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:46:32 smithi142 ceph-mon[34050]: pgmap v474: 129 pgs: 129 active+clean; 152 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 17 KiB/s wr, 37 op/s 2024-09-21T01:46:33.467 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:46:32 smithi119 ceph-mon[33693]: pgmap v474: 129 pgs: 129 active+clean; 152 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 17 KiB/s wr, 37 op/s 2024-09-21T01:46:33.691 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 0 offset 4197376 len 16384 2024-09-21T01:46:33.691 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 0 offset 4197376 len 16384 2024-09-21T01:46:33.691 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 0 offset 4197888 len 1024 2024-09-21T01:46:33.691 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 0 offset 4197888 len 1024 2024-09-21T01:46:33.691 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 0 offset 4197888 len 1024 2024-09-21T01:46:33.691 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 0 offset 4197888 len 1024 2024-09-21T01:46:33.691 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 0 offset 4197888 len 2048 2024-09-21T01:46:33.691 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 0 offset 4197888 len 2048 2024-09-21T01:46:33.691 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 0 offset 4197888 len 2048 2024-09-21T01:46:33.691 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 0 offset 4197888 len 2048 2024-09-21T01:46:33.691 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 0 offset 4197888 len 4096 2024-09-21T01:46:33.691 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 0 offset 4197888 len 4096 2024-09-21T01:46:33.691 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 0 offset 4197888 len 4096 2024-09-21T01:46:33.692 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 0 offset 4197888 len 4096 2024-09-21T01:46:33.692 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 0 offset 4197888 len 8192 2024-09-21T01:46:33.692 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 0 offset 4197888 len 8192 2024-09-21T01:46:33.692 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 0 offset 4197888 len 8192 2024-09-21T01:46:33.692 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 0 offset 4197888 len 8192 2024-09-21T01:46:33.692 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 0 offset 4197888 len 16384 2024-09-21T01:46:33.692 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 0 offset 4197888 len 16384 2024-09-21T01:46:33.692 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 0 offset 4197888 len 16384 2024-09-21T01:46:33.692 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 0 offset 4197888 len 16384 2024-09-21T01:46:33.692 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 512 offset 4190720 len 1024 2024-09-21T01:46:33.692 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 512 offset 4190720 len 1024 2024-09-21T01:46:33.692 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 512 offset 4190720 len 1024 2024-09-21T01:46:33.692 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 512 offset 4190720 len 1024 2024-09-21T01:46:33.692 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 512 offset 4190720 len 2048 2024-09-21T01:46:33.692 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 512 offset 4190720 len 2048 2024-09-21T01:46:33.693 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 512 offset 4190720 len 2048 2024-09-21T01:46:33.693 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 512 offset 4190720 len 2048 2024-09-21T01:46:33.693 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 512 offset 4190720 len 4096 2024-09-21T01:46:33.693 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 512 offset 4190720 len 4096 2024-09-21T01:46:33.693 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 512 offset 4190720 len 4096 2024-09-21T01:46:33.693 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 512 offset 4190720 len 4096 2024-09-21T01:46:33.693 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 512 offset 4190720 len 8192 2024-09-21T01:46:33.693 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 512 offset 4190720 len 8192 2024-09-21T01:46:33.693 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 512 offset 4190720 len 8192 2024-09-21T01:46:33.693 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 512 offset 4190720 len 8192 2024-09-21T01:46:33.693 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 512 offset 4190720 len 16384 2024-09-21T01:46:33.693 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 512 offset 4190720 len 16384 2024-09-21T01:46:33.693 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 512 offset 4190720 len 16384 2024-09-21T01:46:33.693 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 512 offset 4190720 len 16384 2024-09-21T01:46:33.693 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 512 offset 4191232 len 1024 2024-09-21T01:46:33.694 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 512 offset 4191232 len 1024 2024-09-21T01:46:33.694 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 512 offset 4191232 len 1024 2024-09-21T01:46:33.694 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 512 offset 4191232 len 1024 2024-09-21T01:46:33.694 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 512 offset 4191232 len 2048 2024-09-21T01:46:33.694 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 512 offset 4191232 len 2048 2024-09-21T01:46:33.694 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 512 offset 4191232 len 2048 2024-09-21T01:46:33.694 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 512 offset 4191232 len 2048 2024-09-21T01:46:33.694 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 512 offset 4191232 len 4096 2024-09-21T01:46:33.694 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 512 offset 4191232 len 4096 2024-09-21T01:46:33.694 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 512 offset 4191232 len 4096 2024-09-21T01:46:33.694 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 512 offset 4191232 len 4096 2024-09-21T01:46:33.694 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 512 offset 4191232 len 8192 2024-09-21T01:46:33.694 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 512 offset 4191232 len 8192 2024-09-21T01:46:33.694 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 512 offset 4191232 len 8192 2024-09-21T01:46:33.694 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 512 offset 4191232 len 8192 2024-09-21T01:46:33.695 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 512 offset 4191232 len 16384 2024-09-21T01:46:33.695 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 512 offset 4191232 len 16384 2024-09-21T01:46:33.695 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 512 offset 4191232 len 16384 2024-09-21T01:46:33.695 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 512 offset 4191232 len 16384 2024-09-21T01:46:33.695 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 512 offset 4191744 len 1024 2024-09-21T01:46:33.695 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 512 offset 4191744 len 1024 2024-09-21T01:46:33.695 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 512 offset 4191744 len 1024 2024-09-21T01:46:33.695 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 512 offset 4191744 len 1024 2024-09-21T01:46:33.695 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 512 offset 4191744 len 2048 2024-09-21T01:46:33.695 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 512 offset 4191744 len 2048 2024-09-21T01:46:33.695 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 512 offset 4191744 len 2048 2024-09-21T01:46:33.695 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 512 offset 4191744 len 2048 2024-09-21T01:46:33.695 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 512 offset 4191744 len 4096 2024-09-21T01:46:33.695 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 512 offset 4191744 len 4096 2024-09-21T01:46:33.696 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 512 offset 4191744 len 4096 2024-09-21T01:46:33.696 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 512 offset 4191744 len 4096 2024-09-21T01:46:33.696 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 512 offset 4191744 len 8192 2024-09-21T01:46:33.696 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 512 offset 4191744 len 8192 2024-09-21T01:46:33.696 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 512 offset 4191744 len 8192 2024-09-21T01:46:33.696 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 512 offset 4191744 len 8192 2024-09-21T01:46:33.696 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 512 offset 4191744 len 16384 2024-09-21T01:46:33.696 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 512 offset 4191744 len 16384 2024-09-21T01:46:33.696 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 512 offset 4191744 len 16384 2024-09-21T01:46:33.696 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 512 offset 4191744 len 16384 2024-09-21T01:46:33.696 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 512 offset 4192256 len 1024 2024-09-21T01:46:33.696 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 512 offset 4192256 len 1024 2024-09-21T01:46:34.525 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 512 offset 4192256 len 1024 2024-09-21T01:46:34.525 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 512 offset 4192256 len 1024 2024-09-21T01:46:34.525 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 512 offset 4192256 len 2048 2024-09-21T01:46:34.525 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 512 offset 4192256 len 2048 2024-09-21T01:46:34.525 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 512 offset 4192256 len 2048 2024-09-21T01:46:34.525 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 512 offset 4192256 len 2048 2024-09-21T01:46:34.525 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 512 offset 4192256 len 4096 2024-09-21T01:46:34.525 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 512 offset 4192256 len 4096 2024-09-21T01:46:34.525 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 512 offset 4192256 len 4096 2024-09-21T01:46:34.526 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 512 offset 4192256 len 4096 2024-09-21T01:46:34.526 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 512 offset 4192256 len 8192 2024-09-21T01:46:34.526 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 512 offset 4192256 len 8192 2024-09-21T01:46:34.526 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 512 offset 4192256 len 8192 2024-09-21T01:46:34.526 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 512 offset 4192256 len 8192 2024-09-21T01:46:34.526 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 512 offset 4192256 len 16384 2024-09-21T01:46:34.526 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 512 offset 4192256 len 16384 2024-09-21T01:46:34.526 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 512 offset 4192256 len 16384 2024-09-21T01:46:34.526 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 512 offset 4192256 len 16384 2024-09-21T01:46:34.526 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 512 offset 4192768 len 1024 2024-09-21T01:46:34.526 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 512 offset 4192768 len 1024 2024-09-21T01:46:34.526 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 512 offset 4192768 len 1024 2024-09-21T01:46:34.526 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 512 offset 4192768 len 1024 2024-09-21T01:46:34.526 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 512 offset 4192768 len 2048 2024-09-21T01:46:34.526 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 512 offset 4192768 len 2048 2024-09-21T01:46:34.526 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 512 offset 4192768 len 2048 2024-09-21T01:46:34.527 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 512 offset 4192768 len 2048 2024-09-21T01:46:34.527 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 512 offset 4192768 len 4096 2024-09-21T01:46:34.527 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 512 offset 4192768 len 4096 2024-09-21T01:46:34.527 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 512 offset 4192768 len 4096 2024-09-21T01:46:34.527 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 512 offset 4192768 len 4096 2024-09-21T01:46:34.527 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 512 offset 4192768 len 8192 2024-09-21T01:46:34.527 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 512 offset 4192768 len 8192 2024-09-21T01:46:34.527 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 512 offset 4192768 len 8192 2024-09-21T01:46:34.527 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 512 offset 4192768 len 8192 2024-09-21T01:46:34.527 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 512 offset 4192768 len 16384 2024-09-21T01:46:34.527 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 512 offset 4192768 len 16384 2024-09-21T01:46:34.527 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 512 offset 4192768 len 16384 2024-09-21T01:46:34.527 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 512 offset 4192768 len 16384 2024-09-21T01:46:34.527 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 512 offset 4193280 len 1024 2024-09-21T01:46:34.527 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 512 offset 4193280 len 1024 2024-09-21T01:46:34.527 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 512 offset 4193280 len 1024 2024-09-21T01:46:34.528 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 512 offset 4193280 len 1024 2024-09-21T01:46:34.528 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 512 offset 4193280 len 2048 2024-09-21T01:46:34.528 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 512 offset 4193280 len 2048 2024-09-21T01:46:34.528 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 512 offset 4193280 len 2048 2024-09-21T01:46:34.528 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 512 offset 4193280 len 2048 2024-09-21T01:46:34.528 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 512 offset 4193280 len 4096 2024-09-21T01:46:34.528 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 512 offset 4193280 len 4096 2024-09-21T01:46:34.528 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 512 offset 4193280 len 4096 2024-09-21T01:46:34.528 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 512 offset 4193280 len 4096 2024-09-21T01:46:34.528 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 512 offset 4193280 len 8192 2024-09-21T01:46:34.528 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 512 offset 4193280 len 8192 2024-09-21T01:46:34.528 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 512 offset 4193280 len 8192 2024-09-21T01:46:34.528 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 512 offset 4193280 len 8192 2024-09-21T01:46:34.528 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 512 offset 4193280 len 16384 2024-09-21T01:46:34.528 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 512 offset 4193280 len 16384 2024-09-21T01:46:34.529 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 512 offset 4193280 len 16384 2024-09-21T01:46:34.529 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 512 offset 4193280 len 16384 2024-09-21T01:46:34.529 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 512 offset 4193792 len 1024 2024-09-21T01:46:34.529 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 512 offset 4193792 len 1024 2024-09-21T01:46:34.529 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 512 offset 4193792 len 1024 2024-09-21T01:46:34.529 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 512 offset 4193792 len 1024 2024-09-21T01:46:34.529 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 512 offset 4193792 len 2048 2024-09-21T01:46:34.529 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 512 offset 4193792 len 2048 2024-09-21T01:46:34.529 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 512 offset 4193792 len 2048 2024-09-21T01:46:34.529 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 512 offset 4193792 len 2048 2024-09-21T01:46:34.529 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 512 offset 4193792 len 4096 2024-09-21T01:46:34.529 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 512 offset 4193792 len 4096 2024-09-21T01:46:34.529 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 512 offset 4193792 len 4096 2024-09-21T01:46:34.529 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 512 offset 4193792 len 4096 2024-09-21T01:46:34.529 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 512 offset 4193792 len 8192 2024-09-21T01:46:34.530 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 512 offset 4193792 len 8192 2024-09-21T01:46:34.530 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 512 offset 4193792 len 8192 2024-09-21T01:46:34.530 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 512 offset 4193792 len 8192 2024-09-21T01:46:34.530 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 512 offset 4193792 len 16384 2024-09-21T01:46:34.530 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 512 offset 4193792 len 16384 2024-09-21T01:46:34.530 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 512 offset 4193792 len 16384 2024-09-21T01:46:34.530 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 512 offset 4193792 len 16384 2024-09-21T01:46:34.530 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 512 offset 4194304 len 1024 2024-09-21T01:46:34.530 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 512 offset 4194304 len 1024 2024-09-21T01:46:34.530 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 512 offset 4194304 len 1024 2024-09-21T01:46:34.530 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 512 offset 4194304 len 1024 2024-09-21T01:46:34.991 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 512 offset 4194304 len 2048 2024-09-21T01:46:34.991 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 512 offset 4194304 len 2048 2024-09-21T01:46:34.991 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 512 offset 4194304 len 2048 2024-09-21T01:46:34.991 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 512 offset 4194304 len 2048 2024-09-21T01:46:34.991 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 512 offset 4194304 len 4096 2024-09-21T01:46:34.992 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 512 offset 4194304 len 4096 2024-09-21T01:46:34.992 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 512 offset 4194304 len 4096 2024-09-21T01:46:34.992 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 512 offset 4194304 len 4096 2024-09-21T01:46:34.992 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 512 offset 4194304 len 8192 2024-09-21T01:46:34.992 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 512 offset 4194304 len 8192 2024-09-21T01:46:34.992 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 512 offset 4194304 len 8192 2024-09-21T01:46:34.992 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 512 offset 4194304 len 8192 2024-09-21T01:46:34.992 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 512 offset 4194304 len 16384 2024-09-21T01:46:34.992 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 512 offset 4194304 len 16384 2024-09-21T01:46:34.992 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 512 offset 4194304 len 16384 2024-09-21T01:46:34.992 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 512 offset 4194304 len 16384 2024-09-21T01:46:34.992 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 512 offset 4194816 len 1024 2024-09-21T01:46:34.992 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 512 offset 4194816 len 1024 2024-09-21T01:46:34.992 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 512 offset 4194816 len 1024 2024-09-21T01:46:34.992 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 512 offset 4194816 len 1024 2024-09-21T01:46:34.993 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 512 offset 4194816 len 2048 2024-09-21T01:46:34.993 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 512 offset 4194816 len 2048 2024-09-21T01:46:34.993 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 512 offset 4194816 len 2048 2024-09-21T01:46:34.993 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 512 offset 4194816 len 2048 2024-09-21T01:46:34.993 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 512 offset 4194816 len 4096 2024-09-21T01:46:34.993 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 512 offset 4194816 len 4096 2024-09-21T01:46:34.993 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 512 offset 4194816 len 4096 2024-09-21T01:46:34.993 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 512 offset 4194816 len 4096 2024-09-21T01:46:34.993 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 512 offset 4194816 len 8192 2024-09-21T01:46:34.993 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 512 offset 4194816 len 8192 2024-09-21T01:46:34.993 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 512 offset 4194816 len 8192 2024-09-21T01:46:34.993 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 512 offset 4194816 len 8192 2024-09-21T01:46:34.993 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 512 offset 4194816 len 16384 2024-09-21T01:46:34.993 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 512 offset 4194816 len 16384 2024-09-21T01:46:34.993 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 512 offset 4194816 len 16384 2024-09-21T01:46:34.993 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 512 offset 4194816 len 16384 2024-09-21T01:46:34.994 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 512 offset 4195328 len 1024 2024-09-21T01:46:34.994 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 512 offset 4195328 len 1024 2024-09-21T01:46:34.994 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 512 offset 4195328 len 1024 2024-09-21T01:46:34.994 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 512 offset 4195328 len 1024 2024-09-21T01:46:34.994 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 512 offset 4195328 len 2048 2024-09-21T01:46:34.994 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 512 offset 4195328 len 2048 2024-09-21T01:46:34.994 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 512 offset 4195328 len 2048 2024-09-21T01:46:34.994 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 512 offset 4195328 len 2048 2024-09-21T01:46:34.994 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 512 offset 4195328 len 4096 2024-09-21T01:46:34.994 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 512 offset 4195328 len 4096 2024-09-21T01:46:34.994 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 512 offset 4195328 len 4096 2024-09-21T01:46:34.994 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 512 offset 4195328 len 4096 2024-09-21T01:46:34.994 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 512 offset 4195328 len 8192 2024-09-21T01:46:34.994 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 512 offset 4195328 len 8192 2024-09-21T01:46:34.995 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 512 offset 4195328 len 8192 2024-09-21T01:46:34.995 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 512 offset 4195328 len 8192 2024-09-21T01:46:34.995 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 512 offset 4195328 len 16384 2024-09-21T01:46:34.995 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 512 offset 4195328 len 16384 2024-09-21T01:46:34.995 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 512 offset 4195328 len 16384 2024-09-21T01:46:34.995 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 512 offset 4195328 len 16384 2024-09-21T01:46:34.995 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 512 offset 4195840 len 1024 2024-09-21T01:46:34.995 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 512 offset 4195840 len 1024 2024-09-21T01:46:34.995 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 512 offset 4195840 len 1024 2024-09-21T01:46:34.995 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 512 offset 4195840 len 1024 2024-09-21T01:46:34.995 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 512 offset 4195840 len 2048 2024-09-21T01:46:34.995 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 512 offset 4195840 len 2048 2024-09-21T01:46:34.995 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 512 offset 4195840 len 2048 2024-09-21T01:46:34.995 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 512 offset 4195840 len 2048 2024-09-21T01:46:34.996 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 512 offset 4195840 len 4096 2024-09-21T01:46:34.996 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 512 offset 4195840 len 4096 2024-09-21T01:46:34.996 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 512 offset 4195840 len 4096 2024-09-21T01:46:34.996 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 512 offset 4195840 len 4096 2024-09-21T01:46:34.996 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 512 offset 4195840 len 8192 2024-09-21T01:46:34.996 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 512 offset 4195840 len 8192 2024-09-21T01:46:34.996 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 512 offset 4195840 len 8192 2024-09-21T01:46:34.996 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 512 offset 4195840 len 8192 2024-09-21T01:46:34.996 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 512 offset 4195840 len 16384 2024-09-21T01:46:34.996 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 512 offset 4195840 len 16384 2024-09-21T01:46:34.996 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 512 offset 4195840 len 16384 2024-09-21T01:46:34.996 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 512 offset 4195840 len 16384 2024-09-21T01:46:34.997 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 512 offset 4196352 len 1024 2024-09-21T01:46:34.997 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 512 offset 4196352 len 1024 2024-09-21T01:46:34.997 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 512 offset 4196352 len 1024 2024-09-21T01:46:34.997 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 512 offset 4196352 len 1024 2024-09-21T01:46:34.997 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 512 offset 4196352 len 2048 2024-09-21T01:46:34.997 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 512 offset 4196352 len 2048 2024-09-21T01:46:35.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:46:34 smithi083 ceph-mon[31370]: pgmap v475: 129 pgs: 129 active+clean; 267 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 629 KiB/s rd, 486 KiB/s wr, 114 op/s 2024-09-21T01:46:35.464 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:46:34 smithi142 ceph-mon[34050]: pgmap v475: 129 pgs: 129 active+clean; 267 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 629 KiB/s rd, 486 KiB/s wr, 114 op/s 2024-09-21T01:46:35.467 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:46:34 smithi119 ceph-mon[33693]: pgmap v475: 129 pgs: 129 active+clean; 267 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 629 KiB/s rd, 486 KiB/s wr, 114 op/s 2024-09-21T01:46:35.500 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 512 offset 4196352 len 2048 2024-09-21T01:46:35.500 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 512 offset 4196352 len 2048 2024-09-21T01:46:35.500 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 512 offset 4196352 len 4096 2024-09-21T01:46:35.500 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 512 offset 4196352 len 4096 2024-09-21T01:46:35.501 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 512 offset 4196352 len 4096 2024-09-21T01:46:35.501 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 512 offset 4196352 len 4096 2024-09-21T01:46:35.501 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 512 offset 4196352 len 8192 2024-09-21T01:46:35.501 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 512 offset 4196352 len 8192 2024-09-21T01:46:35.501 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 512 offset 4196352 len 8192 2024-09-21T01:46:35.501 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 512 offset 4196352 len 8192 2024-09-21T01:46:35.501 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 512 offset 4196352 len 16384 2024-09-21T01:46:35.501 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 512 offset 4196352 len 16384 2024-09-21T01:46:35.501 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 512 offset 4196352 len 16384 2024-09-21T01:46:35.501 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 512 offset 4196352 len 16384 2024-09-21T01:46:35.501 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 512 offset 4196864 len 1024 2024-09-21T01:46:35.501 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 512 offset 4196864 len 1024 2024-09-21T01:46:35.501 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 512 offset 4196864 len 1024 2024-09-21T01:46:35.502 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 512 offset 4196864 len 1024 2024-09-21T01:46:35.502 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 512 offset 4196864 len 2048 2024-09-21T01:46:35.502 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 512 offset 4196864 len 2048 2024-09-21T01:46:35.502 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 512 offset 4196864 len 2048 2024-09-21T01:46:35.502 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 512 offset 4196864 len 2048 2024-09-21T01:46:35.502 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 512 offset 4196864 len 4096 2024-09-21T01:46:35.502 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 512 offset 4196864 len 4096 2024-09-21T01:46:35.502 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 512 offset 4196864 len 4096 2024-09-21T01:46:35.502 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 512 offset 4196864 len 4096 2024-09-21T01:46:35.502 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 512 offset 4196864 len 8192 2024-09-21T01:46:35.502 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 512 offset 4196864 len 8192 2024-09-21T01:46:35.502 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 512 offset 4196864 len 8192 2024-09-21T01:46:35.502 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 512 offset 4196864 len 8192 2024-09-21T01:46:35.502 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 512 offset 4196864 len 16384 2024-09-21T01:46:35.502 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 512 offset 4196864 len 16384 2024-09-21T01:46:35.503 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 512 offset 4196864 len 16384 2024-09-21T01:46:35.503 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 512 offset 4196864 len 16384 2024-09-21T01:46:35.503 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 512 offset 4197376 len 1024 2024-09-21T01:46:35.503 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 512 offset 4197376 len 1024 2024-09-21T01:46:35.503 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 512 offset 4197376 len 1024 2024-09-21T01:46:35.503 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 512 offset 4197376 len 1024 2024-09-21T01:46:35.503 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 512 offset 4197376 len 2048 2024-09-21T01:46:35.503 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 512 offset 4197376 len 2048 2024-09-21T01:46:35.503 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 512 offset 4197376 len 2048 2024-09-21T01:46:35.503 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 512 offset 4197376 len 2048 2024-09-21T01:46:35.503 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 512 offset 4197376 len 4096 2024-09-21T01:46:35.503 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 512 offset 4197376 len 4096 2024-09-21T01:46:35.503 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 512 offset 4197376 len 4096 2024-09-21T01:46:35.503 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 512 offset 4197376 len 4096 2024-09-21T01:46:35.504 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 512 offset 4197376 len 8192 2024-09-21T01:46:35.504 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 512 offset 4197376 len 8192 2024-09-21T01:46:35.504 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 512 offset 4197376 len 8192 2024-09-21T01:46:35.504 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 512 offset 4197376 len 8192 2024-09-21T01:46:35.504 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 512 offset 4197376 len 16384 2024-09-21T01:46:35.504 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 512 offset 4197376 len 16384 2024-09-21T01:46:35.504 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 512 offset 4197376 len 16384 2024-09-21T01:46:35.504 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 512 offset 4197376 len 16384 2024-09-21T01:46:35.504 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 512 offset 4197888 len 1024 2024-09-21T01:46:35.504 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 512 offset 4197888 len 1024 2024-09-21T01:46:35.504 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 512 offset 4197888 len 1024 2024-09-21T01:46:35.504 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 512 offset 4197888 len 1024 2024-09-21T01:46:35.504 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 512 offset 4197888 len 2048 2024-09-21T01:46:35.504 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 512 offset 4197888 len 2048 2024-09-21T01:46:35.504 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 512 offset 4197888 len 2048 2024-09-21T01:46:35.505 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 512 offset 4197888 len 2048 2024-09-21T01:46:35.505 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 512 offset 4197888 len 4096 2024-09-21T01:46:35.505 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 512 offset 4197888 len 4096 2024-09-21T01:46:35.505 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 512 offset 4197888 len 4096 2024-09-21T01:46:35.505 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 512 offset 4197888 len 4096 2024-09-21T01:46:35.505 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 512 offset 4197888 len 8192 2024-09-21T01:46:35.505 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 512 offset 4197888 len 8192 2024-09-21T01:46:35.505 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 512 offset 4197888 len 8192 2024-09-21T01:46:35.505 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 512 offset 4197888 len 8192 2024-09-21T01:46:35.505 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 512 offset 4197888 len 16384 2024-09-21T01:46:35.505 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 512 offset 4197888 len 16384 2024-09-21T01:46:35.505 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 512 offset 4197888 len 16384 2024-09-21T01:46:35.505 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 512 offset 4197888 len 16384 2024-09-21T01:46:35.505 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 1024 offset 4190720 len 1024 2024-09-21T01:46:35.505 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1024 offset 4190720 len 1024 2024-09-21T01:46:35.506 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 1024 offset 4190720 len 1024 2024-09-21T01:46:35.506 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1024 offset 4190720 len 1024 2024-09-21T01:46:35.506 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 1024 offset 4190720 len 2048 2024-09-21T01:46:35.506 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1024 offset 4190720 len 2048 2024-09-21T01:46:35.506 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 1024 offset 4190720 len 2048 2024-09-21T01:46:35.506 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1024 offset 4190720 len 2048 2024-09-21T01:46:35.506 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 1024 offset 4190720 len 4096 2024-09-21T01:46:36.327 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1024 offset 4190720 len 4096 2024-09-21T01:46:36.327 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 1024 offset 4190720 len 4096 2024-09-21T01:46:36.327 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1024 offset 4190720 len 4096 2024-09-21T01:46:36.327 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 1024 offset 4190720 len 8192 2024-09-21T01:46:36.327 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1024 offset 4190720 len 8192 2024-09-21T01:46:36.327 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 1024 offset 4190720 len 8192 2024-09-21T01:46:36.327 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1024 offset 4190720 len 8192 2024-09-21T01:46:36.327 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 1024 offset 4190720 len 16384 2024-09-21T01:46:36.327 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1024 offset 4190720 len 16384 2024-09-21T01:46:36.328 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 1024 offset 4190720 len 16384 2024-09-21T01:46:36.328 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1024 offset 4190720 len 16384 2024-09-21T01:46:36.328 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 1024 offset 4191232 len 1024 2024-09-21T01:46:36.328 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1024 offset 4191232 len 1024 2024-09-21T01:46:36.328 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 1024 offset 4191232 len 1024 2024-09-21T01:46:36.328 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1024 offset 4191232 len 1024 2024-09-21T01:46:36.328 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 1024 offset 4191232 len 2048 2024-09-21T01:46:36.328 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1024 offset 4191232 len 2048 2024-09-21T01:46:36.328 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 1024 offset 4191232 len 2048 2024-09-21T01:46:36.328 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1024 offset 4191232 len 2048 2024-09-21T01:46:36.328 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 1024 offset 4191232 len 4096 2024-09-21T01:46:36.328 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1024 offset 4191232 len 4096 2024-09-21T01:46:36.328 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 1024 offset 4191232 len 4096 2024-09-21T01:46:36.329 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1024 offset 4191232 len 4096 2024-09-21T01:46:36.329 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 1024 offset 4191232 len 8192 2024-09-21T01:46:36.329 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1024 offset 4191232 len 8192 2024-09-21T01:46:36.329 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 1024 offset 4191232 len 8192 2024-09-21T01:46:36.329 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1024 offset 4191232 len 8192 2024-09-21T01:46:36.329 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 1024 offset 4191232 len 16384 2024-09-21T01:46:36.329 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1024 offset 4191232 len 16384 2024-09-21T01:46:36.329 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 1024 offset 4191232 len 16384 2024-09-21T01:46:36.329 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1024 offset 4191232 len 16384 2024-09-21T01:46:36.330 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 1024 offset 4191744 len 1024 2024-09-21T01:46:36.330 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1024 offset 4191744 len 1024 2024-09-21T01:46:36.330 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 1024 offset 4191744 len 1024 2024-09-21T01:46:36.330 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1024 offset 4191744 len 1024 2024-09-21T01:46:36.330 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 1024 offset 4191744 len 2048 2024-09-21T01:46:36.330 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1024 offset 4191744 len 2048 2024-09-21T01:46:36.330 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 1024 offset 4191744 len 2048 2024-09-21T01:46:36.330 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1024 offset 4191744 len 2048 2024-09-21T01:46:36.330 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 1024 offset 4191744 len 4096 2024-09-21T01:46:36.331 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1024 offset 4191744 len 4096 2024-09-21T01:46:36.331 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 1024 offset 4191744 len 4096 2024-09-21T01:46:36.331 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1024 offset 4191744 len 4096 2024-09-21T01:46:36.331 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 1024 offset 4191744 len 8192 2024-09-21T01:46:36.331 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1024 offset 4191744 len 8192 2024-09-21T01:46:36.331 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 1024 offset 4191744 len 8192 2024-09-21T01:46:36.331 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1024 offset 4191744 len 8192 2024-09-21T01:46:36.331 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 1024 offset 4191744 len 16384 2024-09-21T01:46:36.331 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1024 offset 4191744 len 16384 2024-09-21T01:46:36.331 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 1024 offset 4191744 len 16384 2024-09-21T01:46:36.331 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1024 offset 4191744 len 16384 2024-09-21T01:46:36.332 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 1024 offset 4192256 len 1024 2024-09-21T01:46:36.332 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1024 offset 4192256 len 1024 2024-09-21T01:46:36.332 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 1024 offset 4192256 len 1024 2024-09-21T01:46:36.332 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1024 offset 4192256 len 1024 2024-09-21T01:46:36.332 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 1024 offset 4192256 len 2048 2024-09-21T01:46:36.332 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1024 offset 4192256 len 2048 2024-09-21T01:46:36.332 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 1024 offset 4192256 len 2048 2024-09-21T01:46:36.332 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1024 offset 4192256 len 2048 2024-09-21T01:46:36.332 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 1024 offset 4192256 len 4096 2024-09-21T01:46:36.332 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1024 offset 4192256 len 4096 2024-09-21T01:46:36.332 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 1024 offset 4192256 len 4096 2024-09-21T01:46:36.333 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1024 offset 4192256 len 4096 2024-09-21T01:46:36.333 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 1024 offset 4192256 len 8192 2024-09-21T01:46:36.333 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1024 offset 4192256 len 8192 2024-09-21T01:46:36.333 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 1024 offset 4192256 len 8192 2024-09-21T01:46:36.333 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1024 offset 4192256 len 8192 2024-09-21T01:46:36.333 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 1024 offset 4192256 len 16384 2024-09-21T01:46:36.333 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1024 offset 4192256 len 16384 2024-09-21T01:46:36.333 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 1024 offset 4192256 len 16384 2024-09-21T01:46:36.333 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1024 offset 4192256 len 16384 2024-09-21T01:46:36.333 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 1024 offset 4192768 len 1024 2024-09-21T01:46:36.333 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1024 offset 4192768 len 1024 2024-09-21T01:46:36.334 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 1024 offset 4192768 len 1024 2024-09-21T01:46:36.334 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1024 offset 4192768 len 1024 2024-09-21T01:46:36.334 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 1024 offset 4192768 len 2048 2024-09-21T01:46:36.334 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1024 offset 4192768 len 2048 2024-09-21T01:46:36.334 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 1024 offset 4192768 len 2048 2024-09-21T01:46:36.334 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1024 offset 4192768 len 2048 2024-09-21T01:46:36.334 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 1024 offset 4192768 len 4096 2024-09-21T01:46:37.025 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1024 offset 4192768 len 4096 2024-09-21T01:46:37.025 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 1024 offset 4192768 len 4096 2024-09-21T01:46:37.025 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1024 offset 4192768 len 4096 2024-09-21T01:46:37.025 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 1024 offset 4192768 len 8192 2024-09-21T01:46:37.026 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1024 offset 4192768 len 8192 2024-09-21T01:46:37.026 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 1024 offset 4192768 len 8192 2024-09-21T01:46:37.026 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1024 offset 4192768 len 8192 2024-09-21T01:46:37.026 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 1024 offset 4192768 len 16384 2024-09-21T01:46:37.026 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1024 offset 4192768 len 16384 2024-09-21T01:46:37.026 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 1024 offset 4192768 len 16384 2024-09-21T01:46:37.026 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1024 offset 4192768 len 16384 2024-09-21T01:46:37.026 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 1024 offset 4193280 len 1024 2024-09-21T01:46:37.026 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1024 offset 4193280 len 1024 2024-09-21T01:46:37.026 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 1024 offset 4193280 len 1024 2024-09-21T01:46:37.026 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1024 offset 4193280 len 1024 2024-09-21T01:46:37.026 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 1024 offset 4193280 len 2048 2024-09-21T01:46:37.026 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1024 offset 4193280 len 2048 2024-09-21T01:46:37.027 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 1024 offset 4193280 len 2048 2024-09-21T01:46:37.027 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1024 offset 4193280 len 2048 2024-09-21T01:46:37.027 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 1024 offset 4193280 len 4096 2024-09-21T01:46:37.027 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1024 offset 4193280 len 4096 2024-09-21T01:46:37.027 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 1024 offset 4193280 len 4096 2024-09-21T01:46:37.027 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1024 offset 4193280 len 4096 2024-09-21T01:46:37.027 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 1024 offset 4193280 len 8192 2024-09-21T01:46:37.027 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1024 offset 4193280 len 8192 2024-09-21T01:46:37.027 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 1024 offset 4193280 len 8192 2024-09-21T01:46:37.027 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1024 offset 4193280 len 8192 2024-09-21T01:46:37.027 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 1024 offset 4193280 len 16384 2024-09-21T01:46:37.027 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1024 offset 4193280 len 16384 2024-09-21T01:46:37.027 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 1024 offset 4193280 len 16384 2024-09-21T01:46:37.027 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1024 offset 4193280 len 16384 2024-09-21T01:46:37.028 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 1024 offset 4193792 len 1024 2024-09-21T01:46:37.028 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1024 offset 4193792 len 1024 2024-09-21T01:46:37.028 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 1024 offset 4193792 len 1024 2024-09-21T01:46:37.028 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1024 offset 4193792 len 1024 2024-09-21T01:46:37.028 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 1024 offset 4193792 len 2048 2024-09-21T01:46:37.028 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1024 offset 4193792 len 2048 2024-09-21T01:46:37.028 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 1024 offset 4193792 len 2048 2024-09-21T01:46:37.028 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1024 offset 4193792 len 2048 2024-09-21T01:46:37.028 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 1024 offset 4193792 len 4096 2024-09-21T01:46:37.028 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1024 offset 4193792 len 4096 2024-09-21T01:46:37.028 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 1024 offset 4193792 len 4096 2024-09-21T01:46:37.028 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1024 offset 4193792 len 4096 2024-09-21T01:46:37.028 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 1024 offset 4193792 len 8192 2024-09-21T01:46:37.028 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1024 offset 4193792 len 8192 2024-09-21T01:46:37.029 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 1024 offset 4193792 len 8192 2024-09-21T01:46:37.029 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1024 offset 4193792 len 8192 2024-09-21T01:46:37.029 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 1024 offset 4193792 len 16384 2024-09-21T01:46:37.029 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1024 offset 4193792 len 16384 2024-09-21T01:46:37.029 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 1024 offset 4193792 len 16384 2024-09-21T01:46:37.029 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1024 offset 4193792 len 16384 2024-09-21T01:46:37.029 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 1024 offset 4194304 len 1024 2024-09-21T01:46:37.029 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1024 offset 4194304 len 1024 2024-09-21T01:46:37.029 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 1024 offset 4194304 len 1024 2024-09-21T01:46:37.029 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1024 offset 4194304 len 1024 2024-09-21T01:46:37.029 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 1024 offset 4194304 len 2048 2024-09-21T01:46:37.029 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1024 offset 4194304 len 2048 2024-09-21T01:46:37.029 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 1024 offset 4194304 len 2048 2024-09-21T01:46:37.030 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1024 offset 4194304 len 2048 2024-09-21T01:46:37.030 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 1024 offset 4194304 len 4096 2024-09-21T01:46:37.030 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1024 offset 4194304 len 4096 2024-09-21T01:46:37.030 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 1024 offset 4194304 len 4096 2024-09-21T01:46:37.030 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1024 offset 4194304 len 4096 2024-09-21T01:46:37.030 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 1024 offset 4194304 len 8192 2024-09-21T01:46:37.030 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1024 offset 4194304 len 8192 2024-09-21T01:46:37.030 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 1024 offset 4194304 len 8192 2024-09-21T01:46:37.030 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1024 offset 4194304 len 8192 2024-09-21T01:46:37.030 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 1024 offset 4194304 len 16384 2024-09-21T01:46:37.030 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1024 offset 4194304 len 16384 2024-09-21T01:46:37.030 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 1024 offset 4194304 len 16384 2024-09-21T01:46:37.030 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1024 offset 4194304 len 16384 2024-09-21T01:46:37.030 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 1024 offset 4194816 len 1024 2024-09-21T01:46:37.030 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1024 offset 4194816 len 1024 2024-09-21T01:46:37.031 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 1024 offset 4194816 len 1024 2024-09-21T01:46:37.031 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1024 offset 4194816 len 1024 2024-09-21T01:46:37.031 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 1024 offset 4194816 len 2048 2024-09-21T01:46:37.031 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1024 offset 4194816 len 2048 2024-09-21T01:46:37.031 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 1024 offset 4194816 len 2048 2024-09-21T01:46:37.031 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1024 offset 4194816 len 2048 2024-09-21T01:46:37.031 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 1024 offset 4194816 len 4096 2024-09-21T01:46:37.031 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1024 offset 4194816 len 4096 2024-09-21T01:46:37.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:46:36 smithi083 ceph-mon[31370]: pgmap v476: 129 pgs: 129 active+clean; 362 MiB data, 438 MiB used, 1.0 TiB / 1.0 TiB avail; 837 KiB/s rd, 790 KiB/s wr, 179 op/s 2024-09-21T01:46:37.464 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:46:36 smithi142 ceph-mon[34050]: pgmap v476: 129 pgs: 129 active+clean; 362 MiB data, 438 MiB used, 1.0 TiB / 1.0 TiB avail; 837 KiB/s rd, 790 KiB/s wr, 179 op/s 2024-09-21T01:46:37.467 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:46:36 smithi119 ceph-mon[33693]: pgmap v476: 129 pgs: 129 active+clean; 362 MiB data, 438 MiB used, 1.0 TiB / 1.0 TiB avail; 837 KiB/s rd, 790 KiB/s wr, 179 op/s 2024-09-21T01:46:37.521 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 1024 offset 4194816 len 4096 2024-09-21T01:46:37.522 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1024 offset 4194816 len 4096 2024-09-21T01:46:37.522 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 1024 offset 4194816 len 8192 2024-09-21T01:46:37.522 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1024 offset 4194816 len 8192 2024-09-21T01:46:37.522 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 1024 offset 4194816 len 8192 2024-09-21T01:46:37.522 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1024 offset 4194816 len 8192 2024-09-21T01:46:37.522 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 1024 offset 4194816 len 16384 2024-09-21T01:46:37.522 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1024 offset 4194816 len 16384 2024-09-21T01:46:37.522 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 1024 offset 4194816 len 16384 2024-09-21T01:46:37.522 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1024 offset 4194816 len 16384 2024-09-21T01:46:37.522 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 1024 offset 4195328 len 1024 2024-09-21T01:46:37.522 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1024 offset 4195328 len 1024 2024-09-21T01:46:37.522 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 1024 offset 4195328 len 1024 2024-09-21T01:46:37.522 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1024 offset 4195328 len 1024 2024-09-21T01:46:37.523 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 1024 offset 4195328 len 2048 2024-09-21T01:46:37.523 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1024 offset 4195328 len 2048 2024-09-21T01:46:37.523 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 1024 offset 4195328 len 2048 2024-09-21T01:46:37.523 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1024 offset 4195328 len 2048 2024-09-21T01:46:37.523 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 1024 offset 4195328 len 4096 2024-09-21T01:46:37.523 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1024 offset 4195328 len 4096 2024-09-21T01:46:37.523 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 1024 offset 4195328 len 4096 2024-09-21T01:46:37.523 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1024 offset 4195328 len 4096 2024-09-21T01:46:37.523 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 1024 offset 4195328 len 8192 2024-09-21T01:46:37.523 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1024 offset 4195328 len 8192 2024-09-21T01:46:37.523 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 1024 offset 4195328 len 8192 2024-09-21T01:46:37.523 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1024 offset 4195328 len 8192 2024-09-21T01:46:37.523 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 1024 offset 4195328 len 16384 2024-09-21T01:46:37.523 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1024 offset 4195328 len 16384 2024-09-21T01:46:37.524 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 1024 offset 4195328 len 16384 2024-09-21T01:46:37.524 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1024 offset 4195328 len 16384 2024-09-21T01:46:37.524 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 1024 offset 4195840 len 1024 2024-09-21T01:46:37.524 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1024 offset 4195840 len 1024 2024-09-21T01:46:37.524 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 1024 offset 4195840 len 1024 2024-09-21T01:46:37.524 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1024 offset 4195840 len 1024 2024-09-21T01:46:37.524 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 1024 offset 4195840 len 2048 2024-09-21T01:46:37.524 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1024 offset 4195840 len 2048 2024-09-21T01:46:37.524 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 1024 offset 4195840 len 2048 2024-09-21T01:46:37.524 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1024 offset 4195840 len 2048 2024-09-21T01:46:37.524 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 1024 offset 4195840 len 4096 2024-09-21T01:46:37.524 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1024 offset 4195840 len 4096 2024-09-21T01:46:37.524 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 1024 offset 4195840 len 4096 2024-09-21T01:46:37.524 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1024 offset 4195840 len 4096 2024-09-21T01:46:37.524 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 1024 offset 4195840 len 8192 2024-09-21T01:46:37.525 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1024 offset 4195840 len 8192 2024-09-21T01:46:37.525 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 1024 offset 4195840 len 8192 2024-09-21T01:46:37.525 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1024 offset 4195840 len 8192 2024-09-21T01:46:37.525 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 1024 offset 4195840 len 16384 2024-09-21T01:46:37.525 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1024 offset 4195840 len 16384 2024-09-21T01:46:37.525 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 1024 offset 4195840 len 16384 2024-09-21T01:46:37.525 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1024 offset 4195840 len 16384 2024-09-21T01:46:37.525 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 1024 offset 4196352 len 1024 2024-09-21T01:46:37.525 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1024 offset 4196352 len 1024 2024-09-21T01:46:37.525 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 1024 offset 4196352 len 1024 2024-09-21T01:46:37.525 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1024 offset 4196352 len 1024 2024-09-21T01:46:37.525 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 1024 offset 4196352 len 2048 2024-09-21T01:46:37.525 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1024 offset 4196352 len 2048 2024-09-21T01:46:37.525 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 1024 offset 4196352 len 2048 2024-09-21T01:46:37.525 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1024 offset 4196352 len 2048 2024-09-21T01:46:37.525 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 1024 offset 4196352 len 4096 2024-09-21T01:46:37.526 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1024 offset 4196352 len 4096 2024-09-21T01:46:37.526 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 1024 offset 4196352 len 4096 2024-09-21T01:46:37.526 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1024 offset 4196352 len 4096 2024-09-21T01:46:37.526 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 1024 offset 4196352 len 8192 2024-09-21T01:46:37.526 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1024 offset 4196352 len 8192 2024-09-21T01:46:37.526 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 1024 offset 4196352 len 8192 2024-09-21T01:46:37.526 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1024 offset 4196352 len 8192 2024-09-21T01:46:37.526 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 1024 offset 4196352 len 16384 2024-09-21T01:46:37.526 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1024 offset 4196352 len 16384 2024-09-21T01:46:37.526 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 1024 offset 4196352 len 16384 2024-09-21T01:46:37.526 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1024 offset 4196352 len 16384 2024-09-21T01:46:37.526 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 1024 offset 4196864 len 1024 2024-09-21T01:46:37.526 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1024 offset 4196864 len 1024 2024-09-21T01:46:37.526 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 1024 offset 4196864 len 1024 2024-09-21T01:46:37.526 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1024 offset 4196864 len 1024 2024-09-21T01:46:37.527 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 1024 offset 4196864 len 2048 2024-09-21T01:46:37.527 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1024 offset 4196864 len 2048 2024-09-21T01:46:37.527 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 1024 offset 4196864 len 2048 2024-09-21T01:46:37.527 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1024 offset 4196864 len 2048 2024-09-21T01:46:37.527 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 1024 offset 4196864 len 4096 2024-09-21T01:46:37.527 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1024 offset 4196864 len 4096 2024-09-21T01:46:37.527 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 1024 offset 4196864 len 4096 2024-09-21T01:46:38.133 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1024 offset 4196864 len 4096 2024-09-21T01:46:38.133 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 1024 offset 4196864 len 8192 2024-09-21T01:46:38.134 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1024 offset 4196864 len 8192 2024-09-21T01:46:38.134 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 1024 offset 4196864 len 8192 2024-09-21T01:46:38.134 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1024 offset 4196864 len 8192 2024-09-21T01:46:38.134 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 1024 offset 4196864 len 16384 2024-09-21T01:46:38.134 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1024 offset 4196864 len 16384 2024-09-21T01:46:38.134 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 1024 offset 4196864 len 16384 2024-09-21T01:46:38.134 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1024 offset 4196864 len 16384 2024-09-21T01:46:38.134 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 1024 offset 4197376 len 1024 2024-09-21T01:46:38.134 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1024 offset 4197376 len 1024 2024-09-21T01:46:38.134 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 1024 offset 4197376 len 1024 2024-09-21T01:46:38.134 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1024 offset 4197376 len 1024 2024-09-21T01:46:38.134 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 1024 offset 4197376 len 2048 2024-09-21T01:46:38.134 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1024 offset 4197376 len 2048 2024-09-21T01:46:38.135 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 1024 offset 4197376 len 2048 2024-09-21T01:46:38.135 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1024 offset 4197376 len 2048 2024-09-21T01:46:38.135 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 1024 offset 4197376 len 4096 2024-09-21T01:46:38.135 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1024 offset 4197376 len 4096 2024-09-21T01:46:38.135 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 1024 offset 4197376 len 4096 2024-09-21T01:46:38.135 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1024 offset 4197376 len 4096 2024-09-21T01:46:38.135 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 1024 offset 4197376 len 8192 2024-09-21T01:46:38.135 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1024 offset 4197376 len 8192 2024-09-21T01:46:38.135 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 1024 offset 4197376 len 8192 2024-09-21T01:46:38.135 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1024 offset 4197376 len 8192 2024-09-21T01:46:38.135 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 1024 offset 4197376 len 16384 2024-09-21T01:46:38.135 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1024 offset 4197376 len 16384 2024-09-21T01:46:38.135 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 1024 offset 4197376 len 16384 2024-09-21T01:46:38.135 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1024 offset 4197376 len 16384 2024-09-21T01:46:38.135 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 1024 offset 4197888 len 1024 2024-09-21T01:46:38.136 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1024 offset 4197888 len 1024 2024-09-21T01:46:38.136 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 1024 offset 4197888 len 1024 2024-09-21T01:46:38.136 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1024 offset 4197888 len 1024 2024-09-21T01:46:38.136 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 1024 offset 4197888 len 2048 2024-09-21T01:46:38.136 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1024 offset 4197888 len 2048 2024-09-21T01:46:38.136 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 1024 offset 4197888 len 2048 2024-09-21T01:46:38.136 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1024 offset 4197888 len 2048 2024-09-21T01:46:38.136 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 1024 offset 4197888 len 4096 2024-09-21T01:46:38.136 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1024 offset 4197888 len 4096 2024-09-21T01:46:38.136 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 1024 offset 4197888 len 4096 2024-09-21T01:46:38.136 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1024 offset 4197888 len 4096 2024-09-21T01:46:38.136 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 1024 offset 4197888 len 8192 2024-09-21T01:46:38.136 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1024 offset 4197888 len 8192 2024-09-21T01:46:38.136 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 1024 offset 4197888 len 8192 2024-09-21T01:46:38.137 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1024 offset 4197888 len 8192 2024-09-21T01:46:38.137 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 1024 offset 4197888 len 16384 2024-09-21T01:46:38.137 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1024 offset 4197888 len 16384 2024-09-21T01:46:38.137 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 1024 offset 4197888 len 16384 2024-09-21T01:46:38.137 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1024 offset 4197888 len 16384 2024-09-21T01:46:38.137 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 1536 offset 4190720 len 1024 2024-09-21T01:46:38.137 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1536 offset 4190720 len 1024 2024-09-21T01:46:38.137 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 1536 offset 4190720 len 1024 2024-09-21T01:46:38.137 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1536 offset 4190720 len 1024 2024-09-21T01:46:38.137 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 1536 offset 4190720 len 2048 2024-09-21T01:46:38.137 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1536 offset 4190720 len 2048 2024-09-21T01:46:38.137 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 1536 offset 4190720 len 2048 2024-09-21T01:46:38.137 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1536 offset 4190720 len 2048 2024-09-21T01:46:38.137 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 1536 offset 4190720 len 4096 2024-09-21T01:46:38.137 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1536 offset 4190720 len 4096 2024-09-21T01:46:38.138 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 1536 offset 4190720 len 4096 2024-09-21T01:46:38.138 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1536 offset 4190720 len 4096 2024-09-21T01:46:38.138 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 1536 offset 4190720 len 8192 2024-09-21T01:46:38.138 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1536 offset 4190720 len 8192 2024-09-21T01:46:38.138 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 1536 offset 4190720 len 8192 2024-09-21T01:46:38.138 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1536 offset 4190720 len 8192 2024-09-21T01:46:38.138 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 1536 offset 4190720 len 16384 2024-09-21T01:46:38.138 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1536 offset 4190720 len 16384 2024-09-21T01:46:38.138 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 1536 offset 4190720 len 16384 2024-09-21T01:46:38.138 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1536 offset 4190720 len 16384 2024-09-21T01:46:38.138 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 1536 offset 4191232 len 1024 2024-09-21T01:46:38.138 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1536 offset 4191232 len 1024 2024-09-21T01:46:38.138 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 1536 offset 4191232 len 1024 2024-09-21T01:46:38.138 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1536 offset 4191232 len 1024 2024-09-21T01:46:38.138 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 1536 offset 4191232 len 2048 2024-09-21T01:46:38.139 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1536 offset 4191232 len 2048 2024-09-21T01:46:38.139 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 1536 offset 4191232 len 2048 2024-09-21T01:46:38.139 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1536 offset 4191232 len 2048 2024-09-21T01:46:38.139 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 1536 offset 4191232 len 4096 2024-09-21T01:46:38.139 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1536 offset 4191232 len 4096 2024-09-21T01:46:38.139 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 1536 offset 4191232 len 4096 2024-09-21T01:46:38.139 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1536 offset 4191232 len 4096 2024-09-21T01:46:38.935 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 1536 offset 4191232 len 8192 2024-09-21T01:46:38.936 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1536 offset 4191232 len 8192 2024-09-21T01:46:38.936 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 1536 offset 4191232 len 8192 2024-09-21T01:46:38.936 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1536 offset 4191232 len 8192 2024-09-21T01:46:38.936 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 1536 offset 4191232 len 16384 2024-09-21T01:46:38.936 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1536 offset 4191232 len 16384 2024-09-21T01:46:38.936 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 1536 offset 4191232 len 16384 2024-09-21T01:46:38.936 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1536 offset 4191232 len 16384 2024-09-21T01:46:38.936 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 1536 offset 4191744 len 1024 2024-09-21T01:46:38.936 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1536 offset 4191744 len 1024 2024-09-21T01:46:38.936 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 1536 offset 4191744 len 1024 2024-09-21T01:46:38.936 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1536 offset 4191744 len 1024 2024-09-21T01:46:38.936 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 1536 offset 4191744 len 2048 2024-09-21T01:46:38.936 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1536 offset 4191744 len 2048 2024-09-21T01:46:38.937 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 1536 offset 4191744 len 2048 2024-09-21T01:46:38.937 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1536 offset 4191744 len 2048 2024-09-21T01:46:38.937 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 1536 offset 4191744 len 4096 2024-09-21T01:46:38.937 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1536 offset 4191744 len 4096 2024-09-21T01:46:38.937 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 1536 offset 4191744 len 4096 2024-09-21T01:46:38.937 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1536 offset 4191744 len 4096 2024-09-21T01:46:38.937 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 1536 offset 4191744 len 8192 2024-09-21T01:46:38.937 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1536 offset 4191744 len 8192 2024-09-21T01:46:38.937 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 1536 offset 4191744 len 8192 2024-09-21T01:46:38.937 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1536 offset 4191744 len 8192 2024-09-21T01:46:38.937 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 1536 offset 4191744 len 16384 2024-09-21T01:46:38.937 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1536 offset 4191744 len 16384 2024-09-21T01:46:38.937 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 1536 offset 4191744 len 16384 2024-09-21T01:46:38.937 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1536 offset 4191744 len 16384 2024-09-21T01:46:38.937 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 1536 offset 4192256 len 1024 2024-09-21T01:46:38.937 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1536 offset 4192256 len 1024 2024-09-21T01:46:38.938 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 1536 offset 4192256 len 1024 2024-09-21T01:46:38.938 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1536 offset 4192256 len 1024 2024-09-21T01:46:38.938 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 1536 offset 4192256 len 2048 2024-09-21T01:46:38.938 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1536 offset 4192256 len 2048 2024-09-21T01:46:38.938 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 1536 offset 4192256 len 2048 2024-09-21T01:46:38.938 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1536 offset 4192256 len 2048 2024-09-21T01:46:38.938 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 1536 offset 4192256 len 4096 2024-09-21T01:46:38.938 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1536 offset 4192256 len 4096 2024-09-21T01:46:38.938 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 1536 offset 4192256 len 4096 2024-09-21T01:46:38.938 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1536 offset 4192256 len 4096 2024-09-21T01:46:38.938 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 1536 offset 4192256 len 8192 2024-09-21T01:46:38.938 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1536 offset 4192256 len 8192 2024-09-21T01:46:38.938 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 1536 offset 4192256 len 8192 2024-09-21T01:46:38.938 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1536 offset 4192256 len 8192 2024-09-21T01:46:38.939 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 1536 offset 4192256 len 16384 2024-09-21T01:46:38.939 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1536 offset 4192256 len 16384 2024-09-21T01:46:38.939 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 1536 offset 4192256 len 16384 2024-09-21T01:46:38.939 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1536 offset 4192256 len 16384 2024-09-21T01:46:38.939 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 1536 offset 4192768 len 1024 2024-09-21T01:46:38.939 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1536 offset 4192768 len 1024 2024-09-21T01:46:38.939 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 1536 offset 4192768 len 1024 2024-09-21T01:46:38.939 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1536 offset 4192768 len 1024 2024-09-21T01:46:38.939 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 1536 offset 4192768 len 2048 2024-09-21T01:46:38.939 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1536 offset 4192768 len 2048 2024-09-21T01:46:38.939 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 1536 offset 4192768 len 2048 2024-09-21T01:46:38.939 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1536 offset 4192768 len 2048 2024-09-21T01:46:38.939 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 1536 offset 4192768 len 4096 2024-09-21T01:46:38.939 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1536 offset 4192768 len 4096 2024-09-21T01:46:38.939 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 1536 offset 4192768 len 4096 2024-09-21T01:46:38.940 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1536 offset 4192768 len 4096 2024-09-21T01:46:38.940 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 1536 offset 4192768 len 8192 2024-09-21T01:46:38.940 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1536 offset 4192768 len 8192 2024-09-21T01:46:38.940 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 1536 offset 4192768 len 8192 2024-09-21T01:46:38.940 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1536 offset 4192768 len 8192 2024-09-21T01:46:38.940 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 1536 offset 4192768 len 16384 2024-09-21T01:46:38.940 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1536 offset 4192768 len 16384 2024-09-21T01:46:38.940 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 1536 offset 4192768 len 16384 2024-09-21T01:46:38.940 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1536 offset 4192768 len 16384 2024-09-21T01:46:38.940 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 1536 offset 4193280 len 1024 2024-09-21T01:46:38.940 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1536 offset 4193280 len 1024 2024-09-21T01:46:38.940 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 1536 offset 4193280 len 1024 2024-09-21T01:46:38.940 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1536 offset 4193280 len 1024 2024-09-21T01:46:38.940 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 1536 offset 4193280 len 2048 2024-09-21T01:46:38.940 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1536 offset 4193280 len 2048 2024-09-21T01:46:38.940 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 1536 offset 4193280 len 2048 2024-09-21T01:46:38.941 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1536 offset 4193280 len 2048 2024-09-21T01:46:38.941 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 1536 offset 4193280 len 4096 2024-09-21T01:46:38.941 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1536 offset 4193280 len 4096 2024-09-21T01:46:38.941 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 1536 offset 4193280 len 4096 2024-09-21T01:46:38.941 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1536 offset 4193280 len 4096 2024-09-21T01:46:38.941 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 1536 offset 4193280 len 8192 2024-09-21T01:46:39.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:46:38 smithi083 ceph-mon[31370]: pgmap v477: 129 pgs: 129 active+clean; 298 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 879 KiB/s rd, 832 KiB/s wr, 204 op/s 2024-09-21T01:46:39.464 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:46:38 smithi142 ceph-mon[34050]: pgmap v477: 129 pgs: 129 active+clean; 298 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 879 KiB/s rd, 832 KiB/s wr, 204 op/s 2024-09-21T01:46:39.467 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:46:38 smithi119 ceph-mon[33693]: pgmap v477: 129 pgs: 129 active+clean; 298 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 879 KiB/s rd, 832 KiB/s wr, 204 op/s 2024-09-21T01:46:39.508 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1536 offset 4193280 len 8192 2024-09-21T01:46:39.508 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 1536 offset 4193280 len 8192 2024-09-21T01:46:39.508 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1536 offset 4193280 len 8192 2024-09-21T01:46:39.508 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 1536 offset 4193280 len 16384 2024-09-21T01:46:39.509 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1536 offset 4193280 len 16384 2024-09-21T01:46:39.509 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 1536 offset 4193280 len 16384 2024-09-21T01:46:39.509 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1536 offset 4193280 len 16384 2024-09-21T01:46:39.509 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 1536 offset 4193792 len 1024 2024-09-21T01:46:39.509 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1536 offset 4193792 len 1024 2024-09-21T01:46:39.509 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 1536 offset 4193792 len 1024 2024-09-21T01:46:39.509 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1536 offset 4193792 len 1024 2024-09-21T01:46:39.509 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 1536 offset 4193792 len 2048 2024-09-21T01:46:39.509 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1536 offset 4193792 len 2048 2024-09-21T01:46:39.509 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 1536 offset 4193792 len 2048 2024-09-21T01:46:39.509 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1536 offset 4193792 len 2048 2024-09-21T01:46:39.509 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 1536 offset 4193792 len 4096 2024-09-21T01:46:39.509 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1536 offset 4193792 len 4096 2024-09-21T01:46:39.509 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 1536 offset 4193792 len 4096 2024-09-21T01:46:39.510 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1536 offset 4193792 len 4096 2024-09-21T01:46:39.510 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 1536 offset 4193792 len 8192 2024-09-21T01:46:39.510 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1536 offset 4193792 len 8192 2024-09-21T01:46:39.510 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 1536 offset 4193792 len 8192 2024-09-21T01:46:39.510 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1536 offset 4193792 len 8192 2024-09-21T01:46:39.510 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 1536 offset 4193792 len 16384 2024-09-21T01:46:39.510 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1536 offset 4193792 len 16384 2024-09-21T01:46:39.510 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 1536 offset 4193792 len 16384 2024-09-21T01:46:39.510 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1536 offset 4193792 len 16384 2024-09-21T01:46:39.510 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 1536 offset 4194304 len 1024 2024-09-21T01:46:39.511 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1536 offset 4194304 len 1024 2024-09-21T01:46:39.511 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 1536 offset 4194304 len 1024 2024-09-21T01:46:39.511 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1536 offset 4194304 len 1024 2024-09-21T01:46:39.511 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 1536 offset 4194304 len 2048 2024-09-21T01:46:39.511 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1536 offset 4194304 len 2048 2024-09-21T01:46:39.511 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 1536 offset 4194304 len 2048 2024-09-21T01:46:39.511 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1536 offset 4194304 len 2048 2024-09-21T01:46:39.511 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 1536 offset 4194304 len 4096 2024-09-21T01:46:39.511 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1536 offset 4194304 len 4096 2024-09-21T01:46:39.511 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 1536 offset 4194304 len 4096 2024-09-21T01:46:39.511 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1536 offset 4194304 len 4096 2024-09-21T01:46:39.511 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 1536 offset 4194304 len 8192 2024-09-21T01:46:39.511 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1536 offset 4194304 len 8192 2024-09-21T01:46:39.511 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 1536 offset 4194304 len 8192 2024-09-21T01:46:39.511 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1536 offset 4194304 len 8192 2024-09-21T01:46:39.512 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 1536 offset 4194304 len 16384 2024-09-21T01:46:39.512 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1536 offset 4194304 len 16384 2024-09-21T01:46:39.512 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 1536 offset 4194304 len 16384 2024-09-21T01:46:39.512 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1536 offset 4194304 len 16384 2024-09-21T01:46:39.512 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 1536 offset 4194816 len 1024 2024-09-21T01:46:39.512 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1536 offset 4194816 len 1024 2024-09-21T01:46:39.512 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 1536 offset 4194816 len 1024 2024-09-21T01:46:39.512 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1536 offset 4194816 len 1024 2024-09-21T01:46:39.512 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 1536 offset 4194816 len 2048 2024-09-21T01:46:39.512 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1536 offset 4194816 len 2048 2024-09-21T01:46:39.512 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 1536 offset 4194816 len 2048 2024-09-21T01:46:39.513 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1536 offset 4194816 len 2048 2024-09-21T01:46:39.513 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 1536 offset 4194816 len 4096 2024-09-21T01:46:39.513 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1536 offset 4194816 len 4096 2024-09-21T01:46:39.513 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 1536 offset 4194816 len 4096 2024-09-21T01:46:39.513 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1536 offset 4194816 len 4096 2024-09-21T01:46:39.513 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 1536 offset 4194816 len 8192 2024-09-21T01:46:39.513 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1536 offset 4194816 len 8192 2024-09-21T01:46:39.513 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 1536 offset 4194816 len 8192 2024-09-21T01:46:39.513 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1536 offset 4194816 len 8192 2024-09-21T01:46:39.513 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 1536 offset 4194816 len 16384 2024-09-21T01:46:39.513 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1536 offset 4194816 len 16384 2024-09-21T01:46:39.514 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 1536 offset 4194816 len 16384 2024-09-21T01:46:39.514 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1536 offset 4194816 len 16384 2024-09-21T01:46:39.514 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 1536 offset 4195328 len 1024 2024-09-21T01:46:39.514 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1536 offset 4195328 len 1024 2024-09-21T01:46:39.514 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 1536 offset 4195328 len 1024 2024-09-21T01:46:39.514 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1536 offset 4195328 len 1024 2024-09-21T01:46:39.514 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 1536 offset 4195328 len 2048 2024-09-21T01:46:39.514 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1536 offset 4195328 len 2048 2024-09-21T01:46:39.514 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 1536 offset 4195328 len 2048 2024-09-21T01:46:39.514 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1536 offset 4195328 len 2048 2024-09-21T01:46:39.514 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 1536 offset 4195328 len 4096 2024-09-21T01:46:39.514 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1536 offset 4195328 len 4096 2024-09-21T01:46:39.514 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 1536 offset 4195328 len 4096 2024-09-21T01:46:39.514 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1536 offset 4195328 len 4096 2024-09-21T01:46:39.515 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 1536 offset 4195328 len 8192 2024-09-21T01:46:40.020 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1536 offset 4195328 len 8192 2024-09-21T01:46:40.020 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 1536 offset 4195328 len 8192 2024-09-21T01:46:40.020 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1536 offset 4195328 len 8192 2024-09-21T01:46:40.020 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 1536 offset 4195328 len 16384 2024-09-21T01:46:40.020 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1536 offset 4195328 len 16384 2024-09-21T01:46:40.020 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 1536 offset 4195328 len 16384 2024-09-21T01:46:40.020 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1536 offset 4195328 len 16384 2024-09-21T01:46:40.020 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 1536 offset 4195840 len 1024 2024-09-21T01:46:40.020 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1536 offset 4195840 len 1024 2024-09-21T01:46:40.021 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 1536 offset 4195840 len 1024 2024-09-21T01:46:40.021 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1536 offset 4195840 len 1024 2024-09-21T01:46:40.021 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 1536 offset 4195840 len 2048 2024-09-21T01:46:40.021 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1536 offset 4195840 len 2048 2024-09-21T01:46:40.021 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 1536 offset 4195840 len 2048 2024-09-21T01:46:40.021 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1536 offset 4195840 len 2048 2024-09-21T01:46:40.021 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 1536 offset 4195840 len 4096 2024-09-21T01:46:40.021 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1536 offset 4195840 len 4096 2024-09-21T01:46:40.021 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 1536 offset 4195840 len 4096 2024-09-21T01:46:40.021 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1536 offset 4195840 len 4096 2024-09-21T01:46:40.021 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 1536 offset 4195840 len 8192 2024-09-21T01:46:40.021 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1536 offset 4195840 len 8192 2024-09-21T01:46:40.021 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 1536 offset 4195840 len 8192 2024-09-21T01:46:40.021 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1536 offset 4195840 len 8192 2024-09-21T01:46:40.022 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 1536 offset 4195840 len 16384 2024-09-21T01:46:40.022 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1536 offset 4195840 len 16384 2024-09-21T01:46:40.022 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 1536 offset 4195840 len 16384 2024-09-21T01:46:40.022 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1536 offset 4195840 len 16384 2024-09-21T01:46:40.022 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 1536 offset 4196352 len 1024 2024-09-21T01:46:40.022 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1536 offset 4196352 len 1024 2024-09-21T01:46:40.022 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 1536 offset 4196352 len 1024 2024-09-21T01:46:40.022 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1536 offset 4196352 len 1024 2024-09-21T01:46:40.022 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 1536 offset 4196352 len 2048 2024-09-21T01:46:40.022 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1536 offset 4196352 len 2048 2024-09-21T01:46:40.022 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 1536 offset 4196352 len 2048 2024-09-21T01:46:40.022 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1536 offset 4196352 len 2048 2024-09-21T01:46:40.022 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 1536 offset 4196352 len 4096 2024-09-21T01:46:40.022 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1536 offset 4196352 len 4096 2024-09-21T01:46:40.023 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 1536 offset 4196352 len 4096 2024-09-21T01:46:40.023 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1536 offset 4196352 len 4096 2024-09-21T01:46:40.023 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 1536 offset 4196352 len 8192 2024-09-21T01:46:40.023 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1536 offset 4196352 len 8192 2024-09-21T01:46:40.023 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 1536 offset 4196352 len 8192 2024-09-21T01:46:40.023 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1536 offset 4196352 len 8192 2024-09-21T01:46:40.023 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 1536 offset 4196352 len 16384 2024-09-21T01:46:40.023 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1536 offset 4196352 len 16384 2024-09-21T01:46:40.023 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 1536 offset 4196352 len 16384 2024-09-21T01:46:40.023 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1536 offset 4196352 len 16384 2024-09-21T01:46:40.023 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 1536 offset 4196864 len 1024 2024-09-21T01:46:40.023 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1536 offset 4196864 len 1024 2024-09-21T01:46:40.023 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 1536 offset 4196864 len 1024 2024-09-21T01:46:40.023 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1536 offset 4196864 len 1024 2024-09-21T01:46:40.023 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 1536 offset 4196864 len 2048 2024-09-21T01:46:40.024 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1536 offset 4196864 len 2048 2024-09-21T01:46:40.024 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 1536 offset 4196864 len 2048 2024-09-21T01:46:40.024 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1536 offset 4196864 len 2048 2024-09-21T01:46:40.024 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 1536 offset 4196864 len 4096 2024-09-21T01:46:40.024 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1536 offset 4196864 len 4096 2024-09-21T01:46:40.024 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 1536 offset 4196864 len 4096 2024-09-21T01:46:40.024 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1536 offset 4196864 len 4096 2024-09-21T01:46:40.024 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 1536 offset 4196864 len 8192 2024-09-21T01:46:40.024 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1536 offset 4196864 len 8192 2024-09-21T01:46:40.024 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 1536 offset 4196864 len 8192 2024-09-21T01:46:40.024 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1536 offset 4196864 len 8192 2024-09-21T01:46:40.024 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 1536 offset 4196864 len 16384 2024-09-21T01:46:40.024 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1536 offset 4196864 len 16384 2024-09-21T01:46:40.024 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 1536 offset 4196864 len 16384 2024-09-21T01:46:40.024 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1536 offset 4196864 len 16384 2024-09-21T01:46:40.025 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 1536 offset 4197376 len 1024 2024-09-21T01:46:40.025 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1536 offset 4197376 len 1024 2024-09-21T01:46:40.025 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 1536 offset 4197376 len 1024 2024-09-21T01:46:40.025 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1536 offset 4197376 len 1024 2024-09-21T01:46:40.025 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 1536 offset 4197376 len 2048 2024-09-21T01:46:40.025 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1536 offset 4197376 len 2048 2024-09-21T01:46:40.025 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 1536 offset 4197376 len 2048 2024-09-21T01:46:40.025 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1536 offset 4197376 len 2048 2024-09-21T01:46:40.025 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 1536 offset 4197376 len 4096 2024-09-21T01:46:40.025 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1536 offset 4197376 len 4096 2024-09-21T01:46:40.025 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 1536 offset 4197376 len 4096 2024-09-21T01:46:40.025 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1536 offset 4197376 len 4096 2024-09-21T01:46:40.025 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 1536 offset 4197376 len 8192 2024-09-21T01:46:40.025 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1536 offset 4197376 len 8192 2024-09-21T01:46:40.722 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 1536 offset 4197376 len 8192 2024-09-21T01:46:40.723 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1536 offset 4197376 len 8192 2024-09-21T01:46:40.723 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 1536 offset 4197376 len 16384 2024-09-21T01:46:40.723 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1536 offset 4197376 len 16384 2024-09-21T01:46:40.723 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 1536 offset 4197376 len 16384 2024-09-21T01:46:40.723 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1536 offset 4197376 len 16384 2024-09-21T01:46:40.723 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 1536 offset 4197888 len 1024 2024-09-21T01:46:40.723 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1536 offset 4197888 len 1024 2024-09-21T01:46:40.723 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 1536 offset 4197888 len 1024 2024-09-21T01:46:40.723 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1536 offset 4197888 len 1024 2024-09-21T01:46:40.723 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 1536 offset 4197888 len 2048 2024-09-21T01:46:40.723 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1536 offset 4197888 len 2048 2024-09-21T01:46:40.723 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 1536 offset 4197888 len 2048 2024-09-21T01:46:40.723 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1536 offset 4197888 len 2048 2024-09-21T01:46:40.723 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 1536 offset 4197888 len 4096 2024-09-21T01:46:40.723 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1536 offset 4197888 len 4096 2024-09-21T01:46:40.724 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 1536 offset 4197888 len 4096 2024-09-21T01:46:40.724 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1536 offset 4197888 len 4096 2024-09-21T01:46:40.724 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 1536 offset 4197888 len 8192 2024-09-21T01:46:40.724 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1536 offset 4197888 len 8192 2024-09-21T01:46:40.724 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 1536 offset 4197888 len 8192 2024-09-21T01:46:40.724 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1536 offset 4197888 len 8192 2024-09-21T01:46:40.724 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 1536 offset 4197888 len 16384 2024-09-21T01:46:40.724 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1536 offset 4197888 len 16384 2024-09-21T01:46:40.724 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 1536 offset 4197888 len 16384 2024-09-21T01:46:40.724 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 1536 offset 4197888 len 16384 2024-09-21T01:46:40.724 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 2048 offset 4190720 len 1024 2024-09-21T01:46:40.724 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2048 offset 4190720 len 1024 2024-09-21T01:46:40.724 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 2048 offset 4190720 len 1024 2024-09-21T01:46:40.724 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2048 offset 4190720 len 1024 2024-09-21T01:46:40.724 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 2048 offset 4190720 len 2048 2024-09-21T01:46:40.725 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2048 offset 4190720 len 2048 2024-09-21T01:46:40.725 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 2048 offset 4190720 len 2048 2024-09-21T01:46:40.725 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2048 offset 4190720 len 2048 2024-09-21T01:46:40.725 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 2048 offset 4190720 len 4096 2024-09-21T01:46:40.725 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2048 offset 4190720 len 4096 2024-09-21T01:46:40.725 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 2048 offset 4190720 len 4096 2024-09-21T01:46:40.725 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2048 offset 4190720 len 4096 2024-09-21T01:46:40.725 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 2048 offset 4190720 len 8192 2024-09-21T01:46:40.725 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2048 offset 4190720 len 8192 2024-09-21T01:46:40.725 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 2048 offset 4190720 len 8192 2024-09-21T01:46:40.725 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2048 offset 4190720 len 8192 2024-09-21T01:46:40.725 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 2048 offset 4190720 len 16384 2024-09-21T01:46:40.725 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2048 offset 4190720 len 16384 2024-09-21T01:46:40.725 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 2048 offset 4190720 len 16384 2024-09-21T01:46:40.725 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2048 offset 4190720 len 16384 2024-09-21T01:46:40.726 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 2048 offset 4191232 len 1024 2024-09-21T01:46:40.726 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2048 offset 4191232 len 1024 2024-09-21T01:46:40.726 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 2048 offset 4191232 len 1024 2024-09-21T01:46:40.726 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2048 offset 4191232 len 1024 2024-09-21T01:46:40.726 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 2048 offset 4191232 len 2048 2024-09-21T01:46:40.726 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2048 offset 4191232 len 2048 2024-09-21T01:46:40.726 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 2048 offset 4191232 len 2048 2024-09-21T01:46:40.726 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2048 offset 4191232 len 2048 2024-09-21T01:46:40.726 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 2048 offset 4191232 len 4096 2024-09-21T01:46:40.726 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2048 offset 4191232 len 4096 2024-09-21T01:46:40.726 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 2048 offset 4191232 len 4096 2024-09-21T01:46:40.726 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2048 offset 4191232 len 4096 2024-09-21T01:46:40.726 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 2048 offset 4191232 len 8192 2024-09-21T01:46:40.726 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2048 offset 4191232 len 8192 2024-09-21T01:46:40.726 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 2048 offset 4191232 len 8192 2024-09-21T01:46:40.727 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2048 offset 4191232 len 8192 2024-09-21T01:46:40.727 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 2048 offset 4191232 len 16384 2024-09-21T01:46:40.727 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2048 offset 4191232 len 16384 2024-09-21T01:46:40.727 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 2048 offset 4191232 len 16384 2024-09-21T01:46:40.727 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2048 offset 4191232 len 16384 2024-09-21T01:46:40.727 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 2048 offset 4191744 len 1024 2024-09-21T01:46:40.727 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2048 offset 4191744 len 1024 2024-09-21T01:46:40.727 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 2048 offset 4191744 len 1024 2024-09-21T01:46:40.727 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2048 offset 4191744 len 1024 2024-09-21T01:46:40.727 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 2048 offset 4191744 len 2048 2024-09-21T01:46:40.727 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2048 offset 4191744 len 2048 2024-09-21T01:46:40.727 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 2048 offset 4191744 len 2048 2024-09-21T01:46:40.727 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2048 offset 4191744 len 2048 2024-09-21T01:46:40.727 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 2048 offset 4191744 len 4096 2024-09-21T01:46:40.728 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2048 offset 4191744 len 4096 2024-09-21T01:46:40.728 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 2048 offset 4191744 len 4096 2024-09-21T01:46:40.728 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2048 offset 4191744 len 4096 2024-09-21T01:46:40.728 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 2048 offset 4191744 len 8192 2024-09-21T01:46:40.728 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2048 offset 4191744 len 8192 2024-09-21T01:46:40.728 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 2048 offset 4191744 len 8192 2024-09-21T01:46:41.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:46:40 smithi083 ceph-mon[31370]: pgmap v478: 129 pgs: 129 active+clean; 308 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 1021 KiB/s rd, 1.0 MiB/s wr, 246 op/s 2024-09-21T01:46:41.464 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:46:40 smithi142 ceph-mon[34050]: pgmap v478: 129 pgs: 129 active+clean; 308 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 1021 KiB/s rd, 1.0 MiB/s wr, 246 op/s 2024-09-21T01:46:41.467 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:46:40 smithi119 ceph-mon[33693]: pgmap v478: 129 pgs: 129 active+clean; 308 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 1021 KiB/s rd, 1.0 MiB/s wr, 246 op/s 2024-09-21T01:46:41.563 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2048 offset 4191744 len 8192 2024-09-21T01:46:41.563 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 2048 offset 4191744 len 16384 2024-09-21T01:46:41.563 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2048 offset 4191744 len 16384 2024-09-21T01:46:41.563 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 2048 offset 4191744 len 16384 2024-09-21T01:46:41.563 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2048 offset 4191744 len 16384 2024-09-21T01:46:41.563 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 2048 offset 4192256 len 1024 2024-09-21T01:46:41.564 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2048 offset 4192256 len 1024 2024-09-21T01:46:41.564 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 2048 offset 4192256 len 1024 2024-09-21T01:46:41.564 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2048 offset 4192256 len 1024 2024-09-21T01:46:41.564 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 2048 offset 4192256 len 2048 2024-09-21T01:46:41.564 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2048 offset 4192256 len 2048 2024-09-21T01:46:41.564 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 2048 offset 4192256 len 2048 2024-09-21T01:46:41.564 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2048 offset 4192256 len 2048 2024-09-21T01:46:41.564 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 2048 offset 4192256 len 4096 2024-09-21T01:46:41.564 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2048 offset 4192256 len 4096 2024-09-21T01:46:41.564 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 2048 offset 4192256 len 4096 2024-09-21T01:46:41.564 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2048 offset 4192256 len 4096 2024-09-21T01:46:41.564 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 2048 offset 4192256 len 8192 2024-09-21T01:46:41.564 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2048 offset 4192256 len 8192 2024-09-21T01:46:41.564 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 2048 offset 4192256 len 8192 2024-09-21T01:46:41.565 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2048 offset 4192256 len 8192 2024-09-21T01:46:41.565 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 2048 offset 4192256 len 16384 2024-09-21T01:46:41.565 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2048 offset 4192256 len 16384 2024-09-21T01:46:41.565 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 2048 offset 4192256 len 16384 2024-09-21T01:46:41.565 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2048 offset 4192256 len 16384 2024-09-21T01:46:41.565 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 2048 offset 4192768 len 1024 2024-09-21T01:46:41.565 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2048 offset 4192768 len 1024 2024-09-21T01:46:41.565 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 2048 offset 4192768 len 1024 2024-09-21T01:46:41.565 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2048 offset 4192768 len 1024 2024-09-21T01:46:41.565 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 2048 offset 4192768 len 2048 2024-09-21T01:46:41.565 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2048 offset 4192768 len 2048 2024-09-21T01:46:41.565 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 2048 offset 4192768 len 2048 2024-09-21T01:46:41.565 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2048 offset 4192768 len 2048 2024-09-21T01:46:41.565 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 2048 offset 4192768 len 4096 2024-09-21T01:46:41.565 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2048 offset 4192768 len 4096 2024-09-21T01:46:41.566 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 2048 offset 4192768 len 4096 2024-09-21T01:46:41.566 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2048 offset 4192768 len 4096 2024-09-21T01:46:41.566 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 2048 offset 4192768 len 8192 2024-09-21T01:46:41.566 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2048 offset 4192768 len 8192 2024-09-21T01:46:41.566 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 2048 offset 4192768 len 8192 2024-09-21T01:46:41.566 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2048 offset 4192768 len 8192 2024-09-21T01:46:41.566 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 2048 offset 4192768 len 16384 2024-09-21T01:46:41.566 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2048 offset 4192768 len 16384 2024-09-21T01:46:41.566 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 2048 offset 4192768 len 16384 2024-09-21T01:46:41.566 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2048 offset 4192768 len 16384 2024-09-21T01:46:41.566 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 2048 offset 4193280 len 1024 2024-09-21T01:46:41.566 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2048 offset 4193280 len 1024 2024-09-21T01:46:41.566 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 2048 offset 4193280 len 1024 2024-09-21T01:46:41.567 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2048 offset 4193280 len 1024 2024-09-21T01:46:41.567 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 2048 offset 4193280 len 2048 2024-09-21T01:46:41.567 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2048 offset 4193280 len 2048 2024-09-21T01:46:41.567 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 2048 offset 4193280 len 2048 2024-09-21T01:46:41.567 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2048 offset 4193280 len 2048 2024-09-21T01:46:41.567 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 2048 offset 4193280 len 4096 2024-09-21T01:46:41.567 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2048 offset 4193280 len 4096 2024-09-21T01:46:41.567 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 2048 offset 4193280 len 4096 2024-09-21T01:46:41.567 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2048 offset 4193280 len 4096 2024-09-21T01:46:41.567 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 2048 offset 4193280 len 8192 2024-09-21T01:46:41.567 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2048 offset 4193280 len 8192 2024-09-21T01:46:41.568 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 2048 offset 4193280 len 8192 2024-09-21T01:46:41.568 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2048 offset 4193280 len 8192 2024-09-21T01:46:41.568 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 2048 offset 4193280 len 16384 2024-09-21T01:46:41.568 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2048 offset 4193280 len 16384 2024-09-21T01:46:41.568 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 2048 offset 4193280 len 16384 2024-09-21T01:46:41.568 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2048 offset 4193280 len 16384 2024-09-21T01:46:41.568 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 2048 offset 4193792 len 1024 2024-09-21T01:46:41.568 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2048 offset 4193792 len 1024 2024-09-21T01:46:41.568 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 2048 offset 4193792 len 1024 2024-09-21T01:46:41.568 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2048 offset 4193792 len 1024 2024-09-21T01:46:41.568 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 2048 offset 4193792 len 2048 2024-09-21T01:46:41.568 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2048 offset 4193792 len 2048 2024-09-21T01:46:41.568 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 2048 offset 4193792 len 2048 2024-09-21T01:46:41.568 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2048 offset 4193792 len 2048 2024-09-21T01:46:41.568 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 2048 offset 4193792 len 4096 2024-09-21T01:46:41.569 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2048 offset 4193792 len 4096 2024-09-21T01:46:41.569 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 2048 offset 4193792 len 4096 2024-09-21T01:46:41.569 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2048 offset 4193792 len 4096 2024-09-21T01:46:41.569 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 2048 offset 4193792 len 8192 2024-09-21T01:46:41.569 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2048 offset 4193792 len 8192 2024-09-21T01:46:41.569 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 2048 offset 4193792 len 8192 2024-09-21T01:46:41.569 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2048 offset 4193792 len 8192 2024-09-21T01:46:42.035 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 2048 offset 4193792 len 16384 2024-09-21T01:46:42.036 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2048 offset 4193792 len 16384 2024-09-21T01:46:42.036 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 2048 offset 4193792 len 16384 2024-09-21T01:46:42.036 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2048 offset 4193792 len 16384 2024-09-21T01:46:42.036 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 2048 offset 4194304 len 1024 2024-09-21T01:46:42.036 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2048 offset 4194304 len 1024 2024-09-21T01:46:42.036 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 2048 offset 4194304 len 1024 2024-09-21T01:46:42.036 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2048 offset 4194304 len 1024 2024-09-21T01:46:42.036 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 2048 offset 4194304 len 2048 2024-09-21T01:46:42.036 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2048 offset 4194304 len 2048 2024-09-21T01:46:42.036 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 2048 offset 4194304 len 2048 2024-09-21T01:46:42.036 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2048 offset 4194304 len 2048 2024-09-21T01:46:42.036 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 2048 offset 4194304 len 4096 2024-09-21T01:46:42.037 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2048 offset 4194304 len 4096 2024-09-21T01:46:42.037 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 2048 offset 4194304 len 4096 2024-09-21T01:46:42.037 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2048 offset 4194304 len 4096 2024-09-21T01:46:42.037 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 2048 offset 4194304 len 8192 2024-09-21T01:46:42.037 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2048 offset 4194304 len 8192 2024-09-21T01:46:42.037 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 2048 offset 4194304 len 8192 2024-09-21T01:46:42.037 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2048 offset 4194304 len 8192 2024-09-21T01:46:42.037 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 2048 offset 4194304 len 16384 2024-09-21T01:46:42.037 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2048 offset 4194304 len 16384 2024-09-21T01:46:42.037 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 2048 offset 4194304 len 16384 2024-09-21T01:46:42.037 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2048 offset 4194304 len 16384 2024-09-21T01:46:42.037 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 2048 offset 4194816 len 1024 2024-09-21T01:46:42.037 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2048 offset 4194816 len 1024 2024-09-21T01:46:42.037 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 2048 offset 4194816 len 1024 2024-09-21T01:46:42.037 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2048 offset 4194816 len 1024 2024-09-21T01:46:42.038 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 2048 offset 4194816 len 2048 2024-09-21T01:46:42.038 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2048 offset 4194816 len 2048 2024-09-21T01:46:42.038 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 2048 offset 4194816 len 2048 2024-09-21T01:46:42.038 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2048 offset 4194816 len 2048 2024-09-21T01:46:42.038 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 2048 offset 4194816 len 4096 2024-09-21T01:46:42.038 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2048 offset 4194816 len 4096 2024-09-21T01:46:42.038 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 2048 offset 4194816 len 4096 2024-09-21T01:46:42.038 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2048 offset 4194816 len 4096 2024-09-21T01:46:42.038 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 2048 offset 4194816 len 8192 2024-09-21T01:46:42.038 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2048 offset 4194816 len 8192 2024-09-21T01:46:42.038 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 2048 offset 4194816 len 8192 2024-09-21T01:46:42.038 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2048 offset 4194816 len 8192 2024-09-21T01:46:42.038 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 2048 offset 4194816 len 16384 2024-09-21T01:46:42.038 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2048 offset 4194816 len 16384 2024-09-21T01:46:42.038 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 2048 offset 4194816 len 16384 2024-09-21T01:46:42.039 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2048 offset 4194816 len 16384 2024-09-21T01:46:42.039 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 2048 offset 4195328 len 1024 2024-09-21T01:46:42.039 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2048 offset 4195328 len 1024 2024-09-21T01:46:42.039 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 2048 offset 4195328 len 1024 2024-09-21T01:46:42.039 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2048 offset 4195328 len 1024 2024-09-21T01:46:42.039 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 2048 offset 4195328 len 2048 2024-09-21T01:46:42.039 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2048 offset 4195328 len 2048 2024-09-21T01:46:42.039 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 2048 offset 4195328 len 2048 2024-09-21T01:46:42.039 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2048 offset 4195328 len 2048 2024-09-21T01:46:42.039 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 2048 offset 4195328 len 4096 2024-09-21T01:46:42.039 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2048 offset 4195328 len 4096 2024-09-21T01:46:42.039 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 2048 offset 4195328 len 4096 2024-09-21T01:46:42.039 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2048 offset 4195328 len 4096 2024-09-21T01:46:42.039 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 2048 offset 4195328 len 8192 2024-09-21T01:46:42.039 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2048 offset 4195328 len 8192 2024-09-21T01:46:42.040 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 2048 offset 4195328 len 8192 2024-09-21T01:46:42.040 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2048 offset 4195328 len 8192 2024-09-21T01:46:42.040 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 2048 offset 4195328 len 16384 2024-09-21T01:46:42.040 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2048 offset 4195328 len 16384 2024-09-21T01:46:42.040 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 2048 offset 4195328 len 16384 2024-09-21T01:46:42.040 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2048 offset 4195328 len 16384 2024-09-21T01:46:42.040 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 2048 offset 4195840 len 1024 2024-09-21T01:46:42.040 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2048 offset 4195840 len 1024 2024-09-21T01:46:42.040 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 2048 offset 4195840 len 1024 2024-09-21T01:46:42.040 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2048 offset 4195840 len 1024 2024-09-21T01:46:42.040 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 2048 offset 4195840 len 2048 2024-09-21T01:46:42.040 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2048 offset 4195840 len 2048 2024-09-21T01:46:42.040 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 2048 offset 4195840 len 2048 2024-09-21T01:46:42.040 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2048 offset 4195840 len 2048 2024-09-21T01:46:42.040 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 2048 offset 4195840 len 4096 2024-09-21T01:46:42.041 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2048 offset 4195840 len 4096 2024-09-21T01:46:42.041 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 2048 offset 4195840 len 4096 2024-09-21T01:46:42.041 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2048 offset 4195840 len 4096 2024-09-21T01:46:42.041 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 2048 offset 4195840 len 8192 2024-09-21T01:46:42.041 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2048 offset 4195840 len 8192 2024-09-21T01:46:42.041 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 2048 offset 4195840 len 8192 2024-09-21T01:46:42.041 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2048 offset 4195840 len 8192 2024-09-21T01:46:42.479 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 2048 offset 4195840 len 16384 2024-09-21T01:46:42.480 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2048 offset 4195840 len 16384 2024-09-21T01:46:42.480 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 2048 offset 4195840 len 16384 2024-09-21T01:46:42.480 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2048 offset 4195840 len 16384 2024-09-21T01:46:42.480 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 2048 offset 4196352 len 1024 2024-09-21T01:46:42.480 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2048 offset 4196352 len 1024 2024-09-21T01:46:42.480 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 2048 offset 4196352 len 1024 2024-09-21T01:46:42.480 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2048 offset 4196352 len 1024 2024-09-21T01:46:42.480 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 2048 offset 4196352 len 2048 2024-09-21T01:46:42.481 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2048 offset 4196352 len 2048 2024-09-21T01:46:42.481 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 2048 offset 4196352 len 2048 2024-09-21T01:46:42.481 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2048 offset 4196352 len 2048 2024-09-21T01:46:42.481 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 2048 offset 4196352 len 4096 2024-09-21T01:46:42.481 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2048 offset 4196352 len 4096 2024-09-21T01:46:42.481 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 2048 offset 4196352 len 4096 2024-09-21T01:46:42.481 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2048 offset 4196352 len 4096 2024-09-21T01:46:42.481 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 2048 offset 4196352 len 8192 2024-09-21T01:46:42.481 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2048 offset 4196352 len 8192 2024-09-21T01:46:42.481 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 2048 offset 4196352 len 8192 2024-09-21T01:46:42.482 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2048 offset 4196352 len 8192 2024-09-21T01:46:42.482 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 2048 offset 4196352 len 16384 2024-09-21T01:46:42.482 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2048 offset 4196352 len 16384 2024-09-21T01:46:42.482 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 2048 offset 4196352 len 16384 2024-09-21T01:46:42.482 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2048 offset 4196352 len 16384 2024-09-21T01:46:42.482 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 2048 offset 4196864 len 1024 2024-09-21T01:46:42.482 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2048 offset 4196864 len 1024 2024-09-21T01:46:42.482 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 2048 offset 4196864 len 1024 2024-09-21T01:46:42.482 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2048 offset 4196864 len 1024 2024-09-21T01:46:42.482 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 2048 offset 4196864 len 2048 2024-09-21T01:46:42.482 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2048 offset 4196864 len 2048 2024-09-21T01:46:42.482 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 2048 offset 4196864 len 2048 2024-09-21T01:46:42.483 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2048 offset 4196864 len 2048 2024-09-21T01:46:42.483 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 2048 offset 4196864 len 4096 2024-09-21T01:46:42.483 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2048 offset 4196864 len 4096 2024-09-21T01:46:42.483 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 2048 offset 4196864 len 4096 2024-09-21T01:46:42.483 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2048 offset 4196864 len 4096 2024-09-21T01:46:42.483 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 2048 offset 4196864 len 8192 2024-09-21T01:46:42.483 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2048 offset 4196864 len 8192 2024-09-21T01:46:42.483 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 2048 offset 4196864 len 8192 2024-09-21T01:46:42.483 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2048 offset 4196864 len 8192 2024-09-21T01:46:42.483 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 2048 offset 4196864 len 16384 2024-09-21T01:46:42.483 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2048 offset 4196864 len 16384 2024-09-21T01:46:42.483 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 2048 offset 4196864 len 16384 2024-09-21T01:46:42.483 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2048 offset 4196864 len 16384 2024-09-21T01:46:42.483 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 2048 offset 4197376 len 1024 2024-09-21T01:46:42.483 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2048 offset 4197376 len 1024 2024-09-21T01:46:42.484 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 2048 offset 4197376 len 1024 2024-09-21T01:46:42.484 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2048 offset 4197376 len 1024 2024-09-21T01:46:42.484 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 2048 offset 4197376 len 2048 2024-09-21T01:46:42.484 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2048 offset 4197376 len 2048 2024-09-21T01:46:42.484 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 2048 offset 4197376 len 2048 2024-09-21T01:46:42.484 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2048 offset 4197376 len 2048 2024-09-21T01:46:42.484 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 2048 offset 4197376 len 4096 2024-09-21T01:46:42.484 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2048 offset 4197376 len 4096 2024-09-21T01:46:42.484 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 2048 offset 4197376 len 4096 2024-09-21T01:46:42.484 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2048 offset 4197376 len 4096 2024-09-21T01:46:42.484 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 2048 offset 4197376 len 8192 2024-09-21T01:46:42.484 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2048 offset 4197376 len 8192 2024-09-21T01:46:42.484 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 2048 offset 4197376 len 8192 2024-09-21T01:46:42.484 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2048 offset 4197376 len 8192 2024-09-21T01:46:42.484 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 2048 offset 4197376 len 16384 2024-09-21T01:46:42.485 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2048 offset 4197376 len 16384 2024-09-21T01:46:42.485 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 2048 offset 4197376 len 16384 2024-09-21T01:46:42.485 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2048 offset 4197376 len 16384 2024-09-21T01:46:42.485 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 2048 offset 4197888 len 1024 2024-09-21T01:46:42.485 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2048 offset 4197888 len 1024 2024-09-21T01:46:42.485 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 2048 offset 4197888 len 1024 2024-09-21T01:46:42.485 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2048 offset 4197888 len 1024 2024-09-21T01:46:42.485 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 2048 offset 4197888 len 2048 2024-09-21T01:46:42.485 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2048 offset 4197888 len 2048 2024-09-21T01:46:42.485 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 2048 offset 4197888 len 2048 2024-09-21T01:46:42.485 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2048 offset 4197888 len 2048 2024-09-21T01:46:42.485 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 2048 offset 4197888 len 4096 2024-09-21T01:46:42.485 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2048 offset 4197888 len 4096 2024-09-21T01:46:42.485 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 2048 offset 4197888 len 4096 2024-09-21T01:46:42.485 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2048 offset 4197888 len 4096 2024-09-21T01:46:42.485 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 2048 offset 4197888 len 8192 2024-09-21T01:46:42.486 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2048 offset 4197888 len 8192 2024-09-21T01:46:42.486 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 2048 offset 4197888 len 8192 2024-09-21T01:46:42.486 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2048 offset 4197888 len 8192 2024-09-21T01:46:42.486 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 2048 offset 4197888 len 16384 2024-09-21T01:46:43.285 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2048 offset 4197888 len 16384 2024-09-21T01:46:43.285 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 2048 offset 4197888 len 16384 2024-09-21T01:46:43.285 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2048 offset 4197888 len 16384 2024-09-21T01:46:43.285 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 2560 offset 4190720 len 1024 2024-09-21T01:46:43.285 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2560 offset 4190720 len 1024 2024-09-21T01:46:43.285 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 2560 offset 4190720 len 1024 2024-09-21T01:46:43.285 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2560 offset 4190720 len 1024 2024-09-21T01:46:43.286 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 2560 offset 4190720 len 2048 2024-09-21T01:46:43.286 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2560 offset 4190720 len 2048 2024-09-21T01:46:43.286 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 2560 offset 4190720 len 2048 2024-09-21T01:46:43.286 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2560 offset 4190720 len 2048 2024-09-21T01:46:43.286 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 2560 offset 4190720 len 4096 2024-09-21T01:46:43.286 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2560 offset 4190720 len 4096 2024-09-21T01:46:43.286 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 2560 offset 4190720 len 4096 2024-09-21T01:46:43.286 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2560 offset 4190720 len 4096 2024-09-21T01:46:43.286 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 2560 offset 4190720 len 8192 2024-09-21T01:46:43.286 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2560 offset 4190720 len 8192 2024-09-21T01:46:43.286 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 2560 offset 4190720 len 8192 2024-09-21T01:46:43.286 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2560 offset 4190720 len 8192 2024-09-21T01:46:43.287 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 2560 offset 4190720 len 16384 2024-09-21T01:46:43.287 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2560 offset 4190720 len 16384 2024-09-21T01:46:43.287 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 2560 offset 4190720 len 16384 2024-09-21T01:46:43.287 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2560 offset 4190720 len 16384 2024-09-21T01:46:43.287 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 2560 offset 4191232 len 1024 2024-09-21T01:46:43.287 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2560 offset 4191232 len 1024 2024-09-21T01:46:43.287 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 2560 offset 4191232 len 1024 2024-09-21T01:46:43.287 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2560 offset 4191232 len 1024 2024-09-21T01:46:43.287 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 2560 offset 4191232 len 2048 2024-09-21T01:46:43.287 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2560 offset 4191232 len 2048 2024-09-21T01:46:43.287 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 2560 offset 4191232 len 2048 2024-09-21T01:46:43.287 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2560 offset 4191232 len 2048 2024-09-21T01:46:43.287 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 2560 offset 4191232 len 4096 2024-09-21T01:46:43.287 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2560 offset 4191232 len 4096 2024-09-21T01:46:43.288 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 2560 offset 4191232 len 4096 2024-09-21T01:46:43.288 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2560 offset 4191232 len 4096 2024-09-21T01:46:43.288 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 2560 offset 4191232 len 8192 2024-09-21T01:46:43.288 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2560 offset 4191232 len 8192 2024-09-21T01:46:43.288 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 2560 offset 4191232 len 8192 2024-09-21T01:46:43.288 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2560 offset 4191232 len 8192 2024-09-21T01:46:43.288 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 2560 offset 4191232 len 16384 2024-09-21T01:46:43.288 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2560 offset 4191232 len 16384 2024-09-21T01:46:43.288 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 2560 offset 4191232 len 16384 2024-09-21T01:46:43.288 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2560 offset 4191232 len 16384 2024-09-21T01:46:43.288 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 2560 offset 4191744 len 1024 2024-09-21T01:46:43.288 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2560 offset 4191744 len 1024 2024-09-21T01:46:43.288 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 2560 offset 4191744 len 1024 2024-09-21T01:46:43.288 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2560 offset 4191744 len 1024 2024-09-21T01:46:43.288 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 2560 offset 4191744 len 2048 2024-09-21T01:46:43.289 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2560 offset 4191744 len 2048 2024-09-21T01:46:43.289 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 2560 offset 4191744 len 2048 2024-09-21T01:46:43.289 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2560 offset 4191744 len 2048 2024-09-21T01:46:43.289 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 2560 offset 4191744 len 4096 2024-09-21T01:46:43.289 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2560 offset 4191744 len 4096 2024-09-21T01:46:43.289 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 2560 offset 4191744 len 4096 2024-09-21T01:46:43.289 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2560 offset 4191744 len 4096 2024-09-21T01:46:43.289 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 2560 offset 4191744 len 8192 2024-09-21T01:46:43.289 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2560 offset 4191744 len 8192 2024-09-21T01:46:43.289 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 2560 offset 4191744 len 8192 2024-09-21T01:46:43.289 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2560 offset 4191744 len 8192 2024-09-21T01:46:43.289 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 2560 offset 4191744 len 16384 2024-09-21T01:46:43.289 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2560 offset 4191744 len 16384 2024-09-21T01:46:43.289 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 2560 offset 4191744 len 16384 2024-09-21T01:46:43.289 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2560 offset 4191744 len 16384 2024-09-21T01:46:43.290 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 2560 offset 4192256 len 1024 2024-09-21T01:46:43.290 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2560 offset 4192256 len 1024 2024-09-21T01:46:43.290 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 2560 offset 4192256 len 1024 2024-09-21T01:46:43.290 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2560 offset 4192256 len 1024 2024-09-21T01:46:43.290 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 2560 offset 4192256 len 2048 2024-09-21T01:46:43.290 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2560 offset 4192256 len 2048 2024-09-21T01:46:43.290 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 2560 offset 4192256 len 2048 2024-09-21T01:46:43.290 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2560 offset 4192256 len 2048 2024-09-21T01:46:43.290 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 2560 offset 4192256 len 4096 2024-09-21T01:46:43.290 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2560 offset 4192256 len 4096 2024-09-21T01:46:43.290 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 2560 offset 4192256 len 4096 2024-09-21T01:46:43.290 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2560 offset 4192256 len 4096 2024-09-21T01:46:43.290 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 2560 offset 4192256 len 8192 2024-09-21T01:46:43.290 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2560 offset 4192256 len 8192 2024-09-21T01:46:43.291 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 2560 offset 4192256 len 8192 2024-09-21T01:46:43.291 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2560 offset 4192256 len 8192 2024-09-21T01:46:43.291 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 2560 offset 4192256 len 16384 2024-09-21T01:46:43.291 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2560 offset 4192256 len 16384 2024-09-21T01:46:43.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:46:42 smithi083 ceph-mon[31370]: pgmap v479: 129 pgs: 129 active+clean; 322 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 318 op/s 2024-09-21T01:46:43.464 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:46:42 smithi142 ceph-mon[34050]: pgmap v479: 129 pgs: 129 active+clean; 322 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 318 op/s 2024-09-21T01:46:43.467 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:46:42 smithi119 ceph-mon[33693]: pgmap v479: 129 pgs: 129 active+clean; 322 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 318 op/s 2024-09-21T01:46:44.017 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 2560 offset 4192256 len 16384 2024-09-21T01:46:44.017 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2560 offset 4192256 len 16384 2024-09-21T01:46:44.017 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 2560 offset 4192768 len 1024 2024-09-21T01:46:44.017 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2560 offset 4192768 len 1024 2024-09-21T01:46:44.017 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 2560 offset 4192768 len 1024 2024-09-21T01:46:44.017 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2560 offset 4192768 len 1024 2024-09-21T01:46:44.017 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 2560 offset 4192768 len 2048 2024-09-21T01:46:44.018 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2560 offset 4192768 len 2048 2024-09-21T01:46:44.018 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 2560 offset 4192768 len 2048 2024-09-21T01:46:44.018 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2560 offset 4192768 len 2048 2024-09-21T01:46:44.018 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 2560 offset 4192768 len 4096 2024-09-21T01:46:44.018 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2560 offset 4192768 len 4096 2024-09-21T01:46:44.018 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 2560 offset 4192768 len 4096 2024-09-21T01:46:44.018 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2560 offset 4192768 len 4096 2024-09-21T01:46:44.018 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 2560 offset 4192768 len 8192 2024-09-21T01:46:44.018 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2560 offset 4192768 len 8192 2024-09-21T01:46:44.018 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 2560 offset 4192768 len 8192 2024-09-21T01:46:44.018 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2560 offset 4192768 len 8192 2024-09-21T01:46:44.018 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 2560 offset 4192768 len 16384 2024-09-21T01:46:44.018 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2560 offset 4192768 len 16384 2024-09-21T01:46:44.018 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 2560 offset 4192768 len 16384 2024-09-21T01:46:44.019 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2560 offset 4192768 len 16384 2024-09-21T01:46:44.019 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 2560 offset 4193280 len 1024 2024-09-21T01:46:44.019 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2560 offset 4193280 len 1024 2024-09-21T01:46:44.019 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 2560 offset 4193280 len 1024 2024-09-21T01:46:44.019 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2560 offset 4193280 len 1024 2024-09-21T01:46:44.019 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 2560 offset 4193280 len 2048 2024-09-21T01:46:44.019 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2560 offset 4193280 len 2048 2024-09-21T01:46:44.019 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 2560 offset 4193280 len 2048 2024-09-21T01:46:44.019 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2560 offset 4193280 len 2048 2024-09-21T01:46:44.019 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 2560 offset 4193280 len 4096 2024-09-21T01:46:44.019 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2560 offset 4193280 len 4096 2024-09-21T01:46:44.019 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 2560 offset 4193280 len 4096 2024-09-21T01:46:44.019 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2560 offset 4193280 len 4096 2024-09-21T01:46:44.019 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 2560 offset 4193280 len 8192 2024-09-21T01:46:44.019 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2560 offset 4193280 len 8192 2024-09-21T01:46:44.020 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 2560 offset 4193280 len 8192 2024-09-21T01:46:44.020 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2560 offset 4193280 len 8192 2024-09-21T01:46:44.020 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 2560 offset 4193280 len 16384 2024-09-21T01:46:44.020 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2560 offset 4193280 len 16384 2024-09-21T01:46:44.020 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 2560 offset 4193280 len 16384 2024-09-21T01:46:44.020 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2560 offset 4193280 len 16384 2024-09-21T01:46:44.020 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 2560 offset 4193792 len 1024 2024-09-21T01:46:44.020 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2560 offset 4193792 len 1024 2024-09-21T01:46:44.020 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 2560 offset 4193792 len 1024 2024-09-21T01:46:44.020 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2560 offset 4193792 len 1024 2024-09-21T01:46:44.020 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 2560 offset 4193792 len 2048 2024-09-21T01:46:44.020 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2560 offset 4193792 len 2048 2024-09-21T01:46:44.020 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 2560 offset 4193792 len 2048 2024-09-21T01:46:44.020 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2560 offset 4193792 len 2048 2024-09-21T01:46:44.020 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 2560 offset 4193792 len 4096 2024-09-21T01:46:44.021 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2560 offset 4193792 len 4096 2024-09-21T01:46:44.021 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 2560 offset 4193792 len 4096 2024-09-21T01:46:44.021 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2560 offset 4193792 len 4096 2024-09-21T01:46:44.021 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 2560 offset 4193792 len 8192 2024-09-21T01:46:44.021 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2560 offset 4193792 len 8192 2024-09-21T01:46:44.021 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 2560 offset 4193792 len 8192 2024-09-21T01:46:44.021 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2560 offset 4193792 len 8192 2024-09-21T01:46:44.021 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 2560 offset 4193792 len 16384 2024-09-21T01:46:44.021 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2560 offset 4193792 len 16384 2024-09-21T01:46:44.021 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 2560 offset 4193792 len 16384 2024-09-21T01:46:44.021 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2560 offset 4193792 len 16384 2024-09-21T01:46:44.021 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 2560 offset 4194304 len 1024 2024-09-21T01:46:44.021 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2560 offset 4194304 len 1024 2024-09-21T01:46:44.021 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 2560 offset 4194304 len 1024 2024-09-21T01:46:44.021 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2560 offset 4194304 len 1024 2024-09-21T01:46:44.022 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 2560 offset 4194304 len 2048 2024-09-21T01:46:44.022 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2560 offset 4194304 len 2048 2024-09-21T01:46:44.022 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 2560 offset 4194304 len 2048 2024-09-21T01:46:44.022 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2560 offset 4194304 len 2048 2024-09-21T01:46:44.022 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 2560 offset 4194304 len 4096 2024-09-21T01:46:44.022 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2560 offset 4194304 len 4096 2024-09-21T01:46:44.022 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 2560 offset 4194304 len 4096 2024-09-21T01:46:44.022 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2560 offset 4194304 len 4096 2024-09-21T01:46:44.022 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 2560 offset 4194304 len 8192 2024-09-21T01:46:44.022 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2560 offset 4194304 len 8192 2024-09-21T01:46:44.022 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 2560 offset 4194304 len 8192 2024-09-21T01:46:44.022 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2560 offset 4194304 len 8192 2024-09-21T01:46:44.022 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 2560 offset 4194304 len 16384 2024-09-21T01:46:44.022 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2560 offset 4194304 len 16384 2024-09-21T01:46:44.023 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 2560 offset 4194304 len 16384 2024-09-21T01:46:44.501 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2560 offset 4194304 len 16384 2024-09-21T01:46:44.501 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 2560 offset 4194816 len 1024 2024-09-21T01:46:44.501 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2560 offset 4194816 len 1024 2024-09-21T01:46:44.501 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 2560 offset 4194816 len 1024 2024-09-21T01:46:44.501 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2560 offset 4194816 len 1024 2024-09-21T01:46:44.501 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 2560 offset 4194816 len 2048 2024-09-21T01:46:44.501 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2560 offset 4194816 len 2048 2024-09-21T01:46:44.501 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 2560 offset 4194816 len 2048 2024-09-21T01:46:44.501 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2560 offset 4194816 len 2048 2024-09-21T01:46:44.502 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 2560 offset 4194816 len 4096 2024-09-21T01:46:44.502 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2560 offset 4194816 len 4096 2024-09-21T01:46:44.502 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 2560 offset 4194816 len 4096 2024-09-21T01:46:44.502 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2560 offset 4194816 len 4096 2024-09-21T01:46:44.502 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 2560 offset 4194816 len 8192 2024-09-21T01:46:44.502 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2560 offset 4194816 len 8192 2024-09-21T01:46:44.502 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 2560 offset 4194816 len 8192 2024-09-21T01:46:44.502 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2560 offset 4194816 len 8192 2024-09-21T01:46:44.502 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 2560 offset 4194816 len 16384 2024-09-21T01:46:44.502 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2560 offset 4194816 len 16384 2024-09-21T01:46:44.502 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 2560 offset 4194816 len 16384 2024-09-21T01:46:44.502 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2560 offset 4194816 len 16384 2024-09-21T01:46:44.502 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 2560 offset 4195328 len 1024 2024-09-21T01:46:44.502 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2560 offset 4195328 len 1024 2024-09-21T01:46:44.503 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 2560 offset 4195328 len 1024 2024-09-21T01:46:44.503 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2560 offset 4195328 len 1024 2024-09-21T01:46:44.503 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 2560 offset 4195328 len 2048 2024-09-21T01:46:44.503 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2560 offset 4195328 len 2048 2024-09-21T01:46:44.503 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 2560 offset 4195328 len 2048 2024-09-21T01:46:44.503 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2560 offset 4195328 len 2048 2024-09-21T01:46:44.503 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 2560 offset 4195328 len 4096 2024-09-21T01:46:44.503 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2560 offset 4195328 len 4096 2024-09-21T01:46:44.503 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 2560 offset 4195328 len 4096 2024-09-21T01:46:44.503 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2560 offset 4195328 len 4096 2024-09-21T01:46:44.503 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 2560 offset 4195328 len 8192 2024-09-21T01:46:44.503 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2560 offset 4195328 len 8192 2024-09-21T01:46:44.503 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 2560 offset 4195328 len 8192 2024-09-21T01:46:44.503 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2560 offset 4195328 len 8192 2024-09-21T01:46:44.503 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 2560 offset 4195328 len 16384 2024-09-21T01:46:44.503 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2560 offset 4195328 len 16384 2024-09-21T01:46:44.504 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 2560 offset 4195328 len 16384 2024-09-21T01:46:44.504 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2560 offset 4195328 len 16384 2024-09-21T01:46:44.504 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 2560 offset 4195840 len 1024 2024-09-21T01:46:44.504 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2560 offset 4195840 len 1024 2024-09-21T01:46:44.504 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 2560 offset 4195840 len 1024 2024-09-21T01:46:44.504 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2560 offset 4195840 len 1024 2024-09-21T01:46:44.504 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 2560 offset 4195840 len 2048 2024-09-21T01:46:44.504 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2560 offset 4195840 len 2048 2024-09-21T01:46:44.504 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 2560 offset 4195840 len 2048 2024-09-21T01:46:44.504 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2560 offset 4195840 len 2048 2024-09-21T01:46:44.504 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 2560 offset 4195840 len 4096 2024-09-21T01:46:44.504 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2560 offset 4195840 len 4096 2024-09-21T01:46:44.504 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 2560 offset 4195840 len 4096 2024-09-21T01:46:44.504 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2560 offset 4195840 len 4096 2024-09-21T01:46:44.504 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 2560 offset 4195840 len 8192 2024-09-21T01:46:44.505 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2560 offset 4195840 len 8192 2024-09-21T01:46:44.505 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 2560 offset 4195840 len 8192 2024-09-21T01:46:44.505 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2560 offset 4195840 len 8192 2024-09-21T01:46:44.505 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 2560 offset 4195840 len 16384 2024-09-21T01:46:44.505 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2560 offset 4195840 len 16384 2024-09-21T01:46:44.505 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 2560 offset 4195840 len 16384 2024-09-21T01:46:44.505 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2560 offset 4195840 len 16384 2024-09-21T01:46:44.505 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 2560 offset 4196352 len 1024 2024-09-21T01:46:44.505 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2560 offset 4196352 len 1024 2024-09-21T01:46:44.505 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 2560 offset 4196352 len 1024 2024-09-21T01:46:44.505 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2560 offset 4196352 len 1024 2024-09-21T01:46:44.505 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 2560 offset 4196352 len 2048 2024-09-21T01:46:44.505 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2560 offset 4196352 len 2048 2024-09-21T01:46:44.505 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 2560 offset 4196352 len 2048 2024-09-21T01:46:44.505 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2560 offset 4196352 len 2048 2024-09-21T01:46:44.506 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 2560 offset 4196352 len 4096 2024-09-21T01:46:44.506 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2560 offset 4196352 len 4096 2024-09-21T01:46:44.506 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 2560 offset 4196352 len 4096 2024-09-21T01:46:44.506 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2560 offset 4196352 len 4096 2024-09-21T01:46:44.506 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 2560 offset 4196352 len 8192 2024-09-21T01:46:44.506 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2560 offset 4196352 len 8192 2024-09-21T01:46:44.506 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 2560 offset 4196352 len 8192 2024-09-21T01:46:44.506 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2560 offset 4196352 len 8192 2024-09-21T01:46:44.506 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 2560 offset 4196352 len 16384 2024-09-21T01:46:44.506 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2560 offset 4196352 len 16384 2024-09-21T01:46:44.506 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 2560 offset 4196352 len 16384 2024-09-21T01:46:44.506 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2560 offset 4196352 len 16384 2024-09-21T01:46:45.070 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 2560 offset 4196864 len 1024 2024-09-21T01:46:45.071 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2560 offset 4196864 len 1024 2024-09-21T01:46:45.071 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 2560 offset 4196864 len 1024 2024-09-21T01:46:45.071 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2560 offset 4196864 len 1024 2024-09-21T01:46:45.071 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 2560 offset 4196864 len 2048 2024-09-21T01:46:45.071 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2560 offset 4196864 len 2048 2024-09-21T01:46:45.071 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 2560 offset 4196864 len 2048 2024-09-21T01:46:45.071 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2560 offset 4196864 len 2048 2024-09-21T01:46:45.071 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 2560 offset 4196864 len 4096 2024-09-21T01:46:45.071 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2560 offset 4196864 len 4096 2024-09-21T01:46:45.071 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 2560 offset 4196864 len 4096 2024-09-21T01:46:45.071 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2560 offset 4196864 len 4096 2024-09-21T01:46:45.071 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 2560 offset 4196864 len 8192 2024-09-21T01:46:45.072 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2560 offset 4196864 len 8192 2024-09-21T01:46:45.072 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 2560 offset 4196864 len 8192 2024-09-21T01:46:45.072 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2560 offset 4196864 len 8192 2024-09-21T01:46:45.072 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 2560 offset 4196864 len 16384 2024-09-21T01:46:45.072 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2560 offset 4196864 len 16384 2024-09-21T01:46:45.072 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 2560 offset 4196864 len 16384 2024-09-21T01:46:45.072 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2560 offset 4196864 len 16384 2024-09-21T01:46:45.072 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 2560 offset 4197376 len 1024 2024-09-21T01:46:45.072 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2560 offset 4197376 len 1024 2024-09-21T01:46:45.072 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 2560 offset 4197376 len 1024 2024-09-21T01:46:45.072 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2560 offset 4197376 len 1024 2024-09-21T01:46:45.072 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 2560 offset 4197376 len 2048 2024-09-21T01:46:45.072 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2560 offset 4197376 len 2048 2024-09-21T01:46:45.072 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 2560 offset 4197376 len 2048 2024-09-21T01:46:45.072 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2560 offset 4197376 len 2048 2024-09-21T01:46:45.072 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 2560 offset 4197376 len 4096 2024-09-21T01:46:45.073 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2560 offset 4197376 len 4096 2024-09-21T01:46:45.073 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 2560 offset 4197376 len 4096 2024-09-21T01:46:45.073 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2560 offset 4197376 len 4096 2024-09-21T01:46:45.073 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 2560 offset 4197376 len 8192 2024-09-21T01:46:45.073 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2560 offset 4197376 len 8192 2024-09-21T01:46:45.073 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 2560 offset 4197376 len 8192 2024-09-21T01:46:45.073 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2560 offset 4197376 len 8192 2024-09-21T01:46:45.073 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 2560 offset 4197376 len 16384 2024-09-21T01:46:45.073 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2560 offset 4197376 len 16384 2024-09-21T01:46:45.073 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 2560 offset 4197376 len 16384 2024-09-21T01:46:45.073 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2560 offset 4197376 len 16384 2024-09-21T01:46:45.073 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 2560 offset 4197888 len 1024 2024-09-21T01:46:45.073 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2560 offset 4197888 len 1024 2024-09-21T01:46:45.073 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 2560 offset 4197888 len 1024 2024-09-21T01:46:45.074 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2560 offset 4197888 len 1024 2024-09-21T01:46:45.074 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 2560 offset 4197888 len 2048 2024-09-21T01:46:45.074 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2560 offset 4197888 len 2048 2024-09-21T01:46:45.074 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 2560 offset 4197888 len 2048 2024-09-21T01:46:45.074 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2560 offset 4197888 len 2048 2024-09-21T01:46:45.074 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 2560 offset 4197888 len 4096 2024-09-21T01:46:45.074 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2560 offset 4197888 len 4096 2024-09-21T01:46:45.074 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 2560 offset 4197888 len 4096 2024-09-21T01:46:45.074 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2560 offset 4197888 len 4096 2024-09-21T01:46:45.074 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 2560 offset 4197888 len 8192 2024-09-21T01:46:45.074 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2560 offset 4197888 len 8192 2024-09-21T01:46:45.074 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 2560 offset 4197888 len 8192 2024-09-21T01:46:45.074 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2560 offset 4197888 len 8192 2024-09-21T01:46:45.074 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 2560 offset 4197888 len 16384 2024-09-21T01:46:45.075 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2560 offset 4197888 len 16384 2024-09-21T01:46:45.075 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 2560 offset 4197888 len 16384 2024-09-21T01:46:45.075 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 2560 offset 4197888 len 16384 2024-09-21T01:46:45.075 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 3072 offset 4190720 len 1024 2024-09-21T01:46:45.075 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3072 offset 4190720 len 1024 2024-09-21T01:46:45.075 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 3072 offset 4190720 len 1024 2024-09-21T01:46:45.075 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3072 offset 4190720 len 1024 2024-09-21T01:46:45.075 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 3072 offset 4190720 len 2048 2024-09-21T01:46:45.075 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3072 offset 4190720 len 2048 2024-09-21T01:46:45.075 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 3072 offset 4190720 len 2048 2024-09-21T01:46:45.075 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3072 offset 4190720 len 2048 2024-09-21T01:46:45.075 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 3072 offset 4190720 len 4096 2024-09-21T01:46:45.075 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3072 offset 4190720 len 4096 2024-09-21T01:46:45.075 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 3072 offset 4190720 len 4096 2024-09-21T01:46:45.075 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3072 offset 4190720 len 4096 2024-09-21T01:46:45.076 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 3072 offset 4190720 len 8192 2024-09-21T01:46:45.076 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3072 offset 4190720 len 8192 2024-09-21T01:46:45.076 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 3072 offset 4190720 len 8192 2024-09-21T01:46:45.076 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3072 offset 4190720 len 8192 2024-09-21T01:46:45.076 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 3072 offset 4190720 len 16384 2024-09-21T01:46:45.076 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3072 offset 4190720 len 16384 2024-09-21T01:46:45.076 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 3072 offset 4190720 len 16384 2024-09-21T01:46:45.076 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3072 offset 4190720 len 16384 2024-09-21T01:46:45.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:46:44 smithi083 ceph-mon[31370]: pgmap v480: 129 pgs: 129 active+clean; 359 MiB data, 495 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 345 op/s 2024-09-21T01:46:45.464 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:46:44 smithi142 ceph-mon[34050]: pgmap v480: 129 pgs: 129 active+clean; 359 MiB data, 495 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 345 op/s 2024-09-21T01:46:45.467 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:46:44 smithi119 ceph-mon[33693]: pgmap v480: 129 pgs: 129 active+clean; 359 MiB data, 495 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 345 op/s 2024-09-21T01:46:45.852 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 3072 offset 4191232 len 1024 2024-09-21T01:46:45.852 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3072 offset 4191232 len 1024 2024-09-21T01:46:45.852 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 3072 offset 4191232 len 1024 2024-09-21T01:46:45.852 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3072 offset 4191232 len 1024 2024-09-21T01:46:45.852 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 3072 offset 4191232 len 2048 2024-09-21T01:46:45.853 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3072 offset 4191232 len 2048 2024-09-21T01:46:45.853 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 3072 offset 4191232 len 2048 2024-09-21T01:46:45.853 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3072 offset 4191232 len 2048 2024-09-21T01:46:45.853 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 3072 offset 4191232 len 4096 2024-09-21T01:46:45.853 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3072 offset 4191232 len 4096 2024-09-21T01:46:45.853 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 3072 offset 4191232 len 4096 2024-09-21T01:46:45.853 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3072 offset 4191232 len 4096 2024-09-21T01:46:45.853 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 3072 offset 4191232 len 8192 2024-09-21T01:46:45.853 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3072 offset 4191232 len 8192 2024-09-21T01:46:45.853 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 3072 offset 4191232 len 8192 2024-09-21T01:46:45.853 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3072 offset 4191232 len 8192 2024-09-21T01:46:45.853 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 3072 offset 4191232 len 16384 2024-09-21T01:46:45.853 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3072 offset 4191232 len 16384 2024-09-21T01:46:45.853 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 3072 offset 4191232 len 16384 2024-09-21T01:46:45.854 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3072 offset 4191232 len 16384 2024-09-21T01:46:45.854 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 3072 offset 4191744 len 1024 2024-09-21T01:46:45.854 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3072 offset 4191744 len 1024 2024-09-21T01:46:45.854 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 3072 offset 4191744 len 1024 2024-09-21T01:46:45.854 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3072 offset 4191744 len 1024 2024-09-21T01:46:45.854 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 3072 offset 4191744 len 2048 2024-09-21T01:46:45.854 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3072 offset 4191744 len 2048 2024-09-21T01:46:45.854 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 3072 offset 4191744 len 2048 2024-09-21T01:46:45.854 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3072 offset 4191744 len 2048 2024-09-21T01:46:45.854 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 3072 offset 4191744 len 4096 2024-09-21T01:46:45.854 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3072 offset 4191744 len 4096 2024-09-21T01:46:45.854 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 3072 offset 4191744 len 4096 2024-09-21T01:46:45.854 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3072 offset 4191744 len 4096 2024-09-21T01:46:45.854 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 3072 offset 4191744 len 8192 2024-09-21T01:46:45.855 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3072 offset 4191744 len 8192 2024-09-21T01:46:45.855 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 3072 offset 4191744 len 8192 2024-09-21T01:46:45.855 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3072 offset 4191744 len 8192 2024-09-21T01:46:45.855 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 3072 offset 4191744 len 16384 2024-09-21T01:46:45.855 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3072 offset 4191744 len 16384 2024-09-21T01:46:45.855 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 3072 offset 4191744 len 16384 2024-09-21T01:46:45.855 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3072 offset 4191744 len 16384 2024-09-21T01:46:45.855 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 3072 offset 4192256 len 1024 2024-09-21T01:46:45.855 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3072 offset 4192256 len 1024 2024-09-21T01:46:45.855 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 3072 offset 4192256 len 1024 2024-09-21T01:46:45.855 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3072 offset 4192256 len 1024 2024-09-21T01:46:45.855 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 3072 offset 4192256 len 2048 2024-09-21T01:46:45.855 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3072 offset 4192256 len 2048 2024-09-21T01:46:45.855 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 3072 offset 4192256 len 2048 2024-09-21T01:46:45.855 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3072 offset 4192256 len 2048 2024-09-21T01:46:45.856 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 3072 offset 4192256 len 4096 2024-09-21T01:46:45.856 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3072 offset 4192256 len 4096 2024-09-21T01:46:45.856 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 3072 offset 4192256 len 4096 2024-09-21T01:46:45.856 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3072 offset 4192256 len 4096 2024-09-21T01:46:45.856 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 3072 offset 4192256 len 8192 2024-09-21T01:46:45.856 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3072 offset 4192256 len 8192 2024-09-21T01:46:45.856 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 3072 offset 4192256 len 8192 2024-09-21T01:46:45.856 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3072 offset 4192256 len 8192 2024-09-21T01:46:45.856 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 3072 offset 4192256 len 16384 2024-09-21T01:46:45.856 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3072 offset 4192256 len 16384 2024-09-21T01:46:45.856 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 3072 offset 4192256 len 16384 2024-09-21T01:46:45.856 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3072 offset 4192256 len 16384 2024-09-21T01:46:45.856 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 3072 offset 4192768 len 1024 2024-09-21T01:46:45.856 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3072 offset 4192768 len 1024 2024-09-21T01:46:45.856 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 3072 offset 4192768 len 1024 2024-09-21T01:46:45.857 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3072 offset 4192768 len 1024 2024-09-21T01:46:45.857 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 3072 offset 4192768 len 2048 2024-09-21T01:46:45.857 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3072 offset 4192768 len 2048 2024-09-21T01:46:45.857 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 3072 offset 4192768 len 2048 2024-09-21T01:46:45.857 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3072 offset 4192768 len 2048 2024-09-21T01:46:45.857 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 3072 offset 4192768 len 4096 2024-09-21T01:46:45.857 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3072 offset 4192768 len 4096 2024-09-21T01:46:45.857 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 3072 offset 4192768 len 4096 2024-09-21T01:46:45.857 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3072 offset 4192768 len 4096 2024-09-21T01:46:45.857 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 3072 offset 4192768 len 8192 2024-09-21T01:46:45.857 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3072 offset 4192768 len 8192 2024-09-21T01:46:45.857 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 3072 offset 4192768 len 8192 2024-09-21T01:46:45.857 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3072 offset 4192768 len 8192 2024-09-21T01:46:45.857 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 3072 offset 4192768 len 16384 2024-09-21T01:46:45.857 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3072 offset 4192768 len 16384 2024-09-21T01:46:45.858 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 3072 offset 4192768 len 16384 2024-09-21T01:46:45.858 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3072 offset 4192768 len 16384 2024-09-21T01:46:45.858 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 3072 offset 4193280 len 1024 2024-09-21T01:46:46.478 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3072 offset 4193280 len 1024 2024-09-21T01:46:46.478 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 3072 offset 4193280 len 1024 2024-09-21T01:46:46.478 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3072 offset 4193280 len 1024 2024-09-21T01:46:46.478 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 3072 offset 4193280 len 2048 2024-09-21T01:46:46.478 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3072 offset 4193280 len 2048 2024-09-21T01:46:46.479 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 3072 offset 4193280 len 2048 2024-09-21T01:46:46.479 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3072 offset 4193280 len 2048 2024-09-21T01:46:46.479 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 3072 offset 4193280 len 4096 2024-09-21T01:46:46.479 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3072 offset 4193280 len 4096 2024-09-21T01:46:46.479 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 3072 offset 4193280 len 4096 2024-09-21T01:46:46.479 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3072 offset 4193280 len 4096 2024-09-21T01:46:46.479 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 3072 offset 4193280 len 8192 2024-09-21T01:46:46.479 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3072 offset 4193280 len 8192 2024-09-21T01:46:46.479 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 3072 offset 4193280 len 8192 2024-09-21T01:46:46.479 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3072 offset 4193280 len 8192 2024-09-21T01:46:46.479 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 3072 offset 4193280 len 16384 2024-09-21T01:46:46.479 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3072 offset 4193280 len 16384 2024-09-21T01:46:46.479 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 3072 offset 4193280 len 16384 2024-09-21T01:46:46.479 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3072 offset 4193280 len 16384 2024-09-21T01:46:46.479 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 3072 offset 4193792 len 1024 2024-09-21T01:46:46.480 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3072 offset 4193792 len 1024 2024-09-21T01:46:46.480 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 3072 offset 4193792 len 1024 2024-09-21T01:46:46.480 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3072 offset 4193792 len 1024 2024-09-21T01:46:46.480 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 3072 offset 4193792 len 2048 2024-09-21T01:46:46.480 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3072 offset 4193792 len 2048 2024-09-21T01:46:46.480 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 3072 offset 4193792 len 2048 2024-09-21T01:46:46.480 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3072 offset 4193792 len 2048 2024-09-21T01:46:46.480 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 3072 offset 4193792 len 4096 2024-09-21T01:46:46.480 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3072 offset 4193792 len 4096 2024-09-21T01:46:46.480 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 3072 offset 4193792 len 4096 2024-09-21T01:46:46.480 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3072 offset 4193792 len 4096 2024-09-21T01:46:46.480 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 3072 offset 4193792 len 8192 2024-09-21T01:46:46.480 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3072 offset 4193792 len 8192 2024-09-21T01:46:46.480 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 3072 offset 4193792 len 8192 2024-09-21T01:46:46.481 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3072 offset 4193792 len 8192 2024-09-21T01:46:46.481 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 3072 offset 4193792 len 16384 2024-09-21T01:46:46.481 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3072 offset 4193792 len 16384 2024-09-21T01:46:46.481 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 3072 offset 4193792 len 16384 2024-09-21T01:46:46.481 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3072 offset 4193792 len 16384 2024-09-21T01:46:46.481 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 3072 offset 4194304 len 1024 2024-09-21T01:46:46.481 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3072 offset 4194304 len 1024 2024-09-21T01:46:46.481 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 3072 offset 4194304 len 1024 2024-09-21T01:46:46.481 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3072 offset 4194304 len 1024 2024-09-21T01:46:46.481 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 3072 offset 4194304 len 2048 2024-09-21T01:46:46.481 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3072 offset 4194304 len 2048 2024-09-21T01:46:46.481 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 3072 offset 4194304 len 2048 2024-09-21T01:46:46.481 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3072 offset 4194304 len 2048 2024-09-21T01:46:46.481 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 3072 offset 4194304 len 4096 2024-09-21T01:46:46.481 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3072 offset 4194304 len 4096 2024-09-21T01:46:46.482 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 3072 offset 4194304 len 4096 2024-09-21T01:46:46.482 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3072 offset 4194304 len 4096 2024-09-21T01:46:46.482 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 3072 offset 4194304 len 8192 2024-09-21T01:46:46.482 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3072 offset 4194304 len 8192 2024-09-21T01:46:46.482 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 3072 offset 4194304 len 8192 2024-09-21T01:46:46.482 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3072 offset 4194304 len 8192 2024-09-21T01:46:46.482 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 3072 offset 4194304 len 16384 2024-09-21T01:46:46.482 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3072 offset 4194304 len 16384 2024-09-21T01:46:46.482 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 3072 offset 4194304 len 16384 2024-09-21T01:46:46.482 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3072 offset 4194304 len 16384 2024-09-21T01:46:46.482 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 3072 offset 4194816 len 1024 2024-09-21T01:46:46.482 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3072 offset 4194816 len 1024 2024-09-21T01:46:46.482 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 3072 offset 4194816 len 1024 2024-09-21T01:46:46.482 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3072 offset 4194816 len 1024 2024-09-21T01:46:46.483 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 3072 offset 4194816 len 2048 2024-09-21T01:46:46.483 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3072 offset 4194816 len 2048 2024-09-21T01:46:46.483 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 3072 offset 4194816 len 2048 2024-09-21T01:46:46.483 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3072 offset 4194816 len 2048 2024-09-21T01:46:46.483 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 3072 offset 4194816 len 4096 2024-09-21T01:46:46.483 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3072 offset 4194816 len 4096 2024-09-21T01:46:46.483 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 3072 offset 4194816 len 4096 2024-09-21T01:46:46.483 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3072 offset 4194816 len 4096 2024-09-21T01:46:46.483 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 3072 offset 4194816 len 8192 2024-09-21T01:46:46.483 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3072 offset 4194816 len 8192 2024-09-21T01:46:46.483 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 3072 offset 4194816 len 8192 2024-09-21T01:46:46.483 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3072 offset 4194816 len 8192 2024-09-21T01:46:46.483 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 3072 offset 4194816 len 16384 2024-09-21T01:46:46.484 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3072 offset 4194816 len 16384 2024-09-21T01:46:46.484 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 3072 offset 4194816 len 16384 2024-09-21T01:46:46.484 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3072 offset 4194816 len 16384 2024-09-21T01:46:46.484 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 3072 offset 4195328 len 1024 2024-09-21T01:46:46.484 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3072 offset 4195328 len 1024 2024-09-21T01:46:46.997 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 3072 offset 4195328 len 1024 2024-09-21T01:46:46.997 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3072 offset 4195328 len 1024 2024-09-21T01:46:46.997 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 3072 offset 4195328 len 2048 2024-09-21T01:46:46.998 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3072 offset 4195328 len 2048 2024-09-21T01:46:46.998 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 3072 offset 4195328 len 2048 2024-09-21T01:46:46.998 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3072 offset 4195328 len 2048 2024-09-21T01:46:46.998 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 3072 offset 4195328 len 4096 2024-09-21T01:46:46.998 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3072 offset 4195328 len 4096 2024-09-21T01:46:46.998 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 3072 offset 4195328 len 4096 2024-09-21T01:46:46.998 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3072 offset 4195328 len 4096 2024-09-21T01:46:46.998 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 3072 offset 4195328 len 8192 2024-09-21T01:46:46.998 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3072 offset 4195328 len 8192 2024-09-21T01:46:46.998 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 3072 offset 4195328 len 8192 2024-09-21T01:46:46.998 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3072 offset 4195328 len 8192 2024-09-21T01:46:46.998 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 3072 offset 4195328 len 16384 2024-09-21T01:46:46.998 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3072 offset 4195328 len 16384 2024-09-21T01:46:46.998 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 3072 offset 4195328 len 16384 2024-09-21T01:46:46.999 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3072 offset 4195328 len 16384 2024-09-21T01:46:46.999 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 3072 offset 4195840 len 1024 2024-09-21T01:46:46.999 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3072 offset 4195840 len 1024 2024-09-21T01:46:46.999 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 3072 offset 4195840 len 1024 2024-09-21T01:46:46.999 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3072 offset 4195840 len 1024 2024-09-21T01:46:46.999 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 3072 offset 4195840 len 2048 2024-09-21T01:46:46.999 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3072 offset 4195840 len 2048 2024-09-21T01:46:46.999 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 3072 offset 4195840 len 2048 2024-09-21T01:46:46.999 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3072 offset 4195840 len 2048 2024-09-21T01:46:46.999 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 3072 offset 4195840 len 4096 2024-09-21T01:46:46.999 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3072 offset 4195840 len 4096 2024-09-21T01:46:46.999 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 3072 offset 4195840 len 4096 2024-09-21T01:46:46.999 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3072 offset 4195840 len 4096 2024-09-21T01:46:46.999 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 3072 offset 4195840 len 8192 2024-09-21T01:46:47.000 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3072 offset 4195840 len 8192 2024-09-21T01:46:47.000 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 3072 offset 4195840 len 8192 2024-09-21T01:46:47.000 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3072 offset 4195840 len 8192 2024-09-21T01:46:47.000 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 3072 offset 4195840 len 16384 2024-09-21T01:46:47.000 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3072 offset 4195840 len 16384 2024-09-21T01:46:47.000 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 3072 offset 4195840 len 16384 2024-09-21T01:46:47.000 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3072 offset 4195840 len 16384 2024-09-21T01:46:47.000 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 3072 offset 4196352 len 1024 2024-09-21T01:46:47.000 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3072 offset 4196352 len 1024 2024-09-21T01:46:47.000 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 3072 offset 4196352 len 1024 2024-09-21T01:46:47.000 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3072 offset 4196352 len 1024 2024-09-21T01:46:47.000 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 3072 offset 4196352 len 2048 2024-09-21T01:46:47.000 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3072 offset 4196352 len 2048 2024-09-21T01:46:47.000 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 3072 offset 4196352 len 2048 2024-09-21T01:46:47.000 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3072 offset 4196352 len 2048 2024-09-21T01:46:47.000 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 3072 offset 4196352 len 4096 2024-09-21T01:46:47.001 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3072 offset 4196352 len 4096 2024-09-21T01:46:47.001 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 3072 offset 4196352 len 4096 2024-09-21T01:46:47.001 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3072 offset 4196352 len 4096 2024-09-21T01:46:47.001 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 3072 offset 4196352 len 8192 2024-09-21T01:46:47.001 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3072 offset 4196352 len 8192 2024-09-21T01:46:47.001 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 3072 offset 4196352 len 8192 2024-09-21T01:46:47.001 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3072 offset 4196352 len 8192 2024-09-21T01:46:47.001 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 3072 offset 4196352 len 16384 2024-09-21T01:46:47.002 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3072 offset 4196352 len 16384 2024-09-21T01:46:47.002 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 3072 offset 4196352 len 16384 2024-09-21T01:46:47.002 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3072 offset 4196352 len 16384 2024-09-21T01:46:47.002 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 3072 offset 4196864 len 1024 2024-09-21T01:46:47.002 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3072 offset 4196864 len 1024 2024-09-21T01:46:47.002 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 3072 offset 4196864 len 1024 2024-09-21T01:46:47.002 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3072 offset 4196864 len 1024 2024-09-21T01:46:47.002 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 3072 offset 4196864 len 2048 2024-09-21T01:46:47.002 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3072 offset 4196864 len 2048 2024-09-21T01:46:47.003 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 3072 offset 4196864 len 2048 2024-09-21T01:46:47.003 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3072 offset 4196864 len 2048 2024-09-21T01:46:47.003 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 3072 offset 4196864 len 4096 2024-09-21T01:46:47.003 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3072 offset 4196864 len 4096 2024-09-21T01:46:47.003 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 3072 offset 4196864 len 4096 2024-09-21T01:46:47.003 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3072 offset 4196864 len 4096 2024-09-21T01:46:47.003 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 3072 offset 4196864 len 8192 2024-09-21T01:46:47.003 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3072 offset 4196864 len 8192 2024-09-21T01:46:47.003 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 3072 offset 4196864 len 8192 2024-09-21T01:46:47.003 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3072 offset 4196864 len 8192 2024-09-21T01:46:47.003 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 3072 offset 4196864 len 16384 2024-09-21T01:46:47.003 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3072 offset 4196864 len 16384 2024-09-21T01:46:47.003 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 3072 offset 4196864 len 16384 2024-09-21T01:46:47.003 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3072 offset 4196864 len 16384 2024-09-21T01:46:47.004 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 3072 offset 4197376 len 1024 2024-09-21T01:46:47.004 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3072 offset 4197376 len 1024 2024-09-21T01:46:47.004 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 3072 offset 4197376 len 1024 2024-09-21T01:46:47.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:46:46 smithi083 ceph-mon[31370]: pgmap v481: 129 pgs: 129 active+clean; 379 MiB data, 476 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.4 MiB/s wr, 324 op/s 2024-09-21T01:46:47.464 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:46:46 smithi142 ceph-mon[34050]: pgmap v481: 129 pgs: 129 active+clean; 379 MiB data, 476 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.4 MiB/s wr, 324 op/s 2024-09-21T01:46:47.467 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:46:46 smithi119 ceph-mon[33693]: pgmap v481: 129 pgs: 129 active+clean; 379 MiB data, 476 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.4 MiB/s wr, 324 op/s 2024-09-21T01:46:47.665 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3072 offset 4197376 len 1024 2024-09-21T01:46:47.665 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 3072 offset 4197376 len 2048 2024-09-21T01:46:47.665 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3072 offset 4197376 len 2048 2024-09-21T01:46:47.665 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 3072 offset 4197376 len 2048 2024-09-21T01:46:47.665 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3072 offset 4197376 len 2048 2024-09-21T01:46:47.665 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 3072 offset 4197376 len 4096 2024-09-21T01:46:47.665 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3072 offset 4197376 len 4096 2024-09-21T01:46:47.665 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 3072 offset 4197376 len 4096 2024-09-21T01:46:47.665 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3072 offset 4197376 len 4096 2024-09-21T01:46:47.666 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 3072 offset 4197376 len 8192 2024-09-21T01:46:47.666 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3072 offset 4197376 len 8192 2024-09-21T01:46:47.666 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 3072 offset 4197376 len 8192 2024-09-21T01:46:47.666 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3072 offset 4197376 len 8192 2024-09-21T01:46:47.666 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 3072 offset 4197376 len 16384 2024-09-21T01:46:47.666 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3072 offset 4197376 len 16384 2024-09-21T01:46:47.666 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 3072 offset 4197376 len 16384 2024-09-21T01:46:47.666 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3072 offset 4197376 len 16384 2024-09-21T01:46:47.666 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 3072 offset 4197888 len 1024 2024-09-21T01:46:47.666 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3072 offset 4197888 len 1024 2024-09-21T01:46:47.666 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 3072 offset 4197888 len 1024 2024-09-21T01:46:47.666 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3072 offset 4197888 len 1024 2024-09-21T01:46:47.666 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 3072 offset 4197888 len 2048 2024-09-21T01:46:47.666 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3072 offset 4197888 len 2048 2024-09-21T01:46:47.667 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 3072 offset 4197888 len 2048 2024-09-21T01:46:47.667 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3072 offset 4197888 len 2048 2024-09-21T01:46:47.667 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 3072 offset 4197888 len 4096 2024-09-21T01:46:47.667 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3072 offset 4197888 len 4096 2024-09-21T01:46:47.667 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 3072 offset 4197888 len 4096 2024-09-21T01:46:47.667 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3072 offset 4197888 len 4096 2024-09-21T01:46:47.667 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 3072 offset 4197888 len 8192 2024-09-21T01:46:47.667 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3072 offset 4197888 len 8192 2024-09-21T01:46:47.667 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 3072 offset 4197888 len 8192 2024-09-21T01:46:47.667 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3072 offset 4197888 len 8192 2024-09-21T01:46:47.667 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 3072 offset 4197888 len 16384 2024-09-21T01:46:47.667 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3072 offset 4197888 len 16384 2024-09-21T01:46:47.667 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 3072 offset 4197888 len 16384 2024-09-21T01:46:47.667 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3072 offset 4197888 len 16384 2024-09-21T01:46:47.668 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 3584 offset 4190720 len 1024 2024-09-21T01:46:47.668 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3584 offset 4190720 len 1024 2024-09-21T01:46:47.668 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 3584 offset 4190720 len 1024 2024-09-21T01:46:47.668 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3584 offset 4190720 len 1024 2024-09-21T01:46:47.668 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 3584 offset 4190720 len 2048 2024-09-21T01:46:47.668 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3584 offset 4190720 len 2048 2024-09-21T01:46:47.668 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 3584 offset 4190720 len 2048 2024-09-21T01:46:47.668 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3584 offset 4190720 len 2048 2024-09-21T01:46:47.668 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 3584 offset 4190720 len 4096 2024-09-21T01:46:47.668 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3584 offset 4190720 len 4096 2024-09-21T01:46:47.668 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 3584 offset 4190720 len 4096 2024-09-21T01:46:47.668 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3584 offset 4190720 len 4096 2024-09-21T01:46:47.668 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 3584 offset 4190720 len 8192 2024-09-21T01:46:47.668 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3584 offset 4190720 len 8192 2024-09-21T01:46:47.668 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 3584 offset 4190720 len 8192 2024-09-21T01:46:47.669 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3584 offset 4190720 len 8192 2024-09-21T01:46:47.669 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 3584 offset 4190720 len 16384 2024-09-21T01:46:47.669 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3584 offset 4190720 len 16384 2024-09-21T01:46:47.669 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 3584 offset 4190720 len 16384 2024-09-21T01:46:47.669 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3584 offset 4190720 len 16384 2024-09-21T01:46:47.669 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 3584 offset 4191232 len 1024 2024-09-21T01:46:47.669 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3584 offset 4191232 len 1024 2024-09-21T01:46:47.669 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 3584 offset 4191232 len 1024 2024-09-21T01:46:47.669 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3584 offset 4191232 len 1024 2024-09-21T01:46:47.669 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 3584 offset 4191232 len 2048 2024-09-21T01:46:47.669 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3584 offset 4191232 len 2048 2024-09-21T01:46:47.669 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 3584 offset 4191232 len 2048 2024-09-21T01:46:47.669 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3584 offset 4191232 len 2048 2024-09-21T01:46:47.669 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 3584 offset 4191232 len 4096 2024-09-21T01:46:47.670 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3584 offset 4191232 len 4096 2024-09-21T01:46:47.670 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 3584 offset 4191232 len 4096 2024-09-21T01:46:47.670 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3584 offset 4191232 len 4096 2024-09-21T01:46:47.670 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 3584 offset 4191232 len 8192 2024-09-21T01:46:47.670 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3584 offset 4191232 len 8192 2024-09-21T01:46:47.670 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 3584 offset 4191232 len 8192 2024-09-21T01:46:47.670 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3584 offset 4191232 len 8192 2024-09-21T01:46:47.670 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 3584 offset 4191232 len 16384 2024-09-21T01:46:47.670 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3584 offset 4191232 len 16384 2024-09-21T01:46:47.670 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 3584 offset 4191232 len 16384 2024-09-21T01:46:47.670 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3584 offset 4191232 len 16384 2024-09-21T01:46:47.670 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 3584 offset 4191744 len 1024 2024-09-21T01:46:47.670 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3584 offset 4191744 len 1024 2024-09-21T01:46:47.670 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 3584 offset 4191744 len 1024 2024-09-21T01:46:47.670 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3584 offset 4191744 len 1024 2024-09-21T01:46:48.108 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 10 2024-09-21T01:46:48.109 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T01:46:48.385 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:46:48.474 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 3584 offset 4191744 len 2048 2024-09-21T01:46:48.475 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3584 offset 4191744 len 2048 2024-09-21T01:46:48.475 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 3584 offset 4191744 len 2048 2024-09-21T01:46:48.475 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3584 offset 4191744 len 2048 2024-09-21T01:46:48.475 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 3584 offset 4191744 len 4096 2024-09-21T01:46:48.475 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3584 offset 4191744 len 4096 2024-09-21T01:46:48.475 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 3584 offset 4191744 len 4096 2024-09-21T01:46:48.475 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3584 offset 4191744 len 4096 2024-09-21T01:46:48.475 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 3584 offset 4191744 len 8192 2024-09-21T01:46:48.475 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3584 offset 4191744 len 8192 2024-09-21T01:46:48.475 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 3584 offset 4191744 len 8192 2024-09-21T01:46:48.475 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3584 offset 4191744 len 8192 2024-09-21T01:46:48.475 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 3584 offset 4191744 len 16384 2024-09-21T01:46:48.475 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3584 offset 4191744 len 16384 2024-09-21T01:46:48.476 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 3584 offset 4191744 len 16384 2024-09-21T01:46:48.476 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3584 offset 4191744 len 16384 2024-09-21T01:46:48.476 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 3584 offset 4192256 len 1024 2024-09-21T01:46:48.476 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3584 offset 4192256 len 1024 2024-09-21T01:46:48.476 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 3584 offset 4192256 len 1024 2024-09-21T01:46:48.476 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3584 offset 4192256 len 1024 2024-09-21T01:46:48.476 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 3584 offset 4192256 len 2048 2024-09-21T01:46:48.476 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3584 offset 4192256 len 2048 2024-09-21T01:46:48.476 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 3584 offset 4192256 len 2048 2024-09-21T01:46:48.476 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3584 offset 4192256 len 2048 2024-09-21T01:46:48.476 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 3584 offset 4192256 len 4096 2024-09-21T01:46:48.476 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3584 offset 4192256 len 4096 2024-09-21T01:46:48.476 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 3584 offset 4192256 len 4096 2024-09-21T01:46:48.476 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3584 offset 4192256 len 4096 2024-09-21T01:46:48.476 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 3584 offset 4192256 len 8192 2024-09-21T01:46:48.477 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3584 offset 4192256 len 8192 2024-09-21T01:46:48.477 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 3584 offset 4192256 len 8192 2024-09-21T01:46:48.477 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3584 offset 4192256 len 8192 2024-09-21T01:46:48.477 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 3584 offset 4192256 len 16384 2024-09-21T01:46:48.477 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3584 offset 4192256 len 16384 2024-09-21T01:46:48.477 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 3584 offset 4192256 len 16384 2024-09-21T01:46:48.477 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3584 offset 4192256 len 16384 2024-09-21T01:46:48.477 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 3584 offset 4192768 len 1024 2024-09-21T01:46:48.477 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3584 offset 4192768 len 1024 2024-09-21T01:46:48.477 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 3584 offset 4192768 len 1024 2024-09-21T01:46:48.477 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3584 offset 4192768 len 1024 2024-09-21T01:46:48.477 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 3584 offset 4192768 len 2048 2024-09-21T01:46:48.477 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3584 offset 4192768 len 2048 2024-09-21T01:46:48.477 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 3584 offset 4192768 len 2048 2024-09-21T01:46:48.478 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3584 offset 4192768 len 2048 2024-09-21T01:46:48.478 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 3584 offset 4192768 len 4096 2024-09-21T01:46:48.478 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3584 offset 4192768 len 4096 2024-09-21T01:46:48.478 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 3584 offset 4192768 len 4096 2024-09-21T01:46:48.478 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3584 offset 4192768 len 4096 2024-09-21T01:46:48.478 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 3584 offset 4192768 len 8192 2024-09-21T01:46:48.478 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3584 offset 4192768 len 8192 2024-09-21T01:46:48.478 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 3584 offset 4192768 len 8192 2024-09-21T01:46:48.478 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3584 offset 4192768 len 8192 2024-09-21T01:46:48.478 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 3584 offset 4192768 len 16384 2024-09-21T01:46:48.478 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3584 offset 4192768 len 16384 2024-09-21T01:46:48.478 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 3584 offset 4192768 len 16384 2024-09-21T01:46:48.478 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3584 offset 4192768 len 16384 2024-09-21T01:46:48.478 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 3584 offset 4193280 len 1024 2024-09-21T01:46:48.479 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3584 offset 4193280 len 1024 2024-09-21T01:46:48.479 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 3584 offset 4193280 len 1024 2024-09-21T01:46:48.479 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3584 offset 4193280 len 1024 2024-09-21T01:46:48.479 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 3584 offset 4193280 len 2048 2024-09-21T01:46:48.479 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3584 offset 4193280 len 2048 2024-09-21T01:46:48.479 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 3584 offset 4193280 len 2048 2024-09-21T01:46:48.479 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3584 offset 4193280 len 2048 2024-09-21T01:46:48.479 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 3584 offset 4193280 len 4096 2024-09-21T01:46:48.479 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3584 offset 4193280 len 4096 2024-09-21T01:46:48.479 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 3584 offset 4193280 len 4096 2024-09-21T01:46:48.479 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3584 offset 4193280 len 4096 2024-09-21T01:46:48.479 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 3584 offset 4193280 len 8192 2024-09-21T01:46:48.479 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3584 offset 4193280 len 8192 2024-09-21T01:46:48.479 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 3584 offset 4193280 len 8192 2024-09-21T01:46:48.480 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3584 offset 4193280 len 8192 2024-09-21T01:46:48.480 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 3584 offset 4193280 len 16384 2024-09-21T01:46:48.480 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3584 offset 4193280 len 16384 2024-09-21T01:46:48.480 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 3584 offset 4193280 len 16384 2024-09-21T01:46:48.480 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3584 offset 4193280 len 16384 2024-09-21T01:46:48.480 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 3584 offset 4193792 len 1024 2024-09-21T01:46:48.480 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3584 offset 4193792 len 1024 2024-09-21T01:46:48.480 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 3584 offset 4193792 len 1024 2024-09-21T01:46:48.480 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3584 offset 4193792 len 1024 2024-09-21T01:46:49.060 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:49.058+0000 7fd929b75640 1 -- 172.21.15.83:0/400163998 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd9241021f0 msgr2=0x7fd924102600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:46:49.060 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:49.058+0000 7fd929b75640 1 --2- 172.21.15.83:0/400163998 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd9241021f0 0x7fd924102600 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fd914009900 tx=0x7fd91402a410 comp rx=0 tx=0).stop 2024-09-21T01:46:49.060 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:49.059+0000 7fd929b75640 1 -- 172.21.15.83:0/400163998 shutdown_connections 2024-09-21T01:46:49.060 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:49.059+0000 7fd929b75640 1 --2- 172.21.15.83:0/400163998 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd924108480 0x7fd92410ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:46:49.060 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:49.059+0000 7fd929b75640 1 --2- 172.21.15.83:0/400163998 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd924107b30 0x7fd924107f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:46:49.060 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:49.059+0000 7fd929b75640 1 --2- 172.21.15.83:0/400163998 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd9241021f0 0x7fd924102600 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:46:49.060 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:49.059+0000 7fd929b75640 1 -- 172.21.15.83:0/400163998 >> 172.21.15.83:0/400163998 conn(0x7fd924077c60 msgr2=0x7fd9240780a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:46:49.060 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:49.059+0000 7fd929b75640 1 -- 172.21.15.83:0/400163998 shutdown_connections 2024-09-21T01:46:49.060 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:49.059+0000 7fd929b75640 1 -- 172.21.15.83:0/400163998 wait complete. 2024-09-21T01:46:49.060 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:49.059+0000 7fd929b75640 1 Processor -- start 2024-09-21T01:46:49.060 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:49.059+0000 7fd929b75640 1 -- start start 2024-09-21T01:46:49.062 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:49.060+0000 7fd929b75640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd9241021f0 0x7fd924108da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:46:49.062 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:49.060+0000 7fd929b75640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd924107b30 0x7fd9241092e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:46:49.062 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:49.060+0000 7fd929b75640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd924108480 0x7fd924109820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:46:49.062 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:49.060+0000 7fd929b75640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fd924111770 con 0x7fd9241021f0 2024-09-21T01:46:49.062 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:49.060+0000 7fd929b75640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fd9241115f0 con 0x7fd924108480 2024-09-21T01:46:49.062 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:49.060+0000 7fd929b75640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fd9241118f0 con 0x7fd924107b30 2024-09-21T01:46:49.062 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:49.060+0000 7fd9237fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd9241021f0 0x7fd924108da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:46:49.062 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:49.060+0000 7fd9237fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd9241021f0 0x7fd924108da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:46236/0 (socket says 172.21.15.83:46236) 2024-09-21T01:46:49.062 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:49.060+0000 7fd9237fe640 1 -- 172.21.15.83:0/1754007615 learned_addr learned my addr 172.21.15.83:0/1754007615 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:46:49.062 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:49.060+0000 7fd922ffd640 1 --2- 172.21.15.83:0/1754007615 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd924107b30 0x7fd9241092e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:46:49.063 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:49.060+0000 7fd923fff640 1 --2- 172.21.15.83:0/1754007615 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd924108480 0x7fd924109820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:46:49.063 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:49.060+0000 7fd9237fe640 1 -- 172.21.15.83:0/1754007615 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd924107b30 msgr2=0x7fd9241092e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:46:49.063 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:49.060+0000 7fd9237fe640 1 --2- 172.21.15.83:0/1754007615 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd924107b30 0x7fd9241092e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:46:49.063 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:49.060+0000 7fd9237fe640 1 -- 172.21.15.83:0/1754007615 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd924108480 msgr2=0x7fd924109820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:46:49.063 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:49.060+0000 7fd9237fe640 1 --2- 172.21.15.83:0/1754007615 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd924108480 0x7fd924109820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:46:49.063 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:49.060+0000 7fd9237fe640 1 -- 172.21.15.83:0/1754007615 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9241a8720 con 0x7fd9241021f0 2024-09-21T01:46:49.063 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:49.061+0000 7fd9237fe640 1 --2- 172.21.15.83:0/1754007615 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd9241021f0 0x7fd924108da0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fd914009230 tx=0x7fd9140319a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:46:49.063 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:49.061+0000 7fd920ff9640 1 -- 172.21.15.83:0/1754007615 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd91403f030 con 0x7fd9241021f0 2024-09-21T01:46:49.063 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:49.061+0000 7fd920ff9640 1 -- 172.21.15.83:0/1754007615 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd9140043d0 con 0x7fd9241021f0 2024-09-21T01:46:49.063 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:49.061+0000 7fd929b75640 1 -- 172.21.15.83:0/1754007615 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9241a89b0 con 0x7fd9241021f0 2024-09-21T01:46:49.063 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:49.061+0000 7fd920ff9640 1 -- 172.21.15.83:0/1754007615 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd914035070 con 0x7fd9241021f0 2024-09-21T01:46:49.063 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:49.061+0000 7fd929b75640 1 -- 172.21.15.83:0/1754007615 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9241a8e90 con 0x7fd9241021f0 2024-09-21T01:46:49.064 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:49.062+0000 7fd929b75640 1 -- 172.21.15.83:0/1754007615 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd924102600 con 0x7fd9241021f0 2024-09-21T01:46:49.064 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:49.064+0000 7fd920ff9640 1 -- 172.21.15.83:0/1754007615 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7fd914042030 con 0x7fd9241021f0 2024-09-21T01:46:49.065 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:49.065+0000 7fd920ff9640 1 --2- 172.21.15.83:0/1754007615 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fd90c0b6680 0x7fd90c0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:46:49.065 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:49.065+0000 7fd922ffd640 1 --2- 172.21.15.83:0/1754007615 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fd90c0b6680 0x7fd90c0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:46:49.065 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:49.065+0000 7fd920ff9640 1 -- 172.21.15.83:0/1754007615 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9315+0+0 (secure 0 0 0) 0x7fd914108220 con 0x7fd9241021f0 2024-09-21T01:46:49.066 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:49.065+0000 7fd922ffd640 1 --2- 172.21.15.83:0/1754007615 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fd90c0b6680 0x7fd90c0b8b90 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fd9241077c0 tx=0x7fd918005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:46:49.068 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:49.068+0000 7fd920ff9640 1 -- 172.21.15.83:0/1754007615 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd9140d27d0 con 0x7fd9241021f0 2024-09-21T01:46:49.082 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 3584 offset 4193792 len 2048 2024-09-21T01:46:49.082 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3584 offset 4193792 len 2048 2024-09-21T01:46:49.082 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 3584 offset 4193792 len 2048 2024-09-21T01:46:49.082 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3584 offset 4193792 len 2048 2024-09-21T01:46:49.083 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 3584 offset 4193792 len 4096 2024-09-21T01:46:49.083 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3584 offset 4193792 len 4096 2024-09-21T01:46:49.083 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 3584 offset 4193792 len 4096 2024-09-21T01:46:49.083 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3584 offset 4193792 len 4096 2024-09-21T01:46:49.083 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 3584 offset 4193792 len 8192 2024-09-21T01:46:49.083 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3584 offset 4193792 len 8192 2024-09-21T01:46:49.083 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 3584 offset 4193792 len 8192 2024-09-21T01:46:49.083 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3584 offset 4193792 len 8192 2024-09-21T01:46:49.083 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 3584 offset 4193792 len 16384 2024-09-21T01:46:49.083 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3584 offset 4193792 len 16384 2024-09-21T01:46:49.083 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 3584 offset 4193792 len 16384 2024-09-21T01:46:49.083 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3584 offset 4193792 len 16384 2024-09-21T01:46:49.083 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 3584 offset 4194304 len 1024 2024-09-21T01:46:49.084 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3584 offset 4194304 len 1024 2024-09-21T01:46:49.084 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 3584 offset 4194304 len 1024 2024-09-21T01:46:49.084 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3584 offset 4194304 len 1024 2024-09-21T01:46:49.084 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 3584 offset 4194304 len 2048 2024-09-21T01:46:49.084 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3584 offset 4194304 len 2048 2024-09-21T01:46:49.084 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 3584 offset 4194304 len 2048 2024-09-21T01:46:49.084 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3584 offset 4194304 len 2048 2024-09-21T01:46:49.084 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 3584 offset 4194304 len 4096 2024-09-21T01:46:49.084 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3584 offset 4194304 len 4096 2024-09-21T01:46:49.084 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 3584 offset 4194304 len 4096 2024-09-21T01:46:49.084 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3584 offset 4194304 len 4096 2024-09-21T01:46:49.084 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 3584 offset 4194304 len 8192 2024-09-21T01:46:49.084 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3584 offset 4194304 len 8192 2024-09-21T01:46:49.084 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 3584 offset 4194304 len 8192 2024-09-21T01:46:49.084 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3584 offset 4194304 len 8192 2024-09-21T01:46:49.085 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 3584 offset 4194304 len 16384 2024-09-21T01:46:49.085 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3584 offset 4194304 len 16384 2024-09-21T01:46:49.085 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 3584 offset 4194304 len 16384 2024-09-21T01:46:49.085 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3584 offset 4194304 len 16384 2024-09-21T01:46:49.085 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 3584 offset 4194816 len 1024 2024-09-21T01:46:49.085 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3584 offset 4194816 len 1024 2024-09-21T01:46:49.085 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 3584 offset 4194816 len 1024 2024-09-21T01:46:49.085 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3584 offset 4194816 len 1024 2024-09-21T01:46:49.085 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 3584 offset 4194816 len 2048 2024-09-21T01:46:49.085 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3584 offset 4194816 len 2048 2024-09-21T01:46:49.085 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 3584 offset 4194816 len 2048 2024-09-21T01:46:49.085 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3584 offset 4194816 len 2048 2024-09-21T01:46:49.085 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 3584 offset 4194816 len 4096 2024-09-21T01:46:49.085 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3584 offset 4194816 len 4096 2024-09-21T01:46:49.086 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 3584 offset 4194816 len 4096 2024-09-21T01:46:49.086 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3584 offset 4194816 len 4096 2024-09-21T01:46:49.086 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 3584 offset 4194816 len 8192 2024-09-21T01:46:49.086 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3584 offset 4194816 len 8192 2024-09-21T01:46:49.086 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 3584 offset 4194816 len 8192 2024-09-21T01:46:49.086 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3584 offset 4194816 len 8192 2024-09-21T01:46:49.086 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 3584 offset 4194816 len 16384 2024-09-21T01:46:49.086 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3584 offset 4194816 len 16384 2024-09-21T01:46:49.086 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 3584 offset 4194816 len 16384 2024-09-21T01:46:49.086 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3584 offset 4194816 len 16384 2024-09-21T01:46:49.086 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 3584 offset 4195328 len 1024 2024-09-21T01:46:49.086 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3584 offset 4195328 len 1024 2024-09-21T01:46:49.087 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 3584 offset 4195328 len 1024 2024-09-21T01:46:49.087 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3584 offset 4195328 len 1024 2024-09-21T01:46:49.087 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 3584 offset 4195328 len 2048 2024-09-21T01:46:49.087 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3584 offset 4195328 len 2048 2024-09-21T01:46:49.087 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 3584 offset 4195328 len 2048 2024-09-21T01:46:49.087 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3584 offset 4195328 len 2048 2024-09-21T01:46:49.087 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 3584 offset 4195328 len 4096 2024-09-21T01:46:49.087 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3584 offset 4195328 len 4096 2024-09-21T01:46:49.087 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 3584 offset 4195328 len 4096 2024-09-21T01:46:49.087 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3584 offset 4195328 len 4096 2024-09-21T01:46:49.087 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 3584 offset 4195328 len 8192 2024-09-21T01:46:49.087 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3584 offset 4195328 len 8192 2024-09-21T01:46:49.087 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 3584 offset 4195328 len 8192 2024-09-21T01:46:49.087 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3584 offset 4195328 len 8192 2024-09-21T01:46:49.088 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 3584 offset 4195328 len 16384 2024-09-21T01:46:49.088 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3584 offset 4195328 len 16384 2024-09-21T01:46:49.088 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 3584 offset 4195328 len 16384 2024-09-21T01:46:49.088 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3584 offset 4195328 len 16384 2024-09-21T01:46:49.088 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 3584 offset 4195840 len 1024 2024-09-21T01:46:49.088 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3584 offset 4195840 len 1024 2024-09-21T01:46:49.088 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 3584 offset 4195840 len 1024 2024-09-21T01:46:49.088 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3584 offset 4195840 len 1024 2024-09-21T01:46:49.088 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 3584 offset 4195840 len 2048 2024-09-21T01:46:49.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:46:48 smithi083 ceph-mon[31370]: pgmap v482: 129 pgs: 129 active+clean; 375 MiB data, 481 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 288 op/s 2024-09-21T01:46:49.321 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:49.321+0000 7fd929b75640 1 -- 172.21.15.83:0/1754007615 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd92402e640 con 0x7fd9241021f0 2024-09-21T01:46:49.322 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:49.322+0000 7fd920ff9640 1 -- 172.21.15.83:0/1754007615 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11857 (secure 0 0 0) 0x7fd9140d7710 con 0x7fd9241021f0 2024-09-21T01:46:49.322 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T01:46:49.322 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":21,"btime":"2024-09-21T01:40:27:947059+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14775,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6835/1105040204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":1105040204},{"type":"v1","addr":"172.21.15.83:6835","nonce":1105040204}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14787,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/2234789563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6836","nonce":2234789563},{"type":"v1","addr":"172.21.15.83:6837","nonce":2234789563}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14838,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6839/136258364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6838","nonce":136258364},{"type":"v1","addr":"172.21.15.83:6839","nonce":136258364}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14850,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6841/129439444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6840","nonce":129439444},{"type":"v1","addr":"172.21.15.83:6841","nonce":129439444}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24569,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/2839502433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":2839502433},{"type":"v1","addr":"172.21.15.119:6833","nonce":2839502433}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24580,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6833/2841606990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":2841606990},{"type":"v1","addr":"172.21.15.142:6833","nonce":2841606990}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24599,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/415902608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":415902608},{"type":"v1","addr":"172.21.15.119:6835","nonce":415902608}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24607,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/3009088510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":3009088510},{"type":"v1","addr":"172.21.15.142:6835","nonce":3009088510}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24613,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/3847200126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6836","nonce":3847200126},{"type":"v1","addr":"172.21.15.142:6837","nonce":3847200126}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24626,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/3619222976","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":3619222976},{"type":"v1","addr":"172.21.15.119:6837","nonce":3619222976}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T01:39:45.145124+0000","modified":"2024-09-21T01:40:27.664151+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24653},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24631":{"gid":24631,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.142:6839/1817880741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6838","nonce":1817880741},{"type":"v1","addr":"172.21.15.142:6839","nonce":1817880741}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24653":{"gid":24653,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.119:6839/3106757092","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":3106757092},{"type":"v1","addr":"172.21.15.119:6839","nonce":3106757092}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24653,"qdb_cluster":[24653]},"id":1}]} 2024-09-21T01:46:49.323 INFO:teuthology.orchestra.run.smithi083.stderr:dumped fsmap epoch 21 2024-09-21T01:46:49.325 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:49.324+0000 7fd929b75640 1 -- 172.21.15.83:0/1754007615 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fd90c0b6680 msgr2=0x7fd90c0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:46:49.325 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:49.324+0000 7fd929b75640 1 --2- 172.21.15.83:0/1754007615 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fd90c0b6680 0x7fd90c0b8b90 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fd9241077c0 tx=0x7fd918005f90 comp rx=0 tx=0).stop 2024-09-21T01:46:49.325 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:49.324+0000 7fd929b75640 1 -- 172.21.15.83:0/1754007615 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd9241021f0 msgr2=0x7fd924108da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:46:49.325 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:49.324+0000 7fd929b75640 1 --2- 172.21.15.83:0/1754007615 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd9241021f0 0x7fd924108da0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fd914009230 tx=0x7fd9140319a0 comp rx=0 tx=0).stop 2024-09-21T01:46:49.325 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:49.324+0000 7fd929b75640 1 -- 172.21.15.83:0/1754007615 shutdown_connections 2024-09-21T01:46:49.325 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:49.324+0000 7fd929b75640 1 --2- 172.21.15.83:0/1754007615 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fd90c0b6680 0x7fd90c0b8b90 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:46:49.325 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:49.324+0000 7fd929b75640 1 --2- 172.21.15.83:0/1754007615 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd924108480 0x7fd924109820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:46:49.325 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:49.324+0000 7fd929b75640 1 --2- 172.21.15.83:0/1754007615 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd924107b30 0x7fd9241092e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:46:49.325 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:49.324+0000 7fd929b75640 1 --2- 172.21.15.83:0/1754007615 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd9241021f0 0x7fd924108da0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:46:49.325 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:49.324+0000 7fd929b75640 1 -- 172.21.15.83:0/1754007615 >> 172.21.15.83:0/1754007615 conn(0x7fd924077c60 msgr2=0x7fd924105b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:46:49.325 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:49.324+0000 7fd929b75640 1 -- 172.21.15.83:0/1754007615 shutdown_connections 2024-09-21T01:46:49.326 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:49.324+0000 7fd929b75640 1 -- 172.21.15.83:0/1754007615 wait complete. 2024-09-21T01:46:49.464 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:46:48 smithi142 ceph-mon[34050]: pgmap v482: 129 pgs: 129 active+clean; 375 MiB data, 481 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 288 op/s 2024-09-21T01:46:49.467 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:46:48 smithi119 ceph-mon[33693]: pgmap v482: 129 pgs: 129 active+clean; 375 MiB data, 481 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 288 op/s 2024-09-21T01:46:49.605 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3584 offset 4195840 len 2048 2024-09-21T01:46:49.605 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 3584 offset 4195840 len 2048 2024-09-21T01:46:49.606 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3584 offset 4195840 len 2048 2024-09-21T01:46:49.606 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 3584 offset 4195840 len 4096 2024-09-21T01:46:49.606 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3584 offset 4195840 len 4096 2024-09-21T01:46:49.606 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 3584 offset 4195840 len 4096 2024-09-21T01:46:49.606 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3584 offset 4195840 len 4096 2024-09-21T01:46:49.606 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 3584 offset 4195840 len 8192 2024-09-21T01:46:49.606 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3584 offset 4195840 len 8192 2024-09-21T01:46:49.606 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 3584 offset 4195840 len 8192 2024-09-21T01:46:49.606 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3584 offset 4195840 len 8192 2024-09-21T01:46:49.606 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 3584 offset 4195840 len 16384 2024-09-21T01:46:49.606 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3584 offset 4195840 len 16384 2024-09-21T01:46:49.606 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 3584 offset 4195840 len 16384 2024-09-21T01:46:49.606 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3584 offset 4195840 len 16384 2024-09-21T01:46:49.606 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 3584 offset 4196352 len 1024 2024-09-21T01:46:49.607 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3584 offset 4196352 len 1024 2024-09-21T01:46:49.607 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 3584 offset 4196352 len 1024 2024-09-21T01:46:49.607 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3584 offset 4196352 len 1024 2024-09-21T01:46:49.607 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 3584 offset 4196352 len 2048 2024-09-21T01:46:49.607 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3584 offset 4196352 len 2048 2024-09-21T01:46:49.607 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 3584 offset 4196352 len 2048 2024-09-21T01:46:49.607 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3584 offset 4196352 len 2048 2024-09-21T01:46:49.607 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 3584 offset 4196352 len 4096 2024-09-21T01:46:49.607 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3584 offset 4196352 len 4096 2024-09-21T01:46:49.607 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 3584 offset 4196352 len 4096 2024-09-21T01:46:49.607 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3584 offset 4196352 len 4096 2024-09-21T01:46:49.607 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 3584 offset 4196352 len 8192 2024-09-21T01:46:49.607 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3584 offset 4196352 len 8192 2024-09-21T01:46:49.608 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 3584 offset 4196352 len 8192 2024-09-21T01:46:49.608 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3584 offset 4196352 len 8192 2024-09-21T01:46:49.608 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 3584 offset 4196352 len 16384 2024-09-21T01:46:49.608 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3584 offset 4196352 len 16384 2024-09-21T01:46:49.608 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 3584 offset 4196352 len 16384 2024-09-21T01:46:49.608 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3584 offset 4196352 len 16384 2024-09-21T01:46:49.608 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 3584 offset 4196864 len 1024 2024-09-21T01:46:49.608 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3584 offset 4196864 len 1024 2024-09-21T01:46:49.608 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 3584 offset 4196864 len 1024 2024-09-21T01:46:49.608 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3584 offset 4196864 len 1024 2024-09-21T01:46:49.608 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 3584 offset 4196864 len 2048 2024-09-21T01:46:49.608 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3584 offset 4196864 len 2048 2024-09-21T01:46:49.608 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 3584 offset 4196864 len 2048 2024-09-21T01:46:49.608 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3584 offset 4196864 len 2048 2024-09-21T01:46:49.608 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 3584 offset 4196864 len 4096 2024-09-21T01:46:49.609 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3584 offset 4196864 len 4096 2024-09-21T01:46:49.609 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 3584 offset 4196864 len 4096 2024-09-21T01:46:49.609 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3584 offset 4196864 len 4096 2024-09-21T01:46:49.609 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 3584 offset 4196864 len 8192 2024-09-21T01:46:49.609 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3584 offset 4196864 len 8192 2024-09-21T01:46:49.609 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 3584 offset 4196864 len 8192 2024-09-21T01:46:49.609 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3584 offset 4196864 len 8192 2024-09-21T01:46:49.609 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 3584 offset 4196864 len 16384 2024-09-21T01:46:49.609 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3584 offset 4196864 len 16384 2024-09-21T01:46:49.609 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 3584 offset 4196864 len 16384 2024-09-21T01:46:49.609 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3584 offset 4196864 len 16384 2024-09-21T01:46:49.609 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 3584 offset 4197376 len 1024 2024-09-21T01:46:49.609 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3584 offset 4197376 len 1024 2024-09-21T01:46:49.609 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 3584 offset 4197376 len 1024 2024-09-21T01:46:49.610 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3584 offset 4197376 len 1024 2024-09-21T01:46:49.610 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 3584 offset 4197376 len 2048 2024-09-21T01:46:49.610 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3584 offset 4197376 len 2048 2024-09-21T01:46:49.610 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 3584 offset 4197376 len 2048 2024-09-21T01:46:49.610 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3584 offset 4197376 len 2048 2024-09-21T01:46:49.610 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 3584 offset 4197376 len 4096 2024-09-21T01:46:49.610 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3584 offset 4197376 len 4096 2024-09-21T01:46:49.610 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 3584 offset 4197376 len 4096 2024-09-21T01:46:49.610 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3584 offset 4197376 len 4096 2024-09-21T01:46:49.610 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 3584 offset 4197376 len 8192 2024-09-21T01:46:49.610 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3584 offset 4197376 len 8192 2024-09-21T01:46:49.610 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 3584 offset 4197376 len 8192 2024-09-21T01:46:49.610 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3584 offset 4197376 len 8192 2024-09-21T01:46:49.610 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 3584 offset 4197376 len 16384 2024-09-21T01:46:49.611 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3584 offset 4197376 len 16384 2024-09-21T01:46:49.611 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 3584 offset 4197376 len 16384 2024-09-21T01:46:49.611 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3584 offset 4197376 len 16384 2024-09-21T01:46:49.611 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 3584 offset 4197888 len 1024 2024-09-21T01:46:49.611 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3584 offset 4197888 len 1024 2024-09-21T01:46:49.611 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 3584 offset 4197888 len 1024 2024-09-21T01:46:49.611 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3584 offset 4197888 len 1024 2024-09-21T01:46:49.611 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 3584 offset 4197888 len 2048 2024-09-21T01:46:49.611 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3584 offset 4197888 len 2048 2024-09-21T01:46:49.682 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 3584 offset 4197888 len 2048 2024-09-21T01:46:49.683 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3584 offset 4197888 len 2048 2024-09-21T01:46:49.683 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 3584 offset 4197888 len 4096 2024-09-21T01:46:49.683 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3584 offset 4197888 len 4096 2024-09-21T01:46:49.683 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 3584 offset 4197888 len 4096 2024-09-21T01:46:49.683 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3584 offset 4197888 len 4096 2024-09-21T01:46:49.683 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 3584 offset 4197888 len 8192 2024-09-21T01:46:49.683 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3584 offset 4197888 len 8192 2024-09-21T01:46:49.683 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 3584 offset 4197888 len 8192 2024-09-21T01:46:49.683 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3584 offset 4197888 len 8192 2024-09-21T01:46:49.683 INFO:tasks.workunit.client.0.smithi083.stdout:write_direct buf_align 3584 offset 4197888 len 16384 2024-09-21T01:46:49.683 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3584 offset 4197888 len 16384 2024-09-21T01:46:49.683 INFO:tasks.workunit.client.0.smithi083.stdout:write_sync buf_align 3584 offset 4197888 len 16384 2024-09-21T01:46:49.683 INFO:tasks.workunit.client.0.smithi083.stdout:write_file buf_align 3584 offset 4197888 len 16384 2024-09-21T01:46:49.684 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-21T01:46:49.684 DEBUG:teuthology.orchestra.run.smithi083:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-21T01:46:49.720 INFO:tasks.workunit:Stopping ['direct_io'] on client.0... 2024-09-21T01:46:49.720 DEBUG:teuthology.orchestra.run.smithi083:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-21T01:46:50.065 DEBUG:teuthology.parallel:result is None 2024-09-21T01:46:50.066 DEBUG:teuthology.orchestra.run.smithi083:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-21T01:46:50.097 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-21T01:46:50.097 DEBUG:teuthology.run_tasks:Unwinding manager quiescer 2024-09-21T01:46:50.112 INFO:tasks.quiescer:joining Quiescers 2024-09-21T01:46:50.113 WARNING:tasks.quiescer:The quiescer is requested to stop, running cancel all 2024-09-21T01:46:50.113 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T01:46:50.141 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24653 quiesce db / --timeout 90 --expiration 130 --await-for 45.0' 2024-09-21T01:46:50.141 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24653 quiesce db / --timeout 90 --expiration 130 --await-for 45.0 2024-09-21T01:46:50.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:46:49 smithi083 ceph-mon[31370]: from='client.? 172.21.15.83:0/1754007615' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:46:50.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:46:49 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:46:50.402 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:46:50.464 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:46:49 smithi142 ceph-mon[34050]: from='client.? 172.21.15.83:0/1754007615' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:46:50.465 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:46:49 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:46:50.467 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:46:49 smithi119 ceph-mon[33693]: from='client.? 172.21.15.83:0/1754007615' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:46:50.467 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:46:49 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:46:50.918 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:50.897+0000 7f6af08c1640 1 -- 172.21.15.83:0/3197533388 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6aec1083c0 msgr2=0x7f6aec1087d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:46:50.918 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:50.897+0000 7f6af08c1640 1 --2- 172.21.15.83:0/3197533388 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6aec1083c0 0x7f6aec1087d0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f6ae0009900 tx=0x7f6ae002a410 comp rx=0 tx=0).stop 2024-09-21T01:46:50.918 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:50.897+0000 7f6af08c1640 1 -- 172.21.15.83:0/3197533388 shutdown_connections 2024-09-21T01:46:50.918 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:50.897+0000 7f6af08c1640 1 --2- 172.21.15.83:0/3197533388 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6aec108d10 0x7f6aec10f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:46:50.918 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:50.897+0000 7f6af08c1640 1 --2- 172.21.15.83:0/3197533388 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6aec1083c0 0x7f6aec1087d0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:46:50.918 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:50.897+0000 7f6af08c1640 1 --2- 172.21.15.83:0/3197533388 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6aec102a80 0x7f6aec102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:46:50.918 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:50.897+0000 7f6af08c1640 1 -- 172.21.15.83:0/3197533388 >> 172.21.15.83:0/3197533388 conn(0x7f6aec079740 msgr2=0x7f6aec079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:46:50.918 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:50.897+0000 7f6af08c1640 1 -- 172.21.15.83:0/3197533388 shutdown_connections 2024-09-21T01:46:50.919 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:50.897+0000 7f6af08c1640 1 -- 172.21.15.83:0/3197533388 wait complete. 2024-09-21T01:46:50.919 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:50.898+0000 7f6af08c1640 1 Processor -- start 2024-09-21T01:46:50.919 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:50.898+0000 7f6af08c1640 1 -- start start 2024-09-21T01:46:50.919 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:50.898+0000 7f6af08c1640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6aec102a80 0x7f6aec19a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:46:50.919 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:50.898+0000 7f6af08c1640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6aec1083c0 0x7f6aec19aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:46:50.919 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:50.898+0000 7f6af08c1640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6aec108d10 0x7f6aec19fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:46:50.919 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:50.898+0000 7f6af08c1640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f6aec113950 con 0x7f6aec102a80 2024-09-21T01:46:50.919 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:50.898+0000 7f6af08c1640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f6aec1137d0 con 0x7f6aec108d10 2024-09-21T01:46:50.919 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:50.898+0000 7f6af08c1640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f6aec113ad0 con 0x7f6aec1083c0 2024-09-21T01:46:50.919 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:50.898+0000 7f6aea59c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6aec102a80 0x7f6aec19a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:46:50.919 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:50.898+0000 7f6aea59c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6aec102a80 0x7f6aec19a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:46260/0 (socket says 172.21.15.83:46260) 2024-09-21T01:46:50.919 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:50.898+0000 7f6aea59c640 1 -- 172.21.15.83:0/3869448418 learned_addr learned my addr 172.21.15.83:0/3869448418 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:46:50.919 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:50.898+0000 7f6aead9d640 1 --2- 172.21.15.83:0/3869448418 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6aec108d10 0x7f6aec19fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:46:50.920 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:50.899+0000 7f6ae9d9b640 1 --2- 172.21.15.83:0/3869448418 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6aec1083c0 0x7f6aec19aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:46:50.920 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:50.899+0000 7f6aea59c640 1 -- 172.21.15.83:0/3869448418 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6aec1083c0 msgr2=0x7f6aec19aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:46:50.920 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:50.899+0000 7f6aea59c640 1 --2- 172.21.15.83:0/3869448418 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6aec1083c0 0x7f6aec19aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:46:50.920 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:50.899+0000 7f6aea59c640 1 -- 172.21.15.83:0/3869448418 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6aec108d10 msgr2=0x7f6aec19fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:46:50.920 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:50.899+0000 7f6aea59c640 1 --2- 172.21.15.83:0/3869448418 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6aec108d10 0x7f6aec19fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:46:50.920 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:50.899+0000 7f6aea59c640 1 -- 172.21.15.83:0/3869448418 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6aec1a0430 con 0x7f6aec102a80 2024-09-21T01:46:50.920 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:50.899+0000 7f6ae9d9b640 1 --2- 172.21.15.83:0/3869448418 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6aec1083c0 0x7f6aec19aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:46:50.920 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:50.899+0000 7f6aea59c640 1 --2- 172.21.15.83:0/3869448418 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6aec102a80 0x7f6aec19a4c0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f6adc00eab0 tx=0x7f6adc00ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:46:50.920 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:50.899+0000 7f6adb7fe640 1 -- 172.21.15.83:0/3869448418 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6adc00ce40 con 0x7f6aec102a80 2024-09-21T01:46:50.920 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:50.899+0000 7f6adb7fe640 1 -- 172.21.15.83:0/3869448418 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6adc011900 con 0x7f6aec102a80 2024-09-21T01:46:50.920 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:50.899+0000 7f6af08c1640 1 -- 172.21.15.83:0/3869448418 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6aec1a0720 con 0x7f6aec102a80 2024-09-21T01:46:50.920 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:50.899+0000 7f6adb7fe640 1 -- 172.21.15.83:0/3869448418 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6adc010990 con 0x7f6aec102a80 2024-09-21T01:46:50.920 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:50.899+0000 7f6af08c1640 1 -- 172.21.15.83:0/3869448418 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6aec1a6e80 con 0x7f6aec102a80 2024-09-21T01:46:50.920 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:50.900+0000 7f6af08c1640 1 -- 172.21.15.83:0/3869448418 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6aec103d00 con 0x7f6aec102a80 2024-09-21T01:46:50.921 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:50.902+0000 7f6adb7fe640 1 -- 172.21.15.83:0/3869448418 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7f6adc011470 con 0x7f6aec102a80 2024-09-21T01:46:50.921 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:50.902+0000 7f6adb7fe640 1 --2- 172.21.15.83:0/3869448418 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f6ad40b6680 0x7f6ad40b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:46:50.921 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:50.902+0000 7f6ae9d9b640 1 --2- 172.21.15.83:0/3869448418 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f6ad40b6680 0x7f6ad40b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:46:50.921 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:50.902+0000 7f6adb7fe640 1 -- 172.21.15.83:0/3869448418 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9315+0+0 (secure 0 0 0) 0x7f6adc0e8030 con 0x7f6aec102a80 2024-09-21T01:46:50.921 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:50.903+0000 7f6ae9d9b640 1 --2- 172.21.15.83:0/3869448418 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f6ad40b6680 0x7f6ad40b8b90 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f6ae0006010 tx=0x7f6ae0000bc0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:46:50.921 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:50.906+0000 7f6adb7fe640 1 -- 172.21.15.83:0/3869448418 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6adc016030 con 0x7f6aec102a80 2024-09-21T01:46:50.963 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:46:51.085 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:46:50 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:46:51.085 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:46:50 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:46:51.085 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:46:50 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:46:51.085 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:46:50 smithi083 ceph-mon[31370]: pgmap v483: 129 pgs: 129 active+clean; 303 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 313 op/s 2024-09-21T01:46:51.145 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:51.143+0000 7f6af08c1640 1 -- 172.21.15.83:0/3869448418 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6aec102e90 con 0x7f6aec102a80 2024-09-21T01:46:51.145 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:51.144+0000 7f6adb7fe640 1 -- 172.21.15.83:0/3869448418 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11857 (secure 0 0 0) 0x7f6aec102e90 con 0x7f6aec102a80 2024-09-21T01:46:51.145 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T01:46:51.145 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":21,"btime":"2024-09-21T01:40:27:947059+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14775,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6835/1105040204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":1105040204},{"type":"v1","addr":"172.21.15.83:6835","nonce":1105040204}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14787,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/2234789563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6836","nonce":2234789563},{"type":"v1","addr":"172.21.15.83:6837","nonce":2234789563}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14838,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6839/136258364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6838","nonce":136258364},{"type":"v1","addr":"172.21.15.83:6839","nonce":136258364}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14850,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6841/129439444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6840","nonce":129439444},{"type":"v1","addr":"172.21.15.83:6841","nonce":129439444}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24569,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/2839502433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":2839502433},{"type":"v1","addr":"172.21.15.119:6833","nonce":2839502433}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24580,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6833/2841606990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":2841606990},{"type":"v1","addr":"172.21.15.142:6833","nonce":2841606990}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24599,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/415902608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":415902608},{"type":"v1","addr":"172.21.15.119:6835","nonce":415902608}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24607,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/3009088510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":3009088510},{"type":"v1","addr":"172.21.15.142:6835","nonce":3009088510}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24613,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/3847200126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6836","nonce":3847200126},{"type":"v1","addr":"172.21.15.142:6837","nonce":3847200126}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24626,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/3619222976","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":3619222976},{"type":"v1","addr":"172.21.15.119:6837","nonce":3619222976}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T01:39:45.145124+0000","modified":"2024-09-21T01:40:27.664151+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24653},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24631":{"gid":24631,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.142:6839/1817880741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6838","nonce":1817880741},{"type":"v1","addr":"172.21.15.142:6839","nonce":1817880741}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24653":{"gid":24653,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.119:6839/3106757092","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":3106757092},{"type":"v1","addr":"172.21.15.119:6839","nonce":3106757092}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24653,"qdb_cluster":[24653]},"id":1}]} 2024-09-21T01:46:51.145 INFO:teuthology.orchestra.run.smithi083.stderr:dumped fsmap epoch 21 2024-09-21T01:46:51.147 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:51.146+0000 7f6af08c1640 1 -- 172.21.15.83:0/3869448418 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f6ad40b6680 msgr2=0x7f6ad40b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:46:51.147 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:51.146+0000 7f6af08c1640 1 --2- 172.21.15.83:0/3869448418 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f6ad40b6680 0x7f6ad40b8b90 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f6ae0006010 tx=0x7f6ae0000bc0 comp rx=0 tx=0).stop 2024-09-21T01:46:51.147 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:51.146+0000 7f6af08c1640 1 -- 172.21.15.83:0/3869448418 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6aec102a80 msgr2=0x7f6aec19a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:46:51.147 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:51.146+0000 7f6af08c1640 1 --2- 172.21.15.83:0/3869448418 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6aec102a80 0x7f6aec19a4c0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f6adc00eab0 tx=0x7f6adc00ef70 comp rx=0 tx=0).stop 2024-09-21T01:46:51.147 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:51.146+0000 7f6af08c1640 1 -- 172.21.15.83:0/3869448418 shutdown_connections 2024-09-21T01:46:51.147 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:51.146+0000 7f6af08c1640 1 --2- 172.21.15.83:0/3869448418 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f6ad40b6680 0x7f6ad40b8b90 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:46:51.147 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:51.146+0000 7f6af08c1640 1 --2- 172.21.15.83:0/3869448418 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6aec108d10 0x7f6aec19fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:46:51.147 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:51.146+0000 7f6af08c1640 1 --2- 172.21.15.83:0/3869448418 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6aec1083c0 0x7f6aec19aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:46:51.147 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:51.146+0000 7f6af08c1640 1 --2- 172.21.15.83:0/3869448418 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6aec102a80 0x7f6aec19a4c0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:46:51.147 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:51.146+0000 7f6af08c1640 1 -- 172.21.15.83:0/3869448418 >> 172.21.15.83:0/3869448418 conn(0x7f6aec079740 msgr2=0x7f6aec1045d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:46:51.148 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:51.146+0000 7f6af08c1640 1 -- 172.21.15.83:0/3869448418 shutdown_connections 2024-09-21T01:46:51.148 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:51.146+0000 7f6af08c1640 1 -- 172.21.15.83:0/3869448418 wait complete. 2024-09-21T01:46:51.464 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:46:50 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:46:51.464 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:46:50 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:46:51.464 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:46:50 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:46:51.465 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:46:50 smithi142 ceph-mon[34050]: pgmap v483: 129 pgs: 129 active+clean; 303 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 313 op/s 2024-09-21T01:46:51.467 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:46:50 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:46:51.467 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:46:50 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:46:51.467 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:46:50 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:46:51.468 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:46:50 smithi119 ceph-mon[33693]: pgmap v483: 129 pgs: 129 active+clean; 303 MiB data, 490 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 313 op/s 2024-09-21T01:46:51.980 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24653 quiesce db --cancel --all' 2024-09-21T01:46:51.980 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24653 quiesce db --cancel --all 2024-09-21T01:46:52.198 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.197+0000 7ff0ae7d4640 1 -- 172.21.15.83:0/976392769 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff0a8102ac0 msgr2=0x7ff0a8102ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:46:52.198 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.197+0000 7ff0ae7d4640 1 --2- 172.21.15.83:0/976392769 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff0a8102ac0 0x7ff0a8102ed0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7ff098009900 tx=0x7ff09802a410 comp rx=0 tx=0).stop 2024-09-21T01:46:52.198 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.197+0000 7ff0ae7d4640 1 -- 172.21.15.83:0/976392769 shutdown_connections 2024-09-21T01:46:52.198 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.197+0000 7ff0ae7d4640 1 --2- 172.21.15.83:0/976392769 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff0a8108d00 0x7ff0a810f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:46:52.198 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.197+0000 7ff0ae7d4640 1 --2- 172.21.15.83:0/976392769 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff0a81083b0 0x7ff0a81087c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:46:52.198 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.197+0000 7ff0ae7d4640 1 --2- 172.21.15.83:0/976392769 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff0a8102ac0 0x7ff0a8102ed0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:46:52.198 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.197+0000 7ff0ae7d4640 1 -- 172.21.15.83:0/976392769 >> 172.21.15.83:0/976392769 conn(0x7ff0a8079740 msgr2=0x7ff0a8079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:46:52.198 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.197+0000 7ff0ae7d4640 1 -- 172.21.15.83:0/976392769 shutdown_connections 2024-09-21T01:46:52.198 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.197+0000 7ff0ae7d4640 1 -- 172.21.15.83:0/976392769 wait complete. 2024-09-21T01:46:52.200 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.198+0000 7ff0ae7d4640 1 Processor -- start 2024-09-21T01:46:52.200 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.198+0000 7ff0ae7d4640 1 -- start start 2024-09-21T01:46:52.200 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.198+0000 7ff0ae7d4640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff0a81083b0 0x7ff0a819b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:46:52.200 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.198+0000 7ff0ae7d4640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff0a8108d00 0x7ff0a819b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:46:52.200 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.199+0000 7ff0ae7d4640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff0a819bc70 0x7ff0a81a6270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:46:52.200 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.199+0000 7ff0ae7d4640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7ff0a8112820 con 0x7ff0a8108d00 2024-09-21T01:46:52.200 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.199+0000 7ff09ffff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff0a8108d00 0x7ff0a819b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:46:52.200 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.199+0000 7ff09ffff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff0a8108d00 0x7ff0a819b730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:46276/0 (socket says 172.21.15.83:46276) 2024-09-21T01:46:52.200 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.199+0000 7ff09ffff640 1 -- 172.21.15.83:0/1068345432 learned_addr learned my addr 172.21.15.83:0/1068345432 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:46:52.201 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.199+0000 7ff0ae7d4640 1 -- 172.21.15.83:0/1068345432 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7ff0a81126a0 con 0x7ff0a81083b0 2024-09-21T01:46:52.201 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.199+0000 7ff0ae7d4640 1 -- 172.21.15.83:0/1068345432 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7ff0a81129a0 con 0x7ff0a819bc70 2024-09-21T01:46:52.201 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.199+0000 7ff0acd71640 1 --2- 172.21.15.83:0/1068345432 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff0a819bc70 0x7ff0a81a6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:46:52.201 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.199+0000 7ff0a7fff640 1 --2- 172.21.15.83:0/1068345432 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff0a81083b0 0x7ff0a819b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:46:52.201 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.199+0000 7ff09ffff640 1 -- 172.21.15.83:0/1068345432 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff0a819bc70 msgr2=0x7ff0a81a6270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:46:52.201 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.199+0000 7ff09ffff640 1 --2- 172.21.15.83:0/1068345432 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff0a819bc70 0x7ff0a81a6270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:46:52.201 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.199+0000 7ff09ffff640 1 -- 172.21.15.83:0/1068345432 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff0a81083b0 msgr2=0x7ff0a819b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:46:52.201 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.199+0000 7ff09ffff640 1 --2- 172.21.15.83:0/1068345432 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff0a81083b0 0x7ff0a819b1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:46:52.201 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.199+0000 7ff09ffff640 1 -- 172.21.15.83:0/1068345432 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0a81a69a0 con 0x7ff0a8108d00 2024-09-21T01:46:52.201 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.199+0000 7ff0acd71640 1 --2- 172.21.15.83:0/1068345432 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff0a819bc70 0x7ff0a81a6270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:46:52.201 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.199+0000 7ff09ffff640 1 --2- 172.21.15.83:0/1068345432 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff0a8108d00 0x7ff0a819b730 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7ff09000d770 tx=0x7ff09000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:46:52.201 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.200+0000 7ff0a5ffb640 1 -- 172.21.15.83:0/1068345432 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff090017070 con 0x7ff0a8108d00 2024-09-21T01:46:52.201 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.200+0000 7ff0a5ffb640 1 -- 172.21.15.83:0/1068345432 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff090009c30 con 0x7ff0a8108d00 2024-09-21T01:46:52.201 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.200+0000 7ff0ae7d4640 1 -- 172.21.15.83:0/1068345432 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0a81a6c90 con 0x7ff0a8108d00 2024-09-21T01:46:52.202 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.200+0000 7ff0a5ffb640 1 -- 172.21.15.83:0/1068345432 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff09000f620 con 0x7ff0a8108d00 2024-09-21T01:46:52.202 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.200+0000 7ff0ae7d4640 1 -- 172.21.15.83:0/1068345432 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0a81a71a0 con 0x7ff0a8108d00 2024-09-21T01:46:52.203 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.202+0000 7ff0b4d48740 1 Processor -- start 2024-09-21T01:46:52.203 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:46:51 smithi083 ceph-mon[31370]: from='client.? 172.21.15.83:0/3869448418' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:46:52.205 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.203+0000 7ff0b4d48740 1 -- start start 2024-09-21T01:46:52.205 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.203+0000 7ff0a5ffb640 1 -- 172.21.15.83:0/1068345432 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7ff09001a070 con 0x7ff0a8108d00 2024-09-21T01:46:52.205 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.203+0000 7ff0b4d48740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c52f97e840 0x55c52fd25600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:46:52.205 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.203+0000 7ff0b4d48740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c52f955980 0x55c52fd25b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:46:52.205 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.203+0000 7ff0b4d48740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c52f95db60 0x55c52fd26080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:46:52.205 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.203+0000 7ff0b4d48740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55c52fc9bb90 con 0x55c52f95db60 2024-09-21T01:46:52.205 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.203+0000 7ff0b4d48740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55c52fc8afc0 con 0x55c52f955980 2024-09-21T01:46:52.205 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.203+0000 7ff0b4d48740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55c52fc8edd0 con 0x55c52f97e840 2024-09-21T01:46:52.206 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.203+0000 7ff0a7fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c52f955980 0x55c52fd25b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:46:52.206 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.203+0000 7ff0a7fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c52f955980 0x55c52fd25b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.83:36822/0 (socket says 172.21.15.83:36822) 2024-09-21T01:46:52.206 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.203+0000 7ff0a7fff640 1 -- 172.21.15.83:0/2997818307 learned_addr learned my addr 172.21.15.83:0/2997818307 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:46:52.206 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.203+0000 7ff09ffff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c52f95db60 0x55c52fd26080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:46:52.206 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.204+0000 7ff0a7fff640 1 -- 172.21.15.83:0/2997818307 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c52f97e840 msgr2=0x55c52fd25600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:46:52.206 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.204+0000 7ff0acd71640 1 --2- 172.21.15.83:0/2997818307 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c52f97e840 0x55c52fd25600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:46:52.206 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.204+0000 7ff0a7fff640 1 --2- 172.21.15.83:0/2997818307 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c52f97e840 0x55c52fd25600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:46:52.206 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.204+0000 7ff0a7fff640 1 -- 172.21.15.83:0/2997818307 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c52f95db60 msgr2=0x55c52fd26080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:46:52.206 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.204+0000 7ff0a7fff640 1 --2- 172.21.15.83:0/2997818307 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c52f95db60 0x55c52fd26080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:46:52.206 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.204+0000 7ff0a7fff640 1 -- 172.21.15.83:0/2997818307 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c52fc12060 con 0x55c52f955980 2024-09-21T01:46:52.206 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.204+0000 7ff0acd71640 1 --2- 172.21.15.83:0/2997818307 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c52f97e840 0x55c52fd25600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:46:52.206 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.204+0000 7ff0a7fff640 1 --2- 172.21.15.83:0/2997818307 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c52f955980 0x55c52fd25b40 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff0980057c0 tx=0x7ff098032c40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=94adbee6e2ebc7d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:46:52.206 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.204+0000 7ff0a5ffb640 1 --2- 172.21.15.83:0/1068345432 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7ff0940b6700 0x7ff0940b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:46:52.207 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.205+0000 7ff09e7fc640 1 -- 172.21.15.83:0/2997818307 <== mon.2 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff09803f070 con 0x55c52f955980 2024-09-21T01:46:52.207 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.205+0000 7ff0acd71640 1 --2- 172.21.15.83:0/1068345432 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7ff0940b6700 0x7ff0940b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:46:52.207 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.205+0000 7ff09e7fc640 1 -- 172.21.15.83:0/2997818307 <== mon.2 v2:172.21.15.119:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff0980044c0 con 0x55c52f955980 2024-09-21T01:46:52.207 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.205+0000 7ff0a5ffb640 1 -- 172.21.15.83:0/1068345432 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9315+0+0 (secure 0 0 0) 0x7ff0900e75c0 con 0x7ff0a8108d00 2024-09-21T01:46:52.208 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.206+0000 7ff09e7fc640 1 -- 172.21.15.83:0/2997818307 <== mon.2 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff098035070 con 0x55c52f955980 2024-09-21T01:46:52.208 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.206+0000 7ff0b4d48740 1 -- 172.21.15.83:0/2997818307 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c52f955980 msgr2=0x55c52fd25b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:46:52.208 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.206+0000 7ff0b4d48740 1 --2- 172.21.15.83:0/2997818307 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c52f955980 0x55c52fd25b40 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff0980057c0 tx=0x7ff098032c40 comp rx=0 tx=0).stop 2024-09-21T01:46:52.208 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.206+0000 7ff0acd71640 1 --2- 172.21.15.83:0/1068345432 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7ff0940b6700 0x7ff0940b8c10 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7ff0a0005fd0 tx=0x7ff0a00095d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:46:52.208 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.206+0000 7ff0b4d48740 1 -- 172.21.15.83:0/2997818307 shutdown_connections 2024-09-21T01:46:52.208 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.206+0000 7ff0b4d48740 1 --2- 172.21.15.83:0/2997818307 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c52f95db60 0x55c52fd26080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:46:52.208 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.206+0000 7ff0b4d48740 1 --2- 172.21.15.83:0/2997818307 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c52f955980 0x55c52fd25b40 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:46:52.208 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.206+0000 7ff0b4d48740 1 --2- 172.21.15.83:0/2997818307 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c52f97e840 0x55c52fd25600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:46:52.208 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.206+0000 7ff0b4d48740 1 -- 172.21.15.83:0/2997818307 >> 172.21.15.83:0/2997818307 conn(0x55c52f972990 msgr2=0x55c52fd234f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:46:52.208 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.206+0000 7ff0b4d48740 1 -- 172.21.15.83:0/2997818307 shutdown_connections 2024-09-21T01:46:52.208 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.206+0000 7ff0b4d48740 1 -- 172.21.15.83:0/2997818307 wait complete. 2024-09-21T01:46:52.209 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.207+0000 7ff0b4d48740 1 -- start start 2024-09-21T01:46:52.209 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.207+0000 7ff0b4d48740 1 Processor -- start 2024-09-21T01:46:52.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.208+0000 7ff0b4d48740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c52f95db60 0x55c52fd35630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:46:52.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.208+0000 7ff0b4d48740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c52f97e840 0x55c52fd35b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:46:52.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.208+0000 7ff0b4d48740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c52f93d1c0 0x55c52fd41480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:46:52.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.208+0000 7ff0b4d48740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55c52faec7a0 con 0x55c52f95db60 2024-09-21T01:46:52.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.208+0000 7ff0a7fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c52f95db60 0x55c52fd35630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:46:52.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.208+0000 7ff0a7fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c52f95db60 0x55c52fd35630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:46288/0 (socket says 172.21.15.83:46288) 2024-09-21T01:46:52.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.208+0000 7ff0a7fff640 1 -- 172.21.15.83:0/1272258864 learned_addr learned my addr 172.21.15.83:0/1272258864 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:46:52.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.208+0000 7ff0b4d48740 1 -- 172.21.15.83:0/1272258864 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x55c52fc300a0 con 0x55c52f93d1c0 2024-09-21T01:46:52.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.208+0000 7ff0b4d48740 1 -- 172.21.15.83:0/1272258864 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55c52fd380d0 con 0x55c52f97e840 2024-09-21T01:46:52.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.208+0000 7ff09ffff640 1 --2- 172.21.15.83:0/1272258864 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c52f97e840 0x55c52fd35b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:46:52.212 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.208+0000 7ff0acd71640 1 --2- 172.21.15.83:0/1272258864 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c52f93d1c0 0x55c52fd41480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:46:52.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.208+0000 7ff0b4d48740 10 client.0 _ll_register_callbacks cb 0x55c52fc0d3c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:46:52.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.209+0000 7ff09ffff640 1 -- 172.21.15.83:0/1272258864 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c52f93d1c0 msgr2=0x55c52fd41480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:46:52.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.209+0000 7ff09ffff640 1 --2- 172.21.15.83:0/1272258864 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c52f93d1c0 0x55c52fd41480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:46:52.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.209+0000 7ff09ffff640 1 -- 172.21.15.83:0/1272258864 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c52f95db60 msgr2=0x55c52fd35630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:46:52.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.209+0000 7ff09ffff640 1 --2- 172.21.15.83:0/1272258864 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c52f95db60 0x55c52fd35630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:46:52.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.209+0000 7ff09ffff640 1 -- 172.21.15.83:0/1272258864 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c52fc1e880 con 0x55c52f97e840 2024-09-21T01:46:52.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.209+0000 7ff0acd71640 1 --2- 172.21.15.83:0/1272258864 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c52f93d1c0 0x55c52fd41480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:46:52.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.209+0000 7ff0a7fff640 1 --2- 172.21.15.83:0/1272258864 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c52f95db60 0x55c52fd35630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:46:52.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.209+0000 7ff09ffff640 1 --2- 172.21.15.83:0/1272258864 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c52f97e840 0x55c52fd35b70 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff0900e49f0 tx=0x7ff0900057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e95da8de62827a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:46:52.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.209+0000 7ff0877fe640 10 client.0 ms_handle_connect on v2:172.21.15.142:3300/0 2024-09-21T01:46:52.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.209+0000 7ff0877fe640 1 -- 172.21.15.83:0/1272258864 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff090021070 con 0x55c52f97e840 2024-09-21T01:46:52.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.209+0000 7ff0877fe640 1 -- 172.21.15.83:0/1272258864 <== mon.1 v2:172.21.15.142:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9315+0+0 (secure 0 0 0) 0x7ff0900e7270 con 0x55c52f97e840 2024-09-21T01:46:52.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.209+0000 7ff0b4d48740 1 -- 172.21.15.83:0/1272258864 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55c52fc9dae0 con 0x55c52f97e840 2024-09-21T01:46:52.213 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.210+0000 7ff0877fe640 1 -- 172.21.15.83:0/1272258864 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7ff0900a8f90 con 0x55c52f97e840 2024-09-21T01:46:52.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.210+0000 7ff0b4d48740 10 client.25276 fetch_fsmap learned FSMap version 21 2024-09-21T01:46:52.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.210+0000 7ff0b4d48740 1 -- 172.21.15.83:0/1272258864 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55c52f9f8b90 con 0x55c52f97e840 2024-09-21T01:46:52.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.210+0000 7ff0877fe640 1 -- 172.21.15.83:0/1272258864 <== mon.1 v2:172.21.15.142:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55c52fc9dae0 con 0x55c52f97e840 2024-09-21T01:46:52.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.211+0000 7ff0877fe640 1 -- 172.21.15.83:0/1272258864 <== mon.1 v2:172.21.15.142:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7ff0900e9bb0 con 0x55c52f97e840 2024-09-21T01:46:52.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.211+0000 7ff0b4d48740 10 client.25276 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T01:46:52.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.211+0000 7ff0b4d48740 10 client.25276 resolve_mds: validated gid 24653 aka daemon mds.b 2024-09-21T01:46:52.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.211+0000 7ff0b4d48740 20 client.25276 populate_metadata read hostname 'smithi083' 2024-09-21T01:46:52.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.211+0000 7ff0b4d48740 1 --2- 172.21.15.83:0/1272258864 >> [v2:172.21.15.119:6838/3106757092,v1:172.21.15.119:6839/3106757092] conn(0x55c52f912570 0x55c52fd47390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:46:52.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.211+0000 7ff0b4d48740 4 client.25276 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:46:52.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.211+0000 7ff0b4d48740 1 -- 172.21.15.83:0/1272258864 --> [v2:172.21.15.119:6838/3106757092,v1:172.21.15.119:6839/3106757092] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c52fc99590 con 0x55c52f912570 2024-09-21T01:46:52.214 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.211+0000 7ff0a7fff640 1 --2- 172.21.15.83:0/1272258864 >> [v2:172.21.15.119:6838/3106757092,v1:172.21.15.119:6839/3106757092] conn(0x55c52f912570 0x55c52fd47390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:46:52.215 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.212+0000 7ff0a7fff640 1 --2- 172.21.15.83:0/1272258864 >> [v2:172.21.15.119:6838/3106757092,v1:172.21.15.119:6839/3106757092] conn(0x55c52f912570 0x55c52fd47390 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5c5dd039b4ad441c server_cookie=6fafa9982c9188be in_seq=0 out_seq=0 2024-09-21T01:46:52.216 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.212+0000 7ff0877fe640 10 client.25276 ms_handle_connect on v2:172.21.15.119:6838/3106757092 2024-09-21T01:46:52.216 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.213+0000 7ff0877fe640 1 -- 172.21.15.83:0/1272258864 <== mds.0 v2:172.21.15.119:6838/3106757092 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c52fc99590 con 0x55c52f912570 2024-09-21T01:46:52.216 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.213+0000 7ff0877fe640 10 client.25276 handle_command_reply: tid=0 2024-09-21T01:46:52.216 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.213+0000 7ff0b4d48740 1 client.25276 shutdown 2024-09-21T01:46:52.216 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.213+0000 7ff0b4d48740 1 -- 172.21.15.83:0/1272258864 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c52f97e840 msgr2=0x55c52fd35b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:46:52.216 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.213+0000 7ff0b4d48740 1 --2- 172.21.15.83:0/1272258864 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c52f97e840 0x55c52fd35b70 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff0900e49f0 tx=0x7ff0900057f0 comp rx=0 tx=0).stop 2024-09-21T01:46:52.216 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.213+0000 7ff0b4d48740 1 -- 172.21.15.83:0/1272258864 shutdown_connections 2024-09-21T01:46:52.216 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.213+0000 7ff0b4d48740 1 --2- 172.21.15.83:0/1272258864 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c52f93d1c0 0x55c52fd41480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:46:52.216 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.213+0000 7ff0b4d48740 1 --2- 172.21.15.83:0/1272258864 >> [v2:172.21.15.119:6838/3106757092,v1:172.21.15.119:6839/3106757092] conn(0x55c52f912570 0x55c52fd47390 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:46:52.216 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.213+0000 7ff0b4d48740 1 --2- 172.21.15.83:0/1272258864 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c52f97e840 0x55c52fd35b70 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:46:52.216 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.213+0000 7ff0b4d48740 1 --2- 172.21.15.83:0/1272258864 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c52f95db60 0x55c52fd35630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:46:52.216 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.213+0000 7ff0877fe640 0 client.25276 ms_handle_reset on v2:172.21.15.119:6838/3106757092 2024-09-21T01:46:52.216 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.213+0000 7ff0b4d48740 1 -- 172.21.15.83:0/1272258864 >> 172.21.15.83:0/1272258864 conn(0x55c52f972990 msgr2=0x55c52fd26ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:46:52.217 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.213+0000 7ff0b4d48740 1 -- 172.21.15.83:0/1272258864 shutdown_connections 2024-09-21T01:46:52.217 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.213+0000 7ff0b4d48740 1 -- 172.21.15.83:0/1272258864 wait complete. 2024-09-21T01:46:52.217 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.213+0000 7ff0b4d48740 20 client.25276 trim_cache size 0 max 16384 2024-09-21T01:46:52.241 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.241+0000 7ff0b4d48740 1 Processor -- start 2024-09-21T01:46:52.242 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.241+0000 7ff0b4d48740 1 -- start start 2024-09-21T01:46:52.242 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.241+0000 7ff0b4d48740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c52f93d1c0 0x55c52fd236a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:46:52.242 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.242+0000 7ff0b4d48740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c52f95db60 0x55c52fd221a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:46:52.242 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.242+0000 7ff0b4d48740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c52f97e840 0x55c52fd2f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:46:52.242 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.242+0000 7ff0a7fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c52f93d1c0 0x55c52fd236a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:46:52.243 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.242+0000 7ff0b4d48740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7ff0a81ace50 con 0x55c52f93d1c0 2024-09-21T01:46:52.243 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.242+0000 7ff0a7fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c52f93d1c0 0x55c52fd236a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:46302/0 (socket says 172.21.15.83:46302) 2024-09-21T01:46:52.243 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.242+0000 7ff0a7fff640 1 -- 172.21.15.83:0/150711166 learned_addr learned my addr 172.21.15.83:0/150711166 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:46:52.243 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.242+0000 7ff0b4d48740 1 -- 172.21.15.83:0/150711166 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7ff0a81af6d0 con 0x55c52f95db60 2024-09-21T01:46:52.243 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.242+0000 7ff0b4d48740 1 -- 172.21.15.83:0/150711166 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7ff0a81ad4c0 con 0x55c52f97e840 2024-09-21T01:46:52.243 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.242+0000 7ff0acd71640 1 --2- 172.21.15.83:0/150711166 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c52f97e840 0x55c52fd2f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:46:52.243 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.242+0000 7ff09ffff640 1 --2- 172.21.15.83:0/150711166 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c52f95db60 0x55c52fd221a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:46:52.244 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.242+0000 7ff0a7fff640 1 -- 172.21.15.83:0/150711166 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c52f97e840 msgr2=0x55c52fd2f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:46:52.244 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.242+0000 7ff0a7fff640 1 --2- 172.21.15.83:0/150711166 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c52f97e840 0x55c52fd2f7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:46:52.244 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.242+0000 7ff0a7fff640 1 -- 172.21.15.83:0/150711166 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c52f95db60 msgr2=0x55c52fd221a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:46:52.245 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.242+0000 7ff0a7fff640 1 --2- 172.21.15.83:0/150711166 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c52f95db60 0x55c52fd221a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:46:52.245 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.242+0000 7ff0a7fff640 1 -- 172.21.15.83:0/150711166 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c52fd283c0 con 0x55c52f93d1c0 2024-09-21T01:46:52.245 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.242+0000 7ff09ffff640 1 --2- 172.21.15.83:0/150711166 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c52f95db60 0x55c52fd221a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:46:52.245 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.242+0000 7ff0acd71640 1 --2- 172.21.15.83:0/150711166 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c52f97e840 0x55c52fd2f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T01:46:52.245 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.243+0000 7ff0a7fff640 1 --2- 172.21.15.83:0/150711166 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c52f93d1c0 0x55c52fd236a0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7ff098005f70 tx=0x7ff098000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cfe39b31904fec9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:46:52.245 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.243+0000 7ff09dffb640 1 -- 172.21.15.83:0/150711166 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff09803f040 con 0x55c52f93d1c0 2024-09-21T01:46:52.245 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.243+0000 7ff09dffb640 1 -- 172.21.15.83:0/150711166 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff098004b50 con 0x55c52f93d1c0 2024-09-21T01:46:52.245 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.243+0000 7ff09dffb640 1 -- 172.21.15.83:0/150711166 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff098035040 con 0x55c52f93d1c0 2024-09-21T01:46:52.245 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.244+0000 7ff0b4d48740 1 -- 172.21.15.83:0/150711166 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c52f93d1c0 msgr2=0x55c52fd236a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:46:52.245 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.244+0000 7ff0b4d48740 1 --2- 172.21.15.83:0/150711166 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c52f93d1c0 0x55c52fd236a0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7ff098005f70 tx=0x7ff098000bc0 comp rx=0 tx=0).stop 2024-09-21T01:46:52.245 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.244+0000 7ff0b4d48740 1 -- 172.21.15.83:0/150711166 shutdown_connections 2024-09-21T01:46:52.245 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.244+0000 7ff0b4d48740 1 --2- 172.21.15.83:0/150711166 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c52f97e840 0x55c52fd2f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:46:52.245 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.244+0000 7ff0b4d48740 1 --2- 172.21.15.83:0/150711166 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c52f95db60 0x55c52fd221a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:46:52.246 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.244+0000 7ff0b4d48740 1 --2- 172.21.15.83:0/150711166 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c52f93d1c0 0x55c52fd236a0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:46:52.246 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.244+0000 7ff0b4d48740 1 -- 172.21.15.83:0/150711166 >> 172.21.15.83:0/150711166 conn(0x55c52f972990 msgr2=0x55c52fd21a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:46:52.246 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.244+0000 7ff0b4d48740 1 -- 172.21.15.83:0/150711166 shutdown_connections 2024-09-21T01:46:52.246 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.244+0000 7ff0b4d48740 1 -- 172.21.15.83:0/150711166 wait complete. 2024-09-21T01:46:52.248 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.245+0000 7ff0b4d48740 1 -- start start 2024-09-21T01:46:52.248 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.245+0000 7ff0b4d48740 1 Processor -- start 2024-09-21T01:46:52.248 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.245+0000 7ff0b4d48740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c52f93d1c0 0x55c52fd2d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:46:52.248 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.245+0000 7ff0b4d48740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c52f95db60 0x55c52fd2d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:46:52.248 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.245+0000 7ff0b4d48740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c52f97e840 0x55c52fd3d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:46:52.249 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.245+0000 7ff0b4d48740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7ff0a81adb90 con 0x55c52f97e840 2024-09-21T01:46:52.249 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.246+0000 7ff0b4d48740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7ff0a81af000 con 0x55c52f93d1c0 2024-09-21T01:46:52.249 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.246+0000 7ff0acd71640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c52f97e840 0x55c52fd3d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:46:52.249 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.246+0000 7ff0b4d48740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7ff0a81ae260 con 0x55c52f95db60 2024-09-21T01:46:52.249 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.246+0000 7ff0acd71640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c52f97e840 0x55c52fd3d3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:46308/0 (socket says 172.21.15.83:46308) 2024-09-21T01:46:52.249 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.246+0000 7ff0a7fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c52f93d1c0 0x55c52fd2d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:46:52.249 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.246+0000 7ff0acd71640 1 -- 172.21.15.83:0/3361552003 learned_addr learned my addr 172.21.15.83:0/3361552003 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:46:52.249 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.246+0000 7ff0b4d48740 10 client.0 _ll_register_callbacks cb 0x7ff0900b4f50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:46:52.249 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.246+0000 7ff09ffff640 1 --2- 172.21.15.83:0/3361552003 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c52f95db60 0x55c52fd2d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:46:52.249 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.246+0000 7ff0acd71640 1 -- 172.21.15.83:0/3361552003 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c52f95db60 msgr2=0x55c52fd2d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:46:52.249 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.246+0000 7ff0acd71640 1 --2- 172.21.15.83:0/3361552003 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c52f95db60 0x55c52fd2d9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:46:52.249 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.246+0000 7ff0acd71640 1 -- 172.21.15.83:0/3361552003 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c52f93d1c0 msgr2=0x55c52fd2d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:46:52.249 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.246+0000 7ff0acd71640 1 --2- 172.21.15.83:0/3361552003 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c52f93d1c0 0x55c52fd2d4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:46:52.250 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.246+0000 7ff0acd71640 1 -- 172.21.15.83:0/3361552003 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c52fd3d920 con 0x55c52f97e840 2024-09-21T01:46:52.250 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.246+0000 7ff0acd71640 1 --2- 172.21.15.83:0/3361552003 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c52f97e840 0x55c52fd3d3e0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7ff0a0012e30 tx=0x7ff0a0004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9adb3b2ef2e4c93 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:46:52.250 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.246+0000 7ff0877fe640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-09-21T01:46:52.250 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.246+0000 7ff0877fe640 1 -- 172.21.15.83:0/3361552003 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0a001f630 con 0x55c52f97e840 2024-09-21T01:46:52.250 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.246+0000 7ff0877fe640 1 -- 172.21.15.83:0/3361552003 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9315+0+0 (secure 0 0 0) 0x7ff0a001f7d0 con 0x55c52f97e840 2024-09-21T01:46:52.250 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.246+0000 7ff0b4d48740 1 -- 172.21.15.83:0/3361552003 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff098004b50 con 0x55c52f97e840 2024-09-21T01:46:52.250 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.247+0000 7ff0877fe640 1 -- 172.21.15.83:0/3361552003 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7ff0a0004b20 con 0x55c52f97e840 2024-09-21T01:46:52.250 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.247+0000 7ff0b4d48740 10 client.15717 fetch_fsmap learned FSMap version 21 2024-09-21T01:46:52.250 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.247+0000 7ff0b4d48740 1 -- 172.21.15.83:0/3361552003 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55c52fdb6dd0 con 0x55c52f97e840 2024-09-21T01:46:52.250 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.247+0000 7ff0877fe640 1 -- 172.21.15.83:0/3361552003 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff098004b50 con 0x55c52f97e840 2024-09-21T01:46:52.250 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.247+0000 7ff0877fe640 1 -- 172.21.15.83:0/3361552003 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7ff0a000f040 con 0x55c52f97e840 2024-09-21T01:46:52.250 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.247+0000 7ff0b4d48740 10 client.15717 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T01:46:52.250 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.247+0000 7ff0b4d48740 10 client.15717 resolve_mds: validated gid 24653 aka daemon mds.b 2024-09-21T01:46:52.251 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.247+0000 7ff0b4d48740 20 client.15717 populate_metadata read hostname 'smithi083' 2024-09-21T01:46:52.251 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.247+0000 7ff0b4d48740 1 --2- 172.21.15.83:0/3361552003 >> [v2:172.21.15.119:6838/3106757092,v1:172.21.15.119:6839/3106757092] conn(0x55c52fdb7670 0x55c52fdb9a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:46:52.251 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.247+0000 7ff0b4d48740 4 client.15717 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 130.0, "await_for": 45.0}] 2024-09-21T01:46:52.251 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.247+0000 7ff0b4d48740 1 -- 172.21.15.83:0/3361552003 --> [v2:172.21.15.119:6838/3106757092,v1:172.21.15.119:6839/3106757092] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 130.0, "await_for": 45.0}) -- 0x55c52fc969c0 con 0x55c52fdb7670 2024-09-21T01:46:52.251 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.248+0000 7ff0a7fff640 1 --2- 172.21.15.83:0/3361552003 >> [v2:172.21.15.119:6838/3106757092,v1:172.21.15.119:6839/3106757092] conn(0x55c52fdb7670 0x55c52fdb9a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:46:52.251 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.248+0000 7ff0877fe640 10 client.15717 ms_handle_connect on v2:172.21.15.119:6838/3106757092 2024-09-21T01:46:52.251 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.248+0000 7ff0a7fff640 1 --2- 172.21.15.83:0/3361552003 >> [v2:172.21.15.119:6838/3106757092,v1:172.21.15.119:6839/3106757092] conn(0x55c52fdb7670 0x55c52fdb9a90 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6fe0179e82deaa51 server_cookie=f3b015198bb5f1f8 in_seq=0 out_seq=0 2024-09-21T01:46:52.251 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:46:52.464 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:46:51 smithi142 ceph-mon[34050]: from='client.? 172.21.15.83:0/3869448418' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:46:52.467 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:46:51 smithi119 ceph-mon[33693]: from='client.? 172.21.15.83:0/3869448418' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:46:52.733 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.726+0000 7fc42bb38640 1 -- 172.21.15.83:0/1371282578 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc4241020f0 msgr2=0x7fc424102500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:46:52.733 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.726+0000 7fc42bb38640 1 --2- 172.21.15.83:0/1371282578 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc4241020f0 0x7fc424102500 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fc420009900 tx=0x7fc42002a410 comp rx=0 tx=0).stop 2024-09-21T01:46:52.733 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.726+0000 7fc42bb38640 1 -- 172.21.15.83:0/1371282578 shutdown_connections 2024-09-21T01:46:52.733 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.726+0000 7fc42bb38640 1 --2- 172.21.15.83:0/1371282578 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc424107c40 0x7fc424110660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:46:52.733 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.726+0000 7fc42bb38640 1 --2- 172.21.15.83:0/1371282578 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc4241072f0 0x7fc424107700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:46:52.733 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.726+0000 7fc42bb38640 1 --2- 172.21.15.83:0/1371282578 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc4241020f0 0x7fc424102500 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:46:52.734 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.726+0000 7fc42bb38640 1 -- 172.21.15.83:0/1371282578 >> 172.21.15.83:0/1371282578 conn(0x7fc424079e30 msgr2=0x7fc42407a240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:46:52.734 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.726+0000 7fc42bb38640 1 -- 172.21.15.83:0/1371282578 shutdown_connections 2024-09-21T01:46:52.734 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.726+0000 7fc42bb38640 1 -- 172.21.15.83:0/1371282578 wait complete. 2024-09-21T01:46:52.734 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.727+0000 7fc42bb38640 1 Processor -- start 2024-09-21T01:46:52.734 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.727+0000 7fc42bb38640 1 -- start start 2024-09-21T01:46:52.734 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.727+0000 7fc42bb38640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc4241020f0 0x7fc42419a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:46:52.734 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.727+0000 7fc42bb38640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc4241072f0 0x7fc42419a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:46:52.734 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.727+0000 7fc42bb38640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc424107c40 0x7fc42419fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:46:52.734 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.727+0000 7fc42bb38640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fc4241139a0 con 0x7fc4241020f0 2024-09-21T01:46:52.734 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.727+0000 7fc42bb38640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fc424113820 con 0x7fc4241072f0 2024-09-21T01:46:52.734 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.727+0000 7fc42bb38640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fc424113b20 con 0x7fc424107c40 2024-09-21T01:46:52.735 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.727+0000 7fc4298d4640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc4241020f0 0x7fc42419a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:46:52.735 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.727+0000 7fc4298d4640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc4241020f0 0x7fc42419a450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:46322/0 (socket says 172.21.15.83:46322) 2024-09-21T01:46:52.735 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.727+0000 7fc4298d4640 1 -- 172.21.15.83:0/745727859 learned_addr learned my addr 172.21.15.83:0/745727859 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:46:52.735 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.727+0000 7fc4290d3640 1 --2- 172.21.15.83:0/745727859 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc4241072f0 0x7fc42419a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:46:52.735 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.727+0000 7fc42a0d5640 1 --2- 172.21.15.83:0/745727859 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc424107c40 0x7fc42419fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:46:52.735 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.727+0000 7fc4298d4640 1 -- 172.21.15.83:0/745727859 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc424107c40 msgr2=0x7fc42419fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:46:52.735 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.728+0000 7fc4298d4640 1 --2- 172.21.15.83:0/745727859 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc424107c40 0x7fc42419fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:46:52.735 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.728+0000 7fc4298d4640 1 -- 172.21.15.83:0/745727859 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc4241072f0 msgr2=0x7fc42419a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:46:52.735 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.728+0000 7fc4298d4640 1 --2- 172.21.15.83:0/745727859 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc4241072f0 0x7fc42419a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:46:52.735 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.728+0000 7fc4298d4640 1 -- 172.21.15.83:0/745727859 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4241a03c0 con 0x7fc4241020f0 2024-09-21T01:46:52.735 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.728+0000 7fc42a0d5640 1 --2- 172.21.15.83:0/745727859 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc424107c40 0x7fc42419fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:46:52.736 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.728+0000 7fc4290d3640 1 --2- 172.21.15.83:0/745727859 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc4241072f0 0x7fc42419a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:46:52.736 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.728+0000 7fc4298d4640 1 --2- 172.21.15.83:0/745727859 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc4241020f0 0x7fc42419a450 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fc420009230 tx=0x7fc420004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:46:52.736 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.728+0000 7fc41affd640 1 -- 172.21.15.83:0/745727859 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc42003f030 con 0x7fc4241020f0 2024-09-21T01:46:52.736 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.728+0000 7fc41affd640 1 -- 172.21.15.83:0/745727859 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc420003a80 con 0x7fc4241020f0 2024-09-21T01:46:52.736 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.728+0000 7fc42bb38640 1 -- 172.21.15.83:0/745727859 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4241a0650 con 0x7fc4241020f0 2024-09-21T01:46:52.736 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.728+0000 7fc41affd640 1 -- 172.21.15.83:0/745727859 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc420035070 con 0x7fc4241020f0 2024-09-21T01:46:52.736 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.728+0000 7fc42bb38640 1 -- 172.21.15.83:0/745727859 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4241a6e10 con 0x7fc4241020f0 2024-09-21T01:46:52.736 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.730+0000 7fc4320ac740 1 Processor -- start 2024-09-21T01:46:52.736 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.731+0000 7fc4320ac740 1 -- start start 2024-09-21T01:46:52.736 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.731+0000 7fc41affd640 1 -- 172.21.15.83:0/745727859 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7fc420042030 con 0x7fc4241020f0 2024-09-21T01:46:52.736 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.731+0000 7fc4320ac740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5645f15472d0 0x5645f18ee310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:46:52.736 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.731+0000 7fc4320ac740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5645f151e410 0x5645f18ee850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:46:52.737 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.731+0000 7fc4320ac740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5645f15265f0 0x5645f18eed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:46:52.737 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.731+0000 7fc4320ac740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x5645f1864dd0 con 0x5645f151e410 2024-09-21T01:46:52.737 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.731+0000 7fc4320ac740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5645f1854200 con 0x5645f15265f0 2024-09-21T01:46:52.737 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.731+0000 7fc4320ac740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x5645f1858010 con 0x5645f15472d0 2024-09-21T01:46:52.737 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.731+0000 7fc4298d4640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5645f151e410 0x5645f18ee850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:46:52.737 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.731+0000 7fc4298d4640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5645f151e410 0x5645f18ee850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:46334/0 (socket says 172.21.15.83:46334) 2024-09-21T01:46:52.737 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.731+0000 7fc4298d4640 1 -- 172.21.15.83:0/3278574817 learned_addr learned my addr 172.21.15.83:0/3278574817 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:46:52.737 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.731+0000 7fc4290d3640 1 --2- 172.21.15.83:0/3278574817 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5645f15265f0 0x5645f18eed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:46:52.737 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.731+0000 7fc42a0d5640 1 --2- 172.21.15.83:0/3278574817 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5645f15472d0 0x5645f18ee310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:46:52.737 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.731+0000 7fc4298d4640 1 -- 172.21.15.83:0/3278574817 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5645f15472d0 msgr2=0x5645f18ee310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:46:52.737 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.731+0000 7fc4298d4640 1 --2- 172.21.15.83:0/3278574817 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5645f15472d0 0x5645f18ee310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:46:52.737 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.731+0000 7fc4298d4640 1 -- 172.21.15.83:0/3278574817 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5645f15265f0 msgr2=0x5645f18eed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:46:52.737 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.731+0000 7fc4298d4640 1 --2- 172.21.15.83:0/3278574817 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5645f15265f0 0x5645f18eed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:46:52.737 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.731+0000 7fc4298d4640 1 -- 172.21.15.83:0/3278574817 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5645f15b28b0 con 0x5645f151e410 2024-09-21T01:46:52.738 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.732+0000 7fc41affd640 1 --2- 172.21.15.83:0/745727859 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fc4100b6700 0x7fc4100b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:46:52.738 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.732+0000 7fc4298d4640 1 --2- 172.21.15.83:0/3278574817 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5645f151e410 0x5645f18ee850 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fc420105530 tx=0x7fc4201105c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97aa75419148d08c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:46:52.738 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.732+0000 7fc42a0d5640 1 --2- 172.21.15.83:0/745727859 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fc4100b6700 0x7fc4100b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:46:52.738 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.732+0000 7fc41affd640 1 -- 172.21.15.83:0/745727859 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9315+0+0 (secure 0 0 0) 0x7fc4201081c0 con 0x7fc4241020f0 2024-09-21T01:46:52.738 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.732+0000 7fc40ffff640 1 -- 172.21.15.83:0/3278574817 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4200ca340 con 0x5645f151e410 2024-09-21T01:46:52.738 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.732+0000 7fc40ffff640 1 -- 172.21.15.83:0/3278574817 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc4200cd800 con 0x5645f151e410 2024-09-21T01:46:52.738 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.732+0000 7fc40ffff640 1 -- 172.21.15.83:0/3278574817 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4200cd460 con 0x5645f151e410 2024-09-21T01:46:52.743 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.733+0000 7fc4320ac740 1 -- 172.21.15.83:0/3278574817 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5645f151e410 msgr2=0x5645f18ee850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:46:52.743 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.733+0000 7fc42a0d5640 1 --2- 172.21.15.83:0/745727859 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fc4100b6700 0x7fc4100b8c10 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fc41c005fd0 tx=0x7fc41c009700 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:46:52.743 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.733+0000 7fc4320ac740 1 --2- 172.21.15.83:0/3278574817 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5645f151e410 0x5645f18ee850 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fc420105530 tx=0x7fc4201105c0 comp rx=0 tx=0).stop 2024-09-21T01:46:52.743 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.733+0000 7fc4320ac740 1 -- 172.21.15.83:0/3278574817 shutdown_connections 2024-09-21T01:46:52.743 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.733+0000 7fc4320ac740 1 --2- 172.21.15.83:0/3278574817 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5645f15265f0 0x5645f18eed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:46:52.743 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.733+0000 7fc4320ac740 1 --2- 172.21.15.83:0/3278574817 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5645f151e410 0x5645f18ee850 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:46:52.743 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.733+0000 7fc4320ac740 1 --2- 172.21.15.83:0/3278574817 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5645f15472d0 0x5645f18ee310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:46:52.743 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.733+0000 7fc4320ac740 1 -- 172.21.15.83:0/3278574817 >> 172.21.15.83:0/3278574817 conn(0x5645f153b6c0 msgr2=0x5645f18ec200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:46:52.744 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.733+0000 7fc4320ac740 1 -- 172.21.15.83:0/3278574817 shutdown_connections 2024-09-21T01:46:52.744 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.733+0000 7fc4320ac740 1 -- 172.21.15.83:0/3278574817 wait complete. 2024-09-21T01:46:52.744 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.734+0000 7fc4320ac740 1 -- start start 2024-09-21T01:46:52.744 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.734+0000 7fc4320ac740 1 Processor -- start 2024-09-21T01:46:52.744 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.734+0000 7fc4320ac740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5645f151e410 0x5645f18fe350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:46:52.744 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.734+0000 7fc4320ac740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5645f15265f0 0x5645f18fe8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:46:52.744 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.734+0000 7fc4320ac740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5645f15472d0 0x5645f1909e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:46:52.744 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.734+0000 7fc4320ac740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x5645f16b5810 con 0x5645f15472d0 2024-09-21T01:46:52.744 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.734+0000 7fc4320ac740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x5645f17ef080 con 0x5645f151e410 2024-09-21T01:46:52.744 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.734+0000 7fc4320ac740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x5645f1900be0 con 0x5645f15265f0 2024-09-21T01:46:52.744 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.734+0000 7fc4320ac740 10 client.0 _ll_register_callbacks cb 0x5645f17ff960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:46:52.744 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.735+0000 7fc42a0d5640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5645f15472d0 0x5645f1909e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:46:52.744 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.735+0000 7fc4290d3640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5645f15265f0 0x5645f18fe8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:46:52.745 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.735+0000 7fc42a0d5640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5645f15472d0 0x5645f1909e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:46344/0 (socket says 172.21.15.83:46344) 2024-09-21T01:46:52.745 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.735+0000 7fc42a0d5640 1 -- 172.21.15.83:0/1129142443 learned_addr learned my addr 172.21.15.83:0/1129142443 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:46:52.745 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.735+0000 7fc4298d4640 1 --2- 172.21.15.83:0/1129142443 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5645f151e410 0x5645f18fe350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:46:52.745 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.735+0000 7fc42a0d5640 1 -- 172.21.15.83:0/1129142443 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5645f15265f0 msgr2=0x5645f18fe8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:46:52.745 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.735+0000 7fc42a0d5640 1 --2- 172.21.15.83:0/1129142443 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5645f15265f0 0x5645f18fe8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:46:52.745 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.735+0000 7fc42a0d5640 1 -- 172.21.15.83:0/1129142443 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5645f151e410 msgr2=0x5645f18fe350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:46:52.745 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.735+0000 7fc42a0d5640 1 --2- 172.21.15.83:0/1129142443 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5645f151e410 0x5645f18fe350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:46:52.745 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.735+0000 7fc42a0d5640 1 -- 172.21.15.83:0/1129142443 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5645f17f9460 con 0x5645f15472d0 2024-09-21T01:46:52.745 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.735+0000 7fc42a0d5640 1 --2- 172.21.15.83:0/1129142443 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5645f15472d0 0x5645f1909e90 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fc41c013fd0 tx=0x7fc41c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0a50539a1634537 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:46:52.745 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.735+0000 7fc40d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-09-21T01:46:52.745 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.735+0000 7fc40d7fa640 1 -- 172.21.15.83:0/1129142443 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc41c01e6d0 con 0x5645f15472d0 2024-09-21T01:46:52.745 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.735+0000 7fc40d7fa640 1 -- 172.21.15.83:0/1129142443 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9315+0+0 (secure 0 0 0) 0x7fc41c01e870 con 0x5645f15472d0 2024-09-21T01:46:52.745 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.735+0000 7fc4320ac740 1 -- 172.21.15.83:0/1129142443 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc4200cd800 con 0x5645f15472d0 2024-09-21T01:46:52.745 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.736+0000 7fc40d7fa640 1 -- 172.21.15.83:0/1129142443 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fc41c01ea70 con 0x5645f15472d0 2024-09-21T01:46:52.746 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.736+0000 7fc4320ac740 10 client.15729 fetch_fsmap learned FSMap version 21 2024-09-21T01:46:52.746 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.736+0000 7fc4320ac740 1 -- 172.21.15.83:0/1129142443 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5645f190cc90 con 0x5645f15472d0 2024-09-21T01:46:52.746 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.736+0000 7fc40d7fa640 1 -- 172.21.15.83:0/1129142443 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc4200cd800 con 0x5645f15472d0 2024-09-21T01:46:52.746 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.736+0000 7fc40d7fa640 1 -- 172.21.15.83:0/1129142443 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fc41c027c90 con 0x5645f15472d0 2024-09-21T01:46:52.746 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.736+0000 7fc4320ac740 10 client.15729 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T01:46:52.746 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.736+0000 7fc4320ac740 10 client.15729 resolve_mds: validated gid 24653 aka daemon mds.b 2024-09-21T01:46:52.746 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.736+0000 7fc4320ac740 20 client.15729 populate_metadata read hostname 'smithi083' 2024-09-21T01:46:52.746 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.736+0000 7fc4320ac740 1 --2- 172.21.15.83:0/1129142443 >> [v2:172.21.15.119:6838/3106757092,v1:172.21.15.119:6839/3106757092] conn(0x5645f1505c50 0x5645f19102c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:46:52.746 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.736+0000 7fc4320ac740 4 client.15729 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T01:46:52.746 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.736+0000 7fc4320ac740 1 -- 172.21.15.83:0/1129142443 --> [v2:172.21.15.119:6838/3106757092,v1:172.21.15.119:6839/3106757092] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5645f1866d20 con 0x5645f1505c50 2024-09-21T01:46:52.746 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.736+0000 7fc4298d4640 1 --2- 172.21.15.83:0/1129142443 >> [v2:172.21.15.119:6838/3106757092,v1:172.21.15.119:6839/3106757092] conn(0x5645f1505c50 0x5645f19102c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:46:52.746 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.737+0000 7fc40d7fa640 10 client.15729 ms_handle_connect on v2:172.21.15.119:6838/3106757092 2024-09-21T01:46:52.746 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.737+0000 7fc4298d4640 1 --2- 172.21.15.83:0/1129142443 >> [v2:172.21.15.119:6838/3106757092,v1:172.21.15.119:6839/3106757092] conn(0x5645f1505c50 0x5645f19102c0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=89112a42679896dd server_cookie=a7931da9b8b70893 in_seq=0 out_seq=0 2024-09-21T01:46:52.747 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.738+0000 7fc40d7fa640 1 -- 172.21.15.83:0/1129142443 <== mds.0 v2:172.21.15.119:6838/3106757092 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5645f1866d20 con 0x5645f1505c50 2024-09-21T01:46:52.747 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.738+0000 7fc40d7fa640 10 client.15729 handle_command_reply: tid=0 2024-09-21T01:46:52.747 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.738+0000 7fc4320ac740 1 client.15729 shutdown 2024-09-21T01:46:52.747 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.738+0000 7fc4320ac740 1 -- 172.21.15.83:0/1129142443 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5645f15472d0 msgr2=0x5645f1909e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:46:52.747 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.738+0000 7fc4320ac740 1 --2- 172.21.15.83:0/1129142443 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5645f15472d0 0x5645f1909e90 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fc41c013fd0 tx=0x7fc41c004a40 comp rx=0 tx=0).stop 2024-09-21T01:46:52.747 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.738+0000 7fc4320ac740 1 -- 172.21.15.83:0/1129142443 shutdown_connections 2024-09-21T01:46:52.747 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.738+0000 7fc4320ac740 1 --2- 172.21.15.83:0/1129142443 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5645f15472d0 0x5645f1909e90 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:46:52.747 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.738+0000 7fc4320ac740 1 --2- 172.21.15.83:0/1129142443 >> [v2:172.21.15.119:6838/3106757092,v1:172.21.15.119:6839/3106757092] conn(0x5645f1505c50 0x5645f19102c0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:46:52.747 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.738+0000 7fc4320ac740 1 --2- 172.21.15.83:0/1129142443 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5645f15265f0 0x5645f18fe8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:46:52.747 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.738+0000 7fc4320ac740 1 --2- 172.21.15.83:0/1129142443 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5645f151e410 0x5645f18fe350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:46:52.747 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.738+0000 7fc40d7fa640 0 client.15729 ms_handle_reset on v2:172.21.15.119:6838/3106757092 2024-09-21T01:46:52.747 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.738+0000 7fc4320ac740 1 -- 172.21.15.83:0/1129142443 >> 172.21.15.83:0/1129142443 conn(0x5645f153b6c0 msgr2=0x5645f18f1460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:46:52.747 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.738+0000 7fc4320ac740 1 -- 172.21.15.83:0/1129142443 shutdown_connections 2024-09-21T01:46:52.747 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.738+0000 7fc4320ac740 1 -- 172.21.15.83:0/1129142443 wait complete. 2024-09-21T01:46:52.748 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.738+0000 7fc4320ac740 20 client.15729 trim_cache size 0 max 16384 2024-09-21T01:46:52.756 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.755+0000 7fc4320ac740 1 Processor -- start 2024-09-21T01:46:52.756 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.755+0000 7fc4320ac740 1 -- start start 2024-09-21T01:46:52.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.755+0000 7fc4320ac740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5645f151e410 0x5645f18ee200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:46:52.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.755+0000 7fc4320ac740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5645f15265f0 0x5645f18ee740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:46:52.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.755+0000 7fc4320ac740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5645f15472d0 0x5645f190a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:46:52.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.755+0000 7fc4320ac740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fc4241aca10 con 0x5645f151e410 2024-09-21T01:46:52.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.755+0000 7fc4320ac740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fc4241af290 con 0x5645f15472d0 2024-09-21T01:46:52.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.755+0000 7fc4320ac740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fc4241ad080 con 0x5645f15265f0 2024-09-21T01:46:52.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.756+0000 7fc4298d4640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5645f151e410 0x5645f18ee200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:46:52.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.756+0000 7fc4298d4640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5645f151e410 0x5645f18ee200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:46354/0 (socket says 172.21.15.83:46354) 2024-09-21T01:46:52.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.756+0000 7fc4298d4640 1 -- 172.21.15.83:0/3876925960 learned_addr learned my addr 172.21.15.83:0/3876925960 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:46:52.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.756+0000 7fc4290d3640 1 --2- 172.21.15.83:0/3876925960 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5645f15265f0 0x5645f18ee740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:46:52.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.756+0000 7fc4298d4640 1 -- 172.21.15.83:0/3876925960 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5645f15265f0 msgr2=0x5645f18ee740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:46:52.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.756+0000 7fc4298d4640 1 --2- 172.21.15.83:0/3876925960 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5645f15265f0 0x5645f18ee740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:46:52.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.756+0000 7fc4298d4640 1 -- 172.21.15.83:0/3876925960 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5645f15472d0 msgr2=0x5645f190a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:46:52.758 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.756+0000 7fc42a0d5640 1 --2- 172.21.15.83:0/3876925960 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5645f15472d0 0x5645f190a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:46:52.758 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.756+0000 7fc4298d4640 1 --2- 172.21.15.83:0/3876925960 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5645f15472d0 0x5645f190a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:46:52.758 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.756+0000 7fc4298d4640 1 -- 172.21.15.83:0/3876925960 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5645f18ff020 con 0x5645f151e410 2024-09-21T01:46:52.758 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.756+0000 7fc42a0d5640 1 --2- 172.21.15.83:0/3876925960 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5645f15472d0 0x5645f190a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:46:52.758 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.756+0000 7fc4298d4640 1 --2- 172.21.15.83:0/3876925960 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5645f151e410 0x5645f18ee200 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fc420105bf0 tx=0x7fc420005c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb2f333de2e0ead4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:46:52.758 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.756+0000 7fc40f7fe640 1 -- 172.21.15.83:0/3876925960 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc420049040 con 0x5645f151e410 2024-09-21T01:46:52.758 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.756+0000 7fc40f7fe640 1 -- 172.21.15.83:0/3876925960 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc42010bbc0 con 0x5645f151e410 2024-09-21T01:46:52.758 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.756+0000 7fc40f7fe640 1 -- 172.21.15.83:0/3876925960 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4200cd640 con 0x5645f151e410 2024-09-21T01:46:52.761 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.757+0000 7fc4320ac740 1 -- 172.21.15.83:0/3876925960 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5645f151e410 msgr2=0x5645f18ee200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:46:52.761 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.757+0000 7fc4320ac740 1 --2- 172.21.15.83:0/3876925960 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5645f151e410 0x5645f18ee200 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fc420105bf0 tx=0x7fc420005c90 comp rx=0 tx=0).stop 2024-09-21T01:46:52.761 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.757+0000 7fc4320ac740 1 -- 172.21.15.83:0/3876925960 shutdown_connections 2024-09-21T01:46:52.761 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.757+0000 7fc4320ac740 1 --2- 172.21.15.83:0/3876925960 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5645f15472d0 0x5645f190a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:46:52.762 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.757+0000 7fc4320ac740 1 --2- 172.21.15.83:0/3876925960 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5645f15265f0 0x5645f18ee740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:46:52.762 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.757+0000 7fc4320ac740 1 --2- 172.21.15.83:0/3876925960 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5645f151e410 0x5645f18ee200 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:46:52.762 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.757+0000 7fc4320ac740 1 -- 172.21.15.83:0/3876925960 >> 172.21.15.83:0/3876925960 conn(0x5645f153b6c0 msgr2=0x5645f18fc9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:46:52.762 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.757+0000 7fc4320ac740 1 -- 172.21.15.83:0/3876925960 shutdown_connections 2024-09-21T01:46:52.762 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.757+0000 7fc4320ac740 1 -- 172.21.15.83:0/3876925960 wait complete. 2024-09-21T01:46:52.762 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.757+0000 7fc4320ac740 1 -- start start 2024-09-21T01:46:52.762 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.757+0000 7fc4320ac740 1 Processor -- start 2024-09-21T01:46:52.762 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.758+0000 7fc4320ac740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5645f151e410 0x5645f1901e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:46:52.762 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.758+0000 7fc4320ac740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5645f15265f0 0x5645f1902340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:46:52.762 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.758+0000 7fc4320ac740 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5645f15472d0 0x5645f1902880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:46:52.762 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.758+0000 7fc4320ac740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fc4241ad750 con 0x5645f15265f0 2024-09-21T01:46:52.762 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.758+0000 7fc4320ac740 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fc4241aebc0 con 0x5645f15472d0 2024-09-21T01:46:52.763 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.758+0000 7fc4320ac740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fc4241ade20 con 0x5645f151e410 2024-09-21T01:46:52.763 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.758+0000 7fc4320ac740 10 client.0 _ll_register_callbacks cb 0x7fc41c010630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T01:46:52.763 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.758+0000 7fc4290d3640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5645f15265f0 0x5645f1902340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:46:52.763 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.758+0000 7fc4290d3640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5645f15265f0 0x5645f1902340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:46366/0 (socket says 172.21.15.83:46366) 2024-09-21T01:46:52.763 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.758+0000 7fc4290d3640 1 -- 172.21.15.83:0/1713710581 learned_addr learned my addr 172.21.15.83:0/1713710581 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:46:52.763 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.758+0000 7fc42a0d5640 1 --2- 172.21.15.83:0/1713710581 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5645f15472d0 0x5645f1902880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:46:52.763 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.758+0000 7fc4298d4640 1 --2- 172.21.15.83:0/1713710581 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5645f151e410 0x5645f1901e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:46:52.763 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.758+0000 7fc4290d3640 1 -- 172.21.15.83:0/1713710581 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5645f151e410 msgr2=0x5645f1901e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:46:52.763 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.758+0000 7fc4290d3640 1 --2- 172.21.15.83:0/1713710581 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5645f151e410 0x5645f1901e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:46:52.763 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.758+0000 7fc4290d3640 1 -- 172.21.15.83:0/1713710581 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5645f15472d0 msgr2=0x5645f1902880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T01:46:52.763 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.758+0000 7fc4290d3640 1 --2- 172.21.15.83:0/1713710581 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5645f15472d0 0x5645f1902880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:46:52.763 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.758+0000 7fc4290d3640 1 -- 172.21.15.83:0/1713710581 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5645f1979cc0 con 0x5645f15265f0 2024-09-21T01:46:52.763 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.759+0000 7fc4290d3640 1 --2- 172.21.15.83:0/1713710581 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5645f15265f0 0x5645f1902340 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fc41400f810 tx=0x7fc41400fcd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c82c502409d4f439 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:46:52.764 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.759+0000 7fc40d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.83:3300/0 2024-09-21T01:46:52.764 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.759+0000 7fc40d7fa640 1 -- 172.21.15.83:0/1713710581 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc41401f060 con 0x5645f15265f0 2024-09-21T01:46:52.764 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.759+0000 7fc40d7fa640 1 -- 172.21.15.83:0/1713710581 <== mon.0 v2:172.21.15.83:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 9315+0+0 (secure 0 0 0) 0x7fc41400ede0 con 0x5645f15265f0 2024-09-21T01:46:52.764 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.759+0000 7fc4320ac740 1 -- 172.21.15.83:0/1713710581 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc42010bbc0 con 0x5645f15265f0 2024-09-21T01:46:52.764 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.759+0000 7fc40d7fa640 1 -- 172.21.15.83:0/1713710581 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fc414026050 con 0x5645f15265f0 2024-09-21T01:46:52.764 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.759+0000 7fc4320ac740 10 client.15735 fetch_fsmap learned FSMap version 21 2024-09-21T01:46:52.764 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.759+0000 7fc4320ac740 1 -- 172.21.15.83:0/1713710581 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5645f197af60 con 0x5645f15265f0 2024-09-21T01:46:52.764 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.759+0000 7fc40d7fa640 1 -- 172.21.15.83:0/1713710581 <== mon.0 v2:172.21.15.83:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc42010bbc0 con 0x5645f15265f0 2024-09-21T01:46:52.764 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.759+0000 7fc40d7fa640 1 -- 172.21.15.83:0/1713710581 <== mon.0 v2:172.21.15.83:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fc41400d430 con 0x5645f15265f0 2024-09-21T01:46:52.764 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.759+0000 7fc4320ac740 10 client.15735 fetch_fsmap finished waiting for FSMap version 21 2024-09-21T01:46:52.764 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.759+0000 7fc4320ac740 10 client.15735 resolve_mds: validated gid 24653 aka daemon mds.b 2024-09-21T01:46:52.764 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.759+0000 7fc4320ac740 20 client.15735 populate_metadata read hostname 'smithi083' 2024-09-21T01:46:52.764 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.759+0000 7fc4320ac740 1 --2- 172.21.15.83:0/1713710581 >> [v2:172.21.15.119:6838/3106757092,v1:172.21.15.119:6839/3106757092] conn(0x5645f14db000 0x5645f197d780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:46:52.765 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.759+0000 7fc4320ac740 4 client.15735 mds_command: new command op to 24653 tid=0 multi_id=0 [{"prefix": "quiesce db", "cancel": true, "all": true}] 2024-09-21T01:46:52.765 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.759+0000 7fc4320ac740 1 -- 172.21.15.83:0/1713710581 --> [v2:172.21.15.119:6838/3106757092,v1:172.21.15.119:6839/3106757092] -- command(tid 0: {"prefix": "quiesce db", "cancel": true, "all": true}) -- 0x5645f18627d0 con 0x5645f14db000 2024-09-21T01:46:52.765 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.760+0000 7fc4298d4640 1 --2- 172.21.15.83:0/1713710581 >> [v2:172.21.15.119:6838/3106757092,v1:172.21.15.119:6839/3106757092] conn(0x5645f14db000 0x5645f197d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:46:52.765 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.760+0000 7fc40d7fa640 10 client.15735 ms_handle_connect on v2:172.21.15.119:6838/3106757092 2024-09-21T01:46:52.765 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.760+0000 7fc4298d4640 1 --2- 172.21.15.83:0/1713710581 >> [v2:172.21.15.119:6838/3106757092,v1:172.21.15.119:6839/3106757092] conn(0x5645f14db000 0x5645f197d780 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8fdf6e14ebecf031 server_cookie=694a06efd0f443f9 in_seq=0 out_seq=0 2024-09-21T01:46:52.765 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.761+0000 7fc40d7fa640 1 -- 172.21.15.83:0/1713710581 <== mds.0 v2:172.21.15.119:6838/3106757092 1 ==== command_reply(tid 0: 0 ) ==== 8+0+80 (crc 0 0 0) 0x5645f18627d0 con 0x5645f14db000 2024-09-21T01:46:52.765 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.761+0000 7fc40d7fa640 10 client.15735 handle_command_reply: tid=0 2024-09-21T01:46:52.765 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.761+0000 7fc4320ac740 1 client.15735 shutdown 2024-09-21T01:46:52.765 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.761+0000 7ff0877fe640 1 -- 172.21.15.83:0/3361552003 <== mds.0 v2:172.21.15.119:6838/3106757092 1 ==== command_reply(tid 0: -125 ) ==== 8+0+591 (crc 0 0 0) 0x55c52fc969c0 con 0x55c52fdb7670 2024-09-21T01:46:52.766 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.761+0000 7ff0877fe640 10 client.15717 handle_command_reply: tid=0 2024-09-21T01:46:52.766 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.761+0000 7ff0b4d48740 1 client.15717 shutdown 2024-09-21T01:46:52.766 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.761+0000 7fc4320ac740 1 -- 172.21.15.83:0/1713710581 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5645f15265f0 msgr2=0x5645f1902340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:46:52.766 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.761+0000 7fc4320ac740 1 --2- 172.21.15.83:0/1713710581 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5645f15265f0 0x5645f1902340 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fc41400f810 tx=0x7fc41400fcd0 comp rx=0 tx=0).stop 2024-09-21T01:46:52.766 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.761+0000 7fc4320ac740 1 -- 172.21.15.83:0/1713710581 shutdown_connections 2024-09-21T01:46:52.766 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.761+0000 7fc4320ac740 1 --2- 172.21.15.83:0/1713710581 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5645f15472d0 0x5645f1902880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:46:52.767 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.761+0000 7fc4320ac740 1 --2- 172.21.15.83:0/1713710581 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x5645f15265f0 0x5645f1902340 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:46:52.767 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.761+0000 7fc4320ac740 1 --2- 172.21.15.83:0/1713710581 >> [v2:172.21.15.119:6838/3106757092,v1:172.21.15.119:6839/3106757092] conn(0x5645f14db000 0x5645f197d780 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:46:52.767 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.761+0000 7fc4320ac740 1 --2- 172.21.15.83:0/1713710581 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5645f151e410 0x5645f1901e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:46:52.767 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.761+0000 7fc40d7fa640 0 client.15735 ms_handle_reset on v2:172.21.15.119:6838/3106757092 2024-09-21T01:46:52.767 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.761+0000 7fc4320ac740 1 -- 172.21.15.83:0/1713710581 >> 172.21.15.83:0/1713710581 conn(0x5645f153b6c0 msgr2=0x5645f190a4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:46:52.767 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.761+0000 7ff0b4d48740 1 -- 172.21.15.83:0/3361552003 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c52f97e840 msgr2=0x55c52fd3d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:46:52.767 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.761+0000 7ff0b4d48740 1 --2- 172.21.15.83:0/3361552003 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c52f97e840 0x55c52fd3d3e0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7ff0a0012e30 tx=0x7ff0a0004ab0 comp rx=0 tx=0).stop 2024-09-21T01:46:52.767 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.761+0000 7fc4320ac740 1 -- 172.21.15.83:0/1713710581 shutdown_connections 2024-09-21T01:46:52.768 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.761+0000 7fc4320ac740 1 -- 172.21.15.83:0/1713710581 wait complete. 2024-09-21T01:46:52.768 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.761+0000 7ff0b4d48740 1 -- 172.21.15.83:0/3361552003 shutdown_connections 2024-09-21T01:46:52.768 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.761+0000 7ff0b4d48740 1 --2- 172.21.15.83:0/3361552003 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55c52f97e840 0x55c52fd3d3e0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:46:52.768 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.761+0000 7ff0b4d48740 1 --2- 172.21.15.83:0/3361552003 >> [v2:172.21.15.119:6838/3106757092,v1:172.21.15.119:6839/3106757092] conn(0x55c52fdb7670 0x55c52fdb9a90 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:46:52.768 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.761+0000 7ff0b4d48740 1 --2- 172.21.15.83:0/3361552003 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c52f95db60 0x55c52fd2d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:46:52.768 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.761+0000 7ff0877fe640 0 client.15717 ms_handle_reset on v2:172.21.15.119:6838/3106757092 2024-09-21T01:46:52.768 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.761+0000 7ff0b4d48740 1 --2- 172.21.15.83:0/3361552003 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c52f93d1c0 0x55c52fd2d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:46:52.768 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.761+0000 7ff0b4d48740 1 -- 172.21.15.83:0/3361552003 >> 172.21.15.83:0/3361552003 conn(0x55c52f972990 msgr2=0x55c52fd23470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:46:52.769 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.761+0000 7fc4320ac740 20 client.15735 trim_cache size 0 max 16384 2024-09-21T01:46:52.769 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.761+0000 7ff0b4d48740 1 -- 172.21.15.83:0/3361552003 shutdown_connections 2024-09-21T01:46:52.769 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.761+0000 7ff0b4d48740 1 -- 172.21.15.83:0/3361552003 wait complete. 2024-09-21T01:46:52.769 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-09-21T01:46:52.769 INFO:teuthology.orchestra.run.smithi083.stdout: "epoch": 21, 2024-09-21T01:46:52.770 INFO:teuthology.orchestra.run.smithi083.stdout: "leader": 24653, 2024-09-21T01:46:52.770 INFO:teuthology.orchestra.run.smithi083.stdout: "set_version": 18, 2024-09-21T01:46:52.770 INFO:teuthology.orchestra.run.smithi083.stdout: "sets": {} 2024-09-21T01:46:52.770 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-09-21T01:46:52.770 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.761+0000 7ff0b4d48740 20 client.15717 trim_cache size 0 max 16384 2024-09-21T01:46:52.770 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-09-21T01:46:52.771 INFO:teuthology.orchestra.run.smithi083.stdout: "epoch": 21, 2024-09-21T01:46:52.771 INFO:teuthology.orchestra.run.smithi083.stdout: "leader": 24653, 2024-09-21T01:46:52.771 INFO:teuthology.orchestra.run.smithi083.stdout: "set_version": 18, 2024-09-21T01:46:52.771 INFO:teuthology.orchestra.run.smithi083.stdout: "sets": { 2024-09-21T01:46:52.771 INFO:teuthology.orchestra.run.smithi083.stdout: "d2499b17": { 2024-09-21T01:46:52.771 INFO:teuthology.orchestra.run.smithi083.stdout: "version": 18, 2024-09-21T01:46:52.771 INFO:teuthology.orchestra.run.smithi083.stdout: "age_ref": 0.0, 2024-09-21T01:46:52.771 INFO:teuthology.orchestra.run.smithi083.stdout: "state": { 2024-09-21T01:46:52.771 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "CANCELED", 2024-09-21T01:46:52.771 INFO:teuthology.orchestra.run.smithi083.stdout: "age": 0.0 2024-09-21T01:46:52.771 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:46:52.771 INFO:teuthology.orchestra.run.smithi083.stdout: "timeout": 90.0, 2024-09-21T01:46:52.771 INFO:teuthology.orchestra.run.smithi083.stdout: "expiration": 130.0, 2024-09-21T01:46:52.771 INFO:teuthology.orchestra.run.smithi083.stdout: "members": { 2024-09-21T01:46:52.772 INFO:teuthology.orchestra.run.smithi083.stdout: "file:/": { 2024-09-21T01:46:52.772 INFO:teuthology.orchestra.run.smithi083.stdout: "excluded": true, 2024-09-21T01:46:52.772 INFO:teuthology.orchestra.run.smithi083.stdout: "state": { 2024-09-21T01:46:52.772 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "QUIESCING", 2024-09-21T01:46:52.772 INFO:teuthology.orchestra.run.smithi083.stdout: "age": 0.5 2024-09-21T01:46:52.772 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:46:52.772 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:46:52.772 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:46:52.772 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:46:52.772 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:46:52.772 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-09-21T01:46:52.772 INFO:teuthology.orchestra.run.smithi083.stderr:Error ECANCELED: 2024-09-21T01:46:52.773 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.762+0000 7fc42bb38640 1 -- 172.21.15.83:0/745727859 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fc4100b6700 msgr2=0x7fc4100b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:46:52.773 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.762+0000 7fc42bb38640 1 --2- 172.21.15.83:0/745727859 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fc4100b6700 0x7fc4100b8c10 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fc41c005fd0 tx=0x7fc41c009700 comp rx=0 tx=0).stop 2024-09-21T01:46:52.773 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.762+0000 7fc42bb38640 1 -- 172.21.15.83:0/745727859 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc4241020f0 msgr2=0x7fc42419a450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:46:52.773 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.762+0000 7fc42bb38640 1 --2- 172.21.15.83:0/745727859 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc4241020f0 0x7fc42419a450 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fc420009230 tx=0x7fc420004270 comp rx=0 tx=0).stop 2024-09-21T01:46:52.773 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.762+0000 7fc42bb38640 1 -- 172.21.15.83:0/745727859 shutdown_connections 2024-09-21T01:46:52.774 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.762+0000 7fc42bb38640 1 --2- 172.21.15.83:0/745727859 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fc4100b6700 0x7fc4100b8c10 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:46:52.774 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.762+0000 7fc42bb38640 1 --2- 172.21.15.83:0/745727859 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc424107c40 0x7fc42419fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:46:52.774 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.762+0000 7fc42bb38640 1 --2- 172.21.15.83:0/745727859 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc4241072f0 0x7fc42419a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:46:52.774 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.762+0000 7fc42bb38640 1 --2- 172.21.15.83:0/745727859 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc4241020f0 0x7fc42419a450 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:46:52.774 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.762+0000 7fc42bb38640 1 -- 172.21.15.83:0/745727859 >> 172.21.15.83:0/745727859 conn(0x7fc424079e30 msgr2=0x7fc4241061e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:46:52.774 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.762+0000 7fc42bb38640 1 -- 172.21.15.83:0/745727859 shutdown_connections 2024-09-21T01:46:52.774 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:46:52.762+0000 7fc42bb38640 1 -- 172.21.15.83:0/745727859 wait complete. 2024-09-21T01:46:53.002 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:46:52 smithi083 ceph-mon[31370]: pgmap v484: 129 pgs: 129 active+clean; 119 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 313 op/s 2024-09-21T01:46:53.464 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:46:52 smithi142 ceph-mon[34050]: pgmap v484: 129 pgs: 129 active+clean; 119 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 313 op/s 2024-09-21T01:46:53.467 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:46:52 smithi119 ceph-mon[33693]: pgmap v484: 129 pgs: 129 active+clean; 119 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 313 op/s 2024-09-21T01:46:54.645 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-09-21T01:46:54.645 INFO:tasks.quiescer:done joining Quiescers 2024-09-21T01:46:54.645 DEBUG:teuthology.run_tasks:Unwinding manager full_sequential_finally 2024-09-21T01:46:54.655 INFO:teuthology.task.full_sequential_finally:In full_sequential_finally, running task exec... 2024-09-21T01:46:54.655 INFO:teuthology.task.exec:Executing custom commands... 2024-09-21T01:46:54.655 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi083.front.sepia.ceph.com 2024-09-21T01:46:54.656 DEBUG:teuthology.orchestra.run.smithi083:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > END_TIME' 2024-09-21T01:46:54.686 DEBUG:teuthology.orchestra.run.smithi083:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi' 2024-09-21T01:46:55.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:46:54 smithi083 ceph-mon[31370]: pgmap v485: 129 pgs: 129 active+clean; 35 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 255 op/s 2024-09-21T01:46:55.464 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:46:54 smithi142 ceph-mon[34050]: pgmap v485: 129 pgs: 129 active+clean; 35 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 255 op/s 2024-09-21T01:46:55.467 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:46:54 smithi119 ceph-mon[33693]: pgmap v485: 129 pgs: 129 active+clean; 35 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 255 op/s 2024-09-21T01:46:57.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:46:56 smithi083 ceph-mon[31370]: pgmap v486: 129 pgs: 129 active+clean; 27 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 722 KiB/s rd, 678 KiB/s wr, 195 op/s 2024-09-21T01:46:57.464 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:46:56 smithi142 ceph-mon[34050]: pgmap v486: 129 pgs: 129 active+clean; 27 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 722 KiB/s rd, 678 KiB/s wr, 195 op/s 2024-09-21T01:46:57.467 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:46:56 smithi119 ceph-mon[33693]: pgmap v486: 129 pgs: 129 active+clean; 27 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 722 KiB/s rd, 678 KiB/s wr, 195 op/s 2024-09-21T01:46:59.268 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:46:58 smithi142 ceph-mon[34050]: pgmap v487: 129 pgs: 129 active+clean; 27 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 638 KiB/s rd, 581 KiB/s wr, 138 op/s 2024-09-21T01:46:59.271 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:46:58 smithi119 ceph-mon[33693]: pgmap v487: 129 pgs: 129 active+clean; 27 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 638 KiB/s rd, 581 KiB/s wr, 138 op/s 2024-09-21T01:46:59.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:46:58 smithi083 ceph-mon[31370]: pgmap v487: 129 pgs: 129 active+clean; 27 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 638 KiB/s rd, 581 KiB/s wr, 138 op/s 2024-09-21T01:47:01.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:47:00 smithi083 ceph-mon[31370]: pgmap v488: 129 pgs: 129 active+clean; 27 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 609 KiB/s rd, 542 KiB/s wr, 112 op/s 2024-09-21T01:47:01.464 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:47:00 smithi142 ceph-mon[34050]: pgmap v488: 129 pgs: 129 active+clean; 27 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 609 KiB/s rd, 542 KiB/s wr, 112 op/s 2024-09-21T01:47:01.467 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:47:00 smithi119 ceph-mon[33693]: pgmap v488: 129 pgs: 129 active+clean; 27 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 609 KiB/s rd, 542 KiB/s wr, 112 op/s 2024-09-21T01:47:03.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:47:02 smithi083 ceph-mon[31370]: pgmap v489: 129 pgs: 129 active+clean; 27 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 171 KiB/s wr, 62 op/s 2024-09-21T01:47:03.464 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:47:02 smithi142 ceph-mon[34050]: pgmap v489: 129 pgs: 129 active+clean; 27 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 171 KiB/s wr, 62 op/s 2024-09-21T01:47:03.467 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:47:02 smithi119 ceph-mon[33693]: pgmap v489: 129 pgs: 129 active+clean; 27 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 171 KiB/s wr, 62 op/s 2024-09-21T01:47:05.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:47:04 smithi083 ceph-mon[31370]: pgmap v490: 129 pgs: 129 active+clean; 27 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 170 KiB/s rd, 129 KiB/s wr, 34 op/s 2024-09-21T01:47:05.464 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:47:04 smithi142 ceph-mon[34050]: pgmap v490: 129 pgs: 129 active+clean; 27 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 170 KiB/s rd, 129 KiB/s wr, 34 op/s 2024-09-21T01:47:05.468 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:47:04 smithi119 ceph-mon[33693]: pgmap v490: 129 pgs: 129 active+clean; 27 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 170 KiB/s rd, 129 KiB/s wr, 34 op/s 2024-09-21T01:47:07.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:47:06 smithi083 ceph-mon[31370]: pgmap v491: 129 pgs: 129 active+clean; 27 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 32 KiB/s wr, 19 op/s 2024-09-21T01:47:07.464 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:47:06 smithi142 ceph-mon[34050]: pgmap v491: 129 pgs: 129 active+clean; 27 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 32 KiB/s wr, 19 op/s 2024-09-21T01:47:07.467 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:47:06 smithi119 ceph-mon[33693]: pgmap v491: 129 pgs: 129 active+clean; 27 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 32 KiB/s wr, 19 op/s 2024-09-21T01:47:09.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:47:08 smithi083 ceph-mon[31370]: pgmap v492: 129 pgs: 129 active+clean; 27 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 32 KiB/s wr, 17 op/s 2024-09-21T01:47:09.464 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:47:08 smithi142 ceph-mon[34050]: pgmap v492: 129 pgs: 129 active+clean; 27 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 32 KiB/s wr, 17 op/s 2024-09-21T01:47:09.467 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:47:08 smithi119 ceph-mon[33693]: pgmap v492: 129 pgs: 129 active+clean; 27 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 32 KiB/s wr, 17 op/s 2024-09-21T01:47:11.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:47:10 smithi083 ceph-mon[31370]: pgmap v493: 129 pgs: 129 active+clean; 27 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 32 KiB/s wr, 18 op/s 2024-09-21T01:47:11.464 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:47:10 smithi142 ceph-mon[34050]: pgmap v493: 129 pgs: 129 active+clean; 27 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 32 KiB/s wr, 18 op/s 2024-09-21T01:47:11.467 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:47:10 smithi119 ceph-mon[33693]: pgmap v493: 129 pgs: 129 active+clean; 27 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 32 KiB/s wr, 18 op/s 2024-09-21T01:47:13.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:47:12 smithi083 ceph-mon[31370]: pgmap v494: 129 pgs: 129 active+clean; 27 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 25 KiB/s wr, 17 op/s 2024-09-21T01:47:13.464 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:47:12 smithi142 ceph-mon[34050]: pgmap v494: 129 pgs: 129 active+clean; 27 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 25 KiB/s wr, 17 op/s 2024-09-21T01:47:13.467 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:47:12 smithi119 ceph-mon[33693]: pgmap v494: 129 pgs: 129 active+clean; 27 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 25 KiB/s wr, 17 op/s 2024-09-21T01:47:15.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:47:14 smithi083 ceph-mon[31370]: pgmap v495: 129 pgs: 129 active+clean; 27 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 15 KiB/s wr, 16 op/s 2024-09-21T01:47:15.464 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:47:14 smithi142 ceph-mon[34050]: pgmap v495: 129 pgs: 129 active+clean; 27 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 15 KiB/s wr, 16 op/s 2024-09-21T01:47:15.467 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:47:14 smithi119 ceph-mon[33693]: pgmap v495: 129 pgs: 129 active+clean; 27 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 15 KiB/s wr, 16 op/s 2024-09-21T01:47:17.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:47:16 smithi083 ceph-mon[31370]: pgmap v496: 129 pgs: 129 active+clean; 27 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 1.1 KiB/s wr, 2 op/s 2024-09-21T01:47:17.464 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:47:16 smithi142 ceph-mon[34050]: pgmap v496: 129 pgs: 129 active+clean; 27 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 1.1 KiB/s wr, 2 op/s 2024-09-21T01:47:17.467 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:47:16 smithi119 ceph-mon[33693]: pgmap v496: 129 pgs: 129 active+clean; 27 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 1.1 KiB/s wr, 2 op/s 2024-09-21T01:47:19.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:47:18 smithi083 ceph-mon[31370]: pgmap v497: 129 pgs: 129 active+clean; 27 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 1.1 KiB/s wr, 2 op/s 2024-09-21T01:47:19.464 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:47:18 smithi142 ceph-mon[34050]: pgmap v497: 129 pgs: 129 active+clean; 27 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 1.1 KiB/s wr, 2 op/s 2024-09-21T01:47:19.467 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:47:18 smithi119 ceph-mon[33693]: pgmap v497: 129 pgs: 129 active+clean; 27 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 1.1 KiB/s wr, 2 op/s 2024-09-21T01:47:21.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:47:20 smithi083 ceph-mon[31370]: pgmap v498: 129 pgs: 129 active+clean; 27 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 1.1 KiB/s wr, 2 op/s 2024-09-21T01:47:21.464 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:47:20 smithi142 ceph-mon[34050]: pgmap v498: 129 pgs: 129 active+clean; 27 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 1.1 KiB/s wr, 2 op/s 2024-09-21T01:47:21.467 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:47:20 smithi119 ceph-mon[33693]: pgmap v498: 129 pgs: 129 active+clean; 27 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 1.1 KiB/s wr, 2 op/s 2024-09-21T01:47:23.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:47:22 smithi083 ceph-mon[31370]: pgmap v499: 129 pgs: 129 active+clean; 27 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 1023 B/s wr, 1 op/s 2024-09-21T01:47:23.464 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:47:22 smithi142 ceph-mon[34050]: pgmap v499: 129 pgs: 129 active+clean; 27 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 1023 B/s wr, 1 op/s 2024-09-21T01:47:23.467 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:47:22 smithi119 ceph-mon[33693]: pgmap v499: 129 pgs: 129 active+clean; 27 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 1023 B/s wr, 1 op/s 2024-09-21T01:47:26.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:47:25 smithi142 ceph-mon[34050]: pgmap v500: 129 pgs: 129 active+clean; 27 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 1023 B/s wr, 2 op/s 2024-09-21T01:47:26.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:47:25 smithi119 ceph-mon[33693]: pgmap v500: 129 pgs: 129 active+clean; 27 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 1023 B/s wr, 2 op/s 2024-09-21T01:47:26.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:47:25 smithi083 ceph-mon[31370]: pgmap v500: 129 pgs: 129 active+clean; 27 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 1023 B/s wr, 2 op/s 2024-09-21T01:47:28.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:47:27 smithi142 ceph-mon[34050]: pgmap v501: 129 pgs: 129 active+clean; 27 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-09-21T01:47:28.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:47:27 smithi119 ceph-mon[33693]: pgmap v501: 129 pgs: 129 active+clean; 27 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-09-21T01:47:28.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:47:27 smithi083 ceph-mon[31370]: pgmap v501: 129 pgs: 129 active+clean; 27 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s rd, 1 op/s 2024-09-21T01:47:29.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:47:28 smithi083 ceph-mon[31370]: pgmap v502: 129 pgs: 129 active+clean; 27 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T01:47:29.464 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:47:28 smithi142 ceph-mon[34050]: pgmap v502: 129 pgs: 129 active+clean; 27 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T01:47:29.467 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:47:28 smithi119 ceph-mon[33693]: pgmap v502: 129 pgs: 129 active+clean; 27 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T01:47:31.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:47:30 smithi083 ceph-mon[31370]: pgmap v503: 129 pgs: 129 active+clean; 27 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T01:47:31.464 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:47:30 smithi142 ceph-mon[34050]: pgmap v503: 129 pgs: 129 active+clean; 27 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T01:47:31.467 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:47:30 smithi119 ceph-mon[33693]: pgmap v503: 129 pgs: 129 active+clean; 27 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T01:47:33.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:47:32 smithi083 ceph-mon[31370]: pgmap v504: 129 pgs: 129 active+clean; 27 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:47:33.464 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:47:32 smithi142 ceph-mon[34050]: pgmap v504: 129 pgs: 129 active+clean; 27 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:47:33.467 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:47:32 smithi119 ceph-mon[33693]: pgmap v504: 129 pgs: 129 active+clean; 27 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:47:35.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:47:34 smithi083 ceph-mon[31370]: pgmap v505: 129 pgs: 129 active+clean; 27 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T01:47:35.465 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:47:34 smithi142 ceph-mon[34050]: pgmap v505: 129 pgs: 129 active+clean; 27 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T01:47:35.468 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:47:34 smithi119 ceph-mon[33693]: pgmap v505: 129 pgs: 129 active+clean; 27 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T01:47:37.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:47:36 smithi083 ceph-mon[31370]: pgmap v506: 129 pgs: 129 active+clean; 27 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:47:37.464 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:47:36 smithi142 ceph-mon[34050]: pgmap v506: 129 pgs: 129 active+clean; 27 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:47:37.467 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:47:36 smithi119 ceph-mon[33693]: pgmap v506: 129 pgs: 129 active+clean; 27 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:47:39.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:47:38 smithi083 ceph-mon[31370]: pgmap v507: 129 pgs: 129 active+clean; 27 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T01:47:39.464 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:47:38 smithi142 ceph-mon[34050]: pgmap v507: 129 pgs: 129 active+clean; 27 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T01:47:39.467 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:47:38 smithi119 ceph-mon[33693]: pgmap v507: 129 pgs: 129 active+clean; 27 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T01:47:41.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:47:40 smithi083 ceph-mon[31370]: pgmap v508: 129 pgs: 129 active+clean; 27 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:47:41.464 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:47:40 smithi142 ceph-mon[34050]: pgmap v508: 129 pgs: 129 active+clean; 27 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:47:41.467 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:47:40 smithi119 ceph-mon[33693]: pgmap v508: 129 pgs: 129 active+clean; 27 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:47:43.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:47:42 smithi083 ceph-mon[31370]: pgmap v509: 129 pgs: 129 active+clean; 27 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:47:43.464 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:47:42 smithi142 ceph-mon[34050]: pgmap v509: 129 pgs: 129 active+clean; 27 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:47:43.467 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:47:42 smithi119 ceph-mon[33693]: pgmap v509: 129 pgs: 129 active+clean; 27 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:47:45.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:47:44 smithi083 ceph-mon[31370]: pgmap v510: 129 pgs: 129 active+clean; 27 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T01:47:45.464 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:47:44 smithi142 ceph-mon[34050]: pgmap v510: 129 pgs: 129 active+clean; 27 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T01:47:45.467 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:47:44 smithi119 ceph-mon[33693]: pgmap v510: 129 pgs: 129 active+clean; 27 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T01:47:47.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:47:46 smithi083 ceph-mon[31370]: pgmap v511: 129 pgs: 129 active+clean; 27 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:47:47.464 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:47:46 smithi142 ceph-mon[34050]: pgmap v511: 129 pgs: 129 active+clean; 27 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:47:47.467 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:47:46 smithi119 ceph-mon[33693]: pgmap v511: 129 pgs: 129 active+clean; 27 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:47:49.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:47:48 smithi083 ceph-mon[31370]: pgmap v512: 129 pgs: 129 active+clean; 27 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T01:47:49.464 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:47:48 smithi142 ceph-mon[34050]: pgmap v512: 129 pgs: 129 active+clean; 27 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T01:47:49.467 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:47:48 smithi119 ceph-mon[33693]: pgmap v512: 129 pgs: 129 active+clean; 27 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T01:47:50.714 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:47:50 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:47:50.717 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:47:50 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:47:50.803 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:47:50 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:47:51.714 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:47:51 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:47:51.715 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:47:51 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:47:51.715 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:47:51 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:47:51.715 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:47:51 smithi142 ceph-mon[34050]: pgmap v513: 129 pgs: 129 active+clean; 27 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:47:51.717 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:47:51 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:47:51.717 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:47:51 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:47:51.717 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:47:51 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:47:51.718 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:47:51 smithi119 ceph-mon[33693]: pgmap v513: 129 pgs: 129 active+clean; 27 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:47:51.804 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:47:51 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:47:51.804 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:47:51 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:47:51.804 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:47:51 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:47:51.804 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:47:51 smithi083 ceph-mon[31370]: pgmap v513: 129 pgs: 129 active+clean; 27 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:47:53.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:47:52 smithi083 ceph-mon[31370]: pgmap v514: 129 pgs: 129 active+clean; 27 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:47:53.464 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:47:52 smithi142 ceph-mon[34050]: pgmap v514: 129 pgs: 129 active+clean; 27 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:47:53.467 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:47:52 smithi119 ceph-mon[33693]: pgmap v514: 129 pgs: 129 active+clean; 27 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:47:55.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:47:54 smithi083 ceph-mon[31370]: pgmap v515: 129 pgs: 129 active+clean; 27 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T01:47:55.464 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:47:54 smithi142 ceph-mon[34050]: pgmap v515: 129 pgs: 129 active+clean; 27 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T01:47:55.467 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:47:54 smithi119 ceph-mon[33693]: pgmap v515: 129 pgs: 129 active+clean; 27 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T01:47:57.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:47:56 smithi083 ceph-mon[31370]: pgmap v516: 129 pgs: 129 active+clean; 27 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:47:57.464 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:47:56 smithi142 ceph-mon[34050]: pgmap v516: 129 pgs: 129 active+clean; 27 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:47:57.467 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:47:56 smithi119 ceph-mon[33693]: pgmap v516: 129 pgs: 129 active+clean; 27 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:47:59.267 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:47:58 smithi142 ceph-mon[34050]: pgmap v517: 129 pgs: 129 active+clean; 27 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T01:47:59.270 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:47:58 smithi119 ceph-mon[33693]: pgmap v517: 129 pgs: 129 active+clean; 27 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T01:47:59.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:47:58 smithi083 ceph-mon[31370]: pgmap v517: 129 pgs: 129 active+clean; 27 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T01:48:01.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:48:00 smithi083 ceph-mon[31370]: pgmap v518: 129 pgs: 129 active+clean; 27 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:48:01.464 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:48:00 smithi142 ceph-mon[34050]: pgmap v518: 129 pgs: 129 active+clean; 27 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:48:01.467 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:48:00 smithi119 ceph-mon[33693]: pgmap v518: 129 pgs: 129 active+clean; 27 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:48:03.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:48:02 smithi083 ceph-mon[31370]: pgmap v519: 129 pgs: 129 active+clean; 27 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 22 KiB/s wr, 3 op/s 2024-09-21T01:48:03.464 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:48:02 smithi142 ceph-mon[34050]: pgmap v519: 129 pgs: 129 active+clean; 27 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 22 KiB/s wr, 3 op/s 2024-09-21T01:48:03.467 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:48:02 smithi119 ceph-mon[33693]: pgmap v519: 129 pgs: 129 active+clean; 27 MiB data, 464 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 22 KiB/s wr, 3 op/s 2024-09-21T01:48:05.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:48:04 smithi083 ceph-mon[31370]: pgmap v520: 129 pgs: 129 active+clean; 27 MiB data, 469 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2024-09-21T01:48:05.464 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:48:04 smithi142 ceph-mon[34050]: pgmap v520: 129 pgs: 129 active+clean; 27 MiB data, 469 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2024-09-21T01:48:05.467 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:48:04 smithi119 ceph-mon[33693]: pgmap v520: 129 pgs: 129 active+clean; 27 MiB data, 469 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2024-09-21T01:48:07.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:48:06 smithi083 ceph-mon[31370]: pgmap v521: 129 pgs: 129 active+clean; 27 MiB data, 469 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 18 op/s 2024-09-21T01:48:07.464 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:48:06 smithi142 ceph-mon[34050]: pgmap v521: 129 pgs: 129 active+clean; 27 MiB data, 469 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 18 op/s 2024-09-21T01:48:07.467 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:48:06 smithi119 ceph-mon[33693]: pgmap v521: 129 pgs: 129 active+clean; 27 MiB data, 469 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 18 op/s 2024-09-21T01:48:09.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:48:08 smithi083 ceph-mon[31370]: pgmap v522: 129 pgs: 129 active+clean; 27 MiB data, 469 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2024-09-21T01:48:09.464 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:48:08 smithi142 ceph-mon[34050]: pgmap v522: 129 pgs: 129 active+clean; 27 MiB data, 469 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2024-09-21T01:48:09.467 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:48:08 smithi119 ceph-mon[33693]: pgmap v522: 129 pgs: 129 active+clean; 27 MiB data, 469 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2024-09-21T01:48:11.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:48:10 smithi083 ceph-mon[31370]: osdmap e85: 12 total, 12 up, 12 in 2024-09-21T01:48:11.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:48:10 smithi083 ceph-mon[31370]: pgmap v524: 129 pgs: 129 active+clean; 27 MiB data, 469 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 22 op/s 2024-09-21T01:48:11.464 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:48:10 smithi142 ceph-mon[34050]: osdmap e85: 12 total, 12 up, 12 in 2024-09-21T01:48:11.465 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:48:10 smithi142 ceph-mon[34050]: pgmap v524: 129 pgs: 129 active+clean; 27 MiB data, 469 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 22 op/s 2024-09-21T01:48:11.467 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:48:10 smithi119 ceph-mon[33693]: osdmap e85: 12 total, 12 up, 12 in 2024-09-21T01:48:11.467 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:48:10 smithi119 ceph-mon[33693]: pgmap v524: 129 pgs: 129 active+clean; 27 MiB data, 469 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 22 op/s 2024-09-21T01:48:13.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:48:12 smithi083 ceph-mon[31370]: pgmap v525: 129 pgs: 129 active+clean; 27 MiB data, 469 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 27 KiB/s wr, 19 op/s 2024-09-21T01:48:13.464 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:48:12 smithi142 ceph-mon[34050]: pgmap v525: 129 pgs: 129 active+clean; 27 MiB data, 469 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 27 KiB/s wr, 19 op/s 2024-09-21T01:48:13.467 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:48:12 smithi119 ceph-mon[33693]: pgmap v525: 129 pgs: 129 active+clean; 27 MiB data, 469 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 27 KiB/s wr, 19 op/s 2024-09-21T01:48:15.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:48:14 smithi083 ceph-mon[31370]: pgmap v526: 129 pgs: 129 active+clean; 27 MiB data, 469 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-21T01:48:15.464 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:48:14 smithi142 ceph-mon[34050]: pgmap v526: 129 pgs: 129 active+clean; 27 MiB data, 469 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-21T01:48:15.467 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:48:14 smithi119 ceph-mon[33693]: pgmap v526: 129 pgs: 129 active+clean; 27 MiB data, 469 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-21T01:48:17.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:48:16 smithi083 ceph-mon[31370]: pgmap v527: 129 pgs: 129 active+clean; 27 MiB data, 469 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-21T01:48:17.464 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:48:16 smithi142 ceph-mon[34050]: pgmap v527: 129 pgs: 129 active+clean; 27 MiB data, 469 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-21T01:48:17.467 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:48:16 smithi119 ceph-mon[33693]: pgmap v527: 129 pgs: 129 active+clean; 27 MiB data, 469 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-21T01:48:20.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:48:19 smithi142 ceph-mon[34050]: pgmap v528: 129 pgs: 129 active+clean; 27 MiB data, 469 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-21T01:48:20.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:48:19 smithi142 ceph-mon[34050]: osdmap e86: 12 total, 12 up, 12 in 2024-09-21T01:48:20.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:48:19 smithi119 ceph-mon[33693]: pgmap v528: 129 pgs: 129 active+clean; 27 MiB data, 469 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-21T01:48:20.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:48:19 smithi119 ceph-mon[33693]: osdmap e86: 12 total, 12 up, 12 in 2024-09-21T01:48:20.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:48:19 smithi083 ceph-mon[31370]: pgmap v528: 129 pgs: 129 active+clean; 27 MiB data, 469 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-21T01:48:20.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:48:19 smithi083 ceph-mon[31370]: osdmap e86: 12 total, 12 up, 12 in 2024-09-21T01:48:21.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:48:20 smithi083 ceph-mon[31370]: pgmap v530: 129 pgs: 129 active+clean; 27 MiB data, 469 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-21T01:48:21.465 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:48:20 smithi142 ceph-mon[34050]: pgmap v530: 129 pgs: 129 active+clean; 27 MiB data, 469 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-21T01:48:21.468 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:48:20 smithi119 ceph-mon[33693]: pgmap v530: 129 pgs: 129 active+clean; 27 MiB data, 469 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-21T01:48:23.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:48:22 smithi083 ceph-mon[31370]: pgmap v531: 129 pgs: 129 active+clean; 27 MiB data, 469 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-21T01:48:23.464 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:48:22 smithi142 ceph-mon[34050]: pgmap v531: 129 pgs: 129 active+clean; 27 MiB data, 469 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-21T01:48:23.467 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:48:22 smithi119 ceph-mon[33693]: pgmap v531: 129 pgs: 129 active+clean; 27 MiB data, 469 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-21T01:48:25.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:48:24 smithi083 ceph-mon[31370]: pgmap v532: 129 pgs: 129 active+clean; 27 MiB data, 469 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-21T01:48:25.464 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:48:24 smithi142 ceph-mon[34050]: pgmap v532: 129 pgs: 129 active+clean; 27 MiB data, 469 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-21T01:48:25.467 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:48:24 smithi119 ceph-mon[33693]: pgmap v532: 129 pgs: 129 active+clean; 27 MiB data, 469 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-21T01:48:27.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:48:26 smithi083 ceph-mon[31370]: pgmap v533: 129 pgs: 129 active+clean; 27 MiB data, 469 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-21T01:48:27.464 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:48:26 smithi142 ceph-mon[34050]: pgmap v533: 129 pgs: 129 active+clean; 27 MiB data, 469 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-21T01:48:27.467 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:48:26 smithi119 ceph-mon[33693]: pgmap v533: 129 pgs: 129 active+clean; 27 MiB data, 469 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-21T01:48:29.266 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:48:28 smithi142 ceph-mon[34050]: pgmap v534: 129 pgs: 129 active+clean; 27 MiB data, 469 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-21T01:48:29.270 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:48:28 smithi119 ceph-mon[33693]: pgmap v534: 129 pgs: 129 active+clean; 27 MiB data, 469 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-21T01:48:29.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:48:28 smithi083 ceph-mon[31370]: pgmap v534: 129 pgs: 129 active+clean; 27 MiB data, 469 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-21T01:48:31.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:48:30 smithi083 ceph-mon[31370]: pgmap v535: 129 pgs: 129 active+clean; 27 MiB data, 469 MiB used, 1.0 TiB / 1.0 TiB avail; 854 B/s rd, 1 op/s 2024-09-21T01:48:31.464 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:48:30 smithi142 ceph-mon[34050]: pgmap v535: 129 pgs: 129 active+clean; 27 MiB data, 469 MiB used, 1.0 TiB / 1.0 TiB avail; 854 B/s rd, 1 op/s 2024-09-21T01:48:31.467 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:48:30 smithi119 ceph-mon[33693]: pgmap v535: 129 pgs: 129 active+clean; 27 MiB data, 469 MiB used, 1.0 TiB / 1.0 TiB avail; 854 B/s rd, 1 op/s 2024-09-21T01:48:33.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:48:32 smithi083 ceph-mon[31370]: pgmap v536: 129 pgs: 129 active+clean; 27 MiB data, 469 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:48:33.464 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:48:32 smithi142 ceph-mon[34050]: pgmap v536: 129 pgs: 129 active+clean; 27 MiB data, 469 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:48:33.467 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:48:32 smithi119 ceph-mon[33693]: pgmap v536: 129 pgs: 129 active+clean; 27 MiB data, 469 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:48:35.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:48:34 smithi083 ceph-mon[31370]: pgmap v537: 129 pgs: 129 active+clean; 27 MiB data, 469 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T01:48:35.464 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:48:34 smithi142 ceph-mon[34050]: pgmap v537: 129 pgs: 129 active+clean; 27 MiB data, 469 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T01:48:35.467 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:48:34 smithi119 ceph-mon[33693]: pgmap v537: 129 pgs: 129 active+clean; 27 MiB data, 469 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T01:48:37.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:48:36 smithi083 ceph-mon[31370]: pgmap v538: 129 pgs: 129 active+clean; 27 MiB data, 469 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:48:37.464 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:48:36 smithi142 ceph-mon[34050]: pgmap v538: 129 pgs: 129 active+clean; 27 MiB data, 469 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:48:37.467 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:48:36 smithi119 ceph-mon[33693]: pgmap v538: 129 pgs: 129 active+clean; 27 MiB data, 469 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:48:39.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:48:38 smithi083 ceph-mon[31370]: pgmap v539: 129 pgs: 129 active+clean; 27 MiB data, 469 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T01:48:39.464 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:48:38 smithi142 ceph-mon[34050]: pgmap v539: 129 pgs: 129 active+clean; 27 MiB data, 469 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T01:48:39.467 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:48:38 smithi119 ceph-mon[33693]: pgmap v539: 129 pgs: 129 active+clean; 27 MiB data, 469 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T01:48:41.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:48:40 smithi083 ceph-mon[31370]: pgmap v540: 129 pgs: 129 active+clean; 27 MiB data, 469 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:48:41.464 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:48:40 smithi142 ceph-mon[34050]: pgmap v540: 129 pgs: 129 active+clean; 27 MiB data, 469 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:48:41.467 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:48:40 smithi119 ceph-mon[33693]: pgmap v540: 129 pgs: 129 active+clean; 27 MiB data, 469 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:48:43.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:48:42 smithi083 ceph-mon[31370]: pgmap v541: 129 pgs: 129 active+clean; 27 MiB data, 469 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:48:43.464 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:48:42 smithi142 ceph-mon[34050]: pgmap v541: 129 pgs: 129 active+clean; 27 MiB data, 469 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:48:43.467 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:48:42 smithi119 ceph-mon[33693]: pgmap v541: 129 pgs: 129 active+clean; 27 MiB data, 469 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:48:45.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:48:44 smithi083 ceph-mon[31370]: pgmap v542: 129 pgs: 129 active+clean; 27 MiB data, 469 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T01:48:45.464 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:48:44 smithi142 ceph-mon[34050]: pgmap v542: 129 pgs: 129 active+clean; 27 MiB data, 469 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T01:48:45.467 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:48:44 smithi119 ceph-mon[33693]: pgmap v542: 129 pgs: 129 active+clean; 27 MiB data, 469 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T01:48:47.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:48:46 smithi083 ceph-mon[31370]: pgmap v543: 129 pgs: 129 active+clean; 27 MiB data, 469 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:48:47.464 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:48:46 smithi142 ceph-mon[34050]: pgmap v543: 129 pgs: 129 active+clean; 27 MiB data, 469 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:48:47.467 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:48:46 smithi119 ceph-mon[33693]: pgmap v543: 129 pgs: 129 active+clean; 27 MiB data, 469 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:48:49.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:48:48 smithi083 ceph-mon[31370]: pgmap v544: 129 pgs: 129 active+clean; 27 MiB data, 469 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T01:48:49.464 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:48:48 smithi142 ceph-mon[34050]: pgmap v544: 129 pgs: 129 active+clean; 27 MiB data, 469 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T01:48:49.467 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:48:48 smithi119 ceph-mon[33693]: pgmap v544: 129 pgs: 129 active+clean; 27 MiB data, 469 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T01:48:51.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:48:50 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:48:51.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:48:50 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:48:51.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:48:50 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:48:52.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:48:51 smithi142 ceph-mon[34050]: pgmap v545: 129 pgs: 129 active+clean; 27 MiB data, 469 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:48:52.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:48:51 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T01:48:52.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:48:51 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T01:48:52.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:48:51 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T01:48:52.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:48:51 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T01:48:52.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:48:51 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T01:48:52.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:48:51 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T01:48:52.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:48:51 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-21T01:48:52.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:48:51 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-21T01:48:52.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:48:51 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:48:52.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:48:51 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:48:52.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:48:51 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:48:52.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:48:51 smithi119 ceph-mon[33693]: pgmap v545: 129 pgs: 129 active+clean; 27 MiB data, 469 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:48:52.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:48:51 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T01:48:52.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:48:51 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T01:48:52.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:48:51 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T01:48:52.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:48:51 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T01:48:52.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:48:51 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T01:48:52.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:48:51 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T01:48:52.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:48:51 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-21T01:48:52.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:48:51 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-21T01:48:52.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:48:51 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:48:52.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:48:51 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:48:52.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:48:51 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:48:52.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:48:51 smithi083 ceph-mon[31370]: pgmap v545: 129 pgs: 129 active+clean; 27 MiB data, 469 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:48:52.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:48:51 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T01:48:52.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:48:51 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T01:48:52.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:48:51 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T01:48:52.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:48:51 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T01:48:52.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:48:51 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T01:48:52.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:48:51 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T01:48:52.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:48:51 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-21T01:48:52.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:48:51 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-21T01:48:52.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:48:51 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:48:52.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:48:51 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:48:52.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:48:51 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:48:53.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:48:52 smithi142 ceph-mon[34050]: Adjusting osd_memory_target on smithi119 to 176.0M 2024-09-21T01:48:53.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:48:52 smithi142 ceph-mon[34050]: Adjusting osd_memory_target on smithi083 to 176.0M 2024-09-21T01:48:53.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:48:52 smithi142 ceph-mon[34050]: Unable to set osd_memory_target on smithi119 to 184561664: error parsing value: Value '184561664' is below minimum 939524096 2024-09-21T01:48:53.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:48:52 smithi142 ceph-mon[34050]: Unable to set osd_memory_target on smithi083 to 184577433: error parsing value: Value '184577433' is below minimum 939524096 2024-09-21T01:48:53.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:48:52 smithi119 ceph-mon[33693]: Adjusting osd_memory_target on smithi119 to 176.0M 2024-09-21T01:48:53.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:48:52 smithi119 ceph-mon[33693]: Adjusting osd_memory_target on smithi083 to 176.0M 2024-09-21T01:48:53.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:48:52 smithi119 ceph-mon[33693]: Unable to set osd_memory_target on smithi119 to 184561664: error parsing value: Value '184561664' is below minimum 939524096 2024-09-21T01:48:53.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:48:52 smithi119 ceph-mon[33693]: Unable to set osd_memory_target on smithi083 to 184577433: error parsing value: Value '184577433' is below minimum 939524096 2024-09-21T01:48:53.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:48:52 smithi083 ceph-mon[31370]: Adjusting osd_memory_target on smithi119 to 176.0M 2024-09-21T01:48:53.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:48:52 smithi083 ceph-mon[31370]: Adjusting osd_memory_target on smithi083 to 176.0M 2024-09-21T01:48:53.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:48:52 smithi083 ceph-mon[31370]: Unable to set osd_memory_target on smithi119 to 184561664: error parsing value: Value '184561664' is below minimum 939524096 2024-09-21T01:48:53.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:48:52 smithi083 ceph-mon[31370]: Unable to set osd_memory_target on smithi083 to 184577433: error parsing value: Value '184577433' is below minimum 939524096 2024-09-21T01:48:54.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:48:53 smithi142 ceph-mon[34050]: pgmap v546: 129 pgs: 129 active+clean; 27 MiB data, 469 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:48:54.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:48:53 smithi119 ceph-mon[33693]: pgmap v546: 129 pgs: 129 active+clean; 27 MiB data, 469 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:48:54.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:48:53 smithi083 ceph-mon[31370]: pgmap v546: 129 pgs: 129 active+clean; 27 MiB data, 469 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:48:56.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:48:55 smithi142 ceph-mon[34050]: pgmap v547: 129 pgs: 129 active+clean; 27 MiB data, 469 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T01:48:56.217 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:48:55 smithi119 ceph-mon[33693]: pgmap v547: 129 pgs: 129 active+clean; 27 MiB data, 469 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T01:48:56.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:48:55 smithi083 ceph-mon[31370]: pgmap v547: 129 pgs: 129 active+clean; 27 MiB data, 469 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T01:48:58.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:48:57 smithi142 ceph-mon[34050]: pgmap v548: 129 pgs: 129 active+clean; 27 MiB data, 469 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:48:58.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:48:57 smithi119 ceph-mon[33693]: pgmap v548: 129 pgs: 129 active+clean; 27 MiB data, 469 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:48:58.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:48:57 smithi083 ceph-mon[31370]: pgmap v548: 129 pgs: 129 active+clean; 27 MiB data, 469 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:48:59.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:48:58 smithi083 ceph-mon[31370]: pgmap v549: 129 pgs: 129 active+clean; 27 MiB data, 469 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T01:48:59.464 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:48:58 smithi142 ceph-mon[34050]: pgmap v549: 129 pgs: 129 active+clean; 27 MiB data, 469 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T01:48:59.467 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:48:58 smithi119 ceph-mon[33693]: pgmap v549: 129 pgs: 129 active+clean; 27 MiB data, 469 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T01:49:01.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:49:00 smithi083 ceph-mon[31370]: pgmap v550: 129 pgs: 129 active+clean; 27 MiB data, 469 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:49:01.347 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:49:00 smithi119 ceph-mon[33693]: pgmap v550: 129 pgs: 129 active+clean; 27 MiB data, 469 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:49:01.466 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:49:00 smithi142 ceph-mon[34050]: pgmap v550: 129 pgs: 129 active+clean; 27 MiB data, 469 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:49:03.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:49:02 smithi083 ceph-mon[31370]: pgmap v551: 129 pgs: 129 active+clean; 27 MiB data, 469 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 22 KiB/s wr, 3 op/s 2024-09-21T01:49:03.464 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:49:02 smithi142 ceph-mon[34050]: pgmap v551: 129 pgs: 129 active+clean; 27 MiB data, 469 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 22 KiB/s wr, 3 op/s 2024-09-21T01:49:03.467 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:49:02 smithi119 ceph-mon[33693]: pgmap v551: 129 pgs: 129 active+clean; 27 MiB data, 469 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 22 KiB/s wr, 3 op/s 2024-09-21T01:49:05.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:49:04 smithi083 ceph-mon[31370]: pgmap v552: 129 pgs: 129 active+clean; 27 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2024-09-21T01:49:05.464 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:49:04 smithi142 ceph-mon[34050]: pgmap v552: 129 pgs: 129 active+clean; 27 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2024-09-21T01:49:05.467 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:49:04 smithi119 ceph-mon[33693]: pgmap v552: 129 pgs: 129 active+clean; 27 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2024-09-21T01:49:07.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:49:06 smithi083 ceph-mon[31370]: pgmap v553: 129 pgs: 129 active+clean; 27 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 45 KiB/s wr, 18 op/s 2024-09-21T01:49:07.464 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:49:06 smithi142 ceph-mon[34050]: pgmap v553: 129 pgs: 129 active+clean; 27 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 45 KiB/s wr, 18 op/s 2024-09-21T01:49:07.467 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:49:06 smithi119 ceph-mon[33693]: pgmap v553: 129 pgs: 129 active+clean; 27 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 45 KiB/s wr, 18 op/s 2024-09-21T01:49:09.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:49:08 smithi083 ceph-mon[31370]: pgmap v554: 129 pgs: 129 active+clean; 27 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2024-09-21T01:49:09.464 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:49:08 smithi142 ceph-mon[34050]: pgmap v554: 129 pgs: 129 active+clean; 27 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2024-09-21T01:49:09.467 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:49:08 smithi119 ceph-mon[33693]: pgmap v554: 129 pgs: 129 active+clean; 27 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2024-09-21T01:49:11.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:49:11 smithi119 ceph-mon[33693]: osdmap e87: 12 total, 12 up, 12 in 2024-09-21T01:49:11.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:49:11 smithi119 ceph-mon[33693]: pgmap v556: 129 pgs: 129 active+clean; 27 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 22 op/s 2024-09-21T01:49:11.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:49:11 smithi083 ceph-mon[31370]: osdmap e87: 12 total, 12 up, 12 in 2024-09-21T01:49:11.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:49:11 smithi083 ceph-mon[31370]: pgmap v556: 129 pgs: 129 active+clean; 27 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 22 op/s 2024-09-21T01:49:11.464 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:49:11 smithi142 ceph-mon[34050]: osdmap e87: 12 total, 12 up, 12 in 2024-09-21T01:49:11.465 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:49:11 smithi142 ceph-mon[34050]: pgmap v556: 129 pgs: 129 active+clean; 27 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 22 op/s 2024-09-21T01:49:13.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:49:12 smithi083 ceph-mon[31370]: pgmap v557: 129 pgs: 129 active+clean; 27 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 27 KiB/s wr, 19 op/s 2024-09-21T01:49:13.464 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:49:12 smithi142 ceph-mon[34050]: pgmap v557: 129 pgs: 129 active+clean; 27 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 27 KiB/s wr, 19 op/s 2024-09-21T01:49:13.468 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:49:12 smithi119 ceph-mon[33693]: pgmap v557: 129 pgs: 129 active+clean; 27 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 27 KiB/s wr, 19 op/s 2024-09-21T01:49:15.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:49:14 smithi083 ceph-mon[31370]: pgmap v558: 129 pgs: 129 active+clean; 27 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-21T01:49:15.464 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:49:14 smithi142 ceph-mon[34050]: pgmap v558: 129 pgs: 129 active+clean; 27 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-21T01:49:15.467 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:49:14 smithi119 ceph-mon[33693]: pgmap v558: 129 pgs: 129 active+clean; 27 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-21T01:49:17.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:49:16 smithi083 ceph-mon[31370]: pgmap v559: 129 pgs: 129 active+clean; 27 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-21T01:49:17.464 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:49:16 smithi142 ceph-mon[34050]: pgmap v559: 129 pgs: 129 active+clean; 27 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-21T01:49:17.467 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:49:16 smithi119 ceph-mon[33693]: pgmap v559: 129 pgs: 129 active+clean; 27 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-21T01:49:19.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:49:18 smithi083 ceph-mon[31370]: pgmap v560: 129 pgs: 129 active+clean; 27 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-21T01:49:19.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:49:18 smithi083 ceph-mon[31370]: osdmap e88: 12 total, 12 up, 12 in 2024-09-21T01:49:19.464 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:49:18 smithi142 ceph-mon[34050]: pgmap v560: 129 pgs: 129 active+clean; 27 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-21T01:49:19.464 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:49:18 smithi142 ceph-mon[34050]: osdmap e88: 12 total, 12 up, 12 in 2024-09-21T01:49:19.467 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:49:18 smithi119 ceph-mon[33693]: pgmap v560: 129 pgs: 129 active+clean; 27 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-21T01:49:19.467 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:49:18 smithi119 ceph-mon[33693]: osdmap e88: 12 total, 12 up, 12 in 2024-09-21T01:49:21.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:49:20 smithi083 ceph-mon[31370]: pgmap v562: 129 pgs: 129 active+clean; 27 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-21T01:49:21.464 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:49:20 smithi142 ceph-mon[34050]: pgmap v562: 129 pgs: 129 active+clean; 27 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-21T01:49:21.467 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:49:21 smithi119 ceph-mon[33693]: pgmap v562: 129 pgs: 129 active+clean; 27 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-21T01:49:23.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:49:22 smithi083 ceph-mon[31370]: pgmap v563: 129 pgs: 129 active+clean; 27 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-21T01:49:23.464 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:49:22 smithi142 ceph-mon[34050]: pgmap v563: 129 pgs: 129 active+clean; 27 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-21T01:49:23.467 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:49:22 smithi119 ceph-mon[33693]: pgmap v563: 129 pgs: 129 active+clean; 27 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-21T01:49:25.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:49:25 smithi083 ceph-mon[31370]: pgmap v564: 129 pgs: 129 active+clean; 27 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-21T01:49:25.464 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:49:25 smithi142 ceph-mon[34050]: pgmap v564: 129 pgs: 129 active+clean; 27 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-21T01:49:25.467 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:49:25 smithi119 ceph-mon[33693]: pgmap v564: 129 pgs: 129 active+clean; 27 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-21T01:49:27.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:49:27 smithi083 ceph-mon[31370]: pgmap v565: 129 pgs: 129 active+clean; 27 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-21T01:49:27.464 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:49:27 smithi142 ceph-mon[34050]: pgmap v565: 129 pgs: 129 active+clean; 27 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-21T01:49:27.470 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:49:27 smithi119 ceph-mon[33693]: pgmap v565: 129 pgs: 129 active+clean; 27 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-21T01:49:29.266 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:49:29 smithi142 ceph-mon[34050]: pgmap v566: 129 pgs: 129 active+clean; 27 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-21T01:49:29.270 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:49:29 smithi119 ceph-mon[33693]: pgmap v566: 129 pgs: 129 active+clean; 27 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-21T01:49:29.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:49:29 smithi083 ceph-mon[31370]: pgmap v566: 129 pgs: 129 active+clean; 27 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-21T01:49:31.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:49:31 smithi083 ceph-mon[31370]: pgmap v567: 129 pgs: 129 active+clean; 27 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:49:31.464 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:49:31 smithi142 ceph-mon[34050]: pgmap v567: 129 pgs: 129 active+clean; 27 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:49:31.467 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:49:31 smithi119 ceph-mon[33693]: pgmap v567: 129 pgs: 129 active+clean; 27 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:49:33.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:49:33 smithi083 ceph-mon[31370]: pgmap v568: 129 pgs: 129 active+clean; 27 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:49:33.464 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:49:33 smithi142 ceph-mon[34050]: pgmap v568: 129 pgs: 129 active+clean; 27 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:49:33.467 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:49:33 smithi119 ceph-mon[33693]: pgmap v568: 129 pgs: 129 active+clean; 27 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:49:35.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:49:35 smithi083 ceph-mon[31370]: pgmap v569: 129 pgs: 129 active+clean; 27 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T01:49:35.464 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:49:35 smithi142 ceph-mon[34050]: pgmap v569: 129 pgs: 129 active+clean; 27 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T01:49:35.467 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:49:35 smithi119 ceph-mon[33693]: pgmap v569: 129 pgs: 129 active+clean; 27 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T01:49:38.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:49:38 smithi083 ceph-mon[31370]: pgmap v570: 129 pgs: 129 active+clean; 27 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:49:38.464 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:49:38 smithi142 ceph-mon[34050]: pgmap v570: 129 pgs: 129 active+clean; 27 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:49:38.468 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:49:38 smithi119 ceph-mon[33693]: pgmap v570: 129 pgs: 129 active+clean; 27 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:49:40.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:49:40 smithi083 ceph-mon[31370]: pgmap v571: 129 pgs: 129 active+clean; 27 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T01:49:40.464 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:49:40 smithi142 ceph-mon[34050]: pgmap v571: 129 pgs: 129 active+clean; 27 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T01:49:40.467 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:49:40 smithi119 ceph-mon[33693]: pgmap v571: 129 pgs: 129 active+clean; 27 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T01:49:42.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:49:42 smithi083 ceph-mon[31370]: pgmap v572: 129 pgs: 129 active+clean; 27 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:49:42.464 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:49:42 smithi142 ceph-mon[34050]: pgmap v572: 129 pgs: 129 active+clean; 27 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:49:42.467 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:49:42 smithi119 ceph-mon[33693]: pgmap v572: 129 pgs: 129 active+clean; 27 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:49:44.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:49:44 smithi083 ceph-mon[31370]: pgmap v573: 129 pgs: 129 active+clean; 27 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:49:44.465 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:49:44 smithi142 ceph-mon[34050]: pgmap v573: 129 pgs: 129 active+clean; 27 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:49:44.467 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:49:44 smithi119 ceph-mon[33693]: pgmap v573: 129 pgs: 129 active+clean; 27 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:49:46.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:49:46 smithi083 ceph-mon[31370]: pgmap v574: 129 pgs: 129 active+clean; 27 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T01:49:46.464 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:49:46 smithi142 ceph-mon[34050]: pgmap v574: 129 pgs: 129 active+clean; 27 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T01:49:46.467 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:49:46 smithi119 ceph-mon[33693]: pgmap v574: 129 pgs: 129 active+clean; 27 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T01:49:48.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:49:48 smithi083 ceph-mon[31370]: pgmap v575: 129 pgs: 129 active+clean; 27 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:49:48.464 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:49:48 smithi142 ceph-mon[34050]: pgmap v575: 129 pgs: 129 active+clean; 27 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:49:48.467 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:49:48 smithi119 ceph-mon[33693]: pgmap v575: 129 pgs: 129 active+clean; 27 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:49:50.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:49:50 smithi083 ceph-mon[31370]: pgmap v576: 129 pgs: 129 active+clean; 27 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T01:49:50.464 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:49:50 smithi142 ceph-mon[34050]: pgmap v576: 129 pgs: 129 active+clean; 27 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T01:49:50.467 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:49:50 smithi119 ceph-mon[33693]: pgmap v576: 129 pgs: 129 active+clean; 27 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T01:49:52.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:49:52 smithi083 ceph-mon[31370]: pgmap v577: 129 pgs: 129 active+clean; 27 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:49:52.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:49:52 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:49:52.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:49:52 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T01:49:52.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:49:52 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T01:49:52.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:49:52 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T01:49:52.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:49:52 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-21T01:49:52.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:49:52 smithi083 ceph-mon[31370]: Adjusting osd_memory_target on smithi142 to 176.0M 2024-09-21T01:49:52.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:49:52 smithi083 ceph-mon[31370]: Unable to set osd_memory_target on smithi142 to 184563097: error parsing value: Value '184563097' is below minimum 939524096 2024-09-21T01:49:52.305 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:49:52 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:49:52.305 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:49:52 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:49:52.305 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:49:52 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:49:52.465 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:49:52 smithi142 ceph-mon[34050]: pgmap v577: 129 pgs: 129 active+clean; 27 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:49:52.465 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:49:52 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:49:52.465 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:49:52 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T01:49:52.465 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:49:52 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T01:49:52.465 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:49:52 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T01:49:52.465 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:49:52 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-21T01:49:52.465 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:49:52 smithi142 ceph-mon[34050]: Adjusting osd_memory_target on smithi142 to 176.0M 2024-09-21T01:49:52.465 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:49:52 smithi142 ceph-mon[34050]: Unable to set osd_memory_target on smithi142 to 184563097: error parsing value: Value '184563097' is below minimum 939524096 2024-09-21T01:49:52.465 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:49:52 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:49:52.465 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:49:52 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:49:52.465 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:49:52 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:49:52.468 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:49:52 smithi119 ceph-mon[33693]: pgmap v577: 129 pgs: 129 active+clean; 27 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:49:52.468 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:49:52 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:49:52.468 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:49:52 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T01:49:52.468 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:49:52 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T01:49:52.468 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:49:52 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T01:49:52.468 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:49:52 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-21T01:49:52.468 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:49:52 smithi119 ceph-mon[33693]: Adjusting osd_memory_target on smithi142 to 176.0M 2024-09-21T01:49:52.468 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:49:52 smithi119 ceph-mon[33693]: Unable to set osd_memory_target on smithi142 to 184563097: error parsing value: Value '184563097' is below minimum 939524096 2024-09-21T01:49:52.468 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:49:52 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:49:52.468 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:49:52 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:49:52.468 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:49:52 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:49:54.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:49:54 smithi083 ceph-mon[31370]: pgmap v578: 129 pgs: 129 active+clean; 27 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:49:54.464 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:49:54 smithi142 ceph-mon[34050]: pgmap v578: 129 pgs: 129 active+clean; 27 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:49:54.467 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:49:54 smithi119 ceph-mon[33693]: pgmap v578: 129 pgs: 129 active+clean; 27 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:49:56.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:49:56 smithi083 ceph-mon[31370]: pgmap v579: 129 pgs: 129 active+clean; 27 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T01:49:56.464 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:49:56 smithi142 ceph-mon[34050]: pgmap v579: 129 pgs: 129 active+clean; 27 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T01:49:56.467 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:49:56 smithi119 ceph-mon[33693]: pgmap v579: 129 pgs: 129 active+clean; 27 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T01:49:58.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:49:58 smithi083 ceph-mon[31370]: pgmap v580: 129 pgs: 129 active+clean; 27 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:49:58.464 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:49:58 smithi142 ceph-mon[34050]: pgmap v580: 129 pgs: 129 active+clean; 27 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:49:58.467 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:49:58 smithi119 ceph-mon[33693]: pgmap v580: 129 pgs: 129 active+clean; 27 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:50:00.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:50:00 smithi083 ceph-mon[31370]: pgmap v581: 129 pgs: 129 active+clean; 27 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T01:50:00.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:50:00 smithi083 ceph-mon[31370]: overall HEALTH_OK 2024-09-21T01:50:00.464 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:50:00 smithi142 ceph-mon[34050]: pgmap v581: 129 pgs: 129 active+clean; 27 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T01:50:00.465 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:50:00 smithi142 ceph-mon[34050]: overall HEALTH_OK 2024-09-21T01:50:00.467 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:50:00 smithi119 ceph-mon[33693]: pgmap v581: 129 pgs: 129 active+clean; 27 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T01:50:00.467 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:50:00 smithi119 ceph-mon[33693]: overall HEALTH_OK 2024-09-21T01:50:02.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:50:02 smithi083 ceph-mon[31370]: pgmap v582: 129 pgs: 129 active+clean; 27 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:50:02.464 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:50:02 smithi142 ceph-mon[34050]: pgmap v582: 129 pgs: 129 active+clean; 27 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:50:02.467 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:50:02 smithi119 ceph-mon[33693]: pgmap v582: 129 pgs: 129 active+clean; 27 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:50:04.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:50:04 smithi083 ceph-mon[31370]: pgmap v583: 129 pgs: 129 active+clean; 27 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 22 KiB/s wr, 3 op/s 2024-09-21T01:50:04.464 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:50:04 smithi142 ceph-mon[34050]: pgmap v583: 129 pgs: 129 active+clean; 27 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 22 KiB/s wr, 3 op/s 2024-09-21T01:50:04.467 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:50:04 smithi119 ceph-mon[33693]: pgmap v583: 129 pgs: 129 active+clean; 27 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 22 KiB/s wr, 3 op/s 2024-09-21T01:50:06.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:50:06 smithi083 ceph-mon[31370]: pgmap v584: 129 pgs: 129 active+clean; 27 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2024-09-21T01:50:06.464 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:50:06 smithi142 ceph-mon[34050]: pgmap v584: 129 pgs: 129 active+clean; 27 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2024-09-21T01:50:06.467 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:50:06 smithi119 ceph-mon[33693]: pgmap v584: 129 pgs: 129 active+clean; 27 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2024-09-21T01:50:08.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:50:08 smithi083 ceph-mon[31370]: pgmap v585: 129 pgs: 129 active+clean; 27 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 45 KiB/s wr, 18 op/s 2024-09-21T01:50:08.464 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:50:08 smithi142 ceph-mon[34050]: pgmap v585: 129 pgs: 129 active+clean; 27 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 45 KiB/s wr, 18 op/s 2024-09-21T01:50:08.467 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:50:08 smithi119 ceph-mon[33693]: pgmap v585: 129 pgs: 129 active+clean; 27 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 45 KiB/s wr, 18 op/s 2024-09-21T01:50:10.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:50:10 smithi083 ceph-mon[31370]: pgmap v586: 129 pgs: 129 active+clean; 27 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2024-09-21T01:50:10.464 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:50:10 smithi142 ceph-mon[34050]: pgmap v586: 129 pgs: 129 active+clean; 27 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2024-09-21T01:50:10.467 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:50:10 smithi119 ceph-mon[33693]: pgmap v586: 129 pgs: 129 active+clean; 27 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2024-09-21T01:50:11.464 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:50:11 smithi142 ceph-mon[34050]: osdmap e89: 12 total, 12 up, 12 in 2024-09-21T01:50:11.467 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:50:11 smithi119 ceph-mon[33693]: osdmap e89: 12 total, 12 up, 12 in 2024-09-21T01:50:11.553 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:50:11 smithi083 ceph-mon[31370]: osdmap e89: 12 total, 12 up, 12 in 2024-09-21T01:50:12.464 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:50:12 smithi142 ceph-mon[34050]: pgmap v588: 129 pgs: 129 active+clean; 27 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 22 op/s 2024-09-21T01:50:12.467 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:50:12 smithi119 ceph-mon[33693]: pgmap v588: 129 pgs: 129 active+clean; 27 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 22 op/s 2024-09-21T01:50:12.554 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:50:12 smithi083 ceph-mon[31370]: pgmap v588: 129 pgs: 129 active+clean; 27 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 22 op/s 2024-09-21T01:50:14.464 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:50:14 smithi142 ceph-mon[34050]: pgmap v589: 129 pgs: 129 active+clean; 27 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 27 KiB/s wr, 19 op/s 2024-09-21T01:50:14.467 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:50:14 smithi119 ceph-mon[33693]: pgmap v589: 129 pgs: 129 active+clean; 27 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 27 KiB/s wr, 19 op/s 2024-09-21T01:50:14.554 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:50:14 smithi083 ceph-mon[31370]: pgmap v589: 129 pgs: 129 active+clean; 27 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 27 KiB/s wr, 19 op/s 2024-09-21T01:50:16.464 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:50:16 smithi142 ceph-mon[34050]: pgmap v590: 129 pgs: 129 active+clean; 27 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-21T01:50:16.467 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:50:16 smithi119 ceph-mon[33693]: pgmap v590: 129 pgs: 129 active+clean; 27 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-21T01:50:16.554 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:50:16 smithi083 ceph-mon[31370]: pgmap v590: 129 pgs: 129 active+clean; 27 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-21T01:50:18.464 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:50:18 smithi142 ceph-mon[34050]: pgmap v591: 129 pgs: 129 active+clean; 27 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-21T01:50:18.467 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:50:18 smithi119 ceph-mon[33693]: pgmap v591: 129 pgs: 129 active+clean; 27 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-21T01:50:18.553 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:50:18 smithi083 ceph-mon[31370]: pgmap v591: 129 pgs: 129 active+clean; 27 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-21T01:50:20.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:50:19 smithi083 ceph-mon[31370]: pgmap v592: 129 pgs: 129 active+clean; 27 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-21T01:50:20.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:50:19 smithi083 ceph-mon[31370]: osdmap e90: 12 total, 12 up, 12 in 2024-09-21T01:50:20.464 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:50:19 smithi142 ceph-mon[34050]: pgmap v592: 129 pgs: 129 active+clean; 27 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-21T01:50:20.464 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:50:19 smithi142 ceph-mon[34050]: osdmap e90: 12 total, 12 up, 12 in 2024-09-21T01:50:20.467 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:50:19 smithi119 ceph-mon[33693]: pgmap v592: 129 pgs: 129 active+clean; 27 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-21T01:50:20.467 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:50:19 smithi119 ceph-mon[33693]: osdmap e90: 12 total, 12 up, 12 in 2024-09-21T01:50:22.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:50:21 smithi083 ceph-mon[31370]: pgmap v594: 129 pgs: 129 active+clean; 27 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-21T01:50:22.464 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:50:21 smithi142 ceph-mon[34050]: pgmap v594: 129 pgs: 129 active+clean; 27 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-21T01:50:22.467 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:50:21 smithi119 ceph-mon[33693]: pgmap v594: 129 pgs: 129 active+clean; 27 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-21T01:50:24.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:50:23 smithi083 ceph-mon[31370]: pgmap v595: 129 pgs: 129 active+clean; 27 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-21T01:50:24.465 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:50:23 smithi142 ceph-mon[34050]: pgmap v595: 129 pgs: 129 active+clean; 27 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-21T01:50:24.467 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:50:23 smithi119 ceph-mon[33693]: pgmap v595: 129 pgs: 129 active+clean; 27 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-21T01:50:26.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:50:25 smithi083 ceph-mon[31370]: pgmap v596: 129 pgs: 129 active+clean; 27 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-21T01:50:26.464 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:50:25 smithi142 ceph-mon[34050]: pgmap v596: 129 pgs: 129 active+clean; 27 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-21T01:50:26.467 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:50:25 smithi119 ceph-mon[33693]: pgmap v596: 129 pgs: 129 active+clean; 27 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-21T01:50:28.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:50:27 smithi083 ceph-mon[31370]: pgmap v597: 129 pgs: 129 active+clean; 27 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-21T01:50:28.464 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:50:27 smithi142 ceph-mon[34050]: pgmap v597: 129 pgs: 129 active+clean; 27 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-21T01:50:28.467 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:50:27 smithi119 ceph-mon[33693]: pgmap v597: 129 pgs: 129 active+clean; 27 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-21T01:50:30.267 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:50:29 smithi142 ceph-mon[34050]: pgmap v598: 129 pgs: 129 active+clean; 27 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-21T01:50:30.270 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:50:29 smithi119 ceph-mon[33693]: pgmap v598: 129 pgs: 129 active+clean; 27 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-21T01:50:30.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:50:29 smithi083 ceph-mon[31370]: pgmap v598: 129 pgs: 129 active+clean; 27 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-21T01:50:32.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:50:31 smithi083 ceph-mon[31370]: pgmap v599: 129 pgs: 129 active+clean; 27 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:50:32.464 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:50:31 smithi142 ceph-mon[34050]: pgmap v599: 129 pgs: 129 active+clean; 27 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:50:32.467 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:50:31 smithi119 ceph-mon[33693]: pgmap v599: 129 pgs: 129 active+clean; 27 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:50:34.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:50:33 smithi083 ceph-mon[31370]: pgmap v600: 129 pgs: 129 active+clean; 27 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:50:34.464 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:50:33 smithi142 ceph-mon[34050]: pgmap v600: 129 pgs: 129 active+clean; 27 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:50:34.467 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:50:33 smithi119 ceph-mon[33693]: pgmap v600: 129 pgs: 129 active+clean; 27 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:50:36.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:50:35 smithi083 ceph-mon[31370]: pgmap v601: 129 pgs: 129 active+clean; 27 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T01:50:36.464 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:50:35 smithi142 ceph-mon[34050]: pgmap v601: 129 pgs: 129 active+clean; 27 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T01:50:36.467 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:50:35 smithi119 ceph-mon[33693]: pgmap v601: 129 pgs: 129 active+clean; 27 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T01:50:38.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:50:37 smithi083 ceph-mon[31370]: pgmap v602: 129 pgs: 129 active+clean; 27 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:50:38.464 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:50:37 smithi142 ceph-mon[34050]: pgmap v602: 129 pgs: 129 active+clean; 27 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:50:38.467 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:50:38 smithi119 ceph-mon[33693]: pgmap v602: 129 pgs: 129 active+clean; 27 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:50:40.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:50:40 smithi083 ceph-mon[31370]: pgmap v603: 129 pgs: 129 active+clean; 27 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T01:50:40.464 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:50:40 smithi142 ceph-mon[34050]: pgmap v603: 129 pgs: 129 active+clean; 27 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T01:50:40.467 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:50:40 smithi119 ceph-mon[33693]: pgmap v603: 129 pgs: 129 active+clean; 27 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T01:50:42.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:50:42 smithi083 ceph-mon[31370]: pgmap v604: 129 pgs: 129 active+clean; 27 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:50:42.465 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:50:42 smithi142 ceph-mon[34050]: pgmap v604: 129 pgs: 129 active+clean; 27 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:50:42.467 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:50:42 smithi119 ceph-mon[33693]: pgmap v604: 129 pgs: 129 active+clean; 27 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:50:44.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:50:44 smithi083 ceph-mon[31370]: pgmap v605: 129 pgs: 129 active+clean; 27 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:50:44.464 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:50:44 smithi142 ceph-mon[34050]: pgmap v605: 129 pgs: 129 active+clean; 27 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:50:44.467 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:50:44 smithi119 ceph-mon[33693]: pgmap v605: 129 pgs: 129 active+clean; 27 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:50:46.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:50:46 smithi083 ceph-mon[31370]: pgmap v606: 129 pgs: 129 active+clean; 27 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T01:50:46.464 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:50:46 smithi142 ceph-mon[34050]: pgmap v606: 129 pgs: 129 active+clean; 27 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T01:50:46.467 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:50:46 smithi119 ceph-mon[33693]: pgmap v606: 129 pgs: 129 active+clean; 27 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T01:50:48.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:50:48 smithi083 ceph-mon[31370]: pgmap v607: 129 pgs: 129 active+clean; 27 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:50:48.464 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:50:48 smithi142 ceph-mon[34050]: pgmap v607: 129 pgs: 129 active+clean; 27 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:50:48.467 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:50:48 smithi119 ceph-mon[33693]: pgmap v607: 129 pgs: 129 active+clean; 27 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:50:50.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:50:50 smithi083 ceph-mon[31370]: pgmap v608: 129 pgs: 129 active+clean; 27 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T01:50:50.464 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:50:50 smithi142 ceph-mon[34050]: pgmap v608: 129 pgs: 129 active+clean; 27 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T01:50:50.467 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:50:50 smithi119 ceph-mon[33693]: pgmap v608: 129 pgs: 129 active+clean; 27 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T01:50:52.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:50:52 smithi083 ceph-mon[31370]: pgmap v609: 129 pgs: 129 active+clean; 27 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:50:52.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:50:52 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:50:52.464 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:50:52 smithi142 ceph-mon[34050]: pgmap v609: 129 pgs: 129 active+clean; 27 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:50:52.464 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:50:52 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:50:52.467 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:50:52 smithi119 ceph-mon[33693]: pgmap v609: 129 pgs: 129 active+clean; 27 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:50:52.467 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:50:52 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:50:53.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:50:53 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:50:53.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:50:53 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:50:53.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:50:53 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:50:53.464 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:50:53 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:50:53.464 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:50:53 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:50:53.465 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:50:53 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:50:53.467 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:50:53 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:50:53.467 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:50:53 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:50:53.468 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:50:53 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:50:54.554 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:50:54 smithi083 ceph-mon[31370]: pgmap v610: 129 pgs: 129 active+clean; 27 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:50:54.714 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:50:54 smithi142 ceph-mon[34050]: pgmap v610: 129 pgs: 129 active+clean; 27 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:50:54.717 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:50:54 smithi119 ceph-mon[33693]: pgmap v610: 129 pgs: 129 active+clean; 27 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:50:56.553 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:50:56 smithi083 ceph-mon[31370]: pgmap v611: 129 pgs: 129 active+clean; 27 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T01:50:56.714 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:50:56 smithi142 ceph-mon[34050]: pgmap v611: 129 pgs: 129 active+clean; 27 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T01:50:56.717 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:50:56 smithi119 ceph-mon[33693]: pgmap v611: 129 pgs: 129 active+clean; 27 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T01:50:58.554 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:50:58 smithi083 ceph-mon[31370]: pgmap v612: 129 pgs: 129 active+clean; 27 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:50:58.714 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:50:58 smithi142 ceph-mon[34050]: pgmap v612: 129 pgs: 129 active+clean; 27 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:50:58.717 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:50:58 smithi119 ceph-mon[33693]: pgmap v612: 129 pgs: 129 active+clean; 27 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:51:00.516 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:51:00 smithi142 ceph-mon[34050]: pgmap v613: 129 pgs: 129 active+clean; 27 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T01:51:00.519 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:51:00 smithi119 ceph-mon[33693]: pgmap v613: 129 pgs: 129 active+clean; 27 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T01:51:00.553 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:51:00 smithi083 ceph-mon[31370]: pgmap v613: 129 pgs: 129 active+clean; 27 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T01:51:02.553 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:51:02 smithi083 ceph-mon[31370]: pgmap v614: 129 pgs: 129 active+clean; 27 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:51:02.714 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:51:02 smithi142 ceph-mon[34050]: pgmap v614: 129 pgs: 129 active+clean; 27 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:51:02.718 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:51:02 smithi119 ceph-mon[33693]: pgmap v614: 129 pgs: 129 active+clean; 27 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:51:04.553 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:51:04 smithi083 ceph-mon[31370]: pgmap v615: 129 pgs: 129 active+clean; 27 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 22 KiB/s wr, 3 op/s 2024-09-21T01:51:04.714 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:51:04 smithi142 ceph-mon[34050]: pgmap v615: 129 pgs: 129 active+clean; 27 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 22 KiB/s wr, 3 op/s 2024-09-21T01:51:04.717 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:51:04 smithi119 ceph-mon[33693]: pgmap v615: 129 pgs: 129 active+clean; 27 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 22 KiB/s wr, 3 op/s 2024-09-21T01:51:06.553 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:51:06 smithi083 ceph-mon[31370]: pgmap v616: 129 pgs: 129 active+clean; 27 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 19 op/s 2024-09-21T01:51:06.714 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:51:06 smithi142 ceph-mon[34050]: pgmap v616: 129 pgs: 129 active+clean; 27 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 19 op/s 2024-09-21T01:51:06.717 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:51:06 smithi119 ceph-mon[33693]: pgmap v616: 129 pgs: 129 active+clean; 27 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 19 op/s 2024-09-21T01:51:08.553 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:51:08 smithi083 ceph-mon[31370]: pgmap v617: 129 pgs: 129 active+clean; 27 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 44 KiB/s wr, 18 op/s 2024-09-21T01:51:08.715 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:51:08 smithi142 ceph-mon[34050]: pgmap v617: 129 pgs: 129 active+clean; 27 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 44 KiB/s wr, 18 op/s 2024-09-21T01:51:08.717 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:51:08 smithi119 ceph-mon[33693]: pgmap v617: 129 pgs: 129 active+clean; 27 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 44 KiB/s wr, 18 op/s 2024-09-21T01:51:10.553 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:51:10 smithi083 ceph-mon[31370]: pgmap v618: 129 pgs: 129 active+clean; 27 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 19 op/s 2024-09-21T01:51:10.714 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:51:10 smithi142 ceph-mon[34050]: pgmap v618: 129 pgs: 129 active+clean; 27 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 19 op/s 2024-09-21T01:51:10.717 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:51:10 smithi119 ceph-mon[33693]: pgmap v618: 129 pgs: 129 active+clean; 27 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 19 op/s 2024-09-21T01:51:11.553 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:51:11 smithi083 ceph-mon[31370]: osdmap e91: 12 total, 12 up, 12 in 2024-09-21T01:51:11.714 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:51:11 smithi142 ceph-mon[34050]: osdmap e91: 12 total, 12 up, 12 in 2024-09-21T01:51:11.717 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:51:11 smithi119 ceph-mon[33693]: osdmap e91: 12 total, 12 up, 12 in 2024-09-21T01:51:12.553 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:51:12 smithi083 ceph-mon[31370]: pgmap v620: 129 pgs: 129 active+clean; 27 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 53 KiB/s wr, 22 op/s 2024-09-21T01:51:12.714 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:51:12 smithi142 ceph-mon[34050]: pgmap v620: 129 pgs: 129 active+clean; 27 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 53 KiB/s wr, 22 op/s 2024-09-21T01:51:12.717 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:51:12 smithi119 ceph-mon[33693]: pgmap v620: 129 pgs: 129 active+clean; 27 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 53 KiB/s wr, 22 op/s 2024-09-21T01:51:14.553 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:51:14 smithi083 ceph-mon[31370]: pgmap v621: 129 pgs: 129 active+clean; 27 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 27 KiB/s wr, 19 op/s 2024-09-21T01:51:14.714 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:51:14 smithi142 ceph-mon[34050]: pgmap v621: 129 pgs: 129 active+clean; 27 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 27 KiB/s wr, 19 op/s 2024-09-21T01:51:14.717 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:51:14 smithi119 ceph-mon[33693]: pgmap v621: 129 pgs: 129 active+clean; 27 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 27 KiB/s wr, 19 op/s 2024-09-21T01:51:16.554 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:51:16 smithi083 ceph-mon[31370]: pgmap v622: 129 pgs: 129 active+clean; 27 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-21T01:51:16.714 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:51:16 smithi142 ceph-mon[34050]: pgmap v622: 129 pgs: 129 active+clean; 27 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-21T01:51:16.717 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:51:16 smithi119 ceph-mon[33693]: pgmap v622: 129 pgs: 129 active+clean; 27 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-21T01:51:18.553 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:51:18 smithi083 ceph-mon[31370]: pgmap v623: 129 pgs: 129 active+clean; 27 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-21T01:51:18.714 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:51:18 smithi142 ceph-mon[34050]: pgmap v623: 129 pgs: 129 active+clean; 27 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-21T01:51:18.717 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:51:18 smithi119 ceph-mon[33693]: pgmap v623: 129 pgs: 129 active+clean; 27 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-21T01:51:20.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:51:19 smithi083 ceph-mon[31370]: pgmap v624: 129 pgs: 129 active+clean; 27 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-21T01:51:20.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:51:19 smithi083 ceph-mon[31370]: osdmap e92: 12 total, 12 up, 12 in 2024-09-21T01:51:20.464 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:51:19 smithi142 ceph-mon[34050]: pgmap v624: 129 pgs: 129 active+clean; 27 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-21T01:51:20.464 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:51:19 smithi142 ceph-mon[34050]: osdmap e92: 12 total, 12 up, 12 in 2024-09-21T01:51:20.467 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:51:19 smithi119 ceph-mon[33693]: pgmap v624: 129 pgs: 129 active+clean; 27 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-21T01:51:20.467 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:51:19 smithi119 ceph-mon[33693]: osdmap e92: 12 total, 12 up, 12 in 2024-09-21T01:51:22.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:51:21 smithi083 ceph-mon[31370]: pgmap v626: 129 pgs: 129 active+clean; 27 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-21T01:51:22.464 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:51:21 smithi142 ceph-mon[34050]: pgmap v626: 129 pgs: 129 active+clean; 27 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-21T01:51:22.467 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:51:21 smithi119 ceph-mon[33693]: pgmap v626: 129 pgs: 129 active+clean; 27 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-21T01:51:24.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:51:23 smithi083 ceph-mon[31370]: pgmap v627: 129 pgs: 129 active+clean; 27 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-21T01:51:24.464 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:51:23 smithi142 ceph-mon[34050]: pgmap v627: 129 pgs: 129 active+clean; 27 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-21T01:51:24.467 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:51:23 smithi119 ceph-mon[33693]: pgmap v627: 129 pgs: 129 active+clean; 27 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-21T01:51:26.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:51:25 smithi083 ceph-mon[31370]: pgmap v628: 129 pgs: 129 active+clean; 27 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-21T01:51:26.464 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:51:25 smithi142 ceph-mon[34050]: pgmap v628: 129 pgs: 129 active+clean; 27 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-21T01:51:26.467 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:51:25 smithi119 ceph-mon[33693]: pgmap v628: 129 pgs: 129 active+clean; 27 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-21T01:51:28.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:51:27 smithi083 ceph-mon[31370]: pgmap v629: 129 pgs: 129 active+clean; 27 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-21T01:51:28.464 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:51:27 smithi142 ceph-mon[34050]: pgmap v629: 129 pgs: 129 active+clean; 27 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-21T01:51:28.467 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:51:27 smithi119 ceph-mon[33693]: pgmap v629: 129 pgs: 129 active+clean; 27 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-21T01:51:30.266 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:51:30 smithi142 ceph-mon[34050]: pgmap v630: 129 pgs: 129 active+clean; 27 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-21T01:51:30.270 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:51:30 smithi119 ceph-mon[33693]: pgmap v630: 129 pgs: 129 active+clean; 27 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-21T01:51:30.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:51:30 smithi083 ceph-mon[31370]: pgmap v630: 129 pgs: 129 active+clean; 27 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-21T01:51:32.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:51:32 smithi083 ceph-mon[31370]: pgmap v631: 129 pgs: 129 active+clean; 27 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:51:32.464 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:51:32 smithi142 ceph-mon[34050]: pgmap v631: 129 pgs: 129 active+clean; 27 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:51:32.467 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:51:32 smithi119 ceph-mon[33693]: pgmap v631: 129 pgs: 129 active+clean; 27 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:51:34.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:51:34 smithi083 ceph-mon[31370]: pgmap v632: 129 pgs: 129 active+clean; 27 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:51:34.464 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:51:34 smithi142 ceph-mon[34050]: pgmap v632: 129 pgs: 129 active+clean; 27 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:51:34.467 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:51:34 smithi119 ceph-mon[33693]: pgmap v632: 129 pgs: 129 active+clean; 27 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:51:36.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:51:36 smithi083 ceph-mon[31370]: pgmap v633: 129 pgs: 129 active+clean; 27 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T01:51:36.464 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:51:36 smithi142 ceph-mon[34050]: pgmap v633: 129 pgs: 129 active+clean; 27 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T01:51:36.467 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:51:36 smithi119 ceph-mon[33693]: pgmap v633: 129 pgs: 129 active+clean; 27 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T01:51:38.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:51:38 smithi083 ceph-mon[31370]: pgmap v634: 129 pgs: 129 active+clean; 27 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:51:38.464 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:51:38 smithi142 ceph-mon[34050]: pgmap v634: 129 pgs: 129 active+clean; 27 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:51:38.467 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:51:38 smithi119 ceph-mon[33693]: pgmap v634: 129 pgs: 129 active+clean; 27 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:51:40.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:51:40 smithi083 ceph-mon[31370]: pgmap v635: 129 pgs: 129 active+clean; 27 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T01:51:40.464 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:51:40 smithi142 ceph-mon[34050]: pgmap v635: 129 pgs: 129 active+clean; 27 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T01:51:40.467 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:51:40 smithi119 ceph-mon[33693]: pgmap v635: 129 pgs: 129 active+clean; 27 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T01:51:42.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:51:42 smithi083 ceph-mon[31370]: pgmap v636: 129 pgs: 129 active+clean; 27 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:51:42.464 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:51:42 smithi142 ceph-mon[34050]: pgmap v636: 129 pgs: 129 active+clean; 27 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:51:42.467 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:51:42 smithi119 ceph-mon[33693]: pgmap v636: 129 pgs: 129 active+clean; 27 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:51:44.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:51:44 smithi083 ceph-mon[31370]: pgmap v637: 129 pgs: 129 active+clean; 27 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:51:44.464 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:51:44 smithi142 ceph-mon[34050]: pgmap v637: 129 pgs: 129 active+clean; 27 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:51:44.467 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:51:44 smithi119 ceph-mon[33693]: pgmap v637: 129 pgs: 129 active+clean; 27 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:51:46.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:51:46 smithi083 ceph-mon[31370]: pgmap v638: 129 pgs: 129 active+clean; 27 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T01:51:46.465 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:51:46 smithi142 ceph-mon[34050]: pgmap v638: 129 pgs: 129 active+clean; 27 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T01:51:46.496 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:51:46 smithi119 ceph-mon[33693]: pgmap v638: 129 pgs: 129 active+clean; 27 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T01:51:48.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:51:48 smithi083 ceph-mon[31370]: pgmap v639: 129 pgs: 129 active+clean; 27 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:51:48.464 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:51:48 smithi142 ceph-mon[34050]: pgmap v639: 129 pgs: 129 active+clean; 27 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:51:48.467 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:51:48 smithi119 ceph-mon[33693]: pgmap v639: 129 pgs: 129 active+clean; 27 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:51:50.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:51:50 smithi083 ceph-mon[31370]: pgmap v640: 129 pgs: 129 active+clean; 27 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T01:51:50.464 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:51:50 smithi142 ceph-mon[34050]: pgmap v640: 129 pgs: 129 active+clean; 27 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T01:51:50.467 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:51:50 smithi119 ceph-mon[33693]: pgmap v640: 129 pgs: 129 active+clean; 27 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T01:51:52.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:51:52 smithi083 ceph-mon[31370]: pgmap v641: 129 pgs: 129 active+clean; 27 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:51:52.465 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:51:52 smithi142 ceph-mon[34050]: pgmap v641: 129 pgs: 129 active+clean; 27 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:51:52.468 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:51:52 smithi119 ceph-mon[33693]: pgmap v641: 129 pgs: 129 active+clean; 27 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:51:53.163 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:51:53 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:51:53.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:51:53 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:51:53.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:51:53 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T01:51:54.964 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:51:54 smithi142 ceph-mon[34050]: pgmap v642: 129 pgs: 129 active+clean; 27 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:51:54.965 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:51:54 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:51:54.965 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:51:54 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:51:54.965 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:51:54 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:51:54.965 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:51:54 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:51:54.965 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:51:54 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:51:54.965 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:51:54 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:51:54.965 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:51:54 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:51:54.965 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:51:54 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:51:54.965 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:51:54 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:51:54.967 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:51:54 smithi119 ceph-mon[33693]: pgmap v642: 129 pgs: 129 active+clean; 27 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:51:54.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:51:54 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:51:54.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:51:54 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:51:54.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:51:54 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:51:54.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:51:54 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:51:54.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:51:54 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:51:54.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:51:54 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:51:54.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:51:54 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:51:54.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:51:54 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:51:54.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:51:54 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:51:55.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:51:54 smithi083 ceph-mon[31370]: pgmap v642: 129 pgs: 129 active+clean; 27 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:51:55.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:51:54 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:51:55.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:51:54 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:51:55.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:51:54 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:51:55.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:51:54 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:51:55.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:51:54 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:51:55.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:51:54 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:51:55.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:51:54 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T01:51:55.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:51:54 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T01:51:55.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:51:54 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' 2024-09-21T01:51:56.758 DEBUG:teuthology.orchestra.run.smithi083:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2024-09-21T01:51:56.883 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:56.883+0000 7f6a623f1640 1 -- 172.21.15.83:0/1097220975 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6a5c1082e0 msgr2=0x7f6a5c1086f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:51:56.883 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:56.883+0000 7f6a623f1640 1 --2- 172.21.15.83:0/1097220975 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6a5c1082e0 0x7f6a5c1086f0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f6a50009900 tx=0x7f6a5002a410 comp rx=0 tx=0).stop 2024-09-21T01:51:56.884 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:56.883+0000 7f6a623f1640 1 -- 172.21.15.83:0/1097220975 shutdown_connections 2024-09-21T01:51:56.884 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:56.883+0000 7f6a623f1640 1 --2- 172.21.15.83:0/1097220975 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a5c108c30 0x7f6a5c10f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:51:56.884 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:56.883+0000 7f6a623f1640 1 --2- 172.21.15.83:0/1097220975 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6a5c1082e0 0x7f6a5c1086f0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:51:56.884 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:56.883+0000 7f6a623f1640 1 --2- 172.21.15.83:0/1097220975 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6a5c1029b0 0x7f6a5c102dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:51:56.884 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:56.883+0000 7f6a623f1640 1 -- 172.21.15.83:0/1097220975 >> 172.21.15.83:0/1097220975 conn(0x7f6a5c07a740 msgr2=0x7f6a5c07ab50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:51:56.884 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:56.883+0000 7f6a623f1640 1 -- 172.21.15.83:0/1097220975 shutdown_connections 2024-09-21T01:51:56.884 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:56.883+0000 7f6a623f1640 1 -- 172.21.15.83:0/1097220975 wait complete. 2024-09-21T01:51:56.886 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:56.883+0000 7f6a623f1640 1 Processor -- start 2024-09-21T01:51:56.886 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:56.883+0000 7f6a623f1640 1 -- start start 2024-09-21T01:51:56.886 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:56.884+0000 7f6a623f1640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6a5c1029b0 0x7f6a5c1992e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:51:56.886 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:56.884+0000 7f6a623f1640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6a5c1082e0 0x7f6a5c199880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:51:56.886 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:56.884+0000 7f6a623f1640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a5c108c30 0x7f6a5c19eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:51:56.886 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:56.884+0000 7f6a623f1640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f6a5c1127a0 con 0x7f6a5c1082e0 2024-09-21T01:51:56.886 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:56.884+0000 7f6a623f1640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f6a5c112620 con 0x7f6a5c1029b0 2024-09-21T01:51:56.886 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:56.884+0000 7f6a623f1640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f6a5c112920 con 0x7f6a5c108c30 2024-09-21T01:51:56.887 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:56.884+0000 7f6a5b7fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6a5c1082e0 0x7f6a5c199880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:51:56.887 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:56.884+0000 7f6a5b7fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6a5c1082e0 0x7f6a5c199880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:51776/0 (socket says 172.21.15.83:51776) 2024-09-21T01:51:56.887 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:56.884+0000 7f6a5b7fe640 1 -- 172.21.15.83:0/1718827811 learned_addr learned my addr 172.21.15.83:0/1718827811 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:51:56.887 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:56.884+0000 7f6a6098e640 1 --2- 172.21.15.83:0/1718827811 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a5c108c30 0x7f6a5c19eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:51:56.887 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:56.884+0000 7f6a5bfff640 1 --2- 172.21.15.83:0/1718827811 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6a5c1029b0 0x7f6a5c1992e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:51:56.887 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:56.884+0000 7f6a5b7fe640 1 -- 172.21.15.83:0/1718827811 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a5c108c30 msgr2=0x7f6a5c19eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:51:56.887 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:56.884+0000 7f6a5b7fe640 1 --2- 172.21.15.83:0/1718827811 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a5c108c30 0x7f6a5c19eb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:51:56.887 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:56.884+0000 7f6a5b7fe640 1 -- 172.21.15.83:0/1718827811 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6a5c1029b0 msgr2=0x7f6a5c1992e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:51:56.887 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:56.884+0000 7f6a5b7fe640 1 --2- 172.21.15.83:0/1718827811 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6a5c1029b0 0x7f6a5c1992e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:51:56.887 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:56.884+0000 7f6a5b7fe640 1 -- 172.21.15.83:0/1718827811 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a5c19f210 con 0x7f6a5c1082e0 2024-09-21T01:51:56.887 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:56.885+0000 7f6a5b7fe640 1 --2- 172.21.15.83:0/1718827811 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6a5c1082e0 0x7f6a5c199880 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f6a50004770 tx=0x7f6a50004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:51:56.887 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:56.885+0000 7f6a597fa640 1 -- 172.21.15.83:0/1718827811 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a5003f030 con 0x7f6a5c1082e0 2024-09-21T01:51:56.887 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:56.885+0000 7f6a597fa640 1 -- 172.21.15.83:0/1718827811 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6a50004440 con 0x7f6a5c1082e0 2024-09-21T01:51:56.888 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:56.885+0000 7f6a597fa640 1 -- 172.21.15.83:0/1718827811 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a50035070 con 0x7f6a5c1082e0 2024-09-21T01:51:56.888 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:56.885+0000 7f6a623f1640 1 -- 172.21.15.83:0/1718827811 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a5c19f4a0 con 0x7f6a5c1082e0 2024-09-21T01:51:56.888 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:56.885+0000 7f6a623f1640 1 -- 172.21.15.83:0/1718827811 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a5c19f940 con 0x7f6a5c1082e0 2024-09-21T01:51:56.889 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:56.886+0000 7f6a623f1640 1 -- 172.21.15.83:0/1718827811 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a5c102dc0 con 0x7f6a5c1082e0 2024-09-21T01:51:56.889 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:56.887+0000 7f6a597fa640 1 -- 172.21.15.83:0/1718827811 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7f6a50042030 con 0x7f6a5c1082e0 2024-09-21T01:51:56.889 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:56.888+0000 7f6a597fa640 1 --2- 172.21.15.83:0/1718827811 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f6a440b6700 0x7f6a440b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:51:56.889 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:56.888+0000 7f6a5bfff640 1 --2- 172.21.15.83:0/1718827811 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f6a440b6700 0x7f6a440b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:51:56.889 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:56.888+0000 7f6a597fa640 1 -- 172.21.15.83:0/1718827811 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9403+0+0 (secure 0 0 0) 0x7f6a50107d50 con 0x7f6a5c1082e0 2024-09-21T01:51:56.889 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:56.889+0000 7f6a5bfff640 1 --2- 172.21.15.83:0/1718827811 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f6a440b6700 0x7f6a440b8c10 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f6a4c005d00 tx=0x7f6a4c00b410 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:51:56.893 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:56.893+0000 7f6a597fa640 1 -- 172.21.15.83:0/1718827811 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6a5010b030 con 0x7f6a5c1082e0 2024-09-21T01:51:56.964 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:51:56 smithi142 ceph-mon[34050]: pgmap v643: 129 pgs: 129 active+clean; 27 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T01:51:56.967 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:51:56 smithi119 ceph-mon[33693]: pgmap v643: 129 pgs: 129 active+clean; 27 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T01:51:57.053 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:51:56 smithi083 ceph-mon[31370]: pgmap v643: 129 pgs: 129 active+clean; 27 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T01:51:57.089 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:57.089+0000 7f6a623f1640 1 -- 172.21.15.83:0/1718827811 --> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) -- 0x7f6a5c063800 con 0x7f6a440b6700 2024-09-21T01:51:57.098 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:57.097+0000 7f6a597fa640 1 -- 172.21.15.83:0/1718827811 <== mgr.14223 v2:172.21.15.83:6800/1748483157 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+350 (secure 0 0 0) 0x7f6a5c063800 con 0x7f6a440b6700 2024-09-21T01:51:57.098 INFO:teuthology.orchestra.run.smithi083.stdout:{"fs": "cephfs", "subvol": null, "group": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2024-09-21T00:00:00", "created": "2024-09-21T01:41:55", "first": "2024-09-21T01:42:00", "last": "2024-09-21T01:51:00", "last_pruned": "2024-09-21T01:51:00", "created_count": 10, "pruned_count": 4, "active": true} 2024-09-21T01:51:57.100 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:57.099+0000 7f6a623f1640 1 -- 172.21.15.83:0/1718827811 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f6a440b6700 msgr2=0x7f6a440b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:51:57.100 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:57.099+0000 7f6a623f1640 1 --2- 172.21.15.83:0/1718827811 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f6a440b6700 0x7f6a440b8c10 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f6a4c005d00 tx=0x7f6a4c00b410 comp rx=0 tx=0).stop 2024-09-21T01:51:57.100 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:57.099+0000 7f6a623f1640 1 -- 172.21.15.83:0/1718827811 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6a5c1082e0 msgr2=0x7f6a5c199880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:51:57.100 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:57.099+0000 7f6a623f1640 1 --2- 172.21.15.83:0/1718827811 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6a5c1082e0 0x7f6a5c199880 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f6a50004770 tx=0x7f6a50004040 comp rx=0 tx=0).stop 2024-09-21T01:51:57.101 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:57.100+0000 7f6a623f1640 1 -- 172.21.15.83:0/1718827811 shutdown_connections 2024-09-21T01:51:57.101 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:57.100+0000 7f6a623f1640 1 --2- 172.21.15.83:0/1718827811 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f6a440b6700 0x7f6a440b8c10 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:51:57.101 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:57.100+0000 7f6a623f1640 1 --2- 172.21.15.83:0/1718827811 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a5c108c30 0x7f6a5c19eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:51:57.101 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:57.100+0000 7f6a623f1640 1 --2- 172.21.15.83:0/1718827811 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6a5c1082e0 0x7f6a5c199880 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:51:57.101 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:57.100+0000 7f6a623f1640 1 --2- 172.21.15.83:0/1718827811 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6a5c1029b0 0x7f6a5c1992e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:51:57.101 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:57.100+0000 7f6a623f1640 1 -- 172.21.15.83:0/1718827811 >> 172.21.15.83:0/1718827811 conn(0x7f6a5c07a740 msgr2=0x7f6a5c106480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:51:57.101 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:57.100+0000 7f6a623f1640 1 -- 172.21.15.83:0/1718827811 shutdown_connections 2024-09-21T01:51:57.101 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:57.100+0000 7f6a623f1640 1 -- 172.21.15.83:0/1718827811 wait complete. 2024-09-21T01:51:57.111 DEBUG:teuthology.orchestra.run.smithi083:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2024-09-21T01:51:57.222 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:57.222+0000 7f002c3cc640 1 -- 172.21.15.83:0/3991828805 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f00241029d0 msgr2=0x7f0024102de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:51:57.223 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:57.222+0000 7f002c3cc640 1 --2- 172.21.15.83:0/3991828805 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f00241029d0 0x7f0024102de0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f0020009900 tx=0x7f002002a410 comp rx=0 tx=0).stop 2024-09-21T01:51:57.223 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:57.222+0000 7f002c3cc640 1 -- 172.21.15.83:0/3991828805 shutdown_connections 2024-09-21T01:51:57.223 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:57.222+0000 7f002c3cc640 1 --2- 172.21.15.83:0/3991828805 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0024108c50 0x7f002410f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:51:57.223 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:57.222+0000 7f002c3cc640 1 --2- 172.21.15.83:0/3991828805 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0024108300 0x7f0024108710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:51:57.223 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:57.222+0000 7f002c3cc640 1 --2- 172.21.15.83:0/3991828805 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f00241029d0 0x7f0024102de0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:51:57.223 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:57.222+0000 7f002c3cc640 1 -- 172.21.15.83:0/3991828805 >> 172.21.15.83:0/3991828805 conn(0x7f00240fe3b0 msgr2=0x7f0024100800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:51:57.223 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:57.222+0000 7f002c3cc640 1 -- 172.21.15.83:0/3991828805 shutdown_connections 2024-09-21T01:51:57.223 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:57.222+0000 7f002c3cc640 1 -- 172.21.15.83:0/3991828805 wait complete. 2024-09-21T01:51:57.223 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:57.222+0000 7f002c3cc640 1 Processor -- start 2024-09-21T01:51:57.223 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:57.222+0000 7f002c3cc640 1 -- start start 2024-09-21T01:51:57.225 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:57.223+0000 7f002c3cc640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f00241029d0 0x7f002419a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:51:57.225 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:57.223+0000 7f002c3cc640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0024108300 0x7f002419a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:51:57.225 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:57.223+0000 7f002c3cc640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0024108c50 0x7f002419fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:51:57.225 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:57.223+0000 7f002c3cc640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f00241138e0 con 0x7f0024108c50 2024-09-21T01:51:57.225 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:57.223+0000 7f002c3cc640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f0024113760 con 0x7f0024108300 2024-09-21T01:51:57.225 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:57.223+0000 7f002c3cc640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f0024113a60 con 0x7f00241029d0 2024-09-21T01:51:57.226 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:57.223+0000 7f002a969640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0024108c50 0x7f002419fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:51:57.226 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:57.223+0000 7f002a969640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0024108c50 0x7f002419fb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:51794/0 (socket says 172.21.15.83:51794) 2024-09-21T01:51:57.226 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:57.223+0000 7f002a969640 1 -- 172.21.15.83:0/2324916267 learned_addr learned my addr 172.21.15.83:0/2324916267 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:51:57.226 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:57.223+0000 7f002a168640 1 --2- 172.21.15.83:0/2324916267 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f00241029d0 0x7f002419a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:51:57.226 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:57.223+0000 7f0029967640 1 --2- 172.21.15.83:0/2324916267 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0024108300 0x7f002419a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:51:57.226 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:57.223+0000 7f002a969640 1 -- 172.21.15.83:0/2324916267 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f00241029d0 msgr2=0x7f002419a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:51:57.226 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:57.223+0000 7f002a969640 1 --2- 172.21.15.83:0/2324916267 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f00241029d0 0x7f002419a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:51:57.226 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:57.223+0000 7f002a969640 1 -- 172.21.15.83:0/2324916267 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0024108300 msgr2=0x7f002419a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:51:57.226 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:57.223+0000 7f002a969640 1 --2- 172.21.15.83:0/2324916267 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0024108300 0x7f002419a8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:51:57.226 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:57.223+0000 7f002a969640 1 -- 172.21.15.83:0/2324916267 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00241a0250 con 0x7f0024108c50 2024-09-21T01:51:57.226 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:57.223+0000 7f002a969640 1 --2- 172.21.15.83:0/2324916267 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0024108c50 0x7f002419fb50 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f001c00eb10 tx=0x7f001c00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:51:57.226 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:57.223+0000 7f00177fe640 1 -- 172.21.15.83:0/2324916267 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f001c004b20 con 0x7f0024108c50 2024-09-21T01:51:57.227 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:57.223+0000 7f00177fe640 1 -- 172.21.15.83:0/2324916267 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f001c004cc0 con 0x7f0024108c50 2024-09-21T01:51:57.227 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:57.223+0000 7f00177fe640 1 -- 172.21.15.83:0/2324916267 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f001c010690 con 0x7f0024108c50 2024-09-21T01:51:57.227 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:57.223+0000 7f002c3cc640 1 -- 172.21.15.83:0/2324916267 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00241a0540 con 0x7f0024108c50 2024-09-21T01:51:57.227 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:57.223+0000 7f002c3cc640 1 -- 172.21.15.83:0/2324916267 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00241a6cd0 con 0x7f0024108c50 2024-09-21T01:51:57.227 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:57.224+0000 7f002c3cc640 1 -- 172.21.15.83:0/2324916267 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0024102de0 con 0x7f0024108c50 2024-09-21T01:51:57.228 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:57.226+0000 7f00177fe640 1 -- 172.21.15.83:0/2324916267 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7f001c005000 con 0x7f0024108c50 2024-09-21T01:51:57.228 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:57.227+0000 7f00177fe640 1 --2- 172.21.15.83:0/2324916267 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f00100b6700 0x7f00100b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:51:57.228 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:57.227+0000 7f002a168640 1 --2- 172.21.15.83:0/2324916267 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f00100b6700 0x7f00100b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:51:57.228 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:57.227+0000 7f00177fe640 1 -- 172.21.15.83:0/2324916267 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9403+0+0 (secure 0 0 0) 0x7f001c0e8240 con 0x7f0024108c50 2024-09-21T01:51:57.228 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:57.227+0000 7f002a168640 1 --2- 172.21.15.83:0/2324916267 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f00100b6700 0x7f00100b8c10 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f00200057c0 tx=0x7f00200058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:51:57.230 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:57.230+0000 7f00177fe640 1 -- 172.21.15.83:0/2324916267 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f001c056710 con 0x7f0024108c50 2024-09-21T01:51:57.430 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:57.429+0000 7f002c3cc640 1 -- 172.21.15.83:0/2324916267 --> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) -- 0x7f0024063800 con 0x7f00100b6700 2024-09-21T01:51:57.437 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:57.437+0000 7f00177fe640 1 -- 172.21.15.83:0/2324916267 <== mgr.14223 v2:172.21.15.83:6800/1748483157 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+10 (secure 0 0 0) 0x7f0024063800 con 0x7f00100b6700 2024-09-21T01:51:57.437 INFO:teuthology.orchestra.run.smithi083.stdout:/ 1m 6m3h 2024-09-21T01:51:57.440 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:57.439+0000 7f002c3cc640 1 -- 172.21.15.83:0/2324916267 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f00100b6700 msgr2=0x7f00100b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:51:57.440 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:57.439+0000 7f002c3cc640 1 --2- 172.21.15.83:0/2324916267 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f00100b6700 0x7f00100b8c10 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f00200057c0 tx=0x7f00200058d0 comp rx=0 tx=0).stop 2024-09-21T01:51:57.440 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:57.439+0000 7f002c3cc640 1 -- 172.21.15.83:0/2324916267 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0024108c50 msgr2=0x7f002419fb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:51:57.440 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:57.439+0000 7f002c3cc640 1 --2- 172.21.15.83:0/2324916267 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0024108c50 0x7f002419fb50 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f001c00eb10 tx=0x7f001c00c2d0 comp rx=0 tx=0).stop 2024-09-21T01:51:57.440 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:57.439+0000 7f002c3cc640 1 -- 172.21.15.83:0/2324916267 shutdown_connections 2024-09-21T01:51:57.440 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:57.439+0000 7f002c3cc640 1 --2- 172.21.15.83:0/2324916267 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f00100b6700 0x7f00100b8c10 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:51:57.440 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:57.439+0000 7f002c3cc640 1 --2- 172.21.15.83:0/2324916267 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0024108c50 0x7f002419fb50 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:51:57.440 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:57.439+0000 7f002c3cc640 1 --2- 172.21.15.83:0/2324916267 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0024108300 0x7f002419a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:51:57.440 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:57.439+0000 7f002c3cc640 1 --2- 172.21.15.83:0/2324916267 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f00241029d0 0x7f002419a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:51:57.440 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:57.439+0000 7f002c3cc640 1 -- 172.21.15.83:0/2324916267 >> 172.21.15.83:0/2324916267 conn(0x7f00240fe3b0 msgr2=0x7f00241007d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:51:57.441 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:57.439+0000 7f002c3cc640 1 -- 172.21.15.83:0/2324916267 shutdown_connections 2024-09-21T01:51:57.441 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:57.439+0000 7f002c3cc640 1 -- 172.21.15.83:0/2324916267 wait complete. 2024-09-21T01:51:57.451 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-09-21T01:51:57.461 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T01:51:57.571 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:57.570+0000 7fce41bdf640 1 -- 172.21.15.83:0/3402402156 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fce3c1029b0 msgr2=0x7fce3c102dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:51:57.571 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:57.570+0000 7fce41bdf640 1 --2- 172.21.15.83:0/3402402156 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fce3c1029b0 0x7fce3c102dc0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fce2c009900 tx=0x7fce2c02a410 comp rx=0 tx=0).stop 2024-09-21T01:51:57.571 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:57.570+0000 7fce41bdf640 1 -- 172.21.15.83:0/3402402156 shutdown_connections 2024-09-21T01:51:57.571 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:57.570+0000 7fce41bdf640 1 --2- 172.21.15.83:0/3402402156 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fce3c108c30 0x7fce3c10f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:51:57.571 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:57.570+0000 7fce41bdf640 1 --2- 172.21.15.83:0/3402402156 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fce3c1082e0 0x7fce3c1086f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:51:57.571 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:57.570+0000 7fce41bdf640 1 --2- 172.21.15.83:0/3402402156 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fce3c1029b0 0x7fce3c102dc0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:51:57.571 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:57.570+0000 7fce41bdf640 1 -- 172.21.15.83:0/3402402156 >> 172.21.15.83:0/3402402156 conn(0x7fce3c0fe410 msgr2=0x7fce3c100860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:51:57.571 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:57.570+0000 7fce41bdf640 1 -- 172.21.15.83:0/3402402156 shutdown_connections 2024-09-21T01:51:57.571 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:57.570+0000 7fce41bdf640 1 -- 172.21.15.83:0/3402402156 wait complete. 2024-09-21T01:51:57.571 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:57.571+0000 7fce41bdf640 1 Processor -- start 2024-09-21T01:51:57.572 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:57.571+0000 7fce41bdf640 1 -- start start 2024-09-21T01:51:57.573 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:57.571+0000 7fce41bdf640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fce3c1029b0 0x7fce3c19b150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:51:57.574 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:57.571+0000 7fce41bdf640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fce3c1082e0 0x7fce3c19b690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:51:57.574 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:57.571+0000 7fce41bdf640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fce3c108c30 0x7fce3c19bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:51:57.574 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:57.571+0000 7fce41bdf640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fce3c1127a0 con 0x7fce3c1082e0 2024-09-21T01:51:57.574 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:57.571+0000 7fce41bdf640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fce3c112620 con 0x7fce3c108c30 2024-09-21T01:51:57.574 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:57.571+0000 7fce41bdf640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fce3c112920 con 0x7fce3c1029b0 2024-09-21T01:51:57.574 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:57.571+0000 7fce33fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fce3c1082e0 0x7fce3c19b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:51:57.574 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:57.571+0000 7fce33fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fce3c1082e0 0x7fce3c19b690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:51808/0 (socket says 172.21.15.83:51808) 2024-09-21T01:51:57.574 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:57.571+0000 7fce33fff640 1 -- 172.21.15.83:0/642171532 learned_addr learned my addr 172.21.15.83:0/642171532 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:51:57.574 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:57.571+0000 7fce3bfff640 1 --2- 172.21.15.83:0/642171532 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fce3c108c30 0x7fce3c19bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:51:57.574 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:57.571+0000 7fce3b7fe640 1 --2- 172.21.15.83:0/642171532 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fce3c1029b0 0x7fce3c19b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:51:57.574 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:57.571+0000 7fce33fff640 1 -- 172.21.15.83:0/642171532 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fce3c1029b0 msgr2=0x7fce3c19b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:51:57.574 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:57.571+0000 7fce33fff640 1 --2- 172.21.15.83:0/642171532 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fce3c1029b0 0x7fce3c19b150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:51:57.574 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:57.571+0000 7fce33fff640 1 -- 172.21.15.83:0/642171532 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fce3c108c30 msgr2=0x7fce3c19bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:51:57.575 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:57.571+0000 7fce33fff640 1 --2- 172.21.15.83:0/642171532 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fce3c108c30 0x7fce3c19bbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:51:57.575 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:57.571+0000 7fce33fff640 1 -- 172.21.15.83:0/642171532 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce3c1a6380 con 0x7fce3c1082e0 2024-09-21T01:51:57.575 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:57.571+0000 7fce3b7fe640 1 --2- 172.21.15.83:0/642171532 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fce3c1029b0 0x7fce3c19b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:51:57.575 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:57.572+0000 7fce33fff640 1 --2- 172.21.15.83:0/642171532 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fce3c1082e0 0x7fce3c19b690 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fce2400c970 tx=0x7fce2400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:51:57.575 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:57.572+0000 7fce397fa640 1 -- 172.21.15.83:0/642171532 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce24007bb0 con 0x7fce3c1082e0 2024-09-21T01:51:57.575 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:57.572+0000 7fce397fa640 1 -- 172.21.15.83:0/642171532 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fce24007d50 con 0x7fce3c1082e0 2024-09-21T01:51:57.575 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:57.572+0000 7fce41bdf640 1 -- 172.21.15.83:0/642171532 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce3c1a6670 con 0x7fce3c1082e0 2024-09-21T01:51:57.575 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:57.572+0000 7fce397fa640 1 -- 172.21.15.83:0/642171532 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce24004da0 con 0x7fce3c1082e0 2024-09-21T01:51:57.575 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:57.572+0000 7fce41bdf640 1 -- 172.21.15.83:0/642171532 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce3c1a6bc0 con 0x7fce3c1082e0 2024-09-21T01:51:57.575 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:57.573+0000 7fce41bdf640 1 -- 172.21.15.83:0/642171532 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce3c103c20 con 0x7fce3c1082e0 2024-09-21T01:51:57.576 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:57.574+0000 7fce397fa640 1 -- 172.21.15.83:0/642171532 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7fce24004f60 con 0x7fce3c1082e0 2024-09-21T01:51:57.576 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:57.575+0000 7fce397fa640 1 --2- 172.21.15.83:0/642171532 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fce280b6680 0x7fce280b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:51:57.576 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:57.575+0000 7fce3b7fe640 1 --2- 172.21.15.83:0/642171532 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fce280b6680 0x7fce280b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:51:57.576 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:57.575+0000 7fce397fa640 1 -- 172.21.15.83:0/642171532 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9403+0+0 (secure 0 0 0) 0x7fce240e7c30 con 0x7fce3c1082e0 2024-09-21T01:51:57.576 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:57.576+0000 7fce3b7fe640 1 --2- 172.21.15.83:0/642171532 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fce280b6680 0x7fce280b8b90 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fce2c000c00 tx=0x7fce2c032d60 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:51:57.578 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:57.578+0000 7fce397fa640 1 -- 172.21.15.83:0/642171532 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fce24014030 con 0x7fce3c1082e0 2024-09-21T01:51:57.756 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:57.756+0000 7fce41bdf640 1 -- 172.21.15.83:0/642171532 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fce3c06b990 con 0x7fce3c1082e0 2024-09-21T01:51:57.758 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:57.757+0000 7fce397fa640 1 -- 172.21.15.83:0/642171532 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v92) ==== 74+0+25277 (secure 0 0 0) 0x7fce3c06b990 con 0x7fce3c1082e0 2024-09-21T01:51:57.758 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T01:51:57.758 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":92,"fsid":"f7697ecc-77b8-11ef-baf5-efdc52797490","created":"2024-09-21T01:31:22.250342+0000","modified":"2024-09-21T01:51:18.982807+0000","last_up_change":"2024-09-21T01:38:53.501659+0000","last_in_change":"2024-09-21T01:38:30.688516+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T01:35:06.977668+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T01:39:41.041950+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T01:39:42.882272+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":15,"snap_epoch":91,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T01:39:49.320532+0000","flags":8197,"flags_names":"hashpspool,ec_overwrites,selfmanaged_snaps","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":15,"snap_epoch":91,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"66947512-01ee-4bf0-87b0-98a168cf50dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":3563457494},{"type":"v1","addr":"172.21.15.83:6803","nonce":3563457494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":3563457494},{"type":"v1","addr":"172.21.15.83:6805","nonce":3563457494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":3563457494},{"type":"v1","addr":"172.21.15.83:6809","nonce":3563457494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":3563457494},{"type":"v1","addr":"172.21.15.83:6807","nonce":3563457494}]},"public_addr":"172.21.15.83:6803/3563457494","cluster_addr":"172.21.15.83:6805/3563457494","heartbeat_back_addr":"172.21.15.83:6809/3563457494","heartbeat_front_addr":"172.21.15.83:6807/3563457494","state":["exists","up"]},{"osd":1,"uuid":"f7818a08-86a5-412d-a164-cfeb18f8650a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":2066870220},{"type":"v1","addr":"172.21.15.119:6801","nonce":2066870220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":2066870220},{"type":"v1","addr":"172.21.15.119:6803","nonce":2066870220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":2066870220},{"type":"v1","addr":"172.21.15.119:6807","nonce":2066870220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":2066870220},{"type":"v1","addr":"172.21.15.119:6805","nonce":2066870220}]},"public_addr":"172.21.15.119:6801/2066870220","cluster_addr":"172.21.15.119:6803/2066870220","heartbeat_back_addr":"172.21.15.119:6807/2066870220","heartbeat_front_addr":"172.21.15.119:6805/2066870220","state":["exists","up"]},{"osd":2,"uuid":"0d1a3870-c67a-4783-85f9-be2bb36f7722","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":3955936117},{"type":"v1","addr":"172.21.15.142:6801","nonce":3955936117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3955936117},{"type":"v1","addr":"172.21.15.142:6803","nonce":3955936117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":3955936117},{"type":"v1","addr":"172.21.15.142:6807","nonce":3955936117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":3955936117},{"type":"v1","addr":"172.21.15.142:6805","nonce":3955936117}]},"public_addr":"172.21.15.142:6801/3955936117","cluster_addr":"172.21.15.142:6803/3955936117","heartbeat_back_addr":"172.21.15.142:6807/3955936117","heartbeat_front_addr":"172.21.15.142:6805/3955936117","state":["exists","up"]},{"osd":3,"uuid":"a4cb1a36-3495-4d36-92da-ed3b6e852d14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":3746834093},{"type":"v1","addr":"172.21.15.83:6811","nonce":3746834093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":3746834093},{"type":"v1","addr":"172.21.15.83:6813","nonce":3746834093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":3746834093},{"type":"v1","addr":"172.21.15.83:6817","nonce":3746834093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":3746834093},{"type":"v1","addr":"172.21.15.83:6815","nonce":3746834093}]},"public_addr":"172.21.15.83:6811/3746834093","cluster_addr":"172.21.15.83:6813/3746834093","heartbeat_back_addr":"172.21.15.83:6817/3746834093","heartbeat_front_addr":"172.21.15.83:6815/3746834093","state":["exists","up"]},{"osd":4,"uuid":"d6f2ec78-7f08-473b-a96c-e8590f5d2f25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":3083907785},{"type":"v1","addr":"172.21.15.119:6809","nonce":3083907785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":3083907785},{"type":"v1","addr":"172.21.15.119:6811","nonce":3083907785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":3083907785},{"type":"v1","addr":"172.21.15.119:6815","nonce":3083907785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":3083907785},{"type":"v1","addr":"172.21.15.119:6813","nonce":3083907785}]},"public_addr":"172.21.15.119:6809/3083907785","cluster_addr":"172.21.15.119:6811/3083907785","heartbeat_back_addr":"172.21.15.119:6815/3083907785","heartbeat_front_addr":"172.21.15.119:6813/3083907785","state":["exists","up"]},{"osd":5,"uuid":"c571d04d-d3ea-4d74-8867-e4c7816f4e0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":349001002},{"type":"v1","addr":"172.21.15.142:6809","nonce":349001002}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":349001002},{"type":"v1","addr":"172.21.15.142:6811","nonce":349001002}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":349001002},{"type":"v1","addr":"172.21.15.142:6815","nonce":349001002}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":349001002},{"type":"v1","addr":"172.21.15.142:6813","nonce":349001002}]},"public_addr":"172.21.15.142:6809/349001002","cluster_addr":"172.21.15.142:6811/349001002","heartbeat_back_addr":"172.21.15.142:6815/349001002","heartbeat_front_addr":"172.21.15.142:6813/349001002","state":["exists","up"]},{"osd":6,"uuid":"6e1b6fe9-700a-448a-b382-59b97896ea7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":771651063},{"type":"v1","addr":"172.21.15.83:6819","nonce":771651063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":771651063},{"type":"v1","addr":"172.21.15.83:6821","nonce":771651063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":771651063},{"type":"v1","addr":"172.21.15.83:6825","nonce":771651063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":771651063},{"type":"v1","addr":"172.21.15.83:6823","nonce":771651063}]},"public_addr":"172.21.15.83:6819/771651063","cluster_addr":"172.21.15.83:6821/771651063","heartbeat_back_addr":"172.21.15.83:6825/771651063","heartbeat_front_addr":"172.21.15.83:6823/771651063","state":["exists","up"]},{"osd":7,"uuid":"283bfae4-5f50-4f9e-860e-bbfd47e005e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":1556984819},{"type":"v1","addr":"172.21.15.119:6817","nonce":1556984819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":1556984819},{"type":"v1","addr":"172.21.15.119:6819","nonce":1556984819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":1556984819},{"type":"v1","addr":"172.21.15.119:6823","nonce":1556984819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":1556984819},{"type":"v1","addr":"172.21.15.119:6821","nonce":1556984819}]},"public_addr":"172.21.15.119:6817/1556984819","cluster_addr":"172.21.15.119:6819/1556984819","heartbeat_back_addr":"172.21.15.119:6823/1556984819","heartbeat_front_addr":"172.21.15.119:6821/1556984819","state":["exists","up"]},{"osd":8,"uuid":"d46e56d4-ed4e-42c3-a315-66af014bd93a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":1860679473},{"type":"v1","addr":"172.21.15.142:6817","nonce":1860679473}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":1860679473},{"type":"v1","addr":"172.21.15.142:6819","nonce":1860679473}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":1860679473},{"type":"v1","addr":"172.21.15.142:6823","nonce":1860679473}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":1860679473},{"type":"v1","addr":"172.21.15.142:6821","nonce":1860679473}]},"public_addr":"172.21.15.142:6817/1860679473","cluster_addr":"172.21.15.142:6819/1860679473","heartbeat_back_addr":"172.21.15.142:6823/1860679473","heartbeat_front_addr":"172.21.15.142:6821/1860679473","state":["exists","up"]},{"osd":9,"uuid":"18a70ee6-56df-4f5c-868d-5db5e72a1859","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":3636757924},{"type":"v1","addr":"172.21.15.83:6827","nonce":3636757924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":3636757924},{"type":"v1","addr":"172.21.15.83:6829","nonce":3636757924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6832","nonce":3636757924},{"type":"v1","addr":"172.21.15.83:6833","nonce":3636757924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":3636757924},{"type":"v1","addr":"172.21.15.83:6831","nonce":3636757924}]},"public_addr":"172.21.15.83:6827/3636757924","cluster_addr":"172.21.15.83:6829/3636757924","heartbeat_back_addr":"172.21.15.83:6833/3636757924","heartbeat_front_addr":"172.21.15.83:6831/3636757924","state":["exists","up"]},{"osd":10,"uuid":"0d32c3de-db03-42c3-9914-07d675aaa339","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":2561963910},{"type":"v1","addr":"172.21.15.119:6825","nonce":2561963910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":2561963910},{"type":"v1","addr":"172.21.15.119:6827","nonce":2561963910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2561963910},{"type":"v1","addr":"172.21.15.119:6831","nonce":2561963910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2561963910},{"type":"v1","addr":"172.21.15.119:6829","nonce":2561963910}]},"public_addr":"172.21.15.119:6825/2561963910","cluster_addr":"172.21.15.119:6827/2561963910","heartbeat_back_addr":"172.21.15.119:6831/2561963910","heartbeat_front_addr":"172.21.15.119:6829/2561963910","state":["exists","up"]},{"osd":11,"uuid":"3a3b444d-b316-4256-bfad-378db29f0824","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":1174646198},{"type":"v1","addr":"172.21.15.142:6825","nonce":1174646198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":1174646198},{"type":"v1","addr":"172.21.15.142:6827","nonce":1174646198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1174646198},{"type":"v1","addr":"172.21.15.142:6831","nonce":1174646198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1174646198},{"type":"v1","addr":"172.21.15.142:6829","nonce":1174646198}]},"public_addr":"172.21.15.142:6825/1174646198","cluster_addr":"172.21.15.142:6827/1174646198","heartbeat_back_addr":"172.21.15.142:6831/1174646198","heartbeat_front_addr":"172.21.15.142:6829/1174646198","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:34:15.337672+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:34:39.259716+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:35:03.348886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:35:29.465711+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:35:53.744378+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:36:19.488785+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:36:45.708616+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:37:11.501065+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:37:36.027277+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:38:01.903625+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:38:27.215212+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:38:51.891278+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.e","mappings":[{"from":4,"to":8},{"from":5,"to":9}]},{"pgid":"3.11","mappings":[{"from":4,"to":6}]},{"pgid":"4.3","mappings":[{"from":5,"to":8}]},{"pgid":"4.10","mappings":[{"from":9,"to":8}]},{"pgid":"4.12","mappings":[{"from":9,"to":10}]},{"pgid":"4.1c","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.83:0/1619062496":"2024-09-22T01:33:08.666525+0000","172.21.15.83:0/2412709299":"2024-09-22T01:31:45.834450+0000","172.21.15.83:6800/4290325964":"2024-09-22T01:31:45.834450+0000","172.21.15.83:6801/4290325964":"2024-09-22T01:31:45.834450+0000","172.21.15.83:0/1440681183":"2024-09-22T01:31:45.834450+0000","172.21.15.83:0/2745413305":"2024-09-22T01:31:45.834450+0000","172.21.15.83:6800/1393748565":"2024-09-22T01:33:08.666525+0000","172.21.15.83:0/110411274":"2024-09-22T01:32:10.073024+0000","172.21.15.83:0/4267551123":"2024-09-22T01:33:08.666525+0000","172.21.15.83:0/1068434643":"2024-09-22T01:32:10.073024+0000","172.21.15.83:6800/2963261730":"2024-09-22T01:32:10.073024+0000","172.21.15.83:0/3544333975":"2024-09-22T01:32:10.073024+0000","172.21.15.83:6801/1393748565":"2024-09-22T01:33:08.666525+0000","172.21.15.83:6801/2963261730":"2024-09-22T01:32:10.073024+0000","172.21.15.83:0/1915285091":"2024-09-22T01:33:08.666525+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":5,"length":1},{"begin":15,"length":1}]},{"pool":4,"snaps":[{"begin":5,"length":1},{"begin":15,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T01:51:57.760 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:57.760+0000 7fce41bdf640 1 -- 172.21.15.83:0/642171532 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fce280b6680 msgr2=0x7fce280b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:51:57.760 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:57.760+0000 7fce41bdf640 1 --2- 172.21.15.83:0/642171532 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fce280b6680 0x7fce280b8b90 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fce2c000c00 tx=0x7fce2c032d60 comp rx=0 tx=0).stop 2024-09-21T01:51:57.760 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:57.760+0000 7fce41bdf640 1 -- 172.21.15.83:0/642171532 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fce3c1082e0 msgr2=0x7fce3c19b690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:51:57.760 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:57.760+0000 7fce41bdf640 1 --2- 172.21.15.83:0/642171532 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fce3c1082e0 0x7fce3c19b690 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fce2400c970 tx=0x7fce2400ce30 comp rx=0 tx=0).stop 2024-09-21T01:51:57.760 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:57.760+0000 7fce41bdf640 1 -- 172.21.15.83:0/642171532 shutdown_connections 2024-09-21T01:51:57.761 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:57.760+0000 7fce41bdf640 1 --2- 172.21.15.83:0/642171532 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fce280b6680 0x7fce280b8b90 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:51:57.761 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:57.760+0000 7fce41bdf640 1 --2- 172.21.15.83:0/642171532 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fce3c108c30 0x7fce3c19bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:51:57.761 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:57.760+0000 7fce41bdf640 1 --2- 172.21.15.83:0/642171532 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fce3c1082e0 0x7fce3c19b690 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:51:57.761 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:57.760+0000 7fce41bdf640 1 --2- 172.21.15.83:0/642171532 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fce3c1029b0 0x7fce3c19b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:51:57.761 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:57.760+0000 7fce41bdf640 1 -- 172.21.15.83:0/642171532 >> 172.21.15.83:0/642171532 conn(0x7fce3c0fe410 msgr2=0x7fce3c100830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:51:57.761 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:57.760+0000 7fce41bdf640 1 -- 172.21.15.83:0/642171532 shutdown_connections 2024-09-21T01:51:57.761 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:57.760+0000 7fce41bdf640 1 -- 172.21.15.83:0/642171532 wait complete. 2024-09-21T01:51:57.772 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-21T01:35:06.977668+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-21T01:39:41.041950+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '74', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-21T01:39:42.882272+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '91', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 15, 'snap_epoch': 91, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-21T01:39:49.320532+0000', 'flags': 8197, 'flags_names': 'hashpspool,ec_overwrites,selfmanaged_snaps', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '91', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 15, 'snap_epoch': 91, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-21T01:51:57.772 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-21T01:51:57.885 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:57.884+0000 7fdcce47f640 1 -- 172.21.15.83:0/1364249524 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdcc81082d0 msgr2=0x7fdcc81086e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:51:57.885 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:57.884+0000 7fdcce47f640 1 --2- 172.21.15.83:0/1364249524 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdcc81082d0 0x7fdcc81086e0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fdcbc009900 tx=0x7fdcbc02a410 comp rx=0 tx=0).stop 2024-09-21T01:51:57.885 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:57.884+0000 7fdcce47f640 1 -- 172.21.15.83:0/1364249524 shutdown_connections 2024-09-21T01:51:57.885 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:57.884+0000 7fdcce47f640 1 --2- 172.21.15.83:0/1364249524 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdcc8108c20 0x7fdcc810f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:51:57.885 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:57.884+0000 7fdcce47f640 1 --2- 172.21.15.83:0/1364249524 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdcc81082d0 0x7fdcc81086e0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:51:57.885 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:57.884+0000 7fdcce47f640 1 --2- 172.21.15.83:0/1364249524 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdcc81029a0 0x7fdcc8102db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:51:57.885 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:57.884+0000 7fdcce47f640 1 -- 172.21.15.83:0/1364249524 >> 172.21.15.83:0/1364249524 conn(0x7fdcc80fe3c0 msgr2=0x7fdcc8100810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:51:57.886 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:57.884+0000 7fdcce47f640 1 -- 172.21.15.83:0/1364249524 shutdown_connections 2024-09-21T01:51:57.886 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:57.884+0000 7fdcce47f640 1 -- 172.21.15.83:0/1364249524 wait complete. 2024-09-21T01:51:57.886 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:57.885+0000 7fdcce47f640 1 Processor -- start 2024-09-21T01:51:57.886 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:57.885+0000 7fdcce47f640 1 -- start start 2024-09-21T01:51:57.888 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:57.885+0000 7fdcce47f640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdcc81029a0 0x7fdcc819b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:51:57.888 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:57.885+0000 7fdcce47f640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdcc81082d0 0x7fdcc819b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:51:57.888 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:57.885+0000 7fdcce47f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdcc8108c20 0x7fdcc819bc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:51:57.888 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:57.885+0000 7fdcce47f640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fdcc8112790 con 0x7fdcc81082d0 2024-09-21T01:51:57.888 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:57.885+0000 7fdcce47f640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fdcc8112610 con 0x7fdcc8108c20 2024-09-21T01:51:57.888 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:57.885+0000 7fdcce47f640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fdcc8112910 con 0x7fdcc81029a0 2024-09-21T01:51:57.888 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:57.885+0000 7fdcc77fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdcc81082d0 0x7fdcc819b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:51:57.888 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:57.885+0000 7fdcc77fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdcc81082d0 0x7fdcc819b700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:51836/0 (socket says 172.21.15.83:51836) 2024-09-21T01:51:57.888 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:57.885+0000 7fdcc77fe640 1 -- 172.21.15.83:0/1198223311 learned_addr learned my addr 172.21.15.83:0/1198223311 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:51:57.889 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:57.886+0000 7fdccca1c640 1 --2- 172.21.15.83:0/1198223311 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdcc8108c20 0x7fdcc819bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:51:57.889 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:57.886+0000 7fdcc7fff640 1 --2- 172.21.15.83:0/1198223311 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdcc81029a0 0x7fdcc819b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:51:57.889 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:57.886+0000 7fdcc77fe640 1 -- 172.21.15.83:0/1198223311 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdcc81029a0 msgr2=0x7fdcc819b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:51:57.889 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:57.886+0000 7fdcc77fe640 1 --2- 172.21.15.83:0/1198223311 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdcc81029a0 0x7fdcc819b1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:51:57.889 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:57.886+0000 7fdcc77fe640 1 -- 172.21.15.83:0/1198223311 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdcc8108c20 msgr2=0x7fdcc819bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:51:57.889 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:57.886+0000 7fdcc77fe640 1 --2- 172.21.15.83:0/1198223311 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdcc8108c20 0x7fdcc819bc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:51:57.889 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:57.886+0000 7fdcc77fe640 1 -- 172.21.15.83:0/1198223311 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcc81a6480 con 0x7fdcc81082d0 2024-09-21T01:51:57.889 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:57.886+0000 7fdccca1c640 1 --2- 172.21.15.83:0/1198223311 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdcc8108c20 0x7fdcc819bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:51:57.889 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:57.886+0000 7fdcc77fe640 1 --2- 172.21.15.83:0/1198223311 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdcc81082d0 0x7fdcc819b700 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fdcbc004770 tx=0x7fdcbc004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:51:57.889 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:57.886+0000 7fdcc57fa640 1 -- 172.21.15.83:0/1198223311 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcbc03f030 con 0x7fdcc81082d0 2024-09-21T01:51:57.889 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:57.886+0000 7fdcce47f640 1 -- 172.21.15.83:0/1198223311 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdcc81a6710 con 0x7fdcc81082d0 2024-09-21T01:51:57.889 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:57.886+0000 7fdcc57fa640 1 -- 172.21.15.83:0/1198223311 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdcbc004440 con 0x7fdcc81082d0 2024-09-21T01:51:57.889 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:57.886+0000 7fdcc57fa640 1 -- 172.21.15.83:0/1198223311 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcbc035070 con 0x7fdcc81082d0 2024-09-21T01:51:57.889 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:57.886+0000 7fdcce47f640 1 -- 172.21.15.83:0/1198223311 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdcc81a6c50 con 0x7fdcc81082d0 2024-09-21T01:51:57.889 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:57.887+0000 7fdcce47f640 1 -- 172.21.15.83:0/1198223311 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdcc8102db0 con 0x7fdcc81082d0 2024-09-21T01:51:57.890 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:57.889+0000 7fdcc57fa640 1 -- 172.21.15.83:0/1198223311 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7fdcbc042030 con 0x7fdcc81082d0 2024-09-21T01:51:57.890 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:57.890+0000 7fdcc57fa640 1 --2- 172.21.15.83:0/1198223311 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fdcb00b6680 0x7fdcb00b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:51:57.890 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:57.890+0000 7fdcc7fff640 1 --2- 172.21.15.83:0/1198223311 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fdcb00b6680 0x7fdcb00b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:51:57.890 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:57.890+0000 7fdcc57fa640 1 -- 172.21.15.83:0/1198223311 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9403+0+0 (secure 0 0 0) 0x7fdcbc108330 con 0x7fdcc81082d0 2024-09-21T01:51:57.891 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:57.890+0000 7fdcc7fff640 1 --2- 172.21.15.83:0/1198223311 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fdcb00b6680 0x7fdcb00b8b90 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fdcc806c420 tx=0x7fdcb8005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:51:57.893 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:57.893+0000 7fdcc57fa640 1 -- 172.21.15.83:0/1198223311 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fdcbc0ce510 con 0x7fdcc81082d0 2024-09-21T01:51:58.070 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:58.070+0000 7fdcce47f640 1 -- 172.21.15.83:0/1198223311 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fdcc802e640 con 0x7fdcc81082d0 2024-09-21T01:51:58.071 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:58.070+0000 7fdcc57fa640 1 -- 172.21.15.83:0/1198223311 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v92) ==== 93+0+10 (secure 0 0 0) 0x7fdcbc0efe20 con 0x7fdcc81082d0 2024-09-21T01:51:58.071 INFO:teuthology.orchestra.run.smithi083.stdout:pg_num: 1 2024-09-21T01:51:58.073 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:58.072+0000 7fdcce47f640 1 -- 172.21.15.83:0/1198223311 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fdcb00b6680 msgr2=0x7fdcb00b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:51:58.073 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:58.072+0000 7fdcce47f640 1 --2- 172.21.15.83:0/1198223311 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fdcb00b6680 0x7fdcb00b8b90 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fdcc806c420 tx=0x7fdcb8005f90 comp rx=0 tx=0).stop 2024-09-21T01:51:58.073 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:58.072+0000 7fdcce47f640 1 -- 172.21.15.83:0/1198223311 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdcc81082d0 msgr2=0x7fdcc819b700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:51:58.073 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:58.072+0000 7fdcce47f640 1 --2- 172.21.15.83:0/1198223311 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdcc81082d0 0x7fdcc819b700 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fdcbc004770 tx=0x7fdcbc004040 comp rx=0 tx=0).stop 2024-09-21T01:51:58.074 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:58.073+0000 7fdcce47f640 1 -- 172.21.15.83:0/1198223311 shutdown_connections 2024-09-21T01:51:58.074 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:58.073+0000 7fdcce47f640 1 --2- 172.21.15.83:0/1198223311 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fdcb00b6680 0x7fdcb00b8b90 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:51:58.074 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:58.073+0000 7fdcce47f640 1 --2- 172.21.15.83:0/1198223311 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdcc8108c20 0x7fdcc819bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:51:58.074 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:58.073+0000 7fdcce47f640 1 --2- 172.21.15.83:0/1198223311 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdcc81082d0 0x7fdcc819b700 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:51:58.074 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:58.073+0000 7fdcce47f640 1 --2- 172.21.15.83:0/1198223311 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdcc81029a0 0x7fdcc819b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:51:58.074 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:58.073+0000 7fdcce47f640 1 -- 172.21.15.83:0/1198223311 >> 172.21.15.83:0/1198223311 conn(0x7fdcc80fe3c0 msgr2=0x7fdcc81007e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:51:58.074 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:58.073+0000 7fdcce47f640 1 -- 172.21.15.83:0/1198223311 shutdown_connections 2024-09-21T01:51:58.074 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:58.073+0000 7fdcce47f640 1 -- 172.21.15.83:0/1198223311 wait complete. 2024-09-21T01:51:58.085 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-21T01:51:58.197 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:58.196+0000 7f14ed16e640 1 -- 172.21.15.83:0/2708372974 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f14e8104810 msgr2=0x7f14e8104c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:51:58.197 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:58.196+0000 7f14ed16e640 1 --2- 172.21.15.83:0/2708372974 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f14e8104810 0x7f14e8104c20 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f14d8009ca0 tx=0x7f14d802a8c0 comp rx=0 tx=0).stop 2024-09-21T01:51:58.197 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:58.196+0000 7f14ed16e640 1 -- 172.21.15.83:0/2708372974 shutdown_connections 2024-09-21T01:51:58.197 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:58.196+0000 7f14ed16e640 1 --2- 172.21.15.83:0/2708372974 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f14e810ddc0 0x7f14e8110260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:51:58.197 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:58.196+0000 7f14ed16e640 1 --2- 172.21.15.83:0/2708372974 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f14e8105240 0x7f14e810d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:51:58.198 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:58.196+0000 7f14ed16e640 1 --2- 172.21.15.83:0/2708372974 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f14e8104810 0x7f14e8104c20 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:51:58.198 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:58.196+0000 7f14ed16e640 1 -- 172.21.15.83:0/2708372974 >> 172.21.15.83:0/2708372974 conn(0x7f14e8079630 msgr2=0x7f14e8079a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:51:58.198 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:58.197+0000 7f14ed16e640 1 -- 172.21.15.83:0/2708372974 shutdown_connections 2024-09-21T01:51:58.198 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:58.197+0000 7f14ed16e640 1 -- 172.21.15.83:0/2708372974 wait complete. 2024-09-21T01:51:58.200 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:58.197+0000 7f14ed16e640 1 Processor -- start 2024-09-21T01:51:58.200 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:58.197+0000 7f14ed16e640 1 -- start start 2024-09-21T01:51:58.200 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:58.198+0000 7f14ed16e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f14e8104810 0x7f14e819a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:51:58.200 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:58.198+0000 7f14ed16e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f14e8105240 0x7f14e819a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:51:58.200 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:58.198+0000 7f14ed16e640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f14e810ddc0 0x7f14e819fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:51:58.200 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:58.198+0000 7f14ed16e640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f14e8113950 con 0x7f14e810ddc0 2024-09-21T01:51:58.201 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:58.198+0000 7f14ed16e640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f14e81137d0 con 0x7f14e8104810 2024-09-21T01:51:58.201 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:58.198+0000 7f14ed16e640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f14e8113ad0 con 0x7f14e8105240 2024-09-21T01:51:58.201 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:58.198+0000 7f14e759e640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f14e810ddc0 0x7f14e819fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:51:58.201 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:58.198+0000 7f14e759e640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f14e810ddc0 0x7f14e819fc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:51852/0 (socket says 172.21.15.83:51852) 2024-09-21T01:51:58.201 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:58.198+0000 7f14e759e640 1 -- 172.21.15.83:0/712818137 learned_addr learned my addr 172.21.15.83:0/712818137 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:51:58.201 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:58.198+0000 7f14e659c640 1 --2- 172.21.15.83:0/712818137 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f14e8105240 0x7f14e819a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:51:58.201 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:58.198+0000 7f14e6d9d640 1 --2- 172.21.15.83:0/712818137 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f14e8104810 0x7f14e819a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:51:58.201 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:58.198+0000 7f14e759e640 1 -- 172.21.15.83:0/712818137 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f14e8105240 msgr2=0x7f14e819a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:51:58.201 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:58.198+0000 7f14e759e640 1 --2- 172.21.15.83:0/712818137 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f14e8105240 0x7f14e819a970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:51:58.201 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:58.198+0000 7f14e759e640 1 -- 172.21.15.83:0/712818137 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f14e8104810 msgr2=0x7f14e819a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:51:58.201 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:58.198+0000 7f14e759e640 1 --2- 172.21.15.83:0/712818137 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f14e8104810 0x7f14e819a3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:51:58.201 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:58.198+0000 7f14e759e640 1 -- 172.21.15.83:0/712818137 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14e81a0300 con 0x7f14e810ddc0 2024-09-21T01:51:58.201 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:58.198+0000 7f14e6d9d640 1 --2- 172.21.15.83:0/712818137 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f14e8104810 0x7f14e819a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:51:58.202 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:58.198+0000 7f14e759e640 1 --2- 172.21.15.83:0/712818137 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f14e810ddc0 0x7f14e819fc00 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f14e000d750 tx=0x7f14e000db50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:51:58.202 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:58.198+0000 7f14cffff640 1 -- 172.21.15.83:0/712818137 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14e0017070 con 0x7f14e810ddc0 2024-09-21T01:51:58.202 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:58.199+0000 7f14cffff640 1 -- 172.21.15.83:0/712818137 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f14e00097c0 con 0x7f14e810ddc0 2024-09-21T01:51:58.202 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:58.199+0000 7f14ed16e640 1 -- 172.21.15.83:0/712818137 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14e81a05f0 con 0x7f14e810ddc0 2024-09-21T01:51:58.202 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:58.199+0000 7f14cffff640 1 -- 172.21.15.83:0/712818137 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14e0004b20 con 0x7f14e810ddc0 2024-09-21T01:51:58.202 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:58.199+0000 7f14ed16e640 1 -- 172.21.15.83:0/712818137 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14e81a6d80 con 0x7f14e810ddc0 2024-09-21T01:51:58.202 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:58.200+0000 7f14ed16e640 1 -- 172.21.15.83:0/712818137 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14e8104c20 con 0x7f14e810ddc0 2024-09-21T01:51:58.203 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:58.201+0000 7f14cffff640 1 -- 172.21.15.83:0/712818137 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7f14e0004cc0 con 0x7f14e810ddc0 2024-09-21T01:51:58.203 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:58.202+0000 7f14cffff640 1 --2- 172.21.15.83:0/712818137 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f14d00b6680 0x7f14d00b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:51:58.203 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:58.202+0000 7f14e6d9d640 1 --2- 172.21.15.83:0/712818137 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f14d00b6680 0x7f14d00b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:51:58.203 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:58.202+0000 7f14cffff640 1 -- 172.21.15.83:0/712818137 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9403+0+0 (secure 0 0 0) 0x7f14e00e7470 con 0x7f14e810ddc0 2024-09-21T01:51:58.203 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:58.202+0000 7f14e6d9d640 1 --2- 172.21.15.83:0/712818137 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f14d00b6680 0x7f14d00b8b90 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f14d8006010 tx=0x7f14d8000f40 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:51:58.206 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:58.206+0000 7f14cffff640 1 -- 172.21.15.83:0/712818137 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f14e00ad650 con 0x7f14e810ddc0 2024-09-21T01:51:58.386 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:58.385+0000 7f14ed16e640 1 -- 172.21.15.83:0/712818137 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f14e802e640 con 0x7f14e810ddc0 2024-09-21T01:51:58.386 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:58.386+0000 7f14cffff640 1 -- 172.21.15.83:0/712818137 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v92) ==== 104+0+11 (secure 0 0 0) 0x7f14e00b1a30 con 0x7f14e810ddc0 2024-09-21T01:51:58.386 INFO:teuthology.orchestra.run.smithi083.stdout:pg_num: 32 2024-09-21T01:51:58.389 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:58.388+0000 7f14ed16e640 1 -- 172.21.15.83:0/712818137 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f14d00b6680 msgr2=0x7f14d00b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:51:58.389 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:58.388+0000 7f14ed16e640 1 --2- 172.21.15.83:0/712818137 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f14d00b6680 0x7f14d00b8b90 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f14d8006010 tx=0x7f14d8000f40 comp rx=0 tx=0).stop 2024-09-21T01:51:58.389 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:58.388+0000 7f14ed16e640 1 -- 172.21.15.83:0/712818137 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f14e810ddc0 msgr2=0x7f14e819fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:51:58.389 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:58.388+0000 7f14ed16e640 1 --2- 172.21.15.83:0/712818137 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f14e810ddc0 0x7f14e819fc00 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f14e000d750 tx=0x7f14e000db50 comp rx=0 tx=0).stop 2024-09-21T01:51:58.389 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:58.388+0000 7f14ed16e640 1 -- 172.21.15.83:0/712818137 shutdown_connections 2024-09-21T01:51:58.389 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:58.388+0000 7f14ed16e640 1 --2- 172.21.15.83:0/712818137 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f14d00b6680 0x7f14d00b8b90 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:51:58.389 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:58.388+0000 7f14ed16e640 1 --2- 172.21.15.83:0/712818137 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f14e810ddc0 0x7f14e819fc00 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:51:58.389 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:58.388+0000 7f14ed16e640 1 --2- 172.21.15.83:0/712818137 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f14e8105240 0x7f14e819a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:51:58.389 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:58.388+0000 7f14ed16e640 1 --2- 172.21.15.83:0/712818137 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f14e8104810 0x7f14e819a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:51:58.389 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:58.388+0000 7f14ed16e640 1 -- 172.21.15.83:0/712818137 >> 172.21.15.83:0/712818137 conn(0x7f14e8079630 msgr2=0x7f14e80ff860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:51:58.390 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:58.388+0000 7f14ed16e640 1 -- 172.21.15.83:0/712818137 shutdown_connections 2024-09-21T01:51:58.390 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:58.388+0000 7f14ed16e640 1 -- 172.21.15.83:0/712818137 wait complete. 2024-09-21T01:51:58.400 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-21T01:51:58.513 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:58.513+0000 7f4ecb827640 1 -- 172.21.15.83:0/1194791433 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4ec4105260 msgr2=0x7f4ec410d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:51:58.514 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:58.513+0000 7f4ecb827640 1 --2- 172.21.15.83:0/1194791433 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4ec4105260 0x7f4ec410d8a0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f4eb8009ca0 tx=0x7f4eb802a8c0 comp rx=0 tx=0).stop 2024-09-21T01:51:58.514 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:58.513+0000 7f4ecb827640 1 -- 172.21.15.83:0/1194791433 shutdown_connections 2024-09-21T01:51:58.514 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:58.513+0000 7f4ecb827640 1 --2- 172.21.15.83:0/1194791433 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4ec410dde0 0x7f4ec4110280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:51:58.514 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:58.513+0000 7f4ecb827640 1 --2- 172.21.15.83:0/1194791433 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4ec4105260 0x7f4ec410d8a0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:51:58.514 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:58.513+0000 7f4ecb827640 1 --2- 172.21.15.83:0/1194791433 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4ec4104830 0x7f4ec4104c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:51:58.514 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:58.513+0000 7f4ecb827640 1 -- 172.21.15.83:0/1194791433 >> 172.21.15.83:0/1194791433 conn(0x7f4ec4079630 msgr2=0x7f4ec4079a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:51:58.514 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:58.513+0000 7f4ecb827640 1 -- 172.21.15.83:0/1194791433 shutdown_connections 2024-09-21T01:51:58.514 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:58.513+0000 7f4ecb827640 1 -- 172.21.15.83:0/1194791433 wait complete. 2024-09-21T01:51:58.514 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:58.513+0000 7f4ecb827640 1 Processor -- start 2024-09-21T01:51:58.514 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:58.513+0000 7f4ecb827640 1 -- start start 2024-09-21T01:51:58.516 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:58.514+0000 7f4ecb827640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4ec4104830 0x7f4ec419a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:51:58.516 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:58.514+0000 7f4ecb827640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4ec4105260 0x7f4ec419a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:51:58.516 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:58.514+0000 7f4ecb827640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4ec410dde0 0x7f4ec419fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:51:58.516 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:58.514+0000 7f4ecb827640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f4ec41138f0 con 0x7f4ec4105260 2024-09-21T01:51:58.516 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:58.514+0000 7f4ecb827640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f4ec4113770 con 0x7f4ec4104830 2024-09-21T01:51:58.516 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:58.514+0000 7f4ecb827640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f4ec4113a70 con 0x7f4ec410dde0 2024-09-21T01:51:58.517 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:58.514+0000 7f4ec8dc2640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4ec4105260 0x7f4ec419a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:51:58.517 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:58.514+0000 7f4ec8dc2640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4ec4105260 0x7f4ec419a8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:51870/0 (socket says 172.21.15.83:51870) 2024-09-21T01:51:58.517 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:58.514+0000 7f4ec8dc2640 1 -- 172.21.15.83:0/2955306681 learned_addr learned my addr 172.21.15.83:0/2955306681 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:51:58.517 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:58.514+0000 7f4ec95c3640 1 --2- 172.21.15.83:0/2955306681 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4ec4104830 0x7f4ec419a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:51:58.517 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:58.514+0000 7f4ec9dc4640 1 --2- 172.21.15.83:0/2955306681 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4ec410dde0 0x7f4ec419fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:51:58.517 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:58.514+0000 7f4ec8dc2640 1 -- 172.21.15.83:0/2955306681 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4ec410dde0 msgr2=0x7f4ec419fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:51:58.517 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:58.514+0000 7f4ec8dc2640 1 --2- 172.21.15.83:0/2955306681 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4ec410dde0 0x7f4ec419fb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:51:58.517 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:58.514+0000 7f4ec8dc2640 1 -- 172.21.15.83:0/2955306681 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4ec4104830 msgr2=0x7f4ec419a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:51:58.517 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:58.514+0000 7f4ec8dc2640 1 --2- 172.21.15.83:0/2955306681 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4ec4104830 0x7f4ec419a350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:51:58.517 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:58.514+0000 7f4ec8dc2640 1 -- 172.21.15.83:0/2955306681 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ec41a0280 con 0x7f4ec4105260 2024-09-21T01:51:58.517 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:58.514+0000 7f4ec8dc2640 1 --2- 172.21.15.83:0/2955306681 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4ec4105260 0x7f4ec419a8f0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f4eb802ade0 tx=0x7f4eb8003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:51:58.517 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:58.514+0000 7f4ec27fc640 1 -- 172.21.15.83:0/2955306681 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4eb8032c90 con 0x7f4ec4105260 2024-09-21T01:51:58.517 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:58.514+0000 7f4ec27fc640 1 -- 172.21.15.83:0/2955306681 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4eb8032e30 con 0x7f4ec4105260 2024-09-21T01:51:58.518 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:58.514+0000 7f4ecb827640 1 -- 172.21.15.83:0/2955306681 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ec41a0510 con 0x7f4ec4105260 2024-09-21T01:51:58.518 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:58.514+0000 7f4ec27fc640 1 -- 172.21.15.83:0/2955306681 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4eb8030aa0 con 0x7f4ec4105260 2024-09-21T01:51:58.518 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:58.515+0000 7f4ecb827640 1 -- 172.21.15.83:0/2955306681 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ec41a6d00 con 0x7f4ec4105260 2024-09-21T01:51:58.518 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:58.515+0000 7f4ecb827640 1 -- 172.21.15.83:0/2955306681 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ec4104c40 con 0x7f4ec4105260 2024-09-21T01:51:58.518 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:58.517+0000 7f4ec27fc640 1 -- 172.21.15.83:0/2955306681 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7f4eb8030c40 con 0x7f4ec4105260 2024-09-21T01:51:58.519 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:58.517+0000 7f4ec27fc640 1 --2- 172.21.15.83:0/2955306681 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f4eac0b6680 0x7f4eac0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:51:58.519 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:58.518+0000 7f4ec95c3640 1 --2- 172.21.15.83:0/2955306681 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f4eac0b6680 0x7f4eac0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:51:58.519 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:58.518+0000 7f4ec27fc640 1 -- 172.21.15.83:0/2955306681 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9403+0+0 (secure 0 0 0) 0x7f4eb8108dd0 con 0x7f4ec4105260 2024-09-21T01:51:58.519 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:58.518+0000 7f4ec95c3640 1 --2- 172.21.15.83:0/2955306681 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f4eac0b6680 0x7f4eac0b8b90 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f4eb4009bd0 tx=0x7f4eb4005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:51:58.521 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:58.521+0000 7f4ec27fc640 1 -- 172.21.15.83:0/2955306681 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4eb80cf040 con 0x7f4ec4105260 2024-09-21T01:51:58.702 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:58.701+0000 7f4ecb827640 1 -- 172.21.15.83:0/2955306681 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f4ec4108f40 con 0x7f4ec4105260 2024-09-21T01:51:58.702 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:58.702+0000 7f4ec27fc640 1 -- 172.21.15.83:0/2955306681 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v92) ==== 100+0+11 (secure 0 0 0) 0x7f4eb80d3420 con 0x7f4ec4105260 2024-09-21T01:51:58.702 INFO:teuthology.orchestra.run.smithi083.stdout:pg_num: 64 2024-09-21T01:51:58.704 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:58.704+0000 7f4ecb827640 1 -- 172.21.15.83:0/2955306681 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f4eac0b6680 msgr2=0x7f4eac0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:51:58.704 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:58.704+0000 7f4ecb827640 1 --2- 172.21.15.83:0/2955306681 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f4eac0b6680 0x7f4eac0b8b90 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f4eb4009bd0 tx=0x7f4eb4005f90 comp rx=0 tx=0).stop 2024-09-21T01:51:58.705 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:58.704+0000 7f4ecb827640 1 -- 172.21.15.83:0/2955306681 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4ec4105260 msgr2=0x7f4ec419a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:51:58.705 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:58.704+0000 7f4ecb827640 1 --2- 172.21.15.83:0/2955306681 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4ec4105260 0x7f4ec419a8f0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f4eb802ade0 tx=0x7f4eb8003f90 comp rx=0 tx=0).stop 2024-09-21T01:51:58.705 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:58.704+0000 7f4ecb827640 1 -- 172.21.15.83:0/2955306681 shutdown_connections 2024-09-21T01:51:58.705 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:58.704+0000 7f4ecb827640 1 --2- 172.21.15.83:0/2955306681 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f4eac0b6680 0x7f4eac0b8b90 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:51:58.705 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:58.704+0000 7f4ecb827640 1 --2- 172.21.15.83:0/2955306681 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4ec410dde0 0x7f4ec419fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:51:58.705 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:58.704+0000 7f4ecb827640 1 --2- 172.21.15.83:0/2955306681 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4ec4105260 0x7f4ec419a8f0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:51:58.705 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:58.704+0000 7f4ecb827640 1 --2- 172.21.15.83:0/2955306681 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4ec4104830 0x7f4ec419a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:51:58.705 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:58.704+0000 7f4ecb827640 1 -- 172.21.15.83:0/2955306681 >> 172.21.15.83:0/2955306681 conn(0x7f4ec4079630 msgr2=0x7f4ec41008a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:51:58.705 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:58.704+0000 7f4ecb827640 1 -- 172.21.15.83:0/2955306681 shutdown_connections 2024-09-21T01:51:58.705 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:58.704+0000 7f4ecb827640 1 -- 172.21.15.83:0/2955306681 wait complete. 2024-09-21T01:51:58.716 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-21T01:51:58.829 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:58.828+0000 7f6e94520640 1 -- 172.21.15.83:0/3233146251 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6e8c109410 msgr2=0x7f6e8c109820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:51:58.829 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:58.828+0000 7f6e94520640 1 --2- 172.21.15.83:0/3233146251 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6e8c109410 0x7f6e8c109820 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f6e7c009900 tx=0x7f6e7c02a3f0 comp rx=0 tx=0).stop 2024-09-21T01:51:58.829 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:58.828+0000 7f6e94520640 1 -- 172.21.15.83:0/3233146251 shutdown_connections 2024-09-21T01:51:58.830 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:58.828+0000 7f6e94520640 1 --2- 172.21.15.83:0/3233146251 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6e8c109d60 0x7f6e8c110590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:51:58.830 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:58.828+0000 7f6e94520640 1 --2- 172.21.15.83:0/3233146251 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6e8c109410 0x7f6e8c109820 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:51:58.830 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:58.828+0000 7f6e94520640 1 --2- 172.21.15.83:0/3233146251 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6e8c103ae0 0x7f6e8c103ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:51:58.830 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:58.828+0000 7f6e94520640 1 -- 172.21.15.83:0/3233146251 >> 172.21.15.83:0/3233146251 conn(0x7f6e8c07a8c0 msgr2=0x7f6e8c07acd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:51:58.830 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:58.828+0000 7f6e94520640 1 -- 172.21.15.83:0/3233146251 shutdown_connections 2024-09-21T01:51:58.830 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:58.828+0000 7f6e94520640 1 -- 172.21.15.83:0/3233146251 wait complete. 2024-09-21T01:51:58.830 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:58.829+0000 7f6e94520640 1 Processor -- start 2024-09-21T01:51:58.830 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:58.829+0000 7f6e94520640 1 -- start start 2024-09-21T01:51:58.832 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:58.829+0000 7f6e94520640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6e8c103ae0 0x7f6e8c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:51:58.832 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:58.829+0000 7f6e94520640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6e8c109410 0x7f6e8c075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:51:58.832 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:58.829+0000 7f6e94520640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6e8c109d60 0x7f6e8c076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:51:58.832 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:58.829+0000 7f6e94520640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f6e8c1138d0 con 0x7f6e8c109d60 2024-09-21T01:51:58.832 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:58.829+0000 7f6e94520640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f6e8c113750 con 0x7f6e8c109410 2024-09-21T01:51:58.832 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:58.829+0000 7f6e94520640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f6e8c113a50 con 0x7f6e8c103ae0 2024-09-21T01:51:58.832 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:58.829+0000 7f6e92abd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6e8c109d60 0x7f6e8c076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:51:58.832 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:58.829+0000 7f6e92abd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6e8c109d60 0x7f6e8c076190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:51880/0 (socket says 172.21.15.83:51880) 2024-09-21T01:51:58.832 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:58.829+0000 7f6e92abd640 1 -- 172.21.15.83:0/651274450 learned_addr learned my addr 172.21.15.83:0/651274450 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:51:58.832 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:58.830+0000 7f6e922bc640 1 --2- 172.21.15.83:0/651274450 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6e8c103ae0 0x7f6e8c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:51:58.833 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:58.830+0000 7f6e92abd640 1 -- 172.21.15.83:0/651274450 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6e8c103ae0 msgr2=0x7f6e8c075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:51:58.833 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:58.830+0000 7f6e92abd640 1 --2- 172.21.15.83:0/651274450 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6e8c103ae0 0x7f6e8c075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:51:58.833 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:58.830+0000 7f6e92abd640 1 -- 172.21.15.83:0/651274450 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6e8c109410 msgr2=0x7f6e8c075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:51:58.833 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:58.830+0000 7f6e92abd640 1 --2- 172.21.15.83:0/651274450 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6e8c109410 0x7f6e8c075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:51:58.833 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:58.830+0000 7f6e92abd640 1 -- 172.21.15.83:0/651274450 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e8c1a8580 con 0x7f6e8c109d60 2024-09-21T01:51:58.833 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:58.830+0000 7f6e922bc640 1 --2- 172.21.15.83:0/651274450 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6e8c103ae0 0x7f6e8c075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:51:58.833 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:58.830+0000 7f6e92abd640 1 --2- 172.21.15.83:0/651274450 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6e8c109d60 0x7f6e8c076190 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f6e8400cce0 tx=0x7f6e8400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:51:58.833 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:58.830+0000 7f6e837fe640 1 -- 172.21.15.83:0/651274450 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e8400f450 con 0x7f6e8c109d60 2024-09-21T01:51:58.833 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:58.830+0000 7f6e94520640 1 -- 172.21.15.83:0/651274450 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e8c1a8870 con 0x7f6e8c109d60 2024-09-21T01:51:58.833 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:58.830+0000 7f6e837fe640 1 -- 172.21.15.83:0/651274450 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6e8400fa80 con 0x7f6e8c109d60 2024-09-21T01:51:58.833 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:58.830+0000 7f6e837fe640 1 -- 172.21.15.83:0/651274450 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e84018ad0 con 0x7f6e8c109d60 2024-09-21T01:51:58.833 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:58.830+0000 7f6e94520640 1 -- 172.21.15.83:0/651274450 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e8c1a8dc0 con 0x7f6e8c109d60 2024-09-21T01:51:58.833 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:58.831+0000 7f6e94520640 1 -- 172.21.15.83:0/651274450 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e8c103ef0 con 0x7f6e8c109d60 2024-09-21T01:51:58.834 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:58.833+0000 7f6e837fe640 1 -- 172.21.15.83:0/651274450 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7f6e8400f5f0 con 0x7f6e8c109d60 2024-09-21T01:51:58.834 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:58.833+0000 7f6e837fe640 1 --2- 172.21.15.83:0/651274450 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f6e780b6680 0x7f6e780b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:51:58.834 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:58.833+0000 7f6e922bc640 1 --2- 172.21.15.83:0/651274450 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f6e780b6680 0x7f6e780b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:51:58.834 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:58.833+0000 7f6e837fe640 1 -- 172.21.15.83:0/651274450 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9403+0+0 (secure 0 0 0) 0x7f6e840e8340 con 0x7f6e8c109d60 2024-09-21T01:51:58.834 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:58.834+0000 7f6e922bc640 1 --2- 172.21.15.83:0/651274450 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f6e780b6680 0x7f6e780b8b90 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f6e8c077160 tx=0x7f6e88005db0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:51:58.837 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:58.837+0000 7f6e837fe640 1 -- 172.21.15.83:0/651274450 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6e84014030 con 0x7f6e8c109d60 2024-09-21T01:51:58.964 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:51:58 smithi142 ceph-mon[34050]: pgmap v644: 129 pgs: 129 active+clean; 27 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:51:58.965 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:51:58 smithi142 ceph-mon[34050]: from='client.15741 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:51:58.965 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:51:58 smithi142 ceph-mon[34050]: from='client.15747 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:51:58.965 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:51:58 smithi142 ceph-mon[34050]: from='client.? 172.21.15.83:0/642171532' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T01:51:58.965 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:51:58 smithi142 ceph-mon[34050]: from='client.? 172.21.15.83:0/1198223311' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T01:51:58.965 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:51:58 smithi142 ceph-mon[34050]: from='client.? 172.21.15.83:0/712818137' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-21T01:51:58.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:51:58 smithi119 ceph-mon[33693]: pgmap v644: 129 pgs: 129 active+clean; 27 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:51:58.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:51:58 smithi119 ceph-mon[33693]: from='client.15741 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:51:58.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:51:58 smithi119 ceph-mon[33693]: from='client.15747 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:51:58.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:51:58 smithi119 ceph-mon[33693]: from='client.? 172.21.15.83:0/642171532' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T01:51:58.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:51:58 smithi119 ceph-mon[33693]: from='client.? 172.21.15.83:0/1198223311' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T01:51:58.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:51:58 smithi119 ceph-mon[33693]: from='client.? 172.21.15.83:0/712818137' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-21T01:51:59.013 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:59.013+0000 7f6e94520640 1 -- 172.21.15.83:0/651274450 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f6e8c02e640 con 0x7f6e8c109d60 2024-09-21T01:51:59.014 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:59.013+0000 7f6e837fe640 1 -- 172.21.15.83:0/651274450 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v92) ==== 103+0+11 (secure 0 0 0) 0x7f6e840ae5b0 con 0x7f6e8c109d60 2024-09-21T01:51:59.014 INFO:teuthology.orchestra.run.smithi083.stdout:pg_num: 32 2024-09-21T01:51:59.016 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:59.015+0000 7f6e94520640 1 -- 172.21.15.83:0/651274450 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f6e780b6680 msgr2=0x7f6e780b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:51:59.016 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:59.015+0000 7f6e94520640 1 --2- 172.21.15.83:0/651274450 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f6e780b6680 0x7f6e780b8b90 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f6e8c077160 tx=0x7f6e88005db0 comp rx=0 tx=0).stop 2024-09-21T01:51:59.016 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:59.015+0000 7f6e94520640 1 -- 172.21.15.83:0/651274450 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6e8c109d60 msgr2=0x7f6e8c076190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:51:59.016 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:59.015+0000 7f6e94520640 1 --2- 172.21.15.83:0/651274450 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6e8c109d60 0x7f6e8c076190 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f6e8400cce0 tx=0x7f6e8400a620 comp rx=0 tx=0).stop 2024-09-21T01:51:59.016 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:59.015+0000 7f6e94520640 1 -- 172.21.15.83:0/651274450 shutdown_connections 2024-09-21T01:51:59.016 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:59.015+0000 7f6e94520640 1 --2- 172.21.15.83:0/651274450 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f6e780b6680 0x7f6e780b8b90 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:51:59.016 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:59.015+0000 7f6e94520640 1 --2- 172.21.15.83:0/651274450 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6e8c109d60 0x7f6e8c076190 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:51:59.016 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:59.015+0000 7f6e94520640 1 --2- 172.21.15.83:0/651274450 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6e8c109410 0x7f6e8c075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:51:59.017 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:59.015+0000 7f6e94520640 1 --2- 172.21.15.83:0/651274450 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6e8c103ae0 0x7f6e8c075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:51:59.017 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:59.015+0000 7f6e94520640 1 -- 172.21.15.83:0/651274450 >> 172.21.15.83:0/651274450 conn(0x7f6e8c07a8c0 msgr2=0x7f6e8c1054d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:51:59.017 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:59.016+0000 7f6e94520640 1 -- 172.21.15.83:0/651274450 shutdown_connections 2024-09-21T01:51:59.017 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:59.016+0000 7f6e94520640 1 -- 172.21.15.83:0/651274450 wait complete. 2024-09-21T01:51:59.026 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:51:58 smithi083 ceph-mon[31370]: pgmap v644: 129 pgs: 129 active+clean; 27 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-21T01:51:59.026 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:51:58 smithi083 ceph-mon[31370]: from='client.15741 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:51:59.026 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:51:58 smithi083 ceph-mon[31370]: from='client.15747 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T01:51:59.027 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:51:58 smithi083 ceph-mon[31370]: from='client.? 172.21.15.83:0/642171532' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T01:51:59.027 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:51:58 smithi083 ceph-mon[31370]: from='client.? 172.21.15.83:0/1198223311' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T01:51:59.027 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:51:58 smithi083 ceph-mon[31370]: from='client.? 172.21.15.83:0/712818137' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-21T01:51:59.028 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-09-21T01:51:59.137 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:59.136+0000 7fb99aece640 1 -- 172.21.15.83:0/975217985 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb9941050c0 msgr2=0x7fb9941054d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:51:59.137 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:59.136+0000 7fb99aece640 1 --2- 172.21.15.83:0/975217985 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb9941050c0 0x7fb9941054d0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fb980009900 tx=0x7fb98002a410 comp rx=0 tx=0).stop 2024-09-21T01:51:59.137 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:59.136+0000 7fb99aece640 1 -- 172.21.15.83:0/975217985 shutdown_connections 2024-09-21T01:51:59.137 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:59.136+0000 7fb99aece640 1 --2- 172.21.15.83:0/975217985 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb994105a10 0x7fb99410f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:51:59.137 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:59.136+0000 7fb99aece640 1 --2- 172.21.15.83:0/975217985 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb9941050c0 0x7fb9941054d0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:51:59.137 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:59.136+0000 7fb99aece640 1 --2- 172.21.15.83:0/975217985 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb994103100 0x7fb994103510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:51:59.137 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:59.136+0000 7fb99aece640 1 -- 172.21.15.83:0/975217985 >> 172.21.15.83:0/975217985 conn(0x7fb994079ce0 msgr2=0x7fb99407a0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:51:59.138 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:59.136+0000 7fb99aece640 1 -- 172.21.15.83:0/975217985 shutdown_connections 2024-09-21T01:51:59.138 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:59.136+0000 7fb99aece640 1 -- 172.21.15.83:0/975217985 wait complete. 2024-09-21T01:51:59.139 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:59.137+0000 7fb99aece640 1 Processor -- start 2024-09-21T01:51:59.140 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:59.137+0000 7fb99aece640 1 -- start start 2024-09-21T01:51:59.140 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:59.137+0000 7fb99aece640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb994103100 0x7fb9941992f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:51:59.140 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:59.137+0000 7fb99aece640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb9941050c0 0x7fb994199890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:51:59.140 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:59.137+0000 7fb99aece640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb994105a10 0x7fb99419eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:51:59.140 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:59.137+0000 7fb99aece640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fb994112790 con 0x7fb994103100 2024-09-21T01:51:59.140 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:59.137+0000 7fb99aece640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fb994112610 con 0x7fb9941050c0 2024-09-21T01:51:59.140 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:59.137+0000 7fb99aece640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fb994112910 con 0x7fb994105a10 2024-09-21T01:51:59.140 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:59.137+0000 7fb998c6a640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb994103100 0x7fb9941992f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:51:59.140 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:59.137+0000 7fb998c6a640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb994103100 0x7fb9941992f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:51892/0 (socket says 172.21.15.83:51892) 2024-09-21T01:51:59.140 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:59.137+0000 7fb998c6a640 1 -- 172.21.15.83:0/2550870353 learned_addr learned my addr 172.21.15.83:0/2550870353 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:51:59.140 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:59.137+0000 7fb993fff640 1 --2- 172.21.15.83:0/2550870353 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb9941050c0 0x7fb994199890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:51:59.140 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:59.138+0000 7fb99946b640 1 --2- 172.21.15.83:0/2550870353 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb994105a10 0x7fb99419eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:51:59.140 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:59.138+0000 7fb998c6a640 1 -- 172.21.15.83:0/2550870353 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb994105a10 msgr2=0x7fb99419eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:51:59.141 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:59.138+0000 7fb998c6a640 1 --2- 172.21.15.83:0/2550870353 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb994105a10 0x7fb99419eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:51:59.141 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:59.138+0000 7fb998c6a640 1 -- 172.21.15.83:0/2550870353 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb9941050c0 msgr2=0x7fb994199890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:51:59.141 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:59.138+0000 7fb998c6a640 1 --2- 172.21.15.83:0/2550870353 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb9941050c0 0x7fb994199890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:51:59.141 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:59.138+0000 7fb998c6a640 1 -- 172.21.15.83:0/2550870353 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb99419f220 con 0x7fb994103100 2024-09-21T01:51:59.141 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:59.138+0000 7fb99946b640 1 --2- 172.21.15.83:0/2550870353 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb994105a10 0x7fb99419eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:51:59.141 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:59.138+0000 7fb998c6a640 1 --2- 172.21.15.83:0/2550870353 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb994103100 0x7fb9941992f0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fb98800c970 tx=0x7fb98800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:51:59.141 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:59.138+0000 7fb991ffb640 1 -- 172.21.15.83:0/2550870353 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb988004220 con 0x7fb994103100 2024-09-21T01:51:59.141 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:59.138+0000 7fb991ffb640 1 -- 172.21.15.83:0/2550870353 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb988007e40 con 0x7fb994103100 2024-09-21T01:51:59.141 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:59.138+0000 7fb99aece640 1 -- 172.21.15.83:0/2550870353 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb99419f510 con 0x7fb994103100 2024-09-21T01:51:59.141 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:59.138+0000 7fb991ffb640 1 -- 172.21.15.83:0/2550870353 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9880047c0 con 0x7fb994103100 2024-09-21T01:51:59.141 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:59.138+0000 7fb99aece640 1 -- 172.21.15.83:0/2550870353 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9941a5ca0 con 0x7fb994103100 2024-09-21T01:51:59.141 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:59.139+0000 7fb99aece640 1 -- 172.21.15.83:0/2550870353 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb994103510 con 0x7fb994103100 2024-09-21T01:51:59.142 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:59.141+0000 7fb991ffb640 1 -- 172.21.15.83:0/2550870353 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7fb9880079b0 con 0x7fb994103100 2024-09-21T01:51:59.142 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:59.141+0000 7fb991ffb640 1 --2- 172.21.15.83:0/2550870353 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fb9840b6680 0x7fb9840b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:51:59.142 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:59.141+0000 7fb993fff640 1 --2- 172.21.15.83:0/2550870353 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fb9840b6680 0x7fb9840b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:51:59.142 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:59.142+0000 7fb991ffb640 1 -- 172.21.15.83:0/2550870353 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9403+0+0 (secure 0 0 0) 0x7fb9880e7c40 con 0x7fb994103100 2024-09-21T01:51:59.142 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:59.142+0000 7fb993fff640 1 --2- 172.21.15.83:0/2550870353 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fb9840b6680 0x7fb9840b8b90 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fb980005940 tx=0x7fb9800058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:51:59.145 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:59.145+0000 7fb991ffb640 1 -- 172.21.15.83:0/2550870353 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb988014030 con 0x7fb994103100 2024-09-21T01:51:59.372 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:59.372+0000 7fb99aece640 1 -- 172.21.15.83:0/2550870353 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7fb99402e640 con 0x7fb994103100 2024-09-21T01:51:59.380 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:59.380+0000 7fb991ffb640 1 -- 172.21.15.83:0/2550870353 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v24) ==== 81+0+834054 (secure 0 0 0) 0x7fb9880a7e20 con 0x7fb994103100 2024-09-21T01:51:59.390 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T01:51:59.390 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-09-21T01:51:59.390 INFO:teuthology.orchestra.run.smithi083.stdout: "epoch": 24, 2024-09-21T01:51:59.390 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.390 INFO:teuthology.orchestra.run.smithi083.stdout: "active_gid": 14223, 2024-09-21T01:51:59.390 INFO:teuthology.orchestra.run.smithi083.stdout: "active_name": "x", 2024-09-21T01:51:59.390 INFO:teuthology.orchestra.run.smithi083.stdout: "active_addrs": { 2024-09-21T01:51:59.390 INFO:teuthology.orchestra.run.smithi083.stdout: "addrvec": [ 2024-09-21T01:51:59.391 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-21T01:51:59.391 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "v2", 2024-09-21T01:51:59.391 INFO:teuthology.orchestra.run.smithi083.stdout: "addr": "172.21.15.83:6800", 2024-09-21T01:51:59.391 INFO:teuthology.orchestra.run.smithi083.stdout: "nonce": 1748483157 2024-09-21T01:51:59.391 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.391 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-21T01:51:59.391 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "v1", 2024-09-21T01:51:59.391 INFO:teuthology.orchestra.run.smithi083.stdout: "addr": "172.21.15.83:6801", 2024-09-21T01:51:59.391 INFO:teuthology.orchestra.run.smithi083.stdout: "nonce": 1748483157 2024-09-21T01:51:59.391 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:51:59.391 INFO:teuthology.orchestra.run.smithi083.stdout: ] 2024-09-21T01:51:59.391 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.391 INFO:teuthology.orchestra.run.smithi083.stdout: "active_addr": "172.21.15.83:6801/1748483157", 2024-09-21T01:51:59.391 INFO:teuthology.orchestra.run.smithi083.stdout: "active_change": "2024-09-21T01:33:08.666649+0000", 2024-09-21T01:51:59.392 INFO:teuthology.orchestra.run.smithi083.stdout: "active_mgr_features": 4540719139924082687, 2024-09-21T01:51:59.392 INFO:teuthology.orchestra.run.smithi083.stdout: "available": true, 2024-09-21T01:51:59.392 INFO:teuthology.orchestra.run.smithi083.stdout: "standbys": [ 2024-09-21T01:51:59.392 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-21T01:51:59.392 INFO:teuthology.orchestra.run.smithi083.stdout: "gid": 24133, 2024-09-21T01:51:59.392 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "z", 2024-09-21T01:51:59.392 INFO:teuthology.orchestra.run.smithi083.stdout: "mgr_features": 4540719139924082687, 2024-09-21T01:51:59.392 INFO:teuthology.orchestra.run.smithi083.stdout: "available_modules": [ 2024-09-21T01:51:59.392 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-21T01:51:59.392 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "alerts", 2024-09-21T01:51:59.392 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-21T01:51:59.392 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-21T01:51:59.393 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-21T01:51:59.393 INFO:teuthology.orchestra.run.smithi083.stdout: "interval": { 2024-09-21T01:51:59.393 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "interval", 2024-09-21T01:51:59.393 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-09-21T01:51:59.393 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.393 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.393 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "60", 2024-09-21T01:51:59.393 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.393 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.393 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.393 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "How frequently to reexamine health status", 2024-09-21T01:51:59.393 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.393 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.394 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.394 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.394 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-21T01:51:59.394 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-21T01:51:59.394 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.394 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.394 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.394 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:51:59.394 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.394 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.394 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:51:59.394 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:51:59.394 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:51:59.394 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:51:59.395 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:51:59.395 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:51:59.395 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:51:59.395 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:51:59.395 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.395 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.395 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.395 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.395 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.395 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-21T01:51:59.395 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-21T01:51:59.395 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.395 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.396 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.396 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:51:59.396 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.396 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.396 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.396 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.396 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.396 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.396 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.396 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.396 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-21T01:51:59.396 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-21T01:51:59.396 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.396 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.396 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.397 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-21T01:51:59.397 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.397 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.397 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:51:59.397 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:51:59.397 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:51:59.397 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:51:59.397 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:51:59.397 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:51:59.397 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:51:59.397 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:51:59.397 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.397 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.397 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.398 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.398 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.398 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-21T01:51:59.398 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-21T01:51:59.398 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.398 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.398 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.398 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:51:59.398 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.398 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.398 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.399 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.399 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.399 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.399 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.399 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.399 INFO:teuthology.orchestra.run.smithi083.stdout: "smtp_destination": { 2024-09-21T01:51:59.399 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "smtp_destination", 2024-09-21T01:51:59.399 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.399 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.399 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.399 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:51:59.399 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.399 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.400 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.400 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Email address to send alerts to, use commas to separate multiple", 2024-09-21T01:51:59.400 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.400 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.400 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.400 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.400 INFO:teuthology.orchestra.run.smithi083.stdout: "smtp_from_name": { 2024-09-21T01:51:59.400 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "smtp_from_name", 2024-09-21T01:51:59.400 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.400 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.400 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.400 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "Ceph", 2024-09-21T01:51:59.400 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.400 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.400 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.401 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Email From: name", 2024-09-21T01:51:59.401 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.401 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.401 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.401 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.401 INFO:teuthology.orchestra.run.smithi083.stdout: "smtp_host": { 2024-09-21T01:51:59.401 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "smtp_host", 2024-09-21T01:51:59.401 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.401 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.401 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.401 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:51:59.401 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.401 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.401 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.401 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "SMTP server", 2024-09-21T01:51:59.401 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.402 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.402 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.402 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.402 INFO:teuthology.orchestra.run.smithi083.stdout: "smtp_password": { 2024-09-21T01:51:59.402 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "smtp_password", 2024-09-21T01:51:59.402 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.402 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.402 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.402 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:51:59.402 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.402 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.402 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.402 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Password to authenticate with", 2024-09-21T01:51:59.402 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.403 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.403 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.403 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.403 INFO:teuthology.orchestra.run.smithi083.stdout: "smtp_port": { 2024-09-21T01:51:59.403 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "smtp_port", 2024-09-21T01:51:59.403 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:51:59.403 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.403 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.403 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "465", 2024-09-21T01:51:59.403 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.403 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.403 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.403 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "SMTP port", 2024-09-21T01:51:59.404 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.404 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.404 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.404 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.404 INFO:teuthology.orchestra.run.smithi083.stdout: "smtp_sender": { 2024-09-21T01:51:59.404 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "smtp_sender", 2024-09-21T01:51:59.404 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.404 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.404 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.404 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:51:59.404 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.404 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.404 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.405 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "SMTP envelope sender", 2024-09-21T01:51:59.405 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.405 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.405 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.405 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.405 INFO:teuthology.orchestra.run.smithi083.stdout: "smtp_ssl": { 2024-09-21T01:51:59.405 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "smtp_ssl", 2024-09-21T01:51:59.405 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.405 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.405 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.405 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-21T01:51:59.406 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.406 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.406 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.406 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-21T01:51:59.406 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.406 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.406 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.406 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.406 INFO:teuthology.orchestra.run.smithi083.stdout: "smtp_user": { 2024-09-21T01:51:59.406 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "smtp_user", 2024-09-21T01:51:59.406 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.406 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.406 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.406 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:51:59.407 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.407 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.407 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.407 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "User to authenticate as", 2024-09-21T01:51:59.407 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.407 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.407 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.407 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.407 INFO:teuthology.orchestra.run.smithi083.stdout: "sqlite3_killpoint": { 2024-09-21T01:51:59.407 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:51:59.407 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:51:59.407 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "dev", 2024-09-21T01:51:59.407 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.407 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0", 2024-09-21T01:51:59.408 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.408 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.408 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.408 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.408 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.408 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.408 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.408 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:51:59.408 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:51:59.408 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.408 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-21T01:51:59.408 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "balancer", 2024-09-21T01:51:59.408 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-21T01:51:59.408 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-21T01:51:59.409 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-21T01:51:59.409 INFO:teuthology.orchestra.run.smithi083.stdout: "active": { 2024-09-21T01:51:59.409 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "active", 2024-09-21T01:51:59.409 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.409 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.409 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.409 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-21T01:51:59.409 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.409 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.409 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.409 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "automatically balance PGs across cluster", 2024-09-21T01:51:59.409 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.409 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.410 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.410 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.410 INFO:teuthology.orchestra.run.smithi083.stdout: "begin_time": { 2024-09-21T01:51:59.410 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "begin_time", 2024-09-21T01:51:59.410 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.410 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.410 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.410 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0000", 2024-09-21T01:51:59.410 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.410 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.410 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.410 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "beginning time of day to automatically balance", 2024-09-21T01:51:59.410 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-21T01:51:59.410 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.411 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.411 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.411 INFO:teuthology.orchestra.run.smithi083.stdout: "begin_weekday": { 2024-09-21T01:51:59.411 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "begin_weekday", 2024-09-21T01:51:59.411 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "uint", 2024-09-21T01:51:59.411 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.411 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.411 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0", 2024-09-21T01:51:59.411 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "0", 2024-09-21T01:51:59.411 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "6", 2024-09-21T01:51:59.411 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.411 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-21T01:51:59.411 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-21T01:51:59.411 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.412 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.412 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.412 INFO:teuthology.orchestra.run.smithi083.stdout: "crush_compat_max_iterations": { 2024-09-21T01:51:59.412 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "crush_compat_max_iterations", 2024-09-21T01:51:59.412 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "uint", 2024-09-21T01:51:59.412 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.412 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.412 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "25", 2024-09-21T01:51:59.412 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "1", 2024-09-21T01:51:59.412 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "250", 2024-09-21T01:51:59.412 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.412 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-21T01:51:59.412 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.412 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.413 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.413 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.413 INFO:teuthology.orchestra.run.smithi083.stdout: "crush_compat_metrics": { 2024-09-21T01:51:59.413 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "crush_compat_metrics", 2024-09-21T01:51:59.413 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.413 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.413 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.413 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "pgs,objects,bytes", 2024-09-21T01:51:59.413 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.413 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.413 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.413 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-21T01:51:59.413 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-21T01:51:59.413 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.413 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.414 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.414 INFO:teuthology.orchestra.run.smithi083.stdout: "crush_compat_step": { 2024-09-21T01:51:59.414 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "crush_compat_step", 2024-09-21T01:51:59.414 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "float", 2024-09-21T01:51:59.414 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.414 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.414 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0.5", 2024-09-21T01:51:59.414 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "0.001", 2024-09-21T01:51:59.414 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "0.999", 2024-09-21T01:51:59.414 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.414 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "aggressiveness of optimization", 2024-09-21T01:51:59.414 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-21T01:51:59.414 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.414 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.415 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.415 INFO:teuthology.orchestra.run.smithi083.stdout: "end_time": { 2024-09-21T01:51:59.415 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "end_time", 2024-09-21T01:51:59.415 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.415 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.415 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.415 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "2359", 2024-09-21T01:51:59.415 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.415 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.415 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.415 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "ending time of day to automatically balance", 2024-09-21T01:51:59.415 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-21T01:51:59.415 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.415 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.416 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.416 INFO:teuthology.orchestra.run.smithi083.stdout: "end_weekday": { 2024-09-21T01:51:59.416 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "end_weekday", 2024-09-21T01:51:59.416 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "uint", 2024-09-21T01:51:59.416 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.416 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.416 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0", 2024-09-21T01:51:59.416 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "0", 2024-09-21T01:51:59.416 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "6", 2024-09-21T01:51:59.416 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.416 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-21T01:51:59.416 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-21T01:51:59.416 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.416 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.416 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.417 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-21T01:51:59.417 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-21T01:51:59.417 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.417 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.417 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.417 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:51:59.417 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.417 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.417 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:51:59.417 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:51:59.417 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:51:59.417 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:51:59.417 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:51:59.418 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:51:59.418 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:51:59.418 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:51:59.418 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.418 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.418 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.418 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.418 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.418 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-21T01:51:59.418 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-21T01:51:59.418 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.418 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.418 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.419 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:51:59.419 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.419 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.419 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.419 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.419 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.419 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.419 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.419 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.419 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-21T01:51:59.419 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-21T01:51:59.419 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.419 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.419 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.419 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-21T01:51:59.420 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.420 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.420 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:51:59.420 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:51:59.420 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:51:59.420 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:51:59.420 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:51:59.420 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:51:59.420 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:51:59.420 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:51:59.420 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.420 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.420 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.420 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.421 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.421 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-21T01:51:59.421 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-21T01:51:59.421 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.421 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.421 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.421 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:51:59.421 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.421 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.421 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.421 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.421 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.421 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.421 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.421 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.422 INFO:teuthology.orchestra.run.smithi083.stdout: "min_score": { 2024-09-21T01:51:59.422 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "min_score", 2024-09-21T01:51:59.422 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "float", 2024-09-21T01:51:59.422 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.422 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.422 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0", 2024-09-21T01:51:59.422 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.422 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.422 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.422 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-21T01:51:59.422 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.422 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.422 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.422 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.423 INFO:teuthology.orchestra.run.smithi083.stdout: "mode": { 2024-09-21T01:51:59.423 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "mode", 2024-09-21T01:51:59.423 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.423 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.423 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.423 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "upmap", 2024-09-21T01:51:59.423 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.423 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.423 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:51:59.423 INFO:teuthology.orchestra.run.smithi083.stdout: "crush-compat", 2024-09-21T01:51:59.423 INFO:teuthology.orchestra.run.smithi083.stdout: "none", 2024-09-21T01:51:59.423 INFO:teuthology.orchestra.run.smithi083.stdout: "read", 2024-09-21T01:51:59.423 INFO:teuthology.orchestra.run.smithi083.stdout: "upmap", 2024-09-21T01:51:59.423 INFO:teuthology.orchestra.run.smithi083.stdout: "upmap-read" 2024-09-21T01:51:59.424 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:51:59.424 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Balancer mode", 2024-09-21T01:51:59.424 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.424 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.424 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.424 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.424 INFO:teuthology.orchestra.run.smithi083.stdout: "pool_ids": { 2024-09-21T01:51:59.424 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "pool_ids", 2024-09-21T01:51:59.424 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.424 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.424 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.424 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:51:59.424 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.424 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.424 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.425 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-21T01:51:59.425 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.425 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.425 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.425 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.425 INFO:teuthology.orchestra.run.smithi083.stdout: "sleep_interval": { 2024-09-21T01:51:59.425 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "sleep_interval", 2024-09-21T01:51:59.425 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-09-21T01:51:59.425 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.425 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.425 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "60", 2024-09-21T01:51:59.425 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.425 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.425 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.426 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-21T01:51:59.426 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.426 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.426 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.426 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.426 INFO:teuthology.orchestra.run.smithi083.stdout: "sqlite3_killpoint": { 2024-09-21T01:51:59.426 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:51:59.426 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:51:59.426 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "dev", 2024-09-21T01:51:59.426 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.426 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0", 2024-09-21T01:51:59.426 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.426 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.426 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.426 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.427 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.427 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.427 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.427 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.427 INFO:teuthology.orchestra.run.smithi083.stdout: "upmap_max_deviation": { 2024-09-21T01:51:59.427 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "upmap_max_deviation", 2024-09-21T01:51:59.427 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:51:59.427 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.427 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.427 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "5", 2024-09-21T01:51:59.427 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "1", 2024-09-21T01:51:59.427 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.427 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.427 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-21T01:51:59.428 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-21T01:51:59.428 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.428 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.428 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.428 INFO:teuthology.orchestra.run.smithi083.stdout: "upmap_max_optimizations": { 2024-09-21T01:51:59.428 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "upmap_max_optimizations", 2024-09-21T01:51:59.428 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "uint", 2024-09-21T01:51:59.428 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.428 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.428 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "10", 2024-09-21T01:51:59.428 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.428 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.428 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.428 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-21T01:51:59.428 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.429 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.429 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.429 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:51:59.429 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:51:59.429 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.429 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-21T01:51:59.429 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "cephadm", 2024-09-21T01:51:59.429 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-21T01:51:59.429 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-21T01:51:59.429 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-21T01:51:59.429 INFO:teuthology.orchestra.run.smithi083.stdout: "agent_down_multiplier": { 2024-09-21T01:51:59.429 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "agent_down_multiplier", 2024-09-21T01:51:59.429 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "float", 2024-09-21T01:51:59.429 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.430 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.430 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "3.0", 2024-09-21T01:51:59.430 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.430 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.430 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.430 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-21T01:51:59.430 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.430 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.430 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.430 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.430 INFO:teuthology.orchestra.run.smithi083.stdout: "agent_refresh_rate": { 2024-09-21T01:51:59.430 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "agent_refresh_rate", 2024-09-21T01:51:59.431 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-09-21T01:51:59.431 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.431 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.431 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "20", 2024-09-21T01:51:59.431 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.431 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.431 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.431 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-21T01:51:59.431 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.431 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.431 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.431 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.431 INFO:teuthology.orchestra.run.smithi083.stdout: "agent_starting_port": { 2024-09-21T01:51:59.431 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "agent_starting_port", 2024-09-21T01:51:59.431 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:51:59.432 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.432 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.432 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "4721", 2024-09-21T01:51:59.432 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.433 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.433 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.433 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-21T01:51:59.433 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.434 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.434 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.434 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.434 INFO:teuthology.orchestra.run.smithi083.stdout: "allow_ptrace": { 2024-09-21T01:51:59.434 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "allow_ptrace", 2024-09-21T01:51:59.434 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.434 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.434 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.434 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:51:59.434 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.434 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.434 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.434 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-21T01:51:59.434 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-21T01:51:59.435 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.435 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.435 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.435 INFO:teuthology.orchestra.run.smithi083.stdout: "autotune_interval": { 2024-09-21T01:51:59.435 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "autotune_interval", 2024-09-21T01:51:59.435 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-09-21T01:51:59.435 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.435 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.435 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "600", 2024-09-21T01:51:59.435 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.435 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.435 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.435 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-21T01:51:59.436 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.436 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.436 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.436 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.436 INFO:teuthology.orchestra.run.smithi083.stdout: "autotune_memory_target_ratio": { 2024-09-21T01:51:59.436 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "autotune_memory_target_ratio", 2024-09-21T01:51:59.436 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "float", 2024-09-21T01:51:59.436 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.436 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.436 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0.7", 2024-09-21T01:51:59.436 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.436 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.436 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.436 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-21T01:51:59.437 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.437 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.437 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.437 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.437 INFO:teuthology.orchestra.run.smithi083.stdout: "cephadm_log_destination": { 2024-09-21T01:51:59.437 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "cephadm_log_destination", 2024-09-21T01:51:59.437 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.437 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.437 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.437 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:51:59.437 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.437 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.437 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:51:59.437 INFO:teuthology.orchestra.run.smithi083.stdout: "file", 2024-09-21T01:51:59.437 INFO:teuthology.orchestra.run.smithi083.stdout: "file,syslog", 2024-09-21T01:51:59.438 INFO:teuthology.orchestra.run.smithi083.stdout: "syslog" 2024-09-21T01:51:59.438 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:51:59.438 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-21T01:51:59.438 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.438 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.438 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.438 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.438 INFO:teuthology.orchestra.run.smithi083.stdout: "cgroups_split": { 2024-09-21T01:51:59.438 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "cgroups_split", 2024-09-21T01:51:59.438 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.438 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.438 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.438 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-21T01:51:59.438 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.438 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.439 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.439 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-21T01:51:59.439 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.439 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.439 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.439 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.439 INFO:teuthology.orchestra.run.smithi083.stdout: "config_checks_enabled": { 2024-09-21T01:51:59.439 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "config_checks_enabled", 2024-09-21T01:51:59.439 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.439 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.439 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.439 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:51:59.440 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.440 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.440 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.440 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-21T01:51:59.440 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.440 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.440 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.440 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.440 INFO:teuthology.orchestra.run.smithi083.stdout: "config_dashboard": { 2024-09-21T01:51:59.440 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "config_dashboard", 2024-09-21T01:51:59.440 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.440 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.440 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.440 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-21T01:51:59.441 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.441 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.441 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.441 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-21T01:51:59.441 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.441 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.441 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.441 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.441 INFO:teuthology.orchestra.run.smithi083.stdout: "container_image_alertmanager": { 2024-09-21T01:51:59.441 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "container_image_alertmanager", 2024-09-21T01:51:59.441 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.441 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.441 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.441 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.27.0", 2024-09-21T01:51:59.442 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.442 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.442 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.442 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Prometheus container image", 2024-09-21T01:51:59.442 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.442 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.442 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.442 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.442 INFO:teuthology.orchestra.run.smithi083.stdout: "container_image_base": { 2024-09-21T01:51:59.442 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "container_image_base", 2024-09-21T01:51:59.442 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.442 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.442 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.442 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-21T01:51:59.443 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.443 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.443 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.443 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Container image name, without the tag", 2024-09-21T01:51:59.443 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.443 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.443 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.443 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.443 INFO:teuthology.orchestra.run.smithi083.stdout: "container_image_elasticsearch": { 2024-09-21T01:51:59.443 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "container_image_elasticsearch", 2024-09-21T01:51:59.443 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.443 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.443 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.443 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-21T01:51:59.444 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.444 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.444 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.444 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "elasticsearch container image", 2024-09-21T01:51:59.444 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.444 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.444 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.444 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.444 INFO:teuthology.orchestra.run.smithi083.stdout: "container_image_grafana": { 2024-09-21T01:51:59.444 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "container_image_grafana", 2024-09-21T01:51:59.444 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.444 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.444 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.445 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "quay.io/ceph/grafana:10.4.8", 2024-09-21T01:51:59.445 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.445 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.445 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.445 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Prometheus container image", 2024-09-21T01:51:59.445 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.445 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.445 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.445 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.445 INFO:teuthology.orchestra.run.smithi083.stdout: "container_image_haproxy": { 2024-09-21T01:51:59.445 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "container_image_haproxy", 2024-09-21T01:51:59.445 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.445 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.445 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.446 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-21T01:51:59.446 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.446 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.446 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.446 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "HAproxy container image", 2024-09-21T01:51:59.446 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.446 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.446 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.446 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.446 INFO:teuthology.orchestra.run.smithi083.stdout: "container_image_jaeger_agent": { 2024-09-21T01:51:59.446 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "container_image_jaeger_agent", 2024-09-21T01:51:59.446 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.446 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.446 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.447 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-21T01:51:59.447 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.447 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.447 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.447 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Jaeger agent container image", 2024-09-21T01:51:59.447 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.447 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.447 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.447 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.447 INFO:teuthology.orchestra.run.smithi083.stdout: "container_image_jaeger_collector": { 2024-09-21T01:51:59.447 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "container_image_jaeger_collector", 2024-09-21T01:51:59.447 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.447 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.447 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.448 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-21T01:51:59.448 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.448 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.448 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.448 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Jaeger collector container image", 2024-09-21T01:51:59.448 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.448 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.448 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.448 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.448 INFO:teuthology.orchestra.run.smithi083.stdout: "container_image_jaeger_query": { 2024-09-21T01:51:59.448 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "container_image_jaeger_query", 2024-09-21T01:51:59.448 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.448 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.449 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.449 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-21T01:51:59.449 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.449 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.449 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.449 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Jaeger query container image", 2024-09-21T01:51:59.449 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.449 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.449 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.449 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.449 INFO:teuthology.orchestra.run.smithi083.stdout: "container_image_keepalived": { 2024-09-21T01:51:59.449 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "container_image_keepalived", 2024-09-21T01:51:59.449 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.450 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.450 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.450 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-21T01:51:59.450 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.450 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.450 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.450 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Keepalived container image", 2024-09-21T01:51:59.450 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.450 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.450 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.450 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.450 INFO:teuthology.orchestra.run.smithi083.stdout: "container_image_loki": { 2024-09-21T01:51:59.450 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "container_image_loki", 2024-09-21T01:51:59.450 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.450 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.451 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.451 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-21T01:51:59.451 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.451 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.451 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.451 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Loki container image", 2024-09-21T01:51:59.451 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.451 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.451 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.451 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.451 INFO:teuthology.orchestra.run.smithi083.stdout: "container_image_nginx": { 2024-09-21T01:51:59.451 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "container_image_nginx", 2024-09-21T01:51:59.451 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.451 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.452 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.452 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "quay.io/ceph/nginx:sclorg-nginx-126", 2024-09-21T01:51:59.452 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.452 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.452 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.452 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Nginx container image", 2024-09-21T01:51:59.452 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.452 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.452 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.452 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.452 INFO:teuthology.orchestra.run.smithi083.stdout: "container_image_node_exporter": { 2024-09-21T01:51:59.452 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "container_image_node_exporter", 2024-09-21T01:51:59.452 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.452 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.453 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.453 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.7.0", 2024-09-21T01:51:59.453 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.453 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.453 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.453 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Prometheus container image", 2024-09-21T01:51:59.453 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.453 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.453 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.453 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.453 INFO:teuthology.orchestra.run.smithi083.stdout: "container_image_nvmeof": { 2024-09-21T01:51:59.453 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "container_image_nvmeof", 2024-09-21T01:51:59.453 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.453 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.453 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.454 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.17", 2024-09-21T01:51:59.454 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.454 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.454 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.454 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Nvme-of container image", 2024-09-21T01:51:59.454 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.454 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.454 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.454 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.454 INFO:teuthology.orchestra.run.smithi083.stdout: "container_image_oauth2_proxy": { 2024-09-21T01:51:59.454 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "container_image_oauth2_proxy", 2024-09-21T01:51:59.454 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.454 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.454 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.455 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "quay.io/oauth2-proxy/oauth2-proxy:v7.6.0", 2024-09-21T01:51:59.455 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.455 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.455 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.455 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "oauth2-proxy container image", 2024-09-21T01:51:59.455 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.455 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.455 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.455 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.455 INFO:teuthology.orchestra.run.smithi083.stdout: "container_image_prometheus": { 2024-09-21T01:51:59.455 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "container_image_prometheus", 2024-09-21T01:51:59.455 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.455 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.455 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.456 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "quay.io/prometheus/prometheus:v2.51.0", 2024-09-21T01:51:59.456 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.456 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.456 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.456 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Prometheus container image", 2024-09-21T01:51:59.456 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.456 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.456 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.456 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.456 INFO:teuthology.orchestra.run.smithi083.stdout: "container_image_promtail": { 2024-09-21T01:51:59.456 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "container_image_promtail", 2024-09-21T01:51:59.456 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.456 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.457 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.457 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-21T01:51:59.457 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.457 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.457 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.457 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Promtail container image", 2024-09-21T01:51:59.457 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.457 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.457 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.457 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.457 INFO:teuthology.orchestra.run.smithi083.stdout: "container_image_samba": { 2024-09-21T01:51:59.457 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "container_image_samba", 2024-09-21T01:51:59.457 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.457 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.457 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.458 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-21T01:51:59.458 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.458 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.458 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.458 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Samba/SMB container image", 2024-09-21T01:51:59.458 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.458 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.458 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.458 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.458 INFO:teuthology.orchestra.run.smithi083.stdout: "container_image_samba_metrics": { 2024-09-21T01:51:59.458 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "container_image_samba_metrics", 2024-09-21T01:51:59.458 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.458 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.458 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.459 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "quay.io/samba.org/samba-metrics:latest", 2024-09-21T01:51:59.459 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.459 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.459 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.459 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Samba/SMB metrics exporter container image", 2024-09-21T01:51:59.459 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.459 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.459 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.459 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.459 INFO:teuthology.orchestra.run.smithi083.stdout: "container_image_snmp_gateway": { 2024-09-21T01:51:59.459 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "container_image_snmp_gateway", 2024-09-21T01:51:59.459 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.459 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.459 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.460 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-21T01:51:59.460 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.460 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.460 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.460 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "SNMP Gateway container image", 2024-09-21T01:51:59.460 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.460 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.460 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.460 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.460 INFO:teuthology.orchestra.run.smithi083.stdout: "container_init": { 2024-09-21T01:51:59.460 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "container_init", 2024-09-21T01:51:59.460 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.460 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.460 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.461 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-21T01:51:59.461 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.461 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.461 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.461 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Run podman/docker with `--init`", 2024-09-21T01:51:59.461 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.461 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.461 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.461 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.461 INFO:teuthology.orchestra.run.smithi083.stdout: "daemon_cache_timeout": { 2024-09-21T01:51:59.461 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "daemon_cache_timeout", 2024-09-21T01:51:59.461 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-09-21T01:51:59.461 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.461 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.462 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "600", 2024-09-21T01:51:59.462 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.462 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.462 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.462 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-21T01:51:59.462 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.462 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.462 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.462 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.462 INFO:teuthology.orchestra.run.smithi083.stdout: "default_cephadm_command_timeout": { 2024-09-21T01:51:59.462 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "default_cephadm_command_timeout", 2024-09-21T01:51:59.462 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:51:59.462 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.462 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.463 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "900", 2024-09-21T01:51:59.463 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.463 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.463 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.463 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-21T01:51:59.463 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.463 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.463 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.463 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.463 INFO:teuthology.orchestra.run.smithi083.stdout: "default_registry": { 2024-09-21T01:51:59.463 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "default_registry", 2024-09-21T01:51:59.463 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.463 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.463 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.463 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "docker.io", 2024-09-21T01:51:59.464 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.464 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.464 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.464 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-21T01:51:59.464 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.464 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.464 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.464 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.464 INFO:teuthology.orchestra.run.smithi083.stdout: "device_cache_timeout": { 2024-09-21T01:51:59.464 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "device_cache_timeout", 2024-09-21T01:51:59.464 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-09-21T01:51:59.464 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.464 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.464 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "1800", 2024-09-21T01:51:59.464 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.465 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.465 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.465 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "seconds to cache device inventory", 2024-09-21T01:51:59.465 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.465 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.465 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.465 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.465 INFO:teuthology.orchestra.run.smithi083.stdout: "device_enhanced_scan": { 2024-09-21T01:51:59.465 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "device_enhanced_scan", 2024-09-21T01:51:59.465 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.465 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.465 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.465 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:51:59.465 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.465 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.466 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.466 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-21T01:51:59.466 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.466 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.466 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.466 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.466 INFO:teuthology.orchestra.run.smithi083.stdout: "facts_cache_timeout": { 2024-09-21T01:51:59.466 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "facts_cache_timeout", 2024-09-21T01:51:59.466 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-09-21T01:51:59.466 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.466 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.466 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "60", 2024-09-21T01:51:59.466 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.467 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.467 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.467 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "seconds to cache host facts data", 2024-09-21T01:51:59.467 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.467 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.467 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.467 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.467 INFO:teuthology.orchestra.run.smithi083.stdout: "grafana_dashboards_path": { 2024-09-21T01:51:59.467 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "grafana_dashboards_path", 2024-09-21T01:51:59.467 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.467 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.467 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.467 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-21T01:51:59.467 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.468 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.468 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.468 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-21T01:51:59.468 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.468 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.468 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.468 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.468 INFO:teuthology.orchestra.run.smithi083.stdout: "host_check_interval": { 2024-09-21T01:51:59.468 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "host_check_interval", 2024-09-21T01:51:59.468 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-09-21T01:51:59.468 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.468 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.468 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "600", 2024-09-21T01:51:59.469 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.469 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.469 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.469 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "how frequently to perform a host check", 2024-09-21T01:51:59.469 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.469 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.469 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.469 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.469 INFO:teuthology.orchestra.run.smithi083.stdout: "hw_monitoring": { 2024-09-21T01:51:59.469 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "hw_monitoring", 2024-09-21T01:51:59.469 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.469 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.469 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.469 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:51:59.469 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.470 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.470 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.470 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-21T01:51:59.470 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.470 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.470 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.470 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.470 INFO:teuthology.orchestra.run.smithi083.stdout: "inventory_list_all": { 2024-09-21T01:51:59.470 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "inventory_list_all", 2024-09-21T01:51:59.470 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.470 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.470 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.470 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:51:59.471 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.471 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.471 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.471 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-21T01:51:59.471 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.471 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.471 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.471 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.471 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-21T01:51:59.471 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-21T01:51:59.471 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.471 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.471 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.472 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:51:59.472 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.472 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.472 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:51:59.472 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:51:59.472 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:51:59.472 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:51:59.472 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:51:59.472 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:51:59.472 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:51:59.472 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:51:59.472 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.472 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.472 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.473 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.473 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.473 INFO:teuthology.orchestra.run.smithi083.stdout: "log_refresh_metadata": { 2024-09-21T01:51:59.473 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_refresh_metadata", 2024-09-21T01:51:59.473 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.473 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.473 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.473 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:51:59.473 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.473 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.473 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.473 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-21T01:51:59.473 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.474 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.474 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.474 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.474 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-21T01:51:59.474 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-21T01:51:59.474 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.474 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.474 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.474 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-21T01:51:59.474 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.474 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.474 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.474 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-21T01:51:59.475 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.475 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.475 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.475 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.475 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-21T01:51:59.475 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-21T01:51:59.475 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.475 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.475 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.475 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-21T01:51:59.475 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.475 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.475 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:51:59.475 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:51:59.475 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:51:59.476 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:51:59.476 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:51:59.476 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:51:59.476 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:51:59.476 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:51:59.476 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.476 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.476 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.476 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.476 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.476 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-21T01:51:59.476 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-21T01:51:59.476 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.476 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.477 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.477 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:51:59.477 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.477 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.477 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.477 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.477 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.477 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.477 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.477 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.477 INFO:teuthology.orchestra.run.smithi083.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-21T01:51:59.477 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-21T01:51:59.477 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.477 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.478 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.478 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:51:59.478 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.478 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.478 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.478 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-21T01:51:59.478 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.478 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.478 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.478 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.478 INFO:teuthology.orchestra.run.smithi083.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-21T01:51:59.478 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-21T01:51:59.478 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.478 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.479 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.479 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "*", 2024-09-21T01:51:59.479 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.479 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.479 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.479 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-21T01:51:59.479 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.479 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.479 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.479 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.479 INFO:teuthology.orchestra.run.smithi083.stdout: "max_count_per_host": { 2024-09-21T01:51:59.479 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "max_count_per_host", 2024-09-21T01:51:59.479 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:51:59.479 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.479 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.480 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "10", 2024-09-21T01:51:59.480 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.480 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.480 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.480 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "max number of daemons per service per host", 2024-09-21T01:51:59.480 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.480 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.480 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.480 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.480 INFO:teuthology.orchestra.run.smithi083.stdout: "max_osd_draining_count": { 2024-09-21T01:51:59.480 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "max_osd_draining_count", 2024-09-21T01:51:59.480 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:51:59.480 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.480 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.481 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "10", 2024-09-21T01:51:59.481 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.481 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.481 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.481 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-21T01:51:59.481 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.481 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.481 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.481 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.481 INFO:teuthology.orchestra.run.smithi083.stdout: "migration_current": { 2024-09-21T01:51:59.481 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "migration_current", 2024-09-21T01:51:59.481 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:51:59.481 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.482 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.482 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:51:59.482 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.482 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.482 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.482 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "internal - do not modify", 2024-09-21T01:51:59.482 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.482 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.482 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.482 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.482 INFO:teuthology.orchestra.run.smithi083.stdout: "mode": { 2024-09-21T01:51:59.482 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "mode", 2024-09-21T01:51:59.482 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.483 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.483 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.483 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "root", 2024-09-21T01:51:59.483 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.483 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.483 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:51:59.483 INFO:teuthology.orchestra.run.smithi083.stdout: "cephadm-package", 2024-09-21T01:51:59.483 INFO:teuthology.orchestra.run.smithi083.stdout: "root" 2024-09-21T01:51:59.483 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:51:59.483 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "mode for remote execution of cephadm", 2024-09-21T01:51:59.483 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.483 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.483 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.483 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.484 INFO:teuthology.orchestra.run.smithi083.stdout: "oob_default_addr": { 2024-09-21T01:51:59.484 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "oob_default_addr", 2024-09-21T01:51:59.484 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.484 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.484 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.484 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "169.254.1.1", 2024-09-21T01:51:59.484 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.484 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.484 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.484 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-21T01:51:59.484 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.484 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.485 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.485 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.485 INFO:teuthology.orchestra.run.smithi083.stdout: "prometheus_alerts_path": { 2024-09-21T01:51:59.485 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "prometheus_alerts_path", 2024-09-21T01:51:59.485 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.485 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.485 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.485 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-21T01:51:59.485 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.485 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.485 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.485 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-21T01:51:59.485 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.485 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.486 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.486 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.486 INFO:teuthology.orchestra.run.smithi083.stdout: "registry_insecure": { 2024-09-21T01:51:59.486 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "registry_insecure", 2024-09-21T01:51:59.486 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.486 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.486 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.486 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:51:59.486 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.486 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.486 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.486 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-21T01:51:59.486 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.487 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.487 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.487 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.487 INFO:teuthology.orchestra.run.smithi083.stdout: "registry_password": { 2024-09-21T01:51:59.487 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "registry_password", 2024-09-21T01:51:59.487 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.487 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.487 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.487 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:51:59.487 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.487 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.487 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.487 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-21T01:51:59.487 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.487 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.488 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.488 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.488 INFO:teuthology.orchestra.run.smithi083.stdout: "registry_url": { 2024-09-21T01:51:59.488 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "registry_url", 2024-09-21T01:51:59.488 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.488 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.488 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.488 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:51:59.488 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.488 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.488 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.488 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-21T01:51:59.488 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.488 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.489 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.489 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.489 INFO:teuthology.orchestra.run.smithi083.stdout: "registry_username": { 2024-09-21T01:51:59.489 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "registry_username", 2024-09-21T01:51:59.489 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.489 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.489 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.489 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:51:59.489 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.489 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.489 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.489 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-21T01:51:59.489 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.489 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.489 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.490 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.490 INFO:teuthology.orchestra.run.smithi083.stdout: "secure_monitoring_stack": { 2024-09-21T01:51:59.490 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "secure_monitoring_stack", 2024-09-21T01:51:59.490 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.490 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.490 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.490 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:51:59.490 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.490 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.490 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.490 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-21T01:51:59.490 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.490 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.490 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.491 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.491 INFO:teuthology.orchestra.run.smithi083.stdout: "service_discovery_port": { 2024-09-21T01:51:59.491 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "service_discovery_port", 2024-09-21T01:51:59.491 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:51:59.491 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.491 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.491 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "8765", 2024-09-21T01:51:59.491 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.491 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.491 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.491 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "cephadm service discovery port", 2024-09-21T01:51:59.491 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.491 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.491 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.492 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.492 INFO:teuthology.orchestra.run.smithi083.stdout: "sqlite3_killpoint": { 2024-09-21T01:51:59.492 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:51:59.492 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:51:59.492 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "dev", 2024-09-21T01:51:59.492 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.492 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0", 2024-09-21T01:51:59.492 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.492 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.492 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.492 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.492 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.492 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.492 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.492 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.493 INFO:teuthology.orchestra.run.smithi083.stdout: "ssh_config_file": { 2024-09-21T01:51:59.493 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "ssh_config_file", 2024-09-21T01:51:59.493 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.493 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.493 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.493 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:51:59.493 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.493 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.493 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.493 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-21T01:51:59.493 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.493 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.493 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.494 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.494 INFO:teuthology.orchestra.run.smithi083.stdout: "ssh_keepalive_count_max": { 2024-09-21T01:51:59.494 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "ssh_keepalive_count_max", 2024-09-21T01:51:59.494 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:51:59.494 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.494 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.494 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "3", 2024-09-21T01:51:59.494 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.494 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.494 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.494 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "How many times ssh connections can fail liveness checks before the host is marked offline", 2024-09-21T01:51:59.494 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.494 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.494 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.495 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.495 INFO:teuthology.orchestra.run.smithi083.stdout: "ssh_keepalive_interval": { 2024-09-21T01:51:59.495 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "ssh_keepalive_interval", 2024-09-21T01:51:59.495 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:51:59.495 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.495 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.495 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "7", 2024-09-21T01:51:59.495 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.495 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.495 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.495 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "How often ssh connections are checked for liveness", 2024-09-21T01:51:59.495 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.495 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.495 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.496 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.496 INFO:teuthology.orchestra.run.smithi083.stdout: "use_agent": { 2024-09-21T01:51:59.496 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "use_agent", 2024-09-21T01:51:59.496 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.496 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.496 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.496 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:51:59.496 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.496 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.496 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.496 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-21T01:51:59.496 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.496 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.496 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.497 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.497 INFO:teuthology.orchestra.run.smithi083.stdout: "use_repo_digest": { 2024-09-21T01:51:59.497 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "use_repo_digest", 2024-09-21T01:51:59.497 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.497 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.497 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.497 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-21T01:51:59.497 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.497 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.497 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.497 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-21T01:51:59.497 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.497 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.497 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.497 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.498 INFO:teuthology.orchestra.run.smithi083.stdout: "warn_on_failed_host_check": { 2024-09-21T01:51:59.498 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "warn_on_failed_host_check", 2024-09-21T01:51:59.498 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.498 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.498 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.498 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-21T01:51:59.498 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.498 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.498 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.498 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "raise a health warning if the host check fails", 2024-09-21T01:51:59.498 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.498 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.498 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.498 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.499 INFO:teuthology.orchestra.run.smithi083.stdout: "warn_on_stray_daemons": { 2024-09-21T01:51:59.499 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "warn_on_stray_daemons", 2024-09-21T01:51:59.499 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.499 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.499 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.499 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-21T01:51:59.499 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.499 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.499 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.499 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-21T01:51:59.499 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.499 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.499 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.499 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.499 INFO:teuthology.orchestra.run.smithi083.stdout: "warn_on_stray_hosts": { 2024-09-21T01:51:59.500 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "warn_on_stray_hosts", 2024-09-21T01:51:59.500 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.500 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.500 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.500 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-21T01:51:59.500 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.500 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.500 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.500 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-21T01:51:59.500 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.500 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.500 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.500 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:51:59.500 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:51:59.500 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.501 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-21T01:51:59.501 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "crash", 2024-09-21T01:51:59.501 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-21T01:51:59.501 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-21T01:51:59.501 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-21T01:51:59.501 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-21T01:51:59.501 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-21T01:51:59.501 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.501 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.501 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.501 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:51:59.501 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.501 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.501 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:51:59.501 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:51:59.502 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:51:59.502 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:51:59.502 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:51:59.502 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:51:59.502 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:51:59.502 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:51:59.502 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.502 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.502 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.502 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.502 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.502 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-21T01:51:59.502 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-21T01:51:59.502 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.503 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.503 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.503 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:51:59.503 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.503 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.503 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.503 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.503 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.503 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.503 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.503 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.503 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-21T01:51:59.503 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-21T01:51:59.504 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.504 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.504 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.504 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-21T01:51:59.504 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.504 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.504 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:51:59.504 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:51:59.504 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:51:59.504 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:51:59.504 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:51:59.504 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:51:59.504 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:51:59.504 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:51:59.505 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.505 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.505 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.505 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.505 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.505 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-21T01:51:59.505 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-21T01:51:59.505 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.505 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.505 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.505 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:51:59.505 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.505 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.505 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.506 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.506 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.506 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.506 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.506 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.506 INFO:teuthology.orchestra.run.smithi083.stdout: "retain_interval": { 2024-09-21T01:51:59.506 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "retain_interval", 2024-09-21T01:51:59.506 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-09-21T01:51:59.506 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.506 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.506 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "31536000", 2024-09-21T01:51:59.506 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.507 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.507 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.507 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-21T01:51:59.507 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.507 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.507 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.507 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.507 INFO:teuthology.orchestra.run.smithi083.stdout: "sqlite3_killpoint": { 2024-09-21T01:51:59.507 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:51:59.507 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:51:59.507 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "dev", 2024-09-21T01:51:59.507 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.507 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0", 2024-09-21T01:51:59.507 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.508 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.508 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.508 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.508 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.508 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.508 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.508 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.508 INFO:teuthology.orchestra.run.smithi083.stdout: "warn_recent_interval": { 2024-09-21T01:51:59.508 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "warn_recent_interval", 2024-09-21T01:51:59.508 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-09-21T01:51:59.508 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.508 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.508 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "1209600", 2024-09-21T01:51:59.509 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.509 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.509 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.509 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-21T01:51:59.509 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.509 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.509 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.509 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:51:59.509 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:51:59.509 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.509 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-21T01:51:59.509 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "dashboard", 2024-09-21T01:51:59.509 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-21T01:51:59.510 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-21T01:51:59.510 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-21T01:51:59.510 INFO:teuthology.orchestra.run.smithi083.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-21T01:51:59.510 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-21T01:51:59.510 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:51:59.510 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.510 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.510 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "10", 2024-09-21T01:51:59.510 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.510 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.510 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.510 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.510 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.511 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.511 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.511 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.511 INFO:teuthology.orchestra.run.smithi083.stdout: "ALERTMANAGER_API_HOST": { 2024-09-21T01:51:59.511 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-21T01:51:59.511 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.511 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.511 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.511 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:51:59.511 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.511 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.511 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.511 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.512 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.512 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.512 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.512 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.512 INFO:teuthology.orchestra.run.smithi083.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-21T01:51:59.512 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-21T01:51:59.512 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.512 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.512 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.512 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-21T01:51:59.512 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.512 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.512 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.512 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.513 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.513 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.513 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.513 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.513 INFO:teuthology.orchestra.run.smithi083.stdout: "AUDIT_API_ENABLED": { 2024-09-21T01:51:59.513 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "AUDIT_API_ENABLED", 2024-09-21T01:51:59.513 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.513 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.513 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.513 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:51:59.513 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.513 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.513 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.513 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.514 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.514 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.514 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.514 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.514 INFO:teuthology.orchestra.run.smithi083.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-21T01:51:59.514 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-21T01:51:59.514 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.514 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.514 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.514 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-21T01:51:59.514 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.514 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.514 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.515 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.515 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.515 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.515 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.515 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.515 INFO:teuthology.orchestra.run.smithi083.stdout: "ENABLE_BROWSABLE_API": { 2024-09-21T01:51:59.515 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-21T01:51:59.515 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.515 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.515 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.515 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-21T01:51:59.515 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.515 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.515 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.515 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.516 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.516 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.516 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.516 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.516 INFO:teuthology.orchestra.run.smithi083.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-21T01:51:59.516 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-21T01:51:59.516 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.516 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.516 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.516 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-21T01:51:59.516 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.516 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.516 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.516 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.516 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.516 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.517 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.517 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.517 INFO:teuthology.orchestra.run.smithi083.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-21T01:51:59.517 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-21T01:51:59.517 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.517 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.517 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.517 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-21T01:51:59.517 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.517 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.517 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.517 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.517 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.517 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.517 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.517 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.518 INFO:teuthology.orchestra.run.smithi083.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-21T01:51:59.518 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-21T01:51:59.518 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.518 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.518 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.518 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-21T01:51:59.518 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.518 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.518 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.518 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.518 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.518 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.518 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.518 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.519 INFO:teuthology.orchestra.run.smithi083.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-21T01:51:59.519 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-21T01:51:59.519 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.519 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.519 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.519 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-21T01:51:59.519 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.519 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.519 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.519 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.519 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.519 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.520 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.520 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.520 INFO:teuthology.orchestra.run.smithi083.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-21T01:51:59.520 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-21T01:51:59.520 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.520 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.520 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.520 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-21T01:51:59.520 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.520 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.520 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.520 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.520 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.520 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.520 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.521 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.521 INFO:teuthology.orchestra.run.smithi083.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-21T01:51:59.521 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-21T01:51:59.521 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.521 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.521 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.521 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-21T01:51:59.521 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.521 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.521 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.521 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.521 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.521 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.521 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.522 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.522 INFO:teuthology.orchestra.run.smithi083.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-21T01:51:59.522 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-21T01:51:59.522 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.522 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.522 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.522 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-21T01:51:59.522 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.522 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.522 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.522 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.522 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.522 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.522 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.522 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.523 INFO:teuthology.orchestra.run.smithi083.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-21T01:51:59.523 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-21T01:51:59.523 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.523 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.523 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.523 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:51:59.523 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.523 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.523 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.523 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.523 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.523 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.523 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.523 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.524 INFO:teuthology.orchestra.run.smithi083.stdout: "GRAFANA_API_PASSWORD": { 2024-09-21T01:51:59.524 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-21T01:51:59.524 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.524 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.524 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.524 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "admin", 2024-09-21T01:51:59.524 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.524 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.524 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.524 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.524 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.524 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.524 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.524 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.524 INFO:teuthology.orchestra.run.smithi083.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-21T01:51:59.525 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-21T01:51:59.525 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.525 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.525 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.525 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-21T01:51:59.525 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.525 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.525 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.525 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.525 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.525 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.525 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.525 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.525 INFO:teuthology.orchestra.run.smithi083.stdout: "GRAFANA_API_URL": { 2024-09-21T01:51:59.525 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "GRAFANA_API_URL", 2024-09-21T01:51:59.526 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.526 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.526 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.526 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:51:59.526 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.526 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.526 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.526 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.526 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.526 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.526 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.526 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.526 INFO:teuthology.orchestra.run.smithi083.stdout: "GRAFANA_API_USERNAME": { 2024-09-21T01:51:59.526 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-21T01:51:59.526 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.527 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.527 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.527 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "admin", 2024-09-21T01:51:59.527 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.527 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.527 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.527 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.527 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.527 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.527 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.527 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.527 INFO:teuthology.orchestra.run.smithi083.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-21T01:51:59.527 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-21T01:51:59.527 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.528 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.528 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.528 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:51:59.528 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.528 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.528 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.528 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.528 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.528 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.528 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.528 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.528 INFO:teuthology.orchestra.run.smithi083.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-21T01:51:59.528 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-21T01:51:59.528 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.528 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.528 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.529 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:51:59.529 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.529 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.529 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.529 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.529 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.529 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.529 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.529 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.529 INFO:teuthology.orchestra.run.smithi083.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-21T01:51:59.529 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-21T01:51:59.529 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.529 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.529 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.530 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-21T01:51:59.530 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.530 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.530 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.530 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.530 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.530 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.530 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.530 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.530 INFO:teuthology.orchestra.run.smithi083.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-21T01:51:59.530 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-21T01:51:59.530 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.530 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.530 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.530 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:51:59.531 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.531 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.531 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.531 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.531 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.531 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.531 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.531 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.531 INFO:teuthology.orchestra.run.smithi083.stdout: "MANAGED_BY_CLUSTERS": { 2024-09-21T01:51:59.531 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-09-21T01:51:59.531 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.531 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.531 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.531 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "[]", 2024-09-21T01:51:59.531 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.532 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.532 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.532 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.532 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.532 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.532 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.532 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.532 INFO:teuthology.orchestra.run.smithi083.stdout: "MULTICLUSTER_CONFIG": { 2024-09-21T01:51:59.532 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "MULTICLUSTER_CONFIG", 2024-09-21T01:51:59.532 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.532 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.532 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.532 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "{}", 2024-09-21T01:51:59.532 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.533 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.533 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.533 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.533 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.533 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.533 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.533 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.533 INFO:teuthology.orchestra.run.smithi083.stdout: "PROMETHEUS_API_HOST": { 2024-09-21T01:51:59.533 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-21T01:51:59.533 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.533 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.533 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.533 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:51:59.533 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.534 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.534 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.534 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.534 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.534 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.534 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.534 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.534 INFO:teuthology.orchestra.run.smithi083.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-21T01:51:59.534 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-21T01:51:59.534 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.534 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.534 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.534 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-21T01:51:59.534 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.535 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.535 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.535 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.535 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.535 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.535 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.535 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.535 INFO:teuthology.orchestra.run.smithi083.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-21T01:51:59.535 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-21T01:51:59.535 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.535 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.535 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.535 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:51:59.535 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.535 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.536 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.536 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.536 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.536 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.536 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.537 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.537 INFO:teuthology.orchestra.run.smithi083.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-21T01:51:59.537 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-21T01:51:59.537 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.538 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.538 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.538 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:51:59.538 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.538 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.538 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.538 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.538 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.538 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.538 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.538 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.538 INFO:teuthology.orchestra.run.smithi083.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-21T01:51:59.538 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-21T01:51:59.539 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.539 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.539 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.539 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-21T01:51:59.539 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.539 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.539 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.539 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.539 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.539 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.539 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.539 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.539 INFO:teuthology.orchestra.run.smithi083.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-21T01:51:59.540 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-21T01:51:59.540 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.540 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.540 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.540 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-21T01:51:59.540 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.540 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.540 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.540 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.540 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.540 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.540 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.540 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.540 INFO:teuthology.orchestra.run.smithi083.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-21T01:51:59.540 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-21T01:51:59.540 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.541 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.541 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.541 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:51:59.541 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.541 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.541 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.541 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.541 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.541 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.541 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.541 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.541 INFO:teuthology.orchestra.run.smithi083.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-21T01:51:59.541 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-21T01:51:59.541 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.541 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.542 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.542 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:51:59.542 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.542 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.542 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.542 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.542 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.542 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.542 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.542 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.542 INFO:teuthology.orchestra.run.smithi083.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-21T01:51:59.542 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-21T01:51:59.542 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.543 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.543 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.543 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:51:59.543 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.543 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.543 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.543 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.543 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.543 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.543 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.543 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.543 INFO:teuthology.orchestra.run.smithi083.stdout: "PWD_POLICY_ENABLED": { 2024-09-21T01:51:59.543 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-21T01:51:59.543 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.544 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.544 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.544 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-21T01:51:59.544 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.544 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.544 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.544 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.544 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.544 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.544 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.544 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.545 INFO:teuthology.orchestra.run.smithi083.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-21T01:51:59.545 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-21T01:51:59.545 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.545 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.545 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.545 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-21T01:51:59.545 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.545 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.545 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.545 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.545 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.545 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.545 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.546 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.546 INFO:teuthology.orchestra.run.smithi083.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-21T01:51:59.546 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-21T01:51:59.546 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:51:59.546 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.546 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.546 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "10", 2024-09-21T01:51:59.546 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.546 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.546 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.546 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.546 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.546 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.547 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.547 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.547 INFO:teuthology.orchestra.run.smithi083.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-21T01:51:59.547 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-21T01:51:59.547 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:51:59.547 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.547 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.547 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "8", 2024-09-21T01:51:59.547 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.547 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.547 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.547 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.547 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.548 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.548 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.548 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.548 INFO:teuthology.orchestra.run.smithi083.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-21T01:51:59.548 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-21T01:51:59.548 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:51:59.548 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.548 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.548 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "45", 2024-09-21T01:51:59.548 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.548 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.548 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.548 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.548 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.548 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.549 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.549 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.549 INFO:teuthology.orchestra.run.smithi083.stdout: "RGW_API_ACCESS_KEY": { 2024-09-21T01:51:59.549 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-21T01:51:59.549 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.549 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.549 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.549 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:51:59.549 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.549 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.549 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.549 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.549 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.549 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.549 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.550 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.550 INFO:teuthology.orchestra.run.smithi083.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-21T01:51:59.550 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-21T01:51:59.550 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.550 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.550 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.550 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "admin", 2024-09-21T01:51:59.550 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.550 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.550 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.550 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.550 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.550 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.551 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.551 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.551 INFO:teuthology.orchestra.run.smithi083.stdout: "RGW_API_SECRET_KEY": { 2024-09-21T01:51:59.551 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-21T01:51:59.551 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.551 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.551 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.551 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:51:59.551 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.551 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.551 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.551 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.551 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.552 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.552 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.552 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.552 INFO:teuthology.orchestra.run.smithi083.stdout: "RGW_API_SSL_VERIFY": { 2024-09-21T01:51:59.552 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-21T01:51:59.552 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.552 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.552 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.552 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-21T01:51:59.552 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.552 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.552 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.552 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.552 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.553 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.553 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.553 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.553 INFO:teuthology.orchestra.run.smithi083.stdout: "UNSAFE_TLS_v1_2": { 2024-09-21T01:51:59.553 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "UNSAFE_TLS_v1_2", 2024-09-21T01:51:59.553 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.553 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.553 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.553 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:51:59.553 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.553 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.553 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.553 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.553 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.553 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.554 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.554 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.554 INFO:teuthology.orchestra.run.smithi083.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-21T01:51:59.554 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-21T01:51:59.554 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:51:59.554 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.554 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.554 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0", 2024-09-21T01:51:59.554 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.554 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.554 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.554 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.554 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.555 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.555 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.555 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.555 INFO:teuthology.orchestra.run.smithi083.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-21T01:51:59.555 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-21T01:51:59.555 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:51:59.555 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.555 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.555 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "10", 2024-09-21T01:51:59.555 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.555 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.555 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.555 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.555 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.555 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.556 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.556 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.556 INFO:teuthology.orchestra.run.smithi083.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-21T01:51:59.556 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-21T01:51:59.556 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:51:59.556 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.556 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.556 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "5", 2024-09-21T01:51:59.556 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.556 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.556 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.556 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.556 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.556 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.557 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.557 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.557 INFO:teuthology.orchestra.run.smithi083.stdout: "cross_origin_url": { 2024-09-21T01:51:59.557 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "cross_origin_url", 2024-09-21T01:51:59.557 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.557 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.557 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.557 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:51:59.557 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.557 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.557 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.557 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.557 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.557 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.557 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.558 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.558 INFO:teuthology.orchestra.run.smithi083.stdout: "crt_file": { 2024-09-21T01:51:59.558 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "crt_file", 2024-09-21T01:51:59.558 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.558 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.558 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.558 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:51:59.558 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.558 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.558 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.558 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.558 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.558 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.558 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.559 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.559 INFO:teuthology.orchestra.run.smithi083.stdout: "debug": { 2024-09-21T01:51:59.559 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "debug", 2024-09-21T01:51:59.559 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.559 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.559 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.559 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:51:59.559 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.559 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.559 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.559 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Enable/disable debug options", 2024-09-21T01:51:59.559 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.559 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.560 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.560 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.560 INFO:teuthology.orchestra.run.smithi083.stdout: "jwt_token_ttl": { 2024-09-21T01:51:59.560 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "jwt_token_ttl", 2024-09-21T01:51:59.560 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:51:59.560 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.560 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.560 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "28800", 2024-09-21T01:51:59.560 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.560 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.560 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.560 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.560 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.560 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.561 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.561 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.561 INFO:teuthology.orchestra.run.smithi083.stdout: "key_file": { 2024-09-21T01:51:59.561 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "key_file", 2024-09-21T01:51:59.561 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.561 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.561 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.561 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:51:59.561 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.561 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.561 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.561 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.561 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.561 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.561 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.562 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.562 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-21T01:51:59.562 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-21T01:51:59.562 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.562 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.562 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.562 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:51:59.562 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.562 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.562 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:51:59.562 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:51:59.562 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:51:59.562 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:51:59.562 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:51:59.563 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:51:59.563 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:51:59.563 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:51:59.563 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.563 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.563 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.563 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.563 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.563 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-21T01:51:59.563 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-21T01:51:59.563 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.563 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.563 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.563 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:51:59.564 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.564 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.564 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.564 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.564 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.564 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.564 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.564 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.564 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-21T01:51:59.564 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-21T01:51:59.564 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.564 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.564 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.564 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-21T01:51:59.564 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.565 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.565 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:51:59.565 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:51:59.565 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:51:59.565 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:51:59.565 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:51:59.565 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:51:59.565 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:51:59.565 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:51:59.565 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.565 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.565 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.565 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.565 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.565 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-21T01:51:59.566 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-21T01:51:59.566 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.566 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.566 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.566 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:51:59.566 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.566 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.566 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.566 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.566 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.566 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.566 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.566 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.566 INFO:teuthology.orchestra.run.smithi083.stdout: "motd": { 2024-09-21T01:51:59.567 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "motd", 2024-09-21T01:51:59.567 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.567 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.567 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.567 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:51:59.567 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.567 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.567 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.567 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "The message of the day", 2024-09-21T01:51:59.567 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.567 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.567 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.567 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.567 INFO:teuthology.orchestra.run.smithi083.stdout: "redirect_resolve_ip_addr": { 2024-09-21T01:51:59.567 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "redirect_resolve_ip_addr", 2024-09-21T01:51:59.568 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.568 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.568 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.568 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:51:59.568 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.568 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.568 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.568 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.568 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.568 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.568 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.568 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.568 INFO:teuthology.orchestra.run.smithi083.stdout: "server_addr": { 2024-09-21T01:51:59.568 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "server_addr", 2024-09-21T01:51:59.569 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.569 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.569 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.569 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "::", 2024-09-21T01:51:59.569 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.569 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.569 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.569 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.569 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.569 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.569 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.569 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.569 INFO:teuthology.orchestra.run.smithi083.stdout: "server_port": { 2024-09-21T01:51:59.569 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "server_port", 2024-09-21T01:51:59.570 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:51:59.570 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.570 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.570 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "8080", 2024-09-21T01:51:59.570 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.570 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.570 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.570 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.570 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.570 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.570 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.570 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.570 INFO:teuthology.orchestra.run.smithi083.stdout: "sqlite3_killpoint": { 2024-09-21T01:51:59.570 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:51:59.571 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:51:59.571 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "dev", 2024-09-21T01:51:59.571 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.571 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0", 2024-09-21T01:51:59.571 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.571 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.571 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.571 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.571 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.571 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.571 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.571 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.571 INFO:teuthology.orchestra.run.smithi083.stdout: "ssl": { 2024-09-21T01:51:59.571 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "ssl", 2024-09-21T01:51:59.572 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.572 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.572 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.572 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-21T01:51:59.572 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.572 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.572 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.572 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.572 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.572 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.572 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.572 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.572 INFO:teuthology.orchestra.run.smithi083.stdout: "ssl_server_port": { 2024-09-21T01:51:59.572 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "ssl_server_port", 2024-09-21T01:51:59.572 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:51:59.573 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.573 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.573 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "8443", 2024-09-21T01:51:59.573 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.573 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.573 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.573 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.573 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.573 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.573 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.573 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.573 INFO:teuthology.orchestra.run.smithi083.stdout: "sso_oauth2": { 2024-09-21T01:51:59.574 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "sso_oauth2", 2024-09-21T01:51:59.574 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.574 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.574 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.574 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:51:59.574 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.574 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.574 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.574 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.574 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.574 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.574 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.574 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.574 INFO:teuthology.orchestra.run.smithi083.stdout: "standby_behaviour": { 2024-09-21T01:51:59.574 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "standby_behaviour", 2024-09-21T01:51:59.575 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.575 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.575 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.575 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "redirect", 2024-09-21T01:51:59.575 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.575 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.575 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:51:59.575 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:51:59.575 INFO:teuthology.orchestra.run.smithi083.stdout: "redirect" 2024-09-21T01:51:59.575 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:51:59.575 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.575 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.575 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.575 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.576 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.576 INFO:teuthology.orchestra.run.smithi083.stdout: "standby_error_status_code": { 2024-09-21T01:51:59.576 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "standby_error_status_code", 2024-09-21T01:51:59.576 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:51:59.576 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.576 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.576 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "500", 2024-09-21T01:51:59.576 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "400", 2024-09-21T01:51:59.576 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "599", 2024-09-21T01:51:59.576 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.576 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.576 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.576 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.576 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.577 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.577 INFO:teuthology.orchestra.run.smithi083.stdout: "url_prefix": { 2024-09-21T01:51:59.577 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "url_prefix", 2024-09-21T01:51:59.577 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.577 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.577 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.577 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:51:59.577 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.577 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.577 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.577 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.577 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.577 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.577 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.578 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:51:59.578 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:51:59.578 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.578 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-21T01:51:59.578 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "devicehealth", 2024-09-21T01:51:59.578 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-21T01:51:59.578 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-21T01:51:59.578 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-21T01:51:59.578 INFO:teuthology.orchestra.run.smithi083.stdout: "enable_monitoring": { 2024-09-21T01:51:59.578 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "enable_monitoring", 2024-09-21T01:51:59.578 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.578 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.578 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.578 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-21T01:51:59.579 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.579 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.579 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.579 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "monitor device health metrics", 2024-09-21T01:51:59.579 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.579 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.579 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.579 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.579 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-21T01:51:59.579 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-21T01:51:59.579 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.579 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.579 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.579 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:51:59.579 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.580 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.580 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:51:59.580 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:51:59.580 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:51:59.580 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:51:59.580 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:51:59.580 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:51:59.580 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:51:59.580 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:51:59.580 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.580 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.580 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.580 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.580 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.580 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-21T01:51:59.581 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-21T01:51:59.581 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.581 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.581 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.581 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:51:59.581 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.581 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.581 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.581 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.581 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.581 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.581 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.581 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.581 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-21T01:51:59.581 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-21T01:51:59.582 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.582 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.582 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.582 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-21T01:51:59.582 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.582 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.582 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:51:59.582 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:51:59.582 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:51:59.582 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:51:59.582 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:51:59.582 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:51:59.582 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:51:59.582 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:51:59.583 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.583 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.583 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.583 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.583 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.583 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-21T01:51:59.583 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-21T01:51:59.583 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.583 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.583 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.583 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:51:59.583 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.583 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.583 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.583 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.584 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.584 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.584 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.584 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.584 INFO:teuthology.orchestra.run.smithi083.stdout: "mark_out_threshold": { 2024-09-21T01:51:59.584 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "mark_out_threshold", 2024-09-21T01:51:59.584 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-09-21T01:51:59.584 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.584 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.584 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "2419200", 2024-09-21T01:51:59.584 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.584 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.584 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.584 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-21T01:51:59.584 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.585 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.585 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.585 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.585 INFO:teuthology.orchestra.run.smithi083.stdout: "pool_name": { 2024-09-21T01:51:59.585 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "pool_name", 2024-09-21T01:51:59.585 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.585 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.585 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.585 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "device_health_metrics", 2024-09-21T01:51:59.585 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.585 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.585 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.585 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-21T01:51:59.585 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.585 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.586 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.586 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.586 INFO:teuthology.orchestra.run.smithi083.stdout: "retention_period": { 2024-09-21T01:51:59.586 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "retention_period", 2024-09-21T01:51:59.586 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-09-21T01:51:59.586 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.586 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.586 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "15552000", 2024-09-21T01:51:59.586 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.586 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.586 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.586 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "how long to retain device health metrics", 2024-09-21T01:51:59.586 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.587 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.587 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.587 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.587 INFO:teuthology.orchestra.run.smithi083.stdout: "scrape_frequency": { 2024-09-21T01:51:59.587 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "scrape_frequency", 2024-09-21T01:51:59.587 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-09-21T01:51:59.587 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.587 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.587 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "86400", 2024-09-21T01:51:59.587 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.587 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.587 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.587 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-21T01:51:59.587 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.587 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.588 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.588 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.588 INFO:teuthology.orchestra.run.smithi083.stdout: "self_heal": { 2024-09-21T01:51:59.588 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "self_heal", 2024-09-21T01:51:59.588 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.588 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.588 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.588 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-21T01:51:59.588 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.588 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.588 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.588 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-21T01:51:59.588 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.588 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.589 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.589 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.589 INFO:teuthology.orchestra.run.smithi083.stdout: "sleep_interval": { 2024-09-21T01:51:59.589 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "sleep_interval", 2024-09-21T01:51:59.589 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-09-21T01:51:59.589 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.589 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.589 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "600", 2024-09-21T01:51:59.589 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.589 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.589 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.589 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "how frequently to wake up and check device health", 2024-09-21T01:51:59.589 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.589 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.590 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.590 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.590 INFO:teuthology.orchestra.run.smithi083.stdout: "sqlite3_killpoint": { 2024-09-21T01:51:59.590 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:51:59.590 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:51:59.590 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "dev", 2024-09-21T01:51:59.590 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.590 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0", 2024-09-21T01:51:59.590 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.590 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.590 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.590 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.590 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.590 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.591 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.591 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.591 INFO:teuthology.orchestra.run.smithi083.stdout: "warn_threshold": { 2024-09-21T01:51:59.591 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "warn_threshold", 2024-09-21T01:51:59.591 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-09-21T01:51:59.591 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.591 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.591 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "7257600", 2024-09-21T01:51:59.591 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.591 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.591 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.591 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-21T01:51:59.591 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.591 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.592 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.592 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:51:59.592 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:51:59.592 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.592 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-21T01:51:59.592 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "diskprediction_local", 2024-09-21T01:51:59.592 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-21T01:51:59.592 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-21T01:51:59.592 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-21T01:51:59.592 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-21T01:51:59.592 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-21T01:51:59.592 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.592 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.592 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.593 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:51:59.593 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.593 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.593 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:51:59.593 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:51:59.593 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:51:59.593 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:51:59.593 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:51:59.593 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:51:59.593 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:51:59.593 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:51:59.593 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.593 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.593 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.594 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.594 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.594 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-21T01:51:59.594 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-21T01:51:59.594 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.594 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.594 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.594 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:51:59.594 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.594 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.594 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.594 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.594 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.594 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.595 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.595 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.595 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-21T01:51:59.595 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-21T01:51:59.595 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.595 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.595 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.595 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-21T01:51:59.595 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.595 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.595 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:51:59.595 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:51:59.595 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:51:59.595 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:51:59.595 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:51:59.596 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:51:59.596 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:51:59.596 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:51:59.596 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.596 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.596 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.596 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.596 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.596 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-21T01:51:59.596 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-21T01:51:59.596 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.596 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.596 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.596 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:51:59.596 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.597 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.597 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.597 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.597 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.597 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.597 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.597 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.597 INFO:teuthology.orchestra.run.smithi083.stdout: "predict_interval": { 2024-09-21T01:51:59.597 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "predict_interval", 2024-09-21T01:51:59.597 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.597 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.597 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.597 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "86400", 2024-09-21T01:51:59.597 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.598 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.598 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.598 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.598 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.598 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.598 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.598 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.598 INFO:teuthology.orchestra.run.smithi083.stdout: "predictor_model": { 2024-09-21T01:51:59.598 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "predictor_model", 2024-09-21T01:51:59.598 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.598 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.598 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.598 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "prophetstor", 2024-09-21T01:51:59.598 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.599 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.599 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.599 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.599 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.599 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.599 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.599 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.599 INFO:teuthology.orchestra.run.smithi083.stdout: "sleep_interval": { 2024-09-21T01:51:59.599 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "sleep_interval", 2024-09-21T01:51:59.599 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.599 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.599 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.599 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "600", 2024-09-21T01:51:59.599 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.600 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.600 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.600 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.600 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.600 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.600 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.600 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.600 INFO:teuthology.orchestra.run.smithi083.stdout: "sqlite3_killpoint": { 2024-09-21T01:51:59.600 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:51:59.600 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:51:59.600 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "dev", 2024-09-21T01:51:59.600 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.600 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0", 2024-09-21T01:51:59.600 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.600 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.601 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.601 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.601 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.601 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.601 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.601 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:51:59.601 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:51:59.601 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.601 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-21T01:51:59.601 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "influx", 2024-09-21T01:51:59.601 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": false, 2024-09-21T01:51:59.601 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "influxdb python module not found", 2024-09-21T01:51:59.601 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-21T01:51:59.601 INFO:teuthology.orchestra.run.smithi083.stdout: "batch_size": { 2024-09-21T01:51:59.602 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "batch_size", 2024-09-21T01:51:59.602 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:51:59.602 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.602 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.602 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "5000", 2024-09-21T01:51:59.602 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.602 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.602 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.602 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-21T01:51:59.602 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.602 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.602 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.602 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.602 INFO:teuthology.orchestra.run.smithi083.stdout: "database": { 2024-09-21T01:51:59.603 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "database", 2024-09-21T01:51:59.603 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.603 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.603 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.603 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "ceph", 2024-09-21T01:51:59.603 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.603 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.603 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.603 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-21T01:51:59.603 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.603 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.603 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.603 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.603 INFO:teuthology.orchestra.run.smithi083.stdout: "hostname": { 2024-09-21T01:51:59.603 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "hostname", 2024-09-21T01:51:59.604 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.604 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.604 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.604 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:51:59.604 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.604 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.604 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.604 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "InfluxDB server hostname", 2024-09-21T01:51:59.604 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.604 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.604 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.604 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.604 INFO:teuthology.orchestra.run.smithi083.stdout: "interval": { 2024-09-21T01:51:59.604 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "interval", 2024-09-21T01:51:59.604 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-09-21T01:51:59.605 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.605 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.605 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "30", 2024-09-21T01:51:59.605 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "5", 2024-09-21T01:51:59.605 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.605 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.605 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-21T01:51:59.605 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.605 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.605 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.605 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.605 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-21T01:51:59.605 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-21T01:51:59.605 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.606 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.606 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.606 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:51:59.606 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.606 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.606 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:51:59.606 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:51:59.606 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:51:59.606 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:51:59.606 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:51:59.606 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:51:59.606 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:51:59.606 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:51:59.606 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.606 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.607 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.607 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.607 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.607 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-21T01:51:59.607 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-21T01:51:59.607 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.607 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.607 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.607 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:51:59.607 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.607 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.607 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.607 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.607 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.607 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.608 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.608 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.608 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-21T01:51:59.608 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-21T01:51:59.608 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.608 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.608 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.608 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-21T01:51:59.608 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.608 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.608 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:51:59.608 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:51:59.608 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:51:59.608 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:51:59.608 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:51:59.609 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:51:59.609 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:51:59.609 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:51:59.609 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.609 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.609 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.609 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.609 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.609 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-21T01:51:59.609 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-21T01:51:59.609 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.609 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.609 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.609 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:51:59.609 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.610 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.610 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.610 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.610 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.610 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.610 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.610 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.610 INFO:teuthology.orchestra.run.smithi083.stdout: "password": { 2024-09-21T01:51:59.610 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "password", 2024-09-21T01:51:59.610 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.610 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.610 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.611 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:51:59.611 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.611 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.611 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.611 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "password of InfluxDB server user", 2024-09-21T01:51:59.611 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.611 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.611 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.611 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.611 INFO:teuthology.orchestra.run.smithi083.stdout: "port": { 2024-09-21T01:51:59.611 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "port", 2024-09-21T01:51:59.611 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:51:59.612 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.612 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.612 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "8086", 2024-09-21T01:51:59.612 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.612 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.612 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.612 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "InfluxDB server port", 2024-09-21T01:51:59.612 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.612 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.612 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.612 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.612 INFO:teuthology.orchestra.run.smithi083.stdout: "sqlite3_killpoint": { 2024-09-21T01:51:59.612 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:51:59.612 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:51:59.613 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "dev", 2024-09-21T01:51:59.613 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.613 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0", 2024-09-21T01:51:59.613 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.613 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.613 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.613 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.613 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.613 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.613 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.613 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.613 INFO:teuthology.orchestra.run.smithi083.stdout: "ssl": { 2024-09-21T01:51:59.613 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "ssl", 2024-09-21T01:51:59.613 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.614 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.614 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.614 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "false", 2024-09-21T01:51:59.614 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.614 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.614 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.614 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-21T01:51:59.614 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.614 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.614 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.614 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.614 INFO:teuthology.orchestra.run.smithi083.stdout: "threads": { 2024-09-21T01:51:59.614 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "threads", 2024-09-21T01:51:59.614 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:51:59.615 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.615 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.615 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "5", 2024-09-21T01:51:59.615 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "1", 2024-09-21T01:51:59.615 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "32", 2024-09-21T01:51:59.615 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.615 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-21T01:51:59.615 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.615 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.615 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.615 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.615 INFO:teuthology.orchestra.run.smithi083.stdout: "username": { 2024-09-21T01:51:59.615 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "username", 2024-09-21T01:51:59.616 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.616 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.616 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.616 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:51:59.616 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.616 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.616 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.616 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "username of InfluxDB server user", 2024-09-21T01:51:59.616 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.616 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.616 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.616 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.617 INFO:teuthology.orchestra.run.smithi083.stdout: "verify_ssl": { 2024-09-21T01:51:59.617 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "verify_ssl", 2024-09-21T01:51:59.617 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.617 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.617 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.617 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "true", 2024-09-21T01:51:59.617 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.617 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.617 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.617 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-21T01:51:59.617 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.617 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.617 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.618 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:51:59.618 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:51:59.618 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.618 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-21T01:51:59.618 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "insights", 2024-09-21T01:51:59.618 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-21T01:51:59.618 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-21T01:51:59.618 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-21T01:51:59.618 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-21T01:51:59.618 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-21T01:51:59.618 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.618 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.618 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.618 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:51:59.619 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.619 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.619 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:51:59.619 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:51:59.619 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:51:59.619 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:51:59.619 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:51:59.619 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:51:59.619 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:51:59.619 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:51:59.619 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.619 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.619 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.620 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.620 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.620 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-21T01:51:59.620 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-21T01:51:59.620 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.620 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.620 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.620 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:51:59.620 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.620 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.620 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.620 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.620 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.620 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.620 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.621 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.621 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-21T01:51:59.621 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-21T01:51:59.621 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.621 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.621 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.621 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-21T01:51:59.621 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.621 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.621 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:51:59.621 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:51:59.621 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:51:59.621 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:51:59.621 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:51:59.621 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:51:59.622 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:51:59.622 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:51:59.622 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.622 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.622 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.622 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.622 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.622 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-21T01:51:59.622 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-21T01:51:59.622 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.622 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.622 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.622 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:51:59.622 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.623 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.623 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.623 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.623 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.623 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.623 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.623 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.623 INFO:teuthology.orchestra.run.smithi083.stdout: "sqlite3_killpoint": { 2024-09-21T01:51:59.623 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:51:59.623 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:51:59.623 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "dev", 2024-09-21T01:51:59.623 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.623 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0", 2024-09-21T01:51:59.623 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.624 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.624 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.624 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.624 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.624 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.624 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.624 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:51:59.624 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:51:59.624 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.624 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-21T01:51:59.624 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "iostat", 2024-09-21T01:51:59.624 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-21T01:51:59.624 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-21T01:51:59.624 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-21T01:51:59.624 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-21T01:51:59.625 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-21T01:51:59.625 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.625 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.625 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.625 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:51:59.625 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.625 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.625 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:51:59.625 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:51:59.625 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:51:59.625 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:51:59.625 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:51:59.625 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:51:59.625 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:51:59.625 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:51:59.626 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.626 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.626 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.626 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.626 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.626 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-21T01:51:59.626 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-21T01:51:59.626 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.626 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.626 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.626 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:51:59.626 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.626 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.626 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.627 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.627 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.627 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.627 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.627 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.627 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-21T01:51:59.627 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-21T01:51:59.627 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.627 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.627 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.627 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-21T01:51:59.627 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.627 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.627 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:51:59.628 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:51:59.628 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:51:59.628 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:51:59.628 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:51:59.628 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:51:59.628 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:51:59.628 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:51:59.628 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.628 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.628 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.628 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.628 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.629 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-21T01:51:59.629 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-21T01:51:59.629 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.629 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.629 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.629 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:51:59.629 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.629 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.629 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.629 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.629 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.629 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.629 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.630 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.630 INFO:teuthology.orchestra.run.smithi083.stdout: "sqlite3_killpoint": { 2024-09-21T01:51:59.630 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:51:59.630 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:51:59.630 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "dev", 2024-09-21T01:51:59.630 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.630 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0", 2024-09-21T01:51:59.630 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.630 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.630 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.630 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.630 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.630 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.630 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.631 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:51:59.631 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:51:59.631 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.631 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-21T01:51:59.631 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "k8sevents", 2024-09-21T01:51:59.631 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-21T01:51:59.631 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-21T01:51:59.631 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-21T01:51:59.631 INFO:teuthology.orchestra.run.smithi083.stdout: "ceph_event_retention_days": { 2024-09-21T01:51:59.631 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "ceph_event_retention_days", 2024-09-21T01:51:59.631 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:51:59.631 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.631 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.631 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "7", 2024-09-21T01:51:59.632 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.632 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.632 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.632 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-21T01:51:59.632 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.632 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.632 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.632 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.632 INFO:teuthology.orchestra.run.smithi083.stdout: "config_check_secs": { 2024-09-21T01:51:59.632 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "config_check_secs", 2024-09-21T01:51:59.632 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:51:59.632 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.632 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.633 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "10", 2024-09-21T01:51:59.633 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "10", 2024-09-21T01:51:59.633 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.633 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.633 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-21T01:51:59.633 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.633 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.633 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.633 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.633 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-21T01:51:59.633 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-21T01:51:59.633 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.633 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.634 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.634 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:51:59.634 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.634 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.634 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:51:59.634 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:51:59.634 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:51:59.634 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:51:59.634 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:51:59.634 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:51:59.634 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:51:59.634 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:51:59.635 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.635 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.635 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.635 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.635 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.635 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-21T01:51:59.635 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-21T01:51:59.635 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.635 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.635 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.635 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:51:59.635 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.636 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.636 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.636 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.636 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.636 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.636 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.636 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.636 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-21T01:51:59.636 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-21T01:51:59.636 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.636 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.636 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.636 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-21T01:51:59.636 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.636 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.637 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:51:59.637 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:51:59.637 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:51:59.637 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:51:59.637 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:51:59.637 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:51:59.637 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:51:59.637 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:51:59.637 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.637 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.637 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.637 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.637 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.637 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-21T01:51:59.638 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-21T01:51:59.638 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.638 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.638 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.638 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:51:59.638 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.638 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.638 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.638 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.638 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.638 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.638 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.638 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.638 INFO:teuthology.orchestra.run.smithi083.stdout: "sqlite3_killpoint": { 2024-09-21T01:51:59.639 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:51:59.639 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:51:59.639 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "dev", 2024-09-21T01:51:59.639 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.639 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0", 2024-09-21T01:51:59.639 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.639 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.639 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.639 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.639 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.639 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.639 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.639 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:51:59.639 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:51:59.640 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.640 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-21T01:51:59.640 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "localpool", 2024-09-21T01:51:59.640 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-21T01:51:59.640 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-21T01:51:59.640 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-21T01:51:59.640 INFO:teuthology.orchestra.run.smithi083.stdout: "failure_domain": { 2024-09-21T01:51:59.640 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "failure_domain", 2024-09-21T01:51:59.640 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.640 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.640 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.640 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "host", 2024-09-21T01:51:59.640 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.641 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.641 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.641 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "failure domain for any created local pool", 2024-09-21T01:51:59.641 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-21T01:51:59.641 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.641 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.641 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.641 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-21T01:51:59.641 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-21T01:51:59.641 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.641 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.642 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.642 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:51:59.642 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.642 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.642 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:51:59.642 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:51:59.642 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:51:59.642 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:51:59.642 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:51:59.642 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:51:59.642 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:51:59.642 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:51:59.642 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.642 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.643 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.643 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.643 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.643 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-21T01:51:59.643 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-21T01:51:59.643 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.643 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.643 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.643 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:51:59.643 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.643 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.643 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.643 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.643 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.643 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.644 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.644 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.644 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-21T01:51:59.644 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-21T01:51:59.644 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.644 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.644 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.644 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-21T01:51:59.644 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.644 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.644 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:51:59.644 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:51:59.644 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:51:59.644 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:51:59.644 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:51:59.645 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:51:59.645 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:51:59.645 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:51:59.645 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.645 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.645 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.645 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.645 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.645 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-21T01:51:59.645 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-21T01:51:59.645 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.645 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.645 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.645 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:51:59.646 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.646 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.646 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.646 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.646 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.646 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.646 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.646 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.646 INFO:teuthology.orchestra.run.smithi083.stdout: "min_size": { 2024-09-21T01:51:59.646 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "min_size", 2024-09-21T01:51:59.646 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:51:59.646 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.647 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.647 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:51:59.647 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.647 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.647 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.647 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "default min_size for any created local pool", 2024-09-21T01:51:59.647 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-21T01:51:59.647 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.647 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.647 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.647 INFO:teuthology.orchestra.run.smithi083.stdout: "num_rep": { 2024-09-21T01:51:59.647 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "num_rep", 2024-09-21T01:51:59.647 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:51:59.648 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.648 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.648 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "3", 2024-09-21T01:51:59.648 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.648 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.648 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.648 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "default replica count for any created local pool", 2024-09-21T01:51:59.648 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.648 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.648 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.648 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.648 INFO:teuthology.orchestra.run.smithi083.stdout: "pg_num": { 2024-09-21T01:51:59.648 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "pg_num", 2024-09-21T01:51:59.648 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:51:59.648 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.649 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.649 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "128", 2024-09-21T01:51:59.649 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.649 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.649 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.649 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "default pg_num for any created local pool", 2024-09-21T01:51:59.649 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.649 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.649 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.649 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.649 INFO:teuthology.orchestra.run.smithi083.stdout: "prefix": { 2024-09-21T01:51:59.649 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "prefix", 2024-09-21T01:51:59.649 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.649 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.649 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.650 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:51:59.650 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.650 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.650 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.650 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "name prefix for any created local pool", 2024-09-21T01:51:59.650 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.650 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.650 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.650 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.650 INFO:teuthology.orchestra.run.smithi083.stdout: "sqlite3_killpoint": { 2024-09-21T01:51:59.650 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:51:59.650 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:51:59.650 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "dev", 2024-09-21T01:51:59.650 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.651 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0", 2024-09-21T01:51:59.651 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.651 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.651 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.651 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.651 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.651 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.651 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.651 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.651 INFO:teuthology.orchestra.run.smithi083.stdout: "subtree": { 2024-09-21T01:51:59.651 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "subtree", 2024-09-21T01:51:59.651 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.651 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.651 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.651 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "rack", 2024-09-21T01:51:59.651 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.652 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.652 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.652 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-21T01:51:59.652 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-21T01:51:59.652 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.652 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.652 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:51:59.652 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:51:59.652 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.652 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-21T01:51:59.652 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "mds_autoscaler", 2024-09-21T01:51:59.652 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-21T01:51:59.653 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-21T01:51:59.653 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-21T01:51:59.653 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-21T01:51:59.653 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-21T01:51:59.653 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.653 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.653 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.653 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:51:59.653 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.653 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.653 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:51:59.653 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:51:59.653 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:51:59.654 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:51:59.654 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:51:59.654 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:51:59.654 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:51:59.654 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:51:59.654 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.654 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.654 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.654 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.654 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.654 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-21T01:51:59.654 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-21T01:51:59.654 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.655 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.655 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.655 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:51:59.655 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.655 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.655 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.655 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.655 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.655 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.655 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.655 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.655 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-21T01:51:59.655 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-21T01:51:59.655 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.656 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.656 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.656 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-21T01:51:59.656 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.656 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.656 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:51:59.656 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:51:59.656 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:51:59.656 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:51:59.656 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:51:59.656 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:51:59.656 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:51:59.656 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:51:59.656 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.657 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.657 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.657 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.657 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.657 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-21T01:51:59.657 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-21T01:51:59.657 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.657 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.657 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.657 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:51:59.657 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.657 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.657 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.657 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.657 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.658 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.658 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.658 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.658 INFO:teuthology.orchestra.run.smithi083.stdout: "sqlite3_killpoint": { 2024-09-21T01:51:59.658 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:51:59.658 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:51:59.658 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "dev", 2024-09-21T01:51:59.658 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.658 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0", 2024-09-21T01:51:59.658 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.658 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.658 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.658 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.659 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.659 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.659 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.659 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:51:59.659 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:51:59.659 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.659 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-21T01:51:59.659 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "mirroring", 2024-09-21T01:51:59.659 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-21T01:51:59.659 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-21T01:51:59.659 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-21T01:51:59.659 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-21T01:51:59.659 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-21T01:51:59.659 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.660 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.660 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.660 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:51:59.660 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.660 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.660 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:51:59.660 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:51:59.660 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:51:59.660 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:51:59.660 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:51:59.660 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:51:59.660 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:51:59.660 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:51:59.660 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.661 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.661 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.661 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.661 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.661 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-21T01:51:59.661 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-21T01:51:59.661 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.661 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.661 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.661 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:51:59.661 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.661 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.661 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.661 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.661 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.662 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.662 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.662 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.662 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-21T01:51:59.662 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-21T01:51:59.662 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.662 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.662 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.662 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-21T01:51:59.662 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.662 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.662 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:51:59.662 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:51:59.662 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:51:59.663 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:51:59.663 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:51:59.663 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:51:59.663 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:51:59.663 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:51:59.663 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.663 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.663 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.663 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.663 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.663 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-21T01:51:59.663 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-21T01:51:59.663 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.663 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.663 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.664 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:51:59.664 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.664 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.664 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.664 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.664 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.664 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.664 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.664 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.664 INFO:teuthology.orchestra.run.smithi083.stdout: "sqlite3_killpoint": { 2024-09-21T01:51:59.664 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:51:59.664 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:51:59.664 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "dev", 2024-09-21T01:51:59.664 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.665 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0", 2024-09-21T01:51:59.665 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.665 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.665 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.665 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.665 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.665 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.665 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.665 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:51:59.665 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:51:59.665 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.665 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-21T01:51:59.665 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "nfs", 2024-09-21T01:51:59.665 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-21T01:51:59.666 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-21T01:51:59.666 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-21T01:51:59.666 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-21T01:51:59.666 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-21T01:51:59.666 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.666 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.666 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.666 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:51:59.666 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.666 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.666 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:51:59.666 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:51:59.666 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:51:59.666 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:51:59.667 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:51:59.667 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:51:59.667 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:51:59.667 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:51:59.667 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.667 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.667 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.667 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.667 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.667 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-21T01:51:59.667 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-21T01:51:59.667 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.667 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.667 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.667 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:51:59.668 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.668 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.668 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.668 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.668 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.668 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.668 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.668 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.668 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-21T01:51:59.668 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-21T01:51:59.668 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.668 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.668 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.668 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-21T01:51:59.669 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.669 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.669 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:51:59.669 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:51:59.669 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:51:59.669 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:51:59.669 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:51:59.669 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:51:59.669 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:51:59.669 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:51:59.669 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.669 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.669 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.669 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.670 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.670 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-21T01:51:59.670 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-21T01:51:59.670 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.670 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.670 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.670 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:51:59.670 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.670 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.670 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.670 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.670 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.670 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.671 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.671 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.671 INFO:teuthology.orchestra.run.smithi083.stdout: "sqlite3_killpoint": { 2024-09-21T01:51:59.671 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:51:59.671 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:51:59.671 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "dev", 2024-09-21T01:51:59.671 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.671 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0", 2024-09-21T01:51:59.671 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.671 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.671 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.671 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.671 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.672 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.672 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.672 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:51:59.672 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:51:59.672 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.672 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-21T01:51:59.672 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "orchestrator", 2024-09-21T01:51:59.672 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-21T01:51:59.672 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-21T01:51:59.672 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-21T01:51:59.672 INFO:teuthology.orchestra.run.smithi083.stdout: "fail_fs": { 2024-09-21T01:51:59.672 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "fail_fs", 2024-09-21T01:51:59.672 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.672 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.672 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.673 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:51:59.673 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.673 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.673 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.673 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-21T01:51:59.673 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.673 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.673 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.673 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.673 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-21T01:51:59.673 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-21T01:51:59.673 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.673 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.673 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.674 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:51:59.674 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.674 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.674 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:51:59.674 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:51:59.674 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:51:59.674 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:51:59.674 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:51:59.674 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:51:59.674 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:51:59.674 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:51:59.674 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.674 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.674 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.675 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.675 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.675 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-21T01:51:59.675 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-21T01:51:59.675 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.675 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.675 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.675 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:51:59.675 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.675 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.675 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.675 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.675 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.675 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.676 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.676 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.676 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-21T01:51:59.676 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-21T01:51:59.676 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.676 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.676 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.676 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-21T01:51:59.676 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.676 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.676 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:51:59.676 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:51:59.676 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:51:59.676 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:51:59.676 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:51:59.677 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:51:59.677 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:51:59.677 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:51:59.677 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.677 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.677 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.677 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.677 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.677 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-21T01:51:59.677 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-21T01:51:59.677 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.677 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.677 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.678 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:51:59.678 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.678 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.678 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.678 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.678 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.678 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.678 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.678 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.678 INFO:teuthology.orchestra.run.smithi083.stdout: "orchestrator": { 2024-09-21T01:51:59.678 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "orchestrator", 2024-09-21T01:51:59.678 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.678 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.678 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.679 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:51:59.679 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.679 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.679 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:51:59.679 INFO:teuthology.orchestra.run.smithi083.stdout: "cephadm", 2024-09-21T01:51:59.679 INFO:teuthology.orchestra.run.smithi083.stdout: "rook", 2024-09-21T01:51:59.679 INFO:teuthology.orchestra.run.smithi083.stdout: "test_orchestrator" 2024-09-21T01:51:59.679 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:51:59.679 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Orchestrator backend", 2024-09-21T01:51:59.679 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.679 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.679 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.679 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.679 INFO:teuthology.orchestra.run.smithi083.stdout: "sqlite3_killpoint": { 2024-09-21T01:51:59.679 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:51:59.680 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:51:59.680 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "dev", 2024-09-21T01:51:59.680 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.680 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0", 2024-09-21T01:51:59.680 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.680 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.680 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.680 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.680 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.680 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.680 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.680 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:51:59.680 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:51:59.680 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.680 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-21T01:51:59.681 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "osd_perf_query", 2024-09-21T01:51:59.681 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-21T01:51:59.681 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-21T01:51:59.681 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-21T01:51:59.681 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-21T01:51:59.681 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-21T01:51:59.681 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.681 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.681 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.681 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:51:59.681 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.681 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.681 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:51:59.681 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:51:59.681 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:51:59.682 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:51:59.682 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:51:59.682 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:51:59.682 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:51:59.682 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:51:59.682 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.682 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.682 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.682 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.682 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.682 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-21T01:51:59.682 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-21T01:51:59.682 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.683 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.683 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.683 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:51:59.683 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.683 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.683 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.683 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.683 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.683 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.683 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.683 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.683 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-21T01:51:59.683 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-21T01:51:59.684 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.684 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.684 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.684 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-21T01:51:59.684 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.684 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.684 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:51:59.684 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:51:59.684 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:51:59.684 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:51:59.684 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:51:59.684 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:51:59.684 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:51:59.684 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:51:59.685 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.685 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.685 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.685 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.685 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.685 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-21T01:51:59.685 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-21T01:51:59.685 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.685 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.685 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.685 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:51:59.685 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.685 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.685 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.686 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.686 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.686 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.686 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.686 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.686 INFO:teuthology.orchestra.run.smithi083.stdout: "sqlite3_killpoint": { 2024-09-21T01:51:59.686 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:51:59.686 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:51:59.686 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "dev", 2024-09-21T01:51:59.686 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.686 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0", 2024-09-21T01:51:59.686 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.686 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.686 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.687 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.687 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.687 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.687 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.687 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:51:59.687 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:51:59.687 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.687 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-21T01:51:59.687 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "osd_support", 2024-09-21T01:51:59.687 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-21T01:51:59.687 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-21T01:51:59.687 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-21T01:51:59.687 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-21T01:51:59.687 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-21T01:51:59.688 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.688 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.688 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.688 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:51:59.688 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.688 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.688 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:51:59.688 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:51:59.688 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:51:59.688 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:51:59.688 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:51:59.688 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:51:59.688 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:51:59.688 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:51:59.688 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.689 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.689 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.689 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.689 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.689 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-21T01:51:59.689 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-21T01:51:59.689 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.689 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.689 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.689 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:51:59.689 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.689 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.689 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.690 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.690 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.690 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.690 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.690 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.690 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-21T01:51:59.690 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-21T01:51:59.690 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.690 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.690 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.690 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-21T01:51:59.690 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.690 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.691 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:51:59.691 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:51:59.691 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:51:59.691 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:51:59.691 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:51:59.691 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:51:59.691 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:51:59.691 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:51:59.691 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.691 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.691 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.691 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.691 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.692 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-21T01:51:59.692 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-21T01:51:59.692 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.692 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.692 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.692 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:51:59.692 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.692 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.692 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.692 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.692 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.692 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.692 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.692 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.692 INFO:teuthology.orchestra.run.smithi083.stdout: "sqlite3_killpoint": { 2024-09-21T01:51:59.693 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:51:59.693 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:51:59.693 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "dev", 2024-09-21T01:51:59.693 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.693 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0", 2024-09-21T01:51:59.693 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.693 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.693 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.693 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.693 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.693 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.693 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.693 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:51:59.693 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:51:59.694 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.694 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-21T01:51:59.694 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "pg_autoscaler", 2024-09-21T01:51:59.694 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-21T01:51:59.694 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-21T01:51:59.694 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-21T01:51:59.694 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-21T01:51:59.694 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-21T01:51:59.694 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.694 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.694 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.694 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:51:59.694 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.695 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.695 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:51:59.695 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:51:59.695 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:51:59.695 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:51:59.695 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:51:59.695 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:51:59.695 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:51:59.695 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:51:59.695 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.695 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.695 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.695 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.696 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.696 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-21T01:51:59.696 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-21T01:51:59.696 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.696 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.696 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.696 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:51:59.696 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.696 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.696 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.696 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.696 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.696 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.697 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.697 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.697 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-21T01:51:59.697 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-21T01:51:59.697 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.697 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.697 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.697 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-21T01:51:59.697 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.697 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.697 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:51:59.697 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:51:59.697 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:51:59.697 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:51:59.698 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:51:59.698 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:51:59.698 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:51:59.698 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:51:59.698 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.698 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.698 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.698 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.698 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.698 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-21T01:51:59.698 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-21T01:51:59.698 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.698 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.698 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.699 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:51:59.699 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.699 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.699 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.699 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.699 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.699 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.699 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.699 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.699 INFO:teuthology.orchestra.run.smithi083.stdout: "sleep_interval": { 2024-09-21T01:51:59.699 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "sleep_interval", 2024-09-21T01:51:59.699 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-09-21T01:51:59.699 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.699 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.699 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "60", 2024-09-21T01:51:59.700 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.700 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.700 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.700 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.700 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.700 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.700 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.700 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.700 INFO:teuthology.orchestra.run.smithi083.stdout: "sqlite3_killpoint": { 2024-09-21T01:51:59.700 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:51:59.700 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:51:59.700 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "dev", 2024-09-21T01:51:59.700 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.700 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0", 2024-09-21T01:51:59.700 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.701 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.701 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.701 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.701 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.701 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.701 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.701 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.701 INFO:teuthology.orchestra.run.smithi083.stdout: "threshold": { 2024-09-21T01:51:59.701 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "threshold", 2024-09-21T01:51:59.701 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "float", 2024-09-21T01:51:59.701 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.701 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.701 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "3.0", 2024-09-21T01:51:59.701 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "1.0", 2024-09-21T01:51:59.702 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.702 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.702 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "scaling threshold", 2024-09-21T01:51:59.702 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-21T01:51:59.702 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.702 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.702 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:51:59.702 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:51:59.702 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.702 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-21T01:51:59.702 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "progress", 2024-09-21T01:51:59.702 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-21T01:51:59.702 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-21T01:51:59.702 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-21T01:51:59.703 INFO:teuthology.orchestra.run.smithi083.stdout: "allow_pg_recovery_event": { 2024-09-21T01:51:59.703 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "allow_pg_recovery_event", 2024-09-21T01:51:59.703 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.703 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.703 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.703 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:51:59.703 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.703 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.703 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.703 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-21T01:51:59.703 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.703 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.703 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.703 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.704 INFO:teuthology.orchestra.run.smithi083.stdout: "enabled": { 2024-09-21T01:51:59.704 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "enabled", 2024-09-21T01:51:59.704 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.704 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.704 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.704 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-21T01:51:59.704 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.704 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.704 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.704 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.704 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.704 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.704 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.704 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.704 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-21T01:51:59.705 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-21T01:51:59.705 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.705 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.705 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.705 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:51:59.705 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.705 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.705 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:51:59.705 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:51:59.705 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:51:59.705 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:51:59.705 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:51:59.705 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:51:59.705 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:51:59.705 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:51:59.706 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.706 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.706 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.706 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.706 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.706 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-21T01:51:59.706 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-21T01:51:59.706 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.706 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.706 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.706 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:51:59.706 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.706 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.706 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.707 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.707 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.707 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.707 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.707 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.707 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-21T01:51:59.707 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-21T01:51:59.707 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.707 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.707 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.707 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-21T01:51:59.707 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.707 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.707 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:51:59.707 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:51:59.708 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:51:59.708 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:51:59.708 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:51:59.708 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:51:59.708 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:51:59.708 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:51:59.708 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.708 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.708 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.708 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.708 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.708 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-21T01:51:59.708 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-21T01:51:59.708 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.708 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.709 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.709 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:51:59.709 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.709 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.709 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.709 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.709 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.709 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.709 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.709 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.709 INFO:teuthology.orchestra.run.smithi083.stdout: "max_completed_events": { 2024-09-21T01:51:59.709 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "max_completed_events", 2024-09-21T01:51:59.710 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:51:59.710 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.710 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.710 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "50", 2024-09-21T01:51:59.710 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.710 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.710 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.710 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "number of past completed events to remember", 2024-09-21T01:51:59.710 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.710 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.710 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.710 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.711 INFO:teuthology.orchestra.run.smithi083.stdout: "sleep_interval": { 2024-09-21T01:51:59.711 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "sleep_interval", 2024-09-21T01:51:59.711 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-09-21T01:51:59.711 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.711 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.711 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "5", 2024-09-21T01:51:59.711 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.711 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.711 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.711 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "how long the module is going to sleep", 2024-09-21T01:51:59.711 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.711 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.711 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.711 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.711 INFO:teuthology.orchestra.run.smithi083.stdout: "sqlite3_killpoint": { 2024-09-21T01:51:59.712 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:51:59.712 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:51:59.712 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "dev", 2024-09-21T01:51:59.712 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.712 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0", 2024-09-21T01:51:59.712 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.712 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.712 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.712 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.712 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.712 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.712 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.712 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:51:59.712 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:51:59.713 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.713 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-21T01:51:59.713 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "prometheus", 2024-09-21T01:51:59.713 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-21T01:51:59.713 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-21T01:51:59.713 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-21T01:51:59.713 INFO:teuthology.orchestra.run.smithi083.stdout: "cache": { 2024-09-21T01:51:59.713 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "cache", 2024-09-21T01:51:59.713 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.713 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.713 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.713 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-21T01:51:59.713 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.713 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.714 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.714 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.714 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.714 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.714 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.714 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.714 INFO:teuthology.orchestra.run.smithi083.stdout: "exclude_perf_counters": { 2024-09-21T01:51:59.714 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "exclude_perf_counters", 2024-09-21T01:51:59.714 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.714 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.714 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.714 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-21T01:51:59.714 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.714 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.715 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.715 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-21T01:51:59.715 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-21T01:51:59.715 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.715 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.715 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.715 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-21T01:51:59.715 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-21T01:51:59.715 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.715 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.715 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.715 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:51:59.715 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.715 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.716 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:51:59.716 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:51:59.716 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:51:59.716 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:51:59.716 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:51:59.716 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:51:59.716 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:51:59.716 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:51:59.716 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.716 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.716 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.716 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.716 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.716 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-21T01:51:59.716 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-21T01:51:59.716 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.717 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.717 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.717 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:51:59.717 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.717 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.717 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.717 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.717 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.717 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.717 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.717 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.717 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-21T01:51:59.717 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-21T01:51:59.717 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.718 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.718 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.718 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-21T01:51:59.718 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.718 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.718 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:51:59.718 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:51:59.718 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:51:59.718 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:51:59.718 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:51:59.718 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:51:59.718 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:51:59.718 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:51:59.718 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.718 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.719 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.719 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.719 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.719 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-21T01:51:59.719 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-21T01:51:59.719 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.719 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.719 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.719 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:51:59.719 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.719 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.719 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.719 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.719 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.720 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.720 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.720 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.720 INFO:teuthology.orchestra.run.smithi083.stdout: "rbd_stats_pools": { 2024-09-21T01:51:59.720 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "rbd_stats_pools", 2024-09-21T01:51:59.720 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.720 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.720 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.720 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:51:59.720 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.720 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.720 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.720 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.720 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.720 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.721 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.721 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.721 INFO:teuthology.orchestra.run.smithi083.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-21T01:51:59.721 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-21T01:51:59.721 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:51:59.721 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.721 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.721 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "300", 2024-09-21T01:51:59.721 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.721 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.721 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.721 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.721 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.721 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.721 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.722 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.722 INFO:teuthology.orchestra.run.smithi083.stdout: "scrape_interval": { 2024-09-21T01:51:59.722 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "scrape_interval", 2024-09-21T01:51:59.722 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "float", 2024-09-21T01:51:59.722 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.722 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.722 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "15.0", 2024-09-21T01:51:59.722 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.722 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.722 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.722 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.722 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.723 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.723 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.723 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.723 INFO:teuthology.orchestra.run.smithi083.stdout: "server_addr": { 2024-09-21T01:51:59.723 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "server_addr", 2024-09-21T01:51:59.723 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.723 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.723 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.723 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "::", 2024-09-21T01:51:59.723 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.723 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.723 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.723 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-21T01:51:59.723 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.724 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.724 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.724 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.724 INFO:teuthology.orchestra.run.smithi083.stdout: "server_port": { 2024-09-21T01:51:59.724 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "server_port", 2024-09-21T01:51:59.724 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:51:59.724 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.724 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.724 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "9283", 2024-09-21T01:51:59.724 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.724 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.724 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.724 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-21T01:51:59.724 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.725 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.725 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.725 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.725 INFO:teuthology.orchestra.run.smithi083.stdout: "sqlite3_killpoint": { 2024-09-21T01:51:59.725 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:51:59.725 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:51:59.725 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "dev", 2024-09-21T01:51:59.725 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.725 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0", 2024-09-21T01:51:59.725 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.725 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.725 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.725 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.725 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.725 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.726 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.726 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.726 INFO:teuthology.orchestra.run.smithi083.stdout: "stale_cache_strategy": { 2024-09-21T01:51:59.726 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "stale_cache_strategy", 2024-09-21T01:51:59.726 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.726 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.726 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.726 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "log", 2024-09-21T01:51:59.726 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.726 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.726 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.726 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.726 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.726 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.727 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.727 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.727 INFO:teuthology.orchestra.run.smithi083.stdout: "standby_behaviour": { 2024-09-21T01:51:59.727 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "standby_behaviour", 2024-09-21T01:51:59.727 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.727 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.727 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.727 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "default", 2024-09-21T01:51:59.727 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.727 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.727 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:51:59.727 INFO:teuthology.orchestra.run.smithi083.stdout: "default", 2024-09-21T01:51:59.727 INFO:teuthology.orchestra.run.smithi083.stdout: "error" 2024-09-21T01:51:59.728 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:51:59.728 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.728 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.728 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.728 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.728 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.728 INFO:teuthology.orchestra.run.smithi083.stdout: "standby_error_status_code": { 2024-09-21T01:51:59.728 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "standby_error_status_code", 2024-09-21T01:51:59.728 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:51:59.728 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.728 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.728 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "500", 2024-09-21T01:51:59.728 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "400", 2024-09-21T01:51:59.728 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "599", 2024-09-21T01:51:59.728 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.729 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.729 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.729 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.729 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.729 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:51:59.729 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:51:59.729 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.729 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-21T01:51:59.729 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "rbd_support", 2024-09-21T01:51:59.729 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-21T01:51:59.729 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-21T01:51:59.729 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-21T01:51:59.729 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-21T01:51:59.729 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-21T01:51:59.729 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.730 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.730 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.730 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:51:59.730 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.730 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.730 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:51:59.730 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:51:59.730 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:51:59.730 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:51:59.730 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:51:59.730 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:51:59.730 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:51:59.730 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:51:59.730 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.731 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.731 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.731 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.731 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.731 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-21T01:51:59.731 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-21T01:51:59.731 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.731 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.731 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.731 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:51:59.731 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.731 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.731 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.731 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.731 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.732 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.732 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.732 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.732 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-21T01:51:59.732 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-21T01:51:59.732 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.732 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.732 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.732 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-21T01:51:59.732 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.732 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.732 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:51:59.732 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:51:59.732 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:51:59.732 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:51:59.733 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:51:59.733 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:51:59.733 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:51:59.733 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:51:59.733 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.733 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.733 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.733 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.733 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.733 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-21T01:51:59.733 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-21T01:51:59.733 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.733 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.733 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.733 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:51:59.734 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.734 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.734 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.734 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.734 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.734 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.734 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.734 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.734 INFO:teuthology.orchestra.run.smithi083.stdout: "max_concurrent_snap_create": { 2024-09-21T01:51:59.734 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "max_concurrent_snap_create", 2024-09-21T01:51:59.734 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:51:59.734 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.734 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.735 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "10", 2024-09-21T01:51:59.735 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.735 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.735 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.735 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.735 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.735 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.735 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.735 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.735 INFO:teuthology.orchestra.run.smithi083.stdout: "mirror_snapshot_schedule": { 2024-09-21T01:51:59.735 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "mirror_snapshot_schedule", 2024-09-21T01:51:59.735 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.735 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.735 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.735 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:51:59.736 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.736 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.736 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.736 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.736 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.736 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.736 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.736 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.736 INFO:teuthology.orchestra.run.smithi083.stdout: "sqlite3_killpoint": { 2024-09-21T01:51:59.736 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:51:59.736 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:51:59.736 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "dev", 2024-09-21T01:51:59.736 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.737 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0", 2024-09-21T01:51:59.737 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.737 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.737 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.737 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.737 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.737 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.737 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.737 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.737 INFO:teuthology.orchestra.run.smithi083.stdout: "trash_purge_schedule": { 2024-09-21T01:51:59.737 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "trash_purge_schedule", 2024-09-21T01:51:59.737 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.737 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.737 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.738 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:51:59.738 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.738 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.738 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.738 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.738 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.738 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.738 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.738 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:51:59.738 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:51:59.738 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.738 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-21T01:51:59.738 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "restful", 2024-09-21T01:51:59.738 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-21T01:51:59.739 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-21T01:51:59.739 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-21T01:51:59.739 INFO:teuthology.orchestra.run.smithi083.stdout: "enable_auth": { 2024-09-21T01:51:59.739 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "enable_auth", 2024-09-21T01:51:59.739 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.739 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.739 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.739 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-21T01:51:59.739 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.739 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.739 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.739 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.739 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.739 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.740 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.740 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.740 INFO:teuthology.orchestra.run.smithi083.stdout: "key_file": { 2024-09-21T01:51:59.740 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "key_file", 2024-09-21T01:51:59.740 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.740 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.740 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.740 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:51:59.740 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.740 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.740 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.740 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.740 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.740 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.740 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.741 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.741 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-21T01:51:59.741 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-21T01:51:59.741 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.741 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.741 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.741 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:51:59.741 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.741 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.741 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:51:59.741 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:51:59.741 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:51:59.741 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:51:59.741 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:51:59.742 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:51:59.742 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:51:59.742 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:51:59.742 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.742 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.742 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.742 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.742 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.742 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-21T01:51:59.742 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-21T01:51:59.742 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.742 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.742 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.742 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:51:59.743 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.743 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.743 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.743 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.743 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.743 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.743 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.743 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.743 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-21T01:51:59.743 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-21T01:51:59.743 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.743 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.743 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.743 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-21T01:51:59.743 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.744 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.744 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:51:59.744 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:51:59.744 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:51:59.744 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:51:59.744 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:51:59.744 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:51:59.744 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:51:59.744 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:51:59.744 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.744 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.744 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.744 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.744 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.744 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-21T01:51:59.745 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-21T01:51:59.745 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.745 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.745 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.745 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:51:59.745 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.745 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.745 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.745 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.745 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.745 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.745 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.745 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.745 INFO:teuthology.orchestra.run.smithi083.stdout: "max_requests": { 2024-09-21T01:51:59.745 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "max_requests", 2024-09-21T01:51:59.746 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:51:59.746 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.746 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.746 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "500", 2024-09-21T01:51:59.746 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.746 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.746 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.746 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.", 2024-09-21T01:51:59.746 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.746 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.746 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.746 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.746 INFO:teuthology.orchestra.run.smithi083.stdout: "server_addr": { 2024-09-21T01:51:59.746 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "server_addr", 2024-09-21T01:51:59.746 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.747 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.747 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.747 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:51:59.747 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.747 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.747 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.747 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.747 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.747 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.747 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.747 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.747 INFO:teuthology.orchestra.run.smithi083.stdout: "server_port": { 2024-09-21T01:51:59.747 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "server_port", 2024-09-21T01:51:59.747 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.747 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.748 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.748 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:51:59.748 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.748 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.748 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.748 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.748 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.748 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.748 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.748 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.748 INFO:teuthology.orchestra.run.smithi083.stdout: "sqlite3_killpoint": { 2024-09-21T01:51:59.748 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:51:59.748 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:51:59.748 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "dev", 2024-09-21T01:51:59.748 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.749 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0", 2024-09-21T01:51:59.749 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.749 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.749 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.749 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.749 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.749 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.749 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.749 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:51:59.749 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:51:59.749 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.749 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-21T01:51:59.749 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "rgw", 2024-09-21T01:51:59.750 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-21T01:51:59.750 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-21T01:51:59.750 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-21T01:51:59.750 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-21T01:51:59.750 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-21T01:51:59.750 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.750 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.750 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.750 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:51:59.750 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.750 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.750 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:51:59.750 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:51:59.750 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:51:59.751 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:51:59.751 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:51:59.751 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:51:59.751 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:51:59.751 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:51:59.751 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.751 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.751 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.751 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.751 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.751 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-21T01:51:59.751 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-21T01:51:59.751 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.751 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.751 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.752 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:51:59.752 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.752 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.752 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.752 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.752 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.752 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.752 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.752 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.752 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-21T01:51:59.752 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-21T01:51:59.752 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.752 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.752 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.753 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-21T01:51:59.753 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.753 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.753 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:51:59.753 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:51:59.753 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:51:59.753 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:51:59.753 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:51:59.753 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:51:59.753 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:51:59.753 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:51:59.753 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.753 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.753 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.753 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.754 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.754 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-21T01:51:59.754 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-21T01:51:59.754 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.754 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.754 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.754 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:51:59.754 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.754 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.754 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.754 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.754 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.754 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.754 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.755 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.755 INFO:teuthology.orchestra.run.smithi083.stdout: "secondary_zone_period_retry_limit": { 2024-09-21T01:51:59.755 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-21T01:51:59.755 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:51:59.755 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.755 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.755 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "5", 2024-09-21T01:51:59.755 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.755 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.755 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.755 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-21T01:51:59.755 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.755 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.755 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.755 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.756 INFO:teuthology.orchestra.run.smithi083.stdout: "sqlite3_killpoint": { 2024-09-21T01:51:59.756 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:51:59.756 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:51:59.756 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "dev", 2024-09-21T01:51:59.756 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.756 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0", 2024-09-21T01:51:59.756 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.756 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.756 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.756 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.756 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.756 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.756 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.756 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:51:59.757 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:51:59.757 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.757 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-21T01:51:59.757 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "rook", 2024-09-21T01:51:59.757 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-21T01:51:59.757 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-21T01:51:59.757 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-21T01:51:59.757 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-21T01:51:59.757 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-21T01:51:59.757 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.757 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.757 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.757 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:51:59.757 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.757 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.758 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:51:59.758 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:51:59.758 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:51:59.758 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:51:59.758 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:51:59.758 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:51:59.758 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:51:59.758 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:51:59.758 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.758 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.758 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.758 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.758 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.758 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-21T01:51:59.759 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-21T01:51:59.759 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.759 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.759 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.759 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:51:59.759 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.759 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.759 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.759 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.759 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.759 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.759 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.759 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.759 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-21T01:51:59.760 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-21T01:51:59.760 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.760 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.760 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.760 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-21T01:51:59.760 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.760 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.760 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:51:59.760 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:51:59.760 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:51:59.760 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:51:59.760 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:51:59.760 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:51:59.760 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:51:59.760 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:51:59.760 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.761 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.761 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.761 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.761 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.761 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-21T01:51:59.761 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-21T01:51:59.761 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.761 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.761 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.761 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:51:59.761 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.761 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.761 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.761 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.762 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.762 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.762 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.762 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.762 INFO:teuthology.orchestra.run.smithi083.stdout: "sqlite3_killpoint": { 2024-09-21T01:51:59.762 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:51:59.762 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:51:59.762 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "dev", 2024-09-21T01:51:59.762 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.762 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0", 2024-09-21T01:51:59.762 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.762 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.762 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.763 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.763 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.763 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.763 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.763 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.763 INFO:teuthology.orchestra.run.smithi083.stdout: "storage_class": { 2024-09-21T01:51:59.763 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "storage_class", 2024-09-21T01:51:59.763 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.763 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.763 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.763 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "local", 2024-09-21T01:51:59.763 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.763 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.763 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.763 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-21T01:51:59.764 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.764 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.764 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.764 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:51:59.764 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:51:59.764 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.764 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-21T01:51:59.764 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "selftest", 2024-09-21T01:51:59.764 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-21T01:51:59.764 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-21T01:51:59.764 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-21T01:51:59.764 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-21T01:51:59.764 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-21T01:51:59.764 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.765 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.765 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.765 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:51:59.765 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.765 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.765 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:51:59.765 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:51:59.765 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:51:59.765 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:51:59.765 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:51:59.765 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:51:59.765 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:51:59.765 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:51:59.765 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.766 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.766 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.766 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.766 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.766 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-21T01:51:59.766 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-21T01:51:59.766 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.766 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.766 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.766 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:51:59.766 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.766 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.766 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.766 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.766 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.767 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.767 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.767 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.767 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-21T01:51:59.767 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-21T01:51:59.767 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.767 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.767 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.767 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-21T01:51:59.767 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.767 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.767 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:51:59.767 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:51:59.767 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:51:59.768 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:51:59.768 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:51:59.768 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:51:59.768 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:51:59.768 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:51:59.768 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.768 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.768 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.768 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.768 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.768 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-21T01:51:59.768 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-21T01:51:59.768 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.768 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.768 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.769 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:51:59.769 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.769 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.769 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.769 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.769 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.769 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.769 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.769 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.769 INFO:teuthology.orchestra.run.smithi083.stdout: "roption1": { 2024-09-21T01:51:59.769 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "roption1", 2024-09-21T01:51:59.769 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.769 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.769 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.770 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:51:59.770 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.770 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.770 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.770 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.770 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.770 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.770 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.770 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.770 INFO:teuthology.orchestra.run.smithi083.stdout: "roption2": { 2024-09-21T01:51:59.770 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "roption2", 2024-09-21T01:51:59.770 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.770 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.770 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.771 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "xyz", 2024-09-21T01:51:59.771 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.771 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.771 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.771 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.771 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.771 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.771 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.771 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.771 INFO:teuthology.orchestra.run.smithi083.stdout: "rwoption1": { 2024-09-21T01:51:59.771 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "rwoption1", 2024-09-21T01:51:59.771 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.771 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.771 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.771 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:51:59.772 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.772 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.772 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.772 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.772 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.772 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.772 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.772 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.772 INFO:teuthology.orchestra.run.smithi083.stdout: "rwoption2": { 2024-09-21T01:51:59.772 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "rwoption2", 2024-09-21T01:51:59.772 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:51:59.772 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.772 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.772 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:51:59.772 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.773 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.773 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.773 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.773 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.773 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.773 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.773 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.773 INFO:teuthology.orchestra.run.smithi083.stdout: "rwoption3": { 2024-09-21T01:51:59.773 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "rwoption3", 2024-09-21T01:51:59.773 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "float", 2024-09-21T01:51:59.773 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.773 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.773 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:51:59.773 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.774 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.774 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.774 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.774 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.774 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.774 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.774 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.774 INFO:teuthology.orchestra.run.smithi083.stdout: "rwoption4": { 2024-09-21T01:51:59.774 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "rwoption4", 2024-09-21T01:51:59.774 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.774 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.774 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.774 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:51:59.774 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.774 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.775 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.775 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.775 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.775 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.775 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.775 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.775 INFO:teuthology.orchestra.run.smithi083.stdout: "rwoption5": { 2024-09-21T01:51:59.775 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "rwoption5", 2024-09-21T01:51:59.775 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.775 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.775 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.775 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:51:59.775 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.775 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.775 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.776 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.776 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.776 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.776 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.776 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.776 INFO:teuthology.orchestra.run.smithi083.stdout: "rwoption6": { 2024-09-21T01:51:59.776 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "rwoption6", 2024-09-21T01:51:59.776 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.776 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.776 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.776 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-21T01:51:59.776 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.776 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.777 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.777 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.777 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.777 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.777 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.777 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.777 INFO:teuthology.orchestra.run.smithi083.stdout: "rwoption7": { 2024-09-21T01:51:59.777 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "rwoption7", 2024-09-21T01:51:59.777 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:51:59.777 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.777 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.777 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:51:59.777 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "1", 2024-09-21T01:51:59.777 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "42", 2024-09-21T01:51:59.778 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.778 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.778 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.778 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.778 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.778 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.778 INFO:teuthology.orchestra.run.smithi083.stdout: "sqlite3_killpoint": { 2024-09-21T01:51:59.778 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:51:59.778 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:51:59.778 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "dev", 2024-09-21T01:51:59.778 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.778 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0", 2024-09-21T01:51:59.778 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.778 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.779 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.779 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.779 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.779 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.779 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.779 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.779 INFO:teuthology.orchestra.run.smithi083.stdout: "testkey": { 2024-09-21T01:51:59.779 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "testkey", 2024-09-21T01:51:59.779 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.779 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.779 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.779 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:51:59.779 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.779 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.779 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.780 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.780 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.780 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.780 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.780 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.780 INFO:teuthology.orchestra.run.smithi083.stdout: "testlkey": { 2024-09-21T01:51:59.780 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "testlkey", 2024-09-21T01:51:59.780 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.780 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.780 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.780 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:51:59.780 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.780 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.780 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.780 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.781 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.781 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.781 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.781 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.781 INFO:teuthology.orchestra.run.smithi083.stdout: "testnewline": { 2024-09-21T01:51:59.781 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "testnewline", 2024-09-21T01:51:59.781 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.781 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.781 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.781 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:51:59.781 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.781 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.781 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.781 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.782 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.782 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.782 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.782 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:51:59.782 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:51:59.782 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.782 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-21T01:51:59.782 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "smb", 2024-09-21T01:51:59.782 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-21T01:51:59.782 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-21T01:51:59.782 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-21T01:51:59.782 INFO:teuthology.orchestra.run.smithi083.stdout: "internal_store_backend": { 2024-09-21T01:51:59.782 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "internal_store_backend", 2024-09-21T01:51:59.782 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.783 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "dev", 2024-09-21T01:51:59.783 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.783 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:51:59.783 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.783 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.783 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.783 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "set internal store backend. for develoment and testing only", 2024-09-21T01:51:59.783 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.783 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.783 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.783 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.783 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-21T01:51:59.783 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-21T01:51:59.783 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.783 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.784 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.784 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:51:59.784 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.784 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.784 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:51:59.784 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:51:59.784 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:51:59.784 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:51:59.784 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:51:59.784 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:51:59.784 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:51:59.784 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:51:59.784 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.784 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.784 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.785 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.785 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.785 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-21T01:51:59.785 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-21T01:51:59.785 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.785 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.785 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.785 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:51:59.785 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.785 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.785 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.785 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.785 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.785 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.785 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.786 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.786 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-21T01:51:59.786 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-21T01:51:59.786 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.786 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.786 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.786 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-21T01:51:59.786 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.786 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.786 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:51:59.786 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:51:59.786 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:51:59.786 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:51:59.786 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:51:59.787 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:51:59.787 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:51:59.787 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:51:59.787 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.787 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.787 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.787 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.787 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.787 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-21T01:51:59.787 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-21T01:51:59.787 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.787 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.787 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.787 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:51:59.787 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.788 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.788 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.788 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.788 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.788 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.788 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.788 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.788 INFO:teuthology.orchestra.run.smithi083.stdout: "sqlite3_killpoint": { 2024-09-21T01:51:59.788 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:51:59.788 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:51:59.788 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "dev", 2024-09-21T01:51:59.788 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.788 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0", 2024-09-21T01:51:59.788 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.788 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.789 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.789 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.789 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.789 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.789 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.789 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.789 INFO:teuthology.orchestra.run.smithi083.stdout: "update_orchestration": { 2024-09-21T01:51:59.789 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "update_orchestration", 2024-09-21T01:51:59.789 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.789 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.789 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.789 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-21T01:51:59.789 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.790 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.790 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.790 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-09-21T01:51:59.790 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.790 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.790 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.790 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:51:59.790 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:51:59.790 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.790 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-21T01:51:59.790 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "snap_schedule", 2024-09-21T01:51:59.790 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-21T01:51:59.790 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-21T01:51:59.790 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-21T01:51:59.791 INFO:teuthology.orchestra.run.smithi083.stdout: "allow_m_granularity": { 2024-09-21T01:51:59.791 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "allow_m_granularity", 2024-09-21T01:51:59.791 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.791 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.791 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.791 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:51:59.791 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.791 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.791 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.791 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "allow minute scheduled snapshots", 2024-09-21T01:51:59.791 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.791 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.791 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.791 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.792 INFO:teuthology.orchestra.run.smithi083.stdout: "dump_on_update": { 2024-09-21T01:51:59.792 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "dump_on_update", 2024-09-21T01:51:59.792 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.792 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.792 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.792 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:51:59.792 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.792 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.792 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.792 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "dump database to debug log on update", 2024-09-21T01:51:59.792 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.792 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.792 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.792 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.792 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-21T01:51:59.793 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-21T01:51:59.793 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.793 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.793 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.793 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:51:59.793 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.793 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.793 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:51:59.793 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:51:59.793 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:51:59.793 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:51:59.793 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:51:59.793 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:51:59.793 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:51:59.793 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:51:59.794 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.794 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.794 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.794 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.794 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.794 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-21T01:51:59.794 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-21T01:51:59.794 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.794 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.794 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.794 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:51:59.794 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.795 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.795 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.795 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.795 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.795 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.795 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.795 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.795 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-21T01:51:59.795 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-21T01:51:59.795 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.795 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.795 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.795 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-21T01:51:59.795 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.795 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.796 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:51:59.796 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:51:59.796 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:51:59.796 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:51:59.796 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:51:59.796 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:51:59.796 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:51:59.796 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:51:59.796 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.796 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.796 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.796 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.796 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.796 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-21T01:51:59.796 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-21T01:51:59.796 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.797 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.797 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.797 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:51:59.797 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.797 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.797 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.797 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.797 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.797 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.797 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.797 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.797 INFO:teuthology.orchestra.run.smithi083.stdout: "sqlite3_killpoint": { 2024-09-21T01:51:59.797 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:51:59.797 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:51:59.798 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "dev", 2024-09-21T01:51:59.798 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.798 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0", 2024-09-21T01:51:59.798 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.798 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.798 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.798 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.798 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.798 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.798 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.798 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:51:59.798 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:51:59.798 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.798 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-21T01:51:59.798 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "stats", 2024-09-21T01:51:59.799 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-21T01:51:59.799 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-21T01:51:59.799 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-21T01:51:59.799 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-21T01:51:59.799 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-21T01:51:59.799 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.799 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.799 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.799 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:51:59.799 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.799 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.799 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:51:59.799 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:51:59.799 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:51:59.800 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:51:59.800 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:51:59.800 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:51:59.800 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:51:59.800 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:51:59.800 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.800 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.800 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.800 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.800 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.800 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-21T01:51:59.800 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-21T01:51:59.800 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.800 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.800 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.801 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:51:59.801 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.801 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.801 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.801 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.801 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.801 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.801 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.801 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.801 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-21T01:51:59.801 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-21T01:51:59.801 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.801 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.801 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.801 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-21T01:51:59.802 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.802 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.802 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:51:59.802 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:51:59.802 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:51:59.802 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:51:59.802 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:51:59.802 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:51:59.802 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:51:59.802 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:51:59.802 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.802 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.802 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.802 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.803 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.803 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-21T01:51:59.803 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-21T01:51:59.803 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.803 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.803 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.803 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:51:59.803 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.803 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.803 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.803 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.803 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.803 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.804 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.804 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.804 INFO:teuthology.orchestra.run.smithi083.stdout: "sqlite3_killpoint": { 2024-09-21T01:51:59.804 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:51:59.804 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:51:59.804 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "dev", 2024-09-21T01:51:59.804 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.804 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0", 2024-09-21T01:51:59.804 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.804 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.804 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.804 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.804 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.804 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.805 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.805 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:51:59.805 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:51:59.805 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.805 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-21T01:51:59.805 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "status", 2024-09-21T01:51:59.805 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-21T01:51:59.805 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-21T01:51:59.805 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-21T01:51:59.805 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-21T01:51:59.805 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-21T01:51:59.805 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.805 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.805 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.806 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:51:59.806 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.806 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.806 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:51:59.806 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:51:59.806 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:51:59.806 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:51:59.806 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:51:59.806 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:51:59.806 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:51:59.806 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:51:59.806 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.806 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.806 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.806 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.807 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.807 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-21T01:51:59.807 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-21T01:51:59.807 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.807 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.807 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.807 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:51:59.807 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.807 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.807 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.807 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.807 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.807 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.807 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.808 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.808 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-21T01:51:59.808 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-21T01:51:59.808 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.808 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.808 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.808 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-21T01:51:59.808 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.808 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.808 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:51:59.808 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:51:59.808 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:51:59.808 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:51:59.808 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:51:59.809 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:51:59.809 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:51:59.809 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:51:59.809 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.809 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.809 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.809 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.809 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.809 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-21T01:51:59.809 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-21T01:51:59.809 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.809 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.809 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.809 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:51:59.810 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.810 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.810 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.810 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.810 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.810 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.810 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.810 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.810 INFO:teuthology.orchestra.run.smithi083.stdout: "sqlite3_killpoint": { 2024-09-21T01:51:59.810 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:51:59.810 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:51:59.810 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "dev", 2024-09-21T01:51:59.810 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.811 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0", 2024-09-21T01:51:59.811 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.811 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.811 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.811 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.811 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.811 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.811 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.811 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:51:59.811 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:51:59.811 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.811 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-21T01:51:59.811 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "telegraf", 2024-09-21T01:51:59.811 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-21T01:51:59.812 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-21T01:51:59.812 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-21T01:51:59.812 INFO:teuthology.orchestra.run.smithi083.stdout: "address": { 2024-09-21T01:51:59.812 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "address", 2024-09-21T01:51:59.812 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.812 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.812 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.812 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-21T01:51:59.812 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.812 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.812 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.812 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.812 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.812 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.813 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.813 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.813 INFO:teuthology.orchestra.run.smithi083.stdout: "interval": { 2024-09-21T01:51:59.813 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "interval", 2024-09-21T01:51:59.813 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-09-21T01:51:59.813 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.813 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.813 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "15", 2024-09-21T01:51:59.813 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.813 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.813 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.813 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.813 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.813 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.813 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.814 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.814 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-21T01:51:59.814 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-21T01:51:59.814 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.814 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.814 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.814 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:51:59.814 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.814 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.814 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:51:59.814 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:51:59.814 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:51:59.814 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:51:59.814 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:51:59.815 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:51:59.815 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:51:59.815 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:51:59.815 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.815 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.815 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.815 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.815 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.815 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-21T01:51:59.815 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-21T01:51:59.815 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.815 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.815 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.815 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:51:59.816 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.816 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.816 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.816 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.816 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.816 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.816 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.816 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.816 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-21T01:51:59.816 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-21T01:51:59.816 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.816 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.816 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.816 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-21T01:51:59.817 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.817 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.817 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:51:59.817 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:51:59.817 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:51:59.817 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:51:59.817 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:51:59.817 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:51:59.817 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:51:59.817 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:51:59.817 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.817 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.817 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.817 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.818 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.818 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-21T01:51:59.818 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-21T01:51:59.818 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.818 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.818 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.818 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:51:59.818 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.818 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.818 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.818 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.818 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.818 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.818 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.819 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.819 INFO:teuthology.orchestra.run.smithi083.stdout: "sqlite3_killpoint": { 2024-09-21T01:51:59.819 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:51:59.819 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:51:59.819 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "dev", 2024-09-21T01:51:59.819 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.819 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0", 2024-09-21T01:51:59.819 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.819 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.819 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.819 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.819 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.819 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.819 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.820 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:51:59.820 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:51:59.820 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.820 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-21T01:51:59.820 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "telemetry", 2024-09-21T01:51:59.820 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-21T01:51:59.820 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-21T01:51:59.820 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-21T01:51:59.820 INFO:teuthology.orchestra.run.smithi083.stdout: "channel_basic": { 2024-09-21T01:51:59.820 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "channel_basic", 2024-09-21T01:51:59.820 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.820 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.820 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.820 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-21T01:51:59.820 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.821 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.821 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.821 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-21T01:51:59.821 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.821 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.821 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.821 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.821 INFO:teuthology.orchestra.run.smithi083.stdout: "channel_crash": { 2024-09-21T01:51:59.821 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "channel_crash", 2024-09-21T01:51:59.821 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.821 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.821 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.821 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-21T01:51:59.821 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.821 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.822 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.822 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-21T01:51:59.822 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.822 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.822 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.822 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.822 INFO:teuthology.orchestra.run.smithi083.stdout: "channel_device": { 2024-09-21T01:51:59.822 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "channel_device", 2024-09-21T01:51:59.822 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.822 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.822 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.822 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-21T01:51:59.822 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.822 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.823 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.823 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-21T01:51:59.823 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.823 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.823 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.823 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.823 INFO:teuthology.orchestra.run.smithi083.stdout: "channel_ident": { 2024-09-21T01:51:59.823 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "channel_ident", 2024-09-21T01:51:59.823 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.823 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.823 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.823 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:51:59.823 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.823 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.823 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.824 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-21T01:51:59.824 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.824 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.824 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.824 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.824 INFO:teuthology.orchestra.run.smithi083.stdout: "channel_perf": { 2024-09-21T01:51:59.824 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "channel_perf", 2024-09-21T01:51:59.824 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.824 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.824 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.824 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:51:59.824 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.824 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.824 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.824 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-21T01:51:59.825 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.825 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.825 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.825 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.825 INFO:teuthology.orchestra.run.smithi083.stdout: "contact": { 2024-09-21T01:51:59.825 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "contact", 2024-09-21T01:51:59.825 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.825 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.825 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.825 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:51:59.825 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.825 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.825 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.825 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.826 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.826 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.826 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.826 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.826 INFO:teuthology.orchestra.run.smithi083.stdout: "description": { 2024-09-21T01:51:59.826 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "description", 2024-09-21T01:51:59.826 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.826 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.826 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.826 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:51:59.826 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.826 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.826 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.826 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.827 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.827 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.827 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.827 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.827 INFO:teuthology.orchestra.run.smithi083.stdout: "device_url": { 2024-09-21T01:51:59.827 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "device_url", 2024-09-21T01:51:59.827 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.827 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.827 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.827 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-21T01:51:59.827 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.827 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.827 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.827 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.828 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.828 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.828 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.828 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.828 INFO:teuthology.orchestra.run.smithi083.stdout: "enabled": { 2024-09-21T01:51:59.828 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "enabled", 2024-09-21T01:51:59.828 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.828 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.828 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.828 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:51:59.828 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.828 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.828 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.828 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.828 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.829 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.829 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.829 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.829 INFO:teuthology.orchestra.run.smithi083.stdout: "interval": { 2024-09-21T01:51:59.829 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "interval", 2024-09-21T01:51:59.829 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:51:59.829 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.829 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.829 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "24", 2024-09-21T01:51:59.829 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "8", 2024-09-21T01:51:59.829 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.829 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.829 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.829 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.830 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.830 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.830 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.830 INFO:teuthology.orchestra.run.smithi083.stdout: "last_opt_revision": { 2024-09-21T01:51:59.830 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "last_opt_revision", 2024-09-21T01:51:59.830 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:51:59.830 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.830 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.830 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "1", 2024-09-21T01:51:59.830 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.830 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.830 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.830 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.831 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.831 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.831 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.831 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.831 INFO:teuthology.orchestra.run.smithi083.stdout: "leaderboard": { 2024-09-21T01:51:59.831 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "leaderboard", 2024-09-21T01:51:59.831 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.831 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.831 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.831 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:51:59.831 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.831 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.831 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.831 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.832 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.832 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.832 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.832 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.832 INFO:teuthology.orchestra.run.smithi083.stdout: "leaderboard_description": { 2024-09-21T01:51:59.832 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "leaderboard_description", 2024-09-21T01:51:59.832 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.832 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.832 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.832 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:51:59.832 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.832 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.832 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.832 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.833 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.833 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.833 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.833 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.833 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-21T01:51:59.833 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-21T01:51:59.833 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.833 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.833 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.833 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:51:59.833 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.833 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.833 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:51:59.833 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:51:59.834 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:51:59.834 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:51:59.834 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:51:59.834 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:51:59.834 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:51:59.834 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:51:59.834 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.834 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.834 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.834 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.834 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.834 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-21T01:51:59.834 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-21T01:51:59.835 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.835 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.835 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.835 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:51:59.835 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.835 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.835 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.835 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.835 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.835 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.835 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.835 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.835 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-21T01:51:59.835 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-21T01:51:59.836 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.836 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.836 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.836 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-21T01:51:59.836 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.836 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.836 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:51:59.836 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:51:59.836 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:51:59.836 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:51:59.836 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:51:59.836 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:51:59.836 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:51:59.836 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:51:59.837 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.837 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.837 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.837 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.837 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.837 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-21T01:51:59.837 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-21T01:51:59.837 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.837 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.837 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.837 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:51:59.837 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.837 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.837 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.838 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.838 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.838 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.838 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.838 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.838 INFO:teuthology.orchestra.run.smithi083.stdout: "organization": { 2024-09-21T01:51:59.838 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "organization", 2024-09-21T01:51:59.838 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.838 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.838 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.838 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:51:59.838 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.838 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.838 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.838 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.839 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.839 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.839 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.839 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.839 INFO:teuthology.orchestra.run.smithi083.stdout: "proxy": { 2024-09-21T01:51:59.839 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "proxy", 2024-09-21T01:51:59.839 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.839 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.839 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.839 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:51:59.839 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.839 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.839 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.839 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.839 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.840 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.840 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.840 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.840 INFO:teuthology.orchestra.run.smithi083.stdout: "sqlite3_killpoint": { 2024-09-21T01:51:59.840 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:51:59.840 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:51:59.840 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "dev", 2024-09-21T01:51:59.840 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.840 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0", 2024-09-21T01:51:59.840 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.840 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.840 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.840 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.840 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.840 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.841 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.841 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.841 INFO:teuthology.orchestra.run.smithi083.stdout: "url": { 2024-09-21T01:51:59.841 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "url", 2024-09-21T01:51:59.841 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.841 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.841 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.841 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-21T01:51:59.841 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.841 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.842 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.842 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.842 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.842 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.842 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.842 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:51:59.842 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:51:59.842 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.842 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-21T01:51:59.842 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "test_orchestrator", 2024-09-21T01:51:59.842 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-21T01:51:59.842 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-21T01:51:59.842 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-21T01:51:59.842 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-21T01:51:59.843 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-21T01:51:59.843 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.843 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.843 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.843 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:51:59.843 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.843 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.843 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:51:59.843 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:51:59.843 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:51:59.843 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:51:59.843 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:51:59.843 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:51:59.843 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:51:59.843 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:51:59.844 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.844 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.844 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.844 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.844 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.844 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-21T01:51:59.844 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-21T01:51:59.844 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.844 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.844 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.844 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:51:59.844 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.845 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.845 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.845 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.845 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.845 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.845 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.845 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.845 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-21T01:51:59.845 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-21T01:51:59.845 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.845 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.845 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.845 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-21T01:51:59.846 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.846 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.846 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:51:59.846 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:51:59.846 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:51:59.846 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:51:59.846 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:51:59.846 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:51:59.846 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:51:59.846 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:51:59.846 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.846 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.846 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.847 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.847 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.847 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-21T01:51:59.847 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-21T01:51:59.847 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.847 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.847 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.847 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:51:59.847 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.847 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.847 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.847 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.847 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.847 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.848 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.848 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.848 INFO:teuthology.orchestra.run.smithi083.stdout: "sqlite3_killpoint": { 2024-09-21T01:51:59.848 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:51:59.848 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:51:59.848 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "dev", 2024-09-21T01:51:59.848 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.848 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0", 2024-09-21T01:51:59.848 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.848 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.848 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.848 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.848 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.849 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.849 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.849 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:51:59.849 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:51:59.849 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.849 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-21T01:51:59.849 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "volumes", 2024-09-21T01:51:59.849 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-21T01:51:59.849 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-21T01:51:59.849 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-21T01:51:59.849 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-21T01:51:59.849 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-21T01:51:59.849 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.849 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.850 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.850 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:51:59.850 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.850 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.850 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:51:59.850 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:51:59.850 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:51:59.850 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:51:59.850 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:51:59.850 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:51:59.850 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:51:59.850 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:51:59.850 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.850 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.851 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.851 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.851 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.851 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-21T01:51:59.851 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-21T01:51:59.851 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.851 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.851 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.851 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:51:59.851 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.851 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.851 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.851 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.851 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.852 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.852 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.852 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.852 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-21T01:51:59.852 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-21T01:51:59.852 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.852 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.852 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.852 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-21T01:51:59.852 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.852 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.852 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:51:59.852 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:51:59.852 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:51:59.852 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:51:59.853 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:51:59.853 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:51:59.853 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:51:59.853 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:51:59.853 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.853 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.853 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.853 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.853 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.853 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-21T01:51:59.853 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-21T01:51:59.853 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.853 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.853 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.854 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:51:59.854 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.854 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.854 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.854 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.854 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.854 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.854 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.854 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.854 INFO:teuthology.orchestra.run.smithi083.stdout: "max_concurrent_clones": { 2024-09-21T01:51:59.854 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "max_concurrent_clones", 2024-09-21T01:51:59.854 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:51:59.854 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.854 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.855 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "4", 2024-09-21T01:51:59.855 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.855 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.855 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.855 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-21T01:51:59.855 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.855 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.855 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.855 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.855 INFO:teuthology.orchestra.run.smithi083.stdout: "periodic_async_work": { 2024-09-21T01:51:59.855 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "periodic_async_work", 2024-09-21T01:51:59.855 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.855 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.855 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.856 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:51:59.856 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.856 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.856 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.856 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Periodically check for async work", 2024-09-21T01:51:59.856 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.856 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.856 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.856 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.856 INFO:teuthology.orchestra.run.smithi083.stdout: "snapshot_clone_delay": { 2024-09-21T01:51:59.856 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "snapshot_clone_delay", 2024-09-21T01:51:59.856 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:51:59.856 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.856 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.857 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0", 2024-09-21T01:51:59.857 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.857 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.857 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.857 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-21T01:51:59.857 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.857 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.857 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.857 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.857 INFO:teuthology.orchestra.run.smithi083.stdout: "snapshot_clone_no_wait": { 2024-09-21T01:51:59.857 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "snapshot_clone_no_wait", 2024-09-21T01:51:59.857 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.857 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.857 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.858 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-21T01:51:59.858 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.858 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.858 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.858 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-21T01:51:59.858 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.858 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.858 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.858 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.858 INFO:teuthology.orchestra.run.smithi083.stdout: "sqlite3_killpoint": { 2024-09-21T01:51:59.858 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:51:59.858 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:51:59.858 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "dev", 2024-09-21T01:51:59.858 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.859 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0", 2024-09-21T01:51:59.859 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.859 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.859 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.859 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.859 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.859 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.859 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.859 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:51:59.859 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:51:59.859 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.859 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-21T01:51:59.859 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "zabbix", 2024-09-21T01:51:59.859 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-21T01:51:59.860 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-21T01:51:59.860 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-21T01:51:59.860 INFO:teuthology.orchestra.run.smithi083.stdout: "discovery_interval": { 2024-09-21T01:51:59.860 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "discovery_interval", 2024-09-21T01:51:59.860 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "uint", 2024-09-21T01:51:59.860 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.860 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.860 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "100", 2024-09-21T01:51:59.860 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.860 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.860 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.860 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.860 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.860 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.861 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.861 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.861 INFO:teuthology.orchestra.run.smithi083.stdout: "identifier": { 2024-09-21T01:51:59.861 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "identifier", 2024-09-21T01:51:59.861 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.861 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.861 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.861 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:51:59.861 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.861 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.861 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.861 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.861 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.861 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.862 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.862 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.862 INFO:teuthology.orchestra.run.smithi083.stdout: "interval": { 2024-09-21T01:51:59.862 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "interval", 2024-09-21T01:51:59.862 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-09-21T01:51:59.862 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.862 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.862 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "60", 2024-09-21T01:51:59.862 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.862 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.862 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.862 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.862 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.862 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.863 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.863 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.863 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-21T01:51:59.863 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-21T01:51:59.863 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.863 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.863 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.863 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:51:59.863 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.863 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.863 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:51:59.863 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:51:59.863 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:51:59.863 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:51:59.864 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:51:59.864 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:51:59.864 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:51:59.864 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:51:59.864 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.864 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.864 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.864 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.864 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.864 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-21T01:51:59.864 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-21T01:51:59.864 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.864 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.864 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.865 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:51:59.865 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.865 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.865 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.865 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.865 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.865 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.865 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.865 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.865 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-21T01:51:59.865 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-21T01:51:59.865 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.865 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.865 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.865 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-21T01:51:59.866 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.866 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.866 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:51:59.866 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:51:59.866 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:51:59.866 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:51:59.866 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:51:59.866 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:51:59.866 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:51:59.866 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:51:59.866 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.866 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.866 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.866 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.867 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.867 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-21T01:51:59.867 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-21T01:51:59.867 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.867 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.867 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.867 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:51:59.867 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.867 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.867 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.867 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.867 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.867 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.867 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.868 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.868 INFO:teuthology.orchestra.run.smithi083.stdout: "sqlite3_killpoint": { 2024-09-21T01:51:59.868 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:51:59.868 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:51:59.868 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "dev", 2024-09-21T01:51:59.868 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.868 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0", 2024-09-21T01:51:59.868 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.868 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.868 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.868 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.868 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.868 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.868 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.868 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.869 INFO:teuthology.orchestra.run.smithi083.stdout: "zabbix_host": { 2024-09-21T01:51:59.869 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "zabbix_host", 2024-09-21T01:51:59.869 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.869 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.869 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.869 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:51:59.869 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.869 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.869 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.869 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.869 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.869 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.869 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.869 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.870 INFO:teuthology.orchestra.run.smithi083.stdout: "zabbix_port": { 2024-09-21T01:51:59.870 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "zabbix_port", 2024-09-21T01:51:59.870 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:51:59.870 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.870 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.870 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "10051", 2024-09-21T01:51:59.870 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.870 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.870 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.870 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.870 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.870 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.870 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.870 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.871 INFO:teuthology.orchestra.run.smithi083.stdout: "zabbix_sender": { 2024-09-21T01:51:59.871 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "zabbix_sender", 2024-09-21T01:51:59.871 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.871 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.871 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.871 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-21T01:51:59.871 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.871 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.871 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.871 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.871 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.871 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.871 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.872 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:51:59.872 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:51:59.872 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:51:59.872 INFO:teuthology.orchestra.run.smithi083.stdout: ] 2024-09-21T01:51:59.872 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.872 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-21T01:51:59.872 INFO:teuthology.orchestra.run.smithi083.stdout: "gid": 24140, 2024-09-21T01:51:59.872 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "y", 2024-09-21T01:51:59.872 INFO:teuthology.orchestra.run.smithi083.stdout: "mgr_features": 4540719139924082687, 2024-09-21T01:51:59.872 INFO:teuthology.orchestra.run.smithi083.stdout: "available_modules": [ 2024-09-21T01:51:59.872 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-21T01:51:59.872 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "alerts", 2024-09-21T01:51:59.872 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-21T01:51:59.872 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-21T01:51:59.873 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-21T01:51:59.873 INFO:teuthology.orchestra.run.smithi083.stdout: "interval": { 2024-09-21T01:51:59.873 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "interval", 2024-09-21T01:51:59.873 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-09-21T01:51:59.873 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.873 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.873 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "60", 2024-09-21T01:51:59.873 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.873 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.873 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.873 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "How frequently to reexamine health status", 2024-09-21T01:51:59.873 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.873 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.873 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.874 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.874 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-21T01:51:59.874 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-21T01:51:59.874 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.874 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.874 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.874 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:51:59.874 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.874 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.874 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:51:59.874 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:51:59.874 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:51:59.874 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:51:59.874 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:51:59.874 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:51:59.875 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:51:59.875 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:51:59.875 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.875 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.875 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.875 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.875 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.875 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-21T01:51:59.875 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-21T01:51:59.875 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.875 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.875 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.875 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:51:59.876 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.876 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.876 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.876 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.876 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.876 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.876 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.876 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.876 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-21T01:51:59.876 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-21T01:51:59.876 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.876 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.876 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.876 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-21T01:51:59.877 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.877 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.877 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:51:59.877 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:51:59.877 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:51:59.877 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:51:59.877 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:51:59.877 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:51:59.877 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:51:59.877 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:51:59.877 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.877 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.877 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.877 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.878 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.878 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-21T01:51:59.878 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-21T01:51:59.878 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.878 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.878 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.878 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:51:59.878 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.878 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.878 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.878 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.878 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.878 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.878 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.879 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.879 INFO:teuthology.orchestra.run.smithi083.stdout: "smtp_destination": { 2024-09-21T01:51:59.879 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "smtp_destination", 2024-09-21T01:51:59.879 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.879 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.879 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.879 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:51:59.879 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.879 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.879 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.879 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Email address to send alerts to, use commas to separate multiple", 2024-09-21T01:51:59.879 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.879 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.879 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.880 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.880 INFO:teuthology.orchestra.run.smithi083.stdout: "smtp_from_name": { 2024-09-21T01:51:59.880 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "smtp_from_name", 2024-09-21T01:51:59.880 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.880 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.880 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.880 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "Ceph", 2024-09-21T01:51:59.880 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.880 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.880 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.880 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Email From: name", 2024-09-21T01:51:59.880 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.880 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.880 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.881 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.881 INFO:teuthology.orchestra.run.smithi083.stdout: "smtp_host": { 2024-09-21T01:51:59.881 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "smtp_host", 2024-09-21T01:51:59.881 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.881 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.881 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.881 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:51:59.881 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.881 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.881 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.881 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "SMTP server", 2024-09-21T01:51:59.881 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.881 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.881 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.882 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.882 INFO:teuthology.orchestra.run.smithi083.stdout: "smtp_password": { 2024-09-21T01:51:59.882 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "smtp_password", 2024-09-21T01:51:59.882 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.882 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.882 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.882 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:51:59.882 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.882 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.882 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.882 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Password to authenticate with", 2024-09-21T01:51:59.882 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.882 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.882 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.883 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.883 INFO:teuthology.orchestra.run.smithi083.stdout: "smtp_port": { 2024-09-21T01:51:59.883 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "smtp_port", 2024-09-21T01:51:59.883 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:51:59.883 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.883 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.883 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "465", 2024-09-21T01:51:59.883 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.883 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.883 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.883 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "SMTP port", 2024-09-21T01:51:59.883 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.883 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.883 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.884 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.884 INFO:teuthology.orchestra.run.smithi083.stdout: "smtp_sender": { 2024-09-21T01:51:59.884 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "smtp_sender", 2024-09-21T01:51:59.884 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.884 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.884 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.884 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:51:59.884 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.884 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.884 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.884 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "SMTP envelope sender", 2024-09-21T01:51:59.884 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.884 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.884 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.885 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.885 INFO:teuthology.orchestra.run.smithi083.stdout: "smtp_ssl": { 2024-09-21T01:51:59.885 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "smtp_ssl", 2024-09-21T01:51:59.885 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.885 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.885 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.885 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-21T01:51:59.885 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.885 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.885 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.885 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-21T01:51:59.885 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.885 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.886 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.886 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.886 INFO:teuthology.orchestra.run.smithi083.stdout: "smtp_user": { 2024-09-21T01:51:59.886 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "smtp_user", 2024-09-21T01:51:59.886 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.886 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.886 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.886 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:51:59.886 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.886 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.886 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.886 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "User to authenticate as", 2024-09-21T01:51:59.886 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.886 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.887 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.887 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.887 INFO:teuthology.orchestra.run.smithi083.stdout: "sqlite3_killpoint": { 2024-09-21T01:51:59.887 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:51:59.887 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:51:59.887 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "dev", 2024-09-21T01:51:59.887 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.887 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0", 2024-09-21T01:51:59.887 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.887 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.887 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.887 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.887 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.887 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.888 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.888 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:51:59.888 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:51:59.888 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.888 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-21T01:51:59.888 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "balancer", 2024-09-21T01:51:59.888 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-21T01:51:59.888 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-21T01:51:59.888 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-21T01:51:59.888 INFO:teuthology.orchestra.run.smithi083.stdout: "active": { 2024-09-21T01:51:59.888 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "active", 2024-09-21T01:51:59.888 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.888 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.888 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.889 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-21T01:51:59.889 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.889 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.889 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.889 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "automatically balance PGs across cluster", 2024-09-21T01:51:59.889 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.889 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.889 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.889 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.889 INFO:teuthology.orchestra.run.smithi083.stdout: "begin_time": { 2024-09-21T01:51:59.889 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "begin_time", 2024-09-21T01:51:59.889 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.889 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.889 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.889 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0000", 2024-09-21T01:51:59.890 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.890 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.890 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.890 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "beginning time of day to automatically balance", 2024-09-21T01:51:59.890 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-21T01:51:59.890 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.890 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.890 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.890 INFO:teuthology.orchestra.run.smithi083.stdout: "begin_weekday": { 2024-09-21T01:51:59.890 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "begin_weekday", 2024-09-21T01:51:59.890 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "uint", 2024-09-21T01:51:59.890 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.890 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.891 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0", 2024-09-21T01:51:59.891 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "0", 2024-09-21T01:51:59.891 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "6", 2024-09-21T01:51:59.891 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.891 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-21T01:51:59.891 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-21T01:51:59.891 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.891 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.891 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.891 INFO:teuthology.orchestra.run.smithi083.stdout: "crush_compat_max_iterations": { 2024-09-21T01:51:59.891 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "crush_compat_max_iterations", 2024-09-21T01:51:59.891 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "uint", 2024-09-21T01:51:59.891 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.891 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.891 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "25", 2024-09-21T01:51:59.892 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "1", 2024-09-21T01:51:59.892 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "250", 2024-09-21T01:51:59.892 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.892 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-21T01:51:59.892 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.892 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.892 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.892 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.892 INFO:teuthology.orchestra.run.smithi083.stdout: "crush_compat_metrics": { 2024-09-21T01:51:59.892 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "crush_compat_metrics", 2024-09-21T01:51:59.892 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.892 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.892 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.892 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "pgs,objects,bytes", 2024-09-21T01:51:59.893 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.893 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.893 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.893 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-21T01:51:59.893 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-21T01:51:59.893 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.893 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.893 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.893 INFO:teuthology.orchestra.run.smithi083.stdout: "crush_compat_step": { 2024-09-21T01:51:59.893 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "crush_compat_step", 2024-09-21T01:51:59.893 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "float", 2024-09-21T01:51:59.893 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.893 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.893 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0.5", 2024-09-21T01:51:59.893 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "0.001", 2024-09-21T01:51:59.894 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "0.999", 2024-09-21T01:51:59.894 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.894 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "aggressiveness of optimization", 2024-09-21T01:51:59.894 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-21T01:51:59.894 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.894 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.894 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.894 INFO:teuthology.orchestra.run.smithi083.stdout: "end_time": { 2024-09-21T01:51:59.894 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "end_time", 2024-09-21T01:51:59.894 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.894 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.894 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.894 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "2359", 2024-09-21T01:51:59.894 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.895 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.895 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.895 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "ending time of day to automatically balance", 2024-09-21T01:51:59.895 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-21T01:51:59.895 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.895 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.895 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.895 INFO:teuthology.orchestra.run.smithi083.stdout: "end_weekday": { 2024-09-21T01:51:59.895 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "end_weekday", 2024-09-21T01:51:59.895 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "uint", 2024-09-21T01:51:59.895 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.895 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.895 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0", 2024-09-21T01:51:59.895 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "0", 2024-09-21T01:51:59.895 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "6", 2024-09-21T01:51:59.896 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.896 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-21T01:51:59.896 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-21T01:51:59.896 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.896 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.896 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.896 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-21T01:51:59.896 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-21T01:51:59.896 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.896 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.896 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.896 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:51:59.896 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.896 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.897 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:51:59.897 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:51:59.897 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:51:59.897 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:51:59.897 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:51:59.897 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:51:59.897 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:51:59.897 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:51:59.897 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.897 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.897 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.897 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.897 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.898 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-21T01:51:59.898 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-21T01:51:59.898 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.898 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.898 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.898 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:51:59.898 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.898 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.898 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.898 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.898 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.898 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.898 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.898 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.899 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-21T01:51:59.899 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-21T01:51:59.899 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.899 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.899 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.899 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-21T01:51:59.899 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.899 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.899 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:51:59.899 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:51:59.899 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:51:59.899 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:51:59.899 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:51:59.899 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:51:59.900 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:51:59.900 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:51:59.900 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.900 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.900 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.900 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.900 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.900 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-21T01:51:59.900 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-21T01:51:59.900 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.900 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.900 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.900 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:51:59.900 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.901 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.901 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.901 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.901 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.901 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.901 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.901 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.901 INFO:teuthology.orchestra.run.smithi083.stdout: "min_score": { 2024-09-21T01:51:59.901 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "min_score", 2024-09-21T01:51:59.901 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "float", 2024-09-21T01:51:59.901 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.901 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.901 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0", 2024-09-21T01:51:59.901 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.901 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.902 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.902 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-21T01:51:59.902 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.902 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.902 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.902 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.902 INFO:teuthology.orchestra.run.smithi083.stdout: "mode": { 2024-09-21T01:51:59.902 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "mode", 2024-09-21T01:51:59.902 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.902 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.902 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.902 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "upmap", 2024-09-21T01:51:59.902 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.902 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.903 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:51:59.903 INFO:teuthology.orchestra.run.smithi083.stdout: "crush-compat", 2024-09-21T01:51:59.903 INFO:teuthology.orchestra.run.smithi083.stdout: "none", 2024-09-21T01:51:59.903 INFO:teuthology.orchestra.run.smithi083.stdout: "read", 2024-09-21T01:51:59.903 INFO:teuthology.orchestra.run.smithi083.stdout: "upmap", 2024-09-21T01:51:59.903 INFO:teuthology.orchestra.run.smithi083.stdout: "upmap-read" 2024-09-21T01:51:59.903 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:51:59.903 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Balancer mode", 2024-09-21T01:51:59.903 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.903 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.903 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.903 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.903 INFO:teuthology.orchestra.run.smithi083.stdout: "pool_ids": { 2024-09-21T01:51:59.903 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "pool_ids", 2024-09-21T01:51:59.903 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.904 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.904 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.904 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:51:59.904 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.904 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.904 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.904 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-21T01:51:59.904 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.904 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.904 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.904 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.904 INFO:teuthology.orchestra.run.smithi083.stdout: "sleep_interval": { 2024-09-21T01:51:59.904 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "sleep_interval", 2024-09-21T01:51:59.904 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-09-21T01:51:59.905 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.905 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.905 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "60", 2024-09-21T01:51:59.905 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.905 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.905 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.905 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-21T01:51:59.905 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.905 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.905 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.905 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.905 INFO:teuthology.orchestra.run.smithi083.stdout: "sqlite3_killpoint": { 2024-09-21T01:51:59.905 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:51:59.905 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:51:59.906 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "dev", 2024-09-21T01:51:59.906 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.906 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0", 2024-09-21T01:51:59.906 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.906 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.906 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.906 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.906 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.906 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.906 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.906 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.906 INFO:teuthology.orchestra.run.smithi083.stdout: "upmap_max_deviation": { 2024-09-21T01:51:59.906 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "upmap_max_deviation", 2024-09-21T01:51:59.907 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:51:59.907 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.907 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.907 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "5", 2024-09-21T01:51:59.907 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "1", 2024-09-21T01:51:59.907 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.907 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.907 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-21T01:51:59.907 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-21T01:51:59.907 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.907 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.907 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.907 INFO:teuthology.orchestra.run.smithi083.stdout: "upmap_max_optimizations": { 2024-09-21T01:51:59.907 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "upmap_max_optimizations", 2024-09-21T01:51:59.908 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "uint", 2024-09-21T01:51:59.908 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.908 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.908 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "10", 2024-09-21T01:51:59.908 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.908 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.908 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.908 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-21T01:51:59.908 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.908 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.908 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.908 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:51:59.908 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:51:59.908 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.909 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-21T01:51:59.909 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "cephadm", 2024-09-21T01:51:59.909 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-21T01:51:59.909 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-21T01:51:59.909 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-21T01:51:59.909 INFO:teuthology.orchestra.run.smithi083.stdout: "agent_down_multiplier": { 2024-09-21T01:51:59.909 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "agent_down_multiplier", 2024-09-21T01:51:59.909 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "float", 2024-09-21T01:51:59.909 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.909 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.909 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "3.0", 2024-09-21T01:51:59.909 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.909 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.909 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.910 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-21T01:51:59.910 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.910 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.910 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.910 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.910 INFO:teuthology.orchestra.run.smithi083.stdout: "agent_refresh_rate": { 2024-09-21T01:51:59.910 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "agent_refresh_rate", 2024-09-21T01:51:59.910 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-09-21T01:51:59.910 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.910 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.910 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "20", 2024-09-21T01:51:59.910 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.910 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.911 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.911 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-21T01:51:59.911 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.911 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.911 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.911 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.911 INFO:teuthology.orchestra.run.smithi083.stdout: "agent_starting_port": { 2024-09-21T01:51:59.911 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "agent_starting_port", 2024-09-21T01:51:59.911 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:51:59.911 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.911 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.911 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "4721", 2024-09-21T01:51:59.911 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.911 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.912 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.912 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-21T01:51:59.912 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.912 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.912 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.912 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.912 INFO:teuthology.orchestra.run.smithi083.stdout: "allow_ptrace": { 2024-09-21T01:51:59.912 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "allow_ptrace", 2024-09-21T01:51:59.912 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.912 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.912 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.912 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:51:59.912 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.912 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.913 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.913 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-21T01:51:59.913 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-21T01:51:59.913 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.913 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.913 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.913 INFO:teuthology.orchestra.run.smithi083.stdout: "autotune_interval": { 2024-09-21T01:51:59.913 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "autotune_interval", 2024-09-21T01:51:59.913 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-09-21T01:51:59.913 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.913 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.913 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "600", 2024-09-21T01:51:59.913 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.913 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.914 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.914 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-21T01:51:59.914 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.914 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.914 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.914 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.914 INFO:teuthology.orchestra.run.smithi083.stdout: "autotune_memory_target_ratio": { 2024-09-21T01:51:59.914 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "autotune_memory_target_ratio", 2024-09-21T01:51:59.914 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "float", 2024-09-21T01:51:59.914 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.914 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.914 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0.7", 2024-09-21T01:51:59.914 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.914 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.915 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.915 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-21T01:51:59.915 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.915 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.915 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.915 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.915 INFO:teuthology.orchestra.run.smithi083.stdout: "cephadm_log_destination": { 2024-09-21T01:51:59.915 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "cephadm_log_destination", 2024-09-21T01:51:59.915 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.915 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.915 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.915 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:51:59.915 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.915 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.916 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:51:59.916 INFO:teuthology.orchestra.run.smithi083.stdout: "file", 2024-09-21T01:51:59.916 INFO:teuthology.orchestra.run.smithi083.stdout: "file,syslog", 2024-09-21T01:51:59.916 INFO:teuthology.orchestra.run.smithi083.stdout: "syslog" 2024-09-21T01:51:59.916 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:51:59.916 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-21T01:51:59.916 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.916 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.916 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.916 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.916 INFO:teuthology.orchestra.run.smithi083.stdout: "cgroups_split": { 2024-09-21T01:51:59.916 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "cgroups_split", 2024-09-21T01:51:59.916 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.916 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.917 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.917 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-21T01:51:59.917 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.917 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.917 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.917 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-21T01:51:59.917 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.917 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.917 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.917 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.917 INFO:teuthology.orchestra.run.smithi083.stdout: "config_checks_enabled": { 2024-09-21T01:51:59.917 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "config_checks_enabled", 2024-09-21T01:51:59.917 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.918 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.918 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.918 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:51:59.918 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.918 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.918 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.918 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-21T01:51:59.918 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.918 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.918 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.918 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.918 INFO:teuthology.orchestra.run.smithi083.stdout: "config_dashboard": { 2024-09-21T01:51:59.918 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "config_dashboard", 2024-09-21T01:51:59.918 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.919 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.919 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.919 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-21T01:51:59.919 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.919 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.919 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.919 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-21T01:51:59.919 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.919 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.919 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.919 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.919 INFO:teuthology.orchestra.run.smithi083.stdout: "container_image_alertmanager": { 2024-09-21T01:51:59.919 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "container_image_alertmanager", 2024-09-21T01:51:59.919 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.920 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.920 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.920 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.27.0", 2024-09-21T01:51:59.920 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.920 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.920 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.920 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Prometheus container image", 2024-09-21T01:51:59.920 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.920 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.920 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.920 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.920 INFO:teuthology.orchestra.run.smithi083.stdout: "container_image_base": { 2024-09-21T01:51:59.920 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "container_image_base", 2024-09-21T01:51:59.920 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.921 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.921 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.921 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-21T01:51:59.921 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.921 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.921 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.921 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Container image name, without the tag", 2024-09-21T01:51:59.921 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.921 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.921 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.921 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.921 INFO:teuthology.orchestra.run.smithi083.stdout: "container_image_elasticsearch": { 2024-09-21T01:51:59.921 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "container_image_elasticsearch", 2024-09-21T01:51:59.921 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.921 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.922 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.922 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-21T01:51:59.922 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.922 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.922 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.922 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "elasticsearch container image", 2024-09-21T01:51:59.922 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.922 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.922 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.922 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.922 INFO:teuthology.orchestra.run.smithi083.stdout: "container_image_grafana": { 2024-09-21T01:51:59.922 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "container_image_grafana", 2024-09-21T01:51:59.922 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.923 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.923 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.923 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "quay.io/ceph/grafana:10.4.8", 2024-09-21T01:51:59.923 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.923 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.923 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.923 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Prometheus container image", 2024-09-21T01:51:59.923 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.923 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.923 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.923 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.923 INFO:teuthology.orchestra.run.smithi083.stdout: "container_image_haproxy": { 2024-09-21T01:51:59.923 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "container_image_haproxy", 2024-09-21T01:51:59.923 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.924 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.924 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.924 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-21T01:51:59.924 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.924 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.924 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.924 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "HAproxy container image", 2024-09-21T01:51:59.924 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.924 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.924 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.924 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.924 INFO:teuthology.orchestra.run.smithi083.stdout: "container_image_jaeger_agent": { 2024-09-21T01:51:59.924 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "container_image_jaeger_agent", 2024-09-21T01:51:59.924 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.925 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.925 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.925 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-21T01:51:59.925 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.925 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.925 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.925 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Jaeger agent container image", 2024-09-21T01:51:59.925 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.925 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.925 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.925 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.925 INFO:teuthology.orchestra.run.smithi083.stdout: "container_image_jaeger_collector": { 2024-09-21T01:51:59.925 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "container_image_jaeger_collector", 2024-09-21T01:51:59.925 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.926 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.926 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.926 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-21T01:51:59.926 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.926 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.926 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.926 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Jaeger collector container image", 2024-09-21T01:51:59.926 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.926 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.926 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.926 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.926 INFO:teuthology.orchestra.run.smithi083.stdout: "container_image_jaeger_query": { 2024-09-21T01:51:59.926 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "container_image_jaeger_query", 2024-09-21T01:51:59.926 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.927 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.927 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.927 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-21T01:51:59.927 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.927 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.927 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.927 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Jaeger query container image", 2024-09-21T01:51:59.927 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.927 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.927 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.927 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.927 INFO:teuthology.orchestra.run.smithi083.stdout: "container_image_keepalived": { 2024-09-21T01:51:59.927 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "container_image_keepalived", 2024-09-21T01:51:59.927 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.928 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.928 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.928 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-21T01:51:59.928 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.928 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.928 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.928 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Keepalived container image", 2024-09-21T01:51:59.928 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.928 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.928 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.928 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.928 INFO:teuthology.orchestra.run.smithi083.stdout: "container_image_loki": { 2024-09-21T01:51:59.928 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "container_image_loki", 2024-09-21T01:51:59.928 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.929 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.929 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.929 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-21T01:51:59.929 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.929 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.929 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.929 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Loki container image", 2024-09-21T01:51:59.929 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.929 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.929 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.929 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.929 INFO:teuthology.orchestra.run.smithi083.stdout: "container_image_nginx": { 2024-09-21T01:51:59.929 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "container_image_nginx", 2024-09-21T01:51:59.929 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.929 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.930 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.930 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "quay.io/ceph/nginx:sclorg-nginx-126", 2024-09-21T01:51:59.930 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.930 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.930 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.930 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Nginx container image", 2024-09-21T01:51:59.930 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.930 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.930 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.930 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.930 INFO:teuthology.orchestra.run.smithi083.stdout: "container_image_node_exporter": { 2024-09-21T01:51:59.930 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "container_image_node_exporter", 2024-09-21T01:51:59.930 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.930 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.931 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.931 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.7.0", 2024-09-21T01:51:59.931 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.931 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.931 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.931 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Prometheus container image", 2024-09-21T01:51:59.931 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.931 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.931 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.931 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.931 INFO:teuthology.orchestra.run.smithi083.stdout: "container_image_nvmeof": { 2024-09-21T01:51:59.931 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "container_image_nvmeof", 2024-09-21T01:51:59.931 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.931 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.932 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.932 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.17", 2024-09-21T01:51:59.932 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.932 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.932 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.932 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Nvme-of container image", 2024-09-21T01:51:59.932 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.932 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.932 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.932 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.932 INFO:teuthology.orchestra.run.smithi083.stdout: "container_image_oauth2_proxy": { 2024-09-21T01:51:59.932 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "container_image_oauth2_proxy", 2024-09-21T01:51:59.932 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.932 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.932 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.933 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "quay.io/oauth2-proxy/oauth2-proxy:v7.6.0", 2024-09-21T01:51:59.933 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.933 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.933 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.933 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "oauth2-proxy container image", 2024-09-21T01:51:59.933 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.933 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.933 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.933 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.933 INFO:teuthology.orchestra.run.smithi083.stdout: "container_image_prometheus": { 2024-09-21T01:51:59.933 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "container_image_prometheus", 2024-09-21T01:51:59.933 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.933 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.933 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.933 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "quay.io/prometheus/prometheus:v2.51.0", 2024-09-21T01:51:59.934 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.934 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.934 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.934 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Prometheus container image", 2024-09-21T01:51:59.934 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.934 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.934 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.934 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.934 INFO:teuthology.orchestra.run.smithi083.stdout: "container_image_promtail": { 2024-09-21T01:51:59.934 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "container_image_promtail", 2024-09-21T01:51:59.934 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.934 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.934 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.935 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-21T01:51:59.935 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.935 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.935 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.935 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Promtail container image", 2024-09-21T01:51:59.935 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.935 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.935 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.935 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.935 INFO:teuthology.orchestra.run.smithi083.stdout: "container_image_samba": { 2024-09-21T01:51:59.935 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "container_image_samba", 2024-09-21T01:51:59.935 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.935 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.935 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.936 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-21T01:51:59.936 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.936 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.936 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.936 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Samba/SMB container image", 2024-09-21T01:51:59.936 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.936 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.936 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.936 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.936 INFO:teuthology.orchestra.run.smithi083.stdout: "container_image_samba_metrics": { 2024-09-21T01:51:59.936 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "container_image_samba_metrics", 2024-09-21T01:51:59.936 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.936 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.936 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.937 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "quay.io/samba.org/samba-metrics:latest", 2024-09-21T01:51:59.937 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.937 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.937 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.937 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Samba/SMB metrics exporter container image", 2024-09-21T01:51:59.937 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.937 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.937 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.937 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.937 INFO:teuthology.orchestra.run.smithi083.stdout: "container_image_snmp_gateway": { 2024-09-21T01:51:59.937 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "container_image_snmp_gateway", 2024-09-21T01:51:59.937 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.937 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.937 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.938 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-21T01:51:59.938 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.938 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.938 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.938 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "SNMP Gateway container image", 2024-09-21T01:51:59.938 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.938 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.938 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.938 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.938 INFO:teuthology.orchestra.run.smithi083.stdout: "container_init": { 2024-09-21T01:51:59.938 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "container_init", 2024-09-21T01:51:59.938 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.938 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.938 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.939 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-21T01:51:59.939 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.939 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.939 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.939 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Run podman/docker with `--init`", 2024-09-21T01:51:59.939 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.939 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.939 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.939 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.939 INFO:teuthology.orchestra.run.smithi083.stdout: "daemon_cache_timeout": { 2024-09-21T01:51:59.939 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "daemon_cache_timeout", 2024-09-21T01:51:59.939 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-09-21T01:51:59.939 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.939 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.940 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "600", 2024-09-21T01:51:59.940 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.940 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.940 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.940 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-21T01:51:59.940 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.940 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.940 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.940 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.940 INFO:teuthology.orchestra.run.smithi083.stdout: "default_cephadm_command_timeout": { 2024-09-21T01:51:59.940 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "default_cephadm_command_timeout", 2024-09-21T01:51:59.940 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:51:59.940 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.940 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.940 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "900", 2024-09-21T01:51:59.941 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.941 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.941 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.941 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-21T01:51:59.941 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.941 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.941 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.941 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.941 INFO:teuthology.orchestra.run.smithi083.stdout: "default_registry": { 2024-09-21T01:51:59.941 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "default_registry", 2024-09-21T01:51:59.941 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.941 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.941 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.941 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "docker.io", 2024-09-21T01:51:59.942 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.942 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.942 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.942 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-21T01:51:59.942 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.942 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.942 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.942 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.942 INFO:teuthology.orchestra.run.smithi083.stdout: "device_cache_timeout": { 2024-09-21T01:51:59.942 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "device_cache_timeout", 2024-09-21T01:51:59.942 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-09-21T01:51:59.942 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.942 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.942 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "1800", 2024-09-21T01:51:59.943 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.943 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.943 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.943 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "seconds to cache device inventory", 2024-09-21T01:51:59.943 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.943 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.943 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.943 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.943 INFO:teuthology.orchestra.run.smithi083.stdout: "device_enhanced_scan": { 2024-09-21T01:51:59.943 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "device_enhanced_scan", 2024-09-21T01:51:59.943 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.943 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.943 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.943 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:51:59.944 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.944 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.944 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.944 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-21T01:51:59.944 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.944 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.944 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.944 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.944 INFO:teuthology.orchestra.run.smithi083.stdout: "facts_cache_timeout": { 2024-09-21T01:51:59.944 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "facts_cache_timeout", 2024-09-21T01:51:59.944 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-09-21T01:51:59.944 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.944 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.944 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "60", 2024-09-21T01:51:59.945 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.945 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.945 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.945 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "seconds to cache host facts data", 2024-09-21T01:51:59.945 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.945 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.945 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.945 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.945 INFO:teuthology.orchestra.run.smithi083.stdout: "grafana_dashboards_path": { 2024-09-21T01:51:59.945 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "grafana_dashboards_path", 2024-09-21T01:51:59.945 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.945 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.945 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.945 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-21T01:51:59.945 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.946 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.946 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.946 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-21T01:51:59.946 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.946 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.946 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.946 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.946 INFO:teuthology.orchestra.run.smithi083.stdout: "host_check_interval": { 2024-09-21T01:51:59.946 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "host_check_interval", 2024-09-21T01:51:59.946 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-09-21T01:51:59.946 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.946 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.946 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "600", 2024-09-21T01:51:59.947 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.947 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.947 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.947 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "how frequently to perform a host check", 2024-09-21T01:51:59.947 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.947 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.947 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.947 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.947 INFO:teuthology.orchestra.run.smithi083.stdout: "hw_monitoring": { 2024-09-21T01:51:59.947 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "hw_monitoring", 2024-09-21T01:51:59.947 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.947 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.947 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.947 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:51:59.948 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.948 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.948 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.948 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-21T01:51:59.948 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.948 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.948 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.948 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.948 INFO:teuthology.orchestra.run.smithi083.stdout: "inventory_list_all": { 2024-09-21T01:51:59.948 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "inventory_list_all", 2024-09-21T01:51:59.948 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.948 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.948 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.948 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:51:59.949 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.949 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.949 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.949 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-21T01:51:59.949 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.949 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.949 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.949 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.949 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-21T01:51:59.949 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-21T01:51:59.949 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.949 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.949 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.949 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:51:59.949 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.950 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.950 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:51:59.950 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:51:59.950 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:51:59.950 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:51:59.950 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:51:59.950 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:51:59.950 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:51:59.950 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:51:59.950 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.950 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.950 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.950 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.950 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.951 INFO:teuthology.orchestra.run.smithi083.stdout: "log_refresh_metadata": { 2024-09-21T01:51:59.951 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_refresh_metadata", 2024-09-21T01:51:59.951 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.951 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.951 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.951 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:51:59.951 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.951 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.951 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.951 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-21T01:51:59.951 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.951 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.951 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.951 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.951 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-21T01:51:59.952 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-21T01:51:59.952 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.952 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.952 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.952 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-21T01:51:59.952 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.952 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.952 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.952 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-21T01:51:59.952 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.952 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.952 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.952 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.952 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-21T01:51:59.953 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-21T01:51:59.953 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.953 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.953 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.953 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-21T01:51:59.953 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.953 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.953 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:51:59.953 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:51:59.953 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:51:59.953 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:51:59.953 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:51:59.953 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:51:59.953 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:51:59.954 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:51:59.954 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.954 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.954 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.954 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.954 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.954 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-21T01:51:59.954 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-21T01:51:59.954 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.954 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.954 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.954 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:51:59.954 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.954 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.955 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.955 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.955 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.955 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.955 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.955 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.955 INFO:teuthology.orchestra.run.smithi083.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-21T01:51:59.955 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-21T01:51:59.955 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.955 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.955 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.955 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:51:59.955 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.955 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.955 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.956 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-21T01:51:59.956 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.956 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.956 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.956 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.956 INFO:teuthology.orchestra.run.smithi083.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-21T01:51:59.956 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-21T01:51:59.956 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.956 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.956 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.956 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "*", 2024-09-21T01:51:59.956 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.956 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.956 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.956 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-21T01:51:59.957 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.957 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.957 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.957 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.957 INFO:teuthology.orchestra.run.smithi083.stdout: "max_count_per_host": { 2024-09-21T01:51:59.957 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "max_count_per_host", 2024-09-21T01:51:59.957 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:51:59.957 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.957 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.957 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "10", 2024-09-21T01:51:59.957 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.957 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.957 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.957 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "max number of daemons per service per host", 2024-09-21T01:51:59.957 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.958 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.958 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.958 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.958 INFO:teuthology.orchestra.run.smithi083.stdout: "max_osd_draining_count": { 2024-09-21T01:51:59.958 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "max_osd_draining_count", 2024-09-21T01:51:59.958 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:51:59.958 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.958 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.958 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "10", 2024-09-21T01:51:59.958 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.958 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.958 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.958 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-21T01:51:59.958 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.959 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.959 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.959 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.959 INFO:teuthology.orchestra.run.smithi083.stdout: "migration_current": { 2024-09-21T01:51:59.959 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "migration_current", 2024-09-21T01:51:59.959 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:51:59.959 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.959 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.959 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:51:59.959 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.959 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.959 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.959 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "internal - do not modify", 2024-09-21T01:51:59.959 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.960 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.960 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.960 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.960 INFO:teuthology.orchestra.run.smithi083.stdout: "mode": { 2024-09-21T01:51:59.960 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "mode", 2024-09-21T01:51:59.960 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.960 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.960 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.960 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "root", 2024-09-21T01:51:59.960 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.960 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.960 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:51:59.960 INFO:teuthology.orchestra.run.smithi083.stdout: "cephadm-package", 2024-09-21T01:51:59.960 INFO:teuthology.orchestra.run.smithi083.stdout: "root" 2024-09-21T01:51:59.961 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:51:59.961 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "mode for remote execution of cephadm", 2024-09-21T01:51:59.961 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.961 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.961 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.961 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.961 INFO:teuthology.orchestra.run.smithi083.stdout: "oob_default_addr": { 2024-09-21T01:51:59.961 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "oob_default_addr", 2024-09-21T01:51:59.961 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.961 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.961 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.961 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "169.254.1.1", 2024-09-21T01:51:59.961 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.961 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.962 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.962 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-21T01:51:59.962 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.962 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.962 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.962 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.962 INFO:teuthology.orchestra.run.smithi083.stdout: "prometheus_alerts_path": { 2024-09-21T01:51:59.962 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "prometheus_alerts_path", 2024-09-21T01:51:59.962 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.962 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.962 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.962 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-21T01:51:59.962 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.962 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.963 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.963 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-21T01:51:59.963 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.963 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.963 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.963 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.963 INFO:teuthology.orchestra.run.smithi083.stdout: "registry_insecure": { 2024-09-21T01:51:59.963 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "registry_insecure", 2024-09-21T01:51:59.963 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.963 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.963 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.963 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:51:59.963 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.963 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.964 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.964 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-21T01:51:59.964 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.964 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.964 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.964 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.964 INFO:teuthology.orchestra.run.smithi083.stdout: "registry_password": { 2024-09-21T01:51:59.964 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "registry_password", 2024-09-21T01:51:59.964 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.964 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.964 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.964 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:51:59.964 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.964 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.965 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.965 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-21T01:51:59.965 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.965 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.965 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.965 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.965 INFO:teuthology.orchestra.run.smithi083.stdout: "registry_url": { 2024-09-21T01:51:59.965 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "registry_url", 2024-09-21T01:51:59.965 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.965 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.965 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.965 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:51:59.965 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.965 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.966 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.966 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-21T01:51:59.966 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.966 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.966 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.966 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.966 INFO:teuthology.orchestra.run.smithi083.stdout: "registry_username": { 2024-09-21T01:51:59.966 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "registry_username", 2024-09-21T01:51:59.966 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.966 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.966 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.966 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:51:59.966 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.966 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.966 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.967 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-21T01:51:59.967 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.967 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.967 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.967 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.967 INFO:teuthology.orchestra.run.smithi083.stdout: "secure_monitoring_stack": { 2024-09-21T01:51:59.967 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "secure_monitoring_stack", 2024-09-21T01:51:59.967 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.967 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.967 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.967 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:51:59.967 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.968 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.968 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.968 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-21T01:51:59.968 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.968 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.968 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.968 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.968 INFO:teuthology.orchestra.run.smithi083.stdout: "service_discovery_port": { 2024-09-21T01:51:59.968 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "service_discovery_port", 2024-09-21T01:51:59.968 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:51:59.968 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.968 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.968 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "8765", 2024-09-21T01:51:59.968 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.968 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.969 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.969 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "cephadm service discovery port", 2024-09-21T01:51:59.969 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.969 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.969 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.969 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.969 INFO:teuthology.orchestra.run.smithi083.stdout: "sqlite3_killpoint": { 2024-09-21T01:51:59.969 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:51:59.969 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:51:59.969 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "dev", 2024-09-21T01:51:59.969 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.969 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0", 2024-09-21T01:51:59.969 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.969 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.970 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.970 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.970 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.970 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.970 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.970 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.970 INFO:teuthology.orchestra.run.smithi083.stdout: "ssh_config_file": { 2024-09-21T01:51:59.970 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "ssh_config_file", 2024-09-21T01:51:59.970 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.970 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.970 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.970 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:51:59.970 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.970 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.971 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.971 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-21T01:51:59.971 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.971 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.971 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.971 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.971 INFO:teuthology.orchestra.run.smithi083.stdout: "ssh_keepalive_count_max": { 2024-09-21T01:51:59.971 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "ssh_keepalive_count_max", 2024-09-21T01:51:59.971 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:51:59.971 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.971 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.971 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "3", 2024-09-21T01:51:59.971 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.972 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.972 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.972 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "How many times ssh connections can fail liveness checks before the host is marked offline", 2024-09-21T01:51:59.972 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.972 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.972 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.972 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.972 INFO:teuthology.orchestra.run.smithi083.stdout: "ssh_keepalive_interval": { 2024-09-21T01:51:59.972 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "ssh_keepalive_interval", 2024-09-21T01:51:59.972 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:51:59.972 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.972 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.972 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "7", 2024-09-21T01:51:59.972 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.973 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.973 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.973 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "How often ssh connections are checked for liveness", 2024-09-21T01:51:59.973 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.973 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.973 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.973 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.973 INFO:teuthology.orchestra.run.smithi083.stdout: "use_agent": { 2024-09-21T01:51:59.973 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "use_agent", 2024-09-21T01:51:59.973 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.973 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.973 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.973 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:51:59.973 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.974 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.974 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.974 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-21T01:51:59.974 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.974 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.974 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.974 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.974 INFO:teuthology.orchestra.run.smithi083.stdout: "use_repo_digest": { 2024-09-21T01:51:59.974 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "use_repo_digest", 2024-09-21T01:51:59.974 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.974 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.974 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.974 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-21T01:51:59.974 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.975 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.975 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.975 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-21T01:51:59.975 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.975 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.975 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.975 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.975 INFO:teuthology.orchestra.run.smithi083.stdout: "warn_on_failed_host_check": { 2024-09-21T01:51:59.975 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "warn_on_failed_host_check", 2024-09-21T01:51:59.975 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.975 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.975 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.975 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-21T01:51:59.975 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.976 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.976 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.976 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "raise a health warning if the host check fails", 2024-09-21T01:51:59.976 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.976 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.976 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.976 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.976 INFO:teuthology.orchestra.run.smithi083.stdout: "warn_on_stray_daemons": { 2024-09-21T01:51:59.976 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "warn_on_stray_daemons", 2024-09-21T01:51:59.976 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.976 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.976 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.976 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-21T01:51:59.976 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.976 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.977 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.977 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-21T01:51:59.977 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.977 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.977 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.977 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.977 INFO:teuthology.orchestra.run.smithi083.stdout: "warn_on_stray_hosts": { 2024-09-21T01:51:59.977 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "warn_on_stray_hosts", 2024-09-21T01:51:59.977 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.977 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.977 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.977 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-21T01:51:59.977 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.977 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.978 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.978 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-21T01:51:59.978 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.978 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.978 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.978 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:51:59.978 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:51:59.978 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.978 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-21T01:51:59.978 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "crash", 2024-09-21T01:51:59.978 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-21T01:51:59.978 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-21T01:51:59.978 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-21T01:51:59.978 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-21T01:51:59.979 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-21T01:51:59.979 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.979 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.979 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.979 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:51:59.979 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.979 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.979 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:51:59.979 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:51:59.979 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:51:59.979 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:51:59.979 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:51:59.979 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:51:59.979 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:51:59.980 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:51:59.980 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.980 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.980 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.980 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.980 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.980 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-21T01:51:59.980 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-21T01:51:59.980 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.980 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.980 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.980 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:51:59.980 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.980 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.981 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.981 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.981 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.981 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.981 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.981 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.981 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-21T01:51:59.981 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-21T01:51:59.981 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.981 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.981 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.981 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-21T01:51:59.981 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.981 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.982 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:51:59.982 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:51:59.982 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:51:59.982 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:51:59.982 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:51:59.982 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:51:59.982 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:51:59.982 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:51:59.982 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.982 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.982 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.982 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.982 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.982 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-21T01:51:59.982 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-21T01:51:59.983 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.983 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.983 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.983 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:51:59.983 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.983 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.983 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.983 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.983 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.983 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.983 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.983 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.983 INFO:teuthology.orchestra.run.smithi083.stdout: "retain_interval": { 2024-09-21T01:51:59.984 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "retain_interval", 2024-09-21T01:51:59.984 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-09-21T01:51:59.984 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.984 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.984 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "31536000", 2024-09-21T01:51:59.984 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.984 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.984 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.984 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-21T01:51:59.984 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.984 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.984 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.984 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.985 INFO:teuthology.orchestra.run.smithi083.stdout: "sqlite3_killpoint": { 2024-09-21T01:51:59.985 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:51:59.985 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:51:59.985 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "dev", 2024-09-21T01:51:59.985 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.985 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0", 2024-09-21T01:51:59.985 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.985 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.985 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.985 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.985 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.985 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.985 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.986 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.986 INFO:teuthology.orchestra.run.smithi083.stdout: "warn_recent_interval": { 2024-09-21T01:51:59.986 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "warn_recent_interval", 2024-09-21T01:51:59.986 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-09-21T01:51:59.986 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.986 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:51:59.986 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "1209600", 2024-09-21T01:51:59.986 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.986 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.986 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.986 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-21T01:51:59.986 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.986 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.987 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.987 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:51:59.987 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:51:59.987 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.987 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-21T01:51:59.987 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "dashboard", 2024-09-21T01:51:59.987 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-21T01:51:59.987 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-21T01:51:59.987 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-21T01:51:59.987 INFO:teuthology.orchestra.run.smithi083.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-21T01:51:59.987 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-21T01:51:59.987 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:51:59.987 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.987 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.988 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "10", 2024-09-21T01:51:59.988 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.988 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.988 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.988 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.988 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.988 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.988 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.988 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.988 INFO:teuthology.orchestra.run.smithi083.stdout: "ALERTMANAGER_API_HOST": { 2024-09-21T01:51:59.988 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-21T01:51:59.988 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:51:59.988 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.988 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.989 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:51:59.989 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.989 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.989 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.989 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.989 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.989 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.989 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.989 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.989 INFO:teuthology.orchestra.run.smithi083.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-21T01:51:59.989 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-21T01:51:59.989 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.989 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.989 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.990 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-21T01:51:59.990 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.990 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.990 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.990 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.990 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.990 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.990 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.990 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.990 INFO:teuthology.orchestra.run.smithi083.stdout: "AUDIT_API_ENABLED": { 2024-09-21T01:51:59.990 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "AUDIT_API_ENABLED", 2024-09-21T01:51:59.990 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.990 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.990 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.991 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:51:59.991 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.991 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.991 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.991 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.991 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.991 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.991 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.991 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.991 INFO:teuthology.orchestra.run.smithi083.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-21T01:51:59.991 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-21T01:51:59.991 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.991 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.991 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.992 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-21T01:51:59.992 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.992 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.992 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.992 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.992 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.992 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.992 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.992 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.992 INFO:teuthology.orchestra.run.smithi083.stdout: "ENABLE_BROWSABLE_API": { 2024-09-21T01:51:59.992 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-21T01:51:59.992 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.992 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.992 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.992 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-21T01:51:59.993 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.993 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.993 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.993 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.993 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.993 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.993 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.993 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.993 INFO:teuthology.orchestra.run.smithi083.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-21T01:51:59.993 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-21T01:51:59.993 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.993 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.993 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.994 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-21T01:51:59.994 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.994 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.994 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.994 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.994 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.994 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.994 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.994 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.994 INFO:teuthology.orchestra.run.smithi083.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-21T01:51:59.994 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-21T01:51:59.994 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.994 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.994 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.994 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-21T01:51:59.995 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.995 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.995 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.995 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.995 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.995 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.995 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.995 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.995 INFO:teuthology.orchestra.run.smithi083.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-21T01:51:59.995 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-21T01:51:59.995 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.995 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.995 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.995 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-21T01:51:59.996 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.996 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.996 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.996 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.996 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.996 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.996 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.996 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.996 INFO:teuthology.orchestra.run.smithi083.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-21T01:51:59.996 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-21T01:51:59.996 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.996 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.996 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.996 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-21T01:51:59.997 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.997 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.997 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.997 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.997 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.997 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.997 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.997 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.997 INFO:teuthology.orchestra.run.smithi083.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-21T01:51:59.997 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-21T01:51:59.997 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.997 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.997 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.997 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-21T01:51:59.998 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.998 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.998 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.998 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.998 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.998 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.998 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.998 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.998 INFO:teuthology.orchestra.run.smithi083.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-21T01:51:59.998 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-21T01:51:59.998 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.998 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.998 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.998 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-21T01:51:59.999 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:51:59.999 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:51:59.999 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:51:59.999 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:51:59.999 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:51:59.999 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:51:59.999 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:51:59.999 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:51:59.999 INFO:teuthology.orchestra.run.smithi083.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-21T01:51:59.999 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-21T01:51:59.999 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:51:59.999 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:51:59.999 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:51:59.999 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-21T01:52:00.000 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.000 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.000 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.000 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.000 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.000 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.000 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.000 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.000 INFO:teuthology.orchestra.run.smithi083.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-21T01:52:00.000 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-21T01:52:00.000 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.000 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.000 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.000 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:52:00.000 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.001 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.001 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.001 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.001 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.001 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.001 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.001 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.001 INFO:teuthology.orchestra.run.smithi083.stdout: "GRAFANA_API_PASSWORD": { 2024-09-21T01:52:00.001 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-21T01:52:00.001 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.001 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.001 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.001 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "admin", 2024-09-21T01:52:00.002 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.002 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.002 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.002 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.002 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.002 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.002 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.002 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.002 INFO:teuthology.orchestra.run.smithi083.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-21T01:52:00.002 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-21T01:52:00.002 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.002 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.002 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.002 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-21T01:52:00.002 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.003 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.003 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.003 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.003 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.003 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.003 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.003 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.003 INFO:teuthology.orchestra.run.smithi083.stdout: "GRAFANA_API_URL": { 2024-09-21T01:52:00.003 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "GRAFANA_API_URL", 2024-09-21T01:52:00.003 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.003 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.003 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.003 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:52:00.004 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.004 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.004 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.004 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.004 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.004 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.004 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.004 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.004 INFO:teuthology.orchestra.run.smithi083.stdout: "GRAFANA_API_USERNAME": { 2024-09-21T01:52:00.004 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-21T01:52:00.004 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.004 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.004 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.004 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "admin", 2024-09-21T01:52:00.004 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.005 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.005 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.005 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.005 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.005 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.005 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.005 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.005 INFO:teuthology.orchestra.run.smithi083.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-21T01:52:00.005 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-21T01:52:00.005 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.005 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.005 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.005 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:52:00.005 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.006 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.006 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.006 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.006 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.006 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.006 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.006 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.006 INFO:teuthology.orchestra.run.smithi083.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-21T01:52:00.006 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-21T01:52:00.006 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.006 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.006 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.006 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.006 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.006 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.007 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.007 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.007 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.007 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.007 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.007 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.007 INFO:teuthology.orchestra.run.smithi083.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-21T01:52:00.007 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-21T01:52:00.007 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.007 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.007 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.007 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-21T01:52:00.007 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.008 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.008 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.008 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.008 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.008 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.008 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.008 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.008 INFO:teuthology.orchestra.run.smithi083.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-21T01:52:00.008 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-21T01:52:00.008 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.008 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.008 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.008 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:52:00.008 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.008 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.009 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.009 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.009 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.009 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.009 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.009 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.009 INFO:teuthology.orchestra.run.smithi083.stdout: "MANAGED_BY_CLUSTERS": { 2024-09-21T01:52:00.009 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-09-21T01:52:00.009 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.009 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.009 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.009 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "[]", 2024-09-21T01:52:00.009 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.009 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.010 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.010 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.010 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.010 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.010 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.010 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.010 INFO:teuthology.orchestra.run.smithi083.stdout: "MULTICLUSTER_CONFIG": { 2024-09-21T01:52:00.010 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "MULTICLUSTER_CONFIG", 2024-09-21T01:52:00.010 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.010 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.010 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.010 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "{}", 2024-09-21T01:52:00.010 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.011 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.011 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.011 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.011 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.011 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.011 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.011 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.011 INFO:teuthology.orchestra.run.smithi083.stdout: "PROMETHEUS_API_HOST": { 2024-09-21T01:52:00.011 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-21T01:52:00.011 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.011 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.011 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.011 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:52:00.011 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.011 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.012 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.012 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.012 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.012 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.012 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.012 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.012 INFO:teuthology.orchestra.run.smithi083.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-21T01:52:00.012 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-21T01:52:00.012 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.012 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.012 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.012 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-21T01:52:00.012 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.012 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.013 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.013 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.013 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.013 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.013 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.013 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.013 INFO:teuthology.orchestra.run.smithi083.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-21T01:52:00.013 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-21T01:52:00.013 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.013 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.013 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.013 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.013 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.014 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.014 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.014 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.014 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.014 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.014 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.014 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.014 INFO:teuthology.orchestra.run.smithi083.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-21T01:52:00.014 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-21T01:52:00.014 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.014 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.014 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.014 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.015 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.015 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.015 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.015 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.015 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.015 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.015 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.015 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.015 INFO:teuthology.orchestra.run.smithi083.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-21T01:52:00.015 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-21T01:52:00.015 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.015 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.015 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.015 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-21T01:52:00.016 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.016 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.016 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.016 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.016 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.016 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.016 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.016 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.016 INFO:teuthology.orchestra.run.smithi083.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-21T01:52:00.016 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-21T01:52:00.016 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.016 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.016 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.016 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-21T01:52:00.016 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.017 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.017 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.017 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.017 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.017 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.017 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.017 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.017 INFO:teuthology.orchestra.run.smithi083.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-21T01:52:00.017 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-21T01:52:00.017 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.017 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.017 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.017 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.017 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.018 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.018 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.018 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.018 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.018 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.018 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.018 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.018 INFO:teuthology.orchestra.run.smithi083.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-21T01:52:00.018 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-21T01:52:00.018 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.018 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.018 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.018 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.018 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.019 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.019 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.019 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.019 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.019 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.019 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.019 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.019 INFO:teuthology.orchestra.run.smithi083.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-21T01:52:00.019 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-21T01:52:00.019 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.019 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.019 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.019 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.019 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.020 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.020 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.020 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.020 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.020 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.020 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.020 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.020 INFO:teuthology.orchestra.run.smithi083.stdout: "PWD_POLICY_ENABLED": { 2024-09-21T01:52:00.020 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-21T01:52:00.020 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.020 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.020 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.020 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-21T01:52:00.020 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.020 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.021 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.021 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.021 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.021 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.021 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.021 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.021 INFO:teuthology.orchestra.run.smithi083.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-21T01:52:00.021 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-21T01:52:00.021 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.021 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.021 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.021 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-21T01:52:00.021 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.021 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.021 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.022 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.022 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.022 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.022 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.022 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.022 INFO:teuthology.orchestra.run.smithi083.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-21T01:52:00.022 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-21T01:52:00.022 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:52:00.022 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.022 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.022 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "10", 2024-09-21T01:52:00.022 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.022 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.022 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.023 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.023 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.023 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.023 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.023 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.023 INFO:teuthology.orchestra.run.smithi083.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-21T01:52:00.023 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-21T01:52:00.023 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:52:00.023 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.023 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.023 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "8", 2024-09-21T01:52:00.023 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.023 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.024 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.024 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.024 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.024 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.024 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.024 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.024 INFO:teuthology.orchestra.run.smithi083.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-21T01:52:00.024 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-21T01:52:00.024 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:52:00.024 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.024 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.024 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "45", 2024-09-21T01:52:00.024 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.024 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.024 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.025 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.025 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.025 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.025 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.025 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.025 INFO:teuthology.orchestra.run.smithi083.stdout: "RGW_API_ACCESS_KEY": { 2024-09-21T01:52:00.025 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-21T01:52:00.025 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.025 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.025 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.025 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:52:00.025 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.025 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.025 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.026 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.026 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.026 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.026 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.026 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.026 INFO:teuthology.orchestra.run.smithi083.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-21T01:52:00.026 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-21T01:52:00.026 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.026 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.026 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.026 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "admin", 2024-09-21T01:52:00.026 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.026 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.026 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.027 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.027 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.027 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.027 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.027 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.027 INFO:teuthology.orchestra.run.smithi083.stdout: "RGW_API_SECRET_KEY": { 2024-09-21T01:52:00.027 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-21T01:52:00.027 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.027 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.027 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.027 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:52:00.027 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.027 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.027 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.027 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.028 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.028 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.028 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.028 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.028 INFO:teuthology.orchestra.run.smithi083.stdout: "RGW_API_SSL_VERIFY": { 2024-09-21T01:52:00.028 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-21T01:52:00.028 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.028 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.028 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.028 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-21T01:52:00.028 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.028 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.028 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.028 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.029 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.029 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.029 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.029 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.029 INFO:teuthology.orchestra.run.smithi083.stdout: "UNSAFE_TLS_v1_2": { 2024-09-21T01:52:00.029 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "UNSAFE_TLS_v1_2", 2024-09-21T01:52:00.029 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.029 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.029 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.029 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.029 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.029 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.029 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.029 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.029 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.030 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.030 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.030 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.030 INFO:teuthology.orchestra.run.smithi083.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-21T01:52:00.030 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-21T01:52:00.030 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:52:00.030 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.030 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.030 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0", 2024-09-21T01:52:00.030 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.030 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.030 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.030 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.030 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.031 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.031 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.031 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.031 INFO:teuthology.orchestra.run.smithi083.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-21T01:52:00.031 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-21T01:52:00.031 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:52:00.031 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.031 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.031 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "10", 2024-09-21T01:52:00.031 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.031 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.031 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.031 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.031 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.031 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.032 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.032 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.032 INFO:teuthology.orchestra.run.smithi083.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-21T01:52:00.032 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-21T01:52:00.032 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:52:00.032 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.032 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.032 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "5", 2024-09-21T01:52:00.032 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.032 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.032 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.032 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.032 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.032 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.032 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.033 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.033 INFO:teuthology.orchestra.run.smithi083.stdout: "cross_origin_url": { 2024-09-21T01:52:00.033 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "cross_origin_url", 2024-09-21T01:52:00.033 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.033 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.033 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.033 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:52:00.033 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.033 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.033 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.033 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.033 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.033 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.033 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.034 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.034 INFO:teuthology.orchestra.run.smithi083.stdout: "crt_file": { 2024-09-21T01:52:00.034 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "crt_file", 2024-09-21T01:52:00.034 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.034 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.034 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.034 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:52:00.034 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.034 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.034 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.034 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.034 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.034 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.034 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.035 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.035 INFO:teuthology.orchestra.run.smithi083.stdout: "debug": { 2024-09-21T01:52:00.035 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "debug", 2024-09-21T01:52:00.035 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.035 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.035 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.035 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.035 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.035 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.035 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.035 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Enable/disable debug options", 2024-09-21T01:52:00.035 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.035 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.035 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.035 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.036 INFO:teuthology.orchestra.run.smithi083.stdout: "jwt_token_ttl": { 2024-09-21T01:52:00.036 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "jwt_token_ttl", 2024-09-21T01:52:00.036 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:52:00.036 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.036 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.036 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "28800", 2024-09-21T01:52:00.036 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.036 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.036 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.036 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.036 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.036 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.036 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.036 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.037 INFO:teuthology.orchestra.run.smithi083.stdout: "key_file": { 2024-09-21T01:52:00.037 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "key_file", 2024-09-21T01:52:00.037 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.037 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.037 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.037 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:52:00.037 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.037 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.037 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.037 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.037 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.037 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.037 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.037 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.038 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-21T01:52:00.038 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-21T01:52:00.038 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.038 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.038 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.038 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:52:00.038 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.038 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.038 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:52:00.038 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:52:00.038 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:52:00.038 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:52:00.038 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:52:00.038 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:52:00.039 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:52:00.039 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:52:00.039 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.039 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.039 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.039 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.039 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.039 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-21T01:52:00.039 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-21T01:52:00.039 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.039 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.039 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.039 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.039 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.039 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.040 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.040 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.040 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.040 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.040 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.040 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.040 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-21T01:52:00.040 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-21T01:52:00.040 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.040 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.040 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.040 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-21T01:52:00.040 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.040 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.041 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:52:00.041 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:52:00.041 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:52:00.041 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:52:00.041 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:52:00.041 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:52:00.041 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:52:00.041 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:52:00.041 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.041 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.041 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.041 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.041 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.041 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-21T01:52:00.041 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-21T01:52:00.042 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.042 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.042 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.042 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.042 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.042 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.042 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.042 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.042 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.042 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.042 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.042 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.042 INFO:teuthology.orchestra.run.smithi083.stdout: "motd": { 2024-09-21T01:52:00.042 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "motd", 2024-09-21T01:52:00.043 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.043 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.043 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.043 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:52:00.043 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.043 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.043 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.043 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "The message of the day", 2024-09-21T01:52:00.043 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.043 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.043 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.043 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.043 INFO:teuthology.orchestra.run.smithi083.stdout: "redirect_resolve_ip_addr": { 2024-09-21T01:52:00.043 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "redirect_resolve_ip_addr", 2024-09-21T01:52:00.043 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.044 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.044 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.044 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.044 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.044 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.044 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.044 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.044 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.044 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.044 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.044 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.044 INFO:teuthology.orchestra.run.smithi083.stdout: "server_addr": { 2024-09-21T01:52:00.044 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "server_addr", 2024-09-21T01:52:00.044 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.045 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.045 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.045 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "::", 2024-09-21T01:52:00.045 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.045 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.045 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.045 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.045 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.045 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.045 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.045 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.045 INFO:teuthology.orchestra.run.smithi083.stdout: "server_port": { 2024-09-21T01:52:00.045 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "server_port", 2024-09-21T01:52:00.045 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:52:00.045 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.046 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.046 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "8080", 2024-09-21T01:52:00.046 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.046 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.046 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.046 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.046 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.046 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.046 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.046 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.046 INFO:teuthology.orchestra.run.smithi083.stdout: "sqlite3_killpoint": { 2024-09-21T01:52:00.046 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:52:00.046 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:52:00.046 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "dev", 2024-09-21T01:52:00.047 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.047 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0", 2024-09-21T01:52:00.047 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.047 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.047 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.047 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.047 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.047 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.047 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.047 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.047 INFO:teuthology.orchestra.run.smithi083.stdout: "ssl": { 2024-09-21T01:52:00.047 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "ssl", 2024-09-21T01:52:00.047 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.047 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.047 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.048 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-21T01:52:00.048 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.048 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.049 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.049 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.049 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.049 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.049 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.049 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.050 INFO:teuthology.orchestra.run.smithi083.stdout: "ssl_server_port": { 2024-09-21T01:52:00.050 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "ssl_server_port", 2024-09-21T01:52:00.050 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:52:00.050 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.050 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.050 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "8443", 2024-09-21T01:52:00.050 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.050 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.050 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.050 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.050 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.050 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.050 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.050 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.051 INFO:teuthology.orchestra.run.smithi083.stdout: "sso_oauth2": { 2024-09-21T01:52:00.051 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "sso_oauth2", 2024-09-21T01:52:00.051 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.051 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.051 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.051 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.051 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.051 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.051 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.051 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.052 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.052 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.052 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.052 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.052 INFO:teuthology.orchestra.run.smithi083.stdout: "standby_behaviour": { 2024-09-21T01:52:00.052 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "standby_behaviour", 2024-09-21T01:52:00.052 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.052 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.052 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.052 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "redirect", 2024-09-21T01:52:00.052 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.052 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.052 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:52:00.052 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:52:00.053 INFO:teuthology.orchestra.run.smithi083.stdout: "redirect" 2024-09-21T01:52:00.053 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:52:00.053 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.053 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.053 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.053 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.053 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.053 INFO:teuthology.orchestra.run.smithi083.stdout: "standby_error_status_code": { 2024-09-21T01:52:00.053 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "standby_error_status_code", 2024-09-21T01:52:00.053 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:52:00.053 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.053 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.053 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "500", 2024-09-21T01:52:00.053 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "400", 2024-09-21T01:52:00.054 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "599", 2024-09-21T01:52:00.054 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.054 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.054 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.054 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.054 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.054 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.054 INFO:teuthology.orchestra.run.smithi083.stdout: "url_prefix": { 2024-09-21T01:52:00.054 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "url_prefix", 2024-09-21T01:52:00.054 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.054 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.054 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.054 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:52:00.054 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.055 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.055 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.055 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.055 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.055 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.055 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.055 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:52:00.055 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:52:00.055 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.055 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-21T01:52:00.055 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "devicehealth", 2024-09-21T01:52:00.055 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-21T01:52:00.055 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-21T01:52:00.056 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-21T01:52:00.056 INFO:teuthology.orchestra.run.smithi083.stdout: "enable_monitoring": { 2024-09-21T01:52:00.056 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "enable_monitoring", 2024-09-21T01:52:00.056 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.056 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.056 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.056 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-21T01:52:00.056 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.056 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.056 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.056 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "monitor device health metrics", 2024-09-21T01:52:00.057 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.057 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.057 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.057 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.057 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-21T01:52:00.057 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-21T01:52:00.057 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.057 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.057 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.057 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:52:00.057 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.057 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.057 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:52:00.058 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:52:00.058 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:52:00.058 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:52:00.058 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:52:00.058 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:52:00.058 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:52:00.058 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:52:00.058 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.058 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.058 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.059 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.059 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.059 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-21T01:52:00.059 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-21T01:52:00.059 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.059 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.059 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.059 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.059 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.059 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.059 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.059 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.059 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.060 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.060 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.060 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.060 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-21T01:52:00.060 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-21T01:52:00.060 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.060 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.060 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.060 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-21T01:52:00.060 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.060 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.061 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:52:00.061 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:52:00.061 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:52:00.061 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:52:00.061 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:52:00.061 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:52:00.061 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:52:00.061 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:52:00.061 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.061 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.061 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.061 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.062 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.062 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-21T01:52:00.062 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-21T01:52:00.062 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.062 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.062 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.062 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.062 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.062 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.062 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.062 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.063 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.063 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.063 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.063 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.063 INFO:teuthology.orchestra.run.smithi083.stdout: "mark_out_threshold": { 2024-09-21T01:52:00.063 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "mark_out_threshold", 2024-09-21T01:52:00.063 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-09-21T01:52:00.063 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.063 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.063 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "2419200", 2024-09-21T01:52:00.063 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.064 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.064 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.064 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-21T01:52:00.064 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.064 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.064 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.064 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.064 INFO:teuthology.orchestra.run.smithi083.stdout: "pool_name": { 2024-09-21T01:52:00.064 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "pool_name", 2024-09-21T01:52:00.064 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.064 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.064 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.064 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "device_health_metrics", 2024-09-21T01:52:00.065 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.065 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.065 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.065 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-21T01:52:00.065 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.065 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.065 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.065 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.065 INFO:teuthology.orchestra.run.smithi083.stdout: "retention_period": { 2024-09-21T01:52:00.065 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "retention_period", 2024-09-21T01:52:00.066 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-09-21T01:52:00.066 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.066 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.066 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "15552000", 2024-09-21T01:52:00.066 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.066 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.066 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.066 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "how long to retain device health metrics", 2024-09-21T01:52:00.066 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.066 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.067 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.067 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.067 INFO:teuthology.orchestra.run.smithi083.stdout: "scrape_frequency": { 2024-09-21T01:52:00.067 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "scrape_frequency", 2024-09-21T01:52:00.067 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-09-21T01:52:00.067 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.067 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.067 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "86400", 2024-09-21T01:52:00.067 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.067 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.068 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.068 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-21T01:52:00.068 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.068 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.068 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.068 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.068 INFO:teuthology.orchestra.run.smithi083.stdout: "self_heal": { 2024-09-21T01:52:00.068 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "self_heal", 2024-09-21T01:52:00.068 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.068 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.068 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.068 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-21T01:52:00.068 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.069 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.069 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.069 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-21T01:52:00.069 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.069 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.069 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.069 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.069 INFO:teuthology.orchestra.run.smithi083.stdout: "sleep_interval": { 2024-09-21T01:52:00.069 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "sleep_interval", 2024-09-21T01:52:00.069 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-09-21T01:52:00.069 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.069 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.069 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "600", 2024-09-21T01:52:00.069 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.069 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.070 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.070 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "how frequently to wake up and check device health", 2024-09-21T01:52:00.070 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.070 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.070 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.070 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.070 INFO:teuthology.orchestra.run.smithi083.stdout: "sqlite3_killpoint": { 2024-09-21T01:52:00.070 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:52:00.070 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:52:00.070 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "dev", 2024-09-21T01:52:00.070 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.070 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0", 2024-09-21T01:52:00.070 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.070 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.071 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.071 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.071 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.071 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.071 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.071 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.071 INFO:teuthology.orchestra.run.smithi083.stdout: "warn_threshold": { 2024-09-21T01:52:00.071 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "warn_threshold", 2024-09-21T01:52:00.071 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-09-21T01:52:00.071 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.071 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.071 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "7257600", 2024-09-21T01:52:00.071 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.071 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.072 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.072 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-21T01:52:00.072 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.072 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.072 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.072 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:52:00.072 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:52:00.072 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.072 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-21T01:52:00.072 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "diskprediction_local", 2024-09-21T01:52:00.072 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-21T01:52:00.072 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-21T01:52:00.072 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-21T01:52:00.072 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-21T01:52:00.072 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-21T01:52:00.072 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.073 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.073 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.073 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:52:00.073 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.073 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.073 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:52:00.073 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:52:00.073 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:52:00.073 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:52:00.073 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:52:00.073 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:52:00.073 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:52:00.073 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:52:00.073 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.073 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.073 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.074 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.074 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.074 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-21T01:52:00.074 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-21T01:52:00.074 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.074 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.074 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.074 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.074 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.074 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.074 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.074 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.074 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.074 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.075 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.075 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.075 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-21T01:52:00.075 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-21T01:52:00.075 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.075 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.075 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.075 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-21T01:52:00.075 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.075 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.075 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:52:00.075 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:52:00.075 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:52:00.075 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:52:00.075 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:52:00.076 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:52:00.076 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:52:00.076 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:52:00.076 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.076 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.076 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.076 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.076 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.076 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-21T01:52:00.076 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-21T01:52:00.076 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.076 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.076 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.076 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.076 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.077 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.077 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.077 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.077 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.077 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.077 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.077 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.077 INFO:teuthology.orchestra.run.smithi083.stdout: "predict_interval": { 2024-09-21T01:52:00.077 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "predict_interval", 2024-09-21T01:52:00.077 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.077 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.077 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.077 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "86400", 2024-09-21T01:52:00.077 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.077 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.078 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.078 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.078 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.078 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.078 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.078 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.078 INFO:teuthology.orchestra.run.smithi083.stdout: "predictor_model": { 2024-09-21T01:52:00.078 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "predictor_model", 2024-09-21T01:52:00.078 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.078 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.078 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.078 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "prophetstor", 2024-09-21T01:52:00.078 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.078 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.078 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.079 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.079 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.079 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.079 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.079 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.079 INFO:teuthology.orchestra.run.smithi083.stdout: "sleep_interval": { 2024-09-21T01:52:00.079 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "sleep_interval", 2024-09-21T01:52:00.079 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.079 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.079 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.079 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "600", 2024-09-21T01:52:00.079 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.079 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.079 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.079 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.080 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.080 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.080 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.080 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.080 INFO:teuthology.orchestra.run.smithi083.stdout: "sqlite3_killpoint": { 2024-09-21T01:52:00.080 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:52:00.080 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:52:00.080 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "dev", 2024-09-21T01:52:00.080 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.080 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0", 2024-09-21T01:52:00.080 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.080 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.080 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.080 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.081 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.081 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.081 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.081 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:52:00.081 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:52:00.081 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.081 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-21T01:52:00.081 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "influx", 2024-09-21T01:52:00.081 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": false, 2024-09-21T01:52:00.081 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "influxdb python module not found", 2024-09-21T01:52:00.081 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-21T01:52:00.081 INFO:teuthology.orchestra.run.smithi083.stdout: "batch_size": { 2024-09-21T01:52:00.082 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "batch_size", 2024-09-21T01:52:00.082 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:52:00.082 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.082 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.082 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "5000", 2024-09-21T01:52:00.082 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.082 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.082 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.082 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-21T01:52:00.082 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.082 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.082 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.082 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.083 INFO:teuthology.orchestra.run.smithi083.stdout: "database": { 2024-09-21T01:52:00.083 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "database", 2024-09-21T01:52:00.083 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.083 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.083 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.083 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "ceph", 2024-09-21T01:52:00.083 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.083 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.083 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.083 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-21T01:52:00.083 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.083 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.084 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.084 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.084 INFO:teuthology.orchestra.run.smithi083.stdout: "hostname": { 2024-09-21T01:52:00.084 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "hostname", 2024-09-21T01:52:00.084 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.084 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.084 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.084 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:52:00.084 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.084 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.084 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.084 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "InfluxDB server hostname", 2024-09-21T01:52:00.084 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.085 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.085 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.085 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.085 INFO:teuthology.orchestra.run.smithi083.stdout: "interval": { 2024-09-21T01:52:00.085 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "interval", 2024-09-21T01:52:00.085 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-09-21T01:52:00.085 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.085 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.085 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "30", 2024-09-21T01:52:00.085 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "5", 2024-09-21T01:52:00.085 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.085 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.085 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-21T01:52:00.085 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.085 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.086 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.086 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.086 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-21T01:52:00.086 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-21T01:52:00.086 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.086 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.086 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.086 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:52:00.086 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.086 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.086 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:52:00.086 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:52:00.086 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:52:00.087 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:52:00.087 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:52:00.087 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:52:00.087 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:52:00.087 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:52:00.087 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.087 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.087 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.087 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.087 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.087 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-21T01:52:00.087 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-21T01:52:00.087 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.088 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.088 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.088 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.088 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.088 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.088 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.088 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.088 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.088 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.088 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.088 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.088 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-21T01:52:00.088 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-21T01:52:00.088 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.088 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.089 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.089 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-21T01:52:00.089 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.089 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.089 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:52:00.089 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:52:00.089 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:52:00.089 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:52:00.089 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:52:00.089 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:52:00.089 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:52:00.089 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:52:00.089 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.089 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.090 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.090 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.090 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.090 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-21T01:52:00.090 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-21T01:52:00.090 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.090 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.090 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.090 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.090 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.091 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.091 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.091 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.091 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.091 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.091 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.091 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.091 INFO:teuthology.orchestra.run.smithi083.stdout: "password": { 2024-09-21T01:52:00.091 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "password", 2024-09-21T01:52:00.091 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.091 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.091 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.091 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:52:00.091 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.091 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.092 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.092 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "password of InfluxDB server user", 2024-09-21T01:52:00.092 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.092 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.092 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.092 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.092 INFO:teuthology.orchestra.run.smithi083.stdout: "port": { 2024-09-21T01:52:00.092 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "port", 2024-09-21T01:52:00.092 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:52:00.092 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.093 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.093 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "8086", 2024-09-21T01:52:00.093 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.093 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.093 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.093 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "InfluxDB server port", 2024-09-21T01:52:00.093 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.093 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.093 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.093 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.093 INFO:teuthology.orchestra.run.smithi083.stdout: "sqlite3_killpoint": { 2024-09-21T01:52:00.093 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:52:00.093 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:52:00.093 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "dev", 2024-09-21T01:52:00.094 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.094 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0", 2024-09-21T01:52:00.094 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.094 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.094 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.094 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.094 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.094 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.094 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.094 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.095 INFO:teuthology.orchestra.run.smithi083.stdout: "ssl": { 2024-09-21T01:52:00.095 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "ssl", 2024-09-21T01:52:00.095 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.095 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.095 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.095 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "false", 2024-09-21T01:52:00.095 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.095 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.095 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.095 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-21T01:52:00.095 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.095 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.095 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.096 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.096 INFO:teuthology.orchestra.run.smithi083.stdout: "threads": { 2024-09-21T01:52:00.096 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "threads", 2024-09-21T01:52:00.096 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:52:00.096 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.096 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.096 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "5", 2024-09-21T01:52:00.096 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "1", 2024-09-21T01:52:00.096 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "32", 2024-09-21T01:52:00.096 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.096 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-21T01:52:00.096 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.097 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.097 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.097 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.097 INFO:teuthology.orchestra.run.smithi083.stdout: "username": { 2024-09-21T01:52:00.097 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "username", 2024-09-21T01:52:00.097 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.097 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.097 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.097 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:52:00.097 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.097 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.097 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.098 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "username of InfluxDB server user", 2024-09-21T01:52:00.098 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.098 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.098 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.098 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.098 INFO:teuthology.orchestra.run.smithi083.stdout: "verify_ssl": { 2024-09-21T01:52:00.098 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "verify_ssl", 2024-09-21T01:52:00.098 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.098 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.098 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.098 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "true", 2024-09-21T01:52:00.099 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.099 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.099 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.099 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-21T01:52:00.099 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.099 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.099 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.099 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:52:00.099 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:52:00.099 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.100 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-21T01:52:00.100 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "insights", 2024-09-21T01:52:00.100 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-21T01:52:00.100 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-21T01:52:00.100 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-21T01:52:00.100 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-21T01:52:00.100 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-21T01:52:00.100 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.100 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.100 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.100 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:52:00.101 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.101 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.101 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:52:00.101 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:52:00.101 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:52:00.101 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:52:00.101 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:52:00.101 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:52:00.101 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:52:00.101 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:52:00.102 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.102 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.102 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.102 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.102 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.102 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-21T01:52:00.102 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-21T01:52:00.102 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.102 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.102 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.102 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.102 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.103 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.103 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.103 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.103 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.103 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.103 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.103 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.103 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-21T01:52:00.103 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-21T01:52:00.103 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.103 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.103 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.103 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-21T01:52:00.103 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.103 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.104 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:52:00.104 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:52:00.104 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:52:00.104 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:52:00.104 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:52:00.104 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:52:00.104 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:52:00.104 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:52:00.104 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.104 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.104 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.104 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.104 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.104 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-21T01:52:00.104 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-21T01:52:00.105 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.105 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.105 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.105 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.105 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.105 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.105 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.105 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.105 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.105 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.105 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.105 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.105 INFO:teuthology.orchestra.run.smithi083.stdout: "sqlite3_killpoint": { 2024-09-21T01:52:00.105 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:52:00.106 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:52:00.106 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "dev", 2024-09-21T01:52:00.106 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.106 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0", 2024-09-21T01:52:00.106 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.106 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.106 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.106 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.106 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.106 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.106 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.106 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:52:00.106 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:52:00.106 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.107 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-21T01:52:00.107 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "iostat", 2024-09-21T01:52:00.107 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-21T01:52:00.107 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-21T01:52:00.107 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-21T01:52:00.107 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-21T01:52:00.107 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-21T01:52:00.107 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.107 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.107 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.107 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:52:00.107 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.107 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.107 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:52:00.108 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:52:00.108 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:52:00.108 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:52:00.108 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:52:00.108 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:52:00.108 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:52:00.108 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:52:00.108 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.108 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.108 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.108 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.108 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.108 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-21T01:52:00.108 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-21T01:52:00.108 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.109 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.109 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.109 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.109 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.109 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.109 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.109 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.109 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.109 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.109 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.109 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.109 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-21T01:52:00.109 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-21T01:52:00.109 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.110 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.110 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.110 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-21T01:52:00.110 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.110 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.110 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:52:00.110 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:52:00.110 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:52:00.110 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:52:00.110 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:52:00.110 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:52:00.110 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:52:00.110 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:52:00.110 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.111 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.111 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.111 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.111 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.111 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-21T01:52:00.111 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-21T01:52:00.111 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.111 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.111 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.111 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.111 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.111 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.111 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.111 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.112 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.112 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.112 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.112 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.112 INFO:teuthology.orchestra.run.smithi083.stdout: "sqlite3_killpoint": { 2024-09-21T01:52:00.112 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:52:00.112 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:52:00.112 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "dev", 2024-09-21T01:52:00.112 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.112 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0", 2024-09-21T01:52:00.112 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.112 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.112 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.112 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.113 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.113 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.113 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.113 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:52:00.113 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:52:00.113 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.113 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-21T01:52:00.113 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "k8sevents", 2024-09-21T01:52:00.113 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-21T01:52:00.113 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-21T01:52:00.113 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-21T01:52:00.113 INFO:teuthology.orchestra.run.smithi083.stdout: "ceph_event_retention_days": { 2024-09-21T01:52:00.113 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "ceph_event_retention_days", 2024-09-21T01:52:00.113 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:52:00.114 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.114 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.114 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "7", 2024-09-21T01:52:00.114 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.114 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.114 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.114 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-21T01:52:00.114 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.114 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.114 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.114 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.114 INFO:teuthology.orchestra.run.smithi083.stdout: "config_check_secs": { 2024-09-21T01:52:00.114 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "config_check_secs", 2024-09-21T01:52:00.114 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:52:00.114 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.115 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.115 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "10", 2024-09-21T01:52:00.115 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "10", 2024-09-21T01:52:00.115 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.115 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.115 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-21T01:52:00.115 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.115 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.115 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.115 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.115 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-21T01:52:00.115 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-21T01:52:00.115 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.115 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.115 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.116 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:52:00.116 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.116 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.116 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:52:00.116 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:52:00.116 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:52:00.116 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:52:00.116 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:52:00.116 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:52:00.116 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:52:00.116 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:52:00.116 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.116 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.116 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.116 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.117 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.117 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-21T01:52:00.117 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-21T01:52:00.117 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.117 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.117 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.117 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.117 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.117 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.117 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.117 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.117 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.117 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.117 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.117 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.118 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-21T01:52:00.118 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-21T01:52:00.118 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.118 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.118 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.118 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-21T01:52:00.118 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.118 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.118 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:52:00.118 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:52:00.118 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:52:00.118 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:52:00.118 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:52:00.118 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:52:00.118 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:52:00.119 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:52:00.119 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.119 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.119 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.119 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.119 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.119 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-21T01:52:00.119 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-21T01:52:00.119 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.119 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.119 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.119 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.119 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.119 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.120 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.120 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.120 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.120 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.120 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.120 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.120 INFO:teuthology.orchestra.run.smithi083.stdout: "sqlite3_killpoint": { 2024-09-21T01:52:00.120 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:52:00.120 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:52:00.120 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "dev", 2024-09-21T01:52:00.120 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.120 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0", 2024-09-21T01:52:00.120 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.120 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.121 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.121 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.121 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.121 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.121 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.121 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:52:00.121 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:52:00.121 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.121 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-21T01:52:00.121 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "localpool", 2024-09-21T01:52:00.121 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-21T01:52:00.121 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-21T01:52:00.121 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-21T01:52:00.121 INFO:teuthology.orchestra.run.smithi083.stdout: "failure_domain": { 2024-09-21T01:52:00.122 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "failure_domain", 2024-09-21T01:52:00.122 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.122 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.122 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.122 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "host", 2024-09-21T01:52:00.122 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.122 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.122 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.122 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "failure domain for any created local pool", 2024-09-21T01:52:00.122 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-21T01:52:00.123 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.123 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.123 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.123 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-21T01:52:00.123 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-21T01:52:00.123 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.123 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.123 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.123 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:52:00.123 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.123 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.123 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:52:00.123 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:52:00.123 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:52:00.124 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:52:00.124 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:52:00.124 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:52:00.124 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:52:00.124 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:52:00.124 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.124 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.124 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.124 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.125 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.125 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-21T01:52:00.125 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-21T01:52:00.125 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.125 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.125 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.125 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.125 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.125 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.125 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.125 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.125 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.125 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.126 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.126 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.126 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-21T01:52:00.126 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-21T01:52:00.126 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.126 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.126 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.126 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-21T01:52:00.126 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.126 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.127 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:52:00.127 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:52:00.127 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:52:00.127 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:52:00.127 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:52:00.127 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:52:00.127 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:52:00.127 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:52:00.127 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.127 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.127 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.127 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.127 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.128 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-21T01:52:00.128 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-21T01:52:00.128 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.128 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.128 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.128 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.128 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.128 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.128 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.128 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.129 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.129 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.129 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.129 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.129 INFO:teuthology.orchestra.run.smithi083.stdout: "min_size": { 2024-09-21T01:52:00.129 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "min_size", 2024-09-21T01:52:00.129 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:52:00.129 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.129 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.129 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:52:00.130 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.130 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.130 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.130 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "default min_size for any created local pool", 2024-09-21T01:52:00.130 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-21T01:52:00.130 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.130 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.130 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.130 INFO:teuthology.orchestra.run.smithi083.stdout: "num_rep": { 2024-09-21T01:52:00.130 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "num_rep", 2024-09-21T01:52:00.130 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:52:00.130 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.131 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.131 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "3", 2024-09-21T01:52:00.131 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.131 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.131 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.131 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "default replica count for any created local pool", 2024-09-21T01:52:00.131 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.131 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.131 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.131 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.131 INFO:teuthology.orchestra.run.smithi083.stdout: "pg_num": { 2024-09-21T01:52:00.132 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "pg_num", 2024-09-21T01:52:00.132 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:52:00.132 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.132 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.132 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "128", 2024-09-21T01:52:00.132 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.132 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.132 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.132 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "default pg_num for any created local pool", 2024-09-21T01:52:00.132 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.132 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.133 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.133 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.133 INFO:teuthology.orchestra.run.smithi083.stdout: "prefix": { 2024-09-21T01:52:00.133 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "prefix", 2024-09-21T01:52:00.133 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.133 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.133 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.133 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:52:00.133 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.133 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.134 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.134 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "name prefix for any created local pool", 2024-09-21T01:52:00.134 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.134 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.134 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.134 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.134 INFO:teuthology.orchestra.run.smithi083.stdout: "sqlite3_killpoint": { 2024-09-21T01:52:00.134 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:52:00.134 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:52:00.134 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "dev", 2024-09-21T01:52:00.134 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.134 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0", 2024-09-21T01:52:00.135 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.135 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.135 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.135 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.135 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.135 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.135 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.135 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.135 INFO:teuthology.orchestra.run.smithi083.stdout: "subtree": { 2024-09-21T01:52:00.135 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "subtree", 2024-09-21T01:52:00.135 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.135 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.135 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.135 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "rack", 2024-09-21T01:52:00.136 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.136 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.136 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.136 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-21T01:52:00.136 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-21T01:52:00.136 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.136 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.136 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:52:00.136 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:52:00.136 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.136 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-21T01:52:00.136 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "mds_autoscaler", 2024-09-21T01:52:00.136 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-21T01:52:00.136 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-21T01:52:00.137 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-21T01:52:00.137 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-21T01:52:00.137 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-21T01:52:00.137 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.137 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.137 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.137 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:52:00.137 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.137 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.137 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:52:00.137 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:52:00.137 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:52:00.137 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:52:00.137 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:52:00.137 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:52:00.138 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:52:00.138 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:52:00.138 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.138 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.138 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.138 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.138 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.138 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-21T01:52:00.138 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-21T01:52:00.138 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.138 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.138 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.138 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.138 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.139 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.139 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.139 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.139 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.139 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.139 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.139 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.139 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-21T01:52:00.139 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-21T01:52:00.139 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.139 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.139 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.139 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-21T01:52:00.139 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.140 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.140 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:52:00.140 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:52:00.140 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:52:00.140 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:52:00.140 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:52:00.140 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:52:00.140 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:52:00.140 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:52:00.140 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.140 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.140 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.140 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.140 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.140 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-21T01:52:00.141 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-21T01:52:00.141 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.141 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.141 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.141 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.141 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.141 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.141 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.141 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.141 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.141 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.141 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.141 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.141 INFO:teuthology.orchestra.run.smithi083.stdout: "sqlite3_killpoint": { 2024-09-21T01:52:00.142 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:52:00.142 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:52:00.142 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "dev", 2024-09-21T01:52:00.142 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.142 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0", 2024-09-21T01:52:00.142 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.142 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.142 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.142 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.142 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.142 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.142 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.142 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:52:00.142 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:52:00.142 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.143 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-21T01:52:00.143 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "mirroring", 2024-09-21T01:52:00.143 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-21T01:52:00.143 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-21T01:52:00.143 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-21T01:52:00.143 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-21T01:52:00.143 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-21T01:52:00.143 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.143 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.143 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.143 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:52:00.143 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.143 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.143 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:52:00.144 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:52:00.144 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:52:00.144 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:52:00.144 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:52:00.144 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:52:00.144 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:52:00.144 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:52:00.144 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.144 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.144 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.144 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.144 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.144 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-21T01:52:00.144 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-21T01:52:00.144 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.145 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.145 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.145 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.145 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.145 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.145 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.145 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.145 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.145 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.145 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.145 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.145 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-21T01:52:00.145 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-21T01:52:00.145 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.145 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.146 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.146 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-21T01:52:00.146 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.146 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.146 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:52:00.146 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:52:00.146 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:52:00.146 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:52:00.146 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:52:00.146 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:52:00.146 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:52:00.146 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:52:00.146 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.146 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.146 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.147 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.147 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.147 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-21T01:52:00.147 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-21T01:52:00.147 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.147 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.147 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.147 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.147 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.147 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.147 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.147 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.147 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.147 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.147 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.148 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.148 INFO:teuthology.orchestra.run.smithi083.stdout: "sqlite3_killpoint": { 2024-09-21T01:52:00.148 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:52:00.148 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:52:00.148 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "dev", 2024-09-21T01:52:00.148 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.148 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0", 2024-09-21T01:52:00.148 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.148 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.148 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.148 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.148 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.148 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.148 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.148 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:52:00.149 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:52:00.149 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.149 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-21T01:52:00.149 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "nfs", 2024-09-21T01:52:00.149 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-21T01:52:00.149 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-21T01:52:00.149 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-21T01:52:00.149 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-21T01:52:00.149 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-21T01:52:00.149 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.149 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.149 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.149 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:52:00.149 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.149 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.150 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:52:00.150 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:52:00.150 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:52:00.150 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:52:00.150 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:52:00.150 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:52:00.150 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:52:00.150 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:52:00.150 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.150 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.150 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.150 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.150 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.150 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-21T01:52:00.151 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-21T01:52:00.151 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.151 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.151 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.151 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.151 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.151 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.151 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.151 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.151 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.151 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.151 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.151 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.151 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-21T01:52:00.151 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-21T01:52:00.152 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.152 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.152 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.152 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-21T01:52:00.152 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.152 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.152 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:52:00.152 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:52:00.152 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:52:00.152 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:52:00.152 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:52:00.152 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:52:00.152 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:52:00.153 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:52:00.153 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.153 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.153 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.153 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.153 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.153 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-21T01:52:00.153 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-21T01:52:00.153 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.153 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.153 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.153 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.153 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.153 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.154 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.154 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.154 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.154 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.154 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.154 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.154 INFO:teuthology.orchestra.run.smithi083.stdout: "sqlite3_killpoint": { 2024-09-21T01:52:00.154 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:52:00.154 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:52:00.155 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "dev", 2024-09-21T01:52:00.155 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.155 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0", 2024-09-21T01:52:00.155 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.155 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.155 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.155 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.155 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.155 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.155 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.155 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:52:00.155 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:52:00.155 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.155 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-21T01:52:00.155 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "orchestrator", 2024-09-21T01:52:00.156 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-21T01:52:00.156 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-21T01:52:00.156 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-21T01:52:00.156 INFO:teuthology.orchestra.run.smithi083.stdout: "fail_fs": { 2024-09-21T01:52:00.156 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "fail_fs", 2024-09-21T01:52:00.156 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.156 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.156 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.156 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.156 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.157 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.157 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.157 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-21T01:52:00.157 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.157 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.157 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.157 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.157 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-21T01:52:00.157 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-21T01:52:00.157 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.157 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.157 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.157 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:52:00.157 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.158 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.158 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:52:00.158 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:52:00.158 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:52:00.158 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:52:00.158 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:52:00.158 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:52:00.158 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:52:00.158 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:52:00.158 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.158 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.158 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.158 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.158 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.159 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-21T01:52:00.159 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-21T01:52:00.159 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.159 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.159 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.159 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.159 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.159 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.159 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.159 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.159 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.159 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.159 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.159 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.160 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-21T01:52:00.160 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-21T01:52:00.160 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.160 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.160 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.160 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-21T01:52:00.160 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.160 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.160 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:52:00.160 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:52:00.160 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:52:00.160 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:52:00.160 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:52:00.160 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:52:00.161 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:52:00.161 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:52:00.161 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.161 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.161 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.161 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.161 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.161 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-21T01:52:00.161 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-21T01:52:00.161 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.161 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.162 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.162 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.162 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.162 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.162 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.162 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.162 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.162 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.162 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.162 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.162 INFO:teuthology.orchestra.run.smithi083.stdout: "orchestrator": { 2024-09-21T01:52:00.163 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "orchestrator", 2024-09-21T01:52:00.163 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.163 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.163 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.163 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:52:00.163 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.163 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.163 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:52:00.163 INFO:teuthology.orchestra.run.smithi083.stdout: "cephadm", 2024-09-21T01:52:00.163 INFO:teuthology.orchestra.run.smithi083.stdout: "rook", 2024-09-21T01:52:00.163 INFO:teuthology.orchestra.run.smithi083.stdout: "test_orchestrator" 2024-09-21T01:52:00.163 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:52:00.163 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Orchestrator backend", 2024-09-21T01:52:00.164 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.164 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.164 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.164 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.164 INFO:teuthology.orchestra.run.smithi083.stdout: "sqlite3_killpoint": { 2024-09-21T01:52:00.164 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:52:00.164 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:52:00.164 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "dev", 2024-09-21T01:52:00.164 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.164 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0", 2024-09-21T01:52:00.164 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.165 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.165 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.165 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.165 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.165 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.165 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.165 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:52:00.165 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:52:00.165 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.165 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-21T01:52:00.165 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "osd_perf_query", 2024-09-21T01:52:00.166 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-21T01:52:00.166 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-21T01:52:00.166 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-21T01:52:00.166 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-21T01:52:00.166 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-21T01:52:00.166 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.166 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.166 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.166 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:52:00.166 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.167 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.167 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:52:00.167 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:52:00.167 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:52:00.167 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:52:00.167 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:52:00.167 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:52:00.167 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:52:00.167 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:52:00.167 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.168 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.168 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.168 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.168 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.168 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-21T01:52:00.168 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-21T01:52:00.168 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.168 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.168 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.168 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.169 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.169 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.169 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.169 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.169 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.169 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.169 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.169 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.169 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-21T01:52:00.169 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-21T01:52:00.169 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.169 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.169 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.169 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-21T01:52:00.170 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.170 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.170 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:52:00.170 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:52:00.170 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:52:00.170 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:52:00.170 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:52:00.170 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:52:00.170 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:52:00.170 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:52:00.170 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.170 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.170 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.170 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.171 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.171 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-21T01:52:00.171 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-21T01:52:00.171 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.171 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.171 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.171 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.171 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.171 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.171 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.171 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.171 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.171 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.171 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.171 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.172 INFO:teuthology.orchestra.run.smithi083.stdout: "sqlite3_killpoint": { 2024-09-21T01:52:00.172 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:52:00.172 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:52:00.172 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "dev", 2024-09-21T01:52:00.172 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.172 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0", 2024-09-21T01:52:00.172 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.172 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.172 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.172 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.172 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.172 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.172 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.172 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:52:00.173 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:52:00.173 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.173 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-21T01:52:00.173 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "osd_support", 2024-09-21T01:52:00.173 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-21T01:52:00.173 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-21T01:52:00.173 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-21T01:52:00.173 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-21T01:52:00.173 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-21T01:52:00.173 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.173 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.173 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.173 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:52:00.173 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.173 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.174 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:52:00.174 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:52:00.174 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:52:00.174 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:52:00.174 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:52:00.174 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:52:00.174 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:52:00.174 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:52:00.174 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.174 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.174 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.174 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.174 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.174 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-21T01:52:00.175 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-21T01:52:00.175 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.175 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.175 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.175 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.175 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.175 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.175 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.175 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.175 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.175 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.175 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.175 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.175 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-21T01:52:00.175 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-21T01:52:00.176 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.176 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.176 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.176 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-21T01:52:00.176 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.176 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.176 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:52:00.176 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:52:00.176 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:52:00.176 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:52:00.176 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:52:00.176 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:52:00.176 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:52:00.176 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:52:00.177 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.177 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.177 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.177 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.177 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.177 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-21T01:52:00.177 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-21T01:52:00.177 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.177 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.177 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.177 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.177 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.177 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.177 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.177 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.178 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.178 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.178 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.178 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.178 INFO:teuthology.orchestra.run.smithi083.stdout: "sqlite3_killpoint": { 2024-09-21T01:52:00.178 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:52:00.178 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:52:00.178 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "dev", 2024-09-21T01:52:00.178 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.178 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0", 2024-09-21T01:52:00.178 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.178 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.178 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.178 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.178 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.179 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.179 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.179 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:52:00.179 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:52:00.179 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.179 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-21T01:52:00.179 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "pg_autoscaler", 2024-09-21T01:52:00.179 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-21T01:52:00.179 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-21T01:52:00.179 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-21T01:52:00.179 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-21T01:52:00.179 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-21T01:52:00.179 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.179 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.180 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.180 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:52:00.180 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.180 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.180 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:52:00.180 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:52:00.180 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:52:00.180 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:52:00.180 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:52:00.180 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:52:00.180 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:52:00.180 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:52:00.180 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.180 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.181 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.181 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.181 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.181 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-21T01:52:00.181 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-21T01:52:00.181 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.181 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.181 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.181 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.181 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.181 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.181 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.181 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.181 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.181 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.182 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.182 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.182 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-21T01:52:00.182 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-21T01:52:00.182 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.182 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.182 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.182 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-21T01:52:00.182 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.182 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.182 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:52:00.182 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:52:00.182 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:52:00.183 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:52:00.183 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:52:00.183 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:52:00.183 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:52:00.183 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:52:00.183 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.183 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.183 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.183 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.183 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.183 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-21T01:52:00.183 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-21T01:52:00.183 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.183 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.184 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.184 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.184 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.184 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.184 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.184 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.184 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.184 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.184 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.184 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.184 INFO:teuthology.orchestra.run.smithi083.stdout: "sleep_interval": { 2024-09-21T01:52:00.184 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "sleep_interval", 2024-09-21T01:52:00.184 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-09-21T01:52:00.184 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.184 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.185 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "60", 2024-09-21T01:52:00.185 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.185 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.185 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.185 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.185 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.185 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.185 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.185 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.185 INFO:teuthology.orchestra.run.smithi083.stdout: "sqlite3_killpoint": { 2024-09-21T01:52:00.185 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:52:00.185 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:52:00.185 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "dev", 2024-09-21T01:52:00.185 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.186 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0", 2024-09-21T01:52:00.186 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.186 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.186 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.186 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.186 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.186 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.186 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.186 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.186 INFO:teuthology.orchestra.run.smithi083.stdout: "threshold": { 2024-09-21T01:52:00.186 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "threshold", 2024-09-21T01:52:00.186 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "float", 2024-09-21T01:52:00.186 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.186 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.187 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "3.0", 2024-09-21T01:52:00.187 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "1.0", 2024-09-21T01:52:00.187 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.187 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.187 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "scaling threshold", 2024-09-21T01:52:00.187 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-21T01:52:00.187 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.187 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.187 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:52:00.187 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:52:00.187 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.187 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-21T01:52:00.187 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "progress", 2024-09-21T01:52:00.187 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-21T01:52:00.188 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-21T01:52:00.188 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-21T01:52:00.188 INFO:teuthology.orchestra.run.smithi083.stdout: "allow_pg_recovery_event": { 2024-09-21T01:52:00.188 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "allow_pg_recovery_event", 2024-09-21T01:52:00.188 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.188 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.188 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.188 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.188 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.188 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.188 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.188 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-21T01:52:00.188 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.188 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.189 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.189 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.189 INFO:teuthology.orchestra.run.smithi083.stdout: "enabled": { 2024-09-21T01:52:00.189 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "enabled", 2024-09-21T01:52:00.189 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.189 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.189 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.189 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-21T01:52:00.189 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.189 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.190 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.190 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.190 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.190 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.190 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.190 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.190 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-21T01:52:00.190 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-21T01:52:00.190 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.190 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.190 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.190 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:52:00.190 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.190 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.191 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:52:00.191 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:52:00.191 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:52:00.191 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:52:00.191 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:52:00.191 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:52:00.191 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:52:00.191 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:52:00.191 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.191 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.192 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.192 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.192 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.192 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-21T01:52:00.192 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-21T01:52:00.192 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.192 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.192 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.192 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.192 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.192 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.192 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.192 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.192 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.193 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.193 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.193 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.193 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-21T01:52:00.193 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-21T01:52:00.193 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.193 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.193 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.193 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-21T01:52:00.193 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.193 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.194 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:52:00.194 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:52:00.194 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:52:00.194 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:52:00.194 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:52:00.194 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:52:00.194 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:52:00.194 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:52:00.194 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.194 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.194 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.194 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.195 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.195 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-21T01:52:00.195 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-21T01:52:00.195 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.195 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.195 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.195 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.195 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.195 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.195 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.195 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.195 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.196 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.196 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.196 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.196 INFO:teuthology.orchestra.run.smithi083.stdout: "max_completed_events": { 2024-09-21T01:52:00.196 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "max_completed_events", 2024-09-21T01:52:00.196 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:52:00.196 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.196 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.196 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "50", 2024-09-21T01:52:00.196 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.196 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.196 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.197 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "number of past completed events to remember", 2024-09-21T01:52:00.197 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.197 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.197 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.197 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.197 INFO:teuthology.orchestra.run.smithi083.stdout: "sleep_interval": { 2024-09-21T01:52:00.197 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "sleep_interval", 2024-09-21T01:52:00.197 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-09-21T01:52:00.197 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.197 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.198 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "5", 2024-09-21T01:52:00.198 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.198 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.198 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.198 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "how long the module is going to sleep", 2024-09-21T01:52:00.198 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.198 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.198 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.198 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.198 INFO:teuthology.orchestra.run.smithi083.stdout: "sqlite3_killpoint": { 2024-09-21T01:52:00.198 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:52:00.199 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:52:00.199 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "dev", 2024-09-21T01:52:00.199 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.199 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0", 2024-09-21T01:52:00.199 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.199 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.199 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.199 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.199 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.199 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.200 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.200 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:52:00.200 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:52:00.200 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.200 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-21T01:52:00.200 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "prometheus", 2024-09-21T01:52:00.200 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-21T01:52:00.200 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-21T01:52:00.200 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-21T01:52:00.200 INFO:teuthology.orchestra.run.smithi083.stdout: "cache": { 2024-09-21T01:52:00.200 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "cache", 2024-09-21T01:52:00.201 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.201 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.201 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.201 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-21T01:52:00.201 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.201 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.201 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.201 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.201 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.201 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.201 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.201 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.202 INFO:teuthology.orchestra.run.smithi083.stdout: "exclude_perf_counters": { 2024-09-21T01:52:00.202 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "exclude_perf_counters", 2024-09-21T01:52:00.202 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.202 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.202 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.202 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-21T01:52:00.202 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.202 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.202 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.202 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-21T01:52:00.202 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-21T01:52:00.202 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.202 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.202 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.203 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-21T01:52:00.203 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-21T01:52:00.203 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.203 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.203 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.203 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:52:00.203 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.203 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.203 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:52:00.203 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:52:00.203 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:52:00.203 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:52:00.203 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:52:00.203 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:52:00.204 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:52:00.204 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:52:00.204 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.204 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.204 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.204 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.204 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.204 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-21T01:52:00.204 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-21T01:52:00.204 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.204 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.204 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.204 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.204 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.204 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.205 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.205 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.205 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.205 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.205 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.205 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.205 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-21T01:52:00.205 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-21T01:52:00.205 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.205 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.205 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.205 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-21T01:52:00.205 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.205 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.205 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:52:00.205 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:52:00.206 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:52:00.206 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:52:00.206 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:52:00.206 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:52:00.206 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:52:00.206 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:52:00.206 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.206 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.206 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.206 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.206 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.206 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-21T01:52:00.206 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-21T01:52:00.206 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.207 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.207 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.207 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.207 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.207 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.207 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.207 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.207 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.207 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.207 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.207 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.207 INFO:teuthology.orchestra.run.smithi083.stdout: "rbd_stats_pools": { 2024-09-21T01:52:00.207 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "rbd_stats_pools", 2024-09-21T01:52:00.207 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.207 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.207 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.208 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:52:00.208 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.208 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.208 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.208 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.208 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.208 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.208 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.208 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.208 INFO:teuthology.orchestra.run.smithi083.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-21T01:52:00.208 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-21T01:52:00.208 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:52:00.208 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.208 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.208 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "300", 2024-09-21T01:52:00.209 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.209 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.209 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.209 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.209 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.209 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.209 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.209 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.209 INFO:teuthology.orchestra.run.smithi083.stdout: "scrape_interval": { 2024-09-21T01:52:00.209 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "scrape_interval", 2024-09-21T01:52:00.209 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "float", 2024-09-21T01:52:00.209 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.209 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.209 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "15.0", 2024-09-21T01:52:00.210 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.210 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.210 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.210 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.210 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.210 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.210 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.210 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.210 INFO:teuthology.orchestra.run.smithi083.stdout: "server_addr": { 2024-09-21T01:52:00.210 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "server_addr", 2024-09-21T01:52:00.210 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.210 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.210 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.210 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "::", 2024-09-21T01:52:00.211 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.211 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.211 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.211 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-21T01:52:00.211 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.211 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.211 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.211 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.211 INFO:teuthology.orchestra.run.smithi083.stdout: "server_port": { 2024-09-21T01:52:00.211 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "server_port", 2024-09-21T01:52:00.211 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:52:00.211 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.211 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.211 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "9283", 2024-09-21T01:52:00.212 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.212 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.212 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.212 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-21T01:52:00.212 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.212 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.212 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.212 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.212 INFO:teuthology.orchestra.run.smithi083.stdout: "sqlite3_killpoint": { 2024-09-21T01:52:00.212 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:52:00.212 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:52:00.212 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "dev", 2024-09-21T01:52:00.212 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.213 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0", 2024-09-21T01:52:00.213 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.213 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.213 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.213 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.213 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.213 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.213 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.213 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.213 INFO:teuthology.orchestra.run.smithi083.stdout: "stale_cache_strategy": { 2024-09-21T01:52:00.213 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "stale_cache_strategy", 2024-09-21T01:52:00.213 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.213 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.213 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.214 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "log", 2024-09-21T01:52:00.214 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.214 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.214 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.214 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.214 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.214 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.214 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.214 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.214 INFO:teuthology.orchestra.run.smithi083.stdout: "standby_behaviour": { 2024-09-21T01:52:00.214 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "standby_behaviour", 2024-09-21T01:52:00.214 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.214 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.215 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.215 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "default", 2024-09-21T01:52:00.215 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.215 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.215 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:52:00.215 INFO:teuthology.orchestra.run.smithi083.stdout: "default", 2024-09-21T01:52:00.215 INFO:teuthology.orchestra.run.smithi083.stdout: "error" 2024-09-21T01:52:00.215 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:52:00.215 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.215 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.215 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.215 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.215 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.216 INFO:teuthology.orchestra.run.smithi083.stdout: "standby_error_status_code": { 2024-09-21T01:52:00.216 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "standby_error_status_code", 2024-09-21T01:52:00.216 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:52:00.216 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.216 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.216 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "500", 2024-09-21T01:52:00.216 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "400", 2024-09-21T01:52:00.216 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "599", 2024-09-21T01:52:00.216 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.216 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.216 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.216 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.216 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.216 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:52:00.217 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:52:00.217 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.217 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-21T01:52:00.217 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "rbd_support", 2024-09-21T01:52:00.217 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-21T01:52:00.217 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-21T01:52:00.217 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-21T01:52:00.217 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-21T01:52:00.217 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-21T01:52:00.217 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.217 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.217 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.217 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:52:00.217 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.218 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.218 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:52:00.218 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:52:00.218 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:52:00.218 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:52:00.218 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:52:00.218 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:52:00.218 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:52:00.218 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:52:00.218 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.218 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.218 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.218 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.218 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.219 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-21T01:52:00.219 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-21T01:52:00.219 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.219 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.219 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.219 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.219 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.219 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.219 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.219 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.219 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.219 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.219 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.219 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.219 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-21T01:52:00.220 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-21T01:52:00.220 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.220 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.220 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.220 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-21T01:52:00.220 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.220 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.220 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:52:00.220 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:52:00.220 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:52:00.220 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:52:00.220 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:52:00.220 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:52:00.221 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:52:00.221 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:52:00.221 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.221 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.221 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.221 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.221 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.221 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-21T01:52:00.221 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-21T01:52:00.221 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.222 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.222 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.222 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.222 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.222 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.222 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.222 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.222 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.222 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.222 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.222 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.222 INFO:teuthology.orchestra.run.smithi083.stdout: "max_concurrent_snap_create": { 2024-09-21T01:52:00.222 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "max_concurrent_snap_create", 2024-09-21T01:52:00.222 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:52:00.223 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.223 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.223 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "10", 2024-09-21T01:52:00.223 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.223 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.223 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.223 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.223 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.223 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.223 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.224 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.224 INFO:teuthology.orchestra.run.smithi083.stdout: "mirror_snapshot_schedule": { 2024-09-21T01:52:00.224 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "mirror_snapshot_schedule", 2024-09-21T01:52:00.224 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.224 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.224 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.224 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:52:00.224 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.224 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.224 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.224 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.224 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.224 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.224 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.225 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.225 INFO:teuthology.orchestra.run.smithi083.stdout: "sqlite3_killpoint": { 2024-09-21T01:52:00.225 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:52:00.225 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:52:00.225 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "dev", 2024-09-21T01:52:00.225 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.225 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0", 2024-09-21T01:52:00.225 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.225 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.225 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.226 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.226 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.226 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.226 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.226 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.226 INFO:teuthology.orchestra.run.smithi083.stdout: "trash_purge_schedule": { 2024-09-21T01:52:00.226 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "trash_purge_schedule", 2024-09-21T01:52:00.226 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.226 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.226 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.226 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:52:00.226 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.226 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.226 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.227 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.227 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.227 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.227 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.227 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:52:00.227 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:52:00.227 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.227 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-21T01:52:00.227 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "restful", 2024-09-21T01:52:00.227 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-21T01:52:00.227 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-21T01:52:00.227 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-21T01:52:00.227 INFO:teuthology.orchestra.run.smithi083.stdout: "enable_auth": { 2024-09-21T01:52:00.227 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "enable_auth", 2024-09-21T01:52:00.228 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.228 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.228 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.228 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-21T01:52:00.228 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.228 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.228 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.228 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.228 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.228 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.228 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.228 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.228 INFO:teuthology.orchestra.run.smithi083.stdout: "key_file": { 2024-09-21T01:52:00.228 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "key_file", 2024-09-21T01:52:00.228 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.229 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.229 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.229 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:52:00.229 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.229 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.229 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.229 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.229 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.229 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.229 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.230 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.230 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-21T01:52:00.230 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-21T01:52:00.230 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.230 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.230 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.230 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:52:00.230 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.230 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.230 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:52:00.230 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:52:00.230 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:52:00.230 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:52:00.230 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:52:00.231 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:52:00.231 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:52:00.231 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:52:00.231 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.231 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.231 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.231 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.231 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.231 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-21T01:52:00.231 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-21T01:52:00.231 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.231 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.231 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.231 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.231 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.232 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.232 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.232 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.232 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.232 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.232 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.232 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.232 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-21T01:52:00.232 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-21T01:52:00.232 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.232 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.232 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.232 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-21T01:52:00.232 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.232 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.233 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:52:00.233 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:52:00.233 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:52:00.233 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:52:00.233 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:52:00.233 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:52:00.233 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:52:00.233 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:52:00.233 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.233 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.233 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.233 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.233 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.233 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-21T01:52:00.233 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-21T01:52:00.234 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.234 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.234 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.234 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.234 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.234 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.234 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.234 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.234 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.234 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.234 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.234 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.234 INFO:teuthology.orchestra.run.smithi083.stdout: "max_requests": { 2024-09-21T01:52:00.234 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "max_requests", 2024-09-21T01:52:00.235 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:52:00.235 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.235 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.235 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "500", 2024-09-21T01:52:00.235 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.235 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.235 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.235 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.", 2024-09-21T01:52:00.235 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.235 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.235 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.235 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.235 INFO:teuthology.orchestra.run.smithi083.stdout: "server_addr": { 2024-09-21T01:52:00.235 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "server_addr", 2024-09-21T01:52:00.235 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.236 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.236 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.236 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:52:00.236 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.236 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.236 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.236 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.236 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.236 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.236 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.236 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.236 INFO:teuthology.orchestra.run.smithi083.stdout: "server_port": { 2024-09-21T01:52:00.236 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "server_port", 2024-09-21T01:52:00.236 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.237 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.237 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.237 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:52:00.237 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.237 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.237 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.237 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.237 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.237 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.237 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.237 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.237 INFO:teuthology.orchestra.run.smithi083.stdout: "sqlite3_killpoint": { 2024-09-21T01:52:00.237 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:52:00.237 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:52:00.237 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "dev", 2024-09-21T01:52:00.238 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.238 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0", 2024-09-21T01:52:00.238 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.238 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.238 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.238 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.238 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.238 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.238 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.238 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:52:00.238 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:52:00.238 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.238 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-21T01:52:00.239 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "rgw", 2024-09-21T01:52:00.239 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-21T01:52:00.239 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-21T01:52:00.239 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-21T01:52:00.239 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-21T01:52:00.239 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-21T01:52:00.239 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.239 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.239 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.239 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:52:00.239 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.239 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.239 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:52:00.239 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:52:00.240 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:52:00.240 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:52:00.240 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:52:00.240 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:52:00.240 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:52:00.240 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:52:00.240 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.240 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.240 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.240 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.240 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.240 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-21T01:52:00.240 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-21T01:52:00.240 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.240 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.241 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.241 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.241 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.241 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.241 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.241 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.241 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.241 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.241 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.241 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.241 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-21T01:52:00.241 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-21T01:52:00.241 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.241 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.242 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.242 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-21T01:52:00.242 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.242 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.242 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:52:00.242 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:52:00.242 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:52:00.242 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:52:00.242 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:52:00.242 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:52:00.242 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:52:00.242 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:52:00.242 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.242 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.243 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.243 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.243 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.243 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-21T01:52:00.243 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-21T01:52:00.243 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.243 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.243 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.243 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.243 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.243 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.243 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.243 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.243 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.243 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.244 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.244 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.244 INFO:teuthology.orchestra.run.smithi083.stdout: "secondary_zone_period_retry_limit": { 2024-09-21T01:52:00.244 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-21T01:52:00.244 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:52:00.244 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.244 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.244 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "5", 2024-09-21T01:52:00.244 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.244 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.244 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.244 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-21T01:52:00.244 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.244 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.245 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.245 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.245 INFO:teuthology.orchestra.run.smithi083.stdout: "sqlite3_killpoint": { 2024-09-21T01:52:00.245 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:52:00.245 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:52:00.245 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "dev", 2024-09-21T01:52:00.245 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.245 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0", 2024-09-21T01:52:00.245 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.245 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.245 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.245 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.245 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.245 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.245 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.246 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:52:00.246 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:52:00.246 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.246 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-21T01:52:00.246 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "rook", 2024-09-21T01:52:00.246 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-21T01:52:00.246 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-21T01:52:00.246 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-21T01:52:00.246 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-21T01:52:00.246 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-21T01:52:00.246 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.246 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.246 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.246 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:52:00.246 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.247 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.247 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:52:00.247 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:52:00.247 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:52:00.247 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:52:00.247 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:52:00.247 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:52:00.247 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:52:00.247 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:52:00.247 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.247 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.247 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.247 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.247 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.248 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-21T01:52:00.248 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-21T01:52:00.248 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.248 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.248 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.248 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.248 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.248 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.248 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.248 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.248 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.248 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.248 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.248 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.249 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-21T01:52:00.249 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-21T01:52:00.249 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.249 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.249 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.249 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-21T01:52:00.249 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.249 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.249 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:52:00.249 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:52:00.249 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:52:00.249 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:52:00.249 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:52:00.249 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:52:00.249 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:52:00.250 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:52:00.250 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.250 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.250 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.250 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.250 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.250 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-21T01:52:00.250 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-21T01:52:00.250 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.250 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.250 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.250 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.250 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.251 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.251 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.251 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.251 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.251 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.251 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.251 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.251 INFO:teuthology.orchestra.run.smithi083.stdout: "sqlite3_killpoint": { 2024-09-21T01:52:00.251 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:52:00.251 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:52:00.251 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "dev", 2024-09-21T01:52:00.251 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.251 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0", 2024-09-21T01:52:00.251 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.252 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.252 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.252 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.252 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.252 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.252 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.252 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.252 INFO:teuthology.orchestra.run.smithi083.stdout: "storage_class": { 2024-09-21T01:52:00.252 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "storage_class", 2024-09-21T01:52:00.252 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.252 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.252 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.252 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "local", 2024-09-21T01:52:00.253 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.253 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.253 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.253 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-21T01:52:00.253 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.253 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.253 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.253 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:52:00.253 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:52:00.253 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.253 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-21T01:52:00.253 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "selftest", 2024-09-21T01:52:00.253 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-21T01:52:00.253 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-21T01:52:00.254 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-21T01:52:00.254 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-21T01:52:00.254 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-21T01:52:00.254 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.254 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.254 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.254 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:52:00.254 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.254 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.254 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:52:00.254 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:52:00.254 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:52:00.254 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:52:00.255 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:52:00.255 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:52:00.255 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:52:00.255 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:52:00.255 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.255 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.255 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.255 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.255 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.255 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-21T01:52:00.255 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-21T01:52:00.255 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.255 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.255 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.255 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.256 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.256 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.256 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.256 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.256 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.256 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.256 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.256 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.256 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-21T01:52:00.256 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-21T01:52:00.256 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.256 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.256 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.256 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-21T01:52:00.257 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.257 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.257 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:52:00.257 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:52:00.257 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:52:00.257 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:52:00.257 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:52:00.257 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:52:00.257 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:52:00.257 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:52:00.257 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.257 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.257 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.257 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.258 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.258 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-21T01:52:00.258 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-21T01:52:00.258 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.258 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.258 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.258 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.258 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.258 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.258 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.258 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.258 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.258 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.258 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.259 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.259 INFO:teuthology.orchestra.run.smithi083.stdout: "roption1": { 2024-09-21T01:52:00.259 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "roption1", 2024-09-21T01:52:00.259 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.259 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.259 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.259 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:52:00.259 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.259 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.259 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.259 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.259 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.259 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.259 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.260 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.260 INFO:teuthology.orchestra.run.smithi083.stdout: "roption2": { 2024-09-21T01:52:00.260 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "roption2", 2024-09-21T01:52:00.260 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.260 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.260 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.260 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "xyz", 2024-09-21T01:52:00.260 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.260 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.260 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.260 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.260 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.260 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.260 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.261 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.261 INFO:teuthology.orchestra.run.smithi083.stdout: "rwoption1": { 2024-09-21T01:52:00.261 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "rwoption1", 2024-09-21T01:52:00.261 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.261 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.261 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.261 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:52:00.261 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.261 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.261 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.261 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.261 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.261 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.261 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.262 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.262 INFO:teuthology.orchestra.run.smithi083.stdout: "rwoption2": { 2024-09-21T01:52:00.262 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "rwoption2", 2024-09-21T01:52:00.262 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:52:00.262 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.262 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.262 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:52:00.262 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.262 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.262 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.262 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.262 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.262 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.262 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.263 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.263 INFO:teuthology.orchestra.run.smithi083.stdout: "rwoption3": { 2024-09-21T01:52:00.263 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "rwoption3", 2024-09-21T01:52:00.263 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "float", 2024-09-21T01:52:00.263 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.263 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.263 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:52:00.263 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.263 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.263 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.263 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.263 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.263 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.264 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.264 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.264 INFO:teuthology.orchestra.run.smithi083.stdout: "rwoption4": { 2024-09-21T01:52:00.264 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "rwoption4", 2024-09-21T01:52:00.264 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.264 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.264 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.264 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:52:00.264 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.264 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.264 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.264 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.264 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.264 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.265 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.265 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.265 INFO:teuthology.orchestra.run.smithi083.stdout: "rwoption5": { 2024-09-21T01:52:00.265 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "rwoption5", 2024-09-21T01:52:00.265 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.265 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.265 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.265 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:52:00.265 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.265 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.265 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.265 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.265 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.265 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.266 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.266 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.266 INFO:teuthology.orchestra.run.smithi083.stdout: "rwoption6": { 2024-09-21T01:52:00.266 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "rwoption6", 2024-09-21T01:52:00.266 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.266 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.266 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.266 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-21T01:52:00.266 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.266 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.266 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.266 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.267 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.267 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.267 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.267 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.267 INFO:teuthology.orchestra.run.smithi083.stdout: "rwoption7": { 2024-09-21T01:52:00.267 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "rwoption7", 2024-09-21T01:52:00.267 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:52:00.267 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.267 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.267 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:52:00.267 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "1", 2024-09-21T01:52:00.267 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "42", 2024-09-21T01:52:00.267 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.268 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.268 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.268 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.268 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.268 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.268 INFO:teuthology.orchestra.run.smithi083.stdout: "sqlite3_killpoint": { 2024-09-21T01:52:00.268 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:52:00.268 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:52:00.268 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "dev", 2024-09-21T01:52:00.268 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.268 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0", 2024-09-21T01:52:00.268 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.268 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.268 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.269 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.269 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.269 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.269 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.269 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.269 INFO:teuthology.orchestra.run.smithi083.stdout: "testkey": { 2024-09-21T01:52:00.269 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "testkey", 2024-09-21T01:52:00.269 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.269 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.269 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.269 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:52:00.269 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.269 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.269 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.270 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.270 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.270 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.270 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.270 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.270 INFO:teuthology.orchestra.run.smithi083.stdout: "testlkey": { 2024-09-21T01:52:00.270 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "testlkey", 2024-09-21T01:52:00.270 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.270 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.270 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.270 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:52:00.270 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.270 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.270 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.271 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.271 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.271 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.271 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.271 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.271 INFO:teuthology.orchestra.run.smithi083.stdout: "testnewline": { 2024-09-21T01:52:00.271 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "testnewline", 2024-09-21T01:52:00.271 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.271 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.271 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.271 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:52:00.271 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.271 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.271 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.271 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.272 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.272 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.272 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.272 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:52:00.272 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:52:00.272 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.272 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-21T01:52:00.272 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "smb", 2024-09-21T01:52:00.272 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-21T01:52:00.272 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-21T01:52:00.272 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-21T01:52:00.272 INFO:teuthology.orchestra.run.smithi083.stdout: "internal_store_backend": { 2024-09-21T01:52:00.272 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "internal_store_backend", 2024-09-21T01:52:00.273 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.273 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "dev", 2024-09-21T01:52:00.273 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.273 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:52:00.273 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.273 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.273 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.273 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "set internal store backend. for develoment and testing only", 2024-09-21T01:52:00.273 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.273 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.273 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.273 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.273 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-21T01:52:00.273 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-21T01:52:00.273 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.274 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.274 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.274 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:52:00.274 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.274 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.274 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:52:00.274 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:52:00.274 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:52:00.274 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:52:00.274 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:52:00.274 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:52:00.274 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:52:00.274 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:52:00.274 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.274 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.275 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.275 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.275 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.275 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-21T01:52:00.275 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-21T01:52:00.275 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.275 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.275 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.275 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.275 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.275 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.275 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.275 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.275 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.276 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.276 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.276 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.276 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-21T01:52:00.276 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-21T01:52:00.276 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.276 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.276 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.276 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-21T01:52:00.276 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.276 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.276 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:52:00.276 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:52:00.276 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:52:00.276 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:52:00.277 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:52:00.277 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:52:00.277 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:52:00.277 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:52:00.277 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.277 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.277 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.277 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.277 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.277 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-21T01:52:00.277 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-21T01:52:00.277 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.277 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.277 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.277 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.278 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.278 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.278 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.278 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.278 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.278 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.278 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.278 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.278 INFO:teuthology.orchestra.run.smithi083.stdout: "sqlite3_killpoint": { 2024-09-21T01:52:00.278 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:52:00.278 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:52:00.278 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "dev", 2024-09-21T01:52:00.278 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.278 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0", 2024-09-21T01:52:00.279 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.279 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.279 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.279 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.279 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.279 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.279 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.279 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.279 INFO:teuthology.orchestra.run.smithi083.stdout: "update_orchestration": { 2024-09-21T01:52:00.279 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "update_orchestration", 2024-09-21T01:52:00.279 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.279 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.279 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.279 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-21T01:52:00.279 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.280 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.280 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.280 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-09-21T01:52:00.280 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.280 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.280 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.280 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:52:00.280 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:52:00.280 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.280 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-21T01:52:00.280 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "snap_schedule", 2024-09-21T01:52:00.280 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-21T01:52:00.280 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-21T01:52:00.281 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-21T01:52:00.281 INFO:teuthology.orchestra.run.smithi083.stdout: "allow_m_granularity": { 2024-09-21T01:52:00.281 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "allow_m_granularity", 2024-09-21T01:52:00.281 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.281 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.281 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.281 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.281 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.281 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.281 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.281 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "allow minute scheduled snapshots", 2024-09-21T01:52:00.281 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.281 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.281 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.282 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.282 INFO:teuthology.orchestra.run.smithi083.stdout: "dump_on_update": { 2024-09-21T01:52:00.282 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "dump_on_update", 2024-09-21T01:52:00.282 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.282 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.282 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.282 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.282 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.282 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.282 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.282 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "dump database to debug log on update", 2024-09-21T01:52:00.282 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.282 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.283 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.283 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.283 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-21T01:52:00.283 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-21T01:52:00.283 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.283 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.283 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.283 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:52:00.283 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.283 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.283 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:52:00.283 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:52:00.283 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:52:00.283 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:52:00.284 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:52:00.284 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:52:00.284 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:52:00.284 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:52:00.284 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.284 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.284 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.284 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.284 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.284 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-21T01:52:00.284 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-21T01:52:00.284 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.284 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.284 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.285 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.285 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.285 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.285 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.285 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.285 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.285 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.285 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.285 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.285 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-21T01:52:00.285 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-21T01:52:00.285 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.285 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.285 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.285 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-21T01:52:00.286 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.286 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.286 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:52:00.286 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:52:00.286 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:52:00.286 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:52:00.286 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:52:00.286 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:52:00.286 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:52:00.286 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:52:00.286 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.286 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.286 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.286 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.287 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.287 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-21T01:52:00.287 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-21T01:52:00.287 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.287 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.287 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.287 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.287 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.287 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.287 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.287 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.287 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.287 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.287 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.287 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.288 INFO:teuthology.orchestra.run.smithi083.stdout: "sqlite3_killpoint": { 2024-09-21T01:52:00.288 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:52:00.288 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:52:00.288 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "dev", 2024-09-21T01:52:00.288 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.288 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0", 2024-09-21T01:52:00.288 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.288 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.288 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.288 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.288 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.288 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.288 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.288 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:52:00.288 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:52:00.289 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.289 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-21T01:52:00.289 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "stats", 2024-09-21T01:52:00.289 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-21T01:52:00.289 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-21T01:52:00.289 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-21T01:52:00.289 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-21T01:52:00.289 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-21T01:52:00.289 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.289 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.289 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.289 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:52:00.289 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.289 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.290 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:52:00.290 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:52:00.290 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:52:00.290 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:52:00.290 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:52:00.290 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:52:00.290 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:52:00.290 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:52:00.290 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.290 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.290 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.290 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.290 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.290 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-21T01:52:00.291 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-21T01:52:00.291 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.291 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.291 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.291 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.291 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.291 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.291 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.291 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.291 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.291 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.291 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.291 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.291 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-21T01:52:00.291 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-21T01:52:00.292 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.292 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.292 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.292 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-21T01:52:00.292 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.292 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.292 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:52:00.292 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:52:00.292 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:52:00.292 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:52:00.292 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:52:00.292 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:52:00.292 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:52:00.292 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:52:00.292 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.293 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.293 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.293 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.293 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.293 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-21T01:52:00.293 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-21T01:52:00.293 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.293 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.293 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.293 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.293 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.293 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.293 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.294 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.294 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.294 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.294 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.294 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.294 INFO:teuthology.orchestra.run.smithi083.stdout: "sqlite3_killpoint": { 2024-09-21T01:52:00.294 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:52:00.294 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:52:00.294 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "dev", 2024-09-21T01:52:00.294 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.294 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0", 2024-09-21T01:52:00.294 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.294 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.294 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.295 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.295 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.295 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.295 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.295 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:52:00.295 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:52:00.295 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.295 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-21T01:52:00.295 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "status", 2024-09-21T01:52:00.295 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-21T01:52:00.295 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-21T01:52:00.295 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-21T01:52:00.295 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-21T01:52:00.295 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-21T01:52:00.295 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.296 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.296 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.296 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:52:00.296 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.296 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.296 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:52:00.296 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:52:00.296 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:52:00.296 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:52:00.296 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:52:00.296 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:52:00.296 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:52:00.296 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:52:00.296 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.297 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.297 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.297 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.297 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.297 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-21T01:52:00.297 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-21T01:52:00.297 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.297 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.297 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.297 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.297 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.297 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.297 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.297 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.297 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.298 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.298 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.298 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.298 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-21T01:52:00.298 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-21T01:52:00.298 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.298 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.298 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.298 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-21T01:52:00.298 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.298 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.298 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:52:00.298 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:52:00.298 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:52:00.299 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:52:00.299 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:52:00.299 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:52:00.299 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:52:00.299 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:52:00.299 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.299 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.299 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.299 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.299 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.299 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-21T01:52:00.299 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-21T01:52:00.299 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.299 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.300 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.300 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.300 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.300 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.300 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.300 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.300 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.300 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.300 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.300 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.300 INFO:teuthology.orchestra.run.smithi083.stdout: "sqlite3_killpoint": { 2024-09-21T01:52:00.300 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:52:00.300 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:52:00.300 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "dev", 2024-09-21T01:52:00.300 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.300 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0", 2024-09-21T01:52:00.301 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.301 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.301 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.301 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.301 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.301 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.301 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.301 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:52:00.301 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:52:00.301 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.301 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-21T01:52:00.301 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "telegraf", 2024-09-21T01:52:00.301 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-21T01:52:00.301 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-21T01:52:00.302 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-21T01:52:00.302 INFO:teuthology.orchestra.run.smithi083.stdout: "address": { 2024-09-21T01:52:00.302 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "address", 2024-09-21T01:52:00.302 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.302 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.302 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.302 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-21T01:52:00.302 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.302 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.302 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.302 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.302 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.302 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.302 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.302 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.303 INFO:teuthology.orchestra.run.smithi083.stdout: "interval": { 2024-09-21T01:52:00.303 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "interval", 2024-09-21T01:52:00.303 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-09-21T01:52:00.303 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.303 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.303 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "15", 2024-09-21T01:52:00.303 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.303 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.303 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.303 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.303 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.303 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.303 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.303 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.303 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-21T01:52:00.304 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-21T01:52:00.304 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.304 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.304 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.304 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:52:00.304 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.304 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.304 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:52:00.304 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:52:00.304 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:52:00.304 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:52:00.304 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:52:00.304 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:52:00.304 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:52:00.304 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:52:00.305 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.305 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.305 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.305 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.305 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.305 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-21T01:52:00.305 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-21T01:52:00.305 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.305 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.305 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.305 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.305 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.305 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.305 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.306 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.306 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.306 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.306 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.306 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.306 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-21T01:52:00.306 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-21T01:52:00.306 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.306 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.306 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.306 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-21T01:52:00.306 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.306 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.306 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:52:00.307 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:52:00.307 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:52:00.307 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:52:00.307 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:52:00.307 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:52:00.307 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:52:00.307 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:52:00.307 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.307 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.307 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.307 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.307 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.307 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-21T01:52:00.307 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-21T01:52:00.308 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.308 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.308 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.308 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.308 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.308 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.308 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.308 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.308 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.308 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.308 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.308 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.308 INFO:teuthology.orchestra.run.smithi083.stdout: "sqlite3_killpoint": { 2024-09-21T01:52:00.308 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:52:00.308 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:52:00.309 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "dev", 2024-09-21T01:52:00.309 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.309 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0", 2024-09-21T01:52:00.309 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.309 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.309 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.309 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.309 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.309 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.309 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.309 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:52:00.309 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:52:00.309 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.309 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-21T01:52:00.310 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "telemetry", 2024-09-21T01:52:00.310 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-21T01:52:00.310 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-21T01:52:00.310 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-21T01:52:00.310 INFO:teuthology.orchestra.run.smithi083.stdout: "channel_basic": { 2024-09-21T01:52:00.310 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "channel_basic", 2024-09-21T01:52:00.310 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.310 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.310 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.310 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-21T01:52:00.310 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.310 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.310 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.310 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-21T01:52:00.311 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.311 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.311 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.311 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.311 INFO:teuthology.orchestra.run.smithi083.stdout: "channel_crash": { 2024-09-21T01:52:00.311 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "channel_crash", 2024-09-21T01:52:00.311 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.311 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.311 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.311 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-21T01:52:00.311 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.311 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.311 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.311 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-21T01:52:00.311 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.312 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.312 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.312 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.312 INFO:teuthology.orchestra.run.smithi083.stdout: "channel_device": { 2024-09-21T01:52:00.312 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "channel_device", 2024-09-21T01:52:00.312 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.312 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.312 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.312 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-21T01:52:00.312 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.312 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.312 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.312 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-21T01:52:00.312 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.313 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.313 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.313 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.313 INFO:teuthology.orchestra.run.smithi083.stdout: "channel_ident": { 2024-09-21T01:52:00.313 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "channel_ident", 2024-09-21T01:52:00.313 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.313 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.313 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.313 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.313 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.313 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.313 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.313 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-21T01:52:00.313 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.313 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.313 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.314 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.314 INFO:teuthology.orchestra.run.smithi083.stdout: "channel_perf": { 2024-09-21T01:52:00.314 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "channel_perf", 2024-09-21T01:52:00.314 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.314 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.314 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.314 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.314 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.314 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.314 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.314 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-21T01:52:00.314 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.314 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.314 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.315 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.315 INFO:teuthology.orchestra.run.smithi083.stdout: "contact": { 2024-09-21T01:52:00.315 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "contact", 2024-09-21T01:52:00.315 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.315 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.315 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.315 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:52:00.315 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.315 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.315 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.315 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.315 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.315 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.315 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.315 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.316 INFO:teuthology.orchestra.run.smithi083.stdout: "description": { 2024-09-21T01:52:00.316 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "description", 2024-09-21T01:52:00.316 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.316 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.316 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.316 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:52:00.316 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.316 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.316 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.316 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.316 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.316 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.316 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.316 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.316 INFO:teuthology.orchestra.run.smithi083.stdout: "device_url": { 2024-09-21T01:52:00.317 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "device_url", 2024-09-21T01:52:00.317 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.317 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.317 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.317 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-21T01:52:00.317 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.317 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.317 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.317 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.317 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.317 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.317 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.317 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.317 INFO:teuthology.orchestra.run.smithi083.stdout: "enabled": { 2024-09-21T01:52:00.317 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "enabled", 2024-09-21T01:52:00.318 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.318 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.318 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.318 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.318 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.318 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.318 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.318 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.318 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.318 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.318 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.318 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.318 INFO:teuthology.orchestra.run.smithi083.stdout: "interval": { 2024-09-21T01:52:00.318 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "interval", 2024-09-21T01:52:00.319 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:52:00.319 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.319 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.319 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "24", 2024-09-21T01:52:00.319 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "8", 2024-09-21T01:52:00.319 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.319 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.319 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.319 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.319 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.319 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.319 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.319 INFO:teuthology.orchestra.run.smithi083.stdout: "last_opt_revision": { 2024-09-21T01:52:00.319 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "last_opt_revision", 2024-09-21T01:52:00.319 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:52:00.320 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.320 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.320 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "1", 2024-09-21T01:52:00.320 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.320 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.320 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.320 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.320 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.320 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.320 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.320 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.320 INFO:teuthology.orchestra.run.smithi083.stdout: "leaderboard": { 2024-09-21T01:52:00.320 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "leaderboard", 2024-09-21T01:52:00.320 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.320 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.321 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.321 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.321 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.321 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.321 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.321 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.321 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.321 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.321 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.321 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.321 INFO:teuthology.orchestra.run.smithi083.stdout: "leaderboard_description": { 2024-09-21T01:52:00.321 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "leaderboard_description", 2024-09-21T01:52:00.321 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.321 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.321 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.322 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:52:00.322 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.322 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.322 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.322 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.322 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.322 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.322 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.322 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.322 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-21T01:52:00.322 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-21T01:52:00.322 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.322 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.322 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.323 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:52:00.323 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.323 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.323 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:52:00.323 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:52:00.323 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:52:00.323 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:52:00.323 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:52:00.323 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:52:00.323 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:52:00.323 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:52:00.323 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.323 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.323 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.324 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.324 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.324 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-21T01:52:00.324 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-21T01:52:00.324 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.324 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.324 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.324 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.324 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.324 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.324 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.324 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.324 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.324 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.324 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.325 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.325 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-21T01:52:00.325 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-21T01:52:00.325 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.325 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.325 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.325 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-21T01:52:00.325 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.325 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.325 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:52:00.325 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:52:00.325 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:52:00.325 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:52:00.325 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:52:00.326 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:52:00.326 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:52:00.326 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:52:00.326 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.326 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.326 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.326 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.326 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.326 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-21T01:52:00.326 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-21T01:52:00.326 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.326 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.326 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.326 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.326 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.327 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.327 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.327 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.327 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.327 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.327 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.327 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.327 INFO:teuthology.orchestra.run.smithi083.stdout: "organization": { 2024-09-21T01:52:00.327 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "organization", 2024-09-21T01:52:00.327 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.327 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.327 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.327 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:52:00.327 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.328 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.328 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.328 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.328 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.328 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.328 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.328 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.328 INFO:teuthology.orchestra.run.smithi083.stdout: "proxy": { 2024-09-21T01:52:00.328 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "proxy", 2024-09-21T01:52:00.328 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.328 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.328 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.328 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:52:00.328 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.328 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.329 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.329 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.329 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.329 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.329 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.329 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.329 INFO:teuthology.orchestra.run.smithi083.stdout: "sqlite3_killpoint": { 2024-09-21T01:52:00.329 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:52:00.329 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:52:00.329 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "dev", 2024-09-21T01:52:00.329 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.329 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0", 2024-09-21T01:52:00.329 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.329 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.330 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.330 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.330 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.330 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.330 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.330 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.330 INFO:teuthology.orchestra.run.smithi083.stdout: "url": { 2024-09-21T01:52:00.330 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "url", 2024-09-21T01:52:00.330 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.330 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.330 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.330 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-21T01:52:00.330 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.330 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.330 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.331 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.331 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.331 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.331 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.331 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:52:00.331 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:52:00.331 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.331 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-21T01:52:00.331 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "test_orchestrator", 2024-09-21T01:52:00.331 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-21T01:52:00.331 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-21T01:52:00.331 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-21T01:52:00.331 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-21T01:52:00.331 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-21T01:52:00.332 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.332 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.332 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.332 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:52:00.332 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.332 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.332 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:52:00.332 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:52:00.332 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:52:00.332 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:52:00.332 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:52:00.332 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:52:00.332 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:52:00.332 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:52:00.333 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.333 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.333 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.333 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.333 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.333 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-21T01:52:00.333 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-21T01:52:00.333 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.333 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.333 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.333 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.333 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.333 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.333 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.334 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.334 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.334 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.334 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.334 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.334 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-21T01:52:00.334 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-21T01:52:00.334 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.334 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.334 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.334 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-21T01:52:00.334 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.334 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.334 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:52:00.335 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:52:00.335 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:52:00.335 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:52:00.335 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:52:00.335 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:52:00.335 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:52:00.335 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:52:00.335 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.335 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.335 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.335 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.335 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.335 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-21T01:52:00.335 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-21T01:52:00.335 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.336 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.336 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.336 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.336 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.336 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.336 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.336 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.336 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.336 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.336 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.336 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.336 INFO:teuthology.orchestra.run.smithi083.stdout: "sqlite3_killpoint": { 2024-09-21T01:52:00.336 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:52:00.336 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:52:00.337 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "dev", 2024-09-21T01:52:00.337 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.337 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0", 2024-09-21T01:52:00.337 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.337 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.337 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.337 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.337 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.337 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.337 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.337 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:52:00.337 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:52:00.337 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.337 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-21T01:52:00.337 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "volumes", 2024-09-21T01:52:00.338 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-21T01:52:00.338 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-21T01:52:00.338 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-21T01:52:00.338 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-21T01:52:00.338 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-21T01:52:00.338 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.338 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.338 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.338 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:52:00.338 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.338 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.338 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:52:00.338 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:52:00.338 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:52:00.339 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:52:00.339 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:52:00.339 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:52:00.339 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:52:00.339 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:52:00.339 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.339 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.339 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.339 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.339 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.339 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-21T01:52:00.339 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-21T01:52:00.339 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.339 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.339 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.340 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.340 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.340 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.340 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.340 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.340 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.340 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.340 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.340 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.340 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-21T01:52:00.340 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-21T01:52:00.340 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.340 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.340 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.340 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-21T01:52:00.341 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.341 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.341 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:52:00.341 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:52:00.341 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:52:00.341 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:52:00.341 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:52:00.341 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:52:00.341 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:52:00.341 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:52:00.341 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.341 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.341 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.341 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.342 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.342 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-21T01:52:00.342 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-21T01:52:00.342 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.342 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.342 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.342 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.342 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.342 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.342 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.342 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.342 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.342 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.342 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.343 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.343 INFO:teuthology.orchestra.run.smithi083.stdout: "max_concurrent_clones": { 2024-09-21T01:52:00.343 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "max_concurrent_clones", 2024-09-21T01:52:00.343 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:52:00.343 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.343 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.343 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "4", 2024-09-21T01:52:00.343 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.343 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.343 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.343 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-21T01:52:00.343 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.343 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.343 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.343 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.344 INFO:teuthology.orchestra.run.smithi083.stdout: "periodic_async_work": { 2024-09-21T01:52:00.344 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "periodic_async_work", 2024-09-21T01:52:00.344 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.344 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.344 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.344 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.344 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.344 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.344 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.344 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Periodically check for async work", 2024-09-21T01:52:00.344 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.344 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.344 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.344 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.344 INFO:teuthology.orchestra.run.smithi083.stdout: "snapshot_clone_delay": { 2024-09-21T01:52:00.345 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "snapshot_clone_delay", 2024-09-21T01:52:00.345 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:52:00.345 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.345 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.345 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0", 2024-09-21T01:52:00.345 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.345 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.345 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.345 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-21T01:52:00.345 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.345 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.345 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.345 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.345 INFO:teuthology.orchestra.run.smithi083.stdout: "snapshot_clone_no_wait": { 2024-09-21T01:52:00.346 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "snapshot_clone_no_wait", 2024-09-21T01:52:00.346 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.346 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.346 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.346 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-21T01:52:00.346 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.346 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.346 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.346 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-21T01:52:00.346 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.346 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.346 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.346 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.347 INFO:teuthology.orchestra.run.smithi083.stdout: "sqlite3_killpoint": { 2024-09-21T01:52:00.347 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:52:00.347 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:52:00.347 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "dev", 2024-09-21T01:52:00.347 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.347 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0", 2024-09-21T01:52:00.347 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.347 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.347 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.347 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.347 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.347 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.347 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.348 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:52:00.348 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:52:00.348 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.348 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-21T01:52:00.348 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "zabbix", 2024-09-21T01:52:00.348 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-21T01:52:00.348 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-21T01:52:00.348 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-21T01:52:00.348 INFO:teuthology.orchestra.run.smithi083.stdout: "discovery_interval": { 2024-09-21T01:52:00.348 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "discovery_interval", 2024-09-21T01:52:00.348 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "uint", 2024-09-21T01:52:00.348 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.348 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.348 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "100", 2024-09-21T01:52:00.348 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.349 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.349 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.349 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.349 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.349 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.349 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.349 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.349 INFO:teuthology.orchestra.run.smithi083.stdout: "identifier": { 2024-09-21T01:52:00.349 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "identifier", 2024-09-21T01:52:00.349 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.349 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.349 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.349 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:52:00.349 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.350 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.350 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.350 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.350 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.350 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.350 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.350 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.350 INFO:teuthology.orchestra.run.smithi083.stdout: "interval": { 2024-09-21T01:52:00.350 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "interval", 2024-09-21T01:52:00.350 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-09-21T01:52:00.350 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.350 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.350 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "60", 2024-09-21T01:52:00.350 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.351 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.351 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.351 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.351 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.351 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.351 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.351 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.351 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-21T01:52:00.351 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-21T01:52:00.351 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.351 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.351 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.351 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:52:00.351 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.352 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.352 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:52:00.352 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:52:00.352 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:52:00.352 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:52:00.352 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:52:00.352 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:52:00.352 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:52:00.352 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:52:00.352 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.352 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.352 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.352 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.352 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.352 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-21T01:52:00.353 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-21T01:52:00.353 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.353 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.353 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.353 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.353 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.353 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.353 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.353 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.353 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.353 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.353 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.353 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.353 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-21T01:52:00.354 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-21T01:52:00.354 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.354 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.354 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.354 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-21T01:52:00.354 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.354 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.354 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:52:00.354 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:52:00.354 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:52:00.354 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:52:00.354 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:52:00.354 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:52:00.354 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:52:00.354 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:52:00.355 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.355 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.355 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.355 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.355 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.355 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-21T01:52:00.355 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-21T01:52:00.355 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.355 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.355 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.355 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.355 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.355 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.356 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.356 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.356 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.356 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.356 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.356 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.356 INFO:teuthology.orchestra.run.smithi083.stdout: "sqlite3_killpoint": { 2024-09-21T01:52:00.356 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:52:00.356 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:52:00.356 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "dev", 2024-09-21T01:52:00.356 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.356 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0", 2024-09-21T01:52:00.356 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.356 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.356 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.356 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.357 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.357 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.357 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.357 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.357 INFO:teuthology.orchestra.run.smithi083.stdout: "zabbix_host": { 2024-09-21T01:52:00.357 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "zabbix_host", 2024-09-21T01:52:00.357 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.357 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.357 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.357 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:52:00.357 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.357 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.357 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.357 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.358 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.358 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.358 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.358 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.358 INFO:teuthology.orchestra.run.smithi083.stdout: "zabbix_port": { 2024-09-21T01:52:00.358 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "zabbix_port", 2024-09-21T01:52:00.358 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:52:00.358 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.358 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.358 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "10051", 2024-09-21T01:52:00.358 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.358 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.358 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.358 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.358 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.359 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.359 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.359 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.359 INFO:teuthology.orchestra.run.smithi083.stdout: "zabbix_sender": { 2024-09-21T01:52:00.359 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "zabbix_sender", 2024-09-21T01:52:00.359 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.359 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.359 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.359 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-21T01:52:00.359 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.359 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.359 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.359 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.360 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.360 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.360 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.360 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:52:00.360 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:52:00.360 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:52:00.360 INFO:teuthology.orchestra.run.smithi083.stdout: ] 2024-09-21T01:52:00.360 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:52:00.360 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:52:00.360 INFO:teuthology.orchestra.run.smithi083.stdout: "modules": [ 2024-09-21T01:52:00.360 INFO:teuthology.orchestra.run.smithi083.stdout: "cephadm", 2024-09-21T01:52:00.360 INFO:teuthology.orchestra.run.smithi083.stdout: "dashboard", 2024-09-21T01:52:00.361 INFO:teuthology.orchestra.run.smithi083.stdout: "iostat", 2024-09-21T01:52:00.361 INFO:teuthology.orchestra.run.smithi083.stdout: "nfs", 2024-09-21T01:52:00.361 INFO:teuthology.orchestra.run.smithi083.stdout: "restful", 2024-09-21T01:52:00.361 INFO:teuthology.orchestra.run.smithi083.stdout: "snap_schedule" 2024-09-21T01:52:00.361 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:52:00.361 INFO:teuthology.orchestra.run.smithi083.stdout: "available_modules": [ 2024-09-21T01:52:00.361 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-21T01:52:00.361 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "alerts", 2024-09-21T01:52:00.361 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-21T01:52:00.361 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-21T01:52:00.361 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-21T01:52:00.361 INFO:teuthology.orchestra.run.smithi083.stdout: "interval": { 2024-09-21T01:52:00.361 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "interval", 2024-09-21T01:52:00.361 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-09-21T01:52:00.362 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.362 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.362 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "60", 2024-09-21T01:52:00.362 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.362 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.362 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.362 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "How frequently to reexamine health status", 2024-09-21T01:52:00.362 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.362 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.362 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.362 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.362 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-21T01:52:00.362 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-21T01:52:00.363 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.363 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.363 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.363 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:52:00.363 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.363 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.363 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:52:00.363 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:52:00.363 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:52:00.363 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:52:00.363 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:52:00.363 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:52:00.363 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:52:00.363 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:52:00.364 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.364 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.364 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.364 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.364 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.364 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-21T01:52:00.364 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-21T01:52:00.364 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.364 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.364 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.364 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.364 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.364 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.364 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.364 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.365 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.365 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.365 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.365 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.365 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-21T01:52:00.365 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-21T01:52:00.365 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.365 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.365 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.365 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-21T01:52:00.365 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.365 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.365 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:52:00.365 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:52:00.365 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:52:00.366 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:52:00.366 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:52:00.366 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:52:00.366 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:52:00.366 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:52:00.366 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.366 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.366 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.366 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.366 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.366 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-21T01:52:00.366 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-21T01:52:00.366 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.366 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.367 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.367 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.367 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.367 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.367 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.367 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.367 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.367 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.367 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.367 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.367 INFO:teuthology.orchestra.run.smithi083.stdout: "smtp_destination": { 2024-09-21T01:52:00.367 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "smtp_destination", 2024-09-21T01:52:00.367 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.367 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.368 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.368 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:52:00.368 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.368 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.368 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.368 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Email address to send alerts to, use commas to separate multiple", 2024-09-21T01:52:00.368 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.368 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.368 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.368 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.368 INFO:teuthology.orchestra.run.smithi083.stdout: "smtp_from_name": { 2024-09-21T01:52:00.368 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "smtp_from_name", 2024-09-21T01:52:00.368 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.368 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.368 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.368 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "Ceph", 2024-09-21T01:52:00.369 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.369 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.369 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.369 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Email From: name", 2024-09-21T01:52:00.369 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.369 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.369 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.369 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.369 INFO:teuthology.orchestra.run.smithi083.stdout: "smtp_host": { 2024-09-21T01:52:00.369 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "smtp_host", 2024-09-21T01:52:00.369 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.369 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.369 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.369 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:52:00.369 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.370 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.370 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.370 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "SMTP server", 2024-09-21T01:52:00.370 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.370 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.370 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.370 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.370 INFO:teuthology.orchestra.run.smithi083.stdout: "smtp_password": { 2024-09-21T01:52:00.370 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "smtp_password", 2024-09-21T01:52:00.370 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.370 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.370 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.370 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:52:00.370 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.371 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.371 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.371 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Password to authenticate with", 2024-09-21T01:52:00.371 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.371 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.371 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.371 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.371 INFO:teuthology.orchestra.run.smithi083.stdout: "smtp_port": { 2024-09-21T01:52:00.371 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "smtp_port", 2024-09-21T01:52:00.371 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:52:00.371 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.371 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.371 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "465", 2024-09-21T01:52:00.371 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.371 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.372 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.372 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "SMTP port", 2024-09-21T01:52:00.372 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.372 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.372 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.372 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.372 INFO:teuthology.orchestra.run.smithi083.stdout: "smtp_sender": { 2024-09-21T01:52:00.372 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "smtp_sender", 2024-09-21T01:52:00.372 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.372 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.372 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.372 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:52:00.372 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.372 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.372 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.373 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "SMTP envelope sender", 2024-09-21T01:52:00.373 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.373 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.373 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.373 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.373 INFO:teuthology.orchestra.run.smithi083.stdout: "smtp_ssl": { 2024-09-21T01:52:00.373 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "smtp_ssl", 2024-09-21T01:52:00.373 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.373 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.373 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.373 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-21T01:52:00.373 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.373 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.373 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.373 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-21T01:52:00.374 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.374 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.374 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.374 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.374 INFO:teuthology.orchestra.run.smithi083.stdout: "smtp_user": { 2024-09-21T01:52:00.374 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "smtp_user", 2024-09-21T01:52:00.374 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.374 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.374 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.374 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:52:00.374 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.374 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.374 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.374 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "User to authenticate as", 2024-09-21T01:52:00.375 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.375 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.375 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.375 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.375 INFO:teuthology.orchestra.run.smithi083.stdout: "sqlite3_killpoint": { 2024-09-21T01:52:00.375 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:52:00.375 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:52:00.375 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "dev", 2024-09-21T01:52:00.375 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.375 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0", 2024-09-21T01:52:00.375 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.375 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.375 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.375 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.375 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.376 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.376 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.376 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:52:00.376 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:52:00.376 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.376 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-21T01:52:00.376 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "balancer", 2024-09-21T01:52:00.376 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-21T01:52:00.376 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-21T01:52:00.376 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-21T01:52:00.376 INFO:teuthology.orchestra.run.smithi083.stdout: "active": { 2024-09-21T01:52:00.376 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "active", 2024-09-21T01:52:00.376 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.376 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.377 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.377 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-21T01:52:00.377 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.377 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.377 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.377 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "automatically balance PGs across cluster", 2024-09-21T01:52:00.377 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.377 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.377 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.377 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.377 INFO:teuthology.orchestra.run.smithi083.stdout: "begin_time": { 2024-09-21T01:52:00.377 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "begin_time", 2024-09-21T01:52:00.377 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.377 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.378 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.378 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0000", 2024-09-21T01:52:00.378 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.378 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.378 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.378 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "beginning time of day to automatically balance", 2024-09-21T01:52:00.378 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-21T01:52:00.378 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.378 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.378 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.378 INFO:teuthology.orchestra.run.smithi083.stdout: "begin_weekday": { 2024-09-21T01:52:00.378 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "begin_weekday", 2024-09-21T01:52:00.378 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "uint", 2024-09-21T01:52:00.378 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.378 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.379 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0", 2024-09-21T01:52:00.379 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "0", 2024-09-21T01:52:00.379 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "6", 2024-09-21T01:52:00.379 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.379 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-21T01:52:00.379 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-21T01:52:00.379 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.379 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.379 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.379 INFO:teuthology.orchestra.run.smithi083.stdout: "crush_compat_max_iterations": { 2024-09-21T01:52:00.379 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "crush_compat_max_iterations", 2024-09-21T01:52:00.379 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "uint", 2024-09-21T01:52:00.379 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.380 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.380 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "25", 2024-09-21T01:52:00.380 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "1", 2024-09-21T01:52:00.380 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "250", 2024-09-21T01:52:00.380 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.380 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-21T01:52:00.380 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.380 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.380 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.380 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.380 INFO:teuthology.orchestra.run.smithi083.stdout: "crush_compat_metrics": { 2024-09-21T01:52:00.380 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "crush_compat_metrics", 2024-09-21T01:52:00.380 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.380 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.381 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.381 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "pgs,objects,bytes", 2024-09-21T01:52:00.381 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.381 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.381 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.381 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-21T01:52:00.381 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-21T01:52:00.381 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.381 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.381 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.381 INFO:teuthology.orchestra.run.smithi083.stdout: "crush_compat_step": { 2024-09-21T01:52:00.381 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "crush_compat_step", 2024-09-21T01:52:00.381 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "float", 2024-09-21T01:52:00.381 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.381 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.382 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0.5", 2024-09-21T01:52:00.382 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "0.001", 2024-09-21T01:52:00.382 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "0.999", 2024-09-21T01:52:00.382 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.382 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "aggressiveness of optimization", 2024-09-21T01:52:00.382 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-21T01:52:00.382 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.382 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.382 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.382 INFO:teuthology.orchestra.run.smithi083.stdout: "end_time": { 2024-09-21T01:52:00.382 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "end_time", 2024-09-21T01:52:00.382 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.382 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.382 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.383 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "2359", 2024-09-21T01:52:00.383 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.383 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.383 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.383 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "ending time of day to automatically balance", 2024-09-21T01:52:00.383 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-21T01:52:00.383 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.383 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.383 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.383 INFO:teuthology.orchestra.run.smithi083.stdout: "end_weekday": { 2024-09-21T01:52:00.383 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "end_weekday", 2024-09-21T01:52:00.383 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "uint", 2024-09-21T01:52:00.383 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.383 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.383 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0", 2024-09-21T01:52:00.384 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "0", 2024-09-21T01:52:00.384 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "6", 2024-09-21T01:52:00.384 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.384 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-21T01:52:00.384 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-21T01:52:00.384 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.384 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.384 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.384 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-21T01:52:00.384 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-21T01:52:00.384 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.384 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.384 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.385 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:52:00.385 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.385 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.385 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:52:00.385 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:52:00.385 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:52:00.385 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:52:00.385 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:52:00.385 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:52:00.385 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:52:00.385 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:52:00.385 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.385 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.385 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.385 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.386 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.386 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-21T01:52:00.386 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-21T01:52:00.386 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.386 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.386 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.386 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.386 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.386 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.386 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.386 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.386 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.386 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.387 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.387 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.387 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-21T01:52:00.387 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-21T01:52:00.387 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.387 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.387 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.387 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-21T01:52:00.387 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.387 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.387 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:52:00.387 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:52:00.387 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:52:00.387 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:52:00.387 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:52:00.388 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:52:00.388 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:52:00.388 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:52:00.388 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.388 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.388 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.388 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.388 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.388 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-21T01:52:00.388 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-21T01:52:00.388 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.388 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.388 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.389 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.389 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.389 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.389 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.389 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.389 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.389 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.389 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.389 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.389 INFO:teuthology.orchestra.run.smithi083.stdout: "min_score": { 2024-09-21T01:52:00.389 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "min_score", 2024-09-21T01:52:00.389 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "float", 2024-09-21T01:52:00.389 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.389 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.390 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0", 2024-09-21T01:52:00.390 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.390 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.390 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.390 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-21T01:52:00.390 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.390 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.390 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.390 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.390 INFO:teuthology.orchestra.run.smithi083.stdout: "mode": { 2024-09-21T01:52:00.390 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "mode", 2024-09-21T01:52:00.390 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.390 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.390 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.391 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "upmap", 2024-09-21T01:52:00.391 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.391 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.391 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:52:00.391 INFO:teuthology.orchestra.run.smithi083.stdout: "crush-compat", 2024-09-21T01:52:00.391 INFO:teuthology.orchestra.run.smithi083.stdout: "none", 2024-09-21T01:52:00.391 INFO:teuthology.orchestra.run.smithi083.stdout: "read", 2024-09-21T01:52:00.391 INFO:teuthology.orchestra.run.smithi083.stdout: "upmap", 2024-09-21T01:52:00.391 INFO:teuthology.orchestra.run.smithi083.stdout: "upmap-read" 2024-09-21T01:52:00.391 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:52:00.391 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Balancer mode", 2024-09-21T01:52:00.391 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.391 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.391 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.392 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.392 INFO:teuthology.orchestra.run.smithi083.stdout: "pool_ids": { 2024-09-21T01:52:00.392 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "pool_ids", 2024-09-21T01:52:00.392 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.392 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.392 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.392 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:52:00.392 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.392 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.392 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.392 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-21T01:52:00.392 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.392 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.393 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.393 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.393 INFO:teuthology.orchestra.run.smithi083.stdout: "sleep_interval": { 2024-09-21T01:52:00.393 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "sleep_interval", 2024-09-21T01:52:00.393 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-09-21T01:52:00.393 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.393 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.393 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "60", 2024-09-21T01:52:00.393 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.393 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.393 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.393 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-21T01:52:00.394 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.394 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.394 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.394 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.394 INFO:teuthology.orchestra.run.smithi083.stdout: "sqlite3_killpoint": { 2024-09-21T01:52:00.394 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:52:00.394 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:52:00.394 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "dev", 2024-09-21T01:52:00.394 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.394 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0", 2024-09-21T01:52:00.394 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.394 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.394 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.394 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.394 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.395 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.395 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.395 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.395 INFO:teuthology.orchestra.run.smithi083.stdout: "upmap_max_deviation": { 2024-09-21T01:52:00.395 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "upmap_max_deviation", 2024-09-21T01:52:00.395 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:52:00.395 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.395 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.395 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "5", 2024-09-21T01:52:00.395 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "1", 2024-09-21T01:52:00.395 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.395 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.395 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-21T01:52:00.396 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-21T01:52:00.396 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.396 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.396 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.396 INFO:teuthology.orchestra.run.smithi083.stdout: "upmap_max_optimizations": { 2024-09-21T01:52:00.396 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "upmap_max_optimizations", 2024-09-21T01:52:00.396 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "uint", 2024-09-21T01:52:00.396 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.396 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.396 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "10", 2024-09-21T01:52:00.396 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.396 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.396 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.396 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-21T01:52:00.397 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.397 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.397 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.397 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:52:00.397 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:52:00.397 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.397 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-21T01:52:00.397 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "cephadm", 2024-09-21T01:52:00.397 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-21T01:52:00.397 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-21T01:52:00.397 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-21T01:52:00.397 INFO:teuthology.orchestra.run.smithi083.stdout: "agent_down_multiplier": { 2024-09-21T01:52:00.397 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "agent_down_multiplier", 2024-09-21T01:52:00.397 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "float", 2024-09-21T01:52:00.397 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.398 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.398 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "3.0", 2024-09-21T01:52:00.398 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.398 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.398 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.398 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-21T01:52:00.398 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.398 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.398 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.398 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.398 INFO:teuthology.orchestra.run.smithi083.stdout: "agent_refresh_rate": { 2024-09-21T01:52:00.398 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "agent_refresh_rate", 2024-09-21T01:52:00.398 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-09-21T01:52:00.398 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.399 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.399 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "20", 2024-09-21T01:52:00.399 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.399 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.399 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.399 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-21T01:52:00.399 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.399 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.399 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.399 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.399 INFO:teuthology.orchestra.run.smithi083.stdout: "agent_starting_port": { 2024-09-21T01:52:00.399 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "agent_starting_port", 2024-09-21T01:52:00.399 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:52:00.399 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.399 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.400 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "4721", 2024-09-21T01:52:00.400 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.400 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.400 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.400 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-21T01:52:00.400 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.400 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.400 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.400 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.400 INFO:teuthology.orchestra.run.smithi083.stdout: "allow_ptrace": { 2024-09-21T01:52:00.400 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "allow_ptrace", 2024-09-21T01:52:00.400 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.400 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.400 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.400 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.401 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.401 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.401 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.401 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-21T01:52:00.401 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-21T01:52:00.401 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.401 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.401 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.401 INFO:teuthology.orchestra.run.smithi083.stdout: "autotune_interval": { 2024-09-21T01:52:00.401 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "autotune_interval", 2024-09-21T01:52:00.401 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-09-21T01:52:00.401 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.401 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.401 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "600", 2024-09-21T01:52:00.402 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.402 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.402 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.402 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-21T01:52:00.402 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.402 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.402 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.402 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.402 INFO:teuthology.orchestra.run.smithi083.stdout: "autotune_memory_target_ratio": { 2024-09-21T01:52:00.402 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "autotune_memory_target_ratio", 2024-09-21T01:52:00.402 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "float", 2024-09-21T01:52:00.402 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.402 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.402 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0.7", 2024-09-21T01:52:00.402 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.403 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.403 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.403 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-21T01:52:00.403 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.403 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.403 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.403 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.403 INFO:teuthology.orchestra.run.smithi083.stdout: "cephadm_log_destination": { 2024-09-21T01:52:00.403 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "cephadm_log_destination", 2024-09-21T01:52:00.403 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.403 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.403 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.403 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:52:00.403 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.403 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.404 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:52:00.404 INFO:teuthology.orchestra.run.smithi083.stdout: "file", 2024-09-21T01:52:00.404 INFO:teuthology.orchestra.run.smithi083.stdout: "file,syslog", 2024-09-21T01:52:00.404 INFO:teuthology.orchestra.run.smithi083.stdout: "syslog" 2024-09-21T01:52:00.404 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:52:00.404 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-21T01:52:00.404 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.404 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.404 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.404 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.404 INFO:teuthology.orchestra.run.smithi083.stdout: "cgroups_split": { 2024-09-21T01:52:00.404 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "cgroups_split", 2024-09-21T01:52:00.404 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.404 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.404 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.405 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-21T01:52:00.405 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.405 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.405 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.405 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-21T01:52:00.405 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.405 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.405 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.405 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.405 INFO:teuthology.orchestra.run.smithi083.stdout: "config_checks_enabled": { 2024-09-21T01:52:00.405 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "config_checks_enabled", 2024-09-21T01:52:00.405 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.405 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.405 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.405 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.406 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.406 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.406 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.406 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-21T01:52:00.406 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.406 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.406 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.406 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.406 INFO:teuthology.orchestra.run.smithi083.stdout: "config_dashboard": { 2024-09-21T01:52:00.406 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "config_dashboard", 2024-09-21T01:52:00.406 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.406 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.406 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.407 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-21T01:52:00.407 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.407 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.407 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.407 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-21T01:52:00.407 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.407 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.407 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.407 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.407 INFO:teuthology.orchestra.run.smithi083.stdout: "container_image_alertmanager": { 2024-09-21T01:52:00.407 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "container_image_alertmanager", 2024-09-21T01:52:00.407 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.407 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.407 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.407 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.27.0", 2024-09-21T01:52:00.408 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.408 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.408 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.408 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Prometheus container image", 2024-09-21T01:52:00.408 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.408 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.408 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.408 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.408 INFO:teuthology.orchestra.run.smithi083.stdout: "container_image_base": { 2024-09-21T01:52:00.408 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "container_image_base", 2024-09-21T01:52:00.408 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.408 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.408 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.408 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-21T01:52:00.408 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.409 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.409 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.409 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Container image name, without the tag", 2024-09-21T01:52:00.409 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.409 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.409 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.409 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.409 INFO:teuthology.orchestra.run.smithi083.stdout: "container_image_elasticsearch": { 2024-09-21T01:52:00.409 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "container_image_elasticsearch", 2024-09-21T01:52:00.409 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.409 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.409 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.409 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-21T01:52:00.409 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.410 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.410 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.410 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "elasticsearch container image", 2024-09-21T01:52:00.410 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.410 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.410 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.410 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.410 INFO:teuthology.orchestra.run.smithi083.stdout: "container_image_grafana": { 2024-09-21T01:52:00.410 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "container_image_grafana", 2024-09-21T01:52:00.410 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.410 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.410 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.410 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "quay.io/ceph/grafana:10.4.8", 2024-09-21T01:52:00.410 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.411 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.411 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.411 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Prometheus container image", 2024-09-21T01:52:00.411 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.411 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.411 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.411 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.411 INFO:teuthology.orchestra.run.smithi083.stdout: "container_image_haproxy": { 2024-09-21T01:52:00.411 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "container_image_haproxy", 2024-09-21T01:52:00.411 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.411 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.411 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.411 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-21T01:52:00.412 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.412 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.412 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.412 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "HAproxy container image", 2024-09-21T01:52:00.412 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.412 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.412 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.412 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.412 INFO:teuthology.orchestra.run.smithi083.stdout: "container_image_jaeger_agent": { 2024-09-21T01:52:00.412 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "container_image_jaeger_agent", 2024-09-21T01:52:00.412 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.412 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.412 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.412 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-21T01:52:00.412 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.413 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.413 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.413 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Jaeger agent container image", 2024-09-21T01:52:00.413 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.413 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.413 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.413 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.413 INFO:teuthology.orchestra.run.smithi083.stdout: "container_image_jaeger_collector": { 2024-09-21T01:52:00.413 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "container_image_jaeger_collector", 2024-09-21T01:52:00.413 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.413 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.413 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.413 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-21T01:52:00.413 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.413 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.414 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.414 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Jaeger collector container image", 2024-09-21T01:52:00.414 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.414 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.414 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.414 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.414 INFO:teuthology.orchestra.run.smithi083.stdout: "container_image_jaeger_query": { 2024-09-21T01:52:00.414 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "container_image_jaeger_query", 2024-09-21T01:52:00.414 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.414 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.414 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.414 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-21T01:52:00.414 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.414 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.415 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.415 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Jaeger query container image", 2024-09-21T01:52:00.415 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.415 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.415 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.415 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.415 INFO:teuthology.orchestra.run.smithi083.stdout: "container_image_keepalived": { 2024-09-21T01:52:00.415 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "container_image_keepalived", 2024-09-21T01:52:00.415 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.415 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.415 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.415 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-21T01:52:00.415 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.415 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.415 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.416 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Keepalived container image", 2024-09-21T01:52:00.416 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.416 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.416 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.416 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.416 INFO:teuthology.orchestra.run.smithi083.stdout: "container_image_loki": { 2024-09-21T01:52:00.416 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "container_image_loki", 2024-09-21T01:52:00.416 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.416 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.416 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.416 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-21T01:52:00.416 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.416 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.416 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.417 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Loki container image", 2024-09-21T01:52:00.417 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.417 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.417 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.417 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.417 INFO:teuthology.orchestra.run.smithi083.stdout: "container_image_nginx": { 2024-09-21T01:52:00.417 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "container_image_nginx", 2024-09-21T01:52:00.417 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.417 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.417 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.417 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "quay.io/ceph/nginx:sclorg-nginx-126", 2024-09-21T01:52:00.417 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.417 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.417 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.418 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Nginx container image", 2024-09-21T01:52:00.418 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.418 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.418 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.418 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.418 INFO:teuthology.orchestra.run.smithi083.stdout: "container_image_node_exporter": { 2024-09-21T01:52:00.418 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "container_image_node_exporter", 2024-09-21T01:52:00.418 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.418 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.418 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.418 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.7.0", 2024-09-21T01:52:00.418 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.418 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.418 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.419 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Prometheus container image", 2024-09-21T01:52:00.419 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.419 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.419 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.419 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.419 INFO:teuthology.orchestra.run.smithi083.stdout: "container_image_nvmeof": { 2024-09-21T01:52:00.419 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "container_image_nvmeof", 2024-09-21T01:52:00.419 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.419 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.419 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.419 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.17", 2024-09-21T01:52:00.419 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.419 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.419 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.419 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Nvme-of container image", 2024-09-21T01:52:00.420 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.420 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.420 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.420 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.420 INFO:teuthology.orchestra.run.smithi083.stdout: "container_image_oauth2_proxy": { 2024-09-21T01:52:00.420 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "container_image_oauth2_proxy", 2024-09-21T01:52:00.420 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.420 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.420 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.420 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "quay.io/oauth2-proxy/oauth2-proxy:v7.6.0", 2024-09-21T01:52:00.420 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.421 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.421 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.421 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "oauth2-proxy container image", 2024-09-21T01:52:00.421 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.421 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.421 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.421 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.421 INFO:teuthology.orchestra.run.smithi083.stdout: "container_image_prometheus": { 2024-09-21T01:52:00.421 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "container_image_prometheus", 2024-09-21T01:52:00.421 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.421 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.421 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.421 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "quay.io/prometheus/prometheus:v2.51.0", 2024-09-21T01:52:00.421 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.421 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.422 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.422 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Prometheus container image", 2024-09-21T01:52:00.422 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.422 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.422 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.422 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.422 INFO:teuthology.orchestra.run.smithi083.stdout: "container_image_promtail": { 2024-09-21T01:52:00.422 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "container_image_promtail", 2024-09-21T01:52:00.422 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.422 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.422 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.422 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-21T01:52:00.422 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.423 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.423 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.423 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Promtail container image", 2024-09-21T01:52:00.423 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.423 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.423 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.423 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.423 INFO:teuthology.orchestra.run.smithi083.stdout: "container_image_samba": { 2024-09-21T01:52:00.423 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "container_image_samba", 2024-09-21T01:52:00.423 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.423 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.423 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.423 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-21T01:52:00.423 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.424 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.424 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.424 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Samba/SMB container image", 2024-09-21T01:52:00.424 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.424 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.424 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.424 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.424 INFO:teuthology.orchestra.run.smithi083.stdout: "container_image_samba_metrics": { 2024-09-21T01:52:00.424 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "container_image_samba_metrics", 2024-09-21T01:52:00.424 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.424 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.424 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.424 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "quay.io/samba.org/samba-metrics:latest", 2024-09-21T01:52:00.424 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.425 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.425 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.425 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Samba/SMB metrics exporter container image", 2024-09-21T01:52:00.425 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.425 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.425 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.425 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.425 INFO:teuthology.orchestra.run.smithi083.stdout: "container_image_snmp_gateway": { 2024-09-21T01:52:00.425 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "container_image_snmp_gateway", 2024-09-21T01:52:00.425 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.425 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.425 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.425 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-21T01:52:00.425 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.425 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.426 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.426 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "SNMP Gateway container image", 2024-09-21T01:52:00.426 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.426 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.426 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.426 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.426 INFO:teuthology.orchestra.run.smithi083.stdout: "container_init": { 2024-09-21T01:52:00.426 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "container_init", 2024-09-21T01:52:00.426 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.426 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.426 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.426 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-21T01:52:00.426 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.426 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.427 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.427 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Run podman/docker with `--init`", 2024-09-21T01:52:00.427 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.427 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.427 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.427 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.427 INFO:teuthology.orchestra.run.smithi083.stdout: "daemon_cache_timeout": { 2024-09-21T01:52:00.427 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "daemon_cache_timeout", 2024-09-21T01:52:00.427 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-09-21T01:52:00.427 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.427 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.427 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "600", 2024-09-21T01:52:00.427 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.427 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.427 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.428 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-21T01:52:00.428 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.428 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.428 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.428 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.428 INFO:teuthology.orchestra.run.smithi083.stdout: "default_cephadm_command_timeout": { 2024-09-21T01:52:00.428 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "default_cephadm_command_timeout", 2024-09-21T01:52:00.428 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:52:00.428 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.428 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.428 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "900", 2024-09-21T01:52:00.428 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.428 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.428 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.428 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-21T01:52:00.429 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.429 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.429 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.429 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.429 INFO:teuthology.orchestra.run.smithi083.stdout: "default_registry": { 2024-09-21T01:52:00.429 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "default_registry", 2024-09-21T01:52:00.429 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.429 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.429 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.429 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "docker.io", 2024-09-21T01:52:00.429 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.429 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.429 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.429 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-21T01:52:00.429 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.430 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.430 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.430 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.430 INFO:teuthology.orchestra.run.smithi083.stdout: "device_cache_timeout": { 2024-09-21T01:52:00.430 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "device_cache_timeout", 2024-09-21T01:52:00.430 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-09-21T01:52:00.430 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.430 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.430 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "1800", 2024-09-21T01:52:00.430 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.430 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.430 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.430 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "seconds to cache device inventory", 2024-09-21T01:52:00.431 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.431 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.431 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.431 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.431 INFO:teuthology.orchestra.run.smithi083.stdout: "device_enhanced_scan": { 2024-09-21T01:52:00.431 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "device_enhanced_scan", 2024-09-21T01:52:00.431 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.431 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.431 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.431 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.431 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.431 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.431 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.431 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-21T01:52:00.432 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.432 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.432 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.432 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.432 INFO:teuthology.orchestra.run.smithi083.stdout: "facts_cache_timeout": { 2024-09-21T01:52:00.432 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "facts_cache_timeout", 2024-09-21T01:52:00.432 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-09-21T01:52:00.432 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.432 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.432 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "60", 2024-09-21T01:52:00.432 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.432 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.432 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.432 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "seconds to cache host facts data", 2024-09-21T01:52:00.433 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.433 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.433 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.433 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.433 INFO:teuthology.orchestra.run.smithi083.stdout: "grafana_dashboards_path": { 2024-09-21T01:52:00.433 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "grafana_dashboards_path", 2024-09-21T01:52:00.433 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.433 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.433 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.433 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-21T01:52:00.433 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.433 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.433 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.433 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-21T01:52:00.433 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.434 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.434 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.434 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.434 INFO:teuthology.orchestra.run.smithi083.stdout: "host_check_interval": { 2024-09-21T01:52:00.434 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "host_check_interval", 2024-09-21T01:52:00.434 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-09-21T01:52:00.434 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.434 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.434 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "600", 2024-09-21T01:52:00.434 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.434 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.434 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.434 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "how frequently to perform a host check", 2024-09-21T01:52:00.435 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.435 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.435 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.435 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.435 INFO:teuthology.orchestra.run.smithi083.stdout: "hw_monitoring": { 2024-09-21T01:52:00.435 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "hw_monitoring", 2024-09-21T01:52:00.435 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.435 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.435 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.435 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.435 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.435 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.435 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.435 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-21T01:52:00.436 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.436 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.436 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.436 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.436 INFO:teuthology.orchestra.run.smithi083.stdout: "inventory_list_all": { 2024-09-21T01:52:00.436 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "inventory_list_all", 2024-09-21T01:52:00.436 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.436 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.436 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.436 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.436 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.436 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.436 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.436 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-21T01:52:00.436 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.437 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.437 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.437 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.437 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-21T01:52:00.437 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-21T01:52:00.437 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.437 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.437 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.437 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:52:00.437 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.437 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.437 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:52:00.437 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:52:00.437 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:52:00.438 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:52:00.438 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:52:00.438 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:52:00.438 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:52:00.438 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:52:00.438 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.438 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.438 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.438 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.438 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.438 INFO:teuthology.orchestra.run.smithi083.stdout: "log_refresh_metadata": { 2024-09-21T01:52:00.438 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_refresh_metadata", 2024-09-21T01:52:00.438 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.438 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.438 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.439 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.439 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.439 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.439 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.439 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-21T01:52:00.439 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.439 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.439 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.439 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.439 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-21T01:52:00.439 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-21T01:52:00.439 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.439 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.439 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.440 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-21T01:52:00.440 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.440 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.440 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.440 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-21T01:52:00.440 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.440 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.440 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.440 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.440 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-21T01:52:00.440 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-21T01:52:00.440 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.440 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.440 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.440 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-21T01:52:00.441 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.441 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.441 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:52:00.441 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:52:00.441 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:52:00.441 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:52:00.441 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:52:00.441 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:52:00.441 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:52:00.441 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:52:00.441 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.441 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.441 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.441 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.441 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.442 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-21T01:52:00.442 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-21T01:52:00.442 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.442 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.442 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.442 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.442 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.442 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.442 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.442 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.442 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.442 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.442 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.442 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.442 INFO:teuthology.orchestra.run.smithi083.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-21T01:52:00.443 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-21T01:52:00.443 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.443 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.443 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.443 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.443 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.443 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.443 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.443 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-21T01:52:00.443 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.443 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.443 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.443 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.443 INFO:teuthology.orchestra.run.smithi083.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-21T01:52:00.444 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-21T01:52:00.444 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.444 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.444 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.444 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "*", 2024-09-21T01:52:00.444 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.444 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.444 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.444 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-21T01:52:00.444 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.444 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.444 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.444 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.444 INFO:teuthology.orchestra.run.smithi083.stdout: "max_count_per_host": { 2024-09-21T01:52:00.445 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "max_count_per_host", 2024-09-21T01:52:00.445 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:52:00.445 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.445 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.445 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "10", 2024-09-21T01:52:00.445 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.445 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.445 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.445 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "max number of daemons per service per host", 2024-09-21T01:52:00.445 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.445 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.445 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.445 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.445 INFO:teuthology.orchestra.run.smithi083.stdout: "max_osd_draining_count": { 2024-09-21T01:52:00.446 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "max_osd_draining_count", 2024-09-21T01:52:00.446 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:52:00.446 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.446 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.446 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "10", 2024-09-21T01:52:00.446 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.446 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.446 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.446 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-21T01:52:00.446 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.446 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.446 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.446 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.446 INFO:teuthology.orchestra.run.smithi083.stdout: "migration_current": { 2024-09-21T01:52:00.446 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "migration_current", 2024-09-21T01:52:00.447 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:52:00.447 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.447 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.447 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:52:00.447 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.447 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.447 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.447 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "internal - do not modify", 2024-09-21T01:52:00.447 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.447 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.447 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.447 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.447 INFO:teuthology.orchestra.run.smithi083.stdout: "mode": { 2024-09-21T01:52:00.447 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "mode", 2024-09-21T01:52:00.448 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.448 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.448 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.448 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "root", 2024-09-21T01:52:00.448 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.448 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.448 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:52:00.448 INFO:teuthology.orchestra.run.smithi083.stdout: "cephadm-package", 2024-09-21T01:52:00.448 INFO:teuthology.orchestra.run.smithi083.stdout: "root" 2024-09-21T01:52:00.448 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:52:00.448 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "mode for remote execution of cephadm", 2024-09-21T01:52:00.448 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.448 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.448 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.448 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.449 INFO:teuthology.orchestra.run.smithi083.stdout: "oob_default_addr": { 2024-09-21T01:52:00.449 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "oob_default_addr", 2024-09-21T01:52:00.449 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.449 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.449 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.449 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "169.254.1.1", 2024-09-21T01:52:00.449 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.449 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.449 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.449 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-21T01:52:00.449 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.449 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.449 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.449 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.450 INFO:teuthology.orchestra.run.smithi083.stdout: "prometheus_alerts_path": { 2024-09-21T01:52:00.450 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "prometheus_alerts_path", 2024-09-21T01:52:00.450 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.450 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.450 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.450 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-21T01:52:00.450 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.450 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.450 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.450 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-21T01:52:00.450 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.450 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.450 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.450 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.451 INFO:teuthology.orchestra.run.smithi083.stdout: "registry_insecure": { 2024-09-21T01:52:00.451 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "registry_insecure", 2024-09-21T01:52:00.451 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.451 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.451 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.451 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.451 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.451 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.451 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.451 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-21T01:52:00.451 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.451 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.451 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.451 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.452 INFO:teuthology.orchestra.run.smithi083.stdout: "registry_password": { 2024-09-21T01:52:00.452 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "registry_password", 2024-09-21T01:52:00.452 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.452 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.452 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.452 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:52:00.452 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.452 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.452 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.452 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-21T01:52:00.452 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.452 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.452 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.452 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.453 INFO:teuthology.orchestra.run.smithi083.stdout: "registry_url": { 2024-09-21T01:52:00.453 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "registry_url", 2024-09-21T01:52:00.453 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.453 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.453 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.453 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:52:00.453 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.453 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.453 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.453 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-21T01:52:00.453 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.453 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.453 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.453 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.454 INFO:teuthology.orchestra.run.smithi083.stdout: "registry_username": { 2024-09-21T01:52:00.454 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "registry_username", 2024-09-21T01:52:00.454 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.454 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.454 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.454 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:52:00.454 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.454 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.454 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.454 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-21T01:52:00.454 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.454 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.454 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.454 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.455 INFO:teuthology.orchestra.run.smithi083.stdout: "secure_monitoring_stack": { 2024-09-21T01:52:00.455 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "secure_monitoring_stack", 2024-09-21T01:52:00.455 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.455 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.455 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.455 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.455 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.455 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.455 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.455 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-21T01:52:00.455 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.455 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.455 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.457 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.457 INFO:teuthology.orchestra.run.smithi083.stdout: "service_discovery_port": { 2024-09-21T01:52:00.457 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "service_discovery_port", 2024-09-21T01:52:00.458 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:52:00.458 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.458 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.458 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "8765", 2024-09-21T01:52:00.458 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.458 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.458 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.458 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "cephadm service discovery port", 2024-09-21T01:52:00.458 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.458 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.458 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.458 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.458 INFO:teuthology.orchestra.run.smithi083.stdout: "sqlite3_killpoint": { 2024-09-21T01:52:00.458 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:52:00.459 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:52:00.459 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "dev", 2024-09-21T01:52:00.459 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.459 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0", 2024-09-21T01:52:00.459 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.459 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.459 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.459 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.459 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.459 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.459 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.459 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.459 INFO:teuthology.orchestra.run.smithi083.stdout: "ssh_config_file": { 2024-09-21T01:52:00.459 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "ssh_config_file", 2024-09-21T01:52:00.459 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.460 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.460 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.460 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:52:00.460 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.460 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.460 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.460 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-21T01:52:00.460 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.460 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.460 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.460 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.460 INFO:teuthology.orchestra.run.smithi083.stdout: "ssh_keepalive_count_max": { 2024-09-21T01:52:00.460 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "ssh_keepalive_count_max", 2024-09-21T01:52:00.460 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:52:00.461 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.461 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.461 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "3", 2024-09-21T01:52:00.461 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.461 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.461 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.461 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "How many times ssh connections can fail liveness checks before the host is marked offline", 2024-09-21T01:52:00.461 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.461 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.461 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.461 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.461 INFO:teuthology.orchestra.run.smithi083.stdout: "ssh_keepalive_interval": { 2024-09-21T01:52:00.461 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "ssh_keepalive_interval", 2024-09-21T01:52:00.461 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:52:00.462 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.462 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.462 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "7", 2024-09-21T01:52:00.462 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.462 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.462 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.462 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "How often ssh connections are checked for liveness", 2024-09-21T01:52:00.462 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.462 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.462 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.462 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.462 INFO:teuthology.orchestra.run.smithi083.stdout: "use_agent": { 2024-09-21T01:52:00.462 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "use_agent", 2024-09-21T01:52:00.462 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.463 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.463 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.463 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.463 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.463 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.463 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.463 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-21T01:52:00.463 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.463 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.463 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.463 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.463 INFO:teuthology.orchestra.run.smithi083.stdout: "use_repo_digest": { 2024-09-21T01:52:00.463 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "use_repo_digest", 2024-09-21T01:52:00.463 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.464 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.464 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.464 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-21T01:52:00.464 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.464 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.464 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.464 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-21T01:52:00.464 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.464 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.464 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.464 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.464 INFO:teuthology.orchestra.run.smithi083.stdout: "warn_on_failed_host_check": { 2024-09-21T01:52:00.464 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "warn_on_failed_host_check", 2024-09-21T01:52:00.464 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.464 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.465 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.465 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-21T01:52:00.465 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.465 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.465 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.465 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "raise a health warning if the host check fails", 2024-09-21T01:52:00.465 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.465 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.465 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.465 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.465 INFO:teuthology.orchestra.run.smithi083.stdout: "warn_on_stray_daemons": { 2024-09-21T01:52:00.465 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "warn_on_stray_daemons", 2024-09-21T01:52:00.465 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.465 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.466 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.466 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-21T01:52:00.466 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.466 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.466 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.466 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-21T01:52:00.466 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.466 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.466 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.466 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.466 INFO:teuthology.orchestra.run.smithi083.stdout: "warn_on_stray_hosts": { 2024-09-21T01:52:00.466 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "warn_on_stray_hosts", 2024-09-21T01:52:00.467 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.467 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.467 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.467 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-21T01:52:00.467 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.467 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.467 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.467 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-21T01:52:00.467 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.467 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.467 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.467 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:52:00.467 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:52:00.467 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.467 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-21T01:52:00.468 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "crash", 2024-09-21T01:52:00.468 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-21T01:52:00.468 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-21T01:52:00.468 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-21T01:52:00.468 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-21T01:52:00.468 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-21T01:52:00.468 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.468 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.468 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.468 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:52:00.468 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.468 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.468 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:52:00.468 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:52:00.468 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:52:00.469 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:52:00.469 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:52:00.469 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:52:00.469 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:52:00.469 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:52:00.469 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.469 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.469 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.469 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.469 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.469 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-21T01:52:00.469 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-21T01:52:00.469 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.469 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.470 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.470 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.470 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.470 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.470 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.470 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.470 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.470 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.470 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.470 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.470 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-21T01:52:00.470 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-21T01:52:00.470 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.470 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.470 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.471 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-21T01:52:00.471 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.471 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.471 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:52:00.471 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:52:00.471 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:52:00.471 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:52:00.471 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:52:00.471 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:52:00.471 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:52:00.471 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:52:00.471 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.471 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.471 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.472 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.472 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.472 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-21T01:52:00.472 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-21T01:52:00.472 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.472 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.472 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.472 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.472 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.472 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.472 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.472 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.472 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.472 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.472 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.473 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.473 INFO:teuthology.orchestra.run.smithi083.stdout: "retain_interval": { 2024-09-21T01:52:00.473 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "retain_interval", 2024-09-21T01:52:00.473 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-09-21T01:52:00.473 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.473 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.473 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "31536000", 2024-09-21T01:52:00.473 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.473 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.473 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.473 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-21T01:52:00.473 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.473 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.473 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.474 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.474 INFO:teuthology.orchestra.run.smithi083.stdout: "sqlite3_killpoint": { 2024-09-21T01:52:00.474 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:52:00.474 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:52:00.474 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "dev", 2024-09-21T01:52:00.474 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.474 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0", 2024-09-21T01:52:00.474 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.474 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.474 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.474 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.474 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.474 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.474 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.474 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.475 INFO:teuthology.orchestra.run.smithi083.stdout: "warn_recent_interval": { 2024-09-21T01:52:00.475 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "warn_recent_interval", 2024-09-21T01:52:00.475 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-09-21T01:52:00.475 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.475 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.475 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "1209600", 2024-09-21T01:52:00.475 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.475 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.475 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.475 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-21T01:52:00.475 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.475 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.475 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.475 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:52:00.475 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:52:00.476 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.476 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-21T01:52:00.476 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "dashboard", 2024-09-21T01:52:00.476 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-21T01:52:00.476 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-21T01:52:00.476 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-21T01:52:00.476 INFO:teuthology.orchestra.run.smithi083.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-21T01:52:00.476 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-21T01:52:00.476 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:52:00.476 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.476 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.476 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "10", 2024-09-21T01:52:00.476 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.476 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.476 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.477 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.477 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.477 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.477 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.477 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.477 INFO:teuthology.orchestra.run.smithi083.stdout: "ALERTMANAGER_API_HOST": { 2024-09-21T01:52:00.477 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-21T01:52:00.477 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.477 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.477 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.477 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:52:00.477 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.477 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.477 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.477 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.478 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.478 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.478 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.478 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.478 INFO:teuthology.orchestra.run.smithi083.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-21T01:52:00.478 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-21T01:52:00.478 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.478 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.478 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.478 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-21T01:52:00.478 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.478 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.478 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.478 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.479 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.479 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.479 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.479 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.479 INFO:teuthology.orchestra.run.smithi083.stdout: "AUDIT_API_ENABLED": { 2024-09-21T01:52:00.479 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "AUDIT_API_ENABLED", 2024-09-21T01:52:00.479 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.479 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.479 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.479 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.479 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.479 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.479 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.479 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.479 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.480 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.480 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.480 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.480 INFO:teuthology.orchestra.run.smithi083.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-21T01:52:00.480 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-21T01:52:00.480 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.480 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.480 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.480 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-21T01:52:00.480 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.480 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.480 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.480 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.480 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.480 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.481 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.481 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.481 INFO:teuthology.orchestra.run.smithi083.stdout: "ENABLE_BROWSABLE_API": { 2024-09-21T01:52:00.481 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-21T01:52:00.481 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.481 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.481 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.481 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-21T01:52:00.481 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.481 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.481 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.481 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.481 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.481 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.482 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.482 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.482 INFO:teuthology.orchestra.run.smithi083.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-21T01:52:00.482 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-21T01:52:00.482 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.482 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.482 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.482 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-21T01:52:00.482 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.482 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.482 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.482 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.482 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.483 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.483 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.483 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.483 INFO:teuthology.orchestra.run.smithi083.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-21T01:52:00.483 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-21T01:52:00.483 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.483 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.483 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.483 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-21T01:52:00.483 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.483 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.484 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.484 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.484 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.484 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.484 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.484 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.484 INFO:teuthology.orchestra.run.smithi083.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-21T01:52:00.484 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-21T01:52:00.484 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.484 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.484 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.484 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-21T01:52:00.484 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.484 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.485 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.485 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.485 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.485 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.485 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.485 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.485 INFO:teuthology.orchestra.run.smithi083.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-21T01:52:00.485 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-21T01:52:00.485 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.485 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.485 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.485 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-21T01:52:00.485 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.485 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.485 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.486 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.486 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.486 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.486 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.486 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.486 INFO:teuthology.orchestra.run.smithi083.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-21T01:52:00.486 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-21T01:52:00.486 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.486 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.486 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.486 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-21T01:52:00.486 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.486 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.486 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.487 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.487 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.487 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.487 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.487 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.487 INFO:teuthology.orchestra.run.smithi083.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-21T01:52:00.487 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-21T01:52:00.487 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.487 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.487 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.487 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-21T01:52:00.487 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.487 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.487 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.488 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.488 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.488 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.488 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.488 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.488 INFO:teuthology.orchestra.run.smithi083.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-21T01:52:00.488 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-21T01:52:00.488 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.488 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.488 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.488 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-21T01:52:00.488 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.488 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.488 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.488 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.489 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.489 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.489 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.489 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.489 INFO:teuthology.orchestra.run.smithi083.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-21T01:52:00.489 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-21T01:52:00.489 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.489 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.489 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.489 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:52:00.489 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.489 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.489 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.489 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.489 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.490 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.490 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.490 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.490 INFO:teuthology.orchestra.run.smithi083.stdout: "GRAFANA_API_PASSWORD": { 2024-09-21T01:52:00.490 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-21T01:52:00.490 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.490 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.490 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.490 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "admin", 2024-09-21T01:52:00.490 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.490 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.490 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.490 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.490 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.491 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.491 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.491 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.491 INFO:teuthology.orchestra.run.smithi083.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-21T01:52:00.491 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-21T01:52:00.491 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.491 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.491 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.491 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-21T01:52:00.491 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.491 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.491 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.491 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.491 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.491 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.492 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.492 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.492 INFO:teuthology.orchestra.run.smithi083.stdout: "GRAFANA_API_URL": { 2024-09-21T01:52:00.492 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "GRAFANA_API_URL", 2024-09-21T01:52:00.492 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.492 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.492 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.492 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:52:00.492 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.492 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.492 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.492 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.492 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.492 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.492 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.493 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.493 INFO:teuthology.orchestra.run.smithi083.stdout: "GRAFANA_API_USERNAME": { 2024-09-21T01:52:00.493 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-21T01:52:00.493 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.493 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.493 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.493 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "admin", 2024-09-21T01:52:00.493 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.493 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.493 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.493 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.493 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.493 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.493 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.493 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.494 INFO:teuthology.orchestra.run.smithi083.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-21T01:52:00.494 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-21T01:52:00.494 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.494 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.494 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.494 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:52:00.494 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.494 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.494 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.494 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.494 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.494 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.494 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.494 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.495 INFO:teuthology.orchestra.run.smithi083.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-21T01:52:00.495 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-21T01:52:00.495 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.495 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.495 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.495 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.495 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.495 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.495 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.495 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.495 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.495 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.495 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.495 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.495 INFO:teuthology.orchestra.run.smithi083.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-21T01:52:00.496 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-21T01:52:00.496 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.496 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.496 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.496 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-21T01:52:00.496 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.496 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.496 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.496 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.496 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.496 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.496 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.496 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.496 INFO:teuthology.orchestra.run.smithi083.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-21T01:52:00.496 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-21T01:52:00.497 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.497 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.497 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.497 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:52:00.497 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.497 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.497 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.497 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.497 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.497 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.497 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.497 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.497 INFO:teuthology.orchestra.run.smithi083.stdout: "MANAGED_BY_CLUSTERS": { 2024-09-21T01:52:00.497 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-09-21T01:52:00.498 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.498 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.498 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.498 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "[]", 2024-09-21T01:52:00.498 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.498 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.498 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.498 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.498 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.498 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.498 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.498 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.498 INFO:teuthology.orchestra.run.smithi083.stdout: "MULTICLUSTER_CONFIG": { 2024-09-21T01:52:00.498 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "MULTICLUSTER_CONFIG", 2024-09-21T01:52:00.498 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.499 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.499 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.499 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "{}", 2024-09-21T01:52:00.499 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.499 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.499 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.499 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.499 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.499 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.499 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.499 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.499 INFO:teuthology.orchestra.run.smithi083.stdout: "PROMETHEUS_API_HOST": { 2024-09-21T01:52:00.499 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-21T01:52:00.499 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.500 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.500 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.500 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:52:00.500 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.500 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.500 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.500 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.500 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.500 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.500 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.500 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.500 INFO:teuthology.orchestra.run.smithi083.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-21T01:52:00.500 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-21T01:52:00.500 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.501 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.501 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.501 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-21T01:52:00.501 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.501 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.501 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.501 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.501 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.501 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.501 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.501 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.501 INFO:teuthology.orchestra.run.smithi083.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-21T01:52:00.501 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-21T01:52:00.501 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.501 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.502 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.502 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.502 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.502 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.502 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.502 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.502 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.502 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.502 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.502 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.502 INFO:teuthology.orchestra.run.smithi083.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-21T01:52:00.502 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-21T01:52:00.502 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.502 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.503 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.503 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.503 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.503 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.503 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.503 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.503 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.503 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.503 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.503 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.503 INFO:teuthology.orchestra.run.smithi083.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-21T01:52:00.503 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-21T01:52:00.503 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.503 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.503 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.504 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-21T01:52:00.504 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.504 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.504 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.504 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.504 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.504 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.504 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.504 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.504 INFO:teuthology.orchestra.run.smithi083.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-21T01:52:00.504 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-21T01:52:00.504 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.504 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.504 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.504 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-21T01:52:00.505 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.505 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.505 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.505 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.505 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.505 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.505 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.505 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.505 INFO:teuthology.orchestra.run.smithi083.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-21T01:52:00.505 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-21T01:52:00.505 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.505 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.505 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.505 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.506 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.506 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.506 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.506 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.506 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.506 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.506 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.506 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.506 INFO:teuthology.orchestra.run.smithi083.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-21T01:52:00.506 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-21T01:52:00.506 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.506 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.506 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.506 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.506 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.507 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.507 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.507 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.507 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.507 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.507 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.507 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.507 INFO:teuthology.orchestra.run.smithi083.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-21T01:52:00.507 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-21T01:52:00.507 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.507 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.507 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.507 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.507 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.507 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.508 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.508 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.508 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.508 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.508 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.508 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.508 INFO:teuthology.orchestra.run.smithi083.stdout: "PWD_POLICY_ENABLED": { 2024-09-21T01:52:00.508 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-21T01:52:00.508 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.508 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.508 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.508 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-21T01:52:00.508 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.508 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.509 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.509 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.509 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.509 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.509 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.509 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.509 INFO:teuthology.orchestra.run.smithi083.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-21T01:52:00.509 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-21T01:52:00.509 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.509 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.509 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.509 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-21T01:52:00.509 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.509 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.509 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.510 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.510 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.510 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.510 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.510 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.510 INFO:teuthology.orchestra.run.smithi083.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-21T01:52:00.510 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-21T01:52:00.510 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:52:00.510 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.510 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.510 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "10", 2024-09-21T01:52:00.510 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.510 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.510 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.510 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.511 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.511 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.511 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.511 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.511 INFO:teuthology.orchestra.run.smithi083.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-21T01:52:00.511 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-21T01:52:00.511 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:52:00.511 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.511 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.511 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "8", 2024-09-21T01:52:00.511 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.511 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.511 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.511 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.511 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.512 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.512 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.512 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.512 INFO:teuthology.orchestra.run.smithi083.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-21T01:52:00.512 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-21T01:52:00.512 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:52:00.512 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.512 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.512 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "45", 2024-09-21T01:52:00.512 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.512 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.512 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.512 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.512 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.513 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.513 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.513 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.513 INFO:teuthology.orchestra.run.smithi083.stdout: "RGW_API_ACCESS_KEY": { 2024-09-21T01:52:00.513 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-21T01:52:00.513 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.513 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.513 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.513 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:52:00.513 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.513 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.513 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.513 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.513 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.513 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.514 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.514 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.514 INFO:teuthology.orchestra.run.smithi083.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-21T01:52:00.514 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-21T01:52:00.514 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.514 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.514 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.514 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "admin", 2024-09-21T01:52:00.514 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.514 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.514 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.514 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.514 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.514 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.515 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.515 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.515 INFO:teuthology.orchestra.run.smithi083.stdout: "RGW_API_SECRET_KEY": { 2024-09-21T01:52:00.515 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-21T01:52:00.515 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.515 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.515 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.515 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:52:00.515 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.515 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.515 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.515 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.515 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.515 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.515 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.516 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.516 INFO:teuthology.orchestra.run.smithi083.stdout: "RGW_API_SSL_VERIFY": { 2024-09-21T01:52:00.516 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-21T01:52:00.516 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.516 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.516 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.516 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-21T01:52:00.516 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.516 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.516 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.516 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.516 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.516 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.516 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.517 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.517 INFO:teuthology.orchestra.run.smithi083.stdout: "UNSAFE_TLS_v1_2": { 2024-09-21T01:52:00.517 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "UNSAFE_TLS_v1_2", 2024-09-21T01:52:00.517 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.517 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.517 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.517 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.517 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.517 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.517 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.517 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.517 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.517 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.517 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.518 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.518 INFO:teuthology.orchestra.run.smithi083.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-21T01:52:00.518 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-21T01:52:00.518 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:52:00.518 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.518 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.518 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0", 2024-09-21T01:52:00.518 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.518 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.518 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.518 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.518 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.518 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.518 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.518 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.519 INFO:teuthology.orchestra.run.smithi083.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-21T01:52:00.519 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-21T01:52:00.519 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:52:00.519 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.519 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.519 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "10", 2024-09-21T01:52:00.519 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.519 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.519 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.519 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.519 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.519 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.519 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.519 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.519 INFO:teuthology.orchestra.run.smithi083.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-21T01:52:00.520 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-21T01:52:00.520 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:52:00.520 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.520 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.520 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "5", 2024-09-21T01:52:00.520 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.520 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.520 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.520 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.520 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.520 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.520 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.520 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.520 INFO:teuthology.orchestra.run.smithi083.stdout: "cross_origin_url": { 2024-09-21T01:52:00.520 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "cross_origin_url", 2024-09-21T01:52:00.521 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.521 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.521 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.521 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:52:00.521 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.521 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.521 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.521 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.521 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.521 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.521 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.521 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.521 INFO:teuthology.orchestra.run.smithi083.stdout: "crt_file": { 2024-09-21T01:52:00.521 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "crt_file", 2024-09-21T01:52:00.522 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.522 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.522 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.522 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:52:00.522 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.522 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.522 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.522 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.522 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.522 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.522 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.522 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.522 INFO:teuthology.orchestra.run.smithi083.stdout: "debug": { 2024-09-21T01:52:00.522 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "debug", 2024-09-21T01:52:00.522 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.523 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.523 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.523 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.523 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.523 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.523 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.523 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Enable/disable debug options", 2024-09-21T01:52:00.523 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.523 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.523 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.523 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.523 INFO:teuthology.orchestra.run.smithi083.stdout: "jwt_token_ttl": { 2024-09-21T01:52:00.523 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "jwt_token_ttl", 2024-09-21T01:52:00.523 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:52:00.523 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.524 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.524 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "28800", 2024-09-21T01:52:00.524 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.524 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.524 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.524 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.524 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.524 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.524 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.524 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.524 INFO:teuthology.orchestra.run.smithi083.stdout: "key_file": { 2024-09-21T01:52:00.524 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "key_file", 2024-09-21T01:52:00.524 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.524 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.525 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.525 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:52:00.525 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.525 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.525 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.525 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.525 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.525 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.525 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.525 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.525 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-21T01:52:00.525 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-21T01:52:00.525 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.525 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.525 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.526 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:52:00.526 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.526 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.526 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:52:00.526 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:52:00.526 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:52:00.526 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:52:00.526 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:52:00.526 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:52:00.526 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:52:00.526 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:52:00.526 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.526 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.526 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.527 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.527 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.527 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-21T01:52:00.527 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-21T01:52:00.527 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.527 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.527 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.527 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.527 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.527 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.527 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.527 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.527 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.527 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.527 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.528 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.528 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-21T01:52:00.528 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-21T01:52:00.528 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.528 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.528 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.528 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-21T01:52:00.528 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.528 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.528 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:52:00.528 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:52:00.528 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:52:00.528 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:52:00.528 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:52:00.529 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:52:00.529 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:52:00.529 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:52:00.529 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.529 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.529 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.529 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.529 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.529 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-21T01:52:00.529 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-21T01:52:00.529 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.529 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.529 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.529 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.530 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.530 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.530 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.530 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.530 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.530 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.530 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.530 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.530 INFO:teuthology.orchestra.run.smithi083.stdout: "motd": { 2024-09-21T01:52:00.530 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "motd", 2024-09-21T01:52:00.530 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.530 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.530 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.530 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:52:00.531 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.531 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.531 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.531 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "The message of the day", 2024-09-21T01:52:00.531 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.531 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.531 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.531 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.531 INFO:teuthology.orchestra.run.smithi083.stdout: "redirect_resolve_ip_addr": { 2024-09-21T01:52:00.531 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "redirect_resolve_ip_addr", 2024-09-21T01:52:00.531 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.531 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.531 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.531 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.531 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.532 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.532 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.532 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.532 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.532 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.532 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.532 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.532 INFO:teuthology.orchestra.run.smithi083.stdout: "server_addr": { 2024-09-21T01:52:00.532 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "server_addr", 2024-09-21T01:52:00.532 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.532 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.532 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.532 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "::", 2024-09-21T01:52:00.532 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.533 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.533 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.533 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.533 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.533 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.533 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.533 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.533 INFO:teuthology.orchestra.run.smithi083.stdout: "server_port": { 2024-09-21T01:52:00.533 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "server_port", 2024-09-21T01:52:00.533 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:52:00.533 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.533 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.533 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "8080", 2024-09-21T01:52:00.533 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.533 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.534 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.534 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.534 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.534 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.534 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.534 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.534 INFO:teuthology.orchestra.run.smithi083.stdout: "sqlite3_killpoint": { 2024-09-21T01:52:00.534 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:52:00.534 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:52:00.534 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "dev", 2024-09-21T01:52:00.534 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.534 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0", 2024-09-21T01:52:00.534 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.535 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.535 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.535 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.535 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.535 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.535 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.535 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.535 INFO:teuthology.orchestra.run.smithi083.stdout: "ssl": { 2024-09-21T01:52:00.535 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "ssl", 2024-09-21T01:52:00.535 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.535 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.535 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.535 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-21T01:52:00.535 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.536 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.536 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.536 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.536 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.536 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.536 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.536 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.536 INFO:teuthology.orchestra.run.smithi083.stdout: "ssl_server_port": { 2024-09-21T01:52:00.536 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "ssl_server_port", 2024-09-21T01:52:00.536 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:52:00.536 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.536 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.536 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "8443", 2024-09-21T01:52:00.536 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.536 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.537 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.537 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.537 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.537 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.537 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.537 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.537 INFO:teuthology.orchestra.run.smithi083.stdout: "sso_oauth2": { 2024-09-21T01:52:00.537 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "sso_oauth2", 2024-09-21T01:52:00.537 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.537 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.537 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.537 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.537 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.537 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.537 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.538 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.538 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.538 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.538 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.538 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.538 INFO:teuthology.orchestra.run.smithi083.stdout: "standby_behaviour": { 2024-09-21T01:52:00.538 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "standby_behaviour", 2024-09-21T01:52:00.538 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.538 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.538 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.538 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "redirect", 2024-09-21T01:52:00.538 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.538 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.538 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:52:00.539 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:52:00.539 INFO:teuthology.orchestra.run.smithi083.stdout: "redirect" 2024-09-21T01:52:00.539 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:52:00.539 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.539 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.539 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.539 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.539 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.539 INFO:teuthology.orchestra.run.smithi083.stdout: "standby_error_status_code": { 2024-09-21T01:52:00.539 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "standby_error_status_code", 2024-09-21T01:52:00.539 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:52:00.539 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.539 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.539 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "500", 2024-09-21T01:52:00.539 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "400", 2024-09-21T01:52:00.540 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "599", 2024-09-21T01:52:00.540 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.540 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.540 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.540 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.540 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.540 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.540 INFO:teuthology.orchestra.run.smithi083.stdout: "url_prefix": { 2024-09-21T01:52:00.540 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "url_prefix", 2024-09-21T01:52:00.540 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.540 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.540 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.540 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:52:00.540 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.540 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.541 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.541 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.541 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.541 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.541 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.541 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:52:00.541 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:52:00.541 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.541 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-21T01:52:00.541 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "devicehealth", 2024-09-21T01:52:00.541 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-21T01:52:00.541 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-21T01:52:00.541 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-21T01:52:00.541 INFO:teuthology.orchestra.run.smithi083.stdout: "enable_monitoring": { 2024-09-21T01:52:00.542 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "enable_monitoring", 2024-09-21T01:52:00.542 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.542 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.542 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.542 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-21T01:52:00.542 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.542 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.542 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.542 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "monitor device health metrics", 2024-09-21T01:52:00.542 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.542 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.542 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.542 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.542 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-21T01:52:00.542 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-21T01:52:00.543 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.543 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.543 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.543 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:52:00.543 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.543 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.543 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:52:00.543 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:52:00.543 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:52:00.543 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:52:00.543 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:52:00.543 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:52:00.543 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:52:00.543 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:52:00.543 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.544 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.544 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.544 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.544 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.544 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-21T01:52:00.544 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-21T01:52:00.544 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.544 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.544 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.544 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.544 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.544 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.544 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.544 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.545 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.545 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.545 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.545 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.545 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-21T01:52:00.545 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-21T01:52:00.545 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.545 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.545 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.545 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-21T01:52:00.545 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.545 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.545 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:52:00.545 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:52:00.546 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:52:00.546 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:52:00.546 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:52:00.546 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:52:00.546 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:52:00.546 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:52:00.546 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.546 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.546 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.546 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.546 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.546 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-21T01:52:00.546 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-21T01:52:00.546 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.546 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.547 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.547 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.547 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.547 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.547 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.547 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.547 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.547 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.547 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.547 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.547 INFO:teuthology.orchestra.run.smithi083.stdout: "mark_out_threshold": { 2024-09-21T01:52:00.547 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "mark_out_threshold", 2024-09-21T01:52:00.547 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-09-21T01:52:00.547 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.548 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.548 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "2419200", 2024-09-21T01:52:00.548 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.548 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.548 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.548 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-21T01:52:00.548 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.548 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.548 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.548 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.548 INFO:teuthology.orchestra.run.smithi083.stdout: "pool_name": { 2024-09-21T01:52:00.548 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "pool_name", 2024-09-21T01:52:00.548 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.548 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.548 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.549 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "device_health_metrics", 2024-09-21T01:52:00.549 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.549 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.549 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.549 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-21T01:52:00.549 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.549 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.549 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.549 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.549 INFO:teuthology.orchestra.run.smithi083.stdout: "retention_period": { 2024-09-21T01:52:00.549 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "retention_period", 2024-09-21T01:52:00.549 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-09-21T01:52:00.549 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.549 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.549 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "15552000", 2024-09-21T01:52:00.550 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.550 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.550 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.550 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "how long to retain device health metrics", 2024-09-21T01:52:00.550 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.550 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.550 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.550 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.550 INFO:teuthology.orchestra.run.smithi083.stdout: "scrape_frequency": { 2024-09-21T01:52:00.550 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "scrape_frequency", 2024-09-21T01:52:00.550 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-09-21T01:52:00.550 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.550 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.550 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "86400", 2024-09-21T01:52:00.551 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.551 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.551 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.551 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-21T01:52:00.551 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.551 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.551 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.551 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.551 INFO:teuthology.orchestra.run.smithi083.stdout: "self_heal": { 2024-09-21T01:52:00.551 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "self_heal", 2024-09-21T01:52:00.551 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.551 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.551 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.551 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-21T01:52:00.551 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.552 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.552 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.552 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-21T01:52:00.552 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.552 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.552 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.552 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.552 INFO:teuthology.orchestra.run.smithi083.stdout: "sleep_interval": { 2024-09-21T01:52:00.552 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "sleep_interval", 2024-09-21T01:52:00.552 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-09-21T01:52:00.552 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.552 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.552 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "600", 2024-09-21T01:52:00.552 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.552 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.553 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.553 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "how frequently to wake up and check device health", 2024-09-21T01:52:00.553 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.553 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.553 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.553 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.553 INFO:teuthology.orchestra.run.smithi083.stdout: "sqlite3_killpoint": { 2024-09-21T01:52:00.553 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:52:00.553 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:52:00.553 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "dev", 2024-09-21T01:52:00.553 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.553 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0", 2024-09-21T01:52:00.553 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.553 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.553 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.554 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.554 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.554 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.554 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.554 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.554 INFO:teuthology.orchestra.run.smithi083.stdout: "warn_threshold": { 2024-09-21T01:52:00.554 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "warn_threshold", 2024-09-21T01:52:00.554 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-09-21T01:52:00.554 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.554 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.554 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "7257600", 2024-09-21T01:52:00.554 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.554 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.554 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.554 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-21T01:52:00.555 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.555 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.555 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.555 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:52:00.555 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:52:00.555 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.555 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-21T01:52:00.555 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "diskprediction_local", 2024-09-21T01:52:00.555 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-21T01:52:00.555 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-21T01:52:00.555 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-21T01:52:00.555 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-21T01:52:00.555 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-21T01:52:00.555 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.556 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.556 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.556 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:52:00.556 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.556 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.556 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:52:00.556 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:52:00.556 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:52:00.556 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:52:00.556 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:52:00.556 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:52:00.556 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:52:00.556 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:52:00.556 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.556 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.557 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.557 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.557 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.557 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-21T01:52:00.557 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-21T01:52:00.557 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.557 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.557 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.557 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.557 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.557 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.557 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.557 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.557 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.557 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.558 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.558 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.558 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-21T01:52:00.558 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-21T01:52:00.558 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.558 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.558 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.558 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-21T01:52:00.558 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.558 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.558 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:52:00.558 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:52:00.558 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:52:00.558 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:52:00.559 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:52:00.559 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:52:00.559 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:52:00.559 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:52:00.559 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.559 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.559 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.559 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.559 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.559 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-21T01:52:00.559 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-21T01:52:00.559 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.559 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.560 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.560 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.560 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.560 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.560 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.560 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.560 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.560 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.560 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.560 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.560 INFO:teuthology.orchestra.run.smithi083.stdout: "predict_interval": { 2024-09-21T01:52:00.560 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "predict_interval", 2024-09-21T01:52:00.560 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.560 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.561 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.561 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "86400", 2024-09-21T01:52:00.561 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.561 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.561 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.561 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.561 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.561 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.561 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.561 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.561 INFO:teuthology.orchestra.run.smithi083.stdout: "predictor_model": { 2024-09-21T01:52:00.561 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "predictor_model", 2024-09-21T01:52:00.561 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.561 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.562 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.562 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "prophetstor", 2024-09-21T01:52:00.562 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.562 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.562 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.562 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.562 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.562 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.562 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.562 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.562 INFO:teuthology.orchestra.run.smithi083.stdout: "sleep_interval": { 2024-09-21T01:52:00.562 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "sleep_interval", 2024-09-21T01:52:00.562 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.562 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.563 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.563 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "600", 2024-09-21T01:52:00.563 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.563 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.563 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.563 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.563 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.563 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.563 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.563 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.563 INFO:teuthology.orchestra.run.smithi083.stdout: "sqlite3_killpoint": { 2024-09-21T01:52:00.563 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:52:00.563 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:52:00.563 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "dev", 2024-09-21T01:52:00.563 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.564 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0", 2024-09-21T01:52:00.564 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.564 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.564 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.564 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.564 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.564 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.564 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.564 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:52:00.564 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:52:00.564 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.564 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-21T01:52:00.564 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "influx", 2024-09-21T01:52:00.564 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": false, 2024-09-21T01:52:00.564 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "influxdb python module not found", 2024-09-21T01:52:00.565 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-21T01:52:00.565 INFO:teuthology.orchestra.run.smithi083.stdout: "batch_size": { 2024-09-21T01:52:00.565 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "batch_size", 2024-09-21T01:52:00.565 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:52:00.565 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.565 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.565 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "5000", 2024-09-21T01:52:00.565 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.565 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.565 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.565 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-21T01:52:00.565 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.565 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.565 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.566 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.566 INFO:teuthology.orchestra.run.smithi083.stdout: "database": { 2024-09-21T01:52:00.566 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "database", 2024-09-21T01:52:00.566 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.566 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.566 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.566 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "ceph", 2024-09-21T01:52:00.566 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.566 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.566 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.566 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-21T01:52:00.566 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.566 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.566 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.567 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.567 INFO:teuthology.orchestra.run.smithi083.stdout: "hostname": { 2024-09-21T01:52:00.567 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "hostname", 2024-09-21T01:52:00.567 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.567 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.567 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.567 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:52:00.567 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.567 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.567 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.567 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "InfluxDB server hostname", 2024-09-21T01:52:00.567 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.567 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.567 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.567 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.568 INFO:teuthology.orchestra.run.smithi083.stdout: "interval": { 2024-09-21T01:52:00.568 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "interval", 2024-09-21T01:52:00.568 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-09-21T01:52:00.568 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.568 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.568 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "30", 2024-09-21T01:52:00.568 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "5", 2024-09-21T01:52:00.568 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.568 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.568 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-21T01:52:00.568 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.568 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.568 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.568 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.568 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-21T01:52:00.569 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-21T01:52:00.569 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.569 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.569 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.569 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:52:00.569 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.569 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.569 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:52:00.569 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:52:00.569 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:52:00.569 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:52:00.569 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:52:00.569 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:52:00.569 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:52:00.569 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:52:00.570 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.570 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.570 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.570 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.570 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.570 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-21T01:52:00.570 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-21T01:52:00.570 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.570 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.570 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.570 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.570 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.570 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.570 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.570 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.571 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.571 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.571 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.571 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.571 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-21T01:52:00.571 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-21T01:52:00.571 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.571 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.571 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.571 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-21T01:52:00.571 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.571 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.571 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:52:00.571 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:52:00.572 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:52:00.572 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:52:00.572 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:52:00.572 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:52:00.572 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:52:00.572 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:52:00.572 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.572 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.572 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.572 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.572 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.572 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-21T01:52:00.572 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-21T01:52:00.572 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.572 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.573 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.573 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.573 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.573 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.573 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.573 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.573 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.573 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.573 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.573 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.573 INFO:teuthology.orchestra.run.smithi083.stdout: "password": { 2024-09-21T01:52:00.573 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "password", 2024-09-21T01:52:00.573 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.573 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.573 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.574 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:52:00.574 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.574 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.574 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.574 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "password of InfluxDB server user", 2024-09-21T01:52:00.574 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.574 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.574 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.574 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.574 INFO:teuthology.orchestra.run.smithi083.stdout: "port": { 2024-09-21T01:52:00.574 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "port", 2024-09-21T01:52:00.574 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:52:00.574 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.574 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.575 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "8086", 2024-09-21T01:52:00.575 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.575 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.575 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.575 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "InfluxDB server port", 2024-09-21T01:52:00.575 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.575 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.575 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.575 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.575 INFO:teuthology.orchestra.run.smithi083.stdout: "sqlite3_killpoint": { 2024-09-21T01:52:00.575 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:52:00.575 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:52:00.575 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "dev", 2024-09-21T01:52:00.575 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.575 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0", 2024-09-21T01:52:00.576 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.576 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.576 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.576 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.576 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.576 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.576 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.576 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.576 INFO:teuthology.orchestra.run.smithi083.stdout: "ssl": { 2024-09-21T01:52:00.576 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "ssl", 2024-09-21T01:52:00.576 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.576 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.576 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.576 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "false", 2024-09-21T01:52:00.577 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.577 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.577 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.577 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-21T01:52:00.577 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.577 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.577 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.577 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.577 INFO:teuthology.orchestra.run.smithi083.stdout: "threads": { 2024-09-21T01:52:00.577 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "threads", 2024-09-21T01:52:00.577 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:52:00.577 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.577 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.577 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "5", 2024-09-21T01:52:00.577 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "1", 2024-09-21T01:52:00.578 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "32", 2024-09-21T01:52:00.578 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.578 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-21T01:52:00.578 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.578 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.578 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.578 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.578 INFO:teuthology.orchestra.run.smithi083.stdout: "username": { 2024-09-21T01:52:00.578 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "username", 2024-09-21T01:52:00.578 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.578 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.578 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.578 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:52:00.578 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.578 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.579 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.579 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "username of InfluxDB server user", 2024-09-21T01:52:00.579 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.579 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.579 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.579 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.579 INFO:teuthology.orchestra.run.smithi083.stdout: "verify_ssl": { 2024-09-21T01:52:00.579 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "verify_ssl", 2024-09-21T01:52:00.579 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.579 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.579 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.579 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "true", 2024-09-21T01:52:00.579 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.579 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.580 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.580 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-21T01:52:00.580 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.580 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.580 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.580 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:52:00.580 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:52:00.580 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.580 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-21T01:52:00.580 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "insights", 2024-09-21T01:52:00.580 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-21T01:52:00.580 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-21T01:52:00.580 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-21T01:52:00.580 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-21T01:52:00.581 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-21T01:52:00.581 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.581 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.581 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.581 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:52:00.581 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.581 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.581 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:52:00.581 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:52:00.581 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:52:00.582 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:52:00.582 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:52:00.582 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:52:00.582 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:52:00.582 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:52:00.582 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.582 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.582 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.582 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.582 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.582 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-21T01:52:00.582 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-21T01:52:00.582 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.583 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.583 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.583 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.583 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.583 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.583 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.583 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.583 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.583 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.583 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.583 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.583 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-21T01:52:00.583 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-21T01:52:00.583 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.583 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.584 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.584 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-21T01:52:00.584 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.584 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.584 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:52:00.584 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:52:00.584 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:52:00.584 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:52:00.584 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:52:00.584 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:52:00.584 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:52:00.584 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:52:00.584 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.584 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.584 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.585 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.585 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.585 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-21T01:52:00.585 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-21T01:52:00.585 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.585 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.585 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.585 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.585 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.585 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.585 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.585 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.585 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.585 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.586 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.586 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.586 INFO:teuthology.orchestra.run.smithi083.stdout: "sqlite3_killpoint": { 2024-09-21T01:52:00.586 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:52:00.586 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:52:00.586 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "dev", 2024-09-21T01:52:00.586 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.586 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0", 2024-09-21T01:52:00.586 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.586 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.586 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.586 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.586 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.586 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.586 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.587 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:52:00.587 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:52:00.587 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.587 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-21T01:52:00.587 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "iostat", 2024-09-21T01:52:00.587 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-21T01:52:00.587 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-21T01:52:00.587 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-21T01:52:00.587 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-21T01:52:00.587 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-21T01:52:00.587 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.587 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.587 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.588 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:52:00.588 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.588 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.588 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:52:00.588 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:52:00.588 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:52:00.588 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:52:00.588 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:52:00.588 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:52:00.588 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:52:00.588 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:52:00.588 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.588 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.588 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.588 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.589 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.589 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-21T01:52:00.589 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-21T01:52:00.589 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.589 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.589 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.589 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.589 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.589 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.589 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.589 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.589 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.589 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.589 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.589 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.590 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-21T01:52:00.590 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-21T01:52:00.590 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.590 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.590 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.590 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-21T01:52:00.590 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.590 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.590 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:52:00.590 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:52:00.590 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:52:00.590 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:52:00.590 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:52:00.590 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:52:00.591 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:52:00.591 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:52:00.591 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.591 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.591 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.591 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.591 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.591 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-21T01:52:00.591 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-21T01:52:00.591 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.591 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.591 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.591 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.592 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.592 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.592 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.592 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.592 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.592 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.592 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.592 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.592 INFO:teuthology.orchestra.run.smithi083.stdout: "sqlite3_killpoint": { 2024-09-21T01:52:00.592 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:52:00.592 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:52:00.592 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "dev", 2024-09-21T01:52:00.592 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.592 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0", 2024-09-21T01:52:00.593 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.593 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.593 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.593 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.593 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.593 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.593 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.593 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:52:00.593 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:52:00.593 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.593 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-21T01:52:00.593 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "k8sevents", 2024-09-21T01:52:00.593 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-21T01:52:00.593 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-21T01:52:00.594 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-21T01:52:00.594 INFO:teuthology.orchestra.run.smithi083.stdout: "ceph_event_retention_days": { 2024-09-21T01:52:00.594 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "ceph_event_retention_days", 2024-09-21T01:52:00.594 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:52:00.594 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.594 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.594 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "7", 2024-09-21T01:52:00.594 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.594 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.594 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.594 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-21T01:52:00.594 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.594 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.594 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.595 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.595 INFO:teuthology.orchestra.run.smithi083.stdout: "config_check_secs": { 2024-09-21T01:52:00.595 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "config_check_secs", 2024-09-21T01:52:00.595 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:52:00.595 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.595 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.595 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "10", 2024-09-21T01:52:00.595 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "10", 2024-09-21T01:52:00.595 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.595 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.595 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-21T01:52:00.595 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.595 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.595 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.595 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.596 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-21T01:52:00.596 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-21T01:52:00.596 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.596 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.596 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.596 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:52:00.596 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.596 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.596 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:52:00.596 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:52:00.596 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:52:00.596 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:52:00.596 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:52:00.596 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:52:00.596 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:52:00.597 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:52:00.597 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.597 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.597 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.597 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.597 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.597 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-21T01:52:00.597 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-21T01:52:00.597 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.597 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.597 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.597 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.597 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.597 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.598 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.598 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.598 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.598 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.598 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.598 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.598 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-21T01:52:00.598 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-21T01:52:00.598 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.598 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.598 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.598 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-21T01:52:00.598 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.598 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.599 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:52:00.599 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:52:00.599 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:52:00.599 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:52:00.599 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:52:00.599 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:52:00.599 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:52:00.599 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:52:00.599 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.599 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.599 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.599 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.599 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.599 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-21T01:52:00.599 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-21T01:52:00.600 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.600 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.600 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.600 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.600 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.600 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.600 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.600 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.600 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.600 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.600 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.600 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.600 INFO:teuthology.orchestra.run.smithi083.stdout: "sqlite3_killpoint": { 2024-09-21T01:52:00.600 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:52:00.600 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:52:00.601 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "dev", 2024-09-21T01:52:00.601 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.601 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0", 2024-09-21T01:52:00.601 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.601 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.601 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.601 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.601 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.601 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.601 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.601 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:52:00.601 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:52:00.601 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.601 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-21T01:52:00.601 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "localpool", 2024-09-21T01:52:00.602 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-21T01:52:00.602 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-21T01:52:00.602 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-21T01:52:00.602 INFO:teuthology.orchestra.run.smithi083.stdout: "failure_domain": { 2024-09-21T01:52:00.602 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "failure_domain", 2024-09-21T01:52:00.602 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.602 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.602 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.602 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "host", 2024-09-21T01:52:00.602 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.602 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.602 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.602 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "failure domain for any created local pool", 2024-09-21T01:52:00.602 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-21T01:52:00.603 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.603 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.603 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.603 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-21T01:52:00.603 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-21T01:52:00.603 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.603 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.603 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.603 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:52:00.603 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.603 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.603 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:52:00.603 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:52:00.603 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:52:00.603 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:52:00.604 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:52:00.604 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:52:00.604 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:52:00.604 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:52:00.604 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.604 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.604 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.604 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.604 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.604 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-21T01:52:00.604 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-21T01:52:00.604 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.604 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.604 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.604 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.605 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.605 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.605 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.605 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.605 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.605 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.605 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.605 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.605 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-21T01:52:00.605 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-21T01:52:00.605 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.605 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.605 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.605 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-21T01:52:00.605 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.606 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.606 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:52:00.606 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:52:00.606 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:52:00.606 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:52:00.606 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:52:00.606 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:52:00.606 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:52:00.606 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:52:00.606 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.606 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.606 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.606 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.606 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.606 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-21T01:52:00.607 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-21T01:52:00.607 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.607 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.607 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.607 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.607 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.607 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.607 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.607 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.607 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.607 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.608 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.608 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.608 INFO:teuthology.orchestra.run.smithi083.stdout: "min_size": { 2024-09-21T01:52:00.608 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "min_size", 2024-09-21T01:52:00.608 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:52:00.608 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.608 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.608 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:52:00.608 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.608 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.608 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.608 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "default min_size for any created local pool", 2024-09-21T01:52:00.608 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-21T01:52:00.608 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.608 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.609 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.609 INFO:teuthology.orchestra.run.smithi083.stdout: "num_rep": { 2024-09-21T01:52:00.609 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "num_rep", 2024-09-21T01:52:00.609 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:52:00.609 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.609 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.609 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "3", 2024-09-21T01:52:00.609 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.609 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.609 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.609 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "default replica count for any created local pool", 2024-09-21T01:52:00.609 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.609 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.609 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.610 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.610 INFO:teuthology.orchestra.run.smithi083.stdout: "pg_num": { 2024-09-21T01:52:00.610 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "pg_num", 2024-09-21T01:52:00.610 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:52:00.610 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.610 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.610 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "128", 2024-09-21T01:52:00.610 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.610 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.610 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.610 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "default pg_num for any created local pool", 2024-09-21T01:52:00.610 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.610 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.610 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.611 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.611 INFO:teuthology.orchestra.run.smithi083.stdout: "prefix": { 2024-09-21T01:52:00.611 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "prefix", 2024-09-21T01:52:00.611 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.611 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.611 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.611 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:52:00.611 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.611 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.611 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.611 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "name prefix for any created local pool", 2024-09-21T01:52:00.611 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.611 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.611 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.611 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.612 INFO:teuthology.orchestra.run.smithi083.stdout: "sqlite3_killpoint": { 2024-09-21T01:52:00.612 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:52:00.612 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:52:00.612 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "dev", 2024-09-21T01:52:00.612 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.612 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0", 2024-09-21T01:52:00.612 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.612 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.612 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.612 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.612 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.612 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.612 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.612 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.613 INFO:teuthology.orchestra.run.smithi083.stdout: "subtree": { 2024-09-21T01:52:00.613 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "subtree", 2024-09-21T01:52:00.613 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.613 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.613 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.613 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "rack", 2024-09-21T01:52:00.613 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.613 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.613 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.613 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-21T01:52:00.613 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-21T01:52:00.613 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.613 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.613 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:52:00.613 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:52:00.614 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.614 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-21T01:52:00.614 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "mds_autoscaler", 2024-09-21T01:52:00.614 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-21T01:52:00.614 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-21T01:52:00.614 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-21T01:52:00.614 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-21T01:52:00.614 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-21T01:52:00.614 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.614 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.614 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.614 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:52:00.614 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.615 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.615 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:52:00.615 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:52:00.615 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:52:00.615 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:52:00.615 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:52:00.615 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:52:00.615 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:52:00.615 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:52:00.615 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.615 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.615 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.615 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.615 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.616 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-21T01:52:00.616 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-21T01:52:00.616 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.616 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.616 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.616 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.616 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.616 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.616 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.616 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.616 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.616 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.616 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.616 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.616 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-21T01:52:00.617 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-21T01:52:00.617 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.617 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.617 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.617 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-21T01:52:00.617 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.617 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.617 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:52:00.617 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:52:00.617 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:52:00.617 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:52:00.617 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:52:00.617 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:52:00.617 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:52:00.617 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:52:00.618 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.618 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.618 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.618 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.618 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.618 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-21T01:52:00.618 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-21T01:52:00.618 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.618 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.618 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.618 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.618 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.618 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.618 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.619 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.619 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.619 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.619 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.619 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.619 INFO:teuthology.orchestra.run.smithi083.stdout: "sqlite3_killpoint": { 2024-09-21T01:52:00.619 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:52:00.619 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:52:00.619 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "dev", 2024-09-21T01:52:00.619 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.619 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0", 2024-09-21T01:52:00.619 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.619 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.619 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.619 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.620 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.620 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.620 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.620 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:52:00.620 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:52:00.620 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.620 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-21T01:52:00.620 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "mirroring", 2024-09-21T01:52:00.620 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-21T01:52:00.620 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-21T01:52:00.620 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-21T01:52:00.620 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-21T01:52:00.620 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-21T01:52:00.620 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.620 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.621 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.621 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:52:00.621 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.621 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.621 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:52:00.621 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:52:00.621 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:52:00.621 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:52:00.621 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:52:00.621 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:52:00.621 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:52:00.621 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:52:00.621 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.621 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.621 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.622 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.622 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.622 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-21T01:52:00.622 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-21T01:52:00.622 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.622 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.622 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.622 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.622 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.622 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.622 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.622 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.622 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.622 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.623 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.623 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.623 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-21T01:52:00.623 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-21T01:52:00.623 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.623 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.623 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.623 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-21T01:52:00.623 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.623 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.623 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:52:00.623 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:52:00.623 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:52:00.623 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:52:00.624 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:52:00.624 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:52:00.624 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:52:00.624 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:52:00.624 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.624 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.624 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.624 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.624 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.624 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-21T01:52:00.624 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-21T01:52:00.624 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.624 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.624 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.624 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.625 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.625 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.625 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.625 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.625 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.625 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.625 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.625 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.625 INFO:teuthology.orchestra.run.smithi083.stdout: "sqlite3_killpoint": { 2024-09-21T01:52:00.625 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:52:00.625 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:52:00.625 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "dev", 2024-09-21T01:52:00.625 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.625 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0", 2024-09-21T01:52:00.626 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.626 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.626 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.626 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.626 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.626 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.626 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.626 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:52:00.626 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:52:00.626 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.626 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-21T01:52:00.626 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "nfs", 2024-09-21T01:52:00.626 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-21T01:52:00.626 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-21T01:52:00.626 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-21T01:52:00.627 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-21T01:52:00.627 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-21T01:52:00.627 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.627 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.627 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.627 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:52:00.627 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.627 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.627 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:52:00.627 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:52:00.627 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:52:00.627 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:52:00.627 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:52:00.627 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:52:00.628 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:52:00.628 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:52:00.628 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.628 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.628 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.628 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.628 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.628 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-21T01:52:00.628 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-21T01:52:00.628 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.628 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.628 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.628 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.628 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.628 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.629 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.629 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.629 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.629 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.629 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.629 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.629 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-21T01:52:00.629 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-21T01:52:00.629 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.629 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.629 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.629 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-21T01:52:00.629 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.629 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.630 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:52:00.630 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:52:00.630 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:52:00.630 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:52:00.630 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:52:00.630 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:52:00.630 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:52:00.630 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:52:00.630 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.630 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.630 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.630 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.630 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.630 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-21T01:52:00.631 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-21T01:52:00.631 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.631 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.631 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.631 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.631 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.631 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.631 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.631 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.631 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.631 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.631 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.631 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.631 INFO:teuthology.orchestra.run.smithi083.stdout: "sqlite3_killpoint": { 2024-09-21T01:52:00.632 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:52:00.632 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:52:00.632 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "dev", 2024-09-21T01:52:00.632 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.632 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0", 2024-09-21T01:52:00.632 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.632 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.632 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.632 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.632 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.632 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.632 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.632 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:52:00.632 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:52:00.632 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.633 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-21T01:52:00.633 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "orchestrator", 2024-09-21T01:52:00.633 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-21T01:52:00.633 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-21T01:52:00.633 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-21T01:52:00.633 INFO:teuthology.orchestra.run.smithi083.stdout: "fail_fs": { 2024-09-21T01:52:00.633 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "fail_fs", 2024-09-21T01:52:00.633 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.633 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.633 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.633 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.633 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.633 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.633 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.633 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-21T01:52:00.634 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.634 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.634 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.634 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.634 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-21T01:52:00.634 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-21T01:52:00.634 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.634 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.634 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.634 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:52:00.634 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.634 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.634 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:52:00.634 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:52:00.635 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:52:00.635 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:52:00.635 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:52:00.635 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:52:00.635 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:52:00.635 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:52:00.635 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.635 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.635 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.635 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.635 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.635 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-21T01:52:00.635 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-21T01:52:00.635 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.635 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.636 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.636 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.636 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.636 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.636 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.636 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.636 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.636 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.636 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.636 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.636 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-21T01:52:00.636 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-21T01:52:00.636 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.636 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.636 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.637 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-21T01:52:00.637 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.637 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.637 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:52:00.637 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:52:00.637 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:52:00.637 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:52:00.637 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:52:00.637 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:52:00.637 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:52:00.637 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:52:00.637 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.637 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.637 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.637 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.638 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.638 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-21T01:52:00.638 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-21T01:52:00.638 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.638 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.638 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.638 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.638 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.638 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.638 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.638 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.638 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.638 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.638 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.639 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.639 INFO:teuthology.orchestra.run.smithi083.stdout: "orchestrator": { 2024-09-21T01:52:00.639 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "orchestrator", 2024-09-21T01:52:00.639 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.639 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.639 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.639 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:52:00.639 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.639 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.639 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:52:00.639 INFO:teuthology.orchestra.run.smithi083.stdout: "cephadm", 2024-09-21T01:52:00.639 INFO:teuthology.orchestra.run.smithi083.stdout: "rook", 2024-09-21T01:52:00.639 INFO:teuthology.orchestra.run.smithi083.stdout: "test_orchestrator" 2024-09-21T01:52:00.639 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:52:00.639 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Orchestrator backend", 2024-09-21T01:52:00.640 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.640 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.640 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.640 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.640 INFO:teuthology.orchestra.run.smithi083.stdout: "sqlite3_killpoint": { 2024-09-21T01:52:00.640 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:52:00.640 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:52:00.640 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "dev", 2024-09-21T01:52:00.640 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.640 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0", 2024-09-21T01:52:00.640 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.640 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.640 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.640 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.640 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.641 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.641 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.641 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:52:00.641 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:52:00.641 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.641 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-21T01:52:00.641 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "osd_perf_query", 2024-09-21T01:52:00.641 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-21T01:52:00.641 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-21T01:52:00.641 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-21T01:52:00.641 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-21T01:52:00.641 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-21T01:52:00.641 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.641 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.642 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.642 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:52:00.642 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.642 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.642 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:52:00.642 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:52:00.642 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:52:00.642 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:52:00.642 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:52:00.642 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:52:00.642 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:52:00.642 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:52:00.642 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.642 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.643 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.643 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.643 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.643 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-21T01:52:00.643 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-21T01:52:00.643 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.643 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.643 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.643 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.643 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.643 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.643 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.643 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.643 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.643 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.644 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.644 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.644 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-21T01:52:00.644 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-21T01:52:00.644 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.644 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.644 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.644 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-21T01:52:00.644 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.644 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.644 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:52:00.644 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:52:00.644 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:52:00.644 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:52:00.645 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:52:00.645 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:52:00.645 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:52:00.645 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:52:00.645 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.645 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.645 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.645 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.645 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.645 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-21T01:52:00.645 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-21T01:52:00.645 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.645 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.645 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.645 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.646 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.646 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.646 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.646 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.646 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.646 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.646 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.646 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.646 INFO:teuthology.orchestra.run.smithi083.stdout: "sqlite3_killpoint": { 2024-09-21T01:52:00.646 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:52:00.646 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:52:00.646 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "dev", 2024-09-21T01:52:00.646 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.646 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0", 2024-09-21T01:52:00.647 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.647 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.647 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.647 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.647 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.647 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.647 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.647 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:52:00.647 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:52:00.647 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.647 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-21T01:52:00.647 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "osd_support", 2024-09-21T01:52:00.647 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-21T01:52:00.647 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-21T01:52:00.648 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-21T01:52:00.648 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-21T01:52:00.648 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-21T01:52:00.648 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.648 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.648 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.648 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:52:00.648 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.648 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.648 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:52:00.648 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:52:00.648 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:52:00.648 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:52:00.648 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:52:00.648 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:52:00.649 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:52:00.649 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:52:00.649 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.649 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.649 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.649 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.649 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.649 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-21T01:52:00.649 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-21T01:52:00.649 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.649 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.649 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.649 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.649 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.649 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.650 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.650 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.650 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.650 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.650 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.650 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.650 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-21T01:52:00.650 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-21T01:52:00.650 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.650 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.650 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.650 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-21T01:52:00.650 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.650 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.650 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:52:00.651 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:52:00.651 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:52:00.651 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:52:00.651 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:52:00.651 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:52:00.651 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:52:00.651 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:52:00.651 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.651 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.651 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.651 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.651 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.651 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-21T01:52:00.651 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-21T01:52:00.652 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.652 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.652 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.652 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.652 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.652 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.652 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.652 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.652 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.652 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.652 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.652 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.652 INFO:teuthology.orchestra.run.smithi083.stdout: "sqlite3_killpoint": { 2024-09-21T01:52:00.652 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:52:00.652 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:52:00.653 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "dev", 2024-09-21T01:52:00.653 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.653 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0", 2024-09-21T01:52:00.653 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.653 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.653 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.653 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.653 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.653 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.653 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.653 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:52:00.653 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:52:00.653 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.653 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-21T01:52:00.653 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "pg_autoscaler", 2024-09-21T01:52:00.654 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-21T01:52:00.654 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-21T01:52:00.654 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-21T01:52:00.654 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-21T01:52:00.654 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-21T01:52:00.654 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.654 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.654 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.654 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:52:00.654 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.654 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.654 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:52:00.654 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:52:00.654 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:52:00.654 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:52:00.655 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:52:00.655 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:52:00.655 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:52:00.655 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:52:00.655 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.655 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.655 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.655 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.655 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.655 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-21T01:52:00.655 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-21T01:52:00.655 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.655 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.655 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.655 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.656 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.656 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.656 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.656 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.656 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.656 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.656 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.656 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.656 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-21T01:52:00.656 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-21T01:52:00.656 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.656 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.656 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.656 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-21T01:52:00.657 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.657 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.657 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:52:00.657 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:52:00.657 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:52:00.657 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:52:00.657 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:52:00.657 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:52:00.657 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:52:00.657 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:52:00.657 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.657 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.657 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.657 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.657 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.658 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-21T01:52:00.658 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-21T01:52:00.658 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.658 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.658 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.658 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.658 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.658 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.658 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.658 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.658 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.658 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.658 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.658 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.659 INFO:teuthology.orchestra.run.smithi083.stdout: "sleep_interval": { 2024-09-21T01:52:00.659 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "sleep_interval", 2024-09-21T01:52:00.659 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-09-21T01:52:00.659 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.659 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.659 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "60", 2024-09-21T01:52:00.659 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.659 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.659 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.659 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.661 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.661 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.661 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.661 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.662 INFO:teuthology.orchestra.run.smithi083.stdout: "sqlite3_killpoint": { 2024-09-21T01:52:00.662 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:52:00.662 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:52:00.662 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "dev", 2024-09-21T01:52:00.662 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.662 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0", 2024-09-21T01:52:00.662 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.662 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.662 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.662 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.662 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.662 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.662 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.662 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.663 INFO:teuthology.orchestra.run.smithi083.stdout: "threshold": { 2024-09-21T01:52:00.663 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "threshold", 2024-09-21T01:52:00.663 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "float", 2024-09-21T01:52:00.663 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.663 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.663 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "3.0", 2024-09-21T01:52:00.663 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "1.0", 2024-09-21T01:52:00.663 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.663 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.663 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "scaling threshold", 2024-09-21T01:52:00.663 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-21T01:52:00.663 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.663 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.663 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:52:00.663 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:52:00.664 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.664 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-21T01:52:00.664 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "progress", 2024-09-21T01:52:00.664 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-21T01:52:00.664 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-21T01:52:00.664 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-21T01:52:00.664 INFO:teuthology.orchestra.run.smithi083.stdout: "allow_pg_recovery_event": { 2024-09-21T01:52:00.664 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "allow_pg_recovery_event", 2024-09-21T01:52:00.664 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.664 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.664 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.664 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.664 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.664 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.664 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.665 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-21T01:52:00.665 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.665 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.665 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.665 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.665 INFO:teuthology.orchestra.run.smithi083.stdout: "enabled": { 2024-09-21T01:52:00.665 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "enabled", 2024-09-21T01:52:00.665 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.665 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.665 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.665 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-21T01:52:00.665 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.665 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.665 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.666 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.666 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.666 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.666 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.666 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.666 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-21T01:52:00.666 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-21T01:52:00.666 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.666 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.666 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.666 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:52:00.666 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.666 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.666 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:52:00.667 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:52:00.667 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:52:00.667 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:52:00.667 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:52:00.667 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:52:00.667 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:52:00.667 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:52:00.667 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.667 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.667 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.667 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.667 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.667 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-21T01:52:00.667 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-21T01:52:00.668 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.668 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.668 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.668 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.668 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.668 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.668 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.668 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.668 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.668 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.668 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.668 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.668 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-21T01:52:00.668 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-21T01:52:00.668 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.669 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.669 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.669 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-21T01:52:00.669 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.669 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.669 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:52:00.669 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:52:00.669 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:52:00.669 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:52:00.669 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:52:00.669 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:52:00.669 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:52:00.669 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:52:00.669 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.669 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.670 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.670 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.670 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.670 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-21T01:52:00.670 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-21T01:52:00.670 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.670 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.670 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.670 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.670 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.670 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.670 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.670 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.670 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.670 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.671 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.671 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.671 INFO:teuthology.orchestra.run.smithi083.stdout: "max_completed_events": { 2024-09-21T01:52:00.671 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "max_completed_events", 2024-09-21T01:52:00.671 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:52:00.671 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.671 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.671 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "50", 2024-09-21T01:52:00.671 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.671 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.671 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.671 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "number of past completed events to remember", 2024-09-21T01:52:00.671 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.671 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.672 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.672 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.672 INFO:teuthology.orchestra.run.smithi083.stdout: "sleep_interval": { 2024-09-21T01:52:00.672 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "sleep_interval", 2024-09-21T01:52:00.672 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-09-21T01:52:00.672 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.672 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.672 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "5", 2024-09-21T01:52:00.672 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.672 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.672 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.672 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "how long the module is going to sleep", 2024-09-21T01:52:00.672 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.672 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.672 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.673 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.673 INFO:teuthology.orchestra.run.smithi083.stdout: "sqlite3_killpoint": { 2024-09-21T01:52:00.673 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:52:00.673 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:52:00.673 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "dev", 2024-09-21T01:52:00.673 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.673 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0", 2024-09-21T01:52:00.673 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.673 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.673 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.673 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.673 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.673 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.673 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.673 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:52:00.674 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:52:00.674 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.674 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-21T01:52:00.674 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "prometheus", 2024-09-21T01:52:00.674 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-21T01:52:00.674 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-21T01:52:00.674 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-21T01:52:00.674 INFO:teuthology.orchestra.run.smithi083.stdout: "cache": { 2024-09-21T01:52:00.674 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "cache", 2024-09-21T01:52:00.674 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.674 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.674 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.674 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-21T01:52:00.674 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.674 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.675 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.675 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.675 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.675 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.675 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.675 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.675 INFO:teuthology.orchestra.run.smithi083.stdout: "exclude_perf_counters": { 2024-09-21T01:52:00.675 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "exclude_perf_counters", 2024-09-21T01:52:00.675 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.675 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.675 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.675 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-21T01:52:00.675 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.675 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.676 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.676 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-21T01:52:00.676 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-21T01:52:00.676 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.676 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.676 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.676 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-21T01:52:00.676 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-21T01:52:00.676 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.676 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.676 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.676 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:52:00.676 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.676 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.676 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:52:00.677 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:52:00.677 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:52:00.677 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:52:00.677 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:52:00.677 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:52:00.677 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:52:00.677 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:52:00.677 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.677 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.677 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.677 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.677 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.677 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-21T01:52:00.677 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-21T01:52:00.677 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.678 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.678 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.678 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.678 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.678 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.678 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.678 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.678 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.678 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.678 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.678 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.678 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-21T01:52:00.678 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-21T01:52:00.678 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.679 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.679 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.679 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-21T01:52:00.679 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.679 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.679 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:52:00.679 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:52:00.679 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:52:00.679 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:52:00.679 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:52:00.679 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:52:00.679 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:52:00.679 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:52:00.679 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.680 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.680 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.680 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.680 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.680 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-21T01:52:00.680 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-21T01:52:00.680 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.680 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.680 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.680 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.680 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.680 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.680 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.680 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.680 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.681 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.681 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.681 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.681 INFO:teuthology.orchestra.run.smithi083.stdout: "rbd_stats_pools": { 2024-09-21T01:52:00.681 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "rbd_stats_pools", 2024-09-21T01:52:00.681 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.681 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.681 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.681 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:52:00.681 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.681 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.681 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.681 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.681 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.682 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.682 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.682 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.682 INFO:teuthology.orchestra.run.smithi083.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-21T01:52:00.682 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-21T01:52:00.682 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:52:00.682 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.682 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.682 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "300", 2024-09-21T01:52:00.682 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.682 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.682 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.682 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.682 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.682 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.683 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.683 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.683 INFO:teuthology.orchestra.run.smithi083.stdout: "scrape_interval": { 2024-09-21T01:52:00.683 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "scrape_interval", 2024-09-21T01:52:00.683 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "float", 2024-09-21T01:52:00.683 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.683 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.683 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "15.0", 2024-09-21T01:52:00.683 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.683 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.683 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.683 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.683 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.683 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.684 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.684 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.684 INFO:teuthology.orchestra.run.smithi083.stdout: "server_addr": { 2024-09-21T01:52:00.684 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "server_addr", 2024-09-21T01:52:00.684 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.684 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.684 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.684 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "::", 2024-09-21T01:52:00.684 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.684 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.684 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.684 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-21T01:52:00.684 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.684 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.684 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.685 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.685 INFO:teuthology.orchestra.run.smithi083.stdout: "server_port": { 2024-09-21T01:52:00.685 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "server_port", 2024-09-21T01:52:00.685 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:52:00.685 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.685 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.685 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "9283", 2024-09-21T01:52:00.685 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.685 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.685 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.685 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-21T01:52:00.685 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.685 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.685 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.685 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.686 INFO:teuthology.orchestra.run.smithi083.stdout: "sqlite3_killpoint": { 2024-09-21T01:52:00.686 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:52:00.686 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:52:00.686 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "dev", 2024-09-21T01:52:00.686 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.686 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0", 2024-09-21T01:52:00.686 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.686 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.686 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.686 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.686 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.686 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.686 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.686 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.687 INFO:teuthology.orchestra.run.smithi083.stdout: "stale_cache_strategy": { 2024-09-21T01:52:00.687 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "stale_cache_strategy", 2024-09-21T01:52:00.687 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.687 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.687 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.687 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "log", 2024-09-21T01:52:00.687 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.687 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.687 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.687 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.687 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.687 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.687 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.687 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.687 INFO:teuthology.orchestra.run.smithi083.stdout: "standby_behaviour": { 2024-09-21T01:52:00.688 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "standby_behaviour", 2024-09-21T01:52:00.688 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.688 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.688 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.688 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "default", 2024-09-21T01:52:00.688 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.688 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.688 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:52:00.688 INFO:teuthology.orchestra.run.smithi083.stdout: "default", 2024-09-21T01:52:00.688 INFO:teuthology.orchestra.run.smithi083.stdout: "error" 2024-09-21T01:52:00.688 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:52:00.688 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.688 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.688 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.688 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.689 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.689 INFO:teuthology.orchestra.run.smithi083.stdout: "standby_error_status_code": { 2024-09-21T01:52:00.689 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "standby_error_status_code", 2024-09-21T01:52:00.689 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:52:00.689 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.689 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.689 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "500", 2024-09-21T01:52:00.689 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "400", 2024-09-21T01:52:00.689 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "599", 2024-09-21T01:52:00.689 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.689 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.689 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.689 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.689 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.690 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:52:00.690 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:52:00.690 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.690 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-21T01:52:00.690 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "rbd_support", 2024-09-21T01:52:00.690 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-21T01:52:00.690 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-21T01:52:00.690 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-21T01:52:00.690 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-21T01:52:00.690 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-21T01:52:00.690 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.690 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.690 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.690 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:52:00.691 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.691 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.691 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:52:00.691 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:52:00.691 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:52:00.691 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:52:00.691 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:52:00.691 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:52:00.691 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:52:00.691 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:52:00.691 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.691 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.691 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.691 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.692 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.692 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-21T01:52:00.692 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-21T01:52:00.692 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.692 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.692 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.692 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.692 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.692 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.692 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.692 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.692 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.692 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.692 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.692 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.693 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-21T01:52:00.693 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-21T01:52:00.693 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.693 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.693 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.693 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-21T01:52:00.693 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.693 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.693 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:52:00.693 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:52:00.693 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:52:00.693 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:52:00.693 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:52:00.693 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:52:00.694 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:52:00.694 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:52:00.694 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.694 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.694 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.694 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.694 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.694 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-21T01:52:00.694 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-21T01:52:00.694 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.694 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.694 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.694 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.694 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.694 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.695 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.695 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.695 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.695 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.695 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.695 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.695 INFO:teuthology.orchestra.run.smithi083.stdout: "max_concurrent_snap_create": { 2024-09-21T01:52:00.695 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "max_concurrent_snap_create", 2024-09-21T01:52:00.695 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:52:00.695 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.695 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.695 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "10", 2024-09-21T01:52:00.695 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.695 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.696 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.696 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.696 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.696 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.696 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.696 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.696 INFO:teuthology.orchestra.run.smithi083.stdout: "mirror_snapshot_schedule": { 2024-09-21T01:52:00.696 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "mirror_snapshot_schedule", 2024-09-21T01:52:00.696 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.696 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.696 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.696 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:52:00.696 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.696 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.696 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.697 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.697 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.697 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.697 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.697 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.697 INFO:teuthology.orchestra.run.smithi083.stdout: "sqlite3_killpoint": { 2024-09-21T01:52:00.697 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:52:00.697 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:52:00.697 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "dev", 2024-09-21T01:52:00.697 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.697 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0", 2024-09-21T01:52:00.697 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.697 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.697 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.697 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.698 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.698 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.698 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.698 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.698 INFO:teuthology.orchestra.run.smithi083.stdout: "trash_purge_schedule": { 2024-09-21T01:52:00.698 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "trash_purge_schedule", 2024-09-21T01:52:00.698 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.698 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.698 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.698 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:52:00.698 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.698 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.698 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.698 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.699 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.699 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.699 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.699 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:52:00.699 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:52:00.699 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.699 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-21T01:52:00.699 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "restful", 2024-09-21T01:52:00.699 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-21T01:52:00.699 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-21T01:52:00.699 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-21T01:52:00.699 INFO:teuthology.orchestra.run.smithi083.stdout: "enable_auth": { 2024-09-21T01:52:00.699 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "enable_auth", 2024-09-21T01:52:00.699 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.699 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.700 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.700 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-21T01:52:00.700 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.700 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.700 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.700 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.700 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.700 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.700 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.700 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.700 INFO:teuthology.orchestra.run.smithi083.stdout: "key_file": { 2024-09-21T01:52:00.700 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "key_file", 2024-09-21T01:52:00.700 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.700 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.700 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.701 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:52:00.701 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.701 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.701 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.701 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.701 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.701 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.701 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.701 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.701 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-21T01:52:00.701 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-21T01:52:00.701 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.701 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.701 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.701 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:52:00.702 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.702 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.702 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:52:00.702 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:52:00.702 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:52:00.702 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:52:00.702 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:52:00.702 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:52:00.702 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:52:00.702 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:52:00.702 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.702 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.702 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.702 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.702 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.703 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-21T01:52:00.703 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-21T01:52:00.703 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.703 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.703 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.703 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.703 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.703 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.703 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.703 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.703 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.703 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.703 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.703 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.704 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-21T01:52:00.704 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-21T01:52:00.704 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.704 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.704 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.704 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-21T01:52:00.704 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.704 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.704 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:52:00.704 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:52:00.704 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:52:00.704 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:52:00.704 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:52:00.704 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:52:00.704 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:52:00.705 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:52:00.705 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.705 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.705 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.705 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.705 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.705 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-21T01:52:00.705 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-21T01:52:00.705 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.705 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.705 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.705 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.705 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.705 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.705 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.706 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.706 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.706 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.706 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.706 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.706 INFO:teuthology.orchestra.run.smithi083.stdout: "max_requests": { 2024-09-21T01:52:00.706 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "max_requests", 2024-09-21T01:52:00.706 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:52:00.706 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.706 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.706 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "500", 2024-09-21T01:52:00.706 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.706 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.706 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.706 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.", 2024-09-21T01:52:00.707 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.707 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.707 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.707 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.707 INFO:teuthology.orchestra.run.smithi083.stdout: "server_addr": { 2024-09-21T01:52:00.707 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "server_addr", 2024-09-21T01:52:00.707 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.707 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.707 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.707 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:52:00.707 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.707 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.707 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.707 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.707 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.708 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.708 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.708 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.708 INFO:teuthology.orchestra.run.smithi083.stdout: "server_port": { 2024-09-21T01:52:00.708 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "server_port", 2024-09-21T01:52:00.708 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.708 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.708 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.708 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:52:00.708 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.708 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.708 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.708 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.708 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.709 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.709 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.709 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.709 INFO:teuthology.orchestra.run.smithi083.stdout: "sqlite3_killpoint": { 2024-09-21T01:52:00.709 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:52:00.709 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:52:00.709 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "dev", 2024-09-21T01:52:00.709 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.709 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0", 2024-09-21T01:52:00.709 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.709 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.709 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.709 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.709 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.709 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.710 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.710 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:52:00.710 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:52:00.710 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.710 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-21T01:52:00.710 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "rgw", 2024-09-21T01:52:00.710 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-21T01:52:00.710 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-21T01:52:00.710 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-21T01:52:00.710 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-21T01:52:00.710 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-21T01:52:00.710 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.710 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.710 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.710 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:52:00.711 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.711 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.711 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:52:00.711 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:52:00.711 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:52:00.711 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:52:00.711 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:52:00.711 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:52:00.711 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:52:00.711 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:52:00.711 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.711 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.711 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.711 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.712 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.712 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-21T01:52:00.712 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-21T01:52:00.712 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.712 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.712 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.712 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.712 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.712 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.712 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.712 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.712 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.712 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.712 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.712 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.713 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-21T01:52:00.713 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-21T01:52:00.713 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.713 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.713 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.713 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-21T01:52:00.713 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.713 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.713 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:52:00.713 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:52:00.713 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:52:00.713 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:52:00.713 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:52:00.713 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:52:00.713 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:52:00.714 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:52:00.714 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.714 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.714 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.714 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.714 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.714 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-21T01:52:00.714 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-21T01:52:00.714 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.714 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.714 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.714 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.714 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.714 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.715 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.715 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.715 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.715 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.715 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.715 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.715 INFO:teuthology.orchestra.run.smithi083.stdout: "secondary_zone_period_retry_limit": { 2024-09-21T01:52:00.715 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-21T01:52:00.715 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:52:00.715 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.715 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.715 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "5", 2024-09-21T01:52:00.715 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.715 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.715 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.716 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-21T01:52:00.716 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.716 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.716 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.716 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.716 INFO:teuthology.orchestra.run.smithi083.stdout: "sqlite3_killpoint": { 2024-09-21T01:52:00.716 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:52:00.716 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:52:00.716 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "dev", 2024-09-21T01:52:00.716 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.716 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0", 2024-09-21T01:52:00.716 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.716 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.716 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.717 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.717 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.717 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.717 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.717 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:52:00.717 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:52:00.717 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.717 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-21T01:52:00.717 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "rook", 2024-09-21T01:52:00.717 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-21T01:52:00.717 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-21T01:52:00.717 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-21T01:52:00.717 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-21T01:52:00.717 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-21T01:52:00.718 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.718 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.718 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.718 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:52:00.718 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.718 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.718 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:52:00.718 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:52:00.718 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:52:00.718 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:52:00.718 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:52:00.718 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:52:00.718 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:52:00.718 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:52:00.719 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.719 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.719 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.719 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.719 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.719 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-21T01:52:00.719 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-21T01:52:00.719 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.719 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.719 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.719 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.719 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.719 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.719 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.719 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.720 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.720 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.720 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.720 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.720 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-21T01:52:00.720 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-21T01:52:00.720 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.720 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.720 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.720 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-21T01:52:00.720 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.720 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.720 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:52:00.721 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:52:00.721 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:52:00.721 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:52:00.721 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:52:00.721 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:52:00.721 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:52:00.721 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:52:00.721 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.721 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.721 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.721 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.721 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.721 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-21T01:52:00.721 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-21T01:52:00.721 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.721 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.722 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.722 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.722 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.722 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.722 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.722 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.722 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.722 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.722 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.722 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.722 INFO:teuthology.orchestra.run.smithi083.stdout: "sqlite3_killpoint": { 2024-09-21T01:52:00.722 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:52:00.722 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:52:00.722 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "dev", 2024-09-21T01:52:00.723 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.723 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0", 2024-09-21T01:52:00.723 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.723 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.723 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.723 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.723 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.723 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.723 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.723 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.723 INFO:teuthology.orchestra.run.smithi083.stdout: "storage_class": { 2024-09-21T01:52:00.723 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "storage_class", 2024-09-21T01:52:00.723 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.723 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.724 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.724 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "local", 2024-09-21T01:52:00.724 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.724 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.724 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.724 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-21T01:52:00.724 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.724 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.724 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.724 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:52:00.724 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:52:00.724 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.724 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-21T01:52:00.724 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "selftest", 2024-09-21T01:52:00.725 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-21T01:52:00.725 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-21T01:52:00.725 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-21T01:52:00.725 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-21T01:52:00.725 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-21T01:52:00.725 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.725 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.725 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.725 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:52:00.725 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.725 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.725 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:52:00.725 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:52:00.726 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:52:00.726 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:52:00.726 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:52:00.726 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:52:00.726 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:52:00.726 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:52:00.726 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.726 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.726 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.726 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.726 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.726 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-21T01:52:00.726 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-21T01:52:00.726 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.726 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.727 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.727 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.727 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.727 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.727 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.727 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.727 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.727 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.727 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.727 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.727 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-21T01:52:00.727 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-21T01:52:00.727 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.727 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.728 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.728 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-21T01:52:00.728 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.728 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.728 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:52:00.728 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:52:00.728 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:52:00.728 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:52:00.728 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:52:00.728 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:52:00.728 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:52:00.728 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:52:00.728 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.728 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.729 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.729 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.729 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.729 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-21T01:52:00.729 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-21T01:52:00.729 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.729 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.729 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.729 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.729 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.729 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.729 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.729 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.729 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.730 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.730 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.730 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.730 INFO:teuthology.orchestra.run.smithi083.stdout: "roption1": { 2024-09-21T01:52:00.730 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "roption1", 2024-09-21T01:52:00.730 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.730 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.730 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.730 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:52:00.730 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.730 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.730 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.730 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.730 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.731 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.731 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.731 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.731 INFO:teuthology.orchestra.run.smithi083.stdout: "roption2": { 2024-09-21T01:52:00.731 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "roption2", 2024-09-21T01:52:00.731 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.731 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.731 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.731 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "xyz", 2024-09-21T01:52:00.731 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.731 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.731 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.731 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.731 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.732 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.732 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.732 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.732 INFO:teuthology.orchestra.run.smithi083.stdout: "rwoption1": { 2024-09-21T01:52:00.732 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "rwoption1", 2024-09-21T01:52:00.732 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.732 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.732 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.732 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:52:00.732 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.732 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.732 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.732 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.732 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.732 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.733 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.733 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.733 INFO:teuthology.orchestra.run.smithi083.stdout: "rwoption2": { 2024-09-21T01:52:00.733 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "rwoption2", 2024-09-21T01:52:00.733 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:52:00.733 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.733 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.733 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:52:00.733 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.733 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.733 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.733 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.733 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.733 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.734 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.734 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.734 INFO:teuthology.orchestra.run.smithi083.stdout: "rwoption3": { 2024-09-21T01:52:00.734 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "rwoption3", 2024-09-21T01:52:00.734 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "float", 2024-09-21T01:52:00.734 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.734 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.734 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:52:00.734 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.734 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.734 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.734 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.734 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.734 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.735 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.735 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.735 INFO:teuthology.orchestra.run.smithi083.stdout: "rwoption4": { 2024-09-21T01:52:00.735 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "rwoption4", 2024-09-21T01:52:00.735 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.735 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.735 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.735 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:52:00.735 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.735 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.735 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.735 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.735 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.735 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.735 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.736 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.736 INFO:teuthology.orchestra.run.smithi083.stdout: "rwoption5": { 2024-09-21T01:52:00.736 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "rwoption5", 2024-09-21T01:52:00.736 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.736 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.736 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.736 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:52:00.736 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.736 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.736 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.736 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.736 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.736 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.736 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.737 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.737 INFO:teuthology.orchestra.run.smithi083.stdout: "rwoption6": { 2024-09-21T01:52:00.737 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "rwoption6", 2024-09-21T01:52:00.737 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.737 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.737 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.737 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-21T01:52:00.737 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.737 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.737 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.737 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.737 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.737 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.737 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.737 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.738 INFO:teuthology.orchestra.run.smithi083.stdout: "rwoption7": { 2024-09-21T01:52:00.738 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "rwoption7", 2024-09-21T01:52:00.738 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:52:00.738 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.738 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.738 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:52:00.738 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "1", 2024-09-21T01:52:00.738 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "42", 2024-09-21T01:52:00.738 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.738 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.738 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.738 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.738 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.738 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.739 INFO:teuthology.orchestra.run.smithi083.stdout: "sqlite3_killpoint": { 2024-09-21T01:52:00.739 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:52:00.739 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:52:00.739 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "dev", 2024-09-21T01:52:00.739 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.739 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0", 2024-09-21T01:52:00.739 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.739 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.739 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.739 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.739 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.739 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.739 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.739 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.739 INFO:teuthology.orchestra.run.smithi083.stdout: "testkey": { 2024-09-21T01:52:00.740 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "testkey", 2024-09-21T01:52:00.740 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.740 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.740 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.740 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:52:00.740 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.740 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.740 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.740 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.740 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.740 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.740 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.740 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.740 INFO:teuthology.orchestra.run.smithi083.stdout: "testlkey": { 2024-09-21T01:52:00.740 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "testlkey", 2024-09-21T01:52:00.741 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.741 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.741 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.741 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:52:00.741 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.741 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.741 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.741 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.741 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.741 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.741 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.741 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.741 INFO:teuthology.orchestra.run.smithi083.stdout: "testnewline": { 2024-09-21T01:52:00.741 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "testnewline", 2024-09-21T01:52:00.741 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.742 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.742 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.742 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:52:00.742 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.742 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.742 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.742 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.742 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.742 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.742 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.742 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:52:00.742 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:52:00.742 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.742 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-21T01:52:00.743 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "smb", 2024-09-21T01:52:00.743 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-21T01:52:00.743 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-21T01:52:00.743 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-21T01:52:00.743 INFO:teuthology.orchestra.run.smithi083.stdout: "internal_store_backend": { 2024-09-21T01:52:00.743 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "internal_store_backend", 2024-09-21T01:52:00.743 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.743 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "dev", 2024-09-21T01:52:00.743 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.743 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:52:00.743 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.743 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.743 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.743 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "set internal store backend. for develoment and testing only", 2024-09-21T01:52:00.744 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.744 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.744 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.744 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.744 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-21T01:52:00.744 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-21T01:52:00.744 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.744 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.744 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.744 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:52:00.744 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.744 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.744 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:52:00.744 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:52:00.745 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:52:00.745 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:52:00.745 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:52:00.745 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:52:00.745 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:52:00.745 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:52:00.745 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.745 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.745 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.745 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.745 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.745 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-21T01:52:00.745 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-21T01:52:00.745 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.745 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.746 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.746 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.746 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.746 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.746 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.746 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.746 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.746 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.746 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.746 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.746 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-21T01:52:00.746 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-21T01:52:00.746 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.746 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.747 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.747 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-21T01:52:00.747 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.747 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.747 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:52:00.747 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:52:00.747 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:52:00.747 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:52:00.747 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:52:00.747 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:52:00.747 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:52:00.747 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:52:00.747 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.747 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.747 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.748 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.748 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.748 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-21T01:52:00.748 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-21T01:52:00.748 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.748 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.748 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.748 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.748 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.748 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.748 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.748 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.748 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.748 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.748 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.749 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.749 INFO:teuthology.orchestra.run.smithi083.stdout: "sqlite3_killpoint": { 2024-09-21T01:52:00.749 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:52:00.749 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:52:00.749 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "dev", 2024-09-21T01:52:00.749 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.749 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0", 2024-09-21T01:52:00.749 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.749 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.749 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.749 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.749 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.749 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.749 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.749 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.750 INFO:teuthology.orchestra.run.smithi083.stdout: "update_orchestration": { 2024-09-21T01:52:00.750 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "update_orchestration", 2024-09-21T01:52:00.750 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.750 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.750 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.750 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-21T01:52:00.750 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.750 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.750 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.750 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-09-21T01:52:00.750 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.750 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.750 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.750 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:52:00.751 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:52:00.751 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.751 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-21T01:52:00.751 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "snap_schedule", 2024-09-21T01:52:00.751 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-21T01:52:00.751 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-21T01:52:00.751 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-21T01:52:00.751 INFO:teuthology.orchestra.run.smithi083.stdout: "allow_m_granularity": { 2024-09-21T01:52:00.751 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "allow_m_granularity", 2024-09-21T01:52:00.751 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.751 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.751 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.751 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.751 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.752 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.752 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.752 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "allow minute scheduled snapshots", 2024-09-21T01:52:00.752 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.752 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.752 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.752 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.752 INFO:teuthology.orchestra.run.smithi083.stdout: "dump_on_update": { 2024-09-21T01:52:00.752 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "dump_on_update", 2024-09-21T01:52:00.752 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.752 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.752 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.752 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.752 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.752 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.753 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.753 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "dump database to debug log on update", 2024-09-21T01:52:00.753 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.753 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.753 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.753 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.753 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-21T01:52:00.753 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-21T01:52:00.753 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.753 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.753 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.753 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:52:00.753 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.753 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.753 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:52:00.754 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:52:00.754 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:52:00.754 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:52:00.754 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:52:00.754 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:52:00.754 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:52:00.754 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:52:00.754 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.754 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.754 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.754 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.754 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.754 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-21T01:52:00.754 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-21T01:52:00.754 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.755 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.755 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.755 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.755 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.755 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.755 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.755 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.755 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.755 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.755 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.755 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.755 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-21T01:52:00.755 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-21T01:52:00.755 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.755 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.756 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.756 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-21T01:52:00.756 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.756 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.756 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:52:00.756 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:52:00.756 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:52:00.756 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:52:00.756 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:52:00.756 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:52:00.756 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:52:00.756 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:52:00.756 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.756 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.756 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.757 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.757 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.757 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-21T01:52:00.757 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-21T01:52:00.757 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.757 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.757 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.757 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.757 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.757 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.757 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.757 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.757 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.757 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.758 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.758 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.758 INFO:teuthology.orchestra.run.smithi083.stdout: "sqlite3_killpoint": { 2024-09-21T01:52:00.758 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:52:00.758 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:52:00.758 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "dev", 2024-09-21T01:52:00.758 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.758 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0", 2024-09-21T01:52:00.758 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.758 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.758 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.758 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.758 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.758 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.759 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.759 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:52:00.759 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:52:00.759 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.759 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-21T01:52:00.759 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "stats", 2024-09-21T01:52:00.759 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-21T01:52:00.759 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-21T01:52:00.759 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-21T01:52:00.759 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-21T01:52:00.759 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-21T01:52:00.759 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.759 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.760 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.760 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:52:00.760 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.760 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.760 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:52:00.760 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:52:00.760 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:52:00.760 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:52:00.760 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:52:00.760 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:52:00.760 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:52:00.761 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:52:00.761 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.761 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.761 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.761 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.761 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.761 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-21T01:52:00.761 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-21T01:52:00.761 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.761 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.761 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.761 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.761 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.761 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.762 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.762 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.762 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.762 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.762 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.762 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.762 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-21T01:52:00.762 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-21T01:52:00.762 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.762 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.762 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.762 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-21T01:52:00.762 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.763 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.763 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:52:00.763 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:52:00.763 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:52:00.763 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:52:00.763 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:52:00.763 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:52:00.763 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:52:00.763 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:52:00.763 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.763 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.763 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.763 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.763 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.763 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-21T01:52:00.764 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-21T01:52:00.764 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.764 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.764 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.764 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.764 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.764 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.764 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.764 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.764 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.764 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.764 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.764 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.764 INFO:teuthology.orchestra.run.smithi083.stdout: "sqlite3_killpoint": { 2024-09-21T01:52:00.765 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:52:00.765 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:52:00.765 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "dev", 2024-09-21T01:52:00.765 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.765 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0", 2024-09-21T01:52:00.765 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.765 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.765 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.765 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.765 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.765 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.765 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.765 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:52:00.765 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:52:00.765 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.766 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-21T01:52:00.766 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "status", 2024-09-21T01:52:00.766 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-21T01:52:00.766 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-21T01:52:00.766 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-21T01:52:00.766 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-21T01:52:00.766 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-21T01:52:00.766 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.766 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.766 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.766 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:52:00.766 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.766 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.766 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:52:00.767 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:52:00.767 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:52:00.767 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:52:00.767 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:52:00.767 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:52:00.767 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:52:00.767 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:52:00.767 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.767 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.767 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.767 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.767 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.767 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-21T01:52:00.767 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-21T01:52:00.767 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.768 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.768 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.768 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.768 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.768 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.768 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.768 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.768 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.768 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.768 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.768 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.768 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-21T01:52:00.768 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-21T01:52:00.768 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.769 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.769 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.769 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-21T01:52:00.769 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.769 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.769 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:52:00.769 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:52:00.769 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:52:00.769 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:52:00.769 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:52:00.769 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:52:00.769 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:52:00.769 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:52:00.769 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.769 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.770 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.770 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.770 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.770 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-21T01:52:00.770 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-21T01:52:00.770 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.770 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.770 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.770 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.770 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.770 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.770 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.770 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.770 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.771 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.771 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.771 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.771 INFO:teuthology.orchestra.run.smithi083.stdout: "sqlite3_killpoint": { 2024-09-21T01:52:00.771 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:52:00.771 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:52:00.771 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "dev", 2024-09-21T01:52:00.771 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.771 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0", 2024-09-21T01:52:00.771 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.771 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.771 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.771 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.771 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.771 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.772 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.772 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:52:00.772 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:52:00.772 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.772 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-21T01:52:00.772 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "telegraf", 2024-09-21T01:52:00.772 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-21T01:52:00.772 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-21T01:52:00.772 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-21T01:52:00.772 INFO:teuthology.orchestra.run.smithi083.stdout: "address": { 2024-09-21T01:52:00.772 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "address", 2024-09-21T01:52:00.772 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.772 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.772 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.772 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-21T01:52:00.773 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.773 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.773 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.773 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.773 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.773 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.773 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.773 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.773 INFO:teuthology.orchestra.run.smithi083.stdout: "interval": { 2024-09-21T01:52:00.773 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "interval", 2024-09-21T01:52:00.773 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-09-21T01:52:00.773 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.773 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.773 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "15", 2024-09-21T01:52:00.774 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.774 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.774 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.774 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.774 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.774 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.774 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.774 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.774 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-21T01:52:00.774 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-21T01:52:00.774 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.774 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.774 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.774 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:52:00.774 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.775 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.775 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:52:00.775 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:52:00.775 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:52:00.775 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:52:00.775 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:52:00.775 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:52:00.775 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:52:00.775 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:52:00.775 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.775 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.775 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.775 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.775 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.776 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-21T01:52:00.776 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-21T01:52:00.776 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.776 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.776 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.776 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.776 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.776 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.776 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.776 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.776 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.776 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.776 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.776 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.777 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-21T01:52:00.777 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-21T01:52:00.777 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.777 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.777 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.777 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-21T01:52:00.777 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.777 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.777 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:52:00.777 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:52:00.777 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:52:00.777 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:52:00.777 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:52:00.777 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:52:00.777 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:52:00.778 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:52:00.778 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.778 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.778 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.778 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.778 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.778 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-21T01:52:00.778 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-21T01:52:00.778 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.778 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.778 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.778 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.778 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.779 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.779 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.779 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.779 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.779 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.779 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.779 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.779 INFO:teuthology.orchestra.run.smithi083.stdout: "sqlite3_killpoint": { 2024-09-21T01:52:00.779 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:52:00.779 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:52:00.779 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "dev", 2024-09-21T01:52:00.779 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.779 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0", 2024-09-21T01:52:00.779 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.780 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.780 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.780 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.780 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.780 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.780 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.780 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:52:00.780 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:52:00.780 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.780 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-21T01:52:00.780 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "telemetry", 2024-09-21T01:52:00.780 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-21T01:52:00.780 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-21T01:52:00.780 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-21T01:52:00.781 INFO:teuthology.orchestra.run.smithi083.stdout: "channel_basic": { 2024-09-21T01:52:00.781 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "channel_basic", 2024-09-21T01:52:00.781 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.781 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.781 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.781 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-21T01:52:00.781 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.781 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.781 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.781 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-21T01:52:00.781 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.781 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.781 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.781 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.782 INFO:teuthology.orchestra.run.smithi083.stdout: "channel_crash": { 2024-09-21T01:52:00.782 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "channel_crash", 2024-09-21T01:52:00.782 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.782 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.782 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.782 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-21T01:52:00.782 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.782 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.782 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.782 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-21T01:52:00.782 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.782 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.782 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.782 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.783 INFO:teuthology.orchestra.run.smithi083.stdout: "channel_device": { 2024-09-21T01:52:00.783 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "channel_device", 2024-09-21T01:52:00.783 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.783 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.783 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.783 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-21T01:52:00.783 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.783 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.783 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.783 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-21T01:52:00.783 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.783 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.783 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.783 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.783 INFO:teuthology.orchestra.run.smithi083.stdout: "channel_ident": { 2024-09-21T01:52:00.784 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "channel_ident", 2024-09-21T01:52:00.784 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.784 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.784 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.784 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.784 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.784 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.784 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.784 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-21T01:52:00.784 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.784 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.784 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.784 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.784 INFO:teuthology.orchestra.run.smithi083.stdout: "channel_perf": { 2024-09-21T01:52:00.784 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "channel_perf", 2024-09-21T01:52:00.785 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.785 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.785 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.785 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.785 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.785 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.785 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.785 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-21T01:52:00.785 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.785 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.785 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.785 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.785 INFO:teuthology.orchestra.run.smithi083.stdout: "contact": { 2024-09-21T01:52:00.785 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "contact", 2024-09-21T01:52:00.785 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.786 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.786 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.786 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:52:00.786 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.786 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.786 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.786 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.786 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.786 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.786 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.786 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.786 INFO:teuthology.orchestra.run.smithi083.stdout: "description": { 2024-09-21T01:52:00.786 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "description", 2024-09-21T01:52:00.786 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.787 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.787 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.787 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:52:00.787 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.787 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.787 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.787 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.787 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.787 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.787 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.787 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.787 INFO:teuthology.orchestra.run.smithi083.stdout: "device_url": { 2024-09-21T01:52:00.787 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "device_url", 2024-09-21T01:52:00.787 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.787 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.788 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.788 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-21T01:52:00.788 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.788 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.788 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.788 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.788 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.788 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.788 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.788 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.788 INFO:teuthology.orchestra.run.smithi083.stdout: "enabled": { 2024-09-21T01:52:00.788 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "enabled", 2024-09-21T01:52:00.788 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.788 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.789 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.789 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.789 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.789 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.789 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.789 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.789 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.789 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.789 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.789 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.789 INFO:teuthology.orchestra.run.smithi083.stdout: "interval": { 2024-09-21T01:52:00.789 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "interval", 2024-09-21T01:52:00.789 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:52:00.789 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.789 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.790 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "24", 2024-09-21T01:52:00.790 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "8", 2024-09-21T01:52:00.790 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.790 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.790 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.790 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.790 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.790 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.790 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.790 INFO:teuthology.orchestra.run.smithi083.stdout: "last_opt_revision": { 2024-09-21T01:52:00.790 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "last_opt_revision", 2024-09-21T01:52:00.790 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:52:00.790 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.791 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.791 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "1", 2024-09-21T01:52:00.791 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.791 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.791 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.791 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.791 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.791 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.791 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.791 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.791 INFO:teuthology.orchestra.run.smithi083.stdout: "leaderboard": { 2024-09-21T01:52:00.791 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "leaderboard", 2024-09-21T01:52:00.791 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.791 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.792 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.792 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.792 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.792 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.792 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.792 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.792 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.792 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.792 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.792 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.792 INFO:teuthology.orchestra.run.smithi083.stdout: "leaderboard_description": { 2024-09-21T01:52:00.792 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "leaderboard_description", 2024-09-21T01:52:00.792 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.792 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.793 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.793 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:52:00.793 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.793 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.793 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.793 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.793 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.793 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.793 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.793 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.793 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-21T01:52:00.793 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-21T01:52:00.793 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.793 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.794 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.794 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:52:00.794 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.794 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.794 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:52:00.794 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:52:00.794 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:52:00.794 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:52:00.794 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:52:00.794 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:52:00.794 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:52:00.794 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:52:00.794 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.794 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.795 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.795 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.795 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.795 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-21T01:52:00.795 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-21T01:52:00.795 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.795 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.795 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.795 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.795 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.795 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.795 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.795 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.795 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.796 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.796 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.796 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.796 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-21T01:52:00.796 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-21T01:52:00.796 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.796 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.796 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.796 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-21T01:52:00.796 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.796 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.796 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:52:00.796 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:52:00.796 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:52:00.797 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:52:00.797 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:52:00.797 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:52:00.797 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:52:00.797 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:52:00.797 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.797 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.797 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.797 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.797 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.797 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-21T01:52:00.797 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-21T01:52:00.797 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.797 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.797 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.798 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.798 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.798 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.798 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.798 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.798 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.798 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.798 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.798 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.798 INFO:teuthology.orchestra.run.smithi083.stdout: "organization": { 2024-09-21T01:52:00.798 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "organization", 2024-09-21T01:52:00.798 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.798 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.798 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.799 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:52:00.799 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.799 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.799 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.799 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.799 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.799 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.799 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.799 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.799 INFO:teuthology.orchestra.run.smithi083.stdout: "proxy": { 2024-09-21T01:52:00.799 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "proxy", 2024-09-21T01:52:00.799 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.799 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.799 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.799 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:52:00.800 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.800 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.800 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.800 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.800 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.800 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.800 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.800 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.800 INFO:teuthology.orchestra.run.smithi083.stdout: "sqlite3_killpoint": { 2024-09-21T01:52:00.800 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:52:00.800 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:52:00.800 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "dev", 2024-09-21T01:52:00.800 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.800 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0", 2024-09-21T01:52:00.800 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.800 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.801 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.801 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.801 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.801 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.801 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.801 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.801 INFO:teuthology.orchestra.run.smithi083.stdout: "url": { 2024-09-21T01:52:00.801 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "url", 2024-09-21T01:52:00.801 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.801 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.801 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.801 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-21T01:52:00.801 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.801 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.801 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.802 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.802 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.802 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.802 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.802 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:52:00.802 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:52:00.802 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.802 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-21T01:52:00.802 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "test_orchestrator", 2024-09-21T01:52:00.802 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-21T01:52:00.802 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-21T01:52:00.802 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-21T01:52:00.802 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-21T01:52:00.802 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-21T01:52:00.803 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.803 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.803 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.803 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:52:00.803 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.803 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.803 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:52:00.803 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:52:00.803 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:52:00.803 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:52:00.803 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:52:00.803 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:52:00.803 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:52:00.803 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:52:00.803 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.804 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.804 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.804 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.804 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.804 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-21T01:52:00.804 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-21T01:52:00.804 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.804 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.804 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.804 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.804 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.804 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.804 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.804 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.804 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.805 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.805 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.805 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.805 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-21T01:52:00.805 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-21T01:52:00.805 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.805 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.805 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.805 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-21T01:52:00.805 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.805 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.805 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:52:00.805 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:52:00.805 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:52:00.806 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:52:00.806 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:52:00.806 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:52:00.806 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:52:00.806 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:52:00.806 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.806 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.806 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.806 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.806 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.806 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-21T01:52:00.806 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-21T01:52:00.806 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.806 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.807 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.807 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.807 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.807 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.807 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.807 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.807 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.807 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.807 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.807 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.807 INFO:teuthology.orchestra.run.smithi083.stdout: "sqlite3_killpoint": { 2024-09-21T01:52:00.807 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:52:00.807 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:52:00.807 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "dev", 2024-09-21T01:52:00.807 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.808 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0", 2024-09-21T01:52:00.808 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.808 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.808 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.808 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.808 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.808 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.808 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.808 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:52:00.808 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:52:00.808 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.808 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-21T01:52:00.808 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "volumes", 2024-09-21T01:52:00.808 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-21T01:52:00.809 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-21T01:52:00.809 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-21T01:52:00.809 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-21T01:52:00.809 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-21T01:52:00.809 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.809 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.809 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.809 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:52:00.809 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.809 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.809 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:52:00.809 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:52:00.809 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:52:00.809 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:52:00.809 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:52:00.810 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:52:00.810 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:52:00.810 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:52:00.810 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.810 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.810 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.810 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.810 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.810 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-21T01:52:00.810 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-21T01:52:00.810 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.810 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.810 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.810 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.811 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.811 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.811 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.811 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.811 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.811 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.811 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.811 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.811 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-21T01:52:00.811 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-21T01:52:00.811 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.811 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.811 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.811 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-21T01:52:00.811 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.812 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.812 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:52:00.812 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:52:00.812 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:52:00.812 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:52:00.812 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:52:00.812 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:52:00.812 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:52:00.812 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:52:00.812 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.812 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.812 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.812 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.812 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.813 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-21T01:52:00.813 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-21T01:52:00.813 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.813 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.813 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.813 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.813 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.813 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.813 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.813 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.813 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.813 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.813 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.813 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.813 INFO:teuthology.orchestra.run.smithi083.stdout: "max_concurrent_clones": { 2024-09-21T01:52:00.814 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "max_concurrent_clones", 2024-09-21T01:52:00.814 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:52:00.814 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.814 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.814 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "4", 2024-09-21T01:52:00.814 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.814 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.814 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.814 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-21T01:52:00.814 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.814 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.814 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.814 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.814 INFO:teuthology.orchestra.run.smithi083.stdout: "periodic_async_work": { 2024-09-21T01:52:00.815 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "periodic_async_work", 2024-09-21T01:52:00.815 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.815 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.815 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.815 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.815 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.815 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.815 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.815 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Periodically check for async work", 2024-09-21T01:52:00.815 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.815 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.815 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.815 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.815 INFO:teuthology.orchestra.run.smithi083.stdout: "snapshot_clone_delay": { 2024-09-21T01:52:00.815 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "snapshot_clone_delay", 2024-09-21T01:52:00.816 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:52:00.816 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.816 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.816 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0", 2024-09-21T01:52:00.816 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.816 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.816 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.816 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-21T01:52:00.816 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.816 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.816 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.816 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.816 INFO:teuthology.orchestra.run.smithi083.stdout: "snapshot_clone_no_wait": { 2024-09-21T01:52:00.816 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "snapshot_clone_no_wait", 2024-09-21T01:52:00.817 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.817 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.817 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.817 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "True", 2024-09-21T01:52:00.817 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.817 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.817 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.817 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-21T01:52:00.817 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.817 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.817 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.817 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.817 INFO:teuthology.orchestra.run.smithi083.stdout: "sqlite3_killpoint": { 2024-09-21T01:52:00.817 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:52:00.817 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:52:00.818 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "dev", 2024-09-21T01:52:00.818 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.818 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0", 2024-09-21T01:52:00.818 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.818 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.818 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.818 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.818 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.818 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.818 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.818 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:52:00.818 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:52:00.818 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.818 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-21T01:52:00.818 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "zabbix", 2024-09-21T01:52:00.819 INFO:teuthology.orchestra.run.smithi083.stdout: "can_run": true, 2024-09-21T01:52:00.819 INFO:teuthology.orchestra.run.smithi083.stdout: "error_string": "", 2024-09-21T01:52:00.819 INFO:teuthology.orchestra.run.smithi083.stdout: "module_options": { 2024-09-21T01:52:00.819 INFO:teuthology.orchestra.run.smithi083.stdout: "discovery_interval": { 2024-09-21T01:52:00.819 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "discovery_interval", 2024-09-21T01:52:00.819 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "uint", 2024-09-21T01:52:00.819 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.819 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.819 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "100", 2024-09-21T01:52:00.819 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.819 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.819 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.819 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.819 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.819 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.820 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.820 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.820 INFO:teuthology.orchestra.run.smithi083.stdout: "identifier": { 2024-09-21T01:52:00.820 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "identifier", 2024-09-21T01:52:00.820 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.820 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.820 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.820 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:52:00.820 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.820 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.820 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.820 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.820 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.820 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.821 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.821 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.821 INFO:teuthology.orchestra.run.smithi083.stdout: "interval": { 2024-09-21T01:52:00.821 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "interval", 2024-09-21T01:52:00.821 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "secs", 2024-09-21T01:52:00.821 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.821 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.821 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "60", 2024-09-21T01:52:00.821 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.821 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.821 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.821 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.821 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.821 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.821 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.821 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.822 INFO:teuthology.orchestra.run.smithi083.stdout: "log_level": { 2024-09-21T01:52:00.822 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_level", 2024-09-21T01:52:00.822 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.822 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.822 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.822 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:52:00.822 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.822 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.822 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:52:00.822 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:52:00.822 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:52:00.822 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:52:00.822 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:52:00.822 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:52:00.822 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:52:00.823 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:52:00.823 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.823 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.823 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.823 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.823 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.823 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster": { 2024-09-21T01:52:00.823 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster", 2024-09-21T01:52:00.823 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.823 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.823 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.823 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.823 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.823 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.824 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.824 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.824 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.824 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.824 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.824 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.824 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_cluster_level": { 2024-09-21T01:52:00.824 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_cluster_level", 2024-09-21T01:52:00.824 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.824 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.824 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.824 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "info", 2024-09-21T01:52:00.824 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.824 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.824 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [ 2024-09-21T01:52:00.825 INFO:teuthology.orchestra.run.smithi083.stdout: "", 2024-09-21T01:52:00.825 INFO:teuthology.orchestra.run.smithi083.stdout: "critical", 2024-09-21T01:52:00.825 INFO:teuthology.orchestra.run.smithi083.stdout: "debug", 2024-09-21T01:52:00.825 INFO:teuthology.orchestra.run.smithi083.stdout: "error", 2024-09-21T01:52:00.825 INFO:teuthology.orchestra.run.smithi083.stdout: "info", 2024-09-21T01:52:00.825 INFO:teuthology.orchestra.run.smithi083.stdout: "warning" 2024-09-21T01:52:00.825 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:52:00.825 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.825 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.825 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.825 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.825 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.825 INFO:teuthology.orchestra.run.smithi083.stdout: "log_to_file": { 2024-09-21T01:52:00.825 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "log_to_file", 2024-09-21T01:52:00.826 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "bool", 2024-09-21T01:52:00.826 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.826 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.826 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "False", 2024-09-21T01:52:00.826 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.826 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.826 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.826 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.826 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.826 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.826 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.826 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.826 INFO:teuthology.orchestra.run.smithi083.stdout: "sqlite3_killpoint": { 2024-09-21T01:52:00.826 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "sqlite3_killpoint", 2024-09-21T01:52:00.827 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:52:00.827 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "dev", 2024-09-21T01:52:00.827 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 1, 2024-09-21T01:52:00.827 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "0", 2024-09-21T01:52:00.827 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.827 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.827 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.827 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.827 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.827 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.827 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.827 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.827 INFO:teuthology.orchestra.run.smithi083.stdout: "zabbix_host": { 2024-09-21T01:52:00.827 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "zabbix_host", 2024-09-21T01:52:00.827 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.828 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.828 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.828 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "", 2024-09-21T01:52:00.828 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.828 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.828 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.828 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.828 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.828 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.828 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.828 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.828 INFO:teuthology.orchestra.run.smithi083.stdout: "zabbix_port": { 2024-09-21T01:52:00.828 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "zabbix_port", 2024-09-21T01:52:00.828 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "int", 2024-09-21T01:52:00.828 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.829 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.829 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "10051", 2024-09-21T01:52:00.829 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.829 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.829 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.829 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.829 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.829 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.829 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.829 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.829 INFO:teuthology.orchestra.run.smithi083.stdout: "zabbix_sender": { 2024-09-21T01:52:00.829 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "zabbix_sender", 2024-09-21T01:52:00.829 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "str", 2024-09-21T01:52:00.829 INFO:teuthology.orchestra.run.smithi083.stdout: "level": "advanced", 2024-09-21T01:52:00.829 INFO:teuthology.orchestra.run.smithi083.stdout: "flags": 0, 2024-09-21T01:52:00.829 INFO:teuthology.orchestra.run.smithi083.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-21T01:52:00.830 INFO:teuthology.orchestra.run.smithi083.stdout: "min": "", 2024-09-21T01:52:00.830 INFO:teuthology.orchestra.run.smithi083.stdout: "max": "", 2024-09-21T01:52:00.830 INFO:teuthology.orchestra.run.smithi083.stdout: "enum_allowed": [], 2024-09-21T01:52:00.830 INFO:teuthology.orchestra.run.smithi083.stdout: "desc": "", 2024-09-21T01:52:00.830 INFO:teuthology.orchestra.run.smithi083.stdout: "long_desc": "", 2024-09-21T01:52:00.830 INFO:teuthology.orchestra.run.smithi083.stdout: "tags": [], 2024-09-21T01:52:00.830 INFO:teuthology.orchestra.run.smithi083.stdout: "see_also": [] 2024-09-21T01:52:00.830 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:52:00.830 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:52:00.830 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:52:00.830 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:52:00.830 INFO:teuthology.orchestra.run.smithi083.stdout: "services": { 2024-09-21T01:52:00.830 INFO:teuthology.orchestra.run.smithi083.stdout: "dashboard": "https://172.21.15.83:8443/" 2024-09-21T01:52:00.830 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.830 INFO:teuthology.orchestra.run.smithi083.stdout: "always_on_modules": { 2024-09-21T01:52:00.831 INFO:teuthology.orchestra.run.smithi083.stdout: "octopus": [ 2024-09-21T01:52:00.831 INFO:teuthology.orchestra.run.smithi083.stdout: "balancer", 2024-09-21T01:52:00.831 INFO:teuthology.orchestra.run.smithi083.stdout: "crash", 2024-09-21T01:52:00.831 INFO:teuthology.orchestra.run.smithi083.stdout: "devicehealth", 2024-09-21T01:52:00.831 INFO:teuthology.orchestra.run.smithi083.stdout: "orchestrator", 2024-09-21T01:52:00.831 INFO:teuthology.orchestra.run.smithi083.stdout: "pg_autoscaler", 2024-09-21T01:52:00.831 INFO:teuthology.orchestra.run.smithi083.stdout: "progress", 2024-09-21T01:52:00.831 INFO:teuthology.orchestra.run.smithi083.stdout: "rbd_support", 2024-09-21T01:52:00.831 INFO:teuthology.orchestra.run.smithi083.stdout: "status", 2024-09-21T01:52:00.831 INFO:teuthology.orchestra.run.smithi083.stdout: "telemetry", 2024-09-21T01:52:00.831 INFO:teuthology.orchestra.run.smithi083.stdout: "volumes" 2024-09-21T01:52:00.831 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:52:00.831 INFO:teuthology.orchestra.run.smithi083.stdout: "pacific": [ 2024-09-21T01:52:00.831 INFO:teuthology.orchestra.run.smithi083.stdout: "balancer", 2024-09-21T01:52:00.831 INFO:teuthology.orchestra.run.smithi083.stdout: "crash", 2024-09-21T01:52:00.832 INFO:teuthology.orchestra.run.smithi083.stdout: "devicehealth", 2024-09-21T01:52:00.832 INFO:teuthology.orchestra.run.smithi083.stdout: "orchestrator", 2024-09-21T01:52:00.832 INFO:teuthology.orchestra.run.smithi083.stdout: "pg_autoscaler", 2024-09-21T01:52:00.832 INFO:teuthology.orchestra.run.smithi083.stdout: "progress", 2024-09-21T01:52:00.832 INFO:teuthology.orchestra.run.smithi083.stdout: "rbd_support", 2024-09-21T01:52:00.832 INFO:teuthology.orchestra.run.smithi083.stdout: "status", 2024-09-21T01:52:00.832 INFO:teuthology.orchestra.run.smithi083.stdout: "telemetry", 2024-09-21T01:52:00.832 INFO:teuthology.orchestra.run.smithi083.stdout: "volumes" 2024-09-21T01:52:00.832 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:52:00.832 INFO:teuthology.orchestra.run.smithi083.stdout: "quincy": [ 2024-09-21T01:52:00.832 INFO:teuthology.orchestra.run.smithi083.stdout: "balancer", 2024-09-21T01:52:00.832 INFO:teuthology.orchestra.run.smithi083.stdout: "crash", 2024-09-21T01:52:00.832 INFO:teuthology.orchestra.run.smithi083.stdout: "devicehealth", 2024-09-21T01:52:00.832 INFO:teuthology.orchestra.run.smithi083.stdout: "orchestrator", 2024-09-21T01:52:00.833 INFO:teuthology.orchestra.run.smithi083.stdout: "pg_autoscaler", 2024-09-21T01:52:00.833 INFO:teuthology.orchestra.run.smithi083.stdout: "progress", 2024-09-21T01:52:00.833 INFO:teuthology.orchestra.run.smithi083.stdout: "rbd_support", 2024-09-21T01:52:00.833 INFO:teuthology.orchestra.run.smithi083.stdout: "status", 2024-09-21T01:52:00.833 INFO:teuthology.orchestra.run.smithi083.stdout: "telemetry", 2024-09-21T01:52:00.833 INFO:teuthology.orchestra.run.smithi083.stdout: "volumes" 2024-09-21T01:52:00.833 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:52:00.833 INFO:teuthology.orchestra.run.smithi083.stdout: "reef": [ 2024-09-21T01:52:00.833 INFO:teuthology.orchestra.run.smithi083.stdout: "balancer", 2024-09-21T01:52:00.833 INFO:teuthology.orchestra.run.smithi083.stdout: "crash", 2024-09-21T01:52:00.833 INFO:teuthology.orchestra.run.smithi083.stdout: "devicehealth", 2024-09-21T01:52:00.833 INFO:teuthology.orchestra.run.smithi083.stdout: "orchestrator", 2024-09-21T01:52:00.833 INFO:teuthology.orchestra.run.smithi083.stdout: "pg_autoscaler", 2024-09-21T01:52:00.833 INFO:teuthology.orchestra.run.smithi083.stdout: "progress", 2024-09-21T01:52:00.834 INFO:teuthology.orchestra.run.smithi083.stdout: "rbd_support", 2024-09-21T01:52:00.834 INFO:teuthology.orchestra.run.smithi083.stdout: "status", 2024-09-21T01:52:00.834 INFO:teuthology.orchestra.run.smithi083.stdout: "telemetry", 2024-09-21T01:52:00.834 INFO:teuthology.orchestra.run.smithi083.stdout: "volumes" 2024-09-21T01:52:00.834 INFO:teuthology.orchestra.run.smithi083.stdout: ], 2024-09-21T01:52:00.834 INFO:teuthology.orchestra.run.smithi083.stdout: "squid": [ 2024-09-21T01:52:00.834 INFO:teuthology.orchestra.run.smithi083.stdout: "balancer", 2024-09-21T01:52:00.834 INFO:teuthology.orchestra.run.smithi083.stdout: "crash", 2024-09-21T01:52:00.834 INFO:teuthology.orchestra.run.smithi083.stdout: "devicehealth", 2024-09-21T01:52:00.834 INFO:teuthology.orchestra.run.smithi083.stdout: "orchestrator", 2024-09-21T01:52:00.834 INFO:teuthology.orchestra.run.smithi083.stdout: "pg_autoscaler", 2024-09-21T01:52:00.834 INFO:teuthology.orchestra.run.smithi083.stdout: "progress", 2024-09-21T01:52:00.834 INFO:teuthology.orchestra.run.smithi083.stdout: "rbd_support", 2024-09-21T01:52:00.834 INFO:teuthology.orchestra.run.smithi083.stdout: "status", 2024-09-21T01:52:00.835 INFO:teuthology.orchestra.run.smithi083.stdout: "telemetry", 2024-09-21T01:52:00.835 INFO:teuthology.orchestra.run.smithi083.stdout: "volumes" 2024-09-21T01:52:00.835 INFO:teuthology.orchestra.run.smithi083.stdout: ] 2024-09-21T01:52:00.835 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.835 INFO:teuthology.orchestra.run.smithi083.stdout: "last_failure_osd_epoch": 5, 2024-09-21T01:52:00.835 INFO:teuthology.orchestra.run.smithi083.stdout: "active_clients": [ 2024-09-21T01:52:00.835 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-21T01:52:00.835 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "devicehealth", 2024-09-21T01:52:00.835 INFO:teuthology.orchestra.run.smithi083.stdout: "addrvec": [ 2024-09-21T01:52:00.835 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-21T01:52:00.835 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "v2", 2024-09-21T01:52:00.835 INFO:teuthology.orchestra.run.smithi083.stdout: "addr": "172.21.15.83:0", 2024-09-21T01:52:00.835 INFO:teuthology.orchestra.run.smithi083.stdout: "nonce": 4164563527 2024-09-21T01:52:00.835 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:52:00.835 INFO:teuthology.orchestra.run.smithi083.stdout: ] 2024-09-21T01:52:00.836 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.836 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-21T01:52:00.836 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "libcephsqlite", 2024-09-21T01:52:00.836 INFO:teuthology.orchestra.run.smithi083.stdout: "addrvec": [ 2024-09-21T01:52:00.836 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-21T01:52:00.836 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "v2", 2024-09-21T01:52:00.836 INFO:teuthology.orchestra.run.smithi083.stdout: "addr": "172.21.15.83:0", 2024-09-21T01:52:00.836 INFO:teuthology.orchestra.run.smithi083.stdout: "nonce": 1520876042 2024-09-21T01:52:00.836 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:52:00.836 INFO:teuthology.orchestra.run.smithi083.stdout: ] 2024-09-21T01:52:00.836 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.836 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-21T01:52:00.836 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "rbd_support", 2024-09-21T01:52:00.836 INFO:teuthology.orchestra.run.smithi083.stdout: "addrvec": [ 2024-09-21T01:52:00.837 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-21T01:52:00.837 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "v2", 2024-09-21T01:52:00.837 INFO:teuthology.orchestra.run.smithi083.stdout: "addr": "172.21.15.83:0", 2024-09-21T01:52:00.837 INFO:teuthology.orchestra.run.smithi083.stdout: "nonce": 3162415997 2024-09-21T01:52:00.837 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:52:00.837 INFO:teuthology.orchestra.run.smithi083.stdout: ] 2024-09-21T01:52:00.837 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.837 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-21T01:52:00.837 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "snap_schedule", 2024-09-21T01:52:00.837 INFO:teuthology.orchestra.run.smithi083.stdout: "addrvec": [ 2024-09-21T01:52:00.837 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-21T01:52:00.837 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "v2", 2024-09-21T01:52:00.837 INFO:teuthology.orchestra.run.smithi083.stdout: "addr": "172.21.15.83:0", 2024-09-21T01:52:00.837 INFO:teuthology.orchestra.run.smithi083.stdout: "nonce": 2964984553 2024-09-21T01:52:00.837 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:52:00.838 INFO:teuthology.orchestra.run.smithi083.stdout: ] 2024-09-21T01:52:00.838 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.838 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-21T01:52:00.838 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "snap_schedule", 2024-09-21T01:52:00.838 INFO:teuthology.orchestra.run.smithi083.stdout: "addrvec": [ 2024-09-21T01:52:00.838 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-21T01:52:00.838 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "v2", 2024-09-21T01:52:00.838 INFO:teuthology.orchestra.run.smithi083.stdout: "addr": "172.21.15.83:0", 2024-09-21T01:52:00.838 INFO:teuthology.orchestra.run.smithi083.stdout: "nonce": 2707380789 2024-09-21T01:52:00.838 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:52:00.838 INFO:teuthology.orchestra.run.smithi083.stdout: ] 2024-09-21T01:52:00.838 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:00.838 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-21T01:52:00.838 INFO:teuthology.orchestra.run.smithi083.stdout: "name": "volumes", 2024-09-21T01:52:00.838 INFO:teuthology.orchestra.run.smithi083.stdout: "addrvec": [ 2024-09-21T01:52:00.839 INFO:teuthology.orchestra.run.smithi083.stdout: { 2024-09-21T01:52:00.839 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "v2", 2024-09-21T01:52:00.839 INFO:teuthology.orchestra.run.smithi083.stdout: "addr": "172.21.15.83:0", 2024-09-21T01:52:00.839 INFO:teuthology.orchestra.run.smithi083.stdout: "nonce": 1946793512 2024-09-21T01:52:00.839 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:52:00.839 INFO:teuthology.orchestra.run.smithi083.stdout: ] 2024-09-21T01:52:00.839 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:52:00.839 INFO:teuthology.orchestra.run.smithi083.stdout: ] 2024-09-21T01:52:00.839 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-09-21T01:52:00.840 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:59.386+0000 7fb99aece640 1 -- 172.21.15.83:0/2550870353 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fb9840b6680 msgr2=0x7fb9840b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:52:00.840 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:59.386+0000 7fb99aece640 1 --2- 172.21.15.83:0/2550870353 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fb9840b6680 0x7fb9840b8b90 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fb980005940 tx=0x7fb9800058d0 comp rx=0 tx=0).stop 2024-09-21T01:52:00.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:59.386+0000 7fb99aece640 1 -- 172.21.15.83:0/2550870353 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb994103100 msgr2=0x7fb9941992f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:52:00.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:59.386+0000 7fb99aece640 1 --2- 172.21.15.83:0/2550870353 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb994103100 0x7fb9941992f0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fb98800c970 tx=0x7fb98800ce30 comp rx=0 tx=0).stop 2024-09-21T01:52:00.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:59.386+0000 7fb99aece640 1 -- 172.21.15.83:0/2550870353 shutdown_connections 2024-09-21T01:52:00.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:59.386+0000 7fb99aece640 1 --2- 172.21.15.83:0/2550870353 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fb9840b6680 0x7fb9840b8b90 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:52:00.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:59.386+0000 7fb99aece640 1 --2- 172.21.15.83:0/2550870353 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb994105a10 0x7fb99419eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:52:00.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:59.386+0000 7fb99aece640 1 --2- 172.21.15.83:0/2550870353 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb9941050c0 0x7fb994199890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:52:00.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:59.386+0000 7fb99aece640 1 --2- 172.21.15.83:0/2550870353 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb994103100 0x7fb9941992f0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:52:00.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:59.386+0000 7fb99aece640 1 -- 172.21.15.83:0/2550870353 >> 172.21.15.83:0/2550870353 conn(0x7fb994079ce0 msgr2=0x7fb994108530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:52:00.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:59.386+0000 7fb99aece640 1 -- 172.21.15.83:0/2550870353 shutdown_connections 2024-09-21T01:52:00.841 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:51:59.386+0000 7fb99aece640 1 -- 172.21.15.83:0/2550870353 wait complete. 2024-09-21T01:52:00.887 DEBUG:tasks.check_counter:Getting stats from a 2024-09-21T01:52:00.887 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph daemon mds.a perf dump 2024-09-21T01:52:00.887 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:51:59 smithi083 ceph-mon[31370]: from='client.? 172.21.15.83:0/2955306681' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-21T01:52:00.887 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:51:59 smithi083 ceph-mon[31370]: from='client.? 172.21.15.83:0/651274450' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} : dispatch 2024-09-21T01:52:00.888 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:51:59 smithi083 ceph-mon[31370]: from='client.? 172.21.15.83:0/2550870353' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json-pretty"} : dispatch 2024-09-21T01:52:00.888 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:51:59 smithi119 ceph-mon[33693]: from='client.? 172.21.15.83:0/2955306681' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-21T01:52:00.888 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:51:59 smithi119 ceph-mon[33693]: from='client.? 172.21.15.83:0/651274450' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} : dispatch 2024-09-21T01:52:00.889 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:51:59 smithi119 ceph-mon[33693]: from='client.? 172.21.15.83:0/2550870353' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json-pretty"} : dispatch 2024-09-21T01:52:00.889 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:51:59 smithi142 ceph-mon[34050]: from='client.? 172.21.15.83:0/2955306681' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-21T01:52:00.889 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:51:59 smithi142 ceph-mon[34050]: from='client.? 172.21.15.83:0/651274450' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} : dispatch 2024-09-21T01:52:00.889 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:51:59 smithi142 ceph-mon[34050]: from='client.? 172.21.15.83:0/2550870353' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json-pretty"} : dispatch 2024-09-21T01:52:00.964 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:52:00 smithi142 ceph-mon[34050]: pgmap v645: 129 pgs: 129 active+clean; 27 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T01:52:00.967 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:52:00 smithi119 ceph-mon[33693]: pgmap v645: 129 pgs: 129 active+clean; 27 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T01:52:01.053 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:52:00 smithi083 ceph-mon[31370]: pgmap v645: 129 pgs: 129 active+clean; 27 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T01:52:01.133 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:52:01.660 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-09-21T01:52:01.660 INFO:teuthology.orchestra.run.smithi083.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T01:52:01.660 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_recv_messages": 0, 2024-09-21T01:52:01.660 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_messages": 2, 2024-09-21T01:52:01.660 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_recv_bytes": 0, 2024-09-21T01:52:01.661 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_bytes": 0, 2024-09-21T01:52:01.661 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_created_connections": 4, 2024-09-21T01:52:01.661 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_active_connections": 0, 2024-09-21T01:52:01.661 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_total_time": 0.001243996, 2024-09-21T01:52:01.661 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_send_time": 0.000000000, 2024-09-21T01:52:01.661 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_recv_time": 0.000294855, 2024-09-21T01:52:01.661 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T01:52:01.661 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:52:01.661 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-21T01:52:01.661 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-21T01:52:01.661 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-21T01:52:01.661 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:01.661 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:52:01.661 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-21T01:52:01.662 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-21T01:52:01.662 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-21T01:52:01.662 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:01.662 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T01:52:01.662 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T01:52:01.662 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:01.662 INFO:teuthology.orchestra.run.smithi083.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T01:52:01.662 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_recv_messages": 211, 2024-09-21T01:52:01.662 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_messages": 204, 2024-09-21T01:52:01.662 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_recv_bytes": 836816, 2024-09-21T01:52:01.662 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_bytes": 124512, 2024-09-21T01:52:01.662 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_created_connections": 2, 2024-09-21T01:52:01.662 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_active_connections": 1, 2024-09-21T01:52:01.662 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_total_time": 0.037065744, 2024-09-21T01:52:01.663 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_send_time": 0.017801276, 2024-09-21T01:52:01.663 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_recv_time": 0.025473010, 2024-09-21T01:52:01.663 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T01:52:01.663 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:52:01.663 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 204, 2024-09-21T01:52:01.663 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.015941884, 2024-09-21T01:52:01.663 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000078146 2024-09-21T01:52:01.663 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:01.663 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:52:01.663 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-21T01:52:01.663 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-21T01:52:01.663 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-21T01:52:01.663 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:01.663 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_recv_encrypted_bytes": 836816, 2024-09-21T01:52:01.664 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_encrypted_bytes": 124512 2024-09-21T01:52:01.664 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:01.664 INFO:teuthology.orchestra.run.smithi083.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T01:52:01.664 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_recv_messages": 1, 2024-09-21T01:52:01.664 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_messages": 153, 2024-09-21T01:52:01.664 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_recv_bytes": 160, 2024-09-21T01:52:01.664 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_bytes": 107072, 2024-09-21T01:52:01.664 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_created_connections": 3, 2024-09-21T01:52:01.664 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_active_connections": 2, 2024-09-21T01:52:01.664 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_total_time": 0.015775370, 2024-09-21T01:52:01.664 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_send_time": 0.012795794, 2024-09-21T01:52:01.664 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_recv_time": 0.001341890, 2024-09-21T01:52:01.664 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T01:52:01.664 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:52:01.665 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 151, 2024-09-21T01:52:01.665 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.008074374, 2024-09-21T01:52:01.665 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000053472 2024-09-21T01:52:01.665 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:01.665 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:52:01.665 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-21T01:52:01.665 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-21T01:52:01.665 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-21T01:52:01.665 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:01.665 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-21T01:52:01.665 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_encrypted_bytes": 107072 2024-09-21T01:52:01.665 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:01.665 INFO:teuthology.orchestra.run.smithi083.stdout: "cct": { 2024-09-21T01:52:01.665 INFO:teuthology.orchestra.run.smithi083.stdout: "total_workers": 0, 2024-09-21T01:52:01.665 INFO:teuthology.orchestra.run.smithi083.stdout: "unhealthy_workers": 0 2024-09-21T01:52:01.666 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:01.666 INFO:teuthology.orchestra.run.smithi083.stdout: "mempool": { 2024-09-21T01:52:01.666 INFO:teuthology.orchestra.run.smithi083.stdout: "bloom_filter_bytes": 0, 2024-09-21T01:52:01.666 INFO:teuthology.orchestra.run.smithi083.stdout: "bloom_filter_items": 0, 2024-09-21T01:52:01.666 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T01:52:01.666 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_alloc_items": 0, 2024-09-21T01:52:01.666 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T01:52:01.666 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_cache_data_items": 0, 2024-09-21T01:52:01.666 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T01:52:01.666 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T01:52:01.666 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T01:52:01.666 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T01:52:01.666 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T01:52:01.667 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_cache_other_items": 0, 2024-09-21T01:52:01.667 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T01:52:01.667 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T01:52:01.667 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_extent_bytes": 0, 2024-09-21T01:52:01.667 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_extent_items": 0, 2024-09-21T01:52:01.667 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_blob_bytes": 0, 2024-09-21T01:52:01.667 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_blob_items": 0, 2024-09-21T01:52:01.667 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T01:52:01.667 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T01:52:01.667 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T01:52:01.667 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T01:52:01.667 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T01:52:01.667 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_fsck_items": 0, 2024-09-21T01:52:01.667 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_txc_bytes": 0, 2024-09-21T01:52:01.667 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_txc_items": 0, 2024-09-21T01:52:01.668 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T01:52:01.668 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T01:52:01.668 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_writing_bytes": 0, 2024-09-21T01:52:01.668 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_writing_items": 0, 2024-09-21T01:52:01.668 INFO:teuthology.orchestra.run.smithi083.stdout: "bluefs_bytes": 0, 2024-09-21T01:52:01.668 INFO:teuthology.orchestra.run.smithi083.stdout: "bluefs_items": 0, 2024-09-21T01:52:01.668 INFO:teuthology.orchestra.run.smithi083.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T01:52:01.668 INFO:teuthology.orchestra.run.smithi083.stdout: "bluefs_file_reader_items": 0, 2024-09-21T01:52:01.668 INFO:teuthology.orchestra.run.smithi083.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T01:52:01.668 INFO:teuthology.orchestra.run.smithi083.stdout: "bluefs_file_writer_items": 0, 2024-09-21T01:52:01.668 INFO:teuthology.orchestra.run.smithi083.stdout: "buffer_anon_bytes": 149047, 2024-09-21T01:52:01.668 INFO:teuthology.orchestra.run.smithi083.stdout: "buffer_anon_items": 31, 2024-09-21T01:52:01.668 INFO:teuthology.orchestra.run.smithi083.stdout: "buffer_meta_bytes": 0, 2024-09-21T01:52:01.668 INFO:teuthology.orchestra.run.smithi083.stdout: "buffer_meta_items": 0, 2024-09-21T01:52:01.669 INFO:teuthology.orchestra.run.smithi083.stdout: "osd_bytes": 0, 2024-09-21T01:52:01.669 INFO:teuthology.orchestra.run.smithi083.stdout: "osd_items": 0, 2024-09-21T01:52:01.669 INFO:teuthology.orchestra.run.smithi083.stdout: "osd_mapbl_bytes": 0, 2024-09-21T01:52:01.669 INFO:teuthology.orchestra.run.smithi083.stdout: "osd_mapbl_items": 0, 2024-09-21T01:52:01.669 INFO:teuthology.orchestra.run.smithi083.stdout: "osd_pglog_bytes": 0, 2024-09-21T01:52:01.669 INFO:teuthology.orchestra.run.smithi083.stdout: "osd_pglog_items": 0, 2024-09-21T01:52:01.669 INFO:teuthology.orchestra.run.smithi083.stdout: "osdmap_bytes": 0, 2024-09-21T01:52:01.669 INFO:teuthology.orchestra.run.smithi083.stdout: "osdmap_items": 0, 2024-09-21T01:52:01.669 INFO:teuthology.orchestra.run.smithi083.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T01:52:01.669 INFO:teuthology.orchestra.run.smithi083.stdout: "osdmap_mapping_items": 0, 2024-09-21T01:52:01.669 INFO:teuthology.orchestra.run.smithi083.stdout: "pgmap_bytes": 0, 2024-09-21T01:52:01.669 INFO:teuthology.orchestra.run.smithi083.stdout: "pgmap_items": 0, 2024-09-21T01:52:01.669 INFO:teuthology.orchestra.run.smithi083.stdout: "mds_co_bytes": 968, 2024-09-21T01:52:01.669 INFO:teuthology.orchestra.run.smithi083.stdout: "mds_co_items": 2, 2024-09-21T01:52:01.669 INFO:teuthology.orchestra.run.smithi083.stdout: "unittest_1_bytes": 0, 2024-09-21T01:52:01.670 INFO:teuthology.orchestra.run.smithi083.stdout: "unittest_1_items": 0, 2024-09-21T01:52:01.670 INFO:teuthology.orchestra.run.smithi083.stdout: "unittest_2_bytes": 0, 2024-09-21T01:52:01.670 INFO:teuthology.orchestra.run.smithi083.stdout: "unittest_2_items": 0 2024-09-21T01:52:01.670 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:01.670 INFO:teuthology.orchestra.run.smithi083.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T01:52:01.670 INFO:teuthology.orchestra.run.smithi083.stdout: "val": 0, 2024-09-21T01:52:01.670 INFO:teuthology.orchestra.run.smithi083.stdout: "max": 104857600, 2024-09-21T01:52:01.670 INFO:teuthology.orchestra.run.smithi083.stdout: "get_started": 0, 2024-09-21T01:52:01.670 INFO:teuthology.orchestra.run.smithi083.stdout: "get": 208, 2024-09-21T01:52:01.670 INFO:teuthology.orchestra.run.smithi083.stdout: "get_sum": 804644, 2024-09-21T01:52:01.670 INFO:teuthology.orchestra.run.smithi083.stdout: "get_or_fail_fail": 0, 2024-09-21T01:52:01.670 INFO:teuthology.orchestra.run.smithi083.stdout: "get_or_fail_success": 208, 2024-09-21T01:52:01.670 INFO:teuthology.orchestra.run.smithi083.stdout: "take": 0, 2024-09-21T01:52:01.671 INFO:teuthology.orchestra.run.smithi083.stdout: "take_sum": 0, 2024-09-21T01:52:01.671 INFO:teuthology.orchestra.run.smithi083.stdout: "put": 208, 2024-09-21T01:52:01.671 INFO:teuthology.orchestra.run.smithi083.stdout: "put_sum": 804644, 2024-09-21T01:52:01.671 INFO:teuthology.orchestra.run.smithi083.stdout: "wait": { 2024-09-21T01:52:01.671 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-21T01:52:01.671 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-21T01:52:01.671 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-21T01:52:01.671 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:52:01.671 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:52:01.671 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-09-21T01:52:02.458 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.a 2024-09-21T01:52:02.458 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.a 2024-09-21T01:52:02.458 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.a 2024-09-21T01:52:02.458 DEBUG:tasks.check_counter:Getting stats from d 2024-09-21T01:52:02.458 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph daemon mds.d perf dump 2024-09-21T01:52:02.714 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:52:02.947 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:52:02 smithi083 ceph-mon[31370]: pgmap v646: 129 pgs: 129 active+clean; 27 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 0 B/s wr, 3 op/s 2024-09-21T01:52:02.964 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:52:02 smithi142 ceph-mon[34050]: pgmap v646: 129 pgs: 129 active+clean; 27 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 0 B/s wr, 3 op/s 2024-09-21T01:52:02.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:52:02 smithi119 ceph-mon[33693]: pgmap v646: 129 pgs: 129 active+clean; 27 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 0 B/s wr, 3 op/s 2024-09-21T01:52:03.244 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-09-21T01:52:03.244 INFO:teuthology.orchestra.run.smithi083.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T01:52:03.244 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_recv_messages": 213, 2024-09-21T01:52:03.244 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_messages": 208, 2024-09-21T01:52:03.244 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_recv_bytes": 835600, 2024-09-21T01:52:03.244 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_bytes": 127424, 2024-09-21T01:52:03.245 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_created_connections": 4, 2024-09-21T01:52:03.245 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_active_connections": 0, 2024-09-21T01:52:03.245 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_total_time": 0.037976492, 2024-09-21T01:52:03.245 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_send_time": 0.017854387, 2024-09-21T01:52:03.245 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_recv_time": 0.026894103, 2024-09-21T01:52:03.245 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T01:52:03.245 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:52:03.245 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 207, 2024-09-21T01:52:03.245 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.011793227, 2024-09-21T01:52:03.245 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000056972 2024-09-21T01:52:03.245 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:03.245 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:52:03.245 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-21T01:52:03.245 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-21T01:52:03.246 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-21T01:52:03.246 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:03.246 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_recv_encrypted_bytes": 835600, 2024-09-21T01:52:03.246 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_encrypted_bytes": 127424 2024-09-21T01:52:03.246 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:03.246 INFO:teuthology.orchestra.run.smithi083.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T01:52:03.246 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_recv_messages": 5, 2024-09-21T01:52:03.246 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_messages": 159, 2024-09-21T01:52:03.246 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_recv_bytes": 3072, 2024-09-21T01:52:03.246 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_bytes": 108224, 2024-09-21T01:52:03.246 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_created_connections": 3, 2024-09-21T01:52:03.246 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_active_connections": 2, 2024-09-21T01:52:03.246 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_total_time": 0.016341672, 2024-09-21T01:52:03.246 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_send_time": 0.011760253, 2024-09-21T01:52:03.247 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_recv_time": 0.003216716, 2024-09-21T01:52:03.247 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T01:52:03.247 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:52:03.247 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 158, 2024-09-21T01:52:03.247 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.012273621, 2024-09-21T01:52:03.247 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000077681 2024-09-21T01:52:03.247 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:03.247 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:52:03.247 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-21T01:52:03.247 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-21T01:52:03.247 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-21T01:52:03.247 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:03.247 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_recv_encrypted_bytes": 3072, 2024-09-21T01:52:03.247 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_encrypted_bytes": 108224 2024-09-21T01:52:03.248 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:03.248 INFO:teuthology.orchestra.run.smithi083.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T01:52:03.248 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_recv_messages": 0, 2024-09-21T01:52:03.248 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_messages": 2, 2024-09-21T01:52:03.248 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_recv_bytes": 0, 2024-09-21T01:52:03.248 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_bytes": 0, 2024-09-21T01:52:03.248 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_created_connections": 2, 2024-09-21T01:52:03.248 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_active_connections": 1, 2024-09-21T01:52:03.248 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_total_time": 0.000259212, 2024-09-21T01:52:03.248 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_send_time": 0.000000000, 2024-09-21T01:52:03.248 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_recv_time": 0.000166618, 2024-09-21T01:52:03.248 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T01:52:03.248 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:52:03.248 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-21T01:52:03.249 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-21T01:52:03.249 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-21T01:52:03.249 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:03.249 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:52:03.249 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-21T01:52:03.249 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-21T01:52:03.249 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-21T01:52:03.249 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:03.249 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T01:52:03.249 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T01:52:03.249 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:03.249 INFO:teuthology.orchestra.run.smithi083.stdout: "cct": { 2024-09-21T01:52:03.249 INFO:teuthology.orchestra.run.smithi083.stdout: "total_workers": 0, 2024-09-21T01:52:03.249 INFO:teuthology.orchestra.run.smithi083.stdout: "unhealthy_workers": 0 2024-09-21T01:52:03.250 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:03.250 INFO:teuthology.orchestra.run.smithi083.stdout: "mempool": { 2024-09-21T01:52:03.250 INFO:teuthology.orchestra.run.smithi083.stdout: "bloom_filter_bytes": 0, 2024-09-21T01:52:03.250 INFO:teuthology.orchestra.run.smithi083.stdout: "bloom_filter_items": 0, 2024-09-21T01:52:03.250 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T01:52:03.250 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_alloc_items": 0, 2024-09-21T01:52:03.250 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T01:52:03.250 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_cache_data_items": 0, 2024-09-21T01:52:03.250 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T01:52:03.250 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T01:52:03.250 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T01:52:03.250 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T01:52:03.250 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T01:52:03.250 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_cache_other_items": 0, 2024-09-21T01:52:03.251 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T01:52:03.251 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T01:52:03.251 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_extent_bytes": 0, 2024-09-21T01:52:03.251 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_extent_items": 0, 2024-09-21T01:52:03.251 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_blob_bytes": 0, 2024-09-21T01:52:03.251 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_blob_items": 0, 2024-09-21T01:52:03.251 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T01:52:03.251 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T01:52:03.251 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T01:52:03.251 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T01:52:03.251 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T01:52:03.251 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_fsck_items": 0, 2024-09-21T01:52:03.251 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_txc_bytes": 0, 2024-09-21T01:52:03.251 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_txc_items": 0, 2024-09-21T01:52:03.251 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T01:52:03.252 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T01:52:03.252 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_writing_bytes": 0, 2024-09-21T01:52:03.252 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_writing_items": 0, 2024-09-21T01:52:03.252 INFO:teuthology.orchestra.run.smithi083.stdout: "bluefs_bytes": 0, 2024-09-21T01:52:03.252 INFO:teuthology.orchestra.run.smithi083.stdout: "bluefs_items": 0, 2024-09-21T01:52:03.252 INFO:teuthology.orchestra.run.smithi083.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T01:52:03.252 INFO:teuthology.orchestra.run.smithi083.stdout: "bluefs_file_reader_items": 0, 2024-09-21T01:52:03.252 INFO:teuthology.orchestra.run.smithi083.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T01:52:03.252 INFO:teuthology.orchestra.run.smithi083.stdout: "bluefs_file_writer_items": 0, 2024-09-21T01:52:03.252 INFO:teuthology.orchestra.run.smithi083.stdout: "buffer_anon_bytes": 148967, 2024-09-21T01:52:03.252 INFO:teuthology.orchestra.run.smithi083.stdout: "buffer_anon_items": 29, 2024-09-21T01:52:03.252 INFO:teuthology.orchestra.run.smithi083.stdout: "buffer_meta_bytes": 0, 2024-09-21T01:52:03.252 INFO:teuthology.orchestra.run.smithi083.stdout: "buffer_meta_items": 0, 2024-09-21T01:52:03.252 INFO:teuthology.orchestra.run.smithi083.stdout: "osd_bytes": 0, 2024-09-21T01:52:03.253 INFO:teuthology.orchestra.run.smithi083.stdout: "osd_items": 0, 2024-09-21T01:52:03.253 INFO:teuthology.orchestra.run.smithi083.stdout: "osd_mapbl_bytes": 0, 2024-09-21T01:52:03.253 INFO:teuthology.orchestra.run.smithi083.stdout: "osd_mapbl_items": 0, 2024-09-21T01:52:03.253 INFO:teuthology.orchestra.run.smithi083.stdout: "osd_pglog_bytes": 0, 2024-09-21T01:52:03.253 INFO:teuthology.orchestra.run.smithi083.stdout: "osd_pglog_items": 0, 2024-09-21T01:52:03.253 INFO:teuthology.orchestra.run.smithi083.stdout: "osdmap_bytes": 0, 2024-09-21T01:52:03.253 INFO:teuthology.orchestra.run.smithi083.stdout: "osdmap_items": 0, 2024-09-21T01:52:03.253 INFO:teuthology.orchestra.run.smithi083.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T01:52:03.253 INFO:teuthology.orchestra.run.smithi083.stdout: "osdmap_mapping_items": 0, 2024-09-21T01:52:03.253 INFO:teuthology.orchestra.run.smithi083.stdout: "pgmap_bytes": 0, 2024-09-21T01:52:03.253 INFO:teuthology.orchestra.run.smithi083.stdout: "pgmap_items": 0, 2024-09-21T01:52:03.253 INFO:teuthology.orchestra.run.smithi083.stdout: "mds_co_bytes": 968, 2024-09-21T01:52:03.253 INFO:teuthology.orchestra.run.smithi083.stdout: "mds_co_items": 2, 2024-09-21T01:52:03.253 INFO:teuthology.orchestra.run.smithi083.stdout: "unittest_1_bytes": 0, 2024-09-21T01:52:03.253 INFO:teuthology.orchestra.run.smithi083.stdout: "unittest_1_items": 0, 2024-09-21T01:52:03.254 INFO:teuthology.orchestra.run.smithi083.stdout: "unittest_2_bytes": 0, 2024-09-21T01:52:03.254 INFO:teuthology.orchestra.run.smithi083.stdout: "unittest_2_items": 0 2024-09-21T01:52:03.254 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:03.254 INFO:teuthology.orchestra.run.smithi083.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T01:52:03.254 INFO:teuthology.orchestra.run.smithi083.stdout: "val": 0, 2024-09-21T01:52:03.254 INFO:teuthology.orchestra.run.smithi083.stdout: "max": 104857600, 2024-09-21T01:52:03.254 INFO:teuthology.orchestra.run.smithi083.stdout: "get_started": 0, 2024-09-21T01:52:03.254 INFO:teuthology.orchestra.run.smithi083.stdout: "get": 214, 2024-09-21T01:52:03.254 INFO:teuthology.orchestra.run.smithi083.stdout: "get_sum": 805488, 2024-09-21T01:52:03.254 INFO:teuthology.orchestra.run.smithi083.stdout: "get_or_fail_fail": 0, 2024-09-21T01:52:03.254 INFO:teuthology.orchestra.run.smithi083.stdout: "get_or_fail_success": 214, 2024-09-21T01:52:03.254 INFO:teuthology.orchestra.run.smithi083.stdout: "take": 0, 2024-09-21T01:52:03.254 INFO:teuthology.orchestra.run.smithi083.stdout: "take_sum": 0, 2024-09-21T01:52:03.254 INFO:teuthology.orchestra.run.smithi083.stdout: "put": 214, 2024-09-21T01:52:03.255 INFO:teuthology.orchestra.run.smithi083.stdout: "put_sum": 805488, 2024-09-21T01:52:03.255 INFO:teuthology.orchestra.run.smithi083.stdout: "wait": { 2024-09-21T01:52:03.255 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-21T01:52:03.255 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-21T01:52:03.255 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-21T01:52:03.255 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:52:03.255 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:52:03.255 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-09-21T01:52:03.958 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.d 2024-09-21T01:52:03.958 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.d 2024-09-21T01:52:03.958 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.d 2024-09-21T01:52:03.958 DEBUG:tasks.check_counter:Getting stats from g 2024-09-21T01:52:03.958 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph daemon mds.g perf dump 2024-09-21T01:52:04.204 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:52:04.713 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-09-21T01:52:04.714 INFO:teuthology.orchestra.run.smithi083.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T01:52:04.714 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_recv_messages": 0, 2024-09-21T01:52:04.714 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_messages": 2, 2024-09-21T01:52:04.714 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_recv_bytes": 0, 2024-09-21T01:52:04.714 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_bytes": 0, 2024-09-21T01:52:04.714 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_created_connections": 4, 2024-09-21T01:52:04.714 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_active_connections": 0, 2024-09-21T01:52:04.714 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_total_time": 0.001218563, 2024-09-21T01:52:04.714 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_send_time": 0.000000000, 2024-09-21T01:52:04.714 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_recv_time": 0.000304652, 2024-09-21T01:52:04.714 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T01:52:04.714 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:52:04.714 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-21T01:52:04.714 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-21T01:52:04.715 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-21T01:52:04.715 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:04.715 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:52:04.715 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-21T01:52:04.715 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-21T01:52:04.715 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-21T01:52:04.715 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:04.715 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T01:52:04.715 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T01:52:04.715 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:04.715 INFO:teuthology.orchestra.run.smithi083.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T01:52:04.715 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_recv_messages": 212, 2024-09-21T01:52:04.715 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_messages": 205, 2024-09-21T01:52:04.715 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_recv_bytes": 837088, 2024-09-21T01:52:04.716 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_bytes": 125152, 2024-09-21T01:52:04.716 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_created_connections": 2, 2024-09-21T01:52:04.716 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_active_connections": 1, 2024-09-21T01:52:04.716 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_total_time": 0.037279096, 2024-09-21T01:52:04.716 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_send_time": 0.016912716, 2024-09-21T01:52:04.716 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_recv_time": 0.027571008, 2024-09-21T01:52:04.716 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T01:52:04.716 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:52:04.716 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 205, 2024-09-21T01:52:04.716 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.014376516, 2024-09-21T01:52:04.716 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000070129 2024-09-21T01:52:04.716 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:04.716 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:52:04.716 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-21T01:52:04.716 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-21T01:52:04.717 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-21T01:52:04.717 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:04.717 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_recv_encrypted_bytes": 837088, 2024-09-21T01:52:04.717 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_encrypted_bytes": 125152 2024-09-21T01:52:04.717 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:04.717 INFO:teuthology.orchestra.run.smithi083.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T01:52:04.717 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_recv_messages": 1, 2024-09-21T01:52:04.717 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_messages": 155, 2024-09-21T01:52:04.717 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_recv_bytes": 160, 2024-09-21T01:52:04.717 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_bytes": 107424, 2024-09-21T01:52:04.717 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_created_connections": 3, 2024-09-21T01:52:04.717 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_active_connections": 2, 2024-09-21T01:52:04.717 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_total_time": 0.014384605, 2024-09-21T01:52:04.717 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_send_time": 0.011588565, 2024-09-21T01:52:04.717 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_recv_time": 0.001302375, 2024-09-21T01:52:04.718 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T01:52:04.718 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:52:04.718 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 153, 2024-09-21T01:52:04.718 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.007547640, 2024-09-21T01:52:04.718 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000049330 2024-09-21T01:52:04.718 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:04.718 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:52:04.718 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-21T01:52:04.718 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-21T01:52:04.718 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-21T01:52:04.718 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:04.718 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-21T01:52:04.718 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_encrypted_bytes": 107424 2024-09-21T01:52:04.718 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:04.718 INFO:teuthology.orchestra.run.smithi083.stdout: "cct": { 2024-09-21T01:52:04.719 INFO:teuthology.orchestra.run.smithi083.stdout: "total_workers": 0, 2024-09-21T01:52:04.719 INFO:teuthology.orchestra.run.smithi083.stdout: "unhealthy_workers": 0 2024-09-21T01:52:04.719 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:04.719 INFO:teuthology.orchestra.run.smithi083.stdout: "mempool": { 2024-09-21T01:52:04.719 INFO:teuthology.orchestra.run.smithi083.stdout: "bloom_filter_bytes": 0, 2024-09-21T01:52:04.719 INFO:teuthology.orchestra.run.smithi083.stdout: "bloom_filter_items": 0, 2024-09-21T01:52:04.719 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T01:52:04.719 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_alloc_items": 0, 2024-09-21T01:52:04.719 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T01:52:04.719 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_cache_data_items": 0, 2024-09-21T01:52:04.719 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T01:52:04.720 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T01:52:04.720 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T01:52:04.720 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T01:52:04.720 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T01:52:04.720 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_cache_other_items": 0, 2024-09-21T01:52:04.720 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T01:52:04.720 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T01:52:04.720 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_extent_bytes": 0, 2024-09-21T01:52:04.720 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_extent_items": 0, 2024-09-21T01:52:04.720 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_blob_bytes": 0, 2024-09-21T01:52:04.720 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_blob_items": 0, 2024-09-21T01:52:04.720 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T01:52:04.720 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T01:52:04.721 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T01:52:04.721 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T01:52:04.721 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T01:52:04.721 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_fsck_items": 0, 2024-09-21T01:52:04.721 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_txc_bytes": 0, 2024-09-21T01:52:04.721 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_txc_items": 0, 2024-09-21T01:52:04.721 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T01:52:04.721 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T01:52:04.721 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_writing_bytes": 0, 2024-09-21T01:52:04.721 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_writing_items": 0, 2024-09-21T01:52:04.721 INFO:teuthology.orchestra.run.smithi083.stdout: "bluefs_bytes": 0, 2024-09-21T01:52:04.721 INFO:teuthology.orchestra.run.smithi083.stdout: "bluefs_items": 0, 2024-09-21T01:52:04.722 INFO:teuthology.orchestra.run.smithi083.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T01:52:04.722 INFO:teuthology.orchestra.run.smithi083.stdout: "bluefs_file_reader_items": 0, 2024-09-21T01:52:04.722 INFO:teuthology.orchestra.run.smithi083.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T01:52:04.722 INFO:teuthology.orchestra.run.smithi083.stdout: "bluefs_file_writer_items": 0, 2024-09-21T01:52:04.722 INFO:teuthology.orchestra.run.smithi083.stdout: "buffer_anon_bytes": 148984, 2024-09-21T01:52:04.722 INFO:teuthology.orchestra.run.smithi083.stdout: "buffer_anon_items": 30, 2024-09-21T01:52:04.722 INFO:teuthology.orchestra.run.smithi083.stdout: "buffer_meta_bytes": 0, 2024-09-21T01:52:04.722 INFO:teuthology.orchestra.run.smithi083.stdout: "buffer_meta_items": 0, 2024-09-21T01:52:04.722 INFO:teuthology.orchestra.run.smithi083.stdout: "osd_bytes": 0, 2024-09-21T01:52:04.722 INFO:teuthology.orchestra.run.smithi083.stdout: "osd_items": 0, 2024-09-21T01:52:04.722 INFO:teuthology.orchestra.run.smithi083.stdout: "osd_mapbl_bytes": 0, 2024-09-21T01:52:04.722 INFO:teuthology.orchestra.run.smithi083.stdout: "osd_mapbl_items": 0, 2024-09-21T01:52:04.723 INFO:teuthology.orchestra.run.smithi083.stdout: "osd_pglog_bytes": 0, 2024-09-21T01:52:04.723 INFO:teuthology.orchestra.run.smithi083.stdout: "osd_pglog_items": 0, 2024-09-21T01:52:04.723 INFO:teuthology.orchestra.run.smithi083.stdout: "osdmap_bytes": 0, 2024-09-21T01:52:04.723 INFO:teuthology.orchestra.run.smithi083.stdout: "osdmap_items": 0, 2024-09-21T01:52:04.723 INFO:teuthology.orchestra.run.smithi083.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T01:52:04.723 INFO:teuthology.orchestra.run.smithi083.stdout: "osdmap_mapping_items": 0, 2024-09-21T01:52:04.723 INFO:teuthology.orchestra.run.smithi083.stdout: "pgmap_bytes": 0, 2024-09-21T01:52:04.723 INFO:teuthology.orchestra.run.smithi083.stdout: "pgmap_items": 0, 2024-09-21T01:52:04.723 INFO:teuthology.orchestra.run.smithi083.stdout: "mds_co_bytes": 968, 2024-09-21T01:52:04.723 INFO:teuthology.orchestra.run.smithi083.stdout: "mds_co_items": 2, 2024-09-21T01:52:04.723 INFO:teuthology.orchestra.run.smithi083.stdout: "unittest_1_bytes": 0, 2024-09-21T01:52:04.723 INFO:teuthology.orchestra.run.smithi083.stdout: "unittest_1_items": 0, 2024-09-21T01:52:04.723 INFO:teuthology.orchestra.run.smithi083.stdout: "unittest_2_bytes": 0, 2024-09-21T01:52:04.724 INFO:teuthology.orchestra.run.smithi083.stdout: "unittest_2_items": 0 2024-09-21T01:52:04.724 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:04.724 INFO:teuthology.orchestra.run.smithi083.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T01:52:04.724 INFO:teuthology.orchestra.run.smithi083.stdout: "val": 0, 2024-09-21T01:52:04.724 INFO:teuthology.orchestra.run.smithi083.stdout: "max": 104857600, 2024-09-21T01:52:04.724 INFO:teuthology.orchestra.run.smithi083.stdout: "get_started": 0, 2024-09-21T01:52:04.724 INFO:teuthology.orchestra.run.smithi083.stdout: "get": 209, 2024-09-21T01:52:04.724 INFO:teuthology.orchestra.run.smithi083.stdout: "get_sum": 804774, 2024-09-21T01:52:04.724 INFO:teuthology.orchestra.run.smithi083.stdout: "get_or_fail_fail": 0, 2024-09-21T01:52:04.724 INFO:teuthology.orchestra.run.smithi083.stdout: "get_or_fail_success": 209, 2024-09-21T01:52:04.724 INFO:teuthology.orchestra.run.smithi083.stdout: "take": 0, 2024-09-21T01:52:04.724 INFO:teuthology.orchestra.run.smithi083.stdout: "take_sum": 0, 2024-09-21T01:52:04.725 INFO:teuthology.orchestra.run.smithi083.stdout: "put": 209, 2024-09-21T01:52:04.725 INFO:teuthology.orchestra.run.smithi083.stdout: "put_sum": 804774, 2024-09-21T01:52:04.725 INFO:teuthology.orchestra.run.smithi083.stdout: "wait": { 2024-09-21T01:52:04.725 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-21T01:52:04.725 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-21T01:52:04.725 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-21T01:52:04.725 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:52:04.725 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:52:04.725 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-09-21T01:52:04.965 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:52:04 smithi142 ceph-mon[34050]: pgmap v647: 129 pgs: 129 active+clean; 27 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 22 KiB/s wr, 6 op/s 2024-09-21T01:52:04.967 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:52:04 smithi119 ceph-mon[33693]: pgmap v647: 129 pgs: 129 active+clean; 27 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 22 KiB/s wr, 6 op/s 2024-09-21T01:52:05.021 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:52:04 smithi083 ceph-mon[31370]: pgmap v647: 129 pgs: 129 active+clean; 27 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 22 KiB/s wr, 6 op/s 2024-09-21T01:52:05.368 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.g 2024-09-21T01:52:05.369 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.g 2024-09-21T01:52:05.369 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.g 2024-09-21T01:52:05.369 DEBUG:tasks.check_counter:Getting stats from j 2024-09-21T01:52:05.369 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph daemon mds.j perf dump 2024-09-21T01:52:05.615 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:52:06.133 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-09-21T01:52:06.133 INFO:teuthology.orchestra.run.smithi083.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T01:52:06.133 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_recv_messages": 215, 2024-09-21T01:52:06.133 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_messages": 210, 2024-09-21T01:52:06.134 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_recv_bytes": 836144, 2024-09-21T01:52:06.134 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_bytes": 128704, 2024-09-21T01:52:06.134 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_created_connections": 4, 2024-09-21T01:52:06.134 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_active_connections": 0, 2024-09-21T01:52:06.134 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_total_time": 0.041086576, 2024-09-21T01:52:06.134 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_send_time": 0.019541583, 2024-09-21T01:52:06.134 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_recv_time": 0.027595029, 2024-09-21T01:52:06.134 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T01:52:06.134 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:52:06.134 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 209, 2024-09-21T01:52:06.134 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.010867810, 2024-09-21T01:52:06.134 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000051999 2024-09-21T01:52:06.134 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:06.135 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:52:06.135 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-21T01:52:06.135 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-21T01:52:06.135 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-21T01:52:06.135 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:06.135 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_recv_encrypted_bytes": 836144, 2024-09-21T01:52:06.135 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_encrypted_bytes": 128704 2024-09-21T01:52:06.135 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:06.135 INFO:teuthology.orchestra.run.smithi083.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T01:52:06.135 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_recv_messages": 1, 2024-09-21T01:52:06.135 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_messages": 159, 2024-09-21T01:52:06.135 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_recv_bytes": 160, 2024-09-21T01:52:06.135 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_bytes": 108128, 2024-09-21T01:52:06.135 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_created_connections": 3, 2024-09-21T01:52:06.135 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_active_connections": 2, 2024-09-21T01:52:06.135 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_total_time": 0.016022572, 2024-09-21T01:52:06.136 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_send_time": 0.012962779, 2024-09-21T01:52:06.136 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_recv_time": 0.001365686, 2024-09-21T01:52:06.136 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T01:52:06.136 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:52:06.136 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 157, 2024-09-21T01:52:06.136 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.008896514, 2024-09-21T01:52:06.136 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000056665 2024-09-21T01:52:06.136 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:06.136 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:52:06.136 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-21T01:52:06.136 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-21T01:52:06.136 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-21T01:52:06.136 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:06.136 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-21T01:52:06.136 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_encrypted_bytes": 108128 2024-09-21T01:52:06.137 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:06.137 INFO:teuthology.orchestra.run.smithi083.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T01:52:06.137 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_recv_messages": 4, 2024-09-21T01:52:06.137 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_messages": 4, 2024-09-21T01:52:06.137 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_recv_bytes": 2912, 2024-09-21T01:52:06.137 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_bytes": 448, 2024-09-21T01:52:06.137 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_created_connections": 2, 2024-09-21T01:52:06.137 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_active_connections": 1, 2024-09-21T01:52:06.137 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_total_time": 0.002285752, 2024-09-21T01:52:06.137 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_send_time": 0.000037758, 2024-09-21T01:52:06.137 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_recv_time": 0.002239404, 2024-09-21T01:52:06.137 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T01:52:06.137 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:52:06.137 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 3, 2024-09-21T01:52:06.137 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.003909653, 2024-09-21T01:52:06.138 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.001303217 2024-09-21T01:52:06.138 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:06.138 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:52:06.138 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-21T01:52:06.138 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-21T01:52:06.138 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-21T01:52:06.138 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:06.138 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_recv_encrypted_bytes": 2912, 2024-09-21T01:52:06.138 INFO:teuthology.orchestra.run.smithi083.stdout: "msgr_send_encrypted_bytes": 448 2024-09-21T01:52:06.138 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:06.138 INFO:teuthology.orchestra.run.smithi083.stdout: "cct": { 2024-09-21T01:52:06.138 INFO:teuthology.orchestra.run.smithi083.stdout: "total_workers": 0, 2024-09-21T01:52:06.138 INFO:teuthology.orchestra.run.smithi083.stdout: "unhealthy_workers": 0 2024-09-21T01:52:06.139 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:06.139 INFO:teuthology.orchestra.run.smithi083.stdout: "mempool": { 2024-09-21T01:52:06.139 INFO:teuthology.orchestra.run.smithi083.stdout: "bloom_filter_bytes": 0, 2024-09-21T01:52:06.139 INFO:teuthology.orchestra.run.smithi083.stdout: "bloom_filter_items": 0, 2024-09-21T01:52:06.139 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T01:52:06.139 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_alloc_items": 0, 2024-09-21T01:52:06.139 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T01:52:06.139 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_cache_data_items": 0, 2024-09-21T01:52:06.139 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T01:52:06.139 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T01:52:06.139 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T01:52:06.139 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T01:52:06.139 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T01:52:06.139 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_cache_other_items": 0, 2024-09-21T01:52:06.139 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T01:52:06.139 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T01:52:06.140 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_extent_bytes": 0, 2024-09-21T01:52:06.140 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_extent_items": 0, 2024-09-21T01:52:06.140 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_blob_bytes": 0, 2024-09-21T01:52:06.140 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_blob_items": 0, 2024-09-21T01:52:06.140 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T01:52:06.140 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T01:52:06.140 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T01:52:06.140 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T01:52:06.140 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T01:52:06.140 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_fsck_items": 0, 2024-09-21T01:52:06.140 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_txc_bytes": 0, 2024-09-21T01:52:06.140 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_txc_items": 0, 2024-09-21T01:52:06.140 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T01:52:06.140 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T01:52:06.140 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_writing_bytes": 0, 2024-09-21T01:52:06.141 INFO:teuthology.orchestra.run.smithi083.stdout: "bluestore_writing_items": 0, 2024-09-21T01:52:06.141 INFO:teuthology.orchestra.run.smithi083.stdout: "bluefs_bytes": 0, 2024-09-21T01:52:06.141 INFO:teuthology.orchestra.run.smithi083.stdout: "bluefs_items": 0, 2024-09-21T01:52:06.141 INFO:teuthology.orchestra.run.smithi083.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T01:52:06.141 INFO:teuthology.orchestra.run.smithi083.stdout: "bluefs_file_reader_items": 0, 2024-09-21T01:52:06.141 INFO:teuthology.orchestra.run.smithi083.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T01:52:06.141 INFO:teuthology.orchestra.run.smithi083.stdout: "bluefs_file_writer_items": 0, 2024-09-21T01:52:06.141 INFO:teuthology.orchestra.run.smithi083.stdout: "buffer_anon_bytes": 148984, 2024-09-21T01:52:06.141 INFO:teuthology.orchestra.run.smithi083.stdout: "buffer_anon_items": 30, 2024-09-21T01:52:06.141 INFO:teuthology.orchestra.run.smithi083.stdout: "buffer_meta_bytes": 0, 2024-09-21T01:52:06.141 INFO:teuthology.orchestra.run.smithi083.stdout: "buffer_meta_items": 0, 2024-09-21T01:52:06.141 INFO:teuthology.orchestra.run.smithi083.stdout: "osd_bytes": 0, 2024-09-21T01:52:06.141 INFO:teuthology.orchestra.run.smithi083.stdout: "osd_items": 0, 2024-09-21T01:52:06.141 INFO:teuthology.orchestra.run.smithi083.stdout: "osd_mapbl_bytes": 0, 2024-09-21T01:52:06.141 INFO:teuthology.orchestra.run.smithi083.stdout: "osd_mapbl_items": 0, 2024-09-21T01:52:06.142 INFO:teuthology.orchestra.run.smithi083.stdout: "osd_pglog_bytes": 0, 2024-09-21T01:52:06.142 INFO:teuthology.orchestra.run.smithi083.stdout: "osd_pglog_items": 0, 2024-09-21T01:52:06.142 INFO:teuthology.orchestra.run.smithi083.stdout: "osdmap_bytes": 0, 2024-09-21T01:52:06.142 INFO:teuthology.orchestra.run.smithi083.stdout: "osdmap_items": 0, 2024-09-21T01:52:06.142 INFO:teuthology.orchestra.run.smithi083.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T01:52:06.142 INFO:teuthology.orchestra.run.smithi083.stdout: "osdmap_mapping_items": 0, 2024-09-21T01:52:06.142 INFO:teuthology.orchestra.run.smithi083.stdout: "pgmap_bytes": 0, 2024-09-21T01:52:06.142 INFO:teuthology.orchestra.run.smithi083.stdout: "pgmap_items": 0, 2024-09-21T01:52:06.142 INFO:teuthology.orchestra.run.smithi083.stdout: "mds_co_bytes": 968, 2024-09-21T01:52:06.142 INFO:teuthology.orchestra.run.smithi083.stdout: "mds_co_items": 2, 2024-09-21T01:52:06.142 INFO:teuthology.orchestra.run.smithi083.stdout: "unittest_1_bytes": 0, 2024-09-21T01:52:06.142 INFO:teuthology.orchestra.run.smithi083.stdout: "unittest_1_items": 0, 2024-09-21T01:52:06.142 INFO:teuthology.orchestra.run.smithi083.stdout: "unittest_2_bytes": 0, 2024-09-21T01:52:06.142 INFO:teuthology.orchestra.run.smithi083.stdout: "unittest_2_items": 0 2024-09-21T01:52:06.142 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-09-21T01:52:06.143 INFO:teuthology.orchestra.run.smithi083.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T01:52:06.143 INFO:teuthology.orchestra.run.smithi083.stdout: "val": 0, 2024-09-21T01:52:06.143 INFO:teuthology.orchestra.run.smithi083.stdout: "max": 104857600, 2024-09-21T01:52:06.143 INFO:teuthology.orchestra.run.smithi083.stdout: "get_started": 0, 2024-09-21T01:52:06.143 INFO:teuthology.orchestra.run.smithi083.stdout: "get": 216, 2024-09-21T01:52:06.143 INFO:teuthology.orchestra.run.smithi083.stdout: "get_sum": 805748, 2024-09-21T01:52:06.143 INFO:teuthology.orchestra.run.smithi083.stdout: "get_or_fail_fail": 0, 2024-09-21T01:52:06.143 INFO:teuthology.orchestra.run.smithi083.stdout: "get_or_fail_success": 216, 2024-09-21T01:52:06.143 INFO:teuthology.orchestra.run.smithi083.stdout: "take": 0, 2024-09-21T01:52:06.143 INFO:teuthology.orchestra.run.smithi083.stdout: "take_sum": 0, 2024-09-21T01:52:06.143 INFO:teuthology.orchestra.run.smithi083.stdout: "put": 216, 2024-09-21T01:52:06.143 INFO:teuthology.orchestra.run.smithi083.stdout: "put_sum": 805748, 2024-09-21T01:52:06.143 INFO:teuthology.orchestra.run.smithi083.stdout: "wait": { 2024-09-21T01:52:06.143 INFO:teuthology.orchestra.run.smithi083.stdout: "avgcount": 0, 2024-09-21T01:52:06.143 INFO:teuthology.orchestra.run.smithi083.stdout: "sum": 0.000000000, 2024-09-21T01:52:06.144 INFO:teuthology.orchestra.run.smithi083.stdout: "avgtime": 0.000000000 2024-09-21T01:52:06.144 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:52:06.144 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-09-21T01:52:06.144 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-09-21T01:52:06.839 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.j 2024-09-21T01:52:06.839 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.j 2024-09-21T01:52:06.839 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.j 2024-09-21T01:52:06.839 DEBUG:tasks.check_counter:Getting stats from b 2024-09-21T01:52:06.839 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph daemon mds.b perf dump 2024-09-21T01:52:06.964 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:52:06 smithi142 ceph-mon[34050]: pgmap v648: 129 pgs: 129 active+clean; 28 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-09-21T01:52:06.967 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:52:06 smithi119 ceph-mon[33693]: pgmap v648: 129 pgs: 129 active+clean; 28 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-09-21T01:52:07.053 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:52:06 smithi083 ceph-mon[31370]: pgmap v648: 129 pgs: 129 active+clean; 28 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-09-21T01:52:07.101 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T01:52:07.624 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-21T01:52:07.624 INFO:teuthology.orchestra.run.smithi119.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T01:52:07.624 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_messages": 3243, 2024-09-21T01:52:07.625 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_messages": 3245, 2024-09-21T01:52:07.625 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_bytes": 814223, 2024-09-21T01:52:07.625 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_bytes": 17869312, 2024-09-21T01:52:07.625 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_created_connections": 13, 2024-09-21T01:52:07.625 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_active_connections": 5, 2024-09-21T01:52:07.625 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_total_time": 0.323642231, 2024-09-21T01:52:07.625 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_send_time": 0.153848844, 2024-09-21T01:52:07.625 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_recv_time": 0.059870654, 2024-09-21T01:52:07.625 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_fast_dispatch_time": 0.093366088, 2024-09-21T01:52:07.625 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:52:07.625 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 3243, 2024-09-21T01:52:07.625 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 1.091352392, 2024-09-21T01:52:07.626 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000336525 2024-09-21T01:52:07.626 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T01:52:07.626 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:52:07.626 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 4, 2024-09-21T01:52:07.626 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000433, 2024-09-21T01:52:07.626 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000108 2024-09-21T01:52:07.626 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T01:52:07.626 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T01:52:07.626 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T01:52:07.626 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T01:52:07.627 INFO:teuthology.orchestra.run.smithi119.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T01:52:07.627 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_messages": 2691, 2024-09-21T01:52:07.627 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_messages": 2108, 2024-09-21T01:52:07.627 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_bytes": 1757815, 2024-09-21T01:52:07.627 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_bytes": 916865, 2024-09-21T01:52:07.627 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_created_connections": 7, 2024-09-21T01:52:07.627 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_active_connections": 6, 2024-09-21T01:52:07.627 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_total_time": 0.337252835, 2024-09-21T01:52:07.627 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_send_time": 0.122300409, 2024-09-21T01:52:07.627 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_recv_time": 0.106628435, 2024-09-21T01:52:07.627 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_fast_dispatch_time": 0.098678726, 2024-09-21T01:52:07.628 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:52:07.628 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 2108, 2024-09-21T01:52:07.628 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.490178455, 2024-09-21T01:52:07.628 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000232532 2024-09-21T01:52:07.628 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T01:52:07.628 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:52:07.628 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 903, 2024-09-21T01:52:07.628 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000222239, 2024-09-21T01:52:07.628 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000246 2024-09-21T01:52:07.628 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T01:52:07.628 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_encrypted_bytes": 1200496, 2024-09-21T01:52:07.628 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_encrypted_bytes": 236128 2024-09-21T01:52:07.628 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T01:52:07.629 INFO:teuthology.orchestra.run.smithi119.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T01:52:07.629 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_messages": 9048, 2024-09-21T01:52:07.629 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_messages": 13754, 2024-09-21T01:52:07.629 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_bytes": 3072941, 2024-09-21T01:52:07.629 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_bytes": 10333673, 2024-09-21T01:52:07.629 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_created_connections": 33, 2024-09-21T01:52:07.629 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_active_connections": 6, 2024-09-21T01:52:07.629 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_total_time": 0.899540487, 2024-09-21T01:52:07.629 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_send_time": 0.427947980, 2024-09-21T01:52:07.629 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_recv_time": 0.362004415, 2024-09-21T01:52:07.629 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_fast_dispatch_time": 0.141240302, 2024-09-21T01:52:07.630 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:52:07.630 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 13752, 2024-09-21T01:52:07.630 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.978705946, 2024-09-21T01:52:07.630 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000071168 2024-09-21T01:52:07.630 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T01:52:07.630 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:52:07.630 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 17740, 2024-09-21T01:52:07.630 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.002694348, 2024-09-21T01:52:07.630 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000151 2024-09-21T01:52:07.630 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T01:52:07.630 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_encrypted_bytes": 50400, 2024-09-21T01:52:07.631 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_encrypted_bytes": 397552 2024-09-21T01:52:07.631 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T01:52:07.631 INFO:teuthology.orchestra.run.smithi119.stdout: "cct": { 2024-09-21T01:52:07.631 INFO:teuthology.orchestra.run.smithi119.stdout: "total_workers": 1, 2024-09-21T01:52:07.631 INFO:teuthology.orchestra.run.smithi119.stdout: "unhealthy_workers": 0 2024-09-21T01:52:07.631 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T01:52:07.631 INFO:teuthology.orchestra.run.smithi119.stdout: "finisher-MDSRank": { 2024-09-21T01:52:07.631 INFO:teuthology.orchestra.run.smithi119.stdout: "queue_len": 0, 2024-09-21T01:52:07.631 INFO:teuthology.orchestra.run.smithi119.stdout: "complete_latency": { 2024-09-21T01:52:07.631 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 2797, 2024-09-21T01:52:07.631 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 2.094895134, 2024-09-21T01:52:07.631 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000748979 2024-09-21T01:52:07.631 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-21T01:52:07.631 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T01:52:07.632 INFO:teuthology.orchestra.run.smithi119.stdout: "finisher-PurgeQueue": { 2024-09-21T01:52:07.632 INFO:teuthology.orchestra.run.smithi119.stdout: "queue_len": 0, 2024-09-21T01:52:07.632 INFO:teuthology.orchestra.run.smithi119.stdout: "complete_latency": { 2024-09-21T01:52:07.632 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 4101, 2024-09-21T01:52:07.632 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.254758490, 2024-09-21T01:52:07.632 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000062121 2024-09-21T01:52:07.632 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-21T01:52:07.632 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T01:52:07.632 INFO:teuthology.orchestra.run.smithi119.stdout: "mds": { 2024-09-21T01:52:07.632 INFO:teuthology.orchestra.run.smithi119.stdout: "request": 2628, 2024-09-21T01:52:07.632 INFO:teuthology.orchestra.run.smithi119.stdout: "reply": 2628, 2024-09-21T01:52:07.633 INFO:teuthology.orchestra.run.smithi119.stdout: "reply_latency": { 2024-09-21T01:52:07.633 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 2628, 2024-09-21T01:52:07.633 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 11.956185335, 2024-09-21T01:52:07.633 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.004549537 2024-09-21T01:52:07.633 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T01:52:07.633 INFO:teuthology.orchestra.run.smithi119.stdout: "slow_reply": 0, 2024-09-21T01:52:07.633 INFO:teuthology.orchestra.run.smithi119.stdout: "forward": 0, 2024-09-21T01:52:07.633 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_fetch_complete": 0, 2024-09-21T01:52:07.633 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_fetch_keys": 0, 2024-09-21T01:52:07.633 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_commit": 12, 2024-09-21T01:52:07.633 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_split": 0, 2024-09-21T01:52:07.633 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_merge": 0, 2024-09-21T01:52:07.634 INFO:teuthology.orchestra.run.smithi119.stdout: "inodes": 32, 2024-09-21T01:52:07.634 INFO:teuthology.orchestra.run.smithi119.stdout: "inodes_top": 0, 2024-09-21T01:52:07.634 INFO:teuthology.orchestra.run.smithi119.stdout: "inodes_bottom": 32, 2024-09-21T01:52:07.634 INFO:teuthology.orchestra.run.smithi119.stdout: "inodes_pin_tail": 0, 2024-09-21T01:52:07.634 INFO:teuthology.orchestra.run.smithi119.stdout: "inodes_pinned": 32, 2024-09-21T01:52:07.634 INFO:teuthology.orchestra.run.smithi119.stdout: "inodes_expired": 0, 2024-09-21T01:52:07.634 INFO:teuthology.orchestra.run.smithi119.stdout: "inodes_with_caps": 5, 2024-09-21T01:52:07.634 INFO:teuthology.orchestra.run.smithi119.stdout: "caps": 6, 2024-09-21T01:52:07.634 INFO:teuthology.orchestra.run.smithi119.stdout: "subtrees": 2, 2024-09-21T01:52:07.634 INFO:teuthology.orchestra.run.smithi119.stdout: "traverse": 2713, 2024-09-21T01:52:07.634 INFO:teuthology.orchestra.run.smithi119.stdout: "traverse_hit": 2704, 2024-09-21T01:52:07.635 INFO:teuthology.orchestra.run.smithi119.stdout: "traverse_forward": 0, 2024-09-21T01:52:07.635 INFO:teuthology.orchestra.run.smithi119.stdout: "traverse_discover": 0, 2024-09-21T01:52:07.635 INFO:teuthology.orchestra.run.smithi119.stdout: "traverse_dir_fetch": 0, 2024-09-21T01:52:07.635 INFO:teuthology.orchestra.run.smithi119.stdout: "traverse_remote_ino": 0, 2024-09-21T01:52:07.635 INFO:teuthology.orchestra.run.smithi119.stdout: "traverse_lock": 0, 2024-09-21T01:52:07.635 INFO:teuthology.orchestra.run.smithi119.stdout: "load_cent": 0, 2024-09-21T01:52:07.635 INFO:teuthology.orchestra.run.smithi119.stdout: "q": 0, 2024-09-21T01:52:07.635 INFO:teuthology.orchestra.run.smithi119.stdout: "exported": 0, 2024-09-21T01:52:07.635 INFO:teuthology.orchestra.run.smithi119.stdout: "exported_inodes": 0, 2024-09-21T01:52:07.635 INFO:teuthology.orchestra.run.smithi119.stdout: "imported": 0, 2024-09-21T01:52:07.636 INFO:teuthology.orchestra.run.smithi119.stdout: "imported_inodes": 0, 2024-09-21T01:52:07.636 INFO:teuthology.orchestra.run.smithi119.stdout: "openino_dir_fetch": 0, 2024-09-21T01:52:07.636 INFO:teuthology.orchestra.run.smithi119.stdout: "openino_backtrace_fetch": 0, 2024-09-21T01:52:07.636 INFO:teuthology.orchestra.run.smithi119.stdout: "openino_peer_discover": 0, 2024-09-21T01:52:07.636 INFO:teuthology.orchestra.run.smithi119.stdout: "root_rfiles": 4, 2024-09-21T01:52:07.636 INFO:teuthology.orchestra.run.smithi119.stdout: "root_rbytes": 234, 2024-09-21T01:52:07.636 INFO:teuthology.orchestra.run.smithi119.stdout: "root_rsnaps": 6, 2024-09-21T01:52:07.636 INFO:teuthology.orchestra.run.smithi119.stdout: "scrub_backtrace_fetch": 0, 2024-09-21T01:52:07.636 INFO:teuthology.orchestra.run.smithi119.stdout: "scrub_set_tag": 0, 2024-09-21T01:52:07.636 INFO:teuthology.orchestra.run.smithi119.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T01:52:07.637 INFO:teuthology.orchestra.run.smithi119.stdout: "scrub_inotable_repaired": 0, 2024-09-21T01:52:07.637 INFO:teuthology.orchestra.run.smithi119.stdout: "scrub_dir_inodes": 0, 2024-09-21T01:52:07.637 INFO:teuthology.orchestra.run.smithi119.stdout: "scrub_dir_base_inodes": 0, 2024-09-21T01:52:07.637 INFO:teuthology.orchestra.run.smithi119.stdout: "scrub_dirfrag_rstats": 0, 2024-09-21T01:52:07.637 INFO:teuthology.orchestra.run.smithi119.stdout: "scrub_file_inodes": 0, 2024-09-21T01:52:07.637 INFO:teuthology.orchestra.run.smithi119.stdout: "handle_inode_file_caps": 0, 2024-09-21T01:52:07.637 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_cap_op_revoke": 1312, 2024-09-21T01:52:07.637 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_cap_op_grant": 3641, 2024-09-21T01:52:07.637 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_cap_op_trunc": 0, 2024-09-21T01:52:07.637 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T01:52:07.637 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T01:52:07.637 INFO:teuthology.orchestra.run.smithi119.stdout: "handle_client_caps": 3937, 2024-09-21T01:52:07.637 INFO:teuthology.orchestra.run.smithi119.stdout: "handle_client_caps_dirty": 1781, 2024-09-21T01:52:07.637 INFO:teuthology.orchestra.run.smithi119.stdout: "handle_client_cap_release": 26, 2024-09-21T01:52:07.637 INFO:teuthology.orchestra.run.smithi119.stdout: "process_request_cap_release": 3654 2024-09-21T01:52:07.638 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T01:52:07.638 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_cache": { 2024-09-21T01:52:07.638 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_update": 0, 2024-09-21T01:52:07.638 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_update_receipt": 0, 2024-09-21T01:52:07.638 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_try_discover": 0, 2024-09-21T01:52:07.638 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_send_discover": 0, 2024-09-21T01:52:07.638 INFO:teuthology.orchestra.run.smithi119.stdout: "dir_handle_discover": 0, 2024-09-21T01:52:07.638 INFO:teuthology.orchestra.run.smithi119.stdout: "num_strays": 2, 2024-09-21T01:52:07.638 INFO:teuthology.orchestra.run.smithi119.stdout: "num_strays_delayed": 0, 2024-09-21T01:52:07.638 INFO:teuthology.orchestra.run.smithi119.stdout: "num_strays_enqueuing": 0, 2024-09-21T01:52:07.638 INFO:teuthology.orchestra.run.smithi119.stdout: "strays_created": 1212, 2024-09-21T01:52:07.638 INFO:teuthology.orchestra.run.smithi119.stdout: "strays_enqueued": 1210, 2024-09-21T01:52:07.638 INFO:teuthology.orchestra.run.smithi119.stdout: "strays_reintegrated": 0, 2024-09-21T01:52:07.638 INFO:teuthology.orchestra.run.smithi119.stdout: "strays_migrated": 0, 2024-09-21T01:52:07.639 INFO:teuthology.orchestra.run.smithi119.stdout: "num_recovering_processing": 0, 2024-09-21T01:52:07.639 INFO:teuthology.orchestra.run.smithi119.stdout: "num_recovering_enqueued": 0, 2024-09-21T01:52:07.639 INFO:teuthology.orchestra.run.smithi119.stdout: "num_recovering_prioritized": 0, 2024-09-21T01:52:07.639 INFO:teuthology.orchestra.run.smithi119.stdout: "recovery_started": 0, 2024-09-21T01:52:07.639 INFO:teuthology.orchestra.run.smithi119.stdout: "recovery_completed": 0, 2024-09-21T01:52:07.639 INFO:teuthology.orchestra.run.smithi119.stdout: "ireq_quiesce_path": 5, 2024-09-21T01:52:07.639 INFO:teuthology.orchestra.run.smithi119.stdout: "ireq_quiesce_inode": 65, 2024-09-21T01:52:07.639 INFO:teuthology.orchestra.run.smithi119.stdout: "ireq_enqueue_scrub": 0, 2024-09-21T01:52:07.639 INFO:teuthology.orchestra.run.smithi119.stdout: "ireq_exportdir": 0, 2024-09-21T01:52:07.639 INFO:teuthology.orchestra.run.smithi119.stdout: "ireq_flush": 0, 2024-09-21T01:52:07.639 INFO:teuthology.orchestra.run.smithi119.stdout: "ireq_fragmentdir": 0, 2024-09-21T01:52:07.639 INFO:teuthology.orchestra.run.smithi119.stdout: "ireq_fragstats": 0, 2024-09-21T01:52:07.639 INFO:teuthology.orchestra.run.smithi119.stdout: "ireq_inodestats": 0, 2024-09-21T01:52:07.639 INFO:teuthology.orchestra.run.smithi119.stdout: "uninline_started": 0, 2024-09-21T01:52:07.640 INFO:teuthology.orchestra.run.smithi119.stdout: "uninline_succeeded": 0, 2024-09-21T01:52:07.640 INFO:teuthology.orchestra.run.smithi119.stdout: "uninline_write_failed": 0 2024-09-21T01:52:07.640 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T01:52:07.640 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_log": { 2024-09-21T01:52:07.640 INFO:teuthology.orchestra.run.smithi119.stdout: "evlrg": 0, 2024-09-21T01:52:07.640 INFO:teuthology.orchestra.run.smithi119.stdout: "evadd": 6436, 2024-09-21T01:52:07.640 INFO:teuthology.orchestra.run.smithi119.stdout: "evex": 0, 2024-09-21T01:52:07.640 INFO:teuthology.orchestra.run.smithi119.stdout: "evtrm": 0, 2024-09-21T01:52:07.640 INFO:teuthology.orchestra.run.smithi119.stdout: "ev": 6436, 2024-09-21T01:52:07.640 INFO:teuthology.orchestra.run.smithi119.stdout: "evexg": 0, 2024-09-21T01:52:07.640 INFO:teuthology.orchestra.run.smithi119.stdout: "evexd": 0, 2024-09-21T01:52:07.640 INFO:teuthology.orchestra.run.smithi119.stdout: "segadd": 11, 2024-09-21T01:52:07.640 INFO:teuthology.orchestra.run.smithi119.stdout: "segex": 0, 2024-09-21T01:52:07.640 INFO:teuthology.orchestra.run.smithi119.stdout: "segtrm": 0, 2024-09-21T01:52:07.640 INFO:teuthology.orchestra.run.smithi119.stdout: "seg": 11, 2024-09-21T01:52:07.641 INFO:teuthology.orchestra.run.smithi119.stdout: "segmjr": 2, 2024-09-21T01:52:07.641 INFO:teuthology.orchestra.run.smithi119.stdout: "segexg": 0, 2024-09-21T01:52:07.641 INFO:teuthology.orchestra.run.smithi119.stdout: "segexd": 0, 2024-09-21T01:52:07.641 INFO:teuthology.orchestra.run.smithi119.stdout: "expos": 4194304, 2024-09-21T01:52:07.641 INFO:teuthology.orchestra.run.smithi119.stdout: "wrpos": 25149788, 2024-09-21T01:52:07.641 INFO:teuthology.orchestra.run.smithi119.stdout: "rdpos": 0, 2024-09-21T01:52:07.641 INFO:teuthology.orchestra.run.smithi119.stdout: "jlat": { 2024-09-21T01:52:07.641 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 1343, 2024-09-21T01:52:07.641 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 2.395691239, 2024-09-21T01:52:07.641 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.001783835 2024-09-21T01:52:07.641 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T01:52:07.641 INFO:teuthology.orchestra.run.smithi119.stdout: "replayed": 0 2024-09-21T01:52:07.641 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T01:52:07.641 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_mem": { 2024-09-21T01:52:07.641 INFO:teuthology.orchestra.run.smithi119.stdout: "ino": 28, 2024-09-21T01:52:07.642 INFO:teuthology.orchestra.run.smithi119.stdout: "ino+": 1238, 2024-09-21T01:52:07.642 INFO:teuthology.orchestra.run.smithi119.stdout: "ino-": 1210, 2024-09-21T01:52:07.642 INFO:teuthology.orchestra.run.smithi119.stdout: "dir": 20, 2024-09-21T01:52:07.642 INFO:teuthology.orchestra.run.smithi119.stdout: "dir+": 24, 2024-09-21T01:52:07.642 INFO:teuthology.orchestra.run.smithi119.stdout: "dir-": 4, 2024-09-21T01:52:07.642 INFO:teuthology.orchestra.run.smithi119.stdout: "dn": 32, 2024-09-21T01:52:07.642 INFO:teuthology.orchestra.run.smithi119.stdout: "dn+": 1247, 2024-09-21T01:52:07.642 INFO:teuthology.orchestra.run.smithi119.stdout: "dn-": 1215, 2024-09-21T01:52:07.642 INFO:teuthology.orchestra.run.smithi119.stdout: "cap": 6, 2024-09-21T01:52:07.642 INFO:teuthology.orchestra.run.smithi119.stdout: "cap+": 1230, 2024-09-21T01:52:07.642 INFO:teuthology.orchestra.run.smithi119.stdout: "cap-": 1224, 2024-09-21T01:52:07.642 INFO:teuthology.orchestra.run.smithi119.stdout: "rss": 125344, 2024-09-21T01:52:07.642 INFO:teuthology.orchestra.run.smithi119.stdout: "heap": 340602880 2024-09-21T01:52:07.642 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T01:52:07.643 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_server": { 2024-09-21T01:52:07.643 INFO:teuthology.orchestra.run.smithi119.stdout: "dispatch_client_request": 2734, 2024-09-21T01:52:07.643 INFO:teuthology.orchestra.run.smithi119.stdout: "dispatch_server_request": 0, 2024-09-21T01:52:07.643 INFO:teuthology.orchestra.run.smithi119.stdout: "handle_client_request": 2628, 2024-09-21T01:52:07.643 INFO:teuthology.orchestra.run.smithi119.stdout: "handle_client_session": 29, 2024-09-21T01:52:07.643 INFO:teuthology.orchestra.run.smithi119.stdout: "handle_peer_request": 0, 2024-09-21T01:52:07.643 INFO:teuthology.orchestra.run.smithi119.stdout: "req_create_latency": { 2024-09-21T01:52:07.643 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 1210, 2024-09-21T01:52:07.643 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.994581000, 2024-09-21T01:52:07.643 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000821967 2024-09-21T01:52:07.643 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T01:52:07.643 INFO:teuthology.orchestra.run.smithi119.stdout: "req_getattr_latency": { 2024-09-21T01:52:07.643 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 140, 2024-09-21T01:52:07.643 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.027410337, 2024-09-21T01:52:07.643 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000195788 2024-09-21T01:52:07.644 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T01:52:07.644 INFO:teuthology.orchestra.run.smithi119.stdout: "req_getfilelock_latency": { 2024-09-21T01:52:07.644 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T01:52:07.644 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T01:52:07.644 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T01:52:07.644 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T01:52:07.644 INFO:teuthology.orchestra.run.smithi119.stdout: "req_link_latency": { 2024-09-21T01:52:07.644 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T01:52:07.644 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T01:52:07.644 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T01:52:07.644 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T01:52:07.644 INFO:teuthology.orchestra.run.smithi119.stdout: "req_lookup_latency": { 2024-09-21T01:52:07.644 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 8, 2024-09-21T01:52:07.644 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.006254459, 2024-09-21T01:52:07.645 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000781807 2024-09-21T01:52:07.645 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T01:52:07.645 INFO:teuthology.orchestra.run.smithi119.stdout: "req_lookuphash_latency": { 2024-09-21T01:52:07.645 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T01:52:07.645 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T01:52:07.645 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T01:52:07.645 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T01:52:07.645 INFO:teuthology.orchestra.run.smithi119.stdout: "req_lookupino_latency": { 2024-09-21T01:52:07.645 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T01:52:07.645 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T01:52:07.645 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T01:52:07.645 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T01:52:07.645 INFO:teuthology.orchestra.run.smithi119.stdout: "req_lookupname_latency": { 2024-09-21T01:52:07.645 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T01:52:07.646 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T01:52:07.646 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T01:52:07.646 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T01:52:07.646 INFO:teuthology.orchestra.run.smithi119.stdout: "req_lookupparent_latency": { 2024-09-21T01:52:07.646 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T01:52:07.646 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T01:52:07.646 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T01:52:07.646 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T01:52:07.646 INFO:teuthology.orchestra.run.smithi119.stdout: "req_lookupsnap_latency": { 2024-09-21T01:52:07.646 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T01:52:07.646 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T01:52:07.646 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T01:52:07.646 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T01:52:07.647 INFO:teuthology.orchestra.run.smithi119.stdout: "req_lssnap_latency": { 2024-09-21T01:52:07.647 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 11, 2024-09-21T01:52:07.647 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.001492555, 2024-09-21T01:52:07.647 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000135686 2024-09-21T01:52:07.647 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T01:52:07.647 INFO:teuthology.orchestra.run.smithi119.stdout: "req_mkdir_latency": { 2024-09-21T01:52:07.647 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 12, 2024-09-21T01:52:07.647 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.015610385, 2024-09-21T01:52:07.648 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.001300865 2024-09-21T01:52:07.648 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T01:52:07.648 INFO:teuthology.orchestra.run.smithi119.stdout: "req_mknod_latency": { 2024-09-21T01:52:07.648 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T01:52:07.648 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T01:52:07.648 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T01:52:07.648 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T01:52:07.648 INFO:teuthology.orchestra.run.smithi119.stdout: "req_mksnap_latency": { 2024-09-21T01:52:07.648 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 11, 2024-09-21T01:52:07.648 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.048481087, 2024-09-21T01:52:07.648 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.004407371 2024-09-21T01:52:07.648 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T01:52:07.648 INFO:teuthology.orchestra.run.smithi119.stdout: "req_open_latency": { 2024-09-21T01:52:07.648 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T01:52:07.648 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T01:52:07.649 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T01:52:07.649 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T01:52:07.649 INFO:teuthology.orchestra.run.smithi119.stdout: "req_readdir_latency": { 2024-09-21T01:52:07.649 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 5, 2024-09-21T01:52:07.649 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.005452458, 2024-09-21T01:52:07.649 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.001090491 2024-09-21T01:52:07.649 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T01:52:07.649 INFO:teuthology.orchestra.run.smithi119.stdout: "req_rename_latency": { 2024-09-21T01:52:07.649 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 2, 2024-09-21T01:52:07.649 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.002866948, 2024-09-21T01:52:07.649 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.001433474 2024-09-21T01:52:07.649 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T01:52:07.649 INFO:teuthology.orchestra.run.smithi119.stdout: "req_renamesnap_latency": { 2024-09-21T01:52:07.649 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T01:52:07.650 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T01:52:07.650 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T01:52:07.650 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T01:52:07.650 INFO:teuthology.orchestra.run.smithi119.stdout: "req_snapdiff_latency": { 2024-09-21T01:52:07.650 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T01:52:07.650 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T01:52:07.650 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T01:52:07.650 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T01:52:07.650 INFO:teuthology.orchestra.run.smithi119.stdout: "req_rmdir_latency": { 2024-09-21T01:52:07.650 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 6, 2024-09-21T01:52:07.650 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.023601478, 2024-09-21T01:52:07.650 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.003933579 2024-09-21T01:52:07.650 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T01:52:07.650 INFO:teuthology.orchestra.run.smithi119.stdout: "req_rmsnap_latency": { 2024-09-21T01:52:07.650 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 5, 2024-09-21T01:52:07.651 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.019766125, 2024-09-21T01:52:07.651 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.003953225 2024-09-21T01:52:07.651 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T01:52:07.651 INFO:teuthology.orchestra.run.smithi119.stdout: "req_rmxattr_latency": { 2024-09-21T01:52:07.651 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T01:52:07.651 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T01:52:07.651 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T01:52:07.651 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T01:52:07.651 INFO:teuthology.orchestra.run.smithi119.stdout: "req_setattr_latency": { 2024-09-21T01:52:07.651 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 2, 2024-09-21T01:52:07.651 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.001430641, 2024-09-21T01:52:07.651 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000715320 2024-09-21T01:52:07.651 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T01:52:07.651 INFO:teuthology.orchestra.run.smithi119.stdout: "req_setdirlayout_latency": { 2024-09-21T01:52:07.651 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T01:52:07.652 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T01:52:07.652 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T01:52:07.652 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T01:52:07.652 INFO:teuthology.orchestra.run.smithi119.stdout: "req_setfilelock_latency": { 2024-09-21T01:52:07.652 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T01:52:07.652 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T01:52:07.652 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T01:52:07.652 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T01:52:07.652 INFO:teuthology.orchestra.run.smithi119.stdout: "req_setlayout_latency": { 2024-09-21T01:52:07.652 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T01:52:07.652 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T01:52:07.652 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T01:52:07.652 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T01:52:07.652 INFO:teuthology.orchestra.run.smithi119.stdout: "req_setxattr_latency": { 2024-09-21T01:52:07.653 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 10, 2024-09-21T01:52:07.653 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.027612992, 2024-09-21T01:52:07.653 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.002761299 2024-09-21T01:52:07.653 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T01:52:07.653 INFO:teuthology.orchestra.run.smithi119.stdout: "req_symlink_latency": { 2024-09-21T01:52:07.653 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T01:52:07.653 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T01:52:07.653 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T01:52:07.653 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T01:52:07.653 INFO:teuthology.orchestra.run.smithi119.stdout: "req_unlink_latency": { 2024-09-21T01:52:07.653 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 1206, 2024-09-21T01:52:07.653 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 10.781624870, 2024-09-21T01:52:07.653 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.008939987 2024-09-21T01:52:07.653 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T01:52:07.653 INFO:teuthology.orchestra.run.smithi119.stdout: "cap_revoke_eviction": 0, 2024-09-21T01:52:07.654 INFO:teuthology.orchestra.run.smithi119.stdout: "cap_acquisition_throttle": 0, 2024-09-21T01:52:07.654 INFO:teuthology.orchestra.run.smithi119.stdout: "req_getvxattr_latency": { 2024-09-21T01:52:07.654 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T01:52:07.654 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T01:52:07.654 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T01:52:07.654 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-21T01:52:07.654 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T01:52:07.654 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_sessions": { 2024-09-21T01:52:07.654 INFO:teuthology.orchestra.run.smithi119.stdout: "session_count": 2, 2024-09-21T01:52:07.654 INFO:teuthology.orchestra.run.smithi119.stdout: "session_add": 4, 2024-09-21T01:52:07.654 INFO:teuthology.orchestra.run.smithi119.stdout: "session_remove": 2, 2024-09-21T01:52:07.654 INFO:teuthology.orchestra.run.smithi119.stdout: "sessions_open": 2, 2024-09-21T01:52:07.654 INFO:teuthology.orchestra.run.smithi119.stdout: "sessions_stale": 0, 2024-09-21T01:52:07.654 INFO:teuthology.orchestra.run.smithi119.stdout: "total_load": 87, 2024-09-21T01:52:07.655 INFO:teuthology.orchestra.run.smithi119.stdout: "average_load": 43, 2024-09-21T01:52:07.655 INFO:teuthology.orchestra.run.smithi119.stdout: "avg_session_uptime": 607, 2024-09-21T01:52:07.655 INFO:teuthology.orchestra.run.smithi119.stdout: "mdthresh_evicted": 0 2024-09-21T01:52:07.655 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T01:52:07.655 INFO:teuthology.orchestra.run.smithi119.stdout: "mempool": { 2024-09-21T01:52:07.655 INFO:teuthology.orchestra.run.smithi119.stdout: "bloom_filter_bytes": 0, 2024-09-21T01:52:07.655 INFO:teuthology.orchestra.run.smithi119.stdout: "bloom_filter_items": 0, 2024-09-21T01:52:07.655 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T01:52:07.655 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_alloc_items": 0, 2024-09-21T01:52:07.655 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T01:52:07.655 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_data_items": 0, 2024-09-21T01:52:07.655 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T01:52:07.655 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T01:52:07.655 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T01:52:07.656 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T01:52:07.656 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T01:52:07.656 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_other_items": 0, 2024-09-21T01:52:07.656 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T01:52:07.656 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T01:52:07.656 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_extent_bytes": 0, 2024-09-21T01:52:07.656 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_extent_items": 0, 2024-09-21T01:52:07.656 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_blob_bytes": 0, 2024-09-21T01:52:07.656 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_blob_items": 0, 2024-09-21T01:52:07.656 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T01:52:07.656 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T01:52:07.656 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T01:52:07.656 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T01:52:07.656 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T01:52:07.657 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_fsck_items": 0, 2024-09-21T01:52:07.657 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_txc_bytes": 0, 2024-09-21T01:52:07.657 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_txc_items": 0, 2024-09-21T01:52:07.657 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T01:52:07.657 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T01:52:07.657 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_writing_bytes": 0, 2024-09-21T01:52:07.657 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_writing_items": 0, 2024-09-21T01:52:07.657 INFO:teuthology.orchestra.run.smithi119.stdout: "bluefs_bytes": 0, 2024-09-21T01:52:07.657 INFO:teuthology.orchestra.run.smithi119.stdout: "bluefs_items": 0, 2024-09-21T01:52:07.657 INFO:teuthology.orchestra.run.smithi119.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T01:52:07.657 INFO:teuthology.orchestra.run.smithi119.stdout: "bluefs_file_reader_items": 0, 2024-09-21T01:52:07.658 INFO:teuthology.orchestra.run.smithi119.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T01:52:07.658 INFO:teuthology.orchestra.run.smithi119.stdout: "bluefs_file_writer_items": 0, 2024-09-21T01:52:07.658 INFO:teuthology.orchestra.run.smithi119.stdout: "buffer_anon_bytes": 326711, 2024-09-21T01:52:07.658 INFO:teuthology.orchestra.run.smithi119.stdout: "buffer_anon_items": 108, 2024-09-21T01:52:07.658 INFO:teuthology.orchestra.run.smithi119.stdout: "buffer_meta_bytes": 0, 2024-09-21T01:52:07.658 INFO:teuthology.orchestra.run.smithi119.stdout: "buffer_meta_items": 0, 2024-09-21T01:52:07.658 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_bytes": 0, 2024-09-21T01:52:07.658 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_items": 0, 2024-09-21T01:52:07.658 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_mapbl_bytes": 0, 2024-09-21T01:52:07.658 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_mapbl_items": 0, 2024-09-21T01:52:07.658 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_pglog_bytes": 0, 2024-09-21T01:52:07.658 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_pglog_items": 0, 2024-09-21T01:52:07.658 INFO:teuthology.orchestra.run.smithi119.stdout: "osdmap_bytes": 9360, 2024-09-21T01:52:07.658 INFO:teuthology.orchestra.run.smithi119.stdout: "osdmap_items": 190, 2024-09-21T01:52:07.659 INFO:teuthology.orchestra.run.smithi119.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T01:52:07.659 INFO:teuthology.orchestra.run.smithi119.stdout: "osdmap_mapping_items": 0, 2024-09-21T01:52:07.659 INFO:teuthology.orchestra.run.smithi119.stdout: "pgmap_bytes": 0, 2024-09-21T01:52:07.659 INFO:teuthology.orchestra.run.smithi119.stdout: "pgmap_items": 0, 2024-09-21T01:52:07.659 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_co_bytes": 150792, 2024-09-21T01:52:07.659 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_co_items": 1109, 2024-09-21T01:52:07.659 INFO:teuthology.orchestra.run.smithi119.stdout: "unittest_1_bytes": 0, 2024-09-21T01:52:07.659 INFO:teuthology.orchestra.run.smithi119.stdout: "unittest_1_items": 0, 2024-09-21T01:52:07.659 INFO:teuthology.orchestra.run.smithi119.stdout: "unittest_2_bytes": 0, 2024-09-21T01:52:07.659 INFO:teuthology.orchestra.run.smithi119.stdout: "unittest_2_items": 0 2024-09-21T01:52:07.659 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T01:52:07.660 INFO:teuthology.orchestra.run.smithi119.stdout: "objecter": { 2024-09-21T01:52:07.660 INFO:teuthology.orchestra.run.smithi119.stdout: "op_active": 0, 2024-09-21T01:52:07.660 INFO:teuthology.orchestra.run.smithi119.stdout: "op_laggy": 0, 2024-09-21T01:52:07.660 INFO:teuthology.orchestra.run.smithi119.stdout: "op_send": 6767, 2024-09-21T01:52:07.660 INFO:teuthology.orchestra.run.smithi119.stdout: "op_send_bytes": 21205994, 2024-09-21T01:52:07.660 INFO:teuthology.orchestra.run.smithi119.stdout: "op_resend": 31, 2024-09-21T01:52:07.660 INFO:teuthology.orchestra.run.smithi119.stdout: "op_reply": 6767, 2024-09-21T01:52:07.660 INFO:teuthology.orchestra.run.smithi119.stdout: "op_latency": { 2024-09-21T01:52:07.660 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 6767, 2024-09-21T01:52:07.660 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 61.235410005, 2024-09-21T01:52:07.660 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.009049122 2024-09-21T01:52:07.660 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T01:52:07.660 INFO:teuthology.orchestra.run.smithi119.stdout: "op_inflight": 0, 2024-09-21T01:52:07.661 INFO:teuthology.orchestra.run.smithi119.stdout: "oplen_avg": { 2024-09-21T01:52:07.661 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 6767, 2024-09-21T01:52:07.661 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 6859 2024-09-21T01:52:07.661 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T01:52:07.661 INFO:teuthology.orchestra.run.smithi119.stdout: "op": 6767, 2024-09-21T01:52:07.661 INFO:teuthology.orchestra.run.smithi119.stdout: "op_r": 58, 2024-09-21T01:52:07.661 INFO:teuthology.orchestra.run.smithi119.stdout: "op_w": 6709, 2024-09-21T01:52:07.661 INFO:teuthology.orchestra.run.smithi119.stdout: "op_rmw": 0, 2024-09-21T01:52:07.661 INFO:teuthology.orchestra.run.smithi119.stdout: "op_pg": 0, 2024-09-21T01:52:07.661 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_stat": 0, 2024-09-21T01:52:07.661 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_create": 11, 2024-09-21T01:52:07.662 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_read": 58, 2024-09-21T01:52:07.662 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_write": 1401, 2024-09-21T01:52:07.662 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_writefull": 58, 2024-09-21T01:52:07.662 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_writesame": 0, 2024-09-21T01:52:07.662 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_append": 0, 2024-09-21T01:52:07.662 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_zero": 0, 2024-09-21T01:52:07.662 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_truncate": 0, 2024-09-21T01:52:07.662 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_delete": 5177, 2024-09-21T01:52:07.662 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_mapext": 0, 2024-09-21T01:52:07.662 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_sparse_read": 0, 2024-09-21T01:52:07.662 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_clonerange": 0, 2024-09-21T01:52:07.662 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_getxattr": 0, 2024-09-21T01:52:07.662 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_setxattr": 22, 2024-09-21T01:52:07.662 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_cmpxattr": 0, 2024-09-21T01:52:07.663 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_rmxattr": 0, 2024-09-21T01:52:07.663 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_resetxattrs": 0, 2024-09-21T01:52:07.663 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_call": 0, 2024-09-21T01:52:07.663 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_watch": 0, 2024-09-21T01:52:07.663 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_notify": 0, 2024-09-21T01:52:07.663 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T01:52:07.663 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_pgls": 0, 2024-09-21T01:52:07.663 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_pgls_filter": 0, 2024-09-21T01:52:07.663 INFO:teuthology.orchestra.run.smithi119.stdout: "osdop_other": 0, 2024-09-21T01:52:07.663 INFO:teuthology.orchestra.run.smithi119.stdout: "linger_active": 0, 2024-09-21T01:52:07.663 INFO:teuthology.orchestra.run.smithi119.stdout: "linger_send": 0, 2024-09-21T01:52:07.664 INFO:teuthology.orchestra.run.smithi119.stdout: "linger_resend": 0, 2024-09-21T01:52:07.664 INFO:teuthology.orchestra.run.smithi119.stdout: "linger_ping": 0, 2024-09-21T01:52:07.664 INFO:teuthology.orchestra.run.smithi119.stdout: "poolop_active": 0, 2024-09-21T01:52:07.664 INFO:teuthology.orchestra.run.smithi119.stdout: "poolop_send": 0, 2024-09-21T01:52:07.664 INFO:teuthology.orchestra.run.smithi119.stdout: "poolop_resend": 0, 2024-09-21T01:52:07.664 INFO:teuthology.orchestra.run.smithi119.stdout: "poolstat_active": 0, 2024-09-21T01:52:07.664 INFO:teuthology.orchestra.run.smithi119.stdout: "poolstat_send": 0, 2024-09-21T01:52:07.664 INFO:teuthology.orchestra.run.smithi119.stdout: "poolstat_resend": 0, 2024-09-21T01:52:07.664 INFO:teuthology.orchestra.run.smithi119.stdout: "statfs_active": 0, 2024-09-21T01:52:07.664 INFO:teuthology.orchestra.run.smithi119.stdout: "statfs_send": 0, 2024-09-21T01:52:07.664 INFO:teuthology.orchestra.run.smithi119.stdout: "statfs_resend": 0, 2024-09-21T01:52:07.664 INFO:teuthology.orchestra.run.smithi119.stdout: "command_active": 0, 2024-09-21T01:52:07.664 INFO:teuthology.orchestra.run.smithi119.stdout: "command_send": 0, 2024-09-21T01:52:07.665 INFO:teuthology.orchestra.run.smithi119.stdout: "command_resend": 0, 2024-09-21T01:52:07.665 INFO:teuthology.orchestra.run.smithi119.stdout: "map_epoch": 92, 2024-09-21T01:52:07.665 INFO:teuthology.orchestra.run.smithi119.stdout: "map_full": 0, 2024-09-21T01:52:07.665 INFO:teuthology.orchestra.run.smithi119.stdout: "map_inc": 18, 2024-09-21T01:52:07.665 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_sessions": 12, 2024-09-21T01:52:07.665 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_session_open": 12, 2024-09-21T01:52:07.665 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_session_close": 0, 2024-09-21T01:52:07.665 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_laggy": 0, 2024-09-21T01:52:07.665 INFO:teuthology.orchestra.run.smithi119.stdout: "omap_wr": 99, 2024-09-21T01:52:07.665 INFO:teuthology.orchestra.run.smithi119.stdout: "omap_rd": 0, 2024-09-21T01:52:07.665 INFO:teuthology.orchestra.run.smithi119.stdout: "omap_del": 33 2024-09-21T01:52:07.665 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T01:52:07.666 INFO:teuthology.orchestra.run.smithi119.stdout: "oft": { 2024-09-21T01:52:07.666 INFO:teuthology.orchestra.run.smithi119.stdout: "omap_total_objs": 1, 2024-09-21T01:52:07.666 INFO:teuthology.orchestra.run.smithi119.stdout: "omap_total_kv_pairs": 0, 2024-09-21T01:52:07.666 INFO:teuthology.orchestra.run.smithi119.stdout: "omap_total_updates": 0, 2024-09-21T01:52:07.666 INFO:teuthology.orchestra.run.smithi119.stdout: "omap_total_removes": 0 2024-09-21T01:52:07.666 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T01:52:07.666 INFO:teuthology.orchestra.run.smithi119.stdout: "purge_queue": { 2024-09-21T01:52:07.666 INFO:teuthology.orchestra.run.smithi119.stdout: "pq_executing_ops": 0, 2024-09-21T01:52:07.666 INFO:teuthology.orchestra.run.smithi119.stdout: "pq_executing_ops_high_water": 51, 2024-09-21T01:52:07.666 INFO:teuthology.orchestra.run.smithi119.stdout: "pq_executing": 0, 2024-09-21T01:52:07.667 INFO:teuthology.orchestra.run.smithi119.stdout: "pq_executing_high_water": 15, 2024-09-21T01:52:07.667 INFO:teuthology.orchestra.run.smithi119.stdout: "pq_executed_ops": 4661, 2024-09-21T01:52:07.667 INFO:teuthology.orchestra.run.smithi119.stdout: "pq_executed": 1210, 2024-09-21T01:52:07.667 INFO:teuthology.orchestra.run.smithi119.stdout: "pq_item_in_journal": 0 2024-09-21T01:52:07.667 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T01:52:07.667 INFO:teuthology.orchestra.run.smithi119.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T01:52:07.667 INFO:teuthology.orchestra.run.smithi119.stdout: "val": 0, 2024-09-21T01:52:07.667 INFO:teuthology.orchestra.run.smithi119.stdout: "max": 104857600, 2024-09-21T01:52:07.667 INFO:teuthology.orchestra.run.smithi119.stdout: "get_started": 0, 2024-09-21T01:52:07.667 INFO:teuthology.orchestra.run.smithi119.stdout: "get": 14978, 2024-09-21T01:52:07.667 INFO:teuthology.orchestra.run.smithi119.stdout: "get_sum": 4240769, 2024-09-21T01:52:07.668 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_fail": 0, 2024-09-21T01:52:07.668 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_success": 14978, 2024-09-21T01:52:07.668 INFO:teuthology.orchestra.run.smithi119.stdout: "take": 0, 2024-09-21T01:52:07.668 INFO:teuthology.orchestra.run.smithi119.stdout: "take_sum": 0, 2024-09-21T01:52:07.668 INFO:teuthology.orchestra.run.smithi119.stdout: "put": 14978, 2024-09-21T01:52:07.668 INFO:teuthology.orchestra.run.smithi119.stdout: "put_sum": 4240769, 2024-09-21T01:52:07.668 INFO:teuthology.orchestra.run.smithi119.stdout: "wait": { 2024-09-21T01:52:07.668 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T01:52:07.668 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T01:52:07.669 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T01:52:07.669 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-21T01:52:07.669 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T01:52:07.669 INFO:teuthology.orchestra.run.smithi119.stdout: "throttle-objecter_bytes": { 2024-09-21T01:52:07.669 INFO:teuthology.orchestra.run.smithi119.stdout: "val": 0, 2024-09-21T01:52:07.669 INFO:teuthology.orchestra.run.smithi119.stdout: "max": 104857600, 2024-09-21T01:52:07.669 INFO:teuthology.orchestra.run.smithi119.stdout: "get_started": 0, 2024-09-21T01:52:07.669 INFO:teuthology.orchestra.run.smithi119.stdout: "get": 0, 2024-09-21T01:52:07.669 INFO:teuthology.orchestra.run.smithi119.stdout: "get_sum": 0, 2024-09-21T01:52:07.669 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_fail": 0, 2024-09-21T01:52:07.669 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_success": 0, 2024-09-21T01:52:07.669 INFO:teuthology.orchestra.run.smithi119.stdout: "take": 6767, 2024-09-21T01:52:07.669 INFO:teuthology.orchestra.run.smithi119.stdout: "take_sum": 21337876, 2024-09-21T01:52:07.670 INFO:teuthology.orchestra.run.smithi119.stdout: "put": 6767, 2024-09-21T01:52:07.670 INFO:teuthology.orchestra.run.smithi119.stdout: "put_sum": 21337876, 2024-09-21T01:52:07.670 INFO:teuthology.orchestra.run.smithi119.stdout: "wait": { 2024-09-21T01:52:07.670 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T01:52:07.670 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T01:52:07.670 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T01:52:07.670 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-21T01:52:07.670 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T01:52:07.670 INFO:teuthology.orchestra.run.smithi119.stdout: "throttle-objecter_ops": { 2024-09-21T01:52:07.670 INFO:teuthology.orchestra.run.smithi119.stdout: "val": 0, 2024-09-21T01:52:07.670 INFO:teuthology.orchestra.run.smithi119.stdout: "max": 1024, 2024-09-21T01:52:07.670 INFO:teuthology.orchestra.run.smithi119.stdout: "get_started": 0, 2024-09-21T01:52:07.670 INFO:teuthology.orchestra.run.smithi119.stdout: "get": 0, 2024-09-21T01:52:07.670 INFO:teuthology.orchestra.run.smithi119.stdout: "get_sum": 0, 2024-09-21T01:52:07.670 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_fail": 0, 2024-09-21T01:52:07.671 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_success": 0, 2024-09-21T01:52:07.671 INFO:teuthology.orchestra.run.smithi119.stdout: "take": 6767, 2024-09-21T01:52:07.671 INFO:teuthology.orchestra.run.smithi119.stdout: "take_sum": 6767, 2024-09-21T01:52:07.671 INFO:teuthology.orchestra.run.smithi119.stdout: "put": 6767, 2024-09-21T01:52:07.671 INFO:teuthology.orchestra.run.smithi119.stdout: "put_sum": 6767, 2024-09-21T01:52:07.671 INFO:teuthology.orchestra.run.smithi119.stdout: "wait": { 2024-09-21T01:52:07.671 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T01:52:07.671 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T01:52:07.671 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T01:52:07.671 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-21T01:52:07.671 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T01:52:07.671 INFO:teuthology.orchestra.run.smithi119.stdout: "throttle-write_buf_throttle": { 2024-09-21T01:52:07.671 INFO:teuthology.orchestra.run.smithi119.stdout: "val": 0, 2024-09-21T01:52:07.672 INFO:teuthology.orchestra.run.smithi119.stdout: "max": 3758096384, 2024-09-21T01:52:07.672 INFO:teuthology.orchestra.run.smithi119.stdout: "get_started": 0, 2024-09-21T01:52:07.672 INFO:teuthology.orchestra.run.smithi119.stdout: "get": 1210, 2024-09-21T01:52:07.672 INFO:teuthology.orchestra.run.smithi119.stdout: "get_sum": 131882, 2024-09-21T01:52:07.672 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_fail": 0, 2024-09-21T01:52:07.672 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_success": 1210, 2024-09-21T01:52:07.672 INFO:teuthology.orchestra.run.smithi119.stdout: "take": 0, 2024-09-21T01:52:07.672 INFO:teuthology.orchestra.run.smithi119.stdout: "take_sum": 0, 2024-09-21T01:52:07.672 INFO:teuthology.orchestra.run.smithi119.stdout: "put": 58, 2024-09-21T01:52:07.672 INFO:teuthology.orchestra.run.smithi119.stdout: "put_sum": 131882, 2024-09-21T01:52:07.672 INFO:teuthology.orchestra.run.smithi119.stdout: "wait": { 2024-09-21T01:52:07.672 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T01:52:07.672 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T01:52:07.672 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T01:52:07.672 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-21T01:52:07.672 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T01:52:07.673 INFO:teuthology.orchestra.run.smithi119.stdout: "throttle-write_buf_throttle-0x55b9e88512b0": { 2024-09-21T01:52:07.673 INFO:teuthology.orchestra.run.smithi119.stdout: "val": 60, 2024-09-21T01:52:07.673 INFO:teuthology.orchestra.run.smithi119.stdout: "max": 3758096384, 2024-09-21T01:52:07.673 INFO:teuthology.orchestra.run.smithi119.stdout: "get_started": 0, 2024-09-21T01:52:07.673 INFO:teuthology.orchestra.run.smithi119.stdout: "get": 6436, 2024-09-21T01:52:07.673 INFO:teuthology.orchestra.run.smithi119.stdout: "get_sum": 20955484, 2024-09-21T01:52:07.673 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_fail": 0, 2024-09-21T01:52:07.673 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_success": 6436, 2024-09-21T01:52:07.673 INFO:teuthology.orchestra.run.smithi119.stdout: "take": 0, 2024-09-21T01:52:07.673 INFO:teuthology.orchestra.run.smithi119.stdout: "take_sum": 0, 2024-09-21T01:52:07.673 INFO:teuthology.orchestra.run.smithi119.stdout: "put": 1343, 2024-09-21T01:52:07.673 INFO:teuthology.orchestra.run.smithi119.stdout: "put_sum": 20955424, 2024-09-21T01:52:07.673 INFO:teuthology.orchestra.run.smithi119.stdout: "wait": { 2024-09-21T01:52:07.673 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T01:52:07.674 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T01:52:07.674 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T01:52:07.674 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-21T01:52:07.674 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T01:52:07.674 INFO:teuthology.orchestra.run.smithi119.stdout: "trackedop": { 2024-09-21T01:52:07.674 INFO:teuthology.orchestra.run.smithi119.stdout: "slow_ops_count": 58 2024-09-21T01:52:07.674 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-21T01:52:07.674 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-21T01:52:08.586 INFO:tasks.check_counter:Daemon mds.b mds.root_rsnaps=6 2024-09-21T01:52:08.586 INFO:tasks.check_counter:Daemon mds.b mds_server.req_mksnap_latency.avgcount=11 2024-09-21T01:52:08.586 INFO:tasks.check_counter:Daemon mds.b mds_server.req_rmsnap_latency.avgcount=5 2024-09-21T01:52:08.586 DEBUG:tasks.check_counter:Getting stats from e 2024-09-21T01:52:08.586 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph daemon mds.e perf dump 2024-09-21T01:52:08.835 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T01:52:08.955 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:52:08 smithi119 ceph-mon[33693]: pgmap v649: 129 pgs: 129 active+clean; 28 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 21 op/s 2024-09-21T01:52:08.964 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:52:08 smithi142 ceph-mon[34050]: pgmap v649: 129 pgs: 129 active+clean; 28 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 21 op/s 2024-09-21T01:52:09.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:52:08 smithi083 ceph-mon[31370]: pgmap v649: 129 pgs: 129 active+clean; 28 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 21 op/s 2024-09-21T01:52:09.363 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-21T01:52:09.363 INFO:teuthology.orchestra.run.smithi119.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T01:52:09.363 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_messages": 4, 2024-09-21T01:52:09.363 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_messages": 4, 2024-09-21T01:52:09.363 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_bytes": 2912, 2024-09-21T01:52:09.363 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_bytes": 448, 2024-09-21T01:52:09.363 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_created_connections": 4, 2024-09-21T01:52:09.363 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_active_connections": 0, 2024-09-21T01:52:09.363 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_total_time": 0.002947749, 2024-09-21T01:52:09.363 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_send_time": 0.000038242, 2024-09-21T01:52:09.364 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_recv_time": 0.002128417, 2024-09-21T01:52:09.364 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T01:52:09.364 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:52:09.364 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 3, 2024-09-21T01:52:09.364 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.003853480, 2024-09-21T01:52:09.364 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.001284493 2024-09-21T01:52:09.364 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T01:52:09.364 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:52:09.364 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T01:52:09.364 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T01:52:09.364 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T01:52:09.365 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T01:52:09.365 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_encrypted_bytes": 2912, 2024-09-21T01:52:09.365 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_encrypted_bytes": 448 2024-09-21T01:52:09.365 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T01:52:09.365 INFO:teuthology.orchestra.run.smithi119.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T01:52:09.365 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_messages": 1, 2024-09-21T01:52:09.365 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_messages": 158, 2024-09-21T01:52:09.365 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_bytes": 160, 2024-09-21T01:52:09.365 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_bytes": 107952, 2024-09-21T01:52:09.365 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_created_connections": 3, 2024-09-21T01:52:09.365 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_active_connections": 2, 2024-09-21T01:52:09.366 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_total_time": 0.013389283, 2024-09-21T01:52:09.366 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_send_time": 0.010319422, 2024-09-21T01:52:09.366 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_recv_time": 0.001220290, 2024-09-21T01:52:09.366 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T01:52:09.366 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:52:09.366 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 156, 2024-09-21T01:52:09.366 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.010937420, 2024-09-21T01:52:09.366 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000070111 2024-09-21T01:52:09.366 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T01:52:09.367 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:52:09.367 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T01:52:09.367 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T01:52:09.367 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T01:52:09.367 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T01:52:09.367 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-21T01:52:09.367 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_encrypted_bytes": 107952 2024-09-21T01:52:09.367 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T01:52:09.367 INFO:teuthology.orchestra.run.smithi119.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T01:52:09.367 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_messages": 214, 2024-09-21T01:52:09.367 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_messages": 209, 2024-09-21T01:52:09.368 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_bytes": 835872, 2024-09-21T01:52:09.368 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_bytes": 128064, 2024-09-21T01:52:09.368 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_created_connections": 2, 2024-09-21T01:52:09.368 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_active_connections": 1, 2024-09-21T01:52:09.368 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_total_time": 0.041827131, 2024-09-21T01:52:09.368 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_send_time": 0.019968985, 2024-09-21T01:52:09.368 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_recv_time": 0.031468519, 2024-09-21T01:52:09.368 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T01:52:09.368 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:52:09.368 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 208, 2024-09-21T01:52:09.369 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.014324546, 2024-09-21T01:52:09.369 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000068868 2024-09-21T01:52:09.369 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T01:52:09.369 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:52:09.369 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T01:52:09.369 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T01:52:09.369 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T01:52:09.369 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T01:52:09.369 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_encrypted_bytes": 835872, 2024-09-21T01:52:09.369 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_encrypted_bytes": 128064 2024-09-21T01:52:09.369 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T01:52:09.369 INFO:teuthology.orchestra.run.smithi119.stdout: "cct": { 2024-09-21T01:52:09.369 INFO:teuthology.orchestra.run.smithi119.stdout: "total_workers": 0, 2024-09-21T01:52:09.369 INFO:teuthology.orchestra.run.smithi119.stdout: "unhealthy_workers": 0 2024-09-21T01:52:09.370 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T01:52:09.370 INFO:teuthology.orchestra.run.smithi119.stdout: "mempool": { 2024-09-21T01:52:09.370 INFO:teuthology.orchestra.run.smithi119.stdout: "bloom_filter_bytes": 0, 2024-09-21T01:52:09.370 INFO:teuthology.orchestra.run.smithi119.stdout: "bloom_filter_items": 0, 2024-09-21T01:52:09.370 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T01:52:09.370 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_alloc_items": 0, 2024-09-21T01:52:09.370 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T01:52:09.370 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_data_items": 0, 2024-09-21T01:52:09.370 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T01:52:09.370 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T01:52:09.370 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T01:52:09.370 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T01:52:09.370 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T01:52:09.370 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_other_items": 0, 2024-09-21T01:52:09.371 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T01:52:09.371 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T01:52:09.371 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_extent_bytes": 0, 2024-09-21T01:52:09.371 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_extent_items": 0, 2024-09-21T01:52:09.371 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_blob_bytes": 0, 2024-09-21T01:52:09.371 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_blob_items": 0, 2024-09-21T01:52:09.371 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T01:52:09.371 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T01:52:09.371 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T01:52:09.371 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T01:52:09.371 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T01:52:09.371 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_fsck_items": 0, 2024-09-21T01:52:09.371 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_txc_bytes": 0, 2024-09-21T01:52:09.371 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_txc_items": 0, 2024-09-21T01:52:09.372 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T01:52:09.372 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T01:52:09.372 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_writing_bytes": 0, 2024-09-21T01:52:09.372 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_writing_items": 0, 2024-09-21T01:52:09.372 INFO:teuthology.orchestra.run.smithi119.stdout: "bluefs_bytes": 0, 2024-09-21T01:52:09.372 INFO:teuthology.orchestra.run.smithi119.stdout: "bluefs_items": 0, 2024-09-21T01:52:09.372 INFO:teuthology.orchestra.run.smithi119.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T01:52:09.372 INFO:teuthology.orchestra.run.smithi119.stdout: "bluefs_file_reader_items": 0, 2024-09-21T01:52:09.372 INFO:teuthology.orchestra.run.smithi119.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T01:52:09.372 INFO:teuthology.orchestra.run.smithi119.stdout: "bluefs_file_writer_items": 0, 2024-09-21T01:52:09.372 INFO:teuthology.orchestra.run.smithi119.stdout: "buffer_anon_bytes": 149007, 2024-09-21T01:52:09.372 INFO:teuthology.orchestra.run.smithi119.stdout: "buffer_anon_items": 30, 2024-09-21T01:52:09.372 INFO:teuthology.orchestra.run.smithi119.stdout: "buffer_meta_bytes": 0, 2024-09-21T01:52:09.372 INFO:teuthology.orchestra.run.smithi119.stdout: "buffer_meta_items": 0, 2024-09-21T01:52:09.372 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_bytes": 0, 2024-09-21T01:52:09.373 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_items": 0, 2024-09-21T01:52:09.373 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_mapbl_bytes": 0, 2024-09-21T01:52:09.373 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_mapbl_items": 0, 2024-09-21T01:52:09.373 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_pglog_bytes": 0, 2024-09-21T01:52:09.373 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_pglog_items": 0, 2024-09-21T01:52:09.373 INFO:teuthology.orchestra.run.smithi119.stdout: "osdmap_bytes": 0, 2024-09-21T01:52:09.373 INFO:teuthology.orchestra.run.smithi119.stdout: "osdmap_items": 0, 2024-09-21T01:52:09.373 INFO:teuthology.orchestra.run.smithi119.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T01:52:09.373 INFO:teuthology.orchestra.run.smithi119.stdout: "osdmap_mapping_items": 0, 2024-09-21T01:52:09.373 INFO:teuthology.orchestra.run.smithi119.stdout: "pgmap_bytes": 0, 2024-09-21T01:52:09.373 INFO:teuthology.orchestra.run.smithi119.stdout: "pgmap_items": 0, 2024-09-21T01:52:09.373 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_co_bytes": 968, 2024-09-21T01:52:09.373 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_co_items": 2, 2024-09-21T01:52:09.373 INFO:teuthology.orchestra.run.smithi119.stdout: "unittest_1_bytes": 0, 2024-09-21T01:52:09.373 INFO:teuthology.orchestra.run.smithi119.stdout: "unittest_1_items": 0, 2024-09-21T01:52:09.374 INFO:teuthology.orchestra.run.smithi119.stdout: "unittest_2_bytes": 0, 2024-09-21T01:52:09.374 INFO:teuthology.orchestra.run.smithi119.stdout: "unittest_2_items": 0 2024-09-21T01:52:09.374 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T01:52:09.374 INFO:teuthology.orchestra.run.smithi119.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T01:52:09.374 INFO:teuthology.orchestra.run.smithi119.stdout: "val": 0, 2024-09-21T01:52:09.374 INFO:teuthology.orchestra.run.smithi119.stdout: "max": 104857600, 2024-09-21T01:52:09.374 INFO:teuthology.orchestra.run.smithi119.stdout: "get_started": 0, 2024-09-21T01:52:09.374 INFO:teuthology.orchestra.run.smithi119.stdout: "get": 215, 2024-09-21T01:52:09.374 INFO:teuthology.orchestra.run.smithi119.stdout: "get_sum": 805618, 2024-09-21T01:52:09.374 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_fail": 0, 2024-09-21T01:52:09.374 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_success": 215, 2024-09-21T01:52:09.374 INFO:teuthology.orchestra.run.smithi119.stdout: "take": 0, 2024-09-21T01:52:09.374 INFO:teuthology.orchestra.run.smithi119.stdout: "take_sum": 0, 2024-09-21T01:52:09.374 INFO:teuthology.orchestra.run.smithi119.stdout: "put": 215, 2024-09-21T01:52:09.375 INFO:teuthology.orchestra.run.smithi119.stdout: "put_sum": 805618, 2024-09-21T01:52:09.375 INFO:teuthology.orchestra.run.smithi119.stdout: "wait": { 2024-09-21T01:52:09.375 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T01:52:09.375 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T01:52:09.375 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T01:52:09.375 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-21T01:52:09.375 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-21T01:52:09.375 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-21T01:52:10.088 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.e 2024-09-21T01:52:10.088 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.e 2024-09-21T01:52:10.088 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.e 2024-09-21T01:52:10.088 DEBUG:tasks.check_counter:Getting stats from h 2024-09-21T01:52:10.089 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph daemon mds.h perf dump 2024-09-21T01:52:10.331 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T01:52:10.717 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:52:10 smithi119 ceph-mon[33693]: pgmap v650: 129 pgs: 129 active+clean; 28 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-09-21T01:52:10.858 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-21T01:52:10.859 INFO:teuthology.orchestra.run.smithi119.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T01:52:10.859 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_messages": 0, 2024-09-21T01:52:10.859 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_messages": 2, 2024-09-21T01:52:10.859 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_bytes": 0, 2024-09-21T01:52:10.859 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_bytes": 0, 2024-09-21T01:52:10.859 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_created_connections": 4, 2024-09-21T01:52:10.859 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_active_connections": 0, 2024-09-21T01:52:10.859 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_total_time": 0.001166473, 2024-09-21T01:52:10.859 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_send_time": 0.000000000, 2024-09-21T01:52:10.859 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_recv_time": 0.000312643, 2024-09-21T01:52:10.859 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T01:52:10.859 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:52:10.859 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T01:52:10.860 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T01:52:10.860 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T01:52:10.860 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T01:52:10.860 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:52:10.860 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T01:52:10.860 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T01:52:10.860 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T01:52:10.860 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T01:52:10.860 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T01:52:10.860 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T01:52:10.860 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T01:52:10.860 INFO:teuthology.orchestra.run.smithi119.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T01:52:10.860 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_messages": 212, 2024-09-21T01:52:10.860 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_messages": 207, 2024-09-21T01:52:10.860 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_bytes": 835328, 2024-09-21T01:52:10.861 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_bytes": 126784, 2024-09-21T01:52:10.861 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_created_connections": 2, 2024-09-21T01:52:10.861 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_active_connections": 1, 2024-09-21T01:52:10.861 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_total_time": 0.041748405, 2024-09-21T01:52:10.861 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_send_time": 0.019710287, 2024-09-21T01:52:10.861 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_recv_time": 0.030066916, 2024-09-21T01:52:10.861 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T01:52:10.861 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:52:10.861 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 206, 2024-09-21T01:52:10.861 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.014750718, 2024-09-21T01:52:10.861 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000071605 2024-09-21T01:52:10.861 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T01:52:10.861 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:52:10.861 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T01:52:10.861 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T01:52:10.862 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T01:52:10.862 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T01:52:10.862 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_encrypted_bytes": 835328, 2024-09-21T01:52:10.862 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_encrypted_bytes": 126784 2024-09-21T01:52:10.862 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T01:52:10.862 INFO:teuthology.orchestra.run.smithi119.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T01:52:10.862 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_messages": 5, 2024-09-21T01:52:10.862 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_messages": 159, 2024-09-21T01:52:10.862 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_bytes": 3072, 2024-09-21T01:52:10.862 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_bytes": 108224, 2024-09-21T01:52:10.862 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_created_connections": 3, 2024-09-21T01:52:10.862 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_active_connections": 2, 2024-09-21T01:52:10.862 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_total_time": 0.015091760, 2024-09-21T01:52:10.862 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_send_time": 0.010393539, 2024-09-21T01:52:10.863 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_recv_time": 0.002937336, 2024-09-21T01:52:10.863 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T01:52:10.863 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:52:10.863 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 158, 2024-09-21T01:52:10.863 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.015244875, 2024-09-21T01:52:10.863 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000096486 2024-09-21T01:52:10.863 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T01:52:10.863 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:52:10.863 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T01:52:10.863 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T01:52:10.863 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T01:52:10.863 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T01:52:10.863 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_encrypted_bytes": 3072, 2024-09-21T01:52:10.863 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_encrypted_bytes": 108224 2024-09-21T01:52:10.863 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T01:52:10.864 INFO:teuthology.orchestra.run.smithi119.stdout: "cct": { 2024-09-21T01:52:10.864 INFO:teuthology.orchestra.run.smithi119.stdout: "total_workers": 0, 2024-09-21T01:52:10.864 INFO:teuthology.orchestra.run.smithi119.stdout: "unhealthy_workers": 0 2024-09-21T01:52:10.864 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T01:52:10.864 INFO:teuthology.orchestra.run.smithi119.stdout: "mempool": { 2024-09-21T01:52:10.864 INFO:teuthology.orchestra.run.smithi119.stdout: "bloom_filter_bytes": 0, 2024-09-21T01:52:10.864 INFO:teuthology.orchestra.run.smithi119.stdout: "bloom_filter_items": 0, 2024-09-21T01:52:10.864 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T01:52:10.864 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_alloc_items": 0, 2024-09-21T01:52:10.864 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T01:52:10.864 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_data_items": 0, 2024-09-21T01:52:10.864 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T01:52:10.864 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T01:52:10.864 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T01:52:10.864 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T01:52:10.865 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T01:52:10.865 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_other_items": 0, 2024-09-21T01:52:10.865 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T01:52:10.865 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T01:52:10.865 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_extent_bytes": 0, 2024-09-21T01:52:10.865 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_extent_items": 0, 2024-09-21T01:52:10.865 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_blob_bytes": 0, 2024-09-21T01:52:10.865 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_blob_items": 0, 2024-09-21T01:52:10.865 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T01:52:10.865 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T01:52:10.865 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T01:52:10.866 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T01:52:10.866 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T01:52:10.866 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_fsck_items": 0, 2024-09-21T01:52:10.866 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_txc_bytes": 0, 2024-09-21T01:52:10.866 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_txc_items": 0, 2024-09-21T01:52:10.866 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T01:52:10.866 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T01:52:10.866 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_writing_bytes": 0, 2024-09-21T01:52:10.866 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_writing_items": 0, 2024-09-21T01:52:10.866 INFO:teuthology.orchestra.run.smithi119.stdout: "bluefs_bytes": 0, 2024-09-21T01:52:10.866 INFO:teuthology.orchestra.run.smithi119.stdout: "bluefs_items": 0, 2024-09-21T01:52:10.866 INFO:teuthology.orchestra.run.smithi119.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T01:52:10.866 INFO:teuthology.orchestra.run.smithi119.stdout: "bluefs_file_reader_items": 0, 2024-09-21T01:52:10.866 INFO:teuthology.orchestra.run.smithi119.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T01:52:10.867 INFO:teuthology.orchestra.run.smithi119.stdout: "bluefs_file_writer_items": 0, 2024-09-21T01:52:10.867 INFO:teuthology.orchestra.run.smithi119.stdout: "buffer_anon_bytes": 149007, 2024-09-21T01:52:10.867 INFO:teuthology.orchestra.run.smithi119.stdout: "buffer_anon_items": 30, 2024-09-21T01:52:10.867 INFO:teuthology.orchestra.run.smithi119.stdout: "buffer_meta_bytes": 0, 2024-09-21T01:52:10.867 INFO:teuthology.orchestra.run.smithi119.stdout: "buffer_meta_items": 0, 2024-09-21T01:52:10.867 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_bytes": 0, 2024-09-21T01:52:10.867 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_items": 0, 2024-09-21T01:52:10.867 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_mapbl_bytes": 0, 2024-09-21T01:52:10.867 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_mapbl_items": 0, 2024-09-21T01:52:10.867 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_pglog_bytes": 0, 2024-09-21T01:52:10.867 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_pglog_items": 0, 2024-09-21T01:52:10.867 INFO:teuthology.orchestra.run.smithi119.stdout: "osdmap_bytes": 0, 2024-09-21T01:52:10.867 INFO:teuthology.orchestra.run.smithi119.stdout: "osdmap_items": 0, 2024-09-21T01:52:10.867 INFO:teuthology.orchestra.run.smithi119.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T01:52:10.868 INFO:teuthology.orchestra.run.smithi119.stdout: "osdmap_mapping_items": 0, 2024-09-21T01:52:10.868 INFO:teuthology.orchestra.run.smithi119.stdout: "pgmap_bytes": 0, 2024-09-21T01:52:10.868 INFO:teuthology.orchestra.run.smithi119.stdout: "pgmap_items": 0, 2024-09-21T01:52:10.868 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_co_bytes": 968, 2024-09-21T01:52:10.868 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_co_items": 2, 2024-09-21T01:52:10.868 INFO:teuthology.orchestra.run.smithi119.stdout: "unittest_1_bytes": 0, 2024-09-21T01:52:10.868 INFO:teuthology.orchestra.run.smithi119.stdout: "unittest_1_items": 0, 2024-09-21T01:52:10.868 INFO:teuthology.orchestra.run.smithi119.stdout: "unittest_2_bytes": 0, 2024-09-21T01:52:10.868 INFO:teuthology.orchestra.run.smithi119.stdout: "unittest_2_items": 0 2024-09-21T01:52:10.868 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T01:52:10.868 INFO:teuthology.orchestra.run.smithi119.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T01:52:10.868 INFO:teuthology.orchestra.run.smithi119.stdout: "val": 0, 2024-09-21T01:52:10.868 INFO:teuthology.orchestra.run.smithi119.stdout: "max": 104857600, 2024-09-21T01:52:10.868 INFO:teuthology.orchestra.run.smithi119.stdout: "get_started": 0, 2024-09-21T01:52:10.869 INFO:teuthology.orchestra.run.smithi119.stdout: "get": 213, 2024-09-21T01:52:10.869 INFO:teuthology.orchestra.run.smithi119.stdout: "get_sum": 805358, 2024-09-21T01:52:10.869 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_fail": 0, 2024-09-21T01:52:10.869 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_success": 213, 2024-09-21T01:52:10.869 INFO:teuthology.orchestra.run.smithi119.stdout: "take": 0, 2024-09-21T01:52:10.869 INFO:teuthology.orchestra.run.smithi119.stdout: "take_sum": 0, 2024-09-21T01:52:10.869 INFO:teuthology.orchestra.run.smithi119.stdout: "put": 213, 2024-09-21T01:52:10.869 INFO:teuthology.orchestra.run.smithi119.stdout: "put_sum": 805358, 2024-09-21T01:52:10.869 INFO:teuthology.orchestra.run.smithi119.stdout: "wait": { 2024-09-21T01:52:10.869 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T01:52:10.869 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T01:52:10.869 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T01:52:10.869 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-21T01:52:10.869 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-21T01:52:10.869 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-21T01:52:10.964 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:52:10 smithi142 ceph-mon[34050]: pgmap v650: 129 pgs: 129 active+clean; 28 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-09-21T01:52:11.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:52:10 smithi083 ceph-mon[31370]: pgmap v650: 129 pgs: 129 active+clean; 28 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-09-21T01:52:11.576 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.h 2024-09-21T01:52:11.577 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.h 2024-09-21T01:52:11.577 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.h 2024-09-21T01:52:11.577 DEBUG:tasks.check_counter:Getting stats from k 2024-09-21T01:52:11.577 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph daemon mds.k perf dump 2024-09-21T01:52:11.826 INFO:teuthology.orchestra.run.smithi119.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T01:52:11.947 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:52:11 smithi119 ceph-mon[33693]: osdmap e93: 12 total, 12 up, 12 in 2024-09-21T01:52:11.964 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:52:11 smithi142 ceph-mon[34050]: osdmap e93: 12 total, 12 up, 12 in 2024-09-21T01:52:12.053 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:52:11 smithi083 ceph-mon[31370]: osdmap e93: 12 total, 12 up, 12 in 2024-09-21T01:52:12.342 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2024-09-21T01:52:12.342 INFO:teuthology.orchestra.run.smithi119.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T01:52:12.342 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_messages": 221, 2024-09-21T01:52:12.343 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_messages": 214, 2024-09-21T01:52:12.343 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_bytes": 839600, 2024-09-21T01:52:12.343 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_bytes": 130432, 2024-09-21T01:52:12.343 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_created_connections": 4, 2024-09-21T01:52:12.343 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_active_connections": 0, 2024-09-21T01:52:12.343 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_total_time": 0.044340515, 2024-09-21T01:52:12.343 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_send_time": 0.018838521, 2024-09-21T01:52:12.343 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_recv_time": 0.033786688, 2024-09-21T01:52:12.343 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T01:52:12.343 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:52:12.343 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 214, 2024-09-21T01:52:12.343 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.016403495, 2024-09-21T01:52:12.343 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000076651 2024-09-21T01:52:12.343 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T01:52:12.344 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:52:12.344 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T01:52:12.344 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T01:52:12.344 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T01:52:12.344 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T01:52:12.344 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_encrypted_bytes": 839600, 2024-09-21T01:52:12.344 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_encrypted_bytes": 130432 2024-09-21T01:52:12.344 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T01:52:12.344 INFO:teuthology.orchestra.run.smithi119.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T01:52:12.344 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_messages": 1, 2024-09-21T01:52:12.344 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_messages": 161, 2024-09-21T01:52:12.344 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_bytes": 160, 2024-09-21T01:52:12.344 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_bytes": 108480, 2024-09-21T01:52:12.344 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_created_connections": 3, 2024-09-21T01:52:12.345 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_active_connections": 2, 2024-09-21T01:52:12.345 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_total_time": 0.014535662, 2024-09-21T01:52:12.345 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_send_time": 0.010979093, 2024-09-21T01:52:12.345 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_recv_time": 0.001629982, 2024-09-21T01:52:12.345 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T01:52:12.345 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:52:12.345 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 159, 2024-09-21T01:52:12.345 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.010812880, 2024-09-21T01:52:12.345 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000068005 2024-09-21T01:52:12.345 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T01:52:12.345 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:52:12.345 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T01:52:12.345 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T01:52:12.345 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T01:52:12.345 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T01:52:12.345 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-21T01:52:12.346 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_encrypted_bytes": 108480 2024-09-21T01:52:12.346 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T01:52:12.346 INFO:teuthology.orchestra.run.smithi119.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T01:52:12.346 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_messages": 0, 2024-09-21T01:52:12.346 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_messages": 2, 2024-09-21T01:52:12.346 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_bytes": 0, 2024-09-21T01:52:12.346 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_bytes": 0, 2024-09-21T01:52:12.346 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_created_connections": 2, 2024-09-21T01:52:12.346 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_active_connections": 1, 2024-09-21T01:52:12.346 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_total_time": 0.000355248, 2024-09-21T01:52:12.346 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_send_time": 0.000000000, 2024-09-21T01:52:12.347 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_recv_time": 0.000289491, 2024-09-21T01:52:12.347 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T01:52:12.347 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:52:12.347 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T01:52:12.347 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T01:52:12.347 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T01:52:12.347 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T01:52:12.347 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:52:12.347 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T01:52:12.347 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T01:52:12.347 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T01:52:12.347 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T01:52:12.347 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T01:52:12.347 INFO:teuthology.orchestra.run.smithi119.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T01:52:12.347 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T01:52:12.348 INFO:teuthology.orchestra.run.smithi119.stdout: "cct": { 2024-09-21T01:52:12.348 INFO:teuthology.orchestra.run.smithi119.stdout: "total_workers": 0, 2024-09-21T01:52:12.348 INFO:teuthology.orchestra.run.smithi119.stdout: "unhealthy_workers": 0 2024-09-21T01:52:12.348 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T01:52:12.348 INFO:teuthology.orchestra.run.smithi119.stdout: "mempool": { 2024-09-21T01:52:12.348 INFO:teuthology.orchestra.run.smithi119.stdout: "bloom_filter_bytes": 0, 2024-09-21T01:52:12.348 INFO:teuthology.orchestra.run.smithi119.stdout: "bloom_filter_items": 0, 2024-09-21T01:52:12.348 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T01:52:12.348 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_alloc_items": 0, 2024-09-21T01:52:12.348 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T01:52:12.348 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_data_items": 0, 2024-09-21T01:52:12.348 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T01:52:12.348 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T01:52:12.348 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T01:52:12.348 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T01:52:12.349 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T01:52:12.349 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_other_items": 0, 2024-09-21T01:52:12.349 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T01:52:12.349 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T01:52:12.349 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_extent_bytes": 0, 2024-09-21T01:52:12.349 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_extent_items": 0, 2024-09-21T01:52:12.349 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_blob_bytes": 0, 2024-09-21T01:52:12.349 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_blob_items": 0, 2024-09-21T01:52:12.349 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T01:52:12.349 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T01:52:12.349 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T01:52:12.349 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T01:52:12.349 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T01:52:12.349 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_fsck_items": 0, 2024-09-21T01:52:12.350 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_txc_bytes": 0, 2024-09-21T01:52:12.350 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_txc_items": 0, 2024-09-21T01:52:12.350 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T01:52:12.350 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T01:52:12.350 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_writing_bytes": 0, 2024-09-21T01:52:12.350 INFO:teuthology.orchestra.run.smithi119.stdout: "bluestore_writing_items": 0, 2024-09-21T01:52:12.350 INFO:teuthology.orchestra.run.smithi119.stdout: "bluefs_bytes": 0, 2024-09-21T01:52:12.350 INFO:teuthology.orchestra.run.smithi119.stdout: "bluefs_items": 0, 2024-09-21T01:52:12.350 INFO:teuthology.orchestra.run.smithi119.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T01:52:12.350 INFO:teuthology.orchestra.run.smithi119.stdout: "bluefs_file_reader_items": 0, 2024-09-21T01:52:12.350 INFO:teuthology.orchestra.run.smithi119.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T01:52:12.350 INFO:teuthology.orchestra.run.smithi119.stdout: "bluefs_file_writer_items": 0, 2024-09-21T01:52:12.350 INFO:teuthology.orchestra.run.smithi119.stdout: "buffer_anon_bytes": 149007, 2024-09-21T01:52:12.350 INFO:teuthology.orchestra.run.smithi119.stdout: "buffer_anon_items": 30, 2024-09-21T01:52:12.350 INFO:teuthology.orchestra.run.smithi119.stdout: "buffer_meta_bytes": 0, 2024-09-21T01:52:12.351 INFO:teuthology.orchestra.run.smithi119.stdout: "buffer_meta_items": 0, 2024-09-21T01:52:12.351 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_bytes": 0, 2024-09-21T01:52:12.351 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_items": 0, 2024-09-21T01:52:12.351 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_mapbl_bytes": 0, 2024-09-21T01:52:12.351 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_mapbl_items": 0, 2024-09-21T01:52:12.351 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_pglog_bytes": 0, 2024-09-21T01:52:12.351 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_pglog_items": 0, 2024-09-21T01:52:12.351 INFO:teuthology.orchestra.run.smithi119.stdout: "osdmap_bytes": 0, 2024-09-21T01:52:12.351 INFO:teuthology.orchestra.run.smithi119.stdout: "osdmap_items": 0, 2024-09-21T01:52:12.351 INFO:teuthology.orchestra.run.smithi119.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T01:52:12.351 INFO:teuthology.orchestra.run.smithi119.stdout: "osdmap_mapping_items": 0, 2024-09-21T01:52:12.351 INFO:teuthology.orchestra.run.smithi119.stdout: "pgmap_bytes": 0, 2024-09-21T01:52:12.351 INFO:teuthology.orchestra.run.smithi119.stdout: "pgmap_items": 0, 2024-09-21T01:52:12.351 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_co_bytes": 968, 2024-09-21T01:52:12.351 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_co_items": 2, 2024-09-21T01:52:12.352 INFO:teuthology.orchestra.run.smithi119.stdout: "unittest_1_bytes": 0, 2024-09-21T01:52:12.352 INFO:teuthology.orchestra.run.smithi119.stdout: "unittest_1_items": 0, 2024-09-21T01:52:12.352 INFO:teuthology.orchestra.run.smithi119.stdout: "unittest_2_bytes": 0, 2024-09-21T01:52:12.352 INFO:teuthology.orchestra.run.smithi119.stdout: "unittest_2_items": 0 2024-09-21T01:52:12.352 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2024-09-21T01:52:12.352 INFO:teuthology.orchestra.run.smithi119.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T01:52:12.352 INFO:teuthology.orchestra.run.smithi119.stdout: "val": 0, 2024-09-21T01:52:12.352 INFO:teuthology.orchestra.run.smithi119.stdout: "max": 104857600, 2024-09-21T01:52:12.352 INFO:teuthology.orchestra.run.smithi119.stdout: "get_started": 0, 2024-09-21T01:52:12.352 INFO:teuthology.orchestra.run.smithi119.stdout: "get": 218, 2024-09-21T01:52:12.352 INFO:teuthology.orchestra.run.smithi119.stdout: "get_sum": 806008, 2024-09-21T01:52:12.352 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_fail": 0, 2024-09-21T01:52:12.352 INFO:teuthology.orchestra.run.smithi119.stdout: "get_or_fail_success": 218, 2024-09-21T01:52:12.352 INFO:teuthology.orchestra.run.smithi119.stdout: "take": 0, 2024-09-21T01:52:12.352 INFO:teuthology.orchestra.run.smithi119.stdout: "take_sum": 0, 2024-09-21T01:52:12.353 INFO:teuthology.orchestra.run.smithi119.stdout: "put": 218, 2024-09-21T01:52:12.353 INFO:teuthology.orchestra.run.smithi119.stdout: "put_sum": 806008, 2024-09-21T01:52:12.353 INFO:teuthology.orchestra.run.smithi119.stdout: "wait": { 2024-09-21T01:52:12.353 INFO:teuthology.orchestra.run.smithi119.stdout: "avgcount": 0, 2024-09-21T01:52:12.353 INFO:teuthology.orchestra.run.smithi119.stdout: "sum": 0.000000000, 2024-09-21T01:52:12.353 INFO:teuthology.orchestra.run.smithi119.stdout: "avgtime": 0.000000000 2024-09-21T01:52:12.353 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-21T01:52:12.353 INFO:teuthology.orchestra.run.smithi119.stdout: } 2024-09-21T01:52:12.353 INFO:teuthology.orchestra.run.smithi119.stdout:} 2024-09-21T01:52:12.964 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:52:12 smithi142 ceph-mon[34050]: pgmap v652: 129 pgs: 129 active+clean; 28 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 53 KiB/s wr, 22 op/s 2024-09-21T01:52:12.967 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:52:12 smithi119 ceph-mon[33693]: pgmap v652: 129 pgs: 129 active+clean; 28 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 53 KiB/s wr, 22 op/s 2024-09-21T01:52:13.053 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:52:12 smithi083 ceph-mon[31370]: pgmap v652: 129 pgs: 129 active+clean; 28 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 53 KiB/s wr, 22 op/s 2024-09-21T01:52:13.083 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.k 2024-09-21T01:52:13.083 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.k 2024-09-21T01:52:13.083 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.k 2024-09-21T01:52:13.083 DEBUG:tasks.check_counter:Getting stats from c 2024-09-21T01:52:13.084 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph daemon mds.c perf dump 2024-09-21T01:52:13.341 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T01:52:13.884 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-09-21T01:52:13.884 INFO:teuthology.orchestra.run.smithi142.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T01:52:13.884 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_recv_messages": 0, 2024-09-21T01:52:13.884 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_send_messages": 2, 2024-09-21T01:52:13.884 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_recv_bytes": 0, 2024-09-21T01:52:13.884 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_send_bytes": 0, 2024-09-21T01:52:13.884 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_created_connections": 4, 2024-09-21T01:52:13.884 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_active_connections": 0, 2024-09-21T01:52:13.884 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_total_time": 0.001132847, 2024-09-21T01:52:13.885 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_send_time": 0.000000000, 2024-09-21T01:52:13.885 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_recv_time": 0.000253851, 2024-09-21T01:52:13.885 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T01:52:13.885 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:52:13.885 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2024-09-21T01:52:13.885 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2024-09-21T01:52:13.885 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2024-09-21T01:52:13.885 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-09-21T01:52:13.885 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:52:13.885 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2024-09-21T01:52:13.885 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2024-09-21T01:52:13.885 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2024-09-21T01:52:13.885 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-09-21T01:52:13.886 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T01:52:13.886 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T01:52:13.886 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-09-21T01:52:13.886 INFO:teuthology.orchestra.run.smithi142.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T01:52:13.886 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_recv_messages": 218, 2024-09-21T01:52:13.886 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_send_messages": 211, 2024-09-21T01:52:13.886 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_recv_bytes": 838784, 2024-09-21T01:52:13.886 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_send_bytes": 128512, 2024-09-21T01:52:13.886 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_created_connections": 2, 2024-09-21T01:52:13.886 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_active_connections": 1, 2024-09-21T01:52:13.886 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_total_time": 0.042471087, 2024-09-21T01:52:13.886 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_send_time": 0.020213045, 2024-09-21T01:52:13.886 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_recv_time": 0.030230989, 2024-09-21T01:52:13.886 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T01:52:13.887 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:52:13.887 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 211, 2024-09-21T01:52:13.887 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.017396150, 2024-09-21T01:52:13.887 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000082446 2024-09-21T01:52:13.887 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-09-21T01:52:13.887 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:52:13.887 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2024-09-21T01:52:13.887 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2024-09-21T01:52:13.887 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2024-09-21T01:52:13.887 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-09-21T01:52:13.887 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_recv_encrypted_bytes": 838784, 2024-09-21T01:52:13.887 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_send_encrypted_bytes": 128512 2024-09-21T01:52:13.887 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-09-21T01:52:13.887 INFO:teuthology.orchestra.run.smithi142.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T01:52:13.888 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_recv_messages": 1, 2024-09-21T01:52:13.888 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_send_messages": 158, 2024-09-21T01:52:13.888 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_recv_bytes": 160, 2024-09-21T01:52:13.888 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_send_bytes": 107952, 2024-09-21T01:52:13.888 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_created_connections": 3, 2024-09-21T01:52:13.888 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_active_connections": 2, 2024-09-21T01:52:13.888 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_total_time": 0.013606417, 2024-09-21T01:52:13.888 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_send_time": 0.010634693, 2024-09-21T01:52:13.888 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_recv_time": 0.001191346, 2024-09-21T01:52:13.888 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T01:52:13.888 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:52:13.888 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 156, 2024-09-21T01:52:13.888 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.008881734, 2024-09-21T01:52:13.888 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000056934 2024-09-21T01:52:13.888 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-09-21T01:52:13.889 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:52:13.889 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2024-09-21T01:52:13.889 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2024-09-21T01:52:13.889 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2024-09-21T01:52:13.889 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-09-21T01:52:13.889 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-21T01:52:13.889 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_send_encrypted_bytes": 107952 2024-09-21T01:52:13.889 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-09-21T01:52:13.889 INFO:teuthology.orchestra.run.smithi142.stdout: "cct": { 2024-09-21T01:52:13.889 INFO:teuthology.orchestra.run.smithi142.stdout: "total_workers": 0, 2024-09-21T01:52:13.889 INFO:teuthology.orchestra.run.smithi142.stdout: "unhealthy_workers": 0 2024-09-21T01:52:13.889 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-09-21T01:52:13.889 INFO:teuthology.orchestra.run.smithi142.stdout: "mempool": { 2024-09-21T01:52:13.890 INFO:teuthology.orchestra.run.smithi142.stdout: "bloom_filter_bytes": 0, 2024-09-21T01:52:13.890 INFO:teuthology.orchestra.run.smithi142.stdout: "bloom_filter_items": 0, 2024-09-21T01:52:13.890 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T01:52:13.890 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_alloc_items": 0, 2024-09-21T01:52:13.890 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T01:52:13.890 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_cache_data_items": 0, 2024-09-21T01:52:13.890 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T01:52:13.890 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T01:52:13.890 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T01:52:13.890 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T01:52:13.890 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T01:52:13.891 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_cache_other_items": 0, 2024-09-21T01:52:13.891 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T01:52:13.891 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T01:52:13.891 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_extent_bytes": 0, 2024-09-21T01:52:13.891 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_extent_items": 0, 2024-09-21T01:52:13.891 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_blob_bytes": 0, 2024-09-21T01:52:13.891 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_blob_items": 0, 2024-09-21T01:52:13.891 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T01:52:13.891 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T01:52:13.891 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T01:52:13.891 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T01:52:13.891 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T01:52:13.891 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_fsck_items": 0, 2024-09-21T01:52:13.891 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_txc_bytes": 0, 2024-09-21T01:52:13.892 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_txc_items": 0, 2024-09-21T01:52:13.892 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T01:52:13.892 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T01:52:13.892 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_writing_bytes": 0, 2024-09-21T01:52:13.892 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_writing_items": 0, 2024-09-21T01:52:13.892 INFO:teuthology.orchestra.run.smithi142.stdout: "bluefs_bytes": 0, 2024-09-21T01:52:13.892 INFO:teuthology.orchestra.run.smithi142.stdout: "bluefs_items": 0, 2024-09-21T01:52:13.892 INFO:teuthology.orchestra.run.smithi142.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T01:52:13.892 INFO:teuthology.orchestra.run.smithi142.stdout: "bluefs_file_reader_items": 0, 2024-09-21T01:52:13.892 INFO:teuthology.orchestra.run.smithi142.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T01:52:13.892 INFO:teuthology.orchestra.run.smithi142.stdout: "bluefs_file_writer_items": 0, 2024-09-21T01:52:13.892 INFO:teuthology.orchestra.run.smithi142.stdout: "buffer_anon_bytes": 149007, 2024-09-21T01:52:13.892 INFO:teuthology.orchestra.run.smithi142.stdout: "buffer_anon_items": 30, 2024-09-21T01:52:13.892 INFO:teuthology.orchestra.run.smithi142.stdout: "buffer_meta_bytes": 0, 2024-09-21T01:52:13.893 INFO:teuthology.orchestra.run.smithi142.stdout: "buffer_meta_items": 0, 2024-09-21T01:52:13.893 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_bytes": 0, 2024-09-21T01:52:13.893 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_items": 0, 2024-09-21T01:52:13.893 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_mapbl_bytes": 0, 2024-09-21T01:52:13.893 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_mapbl_items": 0, 2024-09-21T01:52:13.893 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_pglog_bytes": 0, 2024-09-21T01:52:13.893 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_pglog_items": 0, 2024-09-21T01:52:13.893 INFO:teuthology.orchestra.run.smithi142.stdout: "osdmap_bytes": 0, 2024-09-21T01:52:13.893 INFO:teuthology.orchestra.run.smithi142.stdout: "osdmap_items": 0, 2024-09-21T01:52:13.893 INFO:teuthology.orchestra.run.smithi142.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T01:52:13.893 INFO:teuthology.orchestra.run.smithi142.stdout: "osdmap_mapping_items": 0, 2024-09-21T01:52:13.893 INFO:teuthology.orchestra.run.smithi142.stdout: "pgmap_bytes": 0, 2024-09-21T01:52:13.893 INFO:teuthology.orchestra.run.smithi142.stdout: "pgmap_items": 0, 2024-09-21T01:52:13.893 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_co_bytes": 968, 2024-09-21T01:52:13.894 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_co_items": 2, 2024-09-21T01:52:13.894 INFO:teuthology.orchestra.run.smithi142.stdout: "unittest_1_bytes": 0, 2024-09-21T01:52:13.894 INFO:teuthology.orchestra.run.smithi142.stdout: "unittest_1_items": 0, 2024-09-21T01:52:13.894 INFO:teuthology.orchestra.run.smithi142.stdout: "unittest_2_bytes": 0, 2024-09-21T01:52:13.894 INFO:teuthology.orchestra.run.smithi142.stdout: "unittest_2_items": 0 2024-09-21T01:52:13.894 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-09-21T01:52:13.894 INFO:teuthology.orchestra.run.smithi142.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T01:52:13.894 INFO:teuthology.orchestra.run.smithi142.stdout: "val": 0, 2024-09-21T01:52:13.894 INFO:teuthology.orchestra.run.smithi142.stdout: "max": 104857600, 2024-09-21T01:52:13.894 INFO:teuthology.orchestra.run.smithi142.stdout: "get_started": 0, 2024-09-21T01:52:13.894 INFO:teuthology.orchestra.run.smithi142.stdout: "get": 215, 2024-09-21T01:52:13.894 INFO:teuthology.orchestra.run.smithi142.stdout: "get_sum": 805618, 2024-09-21T01:52:13.894 INFO:teuthology.orchestra.run.smithi142.stdout: "get_or_fail_fail": 0, 2024-09-21T01:52:13.895 INFO:teuthology.orchestra.run.smithi142.stdout: "get_or_fail_success": 215, 2024-09-21T01:52:13.895 INFO:teuthology.orchestra.run.smithi142.stdout: "take": 0, 2024-09-21T01:52:13.895 INFO:teuthology.orchestra.run.smithi142.stdout: "take_sum": 0, 2024-09-21T01:52:13.895 INFO:teuthology.orchestra.run.smithi142.stdout: "put": 215, 2024-09-21T01:52:13.895 INFO:teuthology.orchestra.run.smithi142.stdout: "put_sum": 805618, 2024-09-21T01:52:13.895 INFO:teuthology.orchestra.run.smithi142.stdout: "wait": { 2024-09-21T01:52:13.895 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2024-09-21T01:52:13.895 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2024-09-21T01:52:13.895 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2024-09-21T01:52:13.895 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-09-21T01:52:13.895 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-09-21T01:52:13.895 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-09-21T01:52:14.769 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.c 2024-09-21T01:52:14.770 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.c 2024-09-21T01:52:14.770 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.c 2024-09-21T01:52:14.770 DEBUG:tasks.check_counter:Getting stats from f 2024-09-21T01:52:14.770 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph daemon mds.f perf dump 2024-09-21T01:52:14.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:52:14 smithi119 ceph-mon[33693]: pgmap v653: 129 pgs: 129 active+clean; 24 MiB data, 439 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 27 KiB/s wr, 19 op/s 2024-09-21T01:52:14.972 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:52:14 smithi142 ceph-mon[34050]: pgmap v653: 129 pgs: 129 active+clean; 24 MiB data, 439 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 27 KiB/s wr, 19 op/s 2024-09-21T01:52:15.022 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T01:52:15.053 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:52:14 smithi083 ceph-mon[31370]: pgmap v653: 129 pgs: 129 active+clean; 24 MiB data, 439 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 27 KiB/s wr, 19 op/s 2024-09-21T01:52:15.541 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-09-21T01:52:15.541 INFO:teuthology.orchestra.run.smithi142.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T01:52:15.542 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_recv_messages": 4, 2024-09-21T01:52:15.542 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_send_messages": 4, 2024-09-21T01:52:15.542 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_recv_bytes": 2912, 2024-09-21T01:52:15.542 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_send_bytes": 448, 2024-09-21T01:52:15.542 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_created_connections": 4, 2024-09-21T01:52:15.542 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_active_connections": 0, 2024-09-21T01:52:15.542 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_total_time": 0.002974983, 2024-09-21T01:52:15.542 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_send_time": 0.000041574, 2024-09-21T01:52:15.542 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_recv_time": 0.002150371, 2024-09-21T01:52:15.542 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T01:52:15.542 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:52:15.542 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 3, 2024-09-21T01:52:15.543 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.003865429, 2024-09-21T01:52:15.543 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.001288476 2024-09-21T01:52:15.543 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-09-21T01:52:15.543 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:52:15.543 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2024-09-21T01:52:15.543 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2024-09-21T01:52:15.543 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2024-09-21T01:52:15.543 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-09-21T01:52:15.543 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_recv_encrypted_bytes": 2912, 2024-09-21T01:52:15.543 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_send_encrypted_bytes": 448 2024-09-21T01:52:15.543 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-09-21T01:52:15.543 INFO:teuthology.orchestra.run.smithi142.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T01:52:15.543 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_recv_messages": 1, 2024-09-21T01:52:15.543 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_send_messages": 159, 2024-09-21T01:52:15.544 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_recv_bytes": 160, 2024-09-21T01:52:15.544 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_send_bytes": 108128, 2024-09-21T01:52:15.544 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_created_connections": 3, 2024-09-21T01:52:15.544 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_active_connections": 2, 2024-09-21T01:52:15.544 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_total_time": 0.014359959, 2024-09-21T01:52:15.544 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_send_time": 0.011102692, 2024-09-21T01:52:15.544 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_recv_time": 0.001207779, 2024-09-21T01:52:15.544 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T01:52:15.544 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:52:15.544 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 157, 2024-09-21T01:52:15.544 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.011881444, 2024-09-21T01:52:15.544 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000075677 2024-09-21T01:52:15.544 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-09-21T01:52:15.544 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:52:15.544 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2024-09-21T01:52:15.545 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2024-09-21T01:52:15.545 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2024-09-21T01:52:15.545 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-09-21T01:52:15.545 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-21T01:52:15.545 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_send_encrypted_bytes": 108128 2024-09-21T01:52:15.545 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-09-21T01:52:15.545 INFO:teuthology.orchestra.run.smithi142.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T01:52:15.545 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_recv_messages": 215, 2024-09-21T01:52:15.545 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_send_messages": 210, 2024-09-21T01:52:15.545 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_recv_bytes": 836144, 2024-09-21T01:52:15.545 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_send_bytes": 128704, 2024-09-21T01:52:15.545 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_created_connections": 2, 2024-09-21T01:52:15.545 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_active_connections": 1, 2024-09-21T01:52:15.545 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_total_time": 0.041201399, 2024-09-21T01:52:15.546 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_send_time": 0.019066099, 2024-09-21T01:52:15.546 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_recv_time": 0.031417700, 2024-09-21T01:52:15.546 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T01:52:15.546 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:52:15.546 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 209, 2024-09-21T01:52:15.546 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.013484124, 2024-09-21T01:52:15.546 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000064517 2024-09-21T01:52:15.546 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-09-21T01:52:15.546 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:52:15.546 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2024-09-21T01:52:15.546 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2024-09-21T01:52:15.546 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2024-09-21T01:52:15.546 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-09-21T01:52:15.546 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_recv_encrypted_bytes": 836144, 2024-09-21T01:52:15.546 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_send_encrypted_bytes": 128704 2024-09-21T01:52:15.547 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-09-21T01:52:15.547 INFO:teuthology.orchestra.run.smithi142.stdout: "cct": { 2024-09-21T01:52:15.547 INFO:teuthology.orchestra.run.smithi142.stdout: "total_workers": 0, 2024-09-21T01:52:15.547 INFO:teuthology.orchestra.run.smithi142.stdout: "unhealthy_workers": 0 2024-09-21T01:52:15.547 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-09-21T01:52:15.547 INFO:teuthology.orchestra.run.smithi142.stdout: "mempool": { 2024-09-21T01:52:15.547 INFO:teuthology.orchestra.run.smithi142.stdout: "bloom_filter_bytes": 0, 2024-09-21T01:52:15.547 INFO:teuthology.orchestra.run.smithi142.stdout: "bloom_filter_items": 0, 2024-09-21T01:52:15.547 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T01:52:15.547 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_alloc_items": 0, 2024-09-21T01:52:15.547 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T01:52:15.547 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_cache_data_items": 0, 2024-09-21T01:52:15.547 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T01:52:15.547 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T01:52:15.548 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T01:52:15.548 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T01:52:15.548 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T01:52:15.548 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_cache_other_items": 0, 2024-09-21T01:52:15.548 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T01:52:15.548 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T01:52:15.548 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_extent_bytes": 0, 2024-09-21T01:52:15.548 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_extent_items": 0, 2024-09-21T01:52:15.548 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_blob_bytes": 0, 2024-09-21T01:52:15.548 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_blob_items": 0, 2024-09-21T01:52:15.548 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T01:52:15.548 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T01:52:15.548 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T01:52:15.548 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T01:52:15.548 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T01:52:15.549 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_fsck_items": 0, 2024-09-21T01:52:15.549 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_txc_bytes": 0, 2024-09-21T01:52:15.549 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_txc_items": 0, 2024-09-21T01:52:15.549 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T01:52:15.549 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T01:52:15.549 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_writing_bytes": 0, 2024-09-21T01:52:15.549 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_writing_items": 0, 2024-09-21T01:52:15.549 INFO:teuthology.orchestra.run.smithi142.stdout: "bluefs_bytes": 0, 2024-09-21T01:52:15.549 INFO:teuthology.orchestra.run.smithi142.stdout: "bluefs_items": 0, 2024-09-21T01:52:15.549 INFO:teuthology.orchestra.run.smithi142.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T01:52:15.549 INFO:teuthology.orchestra.run.smithi142.stdout: "bluefs_file_reader_items": 0, 2024-09-21T01:52:15.549 INFO:teuthology.orchestra.run.smithi142.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T01:52:15.549 INFO:teuthology.orchestra.run.smithi142.stdout: "bluefs_file_writer_items": 0, 2024-09-21T01:52:15.549 INFO:teuthology.orchestra.run.smithi142.stdout: "buffer_anon_bytes": 148967, 2024-09-21T01:52:15.549 INFO:teuthology.orchestra.run.smithi142.stdout: "buffer_anon_items": 29, 2024-09-21T01:52:15.550 INFO:teuthology.orchestra.run.smithi142.stdout: "buffer_meta_bytes": 0, 2024-09-21T01:52:15.550 INFO:teuthology.orchestra.run.smithi142.stdout: "buffer_meta_items": 0, 2024-09-21T01:52:15.550 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_bytes": 0, 2024-09-21T01:52:15.550 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_items": 0, 2024-09-21T01:52:15.550 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_mapbl_bytes": 0, 2024-09-21T01:52:15.550 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_mapbl_items": 0, 2024-09-21T01:52:15.550 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_pglog_bytes": 0, 2024-09-21T01:52:15.550 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_pglog_items": 0, 2024-09-21T01:52:15.550 INFO:teuthology.orchestra.run.smithi142.stdout: "osdmap_bytes": 0, 2024-09-21T01:52:15.550 INFO:teuthology.orchestra.run.smithi142.stdout: "osdmap_items": 0, 2024-09-21T01:52:15.550 INFO:teuthology.orchestra.run.smithi142.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T01:52:15.550 INFO:teuthology.orchestra.run.smithi142.stdout: "osdmap_mapping_items": 0, 2024-09-21T01:52:15.550 INFO:teuthology.orchestra.run.smithi142.stdout: "pgmap_bytes": 0, 2024-09-21T01:52:15.550 INFO:teuthology.orchestra.run.smithi142.stdout: "pgmap_items": 0, 2024-09-21T01:52:15.551 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_co_bytes": 968, 2024-09-21T01:52:15.551 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_co_items": 2, 2024-09-21T01:52:15.551 INFO:teuthology.orchestra.run.smithi142.stdout: "unittest_1_bytes": 0, 2024-09-21T01:52:15.551 INFO:teuthology.orchestra.run.smithi142.stdout: "unittest_1_items": 0, 2024-09-21T01:52:15.551 INFO:teuthology.orchestra.run.smithi142.stdout: "unittest_2_bytes": 0, 2024-09-21T01:52:15.551 INFO:teuthology.orchestra.run.smithi142.stdout: "unittest_2_items": 0 2024-09-21T01:52:15.551 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-09-21T01:52:15.551 INFO:teuthology.orchestra.run.smithi142.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T01:52:15.551 INFO:teuthology.orchestra.run.smithi142.stdout: "val": 0, 2024-09-21T01:52:15.551 INFO:teuthology.orchestra.run.smithi142.stdout: "max": 104857600, 2024-09-21T01:52:15.551 INFO:teuthology.orchestra.run.smithi142.stdout: "get_started": 0, 2024-09-21T01:52:15.551 INFO:teuthology.orchestra.run.smithi142.stdout: "get": 216, 2024-09-21T01:52:15.551 INFO:teuthology.orchestra.run.smithi142.stdout: "get_sum": 805748, 2024-09-21T01:52:15.551 INFO:teuthology.orchestra.run.smithi142.stdout: "get_or_fail_fail": 0, 2024-09-21T01:52:15.551 INFO:teuthology.orchestra.run.smithi142.stdout: "get_or_fail_success": 216, 2024-09-21T01:52:15.552 INFO:teuthology.orchestra.run.smithi142.stdout: "take": 0, 2024-09-21T01:52:15.552 INFO:teuthology.orchestra.run.smithi142.stdout: "take_sum": 0, 2024-09-21T01:52:15.552 INFO:teuthology.orchestra.run.smithi142.stdout: "put": 216, 2024-09-21T01:52:15.552 INFO:teuthology.orchestra.run.smithi142.stdout: "put_sum": 805748, 2024-09-21T01:52:15.552 INFO:teuthology.orchestra.run.smithi142.stdout: "wait": { 2024-09-21T01:52:15.552 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2024-09-21T01:52:15.552 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2024-09-21T01:52:15.552 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2024-09-21T01:52:15.552 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-09-21T01:52:15.552 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-09-21T01:52:15.552 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-09-21T01:52:16.178 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.f 2024-09-21T01:52:16.178 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.f 2024-09-21T01:52:16.178 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.f 2024-09-21T01:52:16.179 DEBUG:tasks.check_counter:Getting stats from i 2024-09-21T01:52:16.179 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph daemon mds.i perf dump 2024-09-21T01:52:16.428 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T01:52:16.886 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:52:16 smithi142 ceph-mon[34050]: pgmap v654: 129 pgs: 129 active+clean; 21 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-21T01:52:17.008 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-09-21T01:52:17.008 INFO:teuthology.orchestra.run.smithi142.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T01:52:17.008 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_recv_messages": 320, 2024-09-21T01:52:17.008 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_send_messages": 322, 2024-09-21T01:52:17.008 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_recv_bytes": 78777, 2024-09-21T01:52:17.008 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_send_bytes": 101766, 2024-09-21T01:52:17.008 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_created_connections": 7, 2024-09-21T01:52:17.008 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_active_connections": 3, 2024-09-21T01:52:17.008 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_total_time": 0.043220730, 2024-09-21T01:52:17.009 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_send_time": 0.015307195, 2024-09-21T01:52:17.009 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_recv_time": 0.009500482, 2024-09-21T01:52:17.009 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_fast_dispatch_time": 0.014270840, 2024-09-21T01:52:17.009 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:52:17.009 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 320, 2024-09-21T01:52:17.009 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.016047463, 2024-09-21T01:52:17.009 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000050148 2024-09-21T01:52:17.009 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-09-21T01:52:17.009 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:52:17.009 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2024-09-21T01:52:17.009 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2024-09-21T01:52:17.009 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2024-09-21T01:52:17.009 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-09-21T01:52:17.009 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T01:52:17.010 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T01:52:17.010 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-09-21T01:52:17.010 INFO:teuthology.orchestra.run.smithi142.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T01:52:17.010 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_recv_messages": 1730, 2024-09-21T01:52:17.010 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_send_messages": 1724, 2024-09-21T01:52:17.010 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_recv_bytes": 13870738, 2024-09-21T01:52:17.010 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_send_bytes": 607253, 2024-09-21T01:52:17.010 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_created_connections": 4, 2024-09-21T01:52:17.010 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_active_connections": 3, 2024-09-21T01:52:17.010 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_total_time": 0.239162383, 2024-09-21T01:52:17.010 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_send_time": 0.099238387, 2024-09-21T01:52:17.010 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_recv_time": 0.079315446, 2024-09-21T01:52:17.010 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_fast_dispatch_time": 0.055226370, 2024-09-21T01:52:17.011 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:52:17.011 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 1723, 2024-09-21T01:52:17.011 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.079700479, 2024-09-21T01:52:17.011 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000046256 2024-09-21T01:52:17.011 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-09-21T01:52:17.011 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:52:17.011 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2024-09-21T01:52:17.011 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2024-09-21T01:52:17.011 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2024-09-21T01:52:17.011 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-09-21T01:52:17.011 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_recv_encrypted_bytes": 858752, 2024-09-21T01:52:17.011 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_send_encrypted_bytes": 130192 2024-09-21T01:52:17.011 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-09-21T01:52:17.011 INFO:teuthology.orchestra.run.smithi142.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T01:52:17.012 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_recv_messages": 413, 2024-09-21T01:52:17.012 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_send_messages": 568, 2024-09-21T01:52:17.012 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_recv_bytes": 8493137, 2024-09-21T01:52:17.012 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_send_bytes": 483450, 2024-09-21T01:52:17.012 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_created_connections": 5, 2024-09-21T01:52:17.012 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_active_connections": 4, 2024-09-21T01:52:17.012 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_total_time": 0.066179553, 2024-09-21T01:52:17.012 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_send_time": 0.031209196, 2024-09-21T01:52:17.012 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_recv_time": 0.016193434, 2024-09-21T01:52:17.012 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_fast_dispatch_time": 0.013700050, 2024-09-21T01:52:17.012 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:52:17.012 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 567, 2024-09-21T01:52:17.012 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.030310578, 2024-09-21T01:52:17.012 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000053457 2024-09-21T01:52:17.012 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-09-21T01:52:17.013 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:52:17.013 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2024-09-21T01:52:17.013 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2024-09-21T01:52:17.013 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2024-09-21T01:52:17.013 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-09-21T01:52:17.013 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_recv_encrypted_bytes": 3072, 2024-09-21T01:52:17.013 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_send_encrypted_bytes": 353696 2024-09-21T01:52:17.013 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-09-21T01:52:17.013 INFO:teuthology.orchestra.run.smithi142.stdout: "cct": { 2024-09-21T01:52:17.013 INFO:teuthology.orchestra.run.smithi142.stdout: "total_workers": 1, 2024-09-21T01:52:17.013 INFO:teuthology.orchestra.run.smithi142.stdout: "unhealthy_workers": 0 2024-09-21T01:52:17.013 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-09-21T01:52:17.014 INFO:teuthology.orchestra.run.smithi142.stdout: "finisher-MDSRank": { 2024-09-21T01:52:17.014 INFO:teuthology.orchestra.run.smithi142.stdout: "queue_len": 0, 2024-09-21T01:52:17.014 INFO:teuthology.orchestra.run.smithi142.stdout: "complete_latency": { 2024-09-21T01:52:17.014 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 3653, 2024-09-21T01:52:17.014 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.121029795, 2024-09-21T01:52:17.014 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000033131 2024-09-21T01:52:17.014 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-09-21T01:52:17.014 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-09-21T01:52:17.014 INFO:teuthology.orchestra.run.smithi142.stdout: "finisher-PurgeQueue": { 2024-09-21T01:52:17.014 INFO:teuthology.orchestra.run.smithi142.stdout: "queue_len": 0, 2024-09-21T01:52:17.014 INFO:teuthology.orchestra.run.smithi142.stdout: "complete_latency": { 2024-09-21T01:52:17.014 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2024-09-21T01:52:17.014 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2024-09-21T01:52:17.014 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2024-09-21T01:52:17.015 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-09-21T01:52:17.015 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-09-21T01:52:17.015 INFO:teuthology.orchestra.run.smithi142.stdout: "mds": { 2024-09-21T01:52:17.015 INFO:teuthology.orchestra.run.smithi142.stdout: "request": 0, 2024-09-21T01:52:17.015 INFO:teuthology.orchestra.run.smithi142.stdout: "reply": 0, 2024-09-21T01:52:17.015 INFO:teuthology.orchestra.run.smithi142.stdout: "reply_latency": { 2024-09-21T01:52:17.015 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2024-09-21T01:52:17.015 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2024-09-21T01:52:17.015 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2024-09-21T01:52:17.015 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-09-21T01:52:17.015 INFO:teuthology.orchestra.run.smithi142.stdout: "slow_reply": 0, 2024-09-21T01:52:17.015 INFO:teuthology.orchestra.run.smithi142.stdout: "forward": 0, 2024-09-21T01:52:17.015 INFO:teuthology.orchestra.run.smithi142.stdout: "dir_fetch_complete": 0, 2024-09-21T01:52:17.016 INFO:teuthology.orchestra.run.smithi142.stdout: "dir_fetch_keys": 0, 2024-09-21T01:52:17.016 INFO:teuthology.orchestra.run.smithi142.stdout: "dir_commit": 0, 2024-09-21T01:52:17.016 INFO:teuthology.orchestra.run.smithi142.stdout: "dir_split": 0, 2024-09-21T01:52:17.016 INFO:teuthology.orchestra.run.smithi142.stdout: "dir_merge": 0, 2024-09-21T01:52:17.016 INFO:teuthology.orchestra.run.smithi142.stdout: "inodes": 1242, 2024-09-21T01:52:17.016 INFO:teuthology.orchestra.run.smithi142.stdout: "inodes_top": 0, 2024-09-21T01:52:17.016 INFO:teuthology.orchestra.run.smithi142.stdout: "inodes_bottom": 1242, 2024-09-21T01:52:17.016 INFO:teuthology.orchestra.run.smithi142.stdout: "inodes_pin_tail": 0, 2024-09-21T01:52:17.016 INFO:teuthology.orchestra.run.smithi142.stdout: "inodes_pinned": 1242, 2024-09-21T01:52:17.016 INFO:teuthology.orchestra.run.smithi142.stdout: "inodes_expired": 0, 2024-09-21T01:52:17.016 INFO:teuthology.orchestra.run.smithi142.stdout: "inodes_with_caps": 0, 2024-09-21T01:52:17.016 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": 0, 2024-09-21T01:52:17.016 INFO:teuthology.orchestra.run.smithi142.stdout: "subtrees": 2, 2024-09-21T01:52:17.016 INFO:teuthology.orchestra.run.smithi142.stdout: "traverse": 0, 2024-09-21T01:52:17.017 INFO:teuthology.orchestra.run.smithi142.stdout: "traverse_hit": 0, 2024-09-21T01:52:17.017 INFO:teuthology.orchestra.run.smithi142.stdout: "traverse_forward": 0, 2024-09-21T01:52:17.017 INFO:teuthology.orchestra.run.smithi142.stdout: "traverse_discover": 0, 2024-09-21T01:52:17.017 INFO:teuthology.orchestra.run.smithi142.stdout: "traverse_dir_fetch": 0, 2024-09-21T01:52:17.017 INFO:teuthology.orchestra.run.smithi142.stdout: "traverse_remote_ino": 0, 2024-09-21T01:52:17.017 INFO:teuthology.orchestra.run.smithi142.stdout: "traverse_lock": 0, 2024-09-21T01:52:17.017 INFO:teuthology.orchestra.run.smithi142.stdout: "load_cent": 0, 2024-09-21T01:52:17.017 INFO:teuthology.orchestra.run.smithi142.stdout: "q": 0, 2024-09-21T01:52:17.017 INFO:teuthology.orchestra.run.smithi142.stdout: "exported": 0, 2024-09-21T01:52:17.017 INFO:teuthology.orchestra.run.smithi142.stdout: "exported_inodes": 0, 2024-09-21T01:52:17.017 INFO:teuthology.orchestra.run.smithi142.stdout: "imported": 0, 2024-09-21T01:52:17.017 INFO:teuthology.orchestra.run.smithi142.stdout: "imported_inodes": 0, 2024-09-21T01:52:17.017 INFO:teuthology.orchestra.run.smithi142.stdout: "openino_dir_fetch": 0, 2024-09-21T01:52:17.018 INFO:teuthology.orchestra.run.smithi142.stdout: "openino_backtrace_fetch": 0, 2024-09-21T01:52:17.018 INFO:teuthology.orchestra.run.smithi142.stdout: "openino_peer_discover": 0, 2024-09-21T01:52:17.018 INFO:teuthology.orchestra.run.smithi142.stdout: "root_rfiles": 4, 2024-09-21T01:52:17.018 INFO:teuthology.orchestra.run.smithi142.stdout: "root_rbytes": 234, 2024-09-21T01:52:17.018 INFO:teuthology.orchestra.run.smithi142.stdout: "root_rsnaps": 6, 2024-09-21T01:52:17.018 INFO:teuthology.orchestra.run.smithi142.stdout: "scrub_backtrace_fetch": 0, 2024-09-21T01:52:17.018 INFO:teuthology.orchestra.run.smithi142.stdout: "scrub_set_tag": 0, 2024-09-21T01:52:17.018 INFO:teuthology.orchestra.run.smithi142.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T01:52:17.018 INFO:teuthology.orchestra.run.smithi142.stdout: "scrub_inotable_repaired": 0, 2024-09-21T01:52:17.018 INFO:teuthology.orchestra.run.smithi142.stdout: "scrub_dir_inodes": 0, 2024-09-21T01:52:17.018 INFO:teuthology.orchestra.run.smithi142.stdout: "scrub_dir_base_inodes": 0, 2024-09-21T01:52:17.018 INFO:teuthology.orchestra.run.smithi142.stdout: "scrub_dirfrag_rstats": 0, 2024-09-21T01:52:17.018 INFO:teuthology.orchestra.run.smithi142.stdout: "scrub_file_inodes": 0, 2024-09-21T01:52:17.019 INFO:teuthology.orchestra.run.smithi142.stdout: "handle_inode_file_caps": 0, 2024-09-21T01:52:17.019 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph_cap_op_revoke": 0, 2024-09-21T01:52:17.019 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph_cap_op_grant": 0, 2024-09-21T01:52:17.019 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph_cap_op_trunc": 0, 2024-09-21T01:52:17.019 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T01:52:17.019 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T01:52:17.019 INFO:teuthology.orchestra.run.smithi142.stdout: "handle_client_caps": 0, 2024-09-21T01:52:17.019 INFO:teuthology.orchestra.run.smithi142.stdout: "handle_client_caps_dirty": 0, 2024-09-21T01:52:17.019 INFO:teuthology.orchestra.run.smithi142.stdout: "handle_client_cap_release": 0, 2024-09-21T01:52:17.019 INFO:teuthology.orchestra.run.smithi142.stdout: "process_request_cap_release": 0 2024-09-21T01:52:17.019 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-09-21T01:52:17.019 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_cache": { 2024-09-21T01:52:17.019 INFO:teuthology.orchestra.run.smithi142.stdout: "dir_update": 0, 2024-09-21T01:52:17.020 INFO:teuthology.orchestra.run.smithi142.stdout: "dir_update_receipt": 0, 2024-09-21T01:52:17.020 INFO:teuthology.orchestra.run.smithi142.stdout: "dir_try_discover": 0, 2024-09-21T01:52:17.020 INFO:teuthology.orchestra.run.smithi142.stdout: "dir_send_discover": 0, 2024-09-21T01:52:17.020 INFO:teuthology.orchestra.run.smithi142.stdout: "dir_handle_discover": 0, 2024-09-21T01:52:17.020 INFO:teuthology.orchestra.run.smithi142.stdout: "num_strays": 0, 2024-09-21T01:52:17.020 INFO:teuthology.orchestra.run.smithi142.stdout: "num_strays_delayed": 0, 2024-09-21T01:52:17.020 INFO:teuthology.orchestra.run.smithi142.stdout: "num_strays_enqueuing": 0, 2024-09-21T01:52:17.020 INFO:teuthology.orchestra.run.smithi142.stdout: "strays_created": 0, 2024-09-21T01:52:17.020 INFO:teuthology.orchestra.run.smithi142.stdout: "strays_enqueued": 0, 2024-09-21T01:52:17.020 INFO:teuthology.orchestra.run.smithi142.stdout: "strays_reintegrated": 0, 2024-09-21T01:52:17.020 INFO:teuthology.orchestra.run.smithi142.stdout: "strays_migrated": 0, 2024-09-21T01:52:17.020 INFO:teuthology.orchestra.run.smithi142.stdout: "num_recovering_processing": 0, 2024-09-21T01:52:17.020 INFO:teuthology.orchestra.run.smithi142.stdout: "num_recovering_enqueued": 0, 2024-09-21T01:52:17.020 INFO:teuthology.orchestra.run.smithi142.stdout: "num_recovering_prioritized": 0, 2024-09-21T01:52:17.020 INFO:teuthology.orchestra.run.smithi142.stdout: "recovery_started": 0, 2024-09-21T01:52:17.021 INFO:teuthology.orchestra.run.smithi142.stdout: "recovery_completed": 0, 2024-09-21T01:52:17.021 INFO:teuthology.orchestra.run.smithi142.stdout: "ireq_quiesce_path": 0, 2024-09-21T01:52:17.021 INFO:teuthology.orchestra.run.smithi142.stdout: "ireq_quiesce_inode": 0, 2024-09-21T01:52:17.021 INFO:teuthology.orchestra.run.smithi142.stdout: "ireq_enqueue_scrub": 0, 2024-09-21T01:52:17.021 INFO:teuthology.orchestra.run.smithi142.stdout: "ireq_exportdir": 0, 2024-09-21T01:52:17.021 INFO:teuthology.orchestra.run.smithi142.stdout: "ireq_flush": 0, 2024-09-21T01:52:17.021 INFO:teuthology.orchestra.run.smithi142.stdout: "ireq_fragmentdir": 0, 2024-09-21T01:52:17.021 INFO:teuthology.orchestra.run.smithi142.stdout: "ireq_fragstats": 0, 2024-09-21T01:52:17.021 INFO:teuthology.orchestra.run.smithi142.stdout: "ireq_inodestats": 0, 2024-09-21T01:52:17.021 INFO:teuthology.orchestra.run.smithi142.stdout: "uninline_started": 0, 2024-09-21T01:52:17.021 INFO:teuthology.orchestra.run.smithi142.stdout: "uninline_succeeded": 0, 2024-09-21T01:52:17.021 INFO:teuthology.orchestra.run.smithi142.stdout: "uninline_write_failed": 0 2024-09-21T01:52:17.021 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-09-21T01:52:17.021 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_log": { 2024-09-21T01:52:17.022 INFO:teuthology.orchestra.run.smithi142.stdout: "evlrg": 0, 2024-09-21T01:52:17.022 INFO:teuthology.orchestra.run.smithi142.stdout: "evadd": 0, 2024-09-21T01:52:17.022 INFO:teuthology.orchestra.run.smithi142.stdout: "evex": 0, 2024-09-21T01:52:17.022 INFO:teuthology.orchestra.run.smithi142.stdout: "evtrm": 0, 2024-09-21T01:52:17.022 INFO:teuthology.orchestra.run.smithi142.stdout: "ev": 6437, 2024-09-21T01:52:17.022 INFO:teuthology.orchestra.run.smithi142.stdout: "evexg": 0, 2024-09-21T01:52:17.022 INFO:teuthology.orchestra.run.smithi142.stdout: "evexd": 0, 2024-09-21T01:52:17.022 INFO:teuthology.orchestra.run.smithi142.stdout: "segadd": 0, 2024-09-21T01:52:17.022 INFO:teuthology.orchestra.run.smithi142.stdout: "segex": 0, 2024-09-21T01:52:17.022 INFO:teuthology.orchestra.run.smithi142.stdout: "segtrm": 0, 2024-09-21T01:52:17.022 INFO:teuthology.orchestra.run.smithi142.stdout: "seg": 11, 2024-09-21T01:52:17.022 INFO:teuthology.orchestra.run.smithi142.stdout: "segmjr": 2, 2024-09-21T01:52:17.022 INFO:teuthology.orchestra.run.smithi142.stdout: "segexg": 0, 2024-09-21T01:52:17.023 INFO:teuthology.orchestra.run.smithi142.stdout: "segexd": 0, 2024-09-21T01:52:17.023 INFO:teuthology.orchestra.run.smithi142.stdout: "expos": 4194304, 2024-09-21T01:52:17.023 INFO:teuthology.orchestra.run.smithi142.stdout: "wrpos": 25149924, 2024-09-21T01:52:17.023 INFO:teuthology.orchestra.run.smithi142.stdout: "rdpos": 25149788, 2024-09-21T01:52:17.023 INFO:teuthology.orchestra.run.smithi142.stdout: "jlat": { 2024-09-21T01:52:17.023 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2024-09-21T01:52:17.023 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2024-09-21T01:52:17.023 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2024-09-21T01:52:17.023 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-09-21T01:52:17.023 INFO:teuthology.orchestra.run.smithi142.stdout: "replayed": 6437 2024-09-21T01:52:17.023 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-09-21T01:52:17.023 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_mem": { 2024-09-21T01:52:17.023 INFO:teuthology.orchestra.run.smithi142.stdout: "ino": 28, 2024-09-21T01:52:17.023 INFO:teuthology.orchestra.run.smithi142.stdout: "ino+": 1238, 2024-09-21T01:52:17.024 INFO:teuthology.orchestra.run.smithi142.stdout: "ino-": 1210, 2024-09-21T01:52:17.024 INFO:teuthology.orchestra.run.smithi142.stdout: "dir": 20, 2024-09-21T01:52:17.024 INFO:teuthology.orchestra.run.smithi142.stdout: "dir+": 24, 2024-09-21T01:52:17.024 INFO:teuthology.orchestra.run.smithi142.stdout: "dir-": 4, 2024-09-21T01:52:17.024 INFO:teuthology.orchestra.run.smithi142.stdout: "dn": 1242, 2024-09-21T01:52:17.024 INFO:teuthology.orchestra.run.smithi142.stdout: "dn+": 1247, 2024-09-21T01:52:17.024 INFO:teuthology.orchestra.run.smithi142.stdout: "dn-": 5, 2024-09-21T01:52:17.024 INFO:teuthology.orchestra.run.smithi142.stdout: "cap": 0, 2024-09-21T01:52:17.024 INFO:teuthology.orchestra.run.smithi142.stdout: "cap+": 0, 2024-09-21T01:52:17.024 INFO:teuthology.orchestra.run.smithi142.stdout: "cap-": 0, 2024-09-21T01:52:17.024 INFO:teuthology.orchestra.run.smithi142.stdout: "rss": 118292, 2024-09-21T01:52:17.024 INFO:teuthology.orchestra.run.smithi142.stdout: "heap": 320012288 2024-09-21T01:52:17.024 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-09-21T01:52:17.024 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_server": { 2024-09-21T01:52:17.025 INFO:teuthology.orchestra.run.smithi142.stdout: "dispatch_client_request": 0, 2024-09-21T01:52:17.025 INFO:teuthology.orchestra.run.smithi142.stdout: "dispatch_server_request": 0, 2024-09-21T01:52:17.025 INFO:teuthology.orchestra.run.smithi142.stdout: "handle_client_request": 0, 2024-09-21T01:52:17.025 INFO:teuthology.orchestra.run.smithi142.stdout: "handle_client_session": 0, 2024-09-21T01:52:17.025 INFO:teuthology.orchestra.run.smithi142.stdout: "handle_peer_request": 0, 2024-09-21T01:52:17.025 INFO:teuthology.orchestra.run.smithi142.stdout: "req_create_latency": { 2024-09-21T01:52:17.025 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2024-09-21T01:52:17.025 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2024-09-21T01:52:17.025 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2024-09-21T01:52:17.025 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-09-21T01:52:17.025 INFO:teuthology.orchestra.run.smithi142.stdout: "req_getattr_latency": { 2024-09-21T01:52:17.025 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2024-09-21T01:52:17.025 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2024-09-21T01:52:17.025 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2024-09-21T01:52:17.026 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-09-21T01:52:17.026 INFO:teuthology.orchestra.run.smithi142.stdout: "req_getfilelock_latency": { 2024-09-21T01:52:17.026 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2024-09-21T01:52:17.026 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2024-09-21T01:52:17.026 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2024-09-21T01:52:17.026 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-09-21T01:52:17.026 INFO:teuthology.orchestra.run.smithi142.stdout: "req_link_latency": { 2024-09-21T01:52:17.026 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2024-09-21T01:52:17.026 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2024-09-21T01:52:17.026 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2024-09-21T01:52:17.026 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-09-21T01:52:17.026 INFO:teuthology.orchestra.run.smithi142.stdout: "req_lookup_latency": { 2024-09-21T01:52:17.026 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2024-09-21T01:52:17.026 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2024-09-21T01:52:17.027 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2024-09-21T01:52:17.027 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-09-21T01:52:17.027 INFO:teuthology.orchestra.run.smithi142.stdout: "req_lookuphash_latency": { 2024-09-21T01:52:17.027 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2024-09-21T01:52:17.027 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2024-09-21T01:52:17.027 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2024-09-21T01:52:17.027 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-09-21T01:52:17.027 INFO:teuthology.orchestra.run.smithi142.stdout: "req_lookupino_latency": { 2024-09-21T01:52:17.027 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2024-09-21T01:52:17.027 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2024-09-21T01:52:17.027 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2024-09-21T01:52:17.027 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-09-21T01:52:17.027 INFO:teuthology.orchestra.run.smithi142.stdout: "req_lookupname_latency": { 2024-09-21T01:52:17.027 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2024-09-21T01:52:17.027 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2024-09-21T01:52:17.028 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2024-09-21T01:52:17.028 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-09-21T01:52:17.028 INFO:teuthology.orchestra.run.smithi142.stdout: "req_lookupparent_latency": { 2024-09-21T01:52:17.028 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2024-09-21T01:52:17.028 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2024-09-21T01:52:17.028 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2024-09-21T01:52:17.028 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-09-21T01:52:17.028 INFO:teuthology.orchestra.run.smithi142.stdout: "req_lookupsnap_latency": { 2024-09-21T01:52:17.028 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2024-09-21T01:52:17.028 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2024-09-21T01:52:17.028 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2024-09-21T01:52:17.028 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-09-21T01:52:17.028 INFO:teuthology.orchestra.run.smithi142.stdout: "req_lssnap_latency": { 2024-09-21T01:52:17.028 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2024-09-21T01:52:17.029 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2024-09-21T01:52:17.029 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2024-09-21T01:52:17.029 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-09-21T01:52:17.029 INFO:teuthology.orchestra.run.smithi142.stdout: "req_mkdir_latency": { 2024-09-21T01:52:17.029 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2024-09-21T01:52:17.029 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2024-09-21T01:52:17.029 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2024-09-21T01:52:17.029 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-09-21T01:52:17.030 INFO:teuthology.orchestra.run.smithi142.stdout: "req_mknod_latency": { 2024-09-21T01:52:17.030 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2024-09-21T01:52:17.030 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2024-09-21T01:52:17.030 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2024-09-21T01:52:17.030 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-09-21T01:52:17.030 INFO:teuthology.orchestra.run.smithi142.stdout: "req_mksnap_latency": { 2024-09-21T01:52:17.030 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2024-09-21T01:52:17.030 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2024-09-21T01:52:17.030 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2024-09-21T01:52:17.030 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-09-21T01:52:17.030 INFO:teuthology.orchestra.run.smithi142.stdout: "req_open_latency": { 2024-09-21T01:52:17.030 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2024-09-21T01:52:17.030 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2024-09-21T01:52:17.030 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2024-09-21T01:52:17.031 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-09-21T01:52:17.031 INFO:teuthology.orchestra.run.smithi142.stdout: "req_readdir_latency": { 2024-09-21T01:52:17.031 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2024-09-21T01:52:17.031 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2024-09-21T01:52:17.031 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2024-09-21T01:52:17.031 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-09-21T01:52:17.031 INFO:teuthology.orchestra.run.smithi142.stdout: "req_rename_latency": { 2024-09-21T01:52:17.031 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2024-09-21T01:52:17.031 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2024-09-21T01:52:17.031 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2024-09-21T01:52:17.031 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-09-21T01:52:17.031 INFO:teuthology.orchestra.run.smithi142.stdout: "req_renamesnap_latency": { 2024-09-21T01:52:17.031 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2024-09-21T01:52:17.031 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2024-09-21T01:52:17.031 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2024-09-21T01:52:17.032 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-09-21T01:52:17.032 INFO:teuthology.orchestra.run.smithi142.stdout: "req_snapdiff_latency": { 2024-09-21T01:52:17.032 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2024-09-21T01:52:17.032 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2024-09-21T01:52:17.032 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2024-09-21T01:52:17.032 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-09-21T01:52:17.032 INFO:teuthology.orchestra.run.smithi142.stdout: "req_rmdir_latency": { 2024-09-21T01:52:17.032 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2024-09-21T01:52:17.032 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2024-09-21T01:52:17.032 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2024-09-21T01:52:17.032 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-09-21T01:52:17.032 INFO:teuthology.orchestra.run.smithi142.stdout: "req_rmsnap_latency": { 2024-09-21T01:52:17.032 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2024-09-21T01:52:17.032 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2024-09-21T01:52:17.033 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2024-09-21T01:52:17.033 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-09-21T01:52:17.033 INFO:teuthology.orchestra.run.smithi142.stdout: "req_rmxattr_latency": { 2024-09-21T01:52:17.033 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2024-09-21T01:52:17.033 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2024-09-21T01:52:17.033 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2024-09-21T01:52:17.033 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-09-21T01:52:17.033 INFO:teuthology.orchestra.run.smithi142.stdout: "req_setattr_latency": { 2024-09-21T01:52:17.033 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2024-09-21T01:52:17.033 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2024-09-21T01:52:17.033 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2024-09-21T01:52:17.033 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-09-21T01:52:17.033 INFO:teuthology.orchestra.run.smithi142.stdout: "req_setdirlayout_latency": { 2024-09-21T01:52:17.033 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2024-09-21T01:52:17.034 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2024-09-21T01:52:17.034 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2024-09-21T01:52:17.034 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-09-21T01:52:17.034 INFO:teuthology.orchestra.run.smithi142.stdout: "req_setfilelock_latency": { 2024-09-21T01:52:17.034 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2024-09-21T01:52:17.034 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2024-09-21T01:52:17.034 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2024-09-21T01:52:17.034 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-09-21T01:52:17.034 INFO:teuthology.orchestra.run.smithi142.stdout: "req_setlayout_latency": { 2024-09-21T01:52:17.034 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2024-09-21T01:52:17.034 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2024-09-21T01:52:17.034 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2024-09-21T01:52:17.034 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-09-21T01:52:17.034 INFO:teuthology.orchestra.run.smithi142.stdout: "req_setxattr_latency": { 2024-09-21T01:52:17.035 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2024-09-21T01:52:17.035 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2024-09-21T01:52:17.035 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2024-09-21T01:52:17.035 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-09-21T01:52:17.035 INFO:teuthology.orchestra.run.smithi142.stdout: "req_symlink_latency": { 2024-09-21T01:52:17.035 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2024-09-21T01:52:17.035 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2024-09-21T01:52:17.035 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2024-09-21T01:52:17.035 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-09-21T01:52:17.035 INFO:teuthology.orchestra.run.smithi142.stdout: "req_unlink_latency": { 2024-09-21T01:52:17.035 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2024-09-21T01:52:17.035 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2024-09-21T01:52:17.035 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2024-09-21T01:52:17.035 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-09-21T01:52:17.036 INFO:teuthology.orchestra.run.smithi142.stdout: "cap_revoke_eviction": 0, 2024-09-21T01:52:17.036 INFO:teuthology.orchestra.run.smithi142.stdout: "cap_acquisition_throttle": 0, 2024-09-21T01:52:17.036 INFO:teuthology.orchestra.run.smithi142.stdout: "req_getvxattr_latency": { 2024-09-21T01:52:17.036 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2024-09-21T01:52:17.036 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2024-09-21T01:52:17.036 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2024-09-21T01:52:17.036 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-09-21T01:52:17.036 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-09-21T01:52:17.036 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_sessions": { 2024-09-21T01:52:17.036 INFO:teuthology.orchestra.run.smithi142.stdout: "session_count": 2, 2024-09-21T01:52:17.036 INFO:teuthology.orchestra.run.smithi142.stdout: "session_add": 4, 2024-09-21T01:52:17.036 INFO:teuthology.orchestra.run.smithi142.stdout: "session_remove": 2, 2024-09-21T01:52:17.036 INFO:teuthology.orchestra.run.smithi142.stdout: "sessions_open": 2, 2024-09-21T01:52:17.036 INFO:teuthology.orchestra.run.smithi142.stdout: "sessions_stale": 0, 2024-09-21T01:52:17.036 INFO:teuthology.orchestra.run.smithi142.stdout: "total_load": 0, 2024-09-21T01:52:17.037 INFO:teuthology.orchestra.run.smithi142.stdout: "average_load": 0, 2024-09-21T01:52:17.037 INFO:teuthology.orchestra.run.smithi142.stdout: "avg_session_uptime": 1727, 2024-09-21T01:52:17.037 INFO:teuthology.orchestra.run.smithi142.stdout: "mdthresh_evicted": 0 2024-09-21T01:52:17.037 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-09-21T01:52:17.037 INFO:teuthology.orchestra.run.smithi142.stdout: "mempool": { 2024-09-21T01:52:17.037 INFO:teuthology.orchestra.run.smithi142.stdout: "bloom_filter_bytes": 0, 2024-09-21T01:52:17.037 INFO:teuthology.orchestra.run.smithi142.stdout: "bloom_filter_items": 0, 2024-09-21T01:52:17.037 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T01:52:17.037 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_alloc_items": 0, 2024-09-21T01:52:17.037 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T01:52:17.037 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_cache_data_items": 0, 2024-09-21T01:52:17.037 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T01:52:17.037 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T01:52:17.037 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T01:52:17.038 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T01:52:17.038 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T01:52:17.038 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_cache_other_items": 0, 2024-09-21T01:52:17.038 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T01:52:17.038 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T01:52:17.038 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_extent_bytes": 0, 2024-09-21T01:52:17.038 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_extent_items": 0, 2024-09-21T01:52:17.038 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_blob_bytes": 0, 2024-09-21T01:52:17.038 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_blob_items": 0, 2024-09-21T01:52:17.038 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T01:52:17.038 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T01:52:17.038 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T01:52:17.038 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T01:52:17.038 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T01:52:17.039 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_fsck_items": 0, 2024-09-21T01:52:17.039 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_txc_bytes": 0, 2024-09-21T01:52:17.039 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_txc_items": 0, 2024-09-21T01:52:17.039 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T01:52:17.039 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T01:52:17.039 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_writing_bytes": 0, 2024-09-21T01:52:17.039 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_writing_items": 0, 2024-09-21T01:52:17.039 INFO:teuthology.orchestra.run.smithi142.stdout: "bluefs_bytes": 0, 2024-09-21T01:52:17.039 INFO:teuthology.orchestra.run.smithi142.stdout: "bluefs_items": 0, 2024-09-21T01:52:17.039 INFO:teuthology.orchestra.run.smithi142.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T01:52:17.039 INFO:teuthology.orchestra.run.smithi142.stdout: "bluefs_file_reader_items": 0, 2024-09-21T01:52:17.039 INFO:teuthology.orchestra.run.smithi142.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T01:52:17.039 INFO:teuthology.orchestra.run.smithi142.stdout: "bluefs_file_writer_items": 0, 2024-09-21T01:52:17.039 INFO:teuthology.orchestra.run.smithi142.stdout: "buffer_anon_bytes": 206367, 2024-09-21T01:52:17.039 INFO:teuthology.orchestra.run.smithi142.stdout: "buffer_anon_items": 61, 2024-09-21T01:52:17.040 INFO:teuthology.orchestra.run.smithi142.stdout: "buffer_meta_bytes": 0, 2024-09-21T01:52:17.040 INFO:teuthology.orchestra.run.smithi142.stdout: "buffer_meta_items": 0, 2024-09-21T01:52:17.040 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_bytes": 0, 2024-09-21T01:52:17.040 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_items": 0, 2024-09-21T01:52:17.040 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_mapbl_bytes": 0, 2024-09-21T01:52:17.040 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_mapbl_items": 0, 2024-09-21T01:52:17.040 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_pglog_bytes": 0, 2024-09-21T01:52:17.040 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_pglog_items": 0, 2024-09-21T01:52:17.040 INFO:teuthology.orchestra.run.smithi142.stdout: "osdmap_bytes": 9600, 2024-09-21T01:52:17.040 INFO:teuthology.orchestra.run.smithi142.stdout: "osdmap_items": 196, 2024-09-21T01:52:17.040 INFO:teuthology.orchestra.run.smithi142.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T01:52:17.040 INFO:teuthology.orchestra.run.smithi142.stdout: "osdmap_mapping_items": 0, 2024-09-21T01:52:17.040 INFO:teuthology.orchestra.run.smithi142.stdout: "pgmap_bytes": 0, 2024-09-21T01:52:17.040 INFO:teuthology.orchestra.run.smithi142.stdout: "pgmap_items": 0, 2024-09-21T01:52:17.041 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_co_bytes": 970200, 2024-09-21T01:52:17.041 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_co_items": 5688, 2024-09-21T01:52:17.041 INFO:teuthology.orchestra.run.smithi142.stdout: "unittest_1_bytes": 0, 2024-09-21T01:52:17.041 INFO:teuthology.orchestra.run.smithi142.stdout: "unittest_1_items": 0, 2024-09-21T01:52:17.041 INFO:teuthology.orchestra.run.smithi142.stdout: "unittest_2_bytes": 0, 2024-09-21T01:52:17.041 INFO:teuthology.orchestra.run.smithi142.stdout: "unittest_2_items": 0 2024-09-21T01:52:17.041 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-09-21T01:52:17.041 INFO:teuthology.orchestra.run.smithi142.stdout: "objecter": { 2024-09-21T01:52:17.041 INFO:teuthology.orchestra.run.smithi142.stdout: "op_active": 0, 2024-09-21T01:52:17.041 INFO:teuthology.orchestra.run.smithi142.stdout: "op_laggy": 0, 2024-09-21T01:52:17.041 INFO:teuthology.orchestra.run.smithi142.stdout: "op_send": 2228, 2024-09-21T01:52:17.041 INFO:teuthology.orchestra.run.smithi142.stdout: "op_send_bytes": 26, 2024-09-21T01:52:17.041 INFO:teuthology.orchestra.run.smithi142.stdout: "op_resend": 4, 2024-09-21T01:52:17.041 INFO:teuthology.orchestra.run.smithi142.stdout: "op_reply": 2228, 2024-09-21T01:52:17.041 INFO:teuthology.orchestra.run.smithi142.stdout: "op_latency": { 2024-09-21T01:52:17.041 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 2228, 2024-09-21T01:52:17.042 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 1.237975557, 2024-09-21T01:52:17.042 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000555644 2024-09-21T01:52:17.042 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-09-21T01:52:17.042 INFO:teuthology.orchestra.run.smithi142.stdout: "op_inflight": 0, 2024-09-21T01:52:17.042 INFO:teuthology.orchestra.run.smithi142.stdout: "oplen_avg": { 2024-09-21T01:52:17.042 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 2228, 2024-09-21T01:52:17.042 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 2229 2024-09-21T01:52:17.042 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-09-21T01:52:17.042 INFO:teuthology.orchestra.run.smithi142.stdout: "op": 2228, 2024-09-21T01:52:17.042 INFO:teuthology.orchestra.run.smithi142.stdout: "op_r": 2228, 2024-09-21T01:52:17.042 INFO:teuthology.orchestra.run.smithi142.stdout: "op_w": 0, 2024-09-21T01:52:17.042 INFO:teuthology.orchestra.run.smithi142.stdout: "op_rmw": 0, 2024-09-21T01:52:17.042 INFO:teuthology.orchestra.run.smithi142.stdout: "op_pg": 0, 2024-09-21T01:52:17.042 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_stat": 1428, 2024-09-21T01:52:17.043 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_create": 0, 2024-09-21T01:52:17.043 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_read": 797, 2024-09-21T01:52:17.043 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_write": 0, 2024-09-21T01:52:17.043 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_writefull": 0, 2024-09-21T01:52:17.043 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_writesame": 0, 2024-09-21T01:52:17.043 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_append": 0, 2024-09-21T01:52:17.043 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_zero": 0, 2024-09-21T01:52:17.043 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_truncate": 0, 2024-09-21T01:52:17.043 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_delete": 0, 2024-09-21T01:52:17.043 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_mapext": 0, 2024-09-21T01:52:17.043 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_sparse_read": 0, 2024-09-21T01:52:17.043 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_clonerange": 0, 2024-09-21T01:52:17.043 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_getxattr": 2, 2024-09-21T01:52:17.043 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_setxattr": 0, 2024-09-21T01:52:17.044 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_cmpxattr": 0, 2024-09-21T01:52:17.044 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_rmxattr": 0, 2024-09-21T01:52:17.044 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_resetxattrs": 0, 2024-09-21T01:52:17.044 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_call": 0, 2024-09-21T01:52:17.044 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_watch": 0, 2024-09-21T01:52:17.044 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_notify": 0, 2024-09-21T01:52:17.044 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T01:52:17.044 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_pgls": 0, 2024-09-21T01:52:17.044 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_pgls_filter": 0, 2024-09-21T01:52:17.044 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_other": 0, 2024-09-21T01:52:17.044 INFO:teuthology.orchestra.run.smithi142.stdout: "linger_active": 0, 2024-09-21T01:52:17.044 INFO:teuthology.orchestra.run.smithi142.stdout: "linger_send": 0, 2024-09-21T01:52:17.044 INFO:teuthology.orchestra.run.smithi142.stdout: "linger_resend": 0, 2024-09-21T01:52:17.044 INFO:teuthology.orchestra.run.smithi142.stdout: "linger_ping": 0, 2024-09-21T01:52:17.044 INFO:teuthology.orchestra.run.smithi142.stdout: "poolop_active": 0, 2024-09-21T01:52:17.045 INFO:teuthology.orchestra.run.smithi142.stdout: "poolop_send": 0, 2024-09-21T01:52:17.045 INFO:teuthology.orchestra.run.smithi142.stdout: "poolop_resend": 0, 2024-09-21T01:52:17.045 INFO:teuthology.orchestra.run.smithi142.stdout: "poolstat_active": 0, 2024-09-21T01:52:17.045 INFO:teuthology.orchestra.run.smithi142.stdout: "poolstat_send": 0, 2024-09-21T01:52:17.045 INFO:teuthology.orchestra.run.smithi142.stdout: "poolstat_resend": 0, 2024-09-21T01:52:17.045 INFO:teuthology.orchestra.run.smithi142.stdout: "statfs_active": 0, 2024-09-21T01:52:17.045 INFO:teuthology.orchestra.run.smithi142.stdout: "statfs_send": 0, 2024-09-21T01:52:17.045 INFO:teuthology.orchestra.run.smithi142.stdout: "statfs_resend": 0, 2024-09-21T01:52:17.045 INFO:teuthology.orchestra.run.smithi142.stdout: "command_active": 0, 2024-09-21T01:52:17.045 INFO:teuthology.orchestra.run.smithi142.stdout: "command_send": 0, 2024-09-21T01:52:17.045 INFO:teuthology.orchestra.run.smithi142.stdout: "command_resend": 0, 2024-09-21T01:52:17.045 INFO:teuthology.orchestra.run.smithi142.stdout: "map_epoch": 93, 2024-09-21T01:52:17.045 INFO:teuthology.orchestra.run.smithi142.stdout: "map_full": 0, 2024-09-21T01:52:17.045 INFO:teuthology.orchestra.run.smithi142.stdout: "map_inc": 11, 2024-09-21T01:52:17.045 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_sessions": 7, 2024-09-21T01:52:17.046 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_session_open": 7, 2024-09-21T01:52:17.046 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_session_close": 0, 2024-09-21T01:52:17.046 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_laggy": 0, 2024-09-21T01:52:17.046 INFO:teuthology.orchestra.run.smithi142.stdout: "omap_wr": 0, 2024-09-21T01:52:17.046 INFO:teuthology.orchestra.run.smithi142.stdout: "omap_rd": 2, 2024-09-21T01:52:17.046 INFO:teuthology.orchestra.run.smithi142.stdout: "omap_del": 0 2024-09-21T01:52:17.046 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-09-21T01:52:17.046 INFO:teuthology.orchestra.run.smithi142.stdout: "oft": { 2024-09-21T01:52:17.046 INFO:teuthology.orchestra.run.smithi142.stdout: "omap_total_objs": 0, 2024-09-21T01:52:17.046 INFO:teuthology.orchestra.run.smithi142.stdout: "omap_total_kv_pairs": 0, 2024-09-21T01:52:17.046 INFO:teuthology.orchestra.run.smithi142.stdout: "omap_total_updates": 0, 2024-09-21T01:52:17.046 INFO:teuthology.orchestra.run.smithi142.stdout: "omap_total_removes": 0 2024-09-21T01:52:17.046 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-09-21T01:52:17.046 INFO:teuthology.orchestra.run.smithi142.stdout: "purge_queue": { 2024-09-21T01:52:17.047 INFO:teuthology.orchestra.run.smithi142.stdout: "pq_executing_ops": 0, 2024-09-21T01:52:17.047 INFO:teuthology.orchestra.run.smithi142.stdout: "pq_executing_ops_high_water": 0, 2024-09-21T01:52:17.047 INFO:teuthology.orchestra.run.smithi142.stdout: "pq_executing": 0, 2024-09-21T01:52:17.047 INFO:teuthology.orchestra.run.smithi142.stdout: "pq_executing_high_water": 0, 2024-09-21T01:52:17.047 INFO:teuthology.orchestra.run.smithi142.stdout: "pq_executed_ops": 0, 2024-09-21T01:52:17.047 INFO:teuthology.orchestra.run.smithi142.stdout: "pq_executed": 0, 2024-09-21T01:52:17.047 INFO:teuthology.orchestra.run.smithi142.stdout: "pq_item_in_journal": 0 2024-09-21T01:52:17.047 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-09-21T01:52:17.047 INFO:teuthology.orchestra.run.smithi142.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T01:52:17.047 INFO:teuthology.orchestra.run.smithi142.stdout: "val": 0, 2024-09-21T01:52:17.047 INFO:teuthology.orchestra.run.smithi142.stdout: "max": 104857600, 2024-09-21T01:52:17.047 INFO:teuthology.orchestra.run.smithi142.stdout: "get_started": 0, 2024-09-21T01:52:17.047 INFO:teuthology.orchestra.run.smithi142.stdout: "get": 2459, 2024-09-21T01:52:17.047 INFO:teuthology.orchestra.run.smithi142.stdout: "get_sum": 22206619, 2024-09-21T01:52:17.048 INFO:teuthology.orchestra.run.smithi142.stdout: "get_or_fail_fail": 0, 2024-09-21T01:52:17.048 INFO:teuthology.orchestra.run.smithi142.stdout: "get_or_fail_success": 2459, 2024-09-21T01:52:17.048 INFO:teuthology.orchestra.run.smithi142.stdout: "take": 0, 2024-09-21T01:52:17.048 INFO:teuthology.orchestra.run.smithi142.stdout: "take_sum": 0, 2024-09-21T01:52:17.048 INFO:teuthology.orchestra.run.smithi142.stdout: "put": 2459, 2024-09-21T01:52:17.048 INFO:teuthology.orchestra.run.smithi142.stdout: "put_sum": 22206619, 2024-09-21T01:52:17.048 INFO:teuthology.orchestra.run.smithi142.stdout: "wait": { 2024-09-21T01:52:17.048 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2024-09-21T01:52:17.048 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2024-09-21T01:52:17.048 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2024-09-21T01:52:17.048 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-09-21T01:52:17.048 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-09-21T01:52:17.048 INFO:teuthology.orchestra.run.smithi142.stdout: "throttle-objecter_bytes": { 2024-09-21T01:52:17.048 INFO:teuthology.orchestra.run.smithi142.stdout: "val": 0, 2024-09-21T01:52:17.048 INFO:teuthology.orchestra.run.smithi142.stdout: "max": 104857600, 2024-09-21T01:52:17.049 INFO:teuthology.orchestra.run.smithi142.stdout: "get_started": 0, 2024-09-21T01:52:17.049 INFO:teuthology.orchestra.run.smithi142.stdout: "get": 0, 2024-09-21T01:52:17.049 INFO:teuthology.orchestra.run.smithi142.stdout: "get_sum": 0, 2024-09-21T01:52:17.049 INFO:teuthology.orchestra.run.smithi142.stdout: "get_or_fail_fail": 0, 2024-09-21T01:52:17.049 INFO:teuthology.orchestra.run.smithi142.stdout: "get_or_fail_success": 0, 2024-09-21T01:52:17.049 INFO:teuthology.orchestra.run.smithi142.stdout: "take": 2228, 2024-09-21T01:52:17.049 INFO:teuthology.orchestra.run.smithi142.stdout: "take_sum": 20955630, 2024-09-21T01:52:17.049 INFO:teuthology.orchestra.run.smithi142.stdout: "put": 2228, 2024-09-21T01:52:17.049 INFO:teuthology.orchestra.run.smithi142.stdout: "put_sum": 20955630, 2024-09-21T01:52:17.049 INFO:teuthology.orchestra.run.smithi142.stdout: "wait": { 2024-09-21T01:52:17.049 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2024-09-21T01:52:17.049 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2024-09-21T01:52:17.049 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2024-09-21T01:52:17.049 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-09-21T01:52:17.050 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-09-21T01:52:17.050 INFO:teuthology.orchestra.run.smithi142.stdout: "throttle-objecter_ops": { 2024-09-21T01:52:17.050 INFO:teuthology.orchestra.run.smithi142.stdout: "val": 0, 2024-09-21T01:52:17.050 INFO:teuthology.orchestra.run.smithi142.stdout: "max": 1024, 2024-09-21T01:52:17.050 INFO:teuthology.orchestra.run.smithi142.stdout: "get_started": 0, 2024-09-21T01:52:17.050 INFO:teuthology.orchestra.run.smithi142.stdout: "get": 0, 2024-09-21T01:52:17.050 INFO:teuthology.orchestra.run.smithi142.stdout: "get_sum": 0, 2024-09-21T01:52:17.050 INFO:teuthology.orchestra.run.smithi142.stdout: "get_or_fail_fail": 0, 2024-09-21T01:52:17.050 INFO:teuthology.orchestra.run.smithi142.stdout: "get_or_fail_success": 0, 2024-09-21T01:52:17.050 INFO:teuthology.orchestra.run.smithi142.stdout: "take": 2228, 2024-09-21T01:52:17.050 INFO:teuthology.orchestra.run.smithi142.stdout: "take_sum": 2228, 2024-09-21T01:52:17.050 INFO:teuthology.orchestra.run.smithi142.stdout: "put": 2228, 2024-09-21T01:52:17.050 INFO:teuthology.orchestra.run.smithi142.stdout: "put_sum": 2228, 2024-09-21T01:52:17.050 INFO:teuthology.orchestra.run.smithi142.stdout: "wait": { 2024-09-21T01:52:17.051 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2024-09-21T01:52:17.051 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2024-09-21T01:52:17.051 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2024-09-21T01:52:17.051 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-09-21T01:52:17.051 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-09-21T01:52:17.051 INFO:teuthology.orchestra.run.smithi142.stdout: "throttle-write_buf_throttle": { 2024-09-21T01:52:17.051 INFO:teuthology.orchestra.run.smithi142.stdout: "val": 0, 2024-09-21T01:52:17.051 INFO:teuthology.orchestra.run.smithi142.stdout: "max": 3758096384, 2024-09-21T01:52:17.051 INFO:teuthology.orchestra.run.smithi142.stdout: "get_started": 0, 2024-09-21T01:52:17.051 INFO:teuthology.orchestra.run.smithi142.stdout: "get": 0, 2024-09-21T01:52:17.051 INFO:teuthology.orchestra.run.smithi142.stdout: "get_sum": 0, 2024-09-21T01:52:17.051 INFO:teuthology.orchestra.run.smithi142.stdout: "get_or_fail_fail": 0, 2024-09-21T01:52:17.051 INFO:teuthology.orchestra.run.smithi142.stdout: "get_or_fail_success": 0, 2024-09-21T01:52:17.052 INFO:teuthology.orchestra.run.smithi142.stdout: "take": 0, 2024-09-21T01:52:17.052 INFO:teuthology.orchestra.run.smithi142.stdout: "take_sum": 0, 2024-09-21T01:52:17.052 INFO:teuthology.orchestra.run.smithi142.stdout: "put": 0, 2024-09-21T01:52:17.052 INFO:teuthology.orchestra.run.smithi142.stdout: "put_sum": 0, 2024-09-21T01:52:17.052 INFO:teuthology.orchestra.run.smithi142.stdout: "wait": { 2024-09-21T01:52:17.052 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2024-09-21T01:52:17.052 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2024-09-21T01:52:17.052 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2024-09-21T01:52:17.052 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-09-21T01:52:17.052 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-09-21T01:52:17.052 INFO:teuthology.orchestra.run.smithi142.stdout: "throttle-write_buf_throttle-0x55f8b8dc72b0": { 2024-09-21T01:52:17.052 INFO:teuthology.orchestra.run.smithi142.stdout: "val": 0, 2024-09-21T01:52:17.052 INFO:teuthology.orchestra.run.smithi142.stdout: "max": 3758096384, 2024-09-21T01:52:17.052 INFO:teuthology.orchestra.run.smithi142.stdout: "get_started": 0, 2024-09-21T01:52:17.052 INFO:teuthology.orchestra.run.smithi142.stdout: "get": 0, 2024-09-21T01:52:17.053 INFO:teuthology.orchestra.run.smithi142.stdout: "get_sum": 0, 2024-09-21T01:52:17.053 INFO:teuthology.orchestra.run.smithi142.stdout: "get_or_fail_fail": 0, 2024-09-21T01:52:17.053 INFO:teuthology.orchestra.run.smithi142.stdout: "get_or_fail_success": 0, 2024-09-21T01:52:17.053 INFO:teuthology.orchestra.run.smithi142.stdout: "take": 0, 2024-09-21T01:52:17.053 INFO:teuthology.orchestra.run.smithi142.stdout: "take_sum": 0, 2024-09-21T01:52:17.053 INFO:teuthology.orchestra.run.smithi142.stdout: "put": 0, 2024-09-21T01:52:17.053 INFO:teuthology.orchestra.run.smithi142.stdout: "put_sum": 0, 2024-09-21T01:52:17.053 INFO:teuthology.orchestra.run.smithi142.stdout: "wait": { 2024-09-21T01:52:17.053 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2024-09-21T01:52:17.053 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2024-09-21T01:52:17.053 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2024-09-21T01:52:17.053 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-09-21T01:52:17.053 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-09-21T01:52:17.053 INFO:teuthology.orchestra.run.smithi142.stdout: "trackedop": { 2024-09-21T01:52:17.054 INFO:teuthology.orchestra.run.smithi142.stdout: "slow_ops_count": 0 2024-09-21T01:52:17.054 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-09-21T01:52:17.054 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-09-21T01:52:17.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:52:16 smithi083 ceph-mon[31370]: pgmap v654: 129 pgs: 129 active+clean; 21 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-21T01:52:17.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:52:16 smithi119 ceph-mon[33693]: pgmap v654: 129 pgs: 129 active+clean; 21 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-21T01:52:17.813 INFO:tasks.check_counter:Daemon mds.i mds.root_rsnaps=6 2024-09-21T01:52:17.813 INFO:tasks.check_counter:Daemon mds.i mds_server.req_mksnap_latency.avgcount=0 2024-09-21T01:52:17.814 INFO:tasks.check_counter:Daemon mds.i mds_server.req_rmsnap_latency.avgcount=0 2024-09-21T01:52:17.814 DEBUG:tasks.check_counter:Getting stats from l 2024-09-21T01:52:17.814 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph daemon mds.l perf dump 2024-09-21T01:52:18.060 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T01:52:18.616 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-09-21T01:52:18.616 INFO:teuthology.orchestra.run.smithi142.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T01:52:18.616 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_recv_messages": 0, 2024-09-21T01:52:18.616 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_send_messages": 2, 2024-09-21T01:52:18.617 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_recv_bytes": 0, 2024-09-21T01:52:18.617 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_send_bytes": 0, 2024-09-21T01:52:18.617 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_created_connections": 4, 2024-09-21T01:52:18.617 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_active_connections": 0, 2024-09-21T01:52:18.617 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_total_time": 0.000999948, 2024-09-21T01:52:18.617 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_send_time": 0.000000000, 2024-09-21T01:52:18.617 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_recv_time": 0.000193113, 2024-09-21T01:52:18.617 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T01:52:18.617 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:52:18.617 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2024-09-21T01:52:18.617 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2024-09-21T01:52:18.617 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2024-09-21T01:52:18.617 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-09-21T01:52:18.617 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:52:18.618 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2024-09-21T01:52:18.618 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2024-09-21T01:52:18.618 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2024-09-21T01:52:18.618 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-09-21T01:52:18.618 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T01:52:18.618 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T01:52:18.618 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-09-21T01:52:18.618 INFO:teuthology.orchestra.run.smithi142.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T01:52:18.618 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_recv_messages": 1, 2024-09-21T01:52:18.618 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_send_messages": 162, 2024-09-21T01:52:18.618 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_recv_bytes": 160, 2024-09-21T01:52:18.618 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_send_bytes": 108656, 2024-09-21T01:52:18.618 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_created_connections": 3, 2024-09-21T01:52:18.618 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_active_connections": 2, 2024-09-21T01:52:18.619 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_total_time": 0.013700995, 2024-09-21T01:52:18.619 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_send_time": 0.010931094, 2024-09-21T01:52:18.619 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_recv_time": 0.000758056, 2024-09-21T01:52:18.619 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T01:52:18.619 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:52:18.619 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 160, 2024-09-21T01:52:18.619 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.011707449, 2024-09-21T01:52:18.619 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000073171 2024-09-21T01:52:18.619 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-09-21T01:52:18.619 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:52:18.619 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2024-09-21T01:52:18.619 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2024-09-21T01:52:18.619 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2024-09-21T01:52:18.619 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-09-21T01:52:18.620 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-21T01:52:18.620 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_send_encrypted_bytes": 108656 2024-09-21T01:52:18.620 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-09-21T01:52:18.620 INFO:teuthology.orchestra.run.smithi142.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T01:52:18.620 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_recv_messages": 223, 2024-09-21T01:52:18.620 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_send_messages": 216, 2024-09-21T01:52:18.620 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_recv_bytes": 840144, 2024-09-21T01:52:18.620 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_send_bytes": 131712, 2024-09-21T01:52:18.620 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_created_connections": 2, 2024-09-21T01:52:18.620 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_active_connections": 1, 2024-09-21T01:52:18.620 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_total_time": 0.043735867, 2024-09-21T01:52:18.620 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_send_time": 0.019408167, 2024-09-21T01:52:18.620 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_recv_time": 0.033884345, 2024-09-21T01:52:18.620 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T01:52:18.621 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T01:52:18.621 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 216, 2024-09-21T01:52:18.621 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.018839039, 2024-09-21T01:52:18.621 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000087217 2024-09-21T01:52:18.621 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-09-21T01:52:18.621 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_handle_ack_lat": { 2024-09-21T01:52:18.621 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2024-09-21T01:52:18.621 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2024-09-21T01:52:18.621 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2024-09-21T01:52:18.621 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-09-21T01:52:18.621 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_recv_encrypted_bytes": 840144, 2024-09-21T01:52:18.621 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_send_encrypted_bytes": 131712 2024-09-21T01:52:18.621 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-09-21T01:52:18.621 INFO:teuthology.orchestra.run.smithi142.stdout: "cct": { 2024-09-21T01:52:18.621 INFO:teuthology.orchestra.run.smithi142.stdout: "total_workers": 0, 2024-09-21T01:52:18.622 INFO:teuthology.orchestra.run.smithi142.stdout: "unhealthy_workers": 0 2024-09-21T01:52:18.622 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-09-21T01:52:18.622 INFO:teuthology.orchestra.run.smithi142.stdout: "mempool": { 2024-09-21T01:52:18.622 INFO:teuthology.orchestra.run.smithi142.stdout: "bloom_filter_bytes": 0, 2024-09-21T01:52:18.622 INFO:teuthology.orchestra.run.smithi142.stdout: "bloom_filter_items": 0, 2024-09-21T01:52:18.622 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T01:52:18.622 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_alloc_items": 0, 2024-09-21T01:52:18.622 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T01:52:18.622 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_cache_data_items": 0, 2024-09-21T01:52:18.622 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T01:52:18.622 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T01:52:18.622 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T01:52:18.623 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T01:52:18.623 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T01:52:18.623 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_cache_other_items": 0, 2024-09-21T01:52:18.623 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T01:52:18.623 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T01:52:18.623 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_extent_bytes": 0, 2024-09-21T01:52:18.623 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_extent_items": 0, 2024-09-21T01:52:18.623 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_blob_bytes": 0, 2024-09-21T01:52:18.623 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_blob_items": 0, 2024-09-21T01:52:18.623 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T01:52:18.623 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T01:52:18.623 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T01:52:18.623 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T01:52:18.624 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T01:52:18.624 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_fsck_items": 0, 2024-09-21T01:52:18.624 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_txc_bytes": 0, 2024-09-21T01:52:18.624 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_txc_items": 0, 2024-09-21T01:52:18.624 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T01:52:18.624 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T01:52:18.624 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_writing_bytes": 0, 2024-09-21T01:52:18.624 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_writing_items": 0, 2024-09-21T01:52:18.624 INFO:teuthology.orchestra.run.smithi142.stdout: "bluefs_bytes": 0, 2024-09-21T01:52:18.624 INFO:teuthology.orchestra.run.smithi142.stdout: "bluefs_items": 0, 2024-09-21T01:52:18.625 INFO:teuthology.orchestra.run.smithi142.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T01:52:18.625 INFO:teuthology.orchestra.run.smithi142.stdout: "bluefs_file_reader_items": 0, 2024-09-21T01:52:18.625 INFO:teuthology.orchestra.run.smithi142.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T01:52:18.625 INFO:teuthology.orchestra.run.smithi142.stdout: "bluefs_file_writer_items": 0, 2024-09-21T01:52:18.625 INFO:teuthology.orchestra.run.smithi142.stdout: "buffer_anon_bytes": 148945, 2024-09-21T01:52:18.625 INFO:teuthology.orchestra.run.smithi142.stdout: "buffer_anon_items": 29, 2024-09-21T01:52:18.625 INFO:teuthology.orchestra.run.smithi142.stdout: "buffer_meta_bytes": 0, 2024-09-21T01:52:18.625 INFO:teuthology.orchestra.run.smithi142.stdout: "buffer_meta_items": 0, 2024-09-21T01:52:18.625 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_bytes": 0, 2024-09-21T01:52:18.625 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_items": 0, 2024-09-21T01:52:18.625 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_mapbl_bytes": 0, 2024-09-21T01:52:18.625 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_mapbl_items": 0, 2024-09-21T01:52:18.625 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_pglog_bytes": 0, 2024-09-21T01:52:18.625 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_pglog_items": 0, 2024-09-21T01:52:18.625 INFO:teuthology.orchestra.run.smithi142.stdout: "osdmap_bytes": 0, 2024-09-21T01:52:18.626 INFO:teuthology.orchestra.run.smithi142.stdout: "osdmap_items": 0, 2024-09-21T01:52:18.626 INFO:teuthology.orchestra.run.smithi142.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T01:52:18.626 INFO:teuthology.orchestra.run.smithi142.stdout: "osdmap_mapping_items": 0, 2024-09-21T01:52:18.626 INFO:teuthology.orchestra.run.smithi142.stdout: "pgmap_bytes": 0, 2024-09-21T01:52:18.626 INFO:teuthology.orchestra.run.smithi142.stdout: "pgmap_items": 0, 2024-09-21T01:52:18.626 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_co_bytes": 968, 2024-09-21T01:52:18.626 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_co_items": 2, 2024-09-21T01:52:18.626 INFO:teuthology.orchestra.run.smithi142.stdout: "unittest_1_bytes": 0, 2024-09-21T01:52:18.626 INFO:teuthology.orchestra.run.smithi142.stdout: "unittest_1_items": 0, 2024-09-21T01:52:18.626 INFO:teuthology.orchestra.run.smithi142.stdout: "unittest_2_bytes": 0, 2024-09-21T01:52:18.626 INFO:teuthology.orchestra.run.smithi142.stdout: "unittest_2_items": 0 2024-09-21T01:52:18.626 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-09-21T01:52:18.626 INFO:teuthology.orchestra.run.smithi142.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T01:52:18.626 INFO:teuthology.orchestra.run.smithi142.stdout: "val": 0, 2024-09-21T01:52:18.627 INFO:teuthology.orchestra.run.smithi142.stdout: "max": 104857600, 2024-09-21T01:52:18.627 INFO:teuthology.orchestra.run.smithi142.stdout: "get_started": 0, 2024-09-21T01:52:18.627 INFO:teuthology.orchestra.run.smithi142.stdout: "get": 220, 2024-09-21T01:52:18.627 INFO:teuthology.orchestra.run.smithi142.stdout: "get_sum": 806268, 2024-09-21T01:52:18.627 INFO:teuthology.orchestra.run.smithi142.stdout: "get_or_fail_fail": 0, 2024-09-21T01:52:18.627 INFO:teuthology.orchestra.run.smithi142.stdout: "get_or_fail_success": 220, 2024-09-21T01:52:18.627 INFO:teuthology.orchestra.run.smithi142.stdout: "take": 0, 2024-09-21T01:52:18.627 INFO:teuthology.orchestra.run.smithi142.stdout: "take_sum": 0, 2024-09-21T01:52:18.627 INFO:teuthology.orchestra.run.smithi142.stdout: "put": 220, 2024-09-21T01:52:18.627 INFO:teuthology.orchestra.run.smithi142.stdout: "put_sum": 806268, 2024-09-21T01:52:18.627 INFO:teuthology.orchestra.run.smithi142.stdout: "wait": { 2024-09-21T01:52:18.627 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2024-09-21T01:52:18.627 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2024-09-21T01:52:18.627 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2024-09-21T01:52:18.627 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-09-21T01:52:18.627 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-09-21T01:52:18.628 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-09-21T01:52:18.924 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:52:18 smithi142 ceph-mon[34050]: pgmap v655: 129 pgs: 129 active+clean; 21 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-21T01:52:19.053 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:52:18 smithi083 ceph-mon[31370]: pgmap v655: 129 pgs: 129 active+clean; 21 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-21T01:52:19.218 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:52:18 smithi119 ceph-mon[33693]: pgmap v655: 129 pgs: 129 active+clean; 21 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-21T01:52:19.288 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.l 2024-09-21T01:52:19.288 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.l 2024-09-21T01:52:19.288 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.l 2024-09-21T01:52:19.288 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-09-21T01:52:19.301 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-09-21T01:52:19.301 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-09-21T01:52:19.301 DEBUG:teuthology.orchestra.run.smithi083:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T01:52:19.322 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-09-21T01:52:19.322 DEBUG:teuthology.orchestra.run.smithi083:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T01:52:19.382 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph osd blocklist ls 2024-09-21T01:52:19.677 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:52:20.053 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:52:20 smithi083 ceph-mon[31370]: pgmap v657: 129 pgs: 129 active+clean; 21 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 246 B/s wr, 2 op/s 2024-09-21T01:52:20.054 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:52:20 smithi083 ceph-mon[31370]: osdmap e94: 12 total, 12 up, 12 in 2024-09-21T01:52:20.230 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:20.216+0000 7fe511913640 1 -- 172.21.15.83:0/3528730488 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe50c101ff0 msgr2=0x7fe50c102400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:52:20.230 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:20.216+0000 7fe511913640 1 --2- 172.21.15.83:0/3528730488 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe50c101ff0 0x7fe50c102400 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fe4fc009900 tx=0x7fe4fc02a410 comp rx=0 tx=0).stop 2024-09-21T01:52:20.230 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:20.217+0000 7fe511913640 1 -- 172.21.15.83:0/3528730488 shutdown_connections 2024-09-21T01:52:20.230 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:20.217+0000 7fe511913640 1 --2- 172.21.15.83:0/3528730488 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe50c114600 0x7fe50c116a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:52:20.230 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:20.217+0000 7fe511913640 1 --2- 172.21.15.83:0/3528730488 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe50c111ca0 0x7fe50c1140c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:52:20.230 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:20.217+0000 7fe511913640 1 --2- 172.21.15.83:0/3528730488 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe50c101ff0 0x7fe50c102400 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:52:20.230 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:20.217+0000 7fe511913640 1 -- 172.21.15.83:0/3528730488 >> 172.21.15.83:0/3528730488 conn(0x7fe50c077cc0 msgr2=0x7fe50c078100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:52:20.230 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:20.217+0000 7fe511913640 1 -- 172.21.15.83:0/3528730488 shutdown_connections 2024-09-21T01:52:20.230 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:20.217+0000 7fe511913640 1 -- 172.21.15.83:0/3528730488 wait complete. 2024-09-21T01:52:20.230 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:20.217+0000 7fe511913640 1 Processor -- start 2024-09-21T01:52:20.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:20.217+0000 7fe511913640 1 -- start start 2024-09-21T01:52:20.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:20.218+0000 7fe511913640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe50c101ff0 0x7fe50c1a0a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:52:20.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:20.218+0000 7fe511913640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe50c111ca0 0x7fe50c1a1000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:52:20.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:20.218+0000 7fe511913640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe50c114600 0x7fe50c1a62a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:52:20.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:20.218+0000 7fe511913640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fe50c119f90 con 0x7fe50c111ca0 2024-09-21T01:52:20.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:20.218+0000 7fe511913640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fe50c119e10 con 0x7fe50c114600 2024-09-21T01:52:20.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:20.218+0000 7fe511913640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fe50c11a110 con 0x7fe50c101ff0 2024-09-21T01:52:20.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:20.218+0000 7fe50a7fc640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe50c111ca0 0x7fe50c1a1000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:52:20.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:20.218+0000 7fe50a7fc640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe50c111ca0 0x7fe50c1a1000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:52632/0 (socket says 172.21.15.83:52632) 2024-09-21T01:52:20.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:20.218+0000 7fe50a7fc640 1 -- 172.21.15.83:0/4154275098 learned_addr learned my addr 172.21.15.83:0/4154275098 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:52:20.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:20.218+0000 7fe50b7fe640 1 --2- 172.21.15.83:0/4154275098 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe50c114600 0x7fe50c1a62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:52:20.231 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:20.218+0000 7fe50affd640 1 --2- 172.21.15.83:0/4154275098 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe50c101ff0 0x7fe50c1a0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:52:20.232 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:20.218+0000 7fe50a7fc640 1 -- 172.21.15.83:0/4154275098 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe50c101ff0 msgr2=0x7fe50c1a0a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:52:20.232 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:20.218+0000 7fe50a7fc640 1 --2- 172.21.15.83:0/4154275098 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe50c101ff0 0x7fe50c1a0a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:52:20.232 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:20.218+0000 7fe50a7fc640 1 -- 172.21.15.83:0/4154275098 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe50c114600 msgr2=0x7fe50c1a62a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:52:20.232 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:20.218+0000 7fe50a7fc640 1 --2- 172.21.15.83:0/4154275098 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe50c114600 0x7fe50c1a62a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:52:20.232 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:20.218+0000 7fe50a7fc640 1 -- 172.21.15.83:0/4154275098 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe50c1a69d0 con 0x7fe50c111ca0 2024-09-21T01:52:20.232 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:20.218+0000 7fe50a7fc640 1 --2- 172.21.15.83:0/4154275098 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe50c111ca0 0x7fe50c1a1000 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fe50000d740 tx=0x7fe50000dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:52:20.232 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:20.218+0000 7fe510911640 1 -- 172.21.15.83:0/4154275098 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe500017070 con 0x7fe50c111ca0 2024-09-21T01:52:20.232 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:20.219+0000 7fe511913640 1 -- 172.21.15.83:0/4154275098 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe50c1a6cc0 con 0x7fe50c111ca0 2024-09-21T01:52:20.232 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:20.219+0000 7fe510911640 1 -- 172.21.15.83:0/4154275098 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe50000de50 con 0x7fe50c111ca0 2024-09-21T01:52:20.232 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:20.219+0000 7fe510911640 1 -- 172.21.15.83:0/4154275098 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe50000f620 con 0x7fe50c111ca0 2024-09-21T01:52:20.232 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:20.219+0000 7fe511913640 1 -- 172.21.15.83:0/4154275098 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe50c1ad420 con 0x7fe50c111ca0 2024-09-21T01:52:20.232 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:20.220+0000 7fe511913640 1 -- 172.21.15.83:0/4154275098 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe50c102400 con 0x7fe50c111ca0 2024-09-21T01:52:20.232 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:20.222+0000 7fe510911640 1 -- 172.21.15.83:0/4154275098 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7fe50001a070 con 0x7fe50c111ca0 2024-09-21T01:52:20.232 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:20.223+0000 7fe510911640 1 --2- 172.21.15.83:0/4154275098 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fe4f40b6680 0x7fe4f40b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:52:20.233 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:20.223+0000 7fe50affd640 1 --2- 172.21.15.83:0/4154275098 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fe4f40b6680 0x7fe4f40b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:52:20.233 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:20.223+0000 7fe510911640 1 -- 172.21.15.83:0/4154275098 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9403+0+0 (secure 0 0 0) 0x7fe5000e74e0 con 0x7fe50c111ca0 2024-09-21T01:52:20.233 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:20.223+0000 7fe50affd640 1 --2- 172.21.15.83:0/4154275098 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fe4f40b6680 0x7fe4f40b8b90 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fe4fc006010 tx=0x7fe4fc032ba0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:52:20.233 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:20.226+0000 7fe510911640 1 -- 172.21.15.83:0/4154275098 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe5000ad660 con 0x7fe50c111ca0 2024-09-21T01:52:20.415 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:20.414+0000 7fe511913640 1 -- 172.21.15.83:0/4154275098 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fe50c1a1b90 con 0x7fe50c111ca0 2024-09-21T01:52:20.415 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:20.415+0000 7fe510911640 1 -- 172.21.15.83:0/4154275098 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 15 entries v94) ==== 81+0+887 (secure 0 0 0) 0x7fe5000b1a40 con 0x7fe50c111ca0 2024-09-21T01:52:20.415 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.15.83:0/1619062496 2024-09-22T01:33:08.666525+0000 2024-09-21T01:52:20.416 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.15.83:0/2412709299 2024-09-22T01:31:45.834450+0000 2024-09-21T01:52:20.416 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.15.83:6800/4290325964 2024-09-22T01:31:45.834450+0000 2024-09-21T01:52:20.416 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.15.83:6801/4290325964 2024-09-22T01:31:45.834450+0000 2024-09-21T01:52:20.416 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.15.83:0/1440681183 2024-09-22T01:31:45.834450+0000 2024-09-21T01:52:20.416 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.15.83:0/2745413305 2024-09-22T01:31:45.834450+0000 2024-09-21T01:52:20.416 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.15.83:6800/1393748565 2024-09-22T01:33:08.666525+0000 2024-09-21T01:52:20.416 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.15.83:0/110411274 2024-09-22T01:32:10.073024+0000 2024-09-21T01:52:20.416 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.15.83:0/4267551123 2024-09-22T01:33:08.666525+0000 2024-09-21T01:52:20.416 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.15.83:0/1068434643 2024-09-22T01:32:10.073024+0000 2024-09-21T01:52:20.416 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.15.83:6800/2963261730 2024-09-22T01:32:10.073024+0000 2024-09-21T01:52:20.416 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.15.83:0/3544333975 2024-09-22T01:32:10.073024+0000 2024-09-21T01:52:20.416 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.15.83:6801/1393748565 2024-09-22T01:33:08.666525+0000 2024-09-21T01:52:20.416 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.15.83:6801/2963261730 2024-09-22T01:32:10.073024+0000 2024-09-21T01:52:20.416 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.15.83:0/1915285091 2024-09-22T01:33:08.666525+0000 2024-09-21T01:52:20.417 INFO:teuthology.orchestra.run.smithi083.stderr:listed 15 entries 2024-09-21T01:52:20.417 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:20.417+0000 7fe511913640 1 -- 172.21.15.83:0/4154275098 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fe4f40b6680 msgr2=0x7fe4f40b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:52:20.417 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:20.417+0000 7fe511913640 1 --2- 172.21.15.83:0/4154275098 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fe4f40b6680 0x7fe4f40b8b90 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fe4fc006010 tx=0x7fe4fc032ba0 comp rx=0 tx=0).stop 2024-09-21T01:52:20.417 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:20.417+0000 7fe511913640 1 -- 172.21.15.83:0/4154275098 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe50c111ca0 msgr2=0x7fe50c1a1000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:52:20.417 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:20.417+0000 7fe511913640 1 --2- 172.21.15.83:0/4154275098 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe50c111ca0 0x7fe50c1a1000 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fe50000d740 tx=0x7fe50000dc00 comp rx=0 tx=0).stop 2024-09-21T01:52:20.418 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:20.417+0000 7fe511913640 1 -- 172.21.15.83:0/4154275098 shutdown_connections 2024-09-21T01:52:20.418 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:20.417+0000 7fe511913640 1 --2- 172.21.15.83:0/4154275098 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fe4f40b6680 0x7fe4f40b8b90 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:52:20.418 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:20.417+0000 7fe511913640 1 --2- 172.21.15.83:0/4154275098 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe50c114600 0x7fe50c1a62a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:52:20.418 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:20.417+0000 7fe511913640 1 --2- 172.21.15.83:0/4154275098 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe50c111ca0 0x7fe50c1a1000 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:52:20.418 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:20.417+0000 7fe511913640 1 --2- 172.21.15.83:0/4154275098 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe50c101ff0 0x7fe50c1a0a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:52:20.418 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:20.417+0000 7fe511913640 1 -- 172.21.15.83:0/4154275098 >> 172.21.15.83:0/4154275098 conn(0x7fe50c077cc0 msgr2=0x7fe50c115d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:52:20.418 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:20.417+0000 7fe511913640 1 -- 172.21.15.83:0/4154275098 shutdown_connections 2024-09-21T01:52:20.418 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:20.417+0000 7fe511913640 1 -- 172.21.15.83:0/4154275098 wait complete. 2024-09-21T01:52:20.465 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:52:20 smithi142 ceph-mon[34050]: pgmap v657: 129 pgs: 129 active+clean; 21 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 246 B/s wr, 2 op/s 2024-09-21T01:52:20.465 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:52:20 smithi142 ceph-mon[34050]: osdmap e94: 12 total, 12 up, 12 in 2024-09-21T01:52:20.467 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:52:20 smithi119 ceph-mon[33693]: pgmap v657: 129 pgs: 129 active+clean; 21 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 246 B/s wr, 2 op/s 2024-09-21T01:52:20.467 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:52:20 smithi119 ceph-mon[33693]: osdmap e94: 12 total, 12 up, 12 in 2024-09-21T01:52:21.050 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-09-21T01:52:21.050 DEBUG:teuthology.orchestra.run.smithi083:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T01:52:21.068 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph osd blocklist ls 2024-09-21T01:52:21.131 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:52:21 smithi083 ceph-mon[31370]: from='client.? 172.21.15.83:0/4154275098' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T01:52:21.353 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:52:21.464 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:52:21 smithi142 ceph-mon[34050]: from='client.? 172.21.15.83:0/4154275098' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T01:52:21.467 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:52:21 smithi119 ceph-mon[33693]: from='client.? 172.21.15.83:0/4154275098' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T01:52:21.906 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:21.854+0000 7f4850c62640 1 -- 172.21.15.83:0/3389903472 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f484c102a60 msgr2=0x7f484c102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:52:21.906 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:21.854+0000 7f4850c62640 1 --2- 172.21.15.83:0/3389903472 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f484c102a60 0x7f484c102e70 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f483c009ca0 tx=0x7f483c02a8c0 comp rx=0 tx=0).stop 2024-09-21T01:52:21.906 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:21.854+0000 7f4850c62640 1 -- 172.21.15.83:0/3389903472 shutdown_connections 2024-09-21T01:52:21.906 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:21.854+0000 7f4850c62640 1 --2- 172.21.15.83:0/3389903472 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f484c108cf0 0x7f484c10f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:52:21.906 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:21.854+0000 7f4850c62640 1 --2- 172.21.15.83:0/3389903472 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f484c1083a0 0x7f484c1087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:52:21.906 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:21.854+0000 7f4850c62640 1 --2- 172.21.15.83:0/3389903472 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f484c102a60 0x7f484c102e70 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:52:21.906 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:21.854+0000 7f4850c62640 1 -- 172.21.15.83:0/3389903472 >> 172.21.15.83:0/3389903472 conn(0x7f484c079730 msgr2=0x7f484c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:52:21.906 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:21.854+0000 7f4850c62640 1 -- 172.21.15.83:0/3389903472 shutdown_connections 2024-09-21T01:52:21.907 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:21.854+0000 7f4850c62640 1 -- 172.21.15.83:0/3389903472 wait complete. 2024-09-21T01:52:21.907 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:21.855+0000 7f4850c62640 1 Processor -- start 2024-09-21T01:52:21.907 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:21.855+0000 7f4850c62640 1 -- start start 2024-09-21T01:52:21.907 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:21.855+0000 7f4850c62640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f484c102a60 0x7f484c19b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:52:21.907 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:21.855+0000 7f4850c62640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f484c1083a0 0x7f484c19b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:52:21.907 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:21.855+0000 7f4850c62640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f484c108cf0 0x7f484c19bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:52:21.907 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:21.855+0000 7f4850c62640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f484c112940 con 0x7f484c102a60 2024-09-21T01:52:21.907 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:21.855+0000 7f4850c62640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f484c1127c0 con 0x7f484c1083a0 2024-09-21T01:52:21.907 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:21.855+0000 7f4850c62640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f484c112ac0 con 0x7f484c108cf0 2024-09-21T01:52:21.907 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:21.855+0000 7f484a59c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f484c102a60 0x7f484c19b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:52:21.907 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:21.855+0000 7f484a59c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f484c102a60 0x7f484c19b330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:52636/0 (socket says 172.21.15.83:52636) 2024-09-21T01:52:21.908 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:21.855+0000 7f484a59c640 1 -- 172.21.15.83:0/3563558324 learned_addr learned my addr 172.21.15.83:0/3563558324 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:52:21.908 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:21.856+0000 7f484ad9d640 1 --2- 172.21.15.83:0/3563558324 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f484c108cf0 0x7f484c19bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:52:21.908 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:21.856+0000 7f4849d9b640 1 --2- 172.21.15.83:0/3563558324 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f484c1083a0 0x7f484c19b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:52:21.908 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:21.856+0000 7f484a59c640 1 -- 172.21.15.83:0/3563558324 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f484c108cf0 msgr2=0x7f484c19bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:52:21.908 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:21.856+0000 7f484a59c640 1 --2- 172.21.15.83:0/3563558324 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f484c108cf0 0x7f484c19bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:52:21.908 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:21.856+0000 7f484a59c640 1 -- 172.21.15.83:0/3563558324 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f484c1083a0 msgr2=0x7f484c19b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:52:21.908 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:21.856+0000 7f484a59c640 1 --2- 172.21.15.83:0/3563558324 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f484c1083a0 0x7f484c19b870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:52:21.908 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:21.856+0000 7f484a59c640 1 -- 172.21.15.83:0/3563558324 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f484c1a65f0 con 0x7f484c102a60 2024-09-21T01:52:21.908 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:21.856+0000 7f4849d9b640 1 --2- 172.21.15.83:0/3563558324 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f484c1083a0 0x7f484c19b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:52:21.908 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:21.856+0000 7f484a59c640 1 --2- 172.21.15.83:0/3563558324 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f484c102a60 0x7f484c19b330 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f483c006010 tx=0x7f483c032bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:52:21.908 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:21.856+0000 7f48437fe640 1 -- 172.21.15.83:0/3563558324 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f483c004040 con 0x7f484c102a60 2024-09-21T01:52:21.908 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:21.856+0000 7f4850c62640 1 -- 172.21.15.83:0/3563558324 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f484c1a6880 con 0x7f484c102a60 2024-09-21T01:52:21.909 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:21.856+0000 7f48437fe640 1 -- 172.21.15.83:0/3563558324 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f483c004670 con 0x7f484c102a60 2024-09-21T01:52:21.909 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:21.856+0000 7f48437fe640 1 -- 172.21.15.83:0/3563558324 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f483c030da0 con 0x7f484c102a60 2024-09-21T01:52:21.909 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:21.856+0000 7f4850c62640 1 -- 172.21.15.83:0/3563558324 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f484c1a6e10 con 0x7f484c102a60 2024-09-21T01:52:21.909 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:21.857+0000 7f4850c62640 1 -- 172.21.15.83:0/3563558324 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f484c102e70 con 0x7f484c102a60 2024-09-21T01:52:21.909 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:21.859+0000 7f48437fe640 1 -- 172.21.15.83:0/3563558324 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7f483c0305c0 con 0x7f484c102a60 2024-09-21T01:52:21.909 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:21.859+0000 7f48437fe640 1 --2- 172.21.15.83:0/3563558324 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f48380b6680 0x7f48380b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:52:21.909 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:21.860+0000 7f4849d9b640 1 --2- 172.21.15.83:0/3563558324 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f48380b6680 0x7f48380b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:52:21.909 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:21.860+0000 7f48437fe640 1 -- 172.21.15.83:0/3563558324 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9403+0+0 (secure 0 0 0) 0x7f483c109270 con 0x7f484c102a60 2024-09-21T01:52:21.909 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:21.860+0000 7f4849d9b640 1 --2- 172.21.15.83:0/3563558324 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f48380b6680 0x7f48380b8b90 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f4834006fd0 tx=0x7f4834008040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:52:21.909 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:21.863+0000 7f48437fe640 1 -- 172.21.15.83:0/3563558324 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f483c004820 con 0x7f484c102a60 2024-09-21T01:52:22.055 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:22.055+0000 7f4850c62640 1 -- 172.21.15.83:0/3563558324 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f484c06b290 con 0x7f484c102a60 2024-09-21T01:52:22.055 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:22.055+0000 7f48437fe640 1 -- 172.21.15.83:0/3563558324 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 15 entries v94) ==== 81+0+887 (secure 0 0 0) 0x7f483c0cf450 con 0x7f484c102a60 2024-09-21T01:52:22.056 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.15.83:0/1619062496 2024-09-22T01:33:08.666525+0000 2024-09-21T01:52:22.056 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.15.83:0/2412709299 2024-09-22T01:31:45.834450+0000 2024-09-21T01:52:22.056 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.15.83:6800/4290325964 2024-09-22T01:31:45.834450+0000 2024-09-21T01:52:22.056 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.15.83:6801/4290325964 2024-09-22T01:31:45.834450+0000 2024-09-21T01:52:22.056 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.15.83:0/1440681183 2024-09-22T01:31:45.834450+0000 2024-09-21T01:52:22.056 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.15.83:0/2745413305 2024-09-22T01:31:45.834450+0000 2024-09-21T01:52:22.056 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.15.83:6800/1393748565 2024-09-22T01:33:08.666525+0000 2024-09-21T01:52:22.056 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.15.83:0/110411274 2024-09-22T01:32:10.073024+0000 2024-09-21T01:52:22.056 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.15.83:0/4267551123 2024-09-22T01:33:08.666525+0000 2024-09-21T01:52:22.056 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.15.83:0/1068434643 2024-09-22T01:32:10.073024+0000 2024-09-21T01:52:22.056 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.15.83:6800/2963261730 2024-09-22T01:32:10.073024+0000 2024-09-21T01:52:22.056 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.15.83:0/3544333975 2024-09-22T01:32:10.073024+0000 2024-09-21T01:52:22.056 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.15.83:6801/1393748565 2024-09-22T01:33:08.666525+0000 2024-09-21T01:52:22.057 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.15.83:6801/2963261730 2024-09-22T01:32:10.073024+0000 2024-09-21T01:52:22.057 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.15.83:0/1915285091 2024-09-22T01:33:08.666525+0000 2024-09-21T01:52:22.057 INFO:teuthology.orchestra.run.smithi083.stderr:listed 15 entries 2024-09-21T01:52:22.058 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:22.057+0000 7f4850c62640 1 -- 172.21.15.83:0/3563558324 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f48380b6680 msgr2=0x7f48380b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:52:22.058 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:22.057+0000 7f4850c62640 1 --2- 172.21.15.83:0/3563558324 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f48380b6680 0x7f48380b8b90 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f4834006fd0 tx=0x7f4834008040 comp rx=0 tx=0).stop 2024-09-21T01:52:22.058 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:22.057+0000 7f4850c62640 1 -- 172.21.15.83:0/3563558324 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f484c102a60 msgr2=0x7f484c19b330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:52:22.058 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:22.057+0000 7f4850c62640 1 --2- 172.21.15.83:0/3563558324 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f484c102a60 0x7f484c19b330 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f483c006010 tx=0x7f483c032bc0 comp rx=0 tx=0).stop 2024-09-21T01:52:22.058 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:22.057+0000 7f4850c62640 1 -- 172.21.15.83:0/3563558324 shutdown_connections 2024-09-21T01:52:22.058 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:22.057+0000 7f4850c62640 1 --2- 172.21.15.83:0/3563558324 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f48380b6680 0x7f48380b8b90 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:52:22.058 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:22.057+0000 7f4850c62640 1 --2- 172.21.15.83:0/3563558324 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f484c108cf0 0x7f484c19bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:52:22.058 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:22.057+0000 7f4850c62640 1 --2- 172.21.15.83:0/3563558324 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f484c1083a0 0x7f484c19b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:52:22.059 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:22.057+0000 7f4850c62640 1 --2- 172.21.15.83:0/3563558324 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f484c102a60 0x7f484c19b330 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:52:22.059 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:22.057+0000 7f4850c62640 1 -- 172.21.15.83:0/3563558324 >> 172.21.15.83:0/3563558324 conn(0x7f484c079730 msgr2=0x7f484c101490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:52:22.059 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:22.057+0000 7f4850c62640 1 -- 172.21.15.83:0/3563558324 shutdown_connections 2024-09-21T01:52:22.059 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:22.057+0000 7f4850c62640 1 -- 172.21.15.83:0/3563558324 wait complete. 2024-09-21T01:52:22.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:52:22 smithi083 ceph-mon[31370]: pgmap v658: 129 pgs: 129 active+clean; 21 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-21T01:52:22.464 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:52:22 smithi142 ceph-mon[34050]: pgmap v658: 129 pgs: 129 active+clean; 21 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-21T01:52:22.467 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:52:22 smithi119 ceph-mon[33693]: pgmap v658: 129 pgs: 129 active+clean; 21 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-21T01:52:22.733 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi083.front.sepia.ceph.com... 2024-09-21T01:52:22.734 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T01:52:22.734 DEBUG:teuthology.orchestra.run.smithi083:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-21T01:52:22.804 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi083.stderr:ceph-fuse[86128]: fuse finished with error 0 and tester_r 0 2024-09-21T01:52:22.806 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T01:52:23.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:52:23 smithi083 ceph-mon[31370]: from='client.? 172.21.15.83:0/3563558324' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T01:52:23.464 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:52:23 smithi142 ceph-mon[34050]: from='client.? 172.21.15.83:0/3563558324' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T01:52:23.467 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:52:23 smithi119 ceph-mon[33693]: from='client.? 172.21.15.83:0/3563558324' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T01:52:24.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:52:24 smithi083 ceph-mon[31370]: pgmap v659: 129 pgs: 129 active+clean; 21 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-21T01:52:24.464 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:52:24 smithi142 ceph-mon[34050]: pgmap v659: 129 pgs: 129 active+clean; 21 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-21T01:52:24.468 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:52:24 smithi119 ceph-mon[33693]: pgmap v659: 129 pgs: 129 active+clean; 21 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-21T01:52:26.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:52:26 smithi083 ceph-mon[31370]: pgmap v660: 129 pgs: 129 active+clean; 21 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 409 B/s wr, 2 op/s 2024-09-21T01:52:26.465 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:52:26 smithi142 ceph-mon[34050]: pgmap v660: 129 pgs: 129 active+clean; 21 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 409 B/s wr, 2 op/s 2024-09-21T01:52:26.467 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:52:26 smithi119 ceph-mon[33693]: pgmap v660: 129 pgs: 129 active+clean; 21 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 409 B/s wr, 2 op/s 2024-09-21T01:52:28.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:52:28 smithi083 ceph-mon[31370]: pgmap v661: 129 pgs: 129 active+clean; 21 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 409 B/s wr, 2 op/s 2024-09-21T01:52:28.464 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:52:28 smithi142 ceph-mon[34050]: pgmap v661: 129 pgs: 129 active+clean; 21 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 409 B/s wr, 2 op/s 2024-09-21T01:52:28.467 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:52:28 smithi119 ceph-mon[33693]: pgmap v661: 129 pgs: 129 active+clean; 21 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 409 B/s wr, 2 op/s 2024-09-21T01:52:28.908 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi083.front.sepia.ceph.com 2024-09-21T01:52:28.908 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T01:52:28.908 DEBUG:teuthology.orchestra.run.smithi083:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-21T01:52:28.927 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T01:52:28.928 DEBUG:teuthology.orchestra.run.smithi083:> ip netns list 2024-09-21T01:52:28.986 INFO:teuthology.orchestra.run.smithi083.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-21T01:52:28.986 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T01:52:28.986 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T01:52:29.055 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T01:52:29.056 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip link delete ceph-brx 2024-09-21T01:52:29.151 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-09-21T01:52:29.162 INFO:tasks.cephadm:Teardown begin 2024-09-21T01:52:29.162 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-21T01:52:29.162 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T01:52:29.413 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:52:29.900 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:29.881+0000 7f7e91411640 1 -- 172.21.15.83:0/4058936532 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7e8c1083c0 msgr2=0x7f7e8c1087d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:52:29.900 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:29.881+0000 7f7e91411640 1 --2- 172.21.15.83:0/4058936532 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7e8c1083c0 0x7f7e8c1087d0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f7e80009900 tx=0x7f7e8002a410 comp rx=0 tx=0).stop 2024-09-21T01:52:29.901 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:29.881+0000 7f7e91411640 1 -- 172.21.15.83:0/4058936532 shutdown_connections 2024-09-21T01:52:29.901 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:29.881+0000 7f7e91411640 1 --2- 172.21.15.83:0/4058936532 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7e8c108d10 0x7f7e8c10f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:52:29.901 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:29.881+0000 7f7e91411640 1 --2- 172.21.15.83:0/4058936532 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7e8c1083c0 0x7f7e8c1087d0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:52:29.901 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:29.881+0000 7f7e91411640 1 --2- 172.21.15.83:0/4058936532 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7e8c102a80 0x7f7e8c102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:52:29.901 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:29.881+0000 7f7e91411640 1 -- 172.21.15.83:0/4058936532 >> 172.21.15.83:0/4058936532 conn(0x7f7e8c079740 msgr2=0x7f7e8c079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:52:29.901 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:29.881+0000 7f7e91411640 1 -- 172.21.15.83:0/4058936532 shutdown_connections 2024-09-21T01:52:29.901 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:29.881+0000 7f7e91411640 1 -- 172.21.15.83:0/4058936532 wait complete. 2024-09-21T01:52:29.901 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:29.881+0000 7f7e91411640 1 Processor -- start 2024-09-21T01:52:29.902 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:29.882+0000 7f7e91411640 1 -- start start 2024-09-21T01:52:29.902 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:29.882+0000 7f7e91411640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7e8c102a80 0x7f7e8c1992e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:52:29.902 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:29.882+0000 7f7e91411640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7e8c1083c0 0x7f7e8c199880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:52:29.902 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:29.882+0000 7f7e91411640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7e8c108d10 0x7f7e8c19eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:52:29.902 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:29.882+0000 7f7e91411640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f7e8c112830 con 0x7f7e8c108d10 2024-09-21T01:52:29.902 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:29.882+0000 7f7e91411640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f7e8c1126b0 con 0x7f7e8c1083c0 2024-09-21T01:52:29.902 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:29.882+0000 7f7e91411640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f7e8c1129b0 con 0x7f7e8c102a80 2024-09-21T01:52:29.902 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:29.882+0000 7f7e8b7fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7e8c108d10 0x7f7e8c19eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:52:29.903 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:29.882+0000 7f7e8b7fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7e8c108d10 0x7f7e8c19eb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:38428/0 (socket says 172.21.15.83:38428) 2024-09-21T01:52:29.903 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:29.882+0000 7f7e8b7fe640 1 -- 172.21.15.83:0/3644217401 learned_addr learned my addr 172.21.15.83:0/3644217401 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:52:29.903 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:29.882+0000 7f7e8a7fc640 1 --2- 172.21.15.83:0/3644217401 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7e8c1083c0 0x7f7e8c199880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:52:29.903 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:29.882+0000 7f7e8affd640 1 --2- 172.21.15.83:0/3644217401 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7e8c102a80 0x7f7e8c1992e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:52:29.903 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:29.882+0000 7f7e8b7fe640 1 -- 172.21.15.83:0/3644217401 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7e8c102a80 msgr2=0x7f7e8c1992e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:52:29.903 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:29.882+0000 7f7e8b7fe640 1 --2- 172.21.15.83:0/3644217401 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7e8c102a80 0x7f7e8c1992e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:52:29.903 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:29.882+0000 7f7e8b7fe640 1 -- 172.21.15.83:0/3644217401 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7e8c1083c0 msgr2=0x7f7e8c199880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:52:29.903 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:29.882+0000 7f7e8b7fe640 1 --2- 172.21.15.83:0/3644217401 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7e8c1083c0 0x7f7e8c199880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:52:29.904 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:29.882+0000 7f7e8b7fe640 1 -- 172.21.15.83:0/3644217401 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e8c19f250 con 0x7f7e8c108d10 2024-09-21T01:52:29.904 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:29.883+0000 7f7e8b7fe640 1 --2- 172.21.15.83:0/3644217401 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7e8c108d10 0x7f7e8c19eb20 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f7e8400eaa0 tx=0x7f7e8400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:52:29.904 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:29.883+0000 7f7e73fff640 1 -- 172.21.15.83:0/3644217401 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e8400cdb0 con 0x7f7e8c108d10 2024-09-21T01:52:29.904 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:29.883+0000 7f7e73fff640 1 -- 172.21.15.83:0/3644217401 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7e84005020 con 0x7f7e8c108d10 2024-09-21T01:52:29.904 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:29.883+0000 7f7e91411640 1 -- 172.21.15.83:0/3644217401 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e8c19f540 con 0x7f7e8c108d10 2024-09-21T01:52:29.904 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:29.883+0000 7f7e73fff640 1 -- 172.21.15.83:0/3644217401 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e840116d0 con 0x7f7e8c108d10 2024-09-21T01:52:29.904 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:29.883+0000 7f7e91411640 1 -- 172.21.15.83:0/3644217401 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e8c1a5ca0 con 0x7f7e8c108d10 2024-09-21T01:52:29.904 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:29.884+0000 7f7e91411640 1 -- 172.21.15.83:0/3644217401 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e8c103d00 con 0x7f7e8c108d10 2024-09-21T01:52:29.904 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:29.885+0000 7f7e73fff640 1 -- 172.21.15.83:0/3644217401 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7f7e840051d0 con 0x7f7e8c108d10 2024-09-21T01:52:29.904 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:29.886+0000 7f7e73fff640 1 --2- 172.21.15.83:0/3644217401 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f7e740b6680 0x7f7e740b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:52:29.904 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:29.886+0000 7f7e8affd640 1 --2- 172.21.15.83:0/3644217401 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f7e740b6680 0x7f7e740b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:52:29.905 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:29.886+0000 7f7e73fff640 1 -- 172.21.15.83:0/3644217401 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9403+0+0 (secure 0 0 0) 0x7f7e840e80e0 con 0x7f7e8c108d10 2024-09-21T01:52:29.905 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:29.887+0000 7f7e8affd640 1 --2- 172.21.15.83:0/3644217401 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f7e740b6680 0x7f7e740b8b90 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f7e7c0058c0 tx=0x7f7e7c00a4c0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:52:29.905 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:29.889+0000 7f7e73fff640 1 -- 172.21.15.83:0/3644217401 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f7e84016030 con 0x7f7e8c108d10 2024-09-21T01:52:30.108 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:30.106+0000 7f7e91411640 1 -- 172.21.15.83:0/3644217401 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7e8c102e90 con 0x7f7e8c108d10 2024-09-21T01:52:30.108 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:30.107+0000 7f7e73fff640 1 -- 172.21.15.83:0/3644217401 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11857 (secure 0 0 0) 0x7f7e840ae2c0 con 0x7f7e8c108d10 2024-09-21T01:52:30.109 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T01:52:30.109 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":21,"btime":"2024-09-21T01:40:27:947059+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14775,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6835/1105040204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":1105040204},{"type":"v1","addr":"172.21.15.83:6835","nonce":1105040204}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14787,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/2234789563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6836","nonce":2234789563},{"type":"v1","addr":"172.21.15.83:6837","nonce":2234789563}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14838,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6839/136258364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6838","nonce":136258364},{"type":"v1","addr":"172.21.15.83:6839","nonce":136258364}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14850,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6841/129439444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6840","nonce":129439444},{"type":"v1","addr":"172.21.15.83:6841","nonce":129439444}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24569,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/2839502433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":2839502433},{"type":"v1","addr":"172.21.15.119:6833","nonce":2839502433}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24580,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6833/2841606990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":2841606990},{"type":"v1","addr":"172.21.15.142:6833","nonce":2841606990}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24599,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/415902608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":415902608},{"type":"v1","addr":"172.21.15.119:6835","nonce":415902608}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24607,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/3009088510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":3009088510},{"type":"v1","addr":"172.21.15.142:6835","nonce":3009088510}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24613,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/3847200126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6836","nonce":3847200126},{"type":"v1","addr":"172.21.15.142:6837","nonce":3847200126}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24626,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/3619222976","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":3619222976},{"type":"v1","addr":"172.21.15.119:6837","nonce":3619222976}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T01:39:45.145124+0000","modified":"2024-09-21T01:40:27.664151+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24653},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24631":{"gid":24631,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.142:6839/1817880741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6838","nonce":1817880741},{"type":"v1","addr":"172.21.15.142:6839","nonce":1817880741}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24653":{"gid":24653,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.119:6839/3106757092","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":3106757092},{"type":"v1","addr":"172.21.15.119:6839","nonce":3106757092}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24653,"qdb_cluster":[24653]},"id":1}]} 2024-09-21T01:52:30.109 INFO:teuthology.orchestra.run.smithi083.stderr:dumped fsmap epoch 21 2024-09-21T01:52:30.111 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:30.109+0000 7f7e91411640 1 -- 172.21.15.83:0/3644217401 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f7e740b6680 msgr2=0x7f7e740b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:52:30.111 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:30.109+0000 7f7e91411640 1 --2- 172.21.15.83:0/3644217401 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f7e740b6680 0x7f7e740b8b90 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f7e7c0058c0 tx=0x7f7e7c00a4c0 comp rx=0 tx=0).stop 2024-09-21T01:52:30.111 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:30.109+0000 7f7e91411640 1 -- 172.21.15.83:0/3644217401 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7e8c108d10 msgr2=0x7f7e8c19eb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:52:30.111 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:30.109+0000 7f7e91411640 1 --2- 172.21.15.83:0/3644217401 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7e8c108d10 0x7f7e8c19eb20 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f7e8400eaa0 tx=0x7f7e8400ef60 comp rx=0 tx=0).stop 2024-09-21T01:52:30.111 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:30.109+0000 7f7e91411640 1 -- 172.21.15.83:0/3644217401 shutdown_connections 2024-09-21T01:52:30.111 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:30.109+0000 7f7e91411640 1 --2- 172.21.15.83:0/3644217401 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f7e740b6680 0x7f7e740b8b90 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:52:30.111 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:30.109+0000 7f7e91411640 1 --2- 172.21.15.83:0/3644217401 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7e8c108d10 0x7f7e8c19eb20 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:52:30.111 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:30.109+0000 7f7e91411640 1 --2- 172.21.15.83:0/3644217401 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7e8c1083c0 0x7f7e8c199880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:52:30.111 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:30.109+0000 7f7e91411640 1 --2- 172.21.15.83:0/3644217401 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7e8c102a80 0x7f7e8c1992e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:52:30.112 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:30.109+0000 7f7e91411640 1 -- 172.21.15.83:0/3644217401 >> 172.21.15.83:0/3644217401 conn(0x7f7e8c079740 msgr2=0x7f7e8c1044a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:52:30.112 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:30.110+0000 7f7e91411640 1 -- 172.21.15.83:0/3644217401 shutdown_connections 2024-09-21T01:52:30.112 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:30.110+0000 7f7e91411640 1 -- 172.21.15.83:0/3644217401 wait complete. 2024-09-21T01:52:30.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:52:30 smithi083 ceph-mon[31370]: pgmap v662: 129 pgs: 129 active+clean; 21 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 306 B/s wr, 2 op/s 2024-09-21T01:52:30.464 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:52:30 smithi142 ceph-mon[34050]: pgmap v662: 129 pgs: 129 active+clean; 21 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 306 B/s wr, 2 op/s 2024-09-21T01:52:30.467 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:52:30 smithi119 ceph-mon[33693]: pgmap v662: 129 pgs: 129 active+clean; 21 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 306 B/s wr, 2 op/s 2024-09-21T01:52:30.801 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T01:52:31.049 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:52:31.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:52:31 smithi083 ceph-mon[31370]: from='client.? 172.21.15.83:0/3644217401' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:52:31.464 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:52:31 smithi142 ceph-mon[34050]: from='client.? 172.21.15.83:0/3644217401' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:52:31.467 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:52:31 smithi119 ceph-mon[33693]: from='client.? 172.21.15.83:0/3644217401' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:52:31.534 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:31.524+0000 7fd994776640 1 -- 172.21.15.83:0/647684816 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd98c109df0 msgr2=0x7fd98c110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:52:31.535 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:31.524+0000 7fd994776640 1 --2- 172.21.15.83:0/647684816 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd98c109df0 0x7fd98c110620 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fd97c009900 tx=0x7fd97c02a410 comp rx=0 tx=0).stop 2024-09-21T01:52:31.535 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:31.524+0000 7fd994776640 1 -- 172.21.15.83:0/647684816 shutdown_connections 2024-09-21T01:52:31.535 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:31.524+0000 7fd994776640 1 --2- 172.21.15.83:0/647684816 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd98c109df0 0x7fd98c110620 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:52:31.535 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:31.524+0000 7fd994776640 1 --2- 172.21.15.83:0/647684816 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd98c1094a0 0x7fd98c1098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:52:31.535 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:31.524+0000 7fd994776640 1 --2- 172.21.15.83:0/647684816 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd98c103b60 0x7fd98c103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:52:31.535 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:31.524+0000 7fd994776640 1 -- 172.21.15.83:0/647684816 >> 172.21.15.83:0/647684816 conn(0x7fd98c07b850 msgr2=0x7fd98c07bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:52:31.535 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:31.524+0000 7fd994776640 1 -- 172.21.15.83:0/647684816 shutdown_connections 2024-09-21T01:52:31.535 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:31.524+0000 7fd994776640 1 -- 172.21.15.83:0/647684816 wait complete. 2024-09-21T01:52:31.535 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:31.525+0000 7fd994776640 1 Processor -- start 2024-09-21T01:52:31.535 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:31.525+0000 7fd994776640 1 -- start start 2024-09-21T01:52:31.535 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:31.525+0000 7fd994776640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd98c103b60 0x7fd98c19a370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:52:31.536 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:31.525+0000 7fd994776640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd98c1094a0 0x7fd98c19a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:52:31.536 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:31.525+0000 7fd994776640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd98c109df0 0x7fd98c19fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:52:31.536 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:31.525+0000 7fd994776640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fd98c113960 con 0x7fd98c103b60 2024-09-21T01:52:31.536 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:31.525+0000 7fd994776640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fd98c1137e0 con 0x7fd98c1094a0 2024-09-21T01:52:31.536 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:31.525+0000 7fd994776640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fd98c113ae0 con 0x7fd98c109df0 2024-09-21T01:52:31.536 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:31.526+0000 7fd992512640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd98c103b60 0x7fd98c19a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:52:31.536 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:31.526+0000 7fd992512640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd98c103b60 0x7fd98c19a370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:38454/0 (socket says 172.21.15.83:38454) 2024-09-21T01:52:31.536 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:31.526+0000 7fd992512640 1 -- 172.21.15.83:0/728478004 learned_addr learned my addr 172.21.15.83:0/728478004 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:52:31.536 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:31.526+0000 7fd992d13640 1 --2- 172.21.15.83:0/728478004 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd98c109df0 0x7fd98c19fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:52:31.536 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:31.526+0000 7fd991d11640 1 --2- 172.21.15.83:0/728478004 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd98c1094a0 0x7fd98c19a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:52:31.537 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:31.526+0000 7fd992512640 1 -- 172.21.15.83:0/728478004 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd98c109df0 msgr2=0x7fd98c19fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:52:31.537 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:31.526+0000 7fd992512640 1 --2- 172.21.15.83:0/728478004 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd98c109df0 0x7fd98c19fbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:52:31.537 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:31.526+0000 7fd992512640 1 -- 172.21.15.83:0/728478004 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd98c1094a0 msgr2=0x7fd98c19a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:52:31.537 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:31.526+0000 7fd992512640 1 --2- 172.21.15.83:0/728478004 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd98c1094a0 0x7fd98c19a910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:52:31.537 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:31.526+0000 7fd992512640 1 -- 172.21.15.83:0/728478004 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd98c1a02e0 con 0x7fd98c103b60 2024-09-21T01:52:31.537 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:31.526+0000 7fd991d11640 1 --2- 172.21.15.83:0/728478004 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd98c1094a0 0x7fd98c19a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:52:31.537 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:31.526+0000 7fd992512640 1 --2- 172.21.15.83:0/728478004 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd98c103b60 0x7fd98c19a370 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fd98400db80 tx=0x7fd98400b630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:52:31.537 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:31.526+0000 7fd98b7fe640 1 -- 172.21.15.83:0/728478004 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd984017070 con 0x7fd98c103b60 2024-09-21T01:52:31.537 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:31.526+0000 7fd994776640 1 -- 172.21.15.83:0/728478004 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd98c1a05d0 con 0x7fd98c103b60 2024-09-21T01:52:31.537 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:31.526+0000 7fd98b7fe640 1 -- 172.21.15.83:0/728478004 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd984004020 con 0x7fd98c103b60 2024-09-21T01:52:31.537 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:31.526+0000 7fd98b7fe640 1 -- 172.21.15.83:0/728478004 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd98400be60 con 0x7fd98c103b60 2024-09-21T01:52:31.537 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:31.526+0000 7fd994776640 1 -- 172.21.15.83:0/728478004 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd98c1a6d30 con 0x7fd98c103b60 2024-09-21T01:52:31.538 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:31.527+0000 7fd994776640 1 -- 172.21.15.83:0/728478004 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd98c103f70 con 0x7fd98c103b60 2024-09-21T01:52:31.538 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:31.529+0000 7fd98b7fe640 1 -- 172.21.15.83:0/728478004 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7fd984003b70 con 0x7fd98c103b60 2024-09-21T01:52:31.538 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:31.530+0000 7fd98b7fe640 1 --2- 172.21.15.83:0/728478004 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fd9740b6680 0x7fd9740b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:52:31.538 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:31.530+0000 7fd991d11640 1 --2- 172.21.15.83:0/728478004 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fd9740b6680 0x7fd9740b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:52:31.538 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:31.530+0000 7fd98b7fe640 1 -- 172.21.15.83:0/728478004 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9403+0+0 (secure 0 0 0) 0x7fd9840e7f80 con 0x7fd98c103b60 2024-09-21T01:52:31.538 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:31.530+0000 7fd991d11640 1 --2- 172.21.15.83:0/728478004 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fd9740b6680 0x7fd9740b8b90 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fd98c106450 tx=0x7fd980005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:52:31.538 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:31.533+0000 7fd98b7fe640 1 -- 172.21.15.83:0/728478004 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd9840ae100 con 0x7fd98c103b60 2024-09-21T01:52:31.749 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:31.747+0000 7fd994776640 1 -- 172.21.15.83:0/728478004 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd98c02e640 con 0x7fd98c103b60 2024-09-21T01:52:31.749 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:31.748+0000 7fd98b7fe640 1 -- 172.21.15.83:0/728478004 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11857 (secure 0 0 0) 0x7fd9840b24e0 con 0x7fd98c103b60 2024-09-21T01:52:31.750 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T01:52:31.750 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":21,"btime":"2024-09-21T01:40:27:947059+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14775,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6835/1105040204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6834","nonce":1105040204},{"type":"v1","addr":"172.21.15.83:6835","nonce":1105040204}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14787,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6837/2234789563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6836","nonce":2234789563},{"type":"v1","addr":"172.21.15.83:6837","nonce":2234789563}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14838,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6839/136258364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6838","nonce":136258364},{"type":"v1","addr":"172.21.15.83:6839","nonce":136258364}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14850,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6841/129439444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6840","nonce":129439444},{"type":"v1","addr":"172.21.15.83:6841","nonce":129439444}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24569,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6833/2839502433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":2839502433},{"type":"v1","addr":"172.21.15.119:6833","nonce":2839502433}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24580,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6833/2841606990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":2841606990},{"type":"v1","addr":"172.21.15.142:6833","nonce":2841606990}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24599,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/415902608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":415902608},{"type":"v1","addr":"172.21.15.119:6835","nonce":415902608}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24607,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/3009088510","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":3009088510},{"type":"v1","addr":"172.21.15.142:6835","nonce":3009088510}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24613,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/3847200126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6836","nonce":3847200126},{"type":"v1","addr":"172.21.15.142:6837","nonce":3847200126}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24626,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/3619222976","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":3619222976},{"type":"v1","addr":"172.21.15.119:6837","nonce":3619222976}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T01:39:45.145124+0000","modified":"2024-09-21T01:40:27.664151+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24653},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24631":{"gid":24631,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.142:6839/1817880741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6838","nonce":1817880741},{"type":"v1","addr":"172.21.15.142:6839","nonce":1817880741}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24653":{"gid":24653,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.119:6839/3106757092","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6838","nonce":3106757092},{"type":"v1","addr":"172.21.15.119:6839","nonce":3106757092}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24653,"qdb_cluster":[24653]},"id":1}]} 2024-09-21T01:52:31.750 INFO:teuthology.orchestra.run.smithi083.stderr:dumped fsmap epoch 21 2024-09-21T01:52:31.753 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:31.751+0000 7fd994776640 1 -- 172.21.15.83:0/728478004 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fd9740b6680 msgr2=0x7fd9740b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:52:31.753 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:31.751+0000 7fd994776640 1 --2- 172.21.15.83:0/728478004 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fd9740b6680 0x7fd9740b8b90 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fd98c106450 tx=0x7fd980005f90 comp rx=0 tx=0).stop 2024-09-21T01:52:31.753 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:31.751+0000 7fd994776640 1 -- 172.21.15.83:0/728478004 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd98c103b60 msgr2=0x7fd98c19a370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:52:31.753 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:31.751+0000 7fd994776640 1 --2- 172.21.15.83:0/728478004 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd98c103b60 0x7fd98c19a370 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fd98400db80 tx=0x7fd98400b630 comp rx=0 tx=0).stop 2024-09-21T01:52:31.753 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:31.751+0000 7fd994776640 1 -- 172.21.15.83:0/728478004 shutdown_connections 2024-09-21T01:52:31.753 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:31.751+0000 7fd994776640 1 --2- 172.21.15.83:0/728478004 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fd9740b6680 0x7fd9740b8b90 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:52:31.753 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:31.751+0000 7fd994776640 1 --2- 172.21.15.83:0/728478004 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd98c109df0 0x7fd98c19fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:52:31.753 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:31.751+0000 7fd994776640 1 --2- 172.21.15.83:0/728478004 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd98c1094a0 0x7fd98c19a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:52:31.753 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:31.751+0000 7fd994776640 1 --2- 172.21.15.83:0/728478004 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd98c103b60 0x7fd98c19a370 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:52:31.753 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:31.751+0000 7fd994776640 1 -- 172.21.15.83:0/728478004 >> 172.21.15.83:0/728478004 conn(0x7fd98c07b850 msgr2=0x7fd98c107590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:52:31.753 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:31.751+0000 7fd994776640 1 -- 172.21.15.83:0/728478004 shutdown_connections 2024-09-21T01:52:31.754 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:31.751+0000 7fd994776640 1 -- 172.21.15.83:0/728478004 wait complete. 2024-09-21T01:52:32.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:52:32 smithi083 ceph-mon[31370]: pgmap v663: 129 pgs: 129 active+clean; 21 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-09-21T01:52:32.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:52:32 smithi083 ceph-mon[31370]: from='client.? 172.21.15.83:0/728478004' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:52:32.461 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T01:52:32.464 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:52:32 smithi142 ceph-mon[34050]: pgmap v663: 129 pgs: 129 active+clean; 21 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-09-21T01:52:32.464 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:52:32 smithi142 ceph-mon[34050]: from='client.? 172.21.15.83:0/728478004' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:52:32.467 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:52:32 smithi119 ceph-mon[33693]: pgmap v663: 129 pgs: 129 active+clean; 21 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-09-21T01:52:32.467 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:52:32 smithi119 ceph-mon[33693]: from='client.? 172.21.15.83:0/728478004' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T01:52:32.713 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:52:33.170 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:33.153+0000 7f2194c0e640 1 -- 172.21.15.83:0/2229742782 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f219010de20 msgr2=0x7f2190110310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:52:33.171 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:33.153+0000 7f2194c0e640 1 --2- 172.21.15.83:0/2229742782 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f219010de20 0x7f2190110310 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f2188009ca0 tx=0x7f218802a8c0 comp rx=0 tx=0).stop 2024-09-21T01:52:33.171 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:33.153+0000 7f2194c0e640 1 -- 172.21.15.83:0/2229742782 shutdown_connections 2024-09-21T01:52:33.171 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:33.153+0000 7f2194c0e640 1 --2- 172.21.15.83:0/2229742782 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f219010de20 0x7f2190110310 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:52:33.171 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:33.153+0000 7f2194c0e640 1 --2- 172.21.15.83:0/2229742782 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2190105310 0x7f219010d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:52:33.171 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:33.153+0000 7f2194c0e640 1 --2- 172.21.15.83:0/2229742782 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f21901049c0 0x7f2190104dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:52:33.171 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:33.153+0000 7f2194c0e640 1 -- 172.21.15.83:0/2229742782 >> 172.21.15.83:0/2229742782 conn(0x7f2190079710 msgr2=0x7f2190079b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:52:33.171 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:33.153+0000 7f2194c0e640 1 -- 172.21.15.83:0/2229742782 shutdown_connections 2024-09-21T01:52:33.171 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:33.153+0000 7f2194c0e640 1 -- 172.21.15.83:0/2229742782 wait complete. 2024-09-21T01:52:33.171 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:33.154+0000 7f2194c0e640 1 Processor -- start 2024-09-21T01:52:33.171 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:33.154+0000 7f2194c0e640 1 -- start start 2024-09-21T01:52:33.171 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:33.154+0000 7f2194c0e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f21901049c0 0x7f219019a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:52:33.171 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:33.154+0000 7f2194c0e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2190105310 0x7f219019a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:52:33.171 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:33.154+0000 7f2194c0e640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f219010de20 0x7f219019fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:52:33.172 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:33.154+0000 7f2194c0e640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f21901139a0 con 0x7f219010de20 2024-09-21T01:52:33.172 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:33.154+0000 7f2194c0e640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f2190113820 con 0x7f21901049c0 2024-09-21T01:52:33.172 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:33.154+0000 7f2194c0e640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f2190113b20 con 0x7f2190105310 2024-09-21T01:52:33.172 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:33.155+0000 7f218ed9d640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f219010de20 0x7f219019fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:52:33.172 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:33.155+0000 7f218ed9d640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f219010de20 0x7f219019fbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:57620/0 (socket says 172.21.15.83:57620) 2024-09-21T01:52:33.172 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:33.155+0000 7f218ed9d640 1 -- 172.21.15.83:0/2015077902 learned_addr learned my addr 172.21.15.83:0/2015077902 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:52:33.172 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:33.155+0000 7f2187fff640 1 --2- 172.21.15.83:0/2015077902 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2190105310 0x7f219019a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:52:33.172 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:33.155+0000 7f218e59c640 1 --2- 172.21.15.83:0/2015077902 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f21901049c0 0x7f219019a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:52:33.172 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:33.155+0000 7f218ed9d640 1 -- 172.21.15.83:0/2015077902 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2190105310 msgr2=0x7f219019a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:52:33.172 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:33.155+0000 7f218ed9d640 1 --2- 172.21.15.83:0/2015077902 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2190105310 0x7f219019a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:52:33.172 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:33.155+0000 7f218ed9d640 1 -- 172.21.15.83:0/2015077902 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f21901049c0 msgr2=0x7f219019a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:52:33.172 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:33.155+0000 7f218ed9d640 1 --2- 172.21.15.83:0/2015077902 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f21901049c0 0x7f219019a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:52:33.172 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:33.155+0000 7f218ed9d640 1 -- 172.21.15.83:0/2015077902 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21901a0300 con 0x7f219010de20 2024-09-21T01:52:33.172 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:33.155+0000 7f218ed9d640 1 --2- 172.21.15.83:0/2015077902 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f219010de20 0x7f219019fbd0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f2188005cc0 tx=0x7f2188032a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:52:33.173 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:33.155+0000 7f21877fe640 1 -- 172.21.15.83:0/2015077902 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2188032e00 con 0x7f219010de20 2024-09-21T01:52:33.173 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:33.155+0000 7f21877fe640 1 -- 172.21.15.83:0/2015077902 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f21880044d0 con 0x7f219010de20 2024-09-21T01:52:33.173 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:33.155+0000 7f2194c0e640 1 -- 172.21.15.83:0/2015077902 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21901a0590 con 0x7f219010de20 2024-09-21T01:52:33.173 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:33.155+0000 7f21877fe640 1 -- 172.21.15.83:0/2015077902 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2188030b70 con 0x7f219010de20 2024-09-21T01:52:33.173 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:33.155+0000 7f2194c0e640 1 -- 172.21.15.83:0/2015077902 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21901a6d50 con 0x7f219010de20 2024-09-21T01:52:33.173 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:33.157+0000 7f2194c0e640 1 -- 172.21.15.83:0/2015077902 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f219006c260 con 0x7f219010de20 2024-09-21T01:52:33.173 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:33.158+0000 7f21877fe640 1 -- 172.21.15.83:0/2015077902 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7f2188030d10 con 0x7f219010de20 2024-09-21T01:52:33.173 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:33.159+0000 7f21877fe640 1 --2- 172.21.15.83:0/2015077902 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f217c0b6680 0x7f217c0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:52:33.173 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:33.159+0000 7f218e59c640 1 --2- 172.21.15.83:0/2015077902 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f217c0b6680 0x7f217c0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:52:33.173 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:33.159+0000 7f21877fe640 1 -- 172.21.15.83:0/2015077902 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9403+0+0 (secure 0 0 0) 0x7f2188108ef0 con 0x7f219010de20 2024-09-21T01:52:33.173 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:33.159+0000 7f218e59c640 1 --2- 172.21.15.83:0/2015077902 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f217c0b6680 0x7f217c0b8b90 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f2180005fd0 tx=0x7f2180005850 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:52:33.173 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:33.162+0000 7f21877fe640 1 -- 172.21.15.83:0/2015077902 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f21880cf0d0 con 0x7f219010de20 2024-09-21T01:52:33.347 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:33.347+0000 7f2194c0e640 1 -- 172.21.15.83:0/2015077902 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f21901a6f20 con 0x7f219010de20 2024-09-21T01:52:33.349 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:33.348+0000 7f21877fe640 1 -- 172.21.15.83:0/2015077902 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v94) ==== 74+0+25277 (secure 0 0 0) 0x7f21880d34b0 con 0x7f219010de20 2024-09-21T01:52:33.349 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-09-21T01:52:33.349 INFO:teuthology.orchestra.run.smithi083.stdout:{"epoch":94,"fsid":"f7697ecc-77b8-11ef-baf5-efdc52797490","created":"2024-09-21T01:31:22.250342+0000","modified":"2024-09-21T01:52:18.999263+0000","last_up_change":"2024-09-21T01:38:53.501659+0000","last_in_change":"2024-09-21T01:38:30.688516+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T01:35:06.977668+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T01:39:41.041950+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T01:39:42.882272+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"93","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":17,"snap_epoch":93,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T01:39:49.320532+0000","flags":8197,"flags_names":"hashpspool,ec_overwrites,selfmanaged_snaps","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"93","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":17,"snap_epoch":93,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"66947512-01ee-4bf0-87b0-98a168cf50dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":3563457494},{"type":"v1","addr":"172.21.15.83:6803","nonce":3563457494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":3563457494},{"type":"v1","addr":"172.21.15.83:6805","nonce":3563457494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":3563457494},{"type":"v1","addr":"172.21.15.83:6809","nonce":3563457494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":3563457494},{"type":"v1","addr":"172.21.15.83:6807","nonce":3563457494}]},"public_addr":"172.21.15.83:6803/3563457494","cluster_addr":"172.21.15.83:6805/3563457494","heartbeat_back_addr":"172.21.15.83:6809/3563457494","heartbeat_front_addr":"172.21.15.83:6807/3563457494","state":["exists","up"]},{"osd":1,"uuid":"f7818a08-86a5-412d-a164-cfeb18f8650a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":2066870220},{"type":"v1","addr":"172.21.15.119:6801","nonce":2066870220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":2066870220},{"type":"v1","addr":"172.21.15.119:6803","nonce":2066870220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":2066870220},{"type":"v1","addr":"172.21.15.119:6807","nonce":2066870220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":2066870220},{"type":"v1","addr":"172.21.15.119:6805","nonce":2066870220}]},"public_addr":"172.21.15.119:6801/2066870220","cluster_addr":"172.21.15.119:6803/2066870220","heartbeat_back_addr":"172.21.15.119:6807/2066870220","heartbeat_front_addr":"172.21.15.119:6805/2066870220","state":["exists","up"]},{"osd":2,"uuid":"0d1a3870-c67a-4783-85f9-be2bb36f7722","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":3955936117},{"type":"v1","addr":"172.21.15.142:6801","nonce":3955936117}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3955936117},{"type":"v1","addr":"172.21.15.142:6803","nonce":3955936117}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":3955936117},{"type":"v1","addr":"172.21.15.142:6807","nonce":3955936117}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":3955936117},{"type":"v1","addr":"172.21.15.142:6805","nonce":3955936117}]},"public_addr":"172.21.15.142:6801/3955936117","cluster_addr":"172.21.15.142:6803/3955936117","heartbeat_back_addr":"172.21.15.142:6807/3955936117","heartbeat_front_addr":"172.21.15.142:6805/3955936117","state":["exists","up"]},{"osd":3,"uuid":"a4cb1a36-3495-4d36-92da-ed3b6e852d14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6810","nonce":3746834093},{"type":"v1","addr":"172.21.15.83:6811","nonce":3746834093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":3746834093},{"type":"v1","addr":"172.21.15.83:6813","nonce":3746834093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":3746834093},{"type":"v1","addr":"172.21.15.83:6817","nonce":3746834093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6814","nonce":3746834093},{"type":"v1","addr":"172.21.15.83:6815","nonce":3746834093}]},"public_addr":"172.21.15.83:6811/3746834093","cluster_addr":"172.21.15.83:6813/3746834093","heartbeat_back_addr":"172.21.15.83:6817/3746834093","heartbeat_front_addr":"172.21.15.83:6815/3746834093","state":["exists","up"]},{"osd":4,"uuid":"d6f2ec78-7f08-473b-a96c-e8590f5d2f25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":3083907785},{"type":"v1","addr":"172.21.15.119:6809","nonce":3083907785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":3083907785},{"type":"v1","addr":"172.21.15.119:6811","nonce":3083907785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":3083907785},{"type":"v1","addr":"172.21.15.119:6815","nonce":3083907785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":3083907785},{"type":"v1","addr":"172.21.15.119:6813","nonce":3083907785}]},"public_addr":"172.21.15.119:6809/3083907785","cluster_addr":"172.21.15.119:6811/3083907785","heartbeat_back_addr":"172.21.15.119:6815/3083907785","heartbeat_front_addr":"172.21.15.119:6813/3083907785","state":["exists","up"]},{"osd":5,"uuid":"c571d04d-d3ea-4d74-8867-e4c7816f4e0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":349001002},{"type":"v1","addr":"172.21.15.142:6809","nonce":349001002}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":349001002},{"type":"v1","addr":"172.21.15.142:6811","nonce":349001002}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":349001002},{"type":"v1","addr":"172.21.15.142:6815","nonce":349001002}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":349001002},{"type":"v1","addr":"172.21.15.142:6813","nonce":349001002}]},"public_addr":"172.21.15.142:6809/349001002","cluster_addr":"172.21.15.142:6811/349001002","heartbeat_back_addr":"172.21.15.142:6815/349001002","heartbeat_front_addr":"172.21.15.142:6813/349001002","state":["exists","up"]},{"osd":6,"uuid":"6e1b6fe9-700a-448a-b382-59b97896ea7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6818","nonce":771651063},{"type":"v1","addr":"172.21.15.83:6819","nonce":771651063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":771651063},{"type":"v1","addr":"172.21.15.83:6821","nonce":771651063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":771651063},{"type":"v1","addr":"172.21.15.83:6825","nonce":771651063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6822","nonce":771651063},{"type":"v1","addr":"172.21.15.83:6823","nonce":771651063}]},"public_addr":"172.21.15.83:6819/771651063","cluster_addr":"172.21.15.83:6821/771651063","heartbeat_back_addr":"172.21.15.83:6825/771651063","heartbeat_front_addr":"172.21.15.83:6823/771651063","state":["exists","up"]},{"osd":7,"uuid":"283bfae4-5f50-4f9e-860e-bbfd47e005e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":1556984819},{"type":"v1","addr":"172.21.15.119:6817","nonce":1556984819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":1556984819},{"type":"v1","addr":"172.21.15.119:6819","nonce":1556984819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6822","nonce":1556984819},{"type":"v1","addr":"172.21.15.119:6823","nonce":1556984819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":1556984819},{"type":"v1","addr":"172.21.15.119:6821","nonce":1556984819}]},"public_addr":"172.21.15.119:6817/1556984819","cluster_addr":"172.21.15.119:6819/1556984819","heartbeat_back_addr":"172.21.15.119:6823/1556984819","heartbeat_front_addr":"172.21.15.119:6821/1556984819","state":["exists","up"]},{"osd":8,"uuid":"d46e56d4-ed4e-42c3-a315-66af014bd93a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":1860679473},{"type":"v1","addr":"172.21.15.142:6817","nonce":1860679473}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":1860679473},{"type":"v1","addr":"172.21.15.142:6819","nonce":1860679473}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":1860679473},{"type":"v1","addr":"172.21.15.142:6823","nonce":1860679473}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":1860679473},{"type":"v1","addr":"172.21.15.142:6821","nonce":1860679473}]},"public_addr":"172.21.15.142:6817/1860679473","cluster_addr":"172.21.15.142:6819/1860679473","heartbeat_back_addr":"172.21.15.142:6823/1860679473","heartbeat_front_addr":"172.21.15.142:6821/1860679473","state":["exists","up"]},{"osd":9,"uuid":"18a70ee6-56df-4f5c-868d-5db5e72a1859","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":3636757924},{"type":"v1","addr":"172.21.15.83:6827","nonce":3636757924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":3636757924},{"type":"v1","addr":"172.21.15.83:6829","nonce":3636757924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6832","nonce":3636757924},{"type":"v1","addr":"172.21.15.83:6833","nonce":3636757924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":3636757924},{"type":"v1","addr":"172.21.15.83:6831","nonce":3636757924}]},"public_addr":"172.21.15.83:6827/3636757924","cluster_addr":"172.21.15.83:6829/3636757924","heartbeat_back_addr":"172.21.15.83:6833/3636757924","heartbeat_front_addr":"172.21.15.83:6831/3636757924","state":["exists","up"]},{"osd":10,"uuid":"0d32c3de-db03-42c3-9914-07d675aaa339","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":2561963910},{"type":"v1","addr":"172.21.15.119:6825","nonce":2561963910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6826","nonce":2561963910},{"type":"v1","addr":"172.21.15.119:6827","nonce":2561963910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2561963910},{"type":"v1","addr":"172.21.15.119:6831","nonce":2561963910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2561963910},{"type":"v1","addr":"172.21.15.119:6829","nonce":2561963910}]},"public_addr":"172.21.15.119:6825/2561963910","cluster_addr":"172.21.15.119:6827/2561963910","heartbeat_back_addr":"172.21.15.119:6831/2561963910","heartbeat_front_addr":"172.21.15.119:6829/2561963910","state":["exists","up"]},{"osd":11,"uuid":"3a3b444d-b316-4256-bfad-378db29f0824","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":1174646198},{"type":"v1","addr":"172.21.15.142:6825","nonce":1174646198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":1174646198},{"type":"v1","addr":"172.21.15.142:6827","nonce":1174646198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1174646198},{"type":"v1","addr":"172.21.15.142:6831","nonce":1174646198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1174646198},{"type":"v1","addr":"172.21.15.142:6829","nonce":1174646198}]},"public_addr":"172.21.15.142:6825/1174646198","cluster_addr":"172.21.15.142:6827/1174646198","heartbeat_back_addr":"172.21.15.142:6831/1174646198","heartbeat_front_addr":"172.21.15.142:6829/1174646198","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:34:15.337672+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:34:39.259716+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:35:03.348886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:35:29.465711+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:35:53.744378+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:36:19.488785+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:36:45.708616+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:37:11.501065+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:37:36.027277+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:38:01.903625+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:38:27.215212+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T01:38:51.891278+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.e","mappings":[{"from":4,"to":8},{"from":5,"to":9}]},{"pgid":"3.11","mappings":[{"from":4,"to":6}]},{"pgid":"4.3","mappings":[{"from":5,"to":8}]},{"pgid":"4.10","mappings":[{"from":9,"to":8}]},{"pgid":"4.12","mappings":[{"from":9,"to":10}]},{"pgid":"4.1c","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.83:0/1619062496":"2024-09-22T01:33:08.666525+0000","172.21.15.83:0/2412709299":"2024-09-22T01:31:45.834450+0000","172.21.15.83:6800/4290325964":"2024-09-22T01:31:45.834450+0000","172.21.15.83:6801/4290325964":"2024-09-22T01:31:45.834450+0000","172.21.15.83:0/1440681183":"2024-09-22T01:31:45.834450+0000","172.21.15.83:0/2745413305":"2024-09-22T01:31:45.834450+0000","172.21.15.83:6800/1393748565":"2024-09-22T01:33:08.666525+0000","172.21.15.83:0/110411274":"2024-09-22T01:32:10.073024+0000","172.21.15.83:0/4267551123":"2024-09-22T01:33:08.666525+0000","172.21.15.83:0/1068434643":"2024-09-22T01:32:10.073024+0000","172.21.15.83:6800/2963261730":"2024-09-22T01:32:10.073024+0000","172.21.15.83:0/3544333975":"2024-09-22T01:32:10.073024+0000","172.21.15.83:6801/1393748565":"2024-09-22T01:33:08.666525+0000","172.21.15.83:6801/2963261730":"2024-09-22T01:32:10.073024+0000","172.21.15.83:0/1915285091":"2024-09-22T01:33:08.666525+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":6,"length":1},{"begin":17,"length":1}]},{"pool":4,"snaps":[{"begin":6,"length":1},{"begin":17,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T01:52:33.352 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:33.351+0000 7f2194c0e640 1 -- 172.21.15.83:0/2015077902 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f217c0b6680 msgr2=0x7f217c0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:52:33.352 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:33.351+0000 7f2194c0e640 1 --2- 172.21.15.83:0/2015077902 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f217c0b6680 0x7f217c0b8b90 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f2180005fd0 tx=0x7f2180005850 comp rx=0 tx=0).stop 2024-09-21T01:52:33.352 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:33.351+0000 7f2194c0e640 1 -- 172.21.15.83:0/2015077902 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f219010de20 msgr2=0x7f219019fbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:52:33.352 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:33.351+0000 7f2194c0e640 1 --2- 172.21.15.83:0/2015077902 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f219010de20 0x7f219019fbd0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f2188005cc0 tx=0x7f2188032a10 comp rx=0 tx=0).stop 2024-09-21T01:52:33.352 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:33.351+0000 7f2194c0e640 1 -- 172.21.15.83:0/2015077902 shutdown_connections 2024-09-21T01:52:33.352 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:33.351+0000 7f2194c0e640 1 --2- 172.21.15.83:0/2015077902 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f217c0b6680 0x7f217c0b8b90 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:52:33.352 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:33.351+0000 7f2194c0e640 1 --2- 172.21.15.83:0/2015077902 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f219010de20 0x7f219019fbd0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:52:33.352 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:33.351+0000 7f2194c0e640 1 --2- 172.21.15.83:0/2015077902 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2190105310 0x7f219019a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:52:33.352 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:33.351+0000 7f2194c0e640 1 --2- 172.21.15.83:0/2015077902 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f21901049c0 0x7f219019a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:52:33.352 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:33.351+0000 7f2194c0e640 1 -- 172.21.15.83:0/2015077902 >> 172.21.15.83:0/2015077902 conn(0x7f2190079710 msgr2=0x7f2190107940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:52:33.352 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:33.351+0000 7f2194c0e640 1 -- 172.21.15.83:0/2015077902 shutdown_connections 2024-09-21T01:52:33.353 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:33.351+0000 7f2194c0e640 1 -- 172.21.15.83:0/2015077902 wait complete. 2024-09-21T01:52:34.012 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph fs fail cephfs 2024-09-21T01:52:34.260 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:52:34.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:52:34 smithi083 ceph-mon[31370]: pgmap v664: 129 pgs: 129 active+clean; 21 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-09-21T01:52:34.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:52:34 smithi083 ceph-mon[31370]: from='client.? 172.21.15.83:0/2015077902' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T01:52:34.464 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:52:34 smithi142 ceph-mon[34050]: pgmap v664: 129 pgs: 129 active+clean; 21 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-09-21T01:52:34.465 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:52:34 smithi142 ceph-mon[34050]: from='client.? 172.21.15.83:0/2015077902' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T01:52:34.467 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:52:34 smithi119 ceph-mon[33693]: pgmap v664: 129 pgs: 129 active+clean; 21 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-09-21T01:52:34.468 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:52:34 smithi119 ceph-mon[33693]: from='client.? 172.21.15.83:0/2015077902' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T01:52:34.754 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:34.753+0000 7fce5fa7e640 1 -- 172.21.15.83:0/1081337511 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fce581083a0 msgr2=0x7fce581087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:52:34.754 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:34.753+0000 7fce5fa7e640 1 --2- 172.21.15.83:0/1081337511 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fce581083a0 0x7fce581087b0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fce4c009900 tx=0x7fce4c02a410 comp rx=0 tx=0).stop 2024-09-21T01:52:34.754 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:34.753+0000 7fce5fa7e640 1 -- 172.21.15.83:0/1081337511 shutdown_connections 2024-09-21T01:52:34.754 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:34.753+0000 7fce5fa7e640 1 --2- 172.21.15.83:0/1081337511 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fce58108cf0 0x7fce5810f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:52:34.754 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:34.753+0000 7fce5fa7e640 1 --2- 172.21.15.83:0/1081337511 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fce581083a0 0x7fce581087b0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:52:34.754 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:34.753+0000 7fce5fa7e640 1 --2- 172.21.15.83:0/1081337511 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fce58102a60 0x7fce58102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:52:34.754 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:34.753+0000 7fce5fa7e640 1 -- 172.21.15.83:0/1081337511 >> 172.21.15.83:0/1081337511 conn(0x7fce58079730 msgr2=0x7fce58079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:52:34.754 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:34.753+0000 7fce5fa7e640 1 -- 172.21.15.83:0/1081337511 shutdown_connections 2024-09-21T01:52:34.754 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:34.753+0000 7fce5fa7e640 1 -- 172.21.15.83:0/1081337511 wait complete. 2024-09-21T01:52:34.756 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:34.754+0000 7fce5fa7e640 1 Processor -- start 2024-09-21T01:52:34.756 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:34.754+0000 7fce5fa7e640 1 -- start start 2024-09-21T01:52:34.756 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:34.754+0000 7fce5fa7e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fce58102a60 0x7fce58199340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:52:34.756 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:34.754+0000 7fce5fa7e640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fce581083a0 0x7fce581998e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:52:34.756 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:34.754+0000 7fce5fa7e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fce58108cf0 0x7fce5819eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:52:34.756 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:34.754+0000 7fce5fa7e640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fce58112870 con 0x7fce581083a0 2024-09-21T01:52:34.756 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:34.754+0000 7fce5fa7e640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7fce581126f0 con 0x7fce58108cf0 2024-09-21T01:52:34.756 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:34.755+0000 7fce5fa7e640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fce581129f0 con 0x7fce58102a60 2024-09-21T01:52:34.756 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:34.755+0000 7fce5d019640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fce581083a0 0x7fce581998e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:52:34.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:34.755+0000 7fce5d019640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fce581083a0 0x7fce581998e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:57630/0 (socket says 172.21.15.83:57630) 2024-09-21T01:52:34.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:34.755+0000 7fce5d019640 1 -- 172.21.15.83:0/1813930192 learned_addr learned my addr 172.21.15.83:0/1813930192 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:52:34.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:34.755+0000 7fce5d81a640 1 --2- 172.21.15.83:0/1813930192 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fce58102a60 0x7fce58199340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:52:34.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:34.755+0000 7fce5d019640 1 -- 172.21.15.83:0/1813930192 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fce58102a60 msgr2=0x7fce58199340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:52:34.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:34.755+0000 7fce5d019640 1 --2- 172.21.15.83:0/1813930192 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fce58102a60 0x7fce58199340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:52:34.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:34.755+0000 7fce5e01b640 1 --2- 172.21.15.83:0/1813930192 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fce58108cf0 0x7fce5819eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:52:34.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:34.755+0000 7fce5d019640 1 -- 172.21.15.83:0/1813930192 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fce58108cf0 msgr2=0x7fce5819eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:52:34.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:34.755+0000 7fce5d019640 1 --2- 172.21.15.83:0/1813930192 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fce58108cf0 0x7fce5819eb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:52:34.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:34.755+0000 7fce5d019640 1 -- 172.21.15.83:0/1813930192 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce5819f2b0 con 0x7fce581083a0 2024-09-21T01:52:34.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:34.755+0000 7fce5d019640 1 --2- 172.21.15.83:0/1813930192 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fce581083a0 0x7fce581998e0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fce4c005940 tx=0x7fce4c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:52:34.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:34.755+0000 7fce56ffd640 1 -- 172.21.15.83:0/1813930192 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce4c03f030 con 0x7fce581083a0 2024-09-21T01:52:34.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:34.755+0000 7fce5fa7e640 1 -- 172.21.15.83:0/1813930192 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce5819f540 con 0x7fce581083a0 2024-09-21T01:52:34.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:34.755+0000 7fce56ffd640 1 -- 172.21.15.83:0/1813930192 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fce4c003c90 con 0x7fce581083a0 2024-09-21T01:52:34.757 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:34.755+0000 7fce56ffd640 1 -- 172.21.15.83:0/1813930192 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce4c035070 con 0x7fce581083a0 2024-09-21T01:52:34.758 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:34.755+0000 7fce5fa7e640 1 -- 172.21.15.83:0/1813930192 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce581a5d00 con 0x7fce581083a0 2024-09-21T01:52:34.758 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:34.756+0000 7fce5fa7e640 1 -- 172.21.15.83:0/1813930192 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce58102e70 con 0x7fce581083a0 2024-09-21T01:52:34.758 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:34.758+0000 7fce56ffd640 1 -- 172.21.15.83:0/1813930192 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7fce4c042030 con 0x7fce581083a0 2024-09-21T01:52:34.759 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:34.759+0000 7fce56ffd640 1 --2- 172.21.15.83:0/1813930192 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fce400b6680 0x7fce400b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:52:34.759 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:34.759+0000 7fce5d81a640 1 --2- 172.21.15.83:0/1813930192 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fce400b6680 0x7fce400b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:52:34.760 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:34.759+0000 7fce56ffd640 1 -- 172.21.15.83:0/1813930192 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9403+0+0 (secure 0 0 0) 0x7fce4c108450 con 0x7fce581083a0 2024-09-21T01:52:34.760 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:34.760+0000 7fce5d81a640 1 --2- 172.21.15.83:0/1813930192 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fce400b6680 0x7fce400b8b90 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fce48005fd0 tx=0x7fce4800b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:52:34.763 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:34.763+0000 7fce56ffd640 1 -- 172.21.15.83:0/1813930192 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fce4c0ce5d0 con 0x7fce581083a0 2024-09-21T01:52:34.980 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:34.980+0000 7fce5fa7e640 1 -- 172.21.15.83:0/1813930192 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fce5819a470 con 0x7fce581083a0 2024-09-21T01:52:34.983 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:34.982+0000 7fce56ffd640 1 -- 172.21.15.83:0/1813930192 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v22) ==== 161+0+0 (secure 0 0 0) 0x7fce5819a470 con 0x7fce581083a0 2024-09-21T01:52:34.983 INFO:teuthology.orchestra.run.smithi083.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-21T01:52:34.987 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:34.986+0000 7fce5fa7e640 1 -- 172.21.15.83:0/1813930192 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fce400b6680 msgr2=0x7fce400b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:52:34.987 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:34.986+0000 7fce5fa7e640 1 --2- 172.21.15.83:0/1813930192 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fce400b6680 0x7fce400b8b90 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fce48005fd0 tx=0x7fce4800b390 comp rx=0 tx=0).stop 2024-09-21T01:52:34.987 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:34.986+0000 7fce5fa7e640 1 -- 172.21.15.83:0/1813930192 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fce581083a0 msgr2=0x7fce581998e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:52:34.987 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:34.986+0000 7fce5fa7e640 1 --2- 172.21.15.83:0/1813930192 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fce581083a0 0x7fce581998e0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fce4c005940 tx=0x7fce4c0042f0 comp rx=0 tx=0).stop 2024-09-21T01:52:34.987 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:34.986+0000 7fce5fa7e640 1 -- 172.21.15.83:0/1813930192 shutdown_connections 2024-09-21T01:52:34.987 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:34.986+0000 7fce5fa7e640 1 --2- 172.21.15.83:0/1813930192 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7fce400b6680 0x7fce400b8b90 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:52:34.987 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:34.986+0000 7fce5fa7e640 1 --2- 172.21.15.83:0/1813930192 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fce58108cf0 0x7fce5819eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:52:34.987 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:34.986+0000 7fce5fa7e640 1 --2- 172.21.15.83:0/1813930192 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fce581083a0 0x7fce581998e0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:52:34.987 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:34.986+0000 7fce5fa7e640 1 --2- 172.21.15.83:0/1813930192 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fce58102a60 0x7fce58199340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:52:34.987 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:34.986+0000 7fce5fa7e640 1 -- 172.21.15.83:0/1813930192 >> 172.21.15.83:0/1813930192 conn(0x7fce58079730 msgr2=0x7fce58105350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:52:34.987 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:34.986+0000 7fce5fa7e640 1 -- 172.21.15.83:0/1813930192 shutdown_connections 2024-09-21T01:52:34.987 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:34.986+0000 7fce5fa7e640 1 -- 172.21.15.83:0/1813930192 wait complete. 2024-09-21T01:52:35.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:52:34 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mon-a[31366]: 2024-09-21T01:52:34.981+0000 7fb713bf9640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T01:52:35.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:52:35 smithi083 ceph-mon[31370]: from='client.? 172.21.15.83:0/1813930192' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-09-21T01:52:35.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:52:35 smithi083 ceph-mon[31370]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-21T01:52:35.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:52:35 smithi083 ceph-mon[31370]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T01:52:35.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:52:35 smithi083 ceph-mon[31370]: from='client.? 172.21.15.83:0/1813930192' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-21T01:52:35.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:52:35 smithi083 ceph-mon[31370]: osdmap e95: 12 total, 12 up, 12 in 2024-09-21T01:52:35.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:52:35 smithi083 ceph-mon[31370]: fsmap cephfs:0/1 10 up:standby, 1 failed 2024-09-21T01:52:35.464 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:52:35 smithi142 ceph-mon[34050]: from='client.? 172.21.15.83:0/1813930192' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-09-21T01:52:35.465 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:52:35 smithi142 ceph-mon[34050]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-21T01:52:35.465 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:52:35 smithi142 ceph-mon[34050]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T01:52:35.465 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:52:35 smithi142 ceph-mon[34050]: from='client.? 172.21.15.83:0/1813930192' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-21T01:52:35.465 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:52:35 smithi142 ceph-mon[34050]: osdmap e95: 12 total, 12 up, 12 in 2024-09-21T01:52:35.465 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:52:35 smithi142 ceph-mon[34050]: fsmap cephfs:0/1 10 up:standby, 1 failed 2024-09-21T01:52:35.465 INFO:journalctl@ceph.mds.i.smithi142.stdout:Sep 21 01:52:35 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mds-i[63810]: ignoring --setuser ceph since I am not root 2024-09-21T01:52:35.465 INFO:journalctl@ceph.mds.i.smithi142.stdout:Sep 21 01:52:35 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mds-i[63810]: ignoring --setgroup ceph since I am not root 2024-09-21T01:52:35.465 INFO:journalctl@ceph.mds.i.smithi142.stdout:Sep 21 01:52:35 smithi142 ceph-mds[63814]: -- 172.21.15.142:0/4077939675 <== mon.1 v2:172.21.15.142:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x558935015860 con 0x5589391bd600 2024-09-21T01:52:35.465 INFO:journalctl@ceph.mds.i.smithi142.stdout:Sep 21 01:52:35 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mds-i[63810]: starting mds.i at 2024-09-21T01:52:35.468 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:52:35 smithi119 ceph-mon[33693]: from='client.? 172.21.15.83:0/1813930192' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-09-21T01:52:35.468 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:52:35 smithi119 ceph-mon[33693]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-21T01:52:35.468 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:52:35 smithi119 ceph-mon[33693]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T01:52:35.468 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:52:35 smithi119 ceph-mon[33693]: from='client.? 172.21.15.83:0/1813930192' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-21T01:52:35.468 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:52:35 smithi119 ceph-mon[33693]: osdmap e95: 12 total, 12 up, 12 in 2024-09-21T01:52:35.468 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:52:35 smithi119 ceph-mon[33693]: fsmap cephfs:0/1 10 up:standby, 1 failed 2024-09-21T01:52:35.468 INFO:journalctl@ceph.mds.b.smithi119.stdout:Sep 21 01:52:35 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mds-b[62910]: ignoring --setuser ceph since I am not root 2024-09-21T01:52:35.468 INFO:journalctl@ceph.mds.b.smithi119.stdout:Sep 21 01:52:35 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mds-b[62910]: ignoring --setgroup ceph since I am not root 2024-09-21T01:52:35.468 INFO:journalctl@ceph.mds.b.smithi119.stdout:Sep 21 01:52:35 smithi119 ceph-mds[62914]: -- 172.21.15.119:0/4106848685 <== mon.2 v2:172.21.15.119:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55e1defed860 con 0x55e1e3195600 2024-09-21T01:52:35.468 INFO:journalctl@ceph.mds.b.smithi119.stdout:Sep 21 01:52:35 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mds-b[62910]: starting mds.b at 2024-09-21T01:52:35.688 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph fs rm cephfs --yes-i-really-mean-it 2024-09-21T01:52:35.936 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:52:36.397 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:52:36 smithi083 ceph-mon[31370]: pgmap v666: 129 pgs: 129 active+clean; 21 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-09-21T01:52:36.464 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:52:36 smithi142 ceph-mon[34050]: pgmap v666: 129 pgs: 129 active+clean; 21 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-09-21T01:52:36.467 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:52:36 smithi119 ceph-mon[33693]: pgmap v666: 129 pgs: 129 active+clean; 21 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-09-21T01:52:36.489 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:36.488+0000 7f2c59d63640 1 -- 172.21.15.83:0/2946815205 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2c541094a0 msgr2=0x7f2c541098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:52:36.490 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:36.488+0000 7f2c59d63640 1 --2- 172.21.15.83:0/2946815205 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2c541094a0 0x7f2c541098b0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f2c48009900 tx=0x7f2c4802a410 comp rx=0 tx=0).stop 2024-09-21T01:52:36.490 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:36.488+0000 7f2c59d63640 1 -- 172.21.15.83:0/2946815205 shutdown_connections 2024-09-21T01:52:36.490 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:36.488+0000 7f2c59d63640 1 --2- 172.21.15.83:0/2946815205 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2c54109df0 0x7f2c54110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:52:36.490 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:36.488+0000 7f2c59d63640 1 --2- 172.21.15.83:0/2946815205 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2c541094a0 0x7f2c541098b0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:52:36.490 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:36.488+0000 7f2c59d63640 1 --2- 172.21.15.83:0/2946815205 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2c54103b60 0x7f2c54103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:52:36.490 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:36.488+0000 7f2c59d63640 1 -- 172.21.15.83:0/2946815205 >> 172.21.15.83:0/2946815205 conn(0x7f2c5407b850 msgr2=0x7f2c5407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:52:36.490 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:36.488+0000 7f2c59d63640 1 -- 172.21.15.83:0/2946815205 shutdown_connections 2024-09-21T01:52:36.490 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:36.488+0000 7f2c59d63640 1 -- 172.21.15.83:0/2946815205 wait complete. 2024-09-21T01:52:36.490 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:36.489+0000 7f2c59d63640 1 Processor -- start 2024-09-21T01:52:36.492 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:36.490+0000 7f2c59d63640 1 -- start start 2024-09-21T01:52:36.493 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:36.490+0000 7f2c59d63640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2c54103b60 0x7f2c5419a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:52:36.493 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:36.490+0000 7f2c59d63640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2c541094a0 0x7f2c5419a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:52:36.494 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:36.490+0000 7f2c59d63640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2c54109df0 0x7f2c5419fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:52:36.494 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:36.490+0000 7f2c59d63640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f2c54113960 con 0x7f2c54109df0 2024-09-21T01:52:36.494 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:36.490+0000 7f2c59d63640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f2c541137e0 con 0x7f2c54103b60 2024-09-21T01:52:36.494 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:36.490+0000 7f2c59d63640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f2c54113ae0 con 0x7f2c541094a0 2024-09-21T01:52:36.494 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:36.490+0000 7f2c53fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2c54109df0 0x7f2c5419fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:52:36.494 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:36.490+0000 7f2c53fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2c54109df0 0x7f2c5419fc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:57654/0 (socket says 172.21.15.83:57654) 2024-09-21T01:52:36.494 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:36.490+0000 7f2c53fff640 1 -- 172.21.15.83:0/860768575 learned_addr learned my addr 172.21.15.83:0/860768575 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:52:36.494 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:36.490+0000 7f2c52ffd640 1 --2- 172.21.15.83:0/860768575 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2c541094a0 0x7f2c5419a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:52:36.494 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:36.490+0000 7f2c537fe640 1 --2- 172.21.15.83:0/860768575 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2c54103b60 0x7f2c5419a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:52:36.494 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:36.490+0000 7f2c53fff640 1 -- 172.21.15.83:0/860768575 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2c541094a0 msgr2=0x7f2c5419a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:52:36.494 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:36.490+0000 7f2c53fff640 1 --2- 172.21.15.83:0/860768575 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2c541094a0 0x7f2c5419a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:52:36.494 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:36.490+0000 7f2c53fff640 1 -- 172.21.15.83:0/860768575 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2c54103b60 msgr2=0x7f2c5419a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:52:36.494 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:36.490+0000 7f2c53fff640 1 --2- 172.21.15.83:0/860768575 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2c54103b60 0x7f2c5419a3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:52:36.495 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:36.490+0000 7f2c53fff640 1 -- 172.21.15.83:0/860768575 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c541a0360 con 0x7f2c54109df0 2024-09-21T01:52:36.495 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:36.491+0000 7f2c53fff640 1 --2- 172.21.15.83:0/860768575 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2c54109df0 0x7f2c5419fc30 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f2c4c00eaa0 tx=0x7f2c4c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:52:36.495 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:36.491+0000 7f2c50ff9640 1 -- 172.21.15.83:0/860768575 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c4c00cdb0 con 0x7f2c54109df0 2024-09-21T01:52:36.495 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:36.491+0000 7f2c59d63640 1 -- 172.21.15.83:0/860768575 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c541a0650 con 0x7f2c54109df0 2024-09-21T01:52:36.495 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:36.491+0000 7f2c50ff9640 1 -- 172.21.15.83:0/860768575 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2c4c005020 con 0x7f2c54109df0 2024-09-21T01:52:36.495 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:36.491+0000 7f2c50ff9640 1 -- 172.21.15.83:0/860768575 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c4c0116d0 con 0x7f2c54109df0 2024-09-21T01:52:36.495 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:36.491+0000 7f2c59d63640 1 -- 172.21.15.83:0/860768575 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c541a6db0 con 0x7f2c54109df0 2024-09-21T01:52:36.496 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:36.492+0000 7f2c59d63640 1 -- 172.21.15.83:0/860768575 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c54103f70 con 0x7f2c54109df0 2024-09-21T01:52:36.496 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:36.493+0000 7f2c50ff9640 1 -- 172.21.15.83:0/860768575 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7f2c4c0051d0 con 0x7f2c54109df0 2024-09-21T01:52:36.496 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:36.494+0000 7f2c50ff9640 1 --2- 172.21.15.83:0/860768575 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f2c3c0b6680 0x7f2c3c0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:52:36.496 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:36.494+0000 7f2c537fe640 1 --2- 172.21.15.83:0/860768575 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f2c3c0b6680 0x7f2c3c0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:52:36.496 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:36.494+0000 7f2c50ff9640 1 -- 172.21.15.83:0/860768575 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9401+0+0 (secure 0 0 0) 0x7f2c4c0e7c30 con 0x7f2c54109df0 2024-09-21T01:52:36.496 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:36.495+0000 7f2c537fe640 1 --2- 172.21.15.83:0/860768575 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f2c3c0b6680 0x7f2c3c0b8b90 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f2c44005fd0 tx=0x7f2c4400b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:52:36.499 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:36.498+0000 7f2c50ff9640 1 -- 172.21.15.83:0/860768575 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2c4c016030 con 0x7f2c54109df0 2024-09-21T01:52:36.713 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:36.713+0000 7f2c59d63640 1 -- 172.21.15.83:0/860768575 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f2c5410bbc0 con 0x7f2c54109df0 2024-09-21T01:52:37.071 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:37.070+0000 7f2c50ff9640 1 -- 172.21.15.83:0/860768575 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v24) ==== 104+0+0 (secure 0 0 0) 0x7f2c4c0b2190 con 0x7f2c54109df0 2024-09-21T01:52:37.073 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:37.073+0000 7f2c59d63640 1 -- 172.21.15.83:0/860768575 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f2c3c0b6680 msgr2=0x7f2c3c0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:52:37.073 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:37.073+0000 7f2c59d63640 1 --2- 172.21.15.83:0/860768575 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f2c3c0b6680 0x7f2c3c0b8b90 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f2c44005fd0 tx=0x7f2c4400b390 comp rx=0 tx=0).stop 2024-09-21T01:52:37.073 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:37.073+0000 7f2c59d63640 1 -- 172.21.15.83:0/860768575 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2c54109df0 msgr2=0x7f2c5419fc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:52:37.073 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:37.073+0000 7f2c59d63640 1 --2- 172.21.15.83:0/860768575 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2c54109df0 0x7f2c5419fc30 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f2c4c00eaa0 tx=0x7f2c4c00ef60 comp rx=0 tx=0).stop 2024-09-21T01:52:37.074 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:37.073+0000 7f2c59d63640 1 -- 172.21.15.83:0/860768575 shutdown_connections 2024-09-21T01:52:37.074 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:37.073+0000 7f2c59d63640 1 --2- 172.21.15.83:0/860768575 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f2c3c0b6680 0x7f2c3c0b8b90 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:52:37.074 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:37.073+0000 7f2c59d63640 1 --2- 172.21.15.83:0/860768575 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2c54109df0 0x7f2c5419fc30 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:52:37.074 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:37.073+0000 7f2c59d63640 1 --2- 172.21.15.83:0/860768575 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2c541094a0 0x7f2c5419a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:52:37.074 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:37.073+0000 7f2c59d63640 1 --2- 172.21.15.83:0/860768575 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2c54103b60 0x7f2c5419a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:52:37.074 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:37.073+0000 7f2c59d63640 1 -- 172.21.15.83:0/860768575 >> 172.21.15.83:0/860768575 conn(0x7f2c5407b850 msgr2=0x7f2c54105560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:52:37.074 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:37.073+0000 7f2c59d63640 1 -- 172.21.15.83:0/860768575 shutdown_connections 2024-09-21T01:52:37.074 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:37.073+0000 7f2c59d63640 1 -- 172.21.15.83:0/860768575 wait complete. 2024-09-21T01:52:37.444 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:52:37 smithi083 ceph-mon[31370]: mds.? [v2:172.21.15.119:6838/2676153358,v1:172.21.15.119:6839/2676153358] up:boot 2024-09-21T01:52:37.444 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:52:37 smithi083 ceph-mon[31370]: mds.? [v2:172.21.15.142:6838/1618060474,v1:172.21.15.142:6839/1618060474] up:boot 2024-09-21T01:52:37.444 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:52:37 smithi083 ceph-mon[31370]: fsmap cephfs:0/1 12 up:standby, 1 failed 2024-09-21T01:52:37.444 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:52:37 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-21T01:52:37.444 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:52:37 smithi083 ceph-mon[31370]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-21T01:52:37.444 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:52:37 smithi083 ceph-mon[31370]: from='client.? 172.21.15.83:0/860768575' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2024-09-21T01:52:37.464 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:52:37 smithi142 ceph-mon[34050]: mds.? [v2:172.21.15.119:6838/2676153358,v1:172.21.15.119:6839/2676153358] up:boot 2024-09-21T01:52:37.465 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:52:37 smithi142 ceph-mon[34050]: mds.? [v2:172.21.15.142:6838/1618060474,v1:172.21.15.142:6839/1618060474] up:boot 2024-09-21T01:52:37.465 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:52:37 smithi142 ceph-mon[34050]: fsmap cephfs:0/1 12 up:standby, 1 failed 2024-09-21T01:52:37.465 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:52:37 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-21T01:52:37.465 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:52:37 smithi142 ceph-mon[34050]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-21T01:52:37.465 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:52:37 smithi142 ceph-mon[34050]: from='client.? 172.21.15.83:0/860768575' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2024-09-21T01:52:37.468 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:52:37 smithi119 ceph-mon[33693]: mds.? [v2:172.21.15.119:6838/2676153358,v1:172.21.15.119:6839/2676153358] up:boot 2024-09-21T01:52:37.468 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:52:37 smithi119 ceph-mon[33693]: mds.? [v2:172.21.15.142:6838/1618060474,v1:172.21.15.142:6839/1618060474] up:boot 2024-09-21T01:52:37.468 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:52:37 smithi119 ceph-mon[33693]: fsmap cephfs:0/1 12 up:standby, 1 failed 2024-09-21T01:52:37.468 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:52:37 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-21T01:52:37.468 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:52:37 smithi119 ceph-mon[33693]: from='mgr.14223 172.21.15.83:0/1593945329' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-21T01:52:37.468 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:52:37 smithi119 ceph-mon[33693]: from='client.? 172.21.15.83:0/860768575' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2024-09-21T01:52:37.765 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-21T01:52:38.010 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:52:38.425 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:52:38 smithi083 ceph-mon[31370]: pgmap v667: 129 pgs: 129 active+clean; 21 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-09-21T01:52:38.425 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:52:38 smithi083 ceph-mon[31370]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-21T01:52:38.425 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:52:38 smithi083 ceph-mon[31370]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-21T01:52:38.425 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:52:38 smithi083 ceph-mon[31370]: Cluster is now healthy 2024-09-21T01:52:38.425 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:52:38 smithi083 ceph-mon[31370]: from='client.? 172.21.15.83:0/860768575' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-21T01:52:38.425 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:52:38 smithi083 ceph-mon[31370]: fsmap 12 up:standby 2024-09-21T01:52:38.464 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:52:38 smithi142 ceph-mon[34050]: pgmap v667: 129 pgs: 129 active+clean; 21 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-09-21T01:52:38.465 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:52:38 smithi142 ceph-mon[34050]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-21T01:52:38.465 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:52:38 smithi142 ceph-mon[34050]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-21T01:52:38.465 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:52:38 smithi142 ceph-mon[34050]: Cluster is now healthy 2024-09-21T01:52:38.465 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:52:38 smithi142 ceph-mon[34050]: from='client.? 172.21.15.83:0/860768575' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-21T01:52:38.465 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:52:38 smithi142 ceph-mon[34050]: fsmap 12 up:standby 2024-09-21T01:52:38.468 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:52:38 smithi119 ceph-mon[33693]: pgmap v667: 129 pgs: 129 active+clean; 21 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-09-21T01:52:38.468 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:52:38 smithi119 ceph-mon[33693]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-21T01:52:38.468 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:52:38 smithi119 ceph-mon[33693]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-21T01:52:38.468 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:52:38 smithi119 ceph-mon[33693]: Cluster is now healthy 2024-09-21T01:52:38.468 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:52:38 smithi119 ceph-mon[33693]: from='client.? 172.21.15.83:0/860768575' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-21T01:52:38.468 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:52:38 smithi119 ceph-mon[33693]: fsmap 12 up:standby 2024-09-21T01:52:38.520 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:38.519+0000 7f1bb595b640 1 -- 172.21.15.83:0/294694719 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1bb0108cf0 msgr2=0x7f1bb010f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:52:38.520 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:38.519+0000 7f1bb595b640 1 --2- 172.21.15.83:0/294694719 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1bb0108cf0 0x7f1bb010f520 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f1ba8009ca0 tx=0x7f1ba802a8c0 comp rx=0 tx=0).stop 2024-09-21T01:52:38.520 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:38.519+0000 7f1bb595b640 1 -- 172.21.15.83:0/294694719 shutdown_connections 2024-09-21T01:52:38.520 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:38.519+0000 7f1bb595b640 1 --2- 172.21.15.83:0/294694719 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1bb0108cf0 0x7f1bb010f520 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:52:38.520 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:38.519+0000 7f1bb595b640 1 --2- 172.21.15.83:0/294694719 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1bb01083a0 0x7f1bb01087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:52:38.520 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:38.519+0000 7f1bb595b640 1 --2- 172.21.15.83:0/294694719 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1bb0102a60 0x7f1bb0102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:52:38.520 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:38.519+0000 7f1bb595b640 1 -- 172.21.15.83:0/294694719 >> 172.21.15.83:0/294694719 conn(0x7f1bb0079730 msgr2=0x7f1bb0079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:52:38.520 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:38.519+0000 7f1bb595b640 1 -- 172.21.15.83:0/294694719 shutdown_connections 2024-09-21T01:52:38.520 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:38.519+0000 7f1bb595b640 1 -- 172.21.15.83:0/294694719 wait complete. 2024-09-21T01:52:38.522 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:38.520+0000 7f1bb595b640 1 Processor -- start 2024-09-21T01:52:38.522 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:38.520+0000 7f1bb595b640 1 -- start start 2024-09-21T01:52:38.522 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:38.520+0000 7f1bb595b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1bb0102a60 0x7f1bb019b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:52:38.522 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:38.520+0000 7f1bb595b640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1bb01083a0 0x7f1bb019b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:52:38.522 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:38.520+0000 7f1bb595b640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1bb0108cf0 0x7f1bb019bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:52:38.522 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:38.520+0000 7f1bb595b640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f1bb0112860 con 0x7f1bb0108cf0 2024-09-21T01:52:38.522 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:38.520+0000 7f1bb595b640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f1bb01126e0 con 0x7f1bb0102a60 2024-09-21T01:52:38.523 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:38.520+0000 7f1bb595b640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f1bb01129e0 con 0x7f1bb01083a0 2024-09-21T01:52:38.523 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:38.520+0000 7f1baf7fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1bb0108cf0 0x7f1bb019bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:52:38.523 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:38.520+0000 7f1baf7fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1bb0108cf0 0x7f1bb019bbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:57680/0 (socket says 172.21.15.83:57680) 2024-09-21T01:52:38.523 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:38.520+0000 7f1baf7fe640 1 -- 172.21.15.83:0/3361966927 learned_addr learned my addr 172.21.15.83:0/3361966927 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:52:38.523 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:38.520+0000 7f1baeffd640 1 --2- 172.21.15.83:0/3361966927 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1bb0102a60 0x7f1bb019b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:52:38.523 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:38.520+0000 7f1ba7fff640 1 --2- 172.21.15.83:0/3361966927 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1bb01083a0 0x7f1bb019b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:52:38.523 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:38.521+0000 7f1baf7fe640 1 -- 172.21.15.83:0/3361966927 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1bb01083a0 msgr2=0x7f1bb019b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:52:38.523 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:38.521+0000 7f1baf7fe640 1 --2- 172.21.15.83:0/3361966927 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1bb01083a0 0x7f1bb019b670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:52:38.523 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:38.521+0000 7f1baf7fe640 1 -- 172.21.15.83:0/3361966927 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1bb0102a60 msgr2=0x7f1bb019b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:52:38.523 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:38.521+0000 7f1baf7fe640 1 --2- 172.21.15.83:0/3361966927 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1bb0102a60 0x7f1bb019b130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:52:38.523 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:38.521+0000 7f1baf7fe640 1 -- 172.21.15.83:0/3361966927 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bb01a63c0 con 0x7f1bb0108cf0 2024-09-21T01:52:38.523 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:38.521+0000 7f1ba7fff640 1 --2- 172.21.15.83:0/3361966927 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1bb01083a0 0x7f1bb019b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T01:52:38.523 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:38.521+0000 7f1baf7fe640 1 --2- 172.21.15.83:0/3361966927 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1bb0108cf0 0x7f1bb019bbb0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f1ba8005cc0 tx=0x7f1ba8032a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:52:38.523 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:38.521+0000 7f1bb4959640 1 -- 172.21.15.83:0/3361966927 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ba8032e00 con 0x7f1bb0108cf0 2024-09-21T01:52:38.524 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:38.521+0000 7f1bb4959640 1 -- 172.21.15.83:0/3361966927 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1ba80044d0 con 0x7f1bb0108cf0 2024-09-21T01:52:38.524 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:38.521+0000 7f1bb595b640 1 -- 172.21.15.83:0/3361966927 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1bb01a6650 con 0x7f1bb0108cf0 2024-09-21T01:52:38.524 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:38.521+0000 7f1bb4959640 1 -- 172.21.15.83:0/3361966927 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ba8030b70 con 0x7f1bb0108cf0 2024-09-21T01:52:38.524 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:38.521+0000 7f1bb595b640 1 -- 172.21.15.83:0/3361966927 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1bb01a6b90 con 0x7f1bb0108cf0 2024-09-21T01:52:38.524 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:38.522+0000 7f1bb595b640 1 -- 172.21.15.83:0/3361966927 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1bb0102e70 con 0x7f1bb0108cf0 2024-09-21T01:52:38.525 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:38.525+0000 7f1bb4959640 1 -- 172.21.15.83:0/3361966927 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7f1ba8030d10 con 0x7f1bb0108cf0 2024-09-21T01:52:38.526 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:38.526+0000 7f1bb4959640 1 --2- 172.21.15.83:0/3361966927 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f1b9c0b66b0 0x7f1b9c0b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:52:38.527 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:38.526+0000 7f1baeffd640 1 --2- 172.21.15.83:0/3361966927 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f1b9c0b66b0 0x7f1b9c0b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:52:38.527 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:38.526+0000 7f1bb4959640 1 -- 172.21.15.83:0/3361966927 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9401+0+0 (secure 0 0 0) 0x7f1ba8108f00 con 0x7f1bb0108cf0 2024-09-21T01:52:38.527 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:38.526+0000 7f1baeffd640 1 --2- 172.21.15.83:0/3361966927 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f1b9c0b66b0 0x7f1b9c0b8bc0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f1bb006b9c0 tx=0x7f1ba000b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:52:38.530 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:38.529+0000 7f1bb4959640 1 -- 172.21.15.83:0/3361966927 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f1ba80cf080 con 0x7f1bb0108cf0 2024-09-21T01:52:38.706 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:38.706+0000 7f1bb595b640 1 -- 172.21.15.83:0/3361966927 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f1bb006b270 con 0x7f1bb0108cf0 2024-09-21T01:52:39.081 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:39.080+0000 7f1bb4959640 1 -- 172.21.15.83:0/3361966927 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v96) ==== 181+0+0 (secure 0 0 0) 0x7f1ba80d3460 con 0x7f1bb0108cf0 2024-09-21T01:52:39.081 INFO:teuthology.orchestra.run.smithi083.stderr:pool 'cephfs_metadata' removed 2024-09-21T01:52:39.085 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:39.084+0000 7f1bb595b640 1 -- 172.21.15.83:0/3361966927 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f1b9c0b66b0 msgr2=0x7f1b9c0b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:52:39.085 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:39.084+0000 7f1bb595b640 1 --2- 172.21.15.83:0/3361966927 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f1b9c0b66b0 0x7f1b9c0b8bc0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f1bb006b9c0 tx=0x7f1ba000b390 comp rx=0 tx=0).stop 2024-09-21T01:52:39.085 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:39.084+0000 7f1bb595b640 1 -- 172.21.15.83:0/3361966927 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1bb0108cf0 msgr2=0x7f1bb019bbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:52:39.085 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:39.084+0000 7f1bb595b640 1 --2- 172.21.15.83:0/3361966927 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1bb0108cf0 0x7f1bb019bbb0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f1ba8005cc0 tx=0x7f1ba8032a10 comp rx=0 tx=0).stop 2024-09-21T01:52:39.085 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:39.084+0000 7f1bb595b640 1 -- 172.21.15.83:0/3361966927 shutdown_connections 2024-09-21T01:52:39.085 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:39.084+0000 7f1bb595b640 1 --2- 172.21.15.83:0/3361966927 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f1b9c0b66b0 0x7f1b9c0b8bc0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:52:39.085 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:39.084+0000 7f1bb595b640 1 --2- 172.21.15.83:0/3361966927 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1bb0108cf0 0x7f1bb019bbb0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:52:39.085 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:39.084+0000 7f1bb595b640 1 --2- 172.21.15.83:0/3361966927 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1bb01083a0 0x7f1bb019b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:52:39.085 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:39.084+0000 7f1bb595b640 1 --2- 172.21.15.83:0/3361966927 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1bb0102a60 0x7f1bb019b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:52:39.086 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:39.084+0000 7f1bb595b640 1 -- 172.21.15.83:0/3361966927 >> 172.21.15.83:0/3361966927 conn(0x7f1bb0079730 msgr2=0x7f1bb01043b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:52:39.086 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:39.085+0000 7f1bb595b640 1 -- 172.21.15.83:0/3361966927 shutdown_connections 2024-09-21T01:52:39.086 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:39.085+0000 7f1bb595b640 1 -- 172.21.15.83:0/3361966927 wait complete. 2024-09-21T01:52:39.387 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:52:39 smithi083 ceph-mon[31370]: from='client.? 172.21.15.83:0/3361966927' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T01:52:39.464 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:52:39 smithi142 ceph-mon[34050]: from='client.? 172.21.15.83:0/3361966927' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T01:52:39.467 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:52:39 smithi119 ceph-mon[33693]: from='client.? 172.21.15.83:0/3361966927' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T01:52:39.691 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-21T01:52:39.941 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:52:40.351 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:52:40 smithi083 ceph-mon[31370]: pgmap v668: 129 pgs: 129 active+clean; 21 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 614 B/s rd, 1 op/s 2024-09-21T01:52:40.351 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:52:40 smithi083 ceph-mon[31370]: from='client.? 172.21.15.83:0/3361966927' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T01:52:40.351 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:52:40 smithi083 ceph-mon[31370]: osdmap e96: 12 total, 12 up, 12 in 2024-09-21T01:52:40.451 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:40.443+0000 7f9191b83640 1 -- 172.21.15.83:0/559796758 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f918c103230 msgr2=0x7f918c103640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:52:40.451 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:40.443+0000 7f9191b83640 1 --2- 172.21.15.83:0/559796758 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f918c103230 0x7f918c103640 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f9180009900 tx=0x7f918002a3f0 comp rx=0 tx=0).stop 2024-09-21T01:52:40.451 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:40.443+0000 7f9191b83640 1 -- 172.21.15.83:0/559796758 shutdown_connections 2024-09-21T01:52:40.451 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:40.443+0000 7f9191b83640 1 --2- 172.21.15.83:0/559796758 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f918c108db0 0x7f918c10f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:52:40.451 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:40.443+0000 7f9191b83640 1 --2- 172.21.15.83:0/559796758 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f918c108460 0x7f918c108870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:52:40.451 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:40.443+0000 7f9191b83640 1 --2- 172.21.15.83:0/559796758 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f918c103230 0x7f918c103640 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:52:40.451 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:40.443+0000 7f9191b83640 1 -- 172.21.15.83:0/559796758 >> 172.21.15.83:0/559796758 conn(0x7f918c079ec0 msgr2=0x7f918c07a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:52:40.452 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:40.443+0000 7f9191b83640 1 -- 172.21.15.83:0/559796758 shutdown_connections 2024-09-21T01:52:40.452 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:40.443+0000 7f9191b83640 1 -- 172.21.15.83:0/559796758 wait complete. 2024-09-21T01:52:40.452 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:40.444+0000 7f9191b83640 1 Processor -- start 2024-09-21T01:52:40.452 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:40.444+0000 7f9191b83640 1 -- start start 2024-09-21T01:52:40.452 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:40.444+0000 7f9191b83640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f918c103230 0x7f918c19c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:52:40.452 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:40.444+0000 7f9191b83640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f918c108460 0x7f918c19cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:52:40.452 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:40.444+0000 7f9191b83640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f918c108db0 0x7f918c1a1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:52:40.452 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:40.444+0000 7f9191b83640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f918c112920 con 0x7f918c108db0 2024-09-21T01:52:40.452 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:40.444+0000 7f9191b83640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f918c1127a0 con 0x7f918c103230 2024-09-21T01:52:40.452 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:40.444+0000 7f9191b83640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f918c112aa0 con 0x7f918c108460 2024-09-21T01:52:40.452 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:40.444+0000 7f918bfff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f918c108db0 0x7f918c1a1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:52:40.452 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:40.444+0000 7f918bfff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f918c108db0 0x7f918c1a1ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:57702/0 (socket says 172.21.15.83:57702) 2024-09-21T01:52:40.452 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:40.444+0000 7f918bfff640 1 -- 172.21.15.83:0/1963440937 learned_addr learned my addr 172.21.15.83:0/1963440937 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:52:40.452 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:40.445+0000 7f918b7fe640 1 --2- 172.21.15.83:0/1963440937 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f918c103230 0x7f918c19c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:52:40.453 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:40.445+0000 7f918affd640 1 --2- 172.21.15.83:0/1963440937 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f918c108460 0x7f918c19cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:52:40.453 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:40.445+0000 7f918bfff640 1 -- 172.21.15.83:0/1963440937 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f918c108460 msgr2=0x7f918c19cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:52:40.453 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:40.445+0000 7f918bfff640 1 --2- 172.21.15.83:0/1963440937 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f918c108460 0x7f918c19cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:52:40.453 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:40.445+0000 7f918bfff640 1 -- 172.21.15.83:0/1963440937 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f918c103230 msgr2=0x7f918c19c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:52:40.453 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:40.445+0000 7f918bfff640 1 --2- 172.21.15.83:0/1963440937 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f918c103230 0x7f918c19c660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:52:40.453 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:40.445+0000 7f918bfff640 1 -- 172.21.15.83:0/1963440937 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f918c1a2510 con 0x7f918c108db0 2024-09-21T01:52:40.453 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:40.445+0000 7f918bfff640 1 --2- 172.21.15.83:0/1963440937 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f918c108db0 0x7f918c1a1ea0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f918400eaa0 tx=0x7f918400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:52:40.453 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:40.445+0000 7f9188ff9640 1 -- 172.21.15.83:0/1963440937 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f918400cdb0 con 0x7f918c108db0 2024-09-21T01:52:40.453 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:40.445+0000 7f9188ff9640 1 -- 172.21.15.83:0/1963440937 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9184005020 con 0x7f918c108db0 2024-09-21T01:52:40.453 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:40.445+0000 7f9191b83640 1 -- 172.21.15.83:0/1963440937 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f918c1a2800 con 0x7f918c108db0 2024-09-21T01:52:40.453 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:40.445+0000 7f9188ff9640 1 -- 172.21.15.83:0/1963440937 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91840116d0 con 0x7f918c108db0 2024-09-21T01:52:40.453 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:40.445+0000 7f9191b83640 1 -- 172.21.15.83:0/1963440937 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f918c1a9020 con 0x7f918c108db0 2024-09-21T01:52:40.453 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:40.446+0000 7f9191b83640 1 -- 172.21.15.83:0/1963440937 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f918c103640 con 0x7f918c108db0 2024-09-21T01:52:40.453 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:40.448+0000 7f9188ff9640 1 -- 172.21.15.83:0/1963440937 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7f91840051d0 con 0x7f918c108db0 2024-09-21T01:52:40.453 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:40.449+0000 7f9188ff9640 1 --2- 172.21.15.83:0/1963440937 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f91740b6730 0x7f91740b8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:52:40.454 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:40.449+0000 7f918b7fe640 1 --2- 172.21.15.83:0/1963440937 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f91740b6730 0x7f91740b8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:52:40.454 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:40.449+0000 7f9188ff9640 1 -- 172.21.15.83:0/1963440937 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 8905+0+0 (secure 0 0 0) 0x7f91840e7eb0 con 0x7f918c108db0 2024-09-21T01:52:40.454 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:40.450+0000 7f918b7fe640 1 --2- 172.21.15.83:0/1963440937 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f91740b6730 0x7f91740b8c40 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f9180000c00 tx=0x7f9180009680 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:52:40.454 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:40.453+0000 7f9188ff9640 1 -- 172.21.15.83:0/1963440937 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f9184016030 con 0x7f918c108db0 2024-09-21T01:52:40.464 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:52:40 smithi142 ceph-mon[34050]: pgmap v668: 129 pgs: 129 active+clean; 21 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 614 B/s rd, 1 op/s 2024-09-21T01:52:40.464 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:52:40 smithi142 ceph-mon[34050]: from='client.? 172.21.15.83:0/3361966927' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T01:52:40.464 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:52:40 smithi142 ceph-mon[34050]: osdmap e96: 12 total, 12 up, 12 in 2024-09-21T01:52:40.468 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:52:40 smithi119 ceph-mon[33693]: pgmap v668: 129 pgs: 129 active+clean; 21 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 614 B/s rd, 1 op/s 2024-09-21T01:52:40.468 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:52:40 smithi119 ceph-mon[33693]: from='client.? 172.21.15.83:0/3361966927' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T01:52:40.468 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:52:40 smithi119 ceph-mon[33693]: osdmap e96: 12 total, 12 up, 12 in 2024-09-21T01:52:40.630 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:40.630+0000 7f9191b83640 1 -- 172.21.15.83:0/1963440937 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f918c19d790 con 0x7f918c108db0 2024-09-21T01:52:41.089 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:41.088+0000 7f9188ff9640 1 -- 172.21.15.83:0/1963440937 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v97) ==== 169+0+0 (secure 0 0 0) 0x7f918c19d790 con 0x7f918c108db0 2024-09-21T01:52:41.089 INFO:teuthology.orchestra.run.smithi083.stderr:pool 'cephfs_data' removed 2024-09-21T01:52:41.092 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:41.092+0000 7f9191b83640 1 -- 172.21.15.83:0/1963440937 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f91740b6730 msgr2=0x7f91740b8c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:52:41.093 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:41.092+0000 7f9191b83640 1 --2- 172.21.15.83:0/1963440937 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f91740b6730 0x7f91740b8c40 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f9180000c00 tx=0x7f9180009680 comp rx=0 tx=0).stop 2024-09-21T01:52:41.093 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:41.092+0000 7f9191b83640 1 -- 172.21.15.83:0/1963440937 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f918c108db0 msgr2=0x7f918c1a1ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:52:41.093 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:41.092+0000 7f9191b83640 1 --2- 172.21.15.83:0/1963440937 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f918c108db0 0x7f918c1a1ea0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f918400eaa0 tx=0x7f918400ef60 comp rx=0 tx=0).stop 2024-09-21T01:52:41.093 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:41.092+0000 7f9191b83640 1 -- 172.21.15.83:0/1963440937 shutdown_connections 2024-09-21T01:52:41.093 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:41.092+0000 7f9191b83640 1 --2- 172.21.15.83:0/1963440937 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f91740b6730 0x7f91740b8c40 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:52:41.093 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:41.092+0000 7f9191b83640 1 --2- 172.21.15.83:0/1963440937 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f918c108db0 0x7f918c1a1ea0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:52:41.093 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:41.092+0000 7f9191b83640 1 --2- 172.21.15.83:0/1963440937 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f918c108460 0x7f918c19cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:52:41.093 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:41.092+0000 7f9191b83640 1 --2- 172.21.15.83:0/1963440937 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f918c103230 0x7f918c19c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:52:41.093 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:41.092+0000 7f9191b83640 1 -- 172.21.15.83:0/1963440937 >> 172.21.15.83:0/1963440937 conn(0x7f918c079ec0 msgr2=0x7f918c1063b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:52:41.094 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:41.093+0000 7f9191b83640 1 -- 172.21.15.83:0/1963440937 shutdown_connections 2024-09-21T01:52:41.094 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:41.093+0000 7f9191b83640 1 -- 172.21.15.83:0/1963440937 wait complete. 2024-09-21T01:52:41.464 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:52:41 smithi142 ceph-mon[34050]: from='client.? 172.21.15.83:0/1963440937' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T01:52:41.468 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:52:41 smithi119 ceph-mon[33693]: from='client.? 172.21.15.83:0/1963440937' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T01:52:41.554 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:52:41 smithi083 ceph-mon[31370]: from='client.? 172.21.15.83:0/1963440937' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T01:52:41.968 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 -- ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-09-21T01:52:42.223 INFO:teuthology.orchestra.run.smithi083.stderr:Inferring config /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T01:52:42.303 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:52:42 smithi083 ceph-mon[31370]: pgmap v670: 97 pgs: 97 active+clean; 577 KiB data, 435 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:52:42.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:52:42 smithi083 ceph-mon[31370]: from='client.? 172.21.15.83:0/1963440937' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T01:52:42.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:52:42 smithi083 ceph-mon[31370]: osdmap e97: 12 total, 12 up, 12 in 2024-09-21T01:52:42.464 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:52:42 smithi142 ceph-mon[34050]: pgmap v670: 97 pgs: 97 active+clean; 577 KiB data, 435 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:52:42.465 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:52:42 smithi142 ceph-mon[34050]: from='client.? 172.21.15.83:0/1963440937' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T01:52:42.465 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:52:42 smithi142 ceph-mon[34050]: osdmap e97: 12 total, 12 up, 12 in 2024-09-21T01:52:42.467 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:52:42 smithi119 ceph-mon[33693]: pgmap v670: 97 pgs: 97 active+clean; 577 KiB data, 435 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:52:42.467 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:52:42 smithi119 ceph-mon[33693]: from='client.? 172.21.15.83:0/1963440937' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T01:52:42.468 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:52:42 smithi119 ceph-mon[33693]: osdmap e97: 12 total, 12 up, 12 in 2024-09-21T01:52:42.696 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:42.696+0000 7f8080f7a640 1 -- 172.21.15.83:0/2643420795 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f807c109df0 msgr2=0x7f807c110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:52:42.697 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:42.696+0000 7f8080f7a640 1 --2- 172.21.15.83:0/2643420795 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f807c109df0 0x7f807c110620 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f8074009ca0 tx=0x7f807402a8c0 comp rx=0 tx=0).stop 2024-09-21T01:52:42.697 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:42.696+0000 7f8080f7a640 1 -- 172.21.15.83:0/2643420795 shutdown_connections 2024-09-21T01:52:42.697 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:42.696+0000 7f8080f7a640 1 --2- 172.21.15.83:0/2643420795 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f807c109df0 0x7f807c110620 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:52:42.697 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:42.696+0000 7f8080f7a640 1 --2- 172.21.15.83:0/2643420795 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f807c1094a0 0x7f807c1098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:52:42.697 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:42.696+0000 7f8080f7a640 1 --2- 172.21.15.83:0/2643420795 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f807c103b60 0x7f807c103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:52:42.697 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:42.696+0000 7f8080f7a640 1 -- 172.21.15.83:0/2643420795 >> 172.21.15.83:0/2643420795 conn(0x7f807c07b850 msgr2=0x7f807c07bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:52:42.697 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:42.696+0000 7f8080f7a640 1 -- 172.21.15.83:0/2643420795 shutdown_connections 2024-09-21T01:52:42.697 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:42.696+0000 7f8080f7a640 1 -- 172.21.15.83:0/2643420795 wait complete. 2024-09-21T01:52:42.699 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:42.697+0000 7f8080f7a640 1 Processor -- start 2024-09-21T01:52:42.699 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:42.697+0000 7f8080f7a640 1 -- start start 2024-09-21T01:52:42.699 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:42.697+0000 7f8080f7a640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f807c103b60 0x7f807c19a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:52:42.700 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:42.697+0000 7f8080f7a640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f807c1094a0 0x7f807c19aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:52:42.700 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:42.697+0000 7f8080f7a640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f807c109df0 0x7f807c19fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:52:42.700 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:42.697+0000 7f8080f7a640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f807c1139b0 con 0x7f807c1094a0 2024-09-21T01:52:42.700 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:42.697+0000 7f8080f7a640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 -- 0x7f807c113830 con 0x7f807c109df0 2024-09-21T01:52:42.700 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:42.697+0000 7f8080f7a640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f807c113b30 con 0x7f807c103b60 2024-09-21T01:52:42.700 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:42.697+0000 7f8079d9b640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f807c1094a0 0x7f807c19aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:52:42.700 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:42.697+0000 7f8079d9b640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f807c1094a0 0x7f807c19aa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:57718/0 (socket says 172.21.15.83:57718) 2024-09-21T01:52:42.700 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:42.697+0000 7f8079d9b640 1 -- 172.21.15.83:0/3308540960 learned_addr learned my addr 172.21.15.83:0/3308540960 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-09-21T01:52:42.700 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:42.698+0000 7f807a59c640 1 --2- 172.21.15.83:0/3308540960 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f807c103b60 0x7f807c19a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:52:42.700 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:42.698+0000 7f807ad9d640 1 --2- 172.21.15.83:0/3308540960 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f807c109df0 0x7f807c19fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:52:42.700 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:42.698+0000 7f8079d9b640 1 -- 172.21.15.83:0/3308540960 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f807c103b60 msgr2=0x7f807c19a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:52:42.700 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:42.698+0000 7f8079d9b640 1 --2- 172.21.15.83:0/3308540960 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f807c103b60 0x7f807c19a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:52:42.700 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:42.698+0000 7f8079d9b640 1 -- 172.21.15.83:0/3308540960 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f807c109df0 msgr2=0x7f807c19fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:52:42.701 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:42.698+0000 7f8079d9b640 1 --2- 172.21.15.83:0/3308540960 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f807c109df0 0x7f807c19fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:52:42.701 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:42.698+0000 7f8079d9b640 1 -- 172.21.15.83:0/3308540960 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f807c1a0370 con 0x7f807c1094a0 2024-09-21T01:52:42.701 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:42.698+0000 7f807ad9d640 1 --2- 172.21.15.83:0/3308540960 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f807c109df0 0x7f807c19fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T01:52:42.701 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:42.698+0000 7f8079d9b640 1 --2- 172.21.15.83:0/3308540960 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f807c1094a0 0x7f807c19aa60 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f807000c8c0 tx=0x7f807000cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:52:42.701 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:42.698+0000 7f806b7fe640 1 -- 172.21.15.83:0/3308540960 <== mon.0 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8070007bb0 con 0x7f807c1094a0 2024-09-21T01:52:42.701 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:42.698+0000 7f8080f7a640 1 -- 172.21.15.83:0/3308540960 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f807c1a0660 con 0x7f807c1094a0 2024-09-21T01:52:42.701 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:42.698+0000 7f806b7fe640 1 -- 172.21.15.83:0/3308540960 <== mon.0 v2:172.21.15.83:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8070007d50 con 0x7f807c1094a0 2024-09-21T01:52:42.701 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:42.698+0000 7f8080f7a640 1 -- 172.21.15.83:0/3308540960 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f807c1a6e80 con 0x7f807c1094a0 2024-09-21T01:52:42.701 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:42.698+0000 7f806b7fe640 1 -- 172.21.15.83:0/3308540960 <== mon.0 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8070005260 con 0x7f807c1094a0 2024-09-21T01:52:42.701 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:42.699+0000 7f8080f7a640 1 -- 172.21.15.83:0/3308540960 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f807c103f70 con 0x7f807c1094a0 2024-09-21T01:52:42.702 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:42.701+0000 7f806b7fe640 1 -- 172.21.15.83:0/3308540960 <== mon.0 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7f807000fa00 con 0x7f807c1094a0 2024-09-21T01:52:42.702 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:42.701+0000 7f806b7fe640 1 --2- 172.21.15.83:0/3308540960 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f80640b66b0 0x7f80640b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T01:52:42.702 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:42.701+0000 7f807a59c640 1 --2- 172.21.15.83:0/3308540960 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f80640b66b0 0x7f80640b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T01:52:42.702 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:42.701+0000 7f806b7fe640 1 -- 172.21.15.83:0/3308540960 <== mon.0 v2:172.21.15.83:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 8367+0+0 (secure 0 0 0) 0x7f80700e7780 con 0x7f807c1094a0 2024-09-21T01:52:42.702 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:42.702+0000 7f807a59c640 1 --2- 172.21.15.83:0/3308540960 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f80640b66b0 0x7f80640b8bc0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f806c005fd0 tx=0x7f806c005850 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T01:52:42.706 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:42.706+0000 7f806b7fe640 1 -- 172.21.15.83:0/3308540960 <== mon.0 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8070014030 con 0x7f807c1094a0 2024-09-21T01:52:42.885 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:42.884+0000 7f8080f7a640 1 -- 172.21.15.83:0/3308540960 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) -- 0x7f807c19b5f0 con 0x7f807c1094a0 2024-09-21T01:52:43.098 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:43.097+0000 7f806b7fe640 1 -- 172.21.15.83:0/3308540960 <== mon.0 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v98) ==== 178+0+0 (secure 0 0 0) 0x7f80700add70 con 0x7f807c1094a0 2024-09-21T01:52:43.098 INFO:teuthology.orchestra.run.smithi083.stderr:pool 'cephfs_data_ec' removed 2024-09-21T01:52:43.102 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:43.101+0000 7f8080f7a640 1 -- 172.21.15.83:0/3308540960 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f80640b66b0 msgr2=0x7f80640b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:52:43.103 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:43.101+0000 7f8080f7a640 1 --2- 172.21.15.83:0/3308540960 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f80640b66b0 0x7f80640b8bc0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f806c005fd0 tx=0x7f806c005850 comp rx=0 tx=0).stop 2024-09-21T01:52:43.103 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:43.101+0000 7f8080f7a640 1 -- 172.21.15.83:0/3308540960 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f807c1094a0 msgr2=0x7f807c19aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T01:52:43.103 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:43.101+0000 7f8080f7a640 1 --2- 172.21.15.83:0/3308540960 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f807c1094a0 0x7f807c19aa60 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f807000c8c0 tx=0x7f807000cd80 comp rx=0 tx=0).stop 2024-09-21T01:52:43.103 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:43.101+0000 7f8080f7a640 1 -- 172.21.15.83:0/3308540960 shutdown_connections 2024-09-21T01:52:43.103 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:43.101+0000 7f8080f7a640 1 --2- 172.21.15.83:0/3308540960 >> [v2:172.21.15.83:6800/1748483157,v1:172.21.15.83:6801/1748483157] conn(0x7f80640b66b0 0x7f80640b8bc0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:52:43.103 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:43.101+0000 7f8080f7a640 1 --2- 172.21.15.83:0/3308540960 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f807c109df0 0x7f807c19fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:52:43.103 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:43.101+0000 7f8080f7a640 1 --2- 172.21.15.83:0/3308540960 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f807c1094a0 0x7f807c19aa60 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:52:43.103 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:43.101+0000 7f8080f7a640 1 --2- 172.21.15.83:0/3308540960 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f807c103b60 0x7f807c19a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T01:52:43.103 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:43.101+0000 7f8080f7a640 1 -- 172.21.15.83:0/3308540960 >> 172.21.15.83:0/3308540960 conn(0x7f807c07b850 msgr2=0x7f807c105610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T01:52:43.103 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:43.101+0000 7f8080f7a640 1 -- 172.21.15.83:0/3308540960 shutdown_connections 2024-09-21T01:52:43.103 INFO:teuthology.orchestra.run.smithi083.stderr:2024-09-21T01:52:43.102+0000 7f8080f7a640 1 -- 172.21.15.83:0/3308540960 wait complete. 2024-09-21T01:52:43.304 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:52:43 smithi083 ceph-mon[31370]: from='client.? 172.21.15.83:0/3308540960' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T01:52:43.464 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:52:43 smithi142 ceph-mon[34050]: from='client.? 172.21.15.83:0/3308540960' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T01:52:43.467 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:52:43 smithi119 ceph-mon[33693]: from='client.? 172.21.15.83:0/3308540960' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T01:52:43.770 DEBUG:teuthology.orchestra.run.smithi083:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T01:52:43.796 DEBUG:teuthology.orchestra.run.smithi119:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T01:52:43.831 DEBUG:teuthology.orchestra.run.smithi142:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T01:52:43.869 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-09-21T01:52:43.870 DEBUG:teuthology.orchestra.run.smithi083:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-21T01:52:43.888 DEBUG:teuthology.orchestra.run.smithi119:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-21T01:52:43.907 DEBUG:teuthology.orchestra.run.smithi142:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-21T01:52:43.931 INFO:tasks.cephadm:Stopping all daemons... 2024-09-21T01:52:43.931 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-09-21T01:52:43.931 DEBUG:teuthology.orchestra.run.smithi083:> sudo systemctl stop ceph-f7697ecc-77b8-11ef-baf5-efdc52797490@mon.a 2024-09-21T01:52:44.053 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:52:43 smithi083 systemd[1]: Stopping Ceph mon.a for f7697ecc-77b8-11ef-baf5-efdc52797490... 2024-09-21T01:52:44.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:52:44 smithi142 ceph-mon[34050]: pgmap v672: 33 pgs: 33 active+clean; 577 KiB data, 423 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:52:44.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:52:44 smithi142 ceph-mon[34050]: from='client.? 172.21.15.83:0/3308540960' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T01:52:44.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:52:44 smithi142 ceph-mon[34050]: osdmap e98: 12 total, 12 up, 12 in 2024-09-21T01:52:44.349 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:52:44 smithi083 ceph-mon[31370]: pgmap v672: 33 pgs: 33 active+clean; 577 KiB data, 423 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:52:44.349 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:52:44 smithi083 ceph-mon[31370]: from='client.? 172.21.15.83:0/3308540960' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T01:52:44.350 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:52:44 smithi083 ceph-mon[31370]: osdmap e98: 12 total, 12 up, 12 in 2024-09-21T01:52:44.350 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:52:44 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mon-a[31366]: 2024-09-21T01:52:44.237+0000 7fb719404640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T01:52:44.350 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:52:44 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mon-a[31366]: 2024-09-21T01:52:44.237+0000 7fb719404640 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-09-21T01:52:44.469 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:52:44 smithi119 ceph-mon[33693]: pgmap v672: 33 pgs: 33 active+clean; 577 KiB data, 423 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T01:52:44.469 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:52:44 smithi119 ceph-mon[33693]: from='client.? 172.21.15.83:0/3308540960' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T01:52:44.470 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:52:44 smithi119 ceph-mon[33693]: osdmap e98: 12 total, 12 up, 12 in 2024-09-21T01:52:44.646 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:52:44 smithi083 podman[93842]: 2024-09-21 01:52:44.3497759 +0000 UTC m=+0.232634046 container died 97cefa149ed934e9d3d868ef7a5f16ab9720dc12c871746ef8f9529cb9f76a83 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mon-a, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2) 2024-09-21T01:52:44.989 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:52:44 smithi083 podman[93842]: 2024-09-21 01:52:44.738020805 +0000 UTC m=+0.620878951 container cleanup 97cefa149ed934e9d3d868ef7a5f16ab9720dc12c871746ef8f9529cb9f76a83 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mon-a, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-21T01:52:44.989 INFO:journalctl@ceph.mon.a.smithi083.stdout:Sep 21 01:52:44 smithi083 bash[93842]: ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mon-a 2024-09-21T01:52:45.120 DEBUG:teuthology.orchestra.run.smithi083:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f7697ecc-77b8-11ef-baf5-efdc52797490@mon.a.service' 2024-09-21T01:52:45.169 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T01:52:45.169 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-09-21T01:52:45.169 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-09-21T01:52:45.169 DEBUG:teuthology.orchestra.run.smithi119:> sudo systemctl stop ceph-f7697ecc-77b8-11ef-baf5-efdc52797490@mon.b 2024-09-21T01:52:45.468 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:52:45 smithi119 systemd[1]: Stopping Ceph mon.b for f7697ecc-77b8-11ef-baf5-efdc52797490... 2024-09-21T01:52:45.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:52:45 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mon-b[33689]: 2024-09-21T01:52:45.498+0000 7fcb9f371640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T01:52:45.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:52:45 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mon-b[33689]: 2024-09-21T01:52:45.498+0000 7fcb9f371640 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-09-21T01:52:45.968 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:52:45 smithi119 podman[66098]: 2024-09-21 01:52:45.632162989 +0000 UTC m=+0.260257674 container died 22c3ca81beccc184365e2f8d1f2502b3a562573e6c84d222fe0fdd1637ea0c1a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mon-b, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T01:52:46.243 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:52:46 smithi119 podman[66098]: 2024-09-21 01:52:46.066978737 +0000 UTC m=+0.695073421 container cleanup 22c3ca81beccc184365e2f8d1f2502b3a562573e6c84d222fe0fdd1637ea0c1a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mon-b, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-09-21T01:52:46.243 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:52:46 smithi119 bash[66098]: ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mon-b 2024-09-21T01:52:46.489 DEBUG:teuthology.orchestra.run.smithi119:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f7697ecc-77b8-11ef-baf5-efdc52797490@mon.b.service' 2024-09-21T01:52:46.511 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:52:46 smithi119 podman[66110]: 2024-09-21 01:52:46.243494069 +0000 UTC m=+0.608792634 container remove 22c3ca81beccc184365e2f8d1f2502b3a562573e6c84d222fe0fdd1637ea0c1a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mon-b, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T01:52:46.511 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:52:46 smithi119 systemd[1]: ceph-f7697ecc-77b8-11ef-baf5-efdc52797490@mon.b.service: Deactivated successfully. 2024-09-21T01:52:46.511 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:52:46 smithi119 systemd[1]: Stopped Ceph mon.b for f7697ecc-77b8-11ef-baf5-efdc52797490. 2024-09-21T01:52:46.512 INFO:journalctl@ceph.mon.b.smithi119.stdout:Sep 21 01:52:46 smithi119 systemd[1]: ceph-f7697ecc-77b8-11ef-baf5-efdc52797490@mon.b.service: Consumed 12.396s CPU time. 2024-09-21T01:52:46.533 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T01:52:46.533 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-09-21T01:52:46.533 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-09-21T01:52:46.534 DEBUG:teuthology.orchestra.run.smithi142:> sudo systemctl stop ceph-f7697ecc-77b8-11ef-baf5-efdc52797490@mon.c 2024-09-21T01:52:46.838 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:52:46 smithi142 systemd[1]: Stopping Ceph mon.c for f7697ecc-77b8-11ef-baf5-efdc52797490... 2024-09-21T01:52:47.214 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:52:46 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mon-c[34046]: 2024-09-21T01:52:46.837+0000 7fd4c0511640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T01:52:47.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:52:46 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mon-c[34046]: 2024-09-21T01:52:46.837+0000 7fd4c0511640 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-09-21T01:52:47.215 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:52:47 smithi142 podman[67067]: 2024-09-21 01:52:47.011153927 +0000 UTC m=+0.283781675 container died 80dee8574d61767c43a98cb3316d47b1e8f1e877b586a53794f6b68e601e8c5d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mon-c, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-09-21T01:52:47.648 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:52:47 smithi142 podman[67067]: 2024-09-21 01:52:47.396363652 +0000 UTC m=+0.668991399 container cleanup 80dee8574d61767c43a98cb3316d47b1e8f1e877b586a53794f6b68e601e8c5d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mon-c, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T01:52:47.648 INFO:journalctl@ceph.mon.c.smithi142.stdout:Sep 21 01:52:47 smithi142 bash[67067]: ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mon-c 2024-09-21T01:52:47.836 DEBUG:teuthology.orchestra.run.smithi142:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f7697ecc-77b8-11ef-baf5-efdc52797490@mon.c.service' 2024-09-21T01:52:47.883 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T01:52:47.883 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-09-21T01:52:47.883 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-09-21T01:52:47.883 DEBUG:teuthology.orchestra.run.smithi083:> sudo systemctl stop ceph-f7697ecc-77b8-11ef-baf5-efdc52797490@mgr.x 2024-09-21T01:52:48.168 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 21 01:52:47 smithi083 systemd[1]: Stopping Ceph mgr.x for f7697ecc-77b8-11ef-baf5-efdc52797490... 2024-09-21T01:52:48.511 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 21 01:52:48 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mgr-x[31598]: 2024-09-21T01:52:48.167+0000 7f43b4977640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T01:52:48.511 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 21 01:52:48 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mgr-x[31598]: 2024-09-21T01:52:48.167+0000 7f43b4977640 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2024-09-21T01:52:48.511 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 21 01:52:48 smithi083 podman[93965]: 2024-09-21 01:52:48.199253944 +0000 UTC m=+0.131875361 container died 8dfd8ae890885a6b23c8d73b3caab70055ba14befaacaeb0f8921e6256a2dd31 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mgr-x, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T01:52:48.804 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 21 01:52:48 smithi083 podman[93965]: 2024-09-21 01:52:48.610835036 +0000 UTC m=+0.543456443 container cleanup 8dfd8ae890885a6b23c8d73b3caab70055ba14befaacaeb0f8921e6256a2dd31 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mgr-x, io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-09-21T01:52:48.804 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 21 01:52:48 smithi083 bash[93965]: ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mgr-x 2024-09-21T01:52:49.089 DEBUG:teuthology.orchestra.run.smithi083:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f7697ecc-77b8-11ef-baf5-efdc52797490@mgr.x.service' 2024-09-21T01:52:49.170 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 21 01:52:48 smithi083 podman[93979]: 2024-09-21 01:52:48.846162515 +0000 UTC m=+0.640181336 container remove 8dfd8ae890885a6b23c8d73b3caab70055ba14befaacaeb0f8921e6256a2dd31 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mgr-x, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T01:52:49.170 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 21 01:52:49 smithi083 systemd[1]: ceph-f7697ecc-77b8-11ef-baf5-efdc52797490@mgr.x.service: Deactivated successfully. 2024-09-21T01:52:49.170 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 21 01:52:49 smithi083 systemd[1]: Stopped Ceph mgr.x for f7697ecc-77b8-11ef-baf5-efdc52797490. 2024-09-21T01:52:49.170 INFO:journalctl@ceph.mgr.x.smithi083.stdout:Sep 21 01:52:49 smithi083 systemd[1]: ceph-f7697ecc-77b8-11ef-baf5-efdc52797490@mgr.x.service: Consumed 47.612s CPU time. 2024-09-21T01:52:49.182 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T01:52:49.182 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-09-21T01:52:49.182 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-09-21T01:52:49.183 DEBUG:teuthology.orchestra.run.smithi119:> sudo systemctl stop ceph-f7697ecc-77b8-11ef-baf5-efdc52797490@mgr.y 2024-09-21T01:52:49.468 INFO:journalctl@ceph.mgr.y.smithi119.stdout:Sep 21 01:52:49 smithi119 systemd[1]: Stopping Ceph mgr.y for f7697ecc-77b8-11ef-baf5-efdc52797490... 2024-09-21T01:52:49.813 INFO:journalctl@ceph.mgr.y.smithi119.stdout:Sep 21 01:52:49 smithi119 podman[66221]: 2024-09-21 01:52:49.527896521 +0000 UTC m=+0.148410121 container died ecc355a207af0a8bd5212e227a513be9ed498579e44e7f7c453f19b32d05f3ec (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mgr-y, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-09-21T01:52:50.174 INFO:journalctl@ceph.mgr.y.smithi119.stdout:Sep 21 01:52:49 smithi119 podman[66221]: 2024-09-21 01:52:49.913674738 +0000 UTC m=+0.534188337 container cleanup ecc355a207af0a8bd5212e227a513be9ed498579e44e7f7c453f19b32d05f3ec (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mgr-y, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-21T01:52:50.174 INFO:journalctl@ceph.mgr.y.smithi119.stdout:Sep 21 01:52:49 smithi119 bash[66221]: ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mgr-y 2024-09-21T01:52:50.333 DEBUG:teuthology.orchestra.run.smithi119:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f7697ecc-77b8-11ef-baf5-efdc52797490@mgr.y.service' 2024-09-21T01:52:50.366 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T01:52:50.367 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-09-21T01:52:50.367 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-09-21T01:52:50.367 DEBUG:teuthology.orchestra.run.smithi142:> sudo systemctl stop ceph-f7697ecc-77b8-11ef-baf5-efdc52797490@mgr.z 2024-09-21T01:52:50.705 INFO:journalctl@ceph.mgr.z.smithi142.stdout:Sep 21 01:52:50 smithi142 systemd[1]: Stopping Ceph mgr.z for f7697ecc-77b8-11ef-baf5-efdc52797490... 2024-09-21T01:52:50.964 INFO:journalctl@ceph.mgr.z.smithi142.stdout:Sep 21 01:52:50 smithi142 podman[67187]: 2024-09-21 01:52:50.705597995 +0000 UTC m=+0.141466604 container died 430c2f99376b4c8ea3d23ae3c0679c79c907044494b5b07b8db4d19aabf3dfff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mgr-z, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T01:52:51.353 INFO:journalctl@ceph.mgr.z.smithi142.stdout:Sep 21 01:52:51 smithi142 podman[67187]: 2024-09-21 01:52:51.110425869 +0000 UTC m=+0.546294477 container cleanup 430c2f99376b4c8ea3d23ae3c0679c79c907044494b5b07b8db4d19aabf3dfff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mgr-z, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-09-21T01:52:51.354 INFO:journalctl@ceph.mgr.z.smithi142.stdout:Sep 21 01:52:51 smithi142 bash[67187]: ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mgr-z 2024-09-21T01:52:51.535 DEBUG:teuthology.orchestra.run.smithi142:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f7697ecc-77b8-11ef-baf5-efdc52797490@mgr.z.service' 2024-09-21T01:52:51.569 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T01:52:51.569 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-09-21T01:52:51.570 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-09-21T01:52:51.570 DEBUG:teuthology.orchestra.run.smithi083:> sudo systemctl stop ceph-f7697ecc-77b8-11ef-baf5-efdc52797490@osd.0 2024-09-21T01:52:51.899 INFO:journalctl@ceph.osd.0.smithi083.stdout:Sep 21 01:52:51 smithi083 systemd[1]: Stopping Ceph osd.0 for f7697ecc-77b8-11ef-baf5-efdc52797490... 2024-09-21T01:52:52.304 INFO:journalctl@ceph.osd.0.smithi083.stdout:Sep 21 01:52:51 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-0[48573]: 2024-09-21T01:52:51.898+0000 7f01da49e640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T01:52:52.304 INFO:journalctl@ceph.osd.0.smithi083.stdout:Sep 21 01:52:51 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-0[48573]: 2024-09-21T01:52:51.898+0000 7f01da49e640 -1 osd.0 98 *** Got signal Terminated *** 2024-09-21T01:52:52.304 INFO:journalctl@ceph.osd.0.smithi083.stdout:Sep 21 01:52:51 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-0[48573]: 2024-09-21T01:52:51.898+0000 7f01da49e640 -1 osd.0 98 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T01:52:57.625 INFO:journalctl@ceph.osd.0.smithi083.stdout:Sep 21 01:52:57 smithi083 podman[94086]: 2024-09-21 01:52:57.357281381 +0000 UTC m=+5.592656900 container died 1f0e0b5d85ffb0869c6e92006cab7e21d2798b06aa758a559a0440acfbe6ea85 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-0, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-21T01:52:57.992 INFO:journalctl@ceph.osd.0.smithi083.stdout:Sep 21 01:52:57 smithi083 podman[94086]: 2024-09-21 01:52:57.732924932 +0000 UTC m=+5.968300450 container cleanup 1f0e0b5d85ffb0869c6e92006cab7e21d2798b06aa758a559a0440acfbe6ea85 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-0, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS) 2024-09-21T01:52:57.993 INFO:journalctl@ceph.osd.0.smithi083.stdout:Sep 21 01:52:57 smithi083 bash[94086]: ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-0 2024-09-21T01:52:58.303 INFO:journalctl@ceph.osd.0.smithi083.stdout:Sep 21 01:52:57 smithi083 podman[94101]: 2024-09-21 01:52:57.992953316 +0000 UTC m=+0.629606262 container remove 1f0e0b5d85ffb0869c6e92006cab7e21d2798b06aa758a559a0440acfbe6ea85 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T01:52:58.554 INFO:journalctl@ceph.osd.0.smithi083.stdout:Sep 21 01:52:58 smithi083 podman[94187]: 2024-09-21 01:52:58.205711882 +0000 UTC m=+0.015712116 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T01:52:58.554 INFO:journalctl@ceph.osd.0.smithi083.stdout:Sep 21 01:52:58 smithi083 podman[94187]: 2024-09-21 01:52:58.344005855 +0000 UTC m=+0.154006092 container create 2e0dca804af5322de2a5648128d845a31ac67e6fc8796a57d13a1a9ab9ee5765 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-0-deactivate, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True) 2024-09-21T01:52:59.054 INFO:journalctl@ceph.osd.0.smithi083.stdout:Sep 21 01:52:58 smithi083 podman[94187]: 2024-09-21 01:52:58.621996244 +0000 UTC m=+0.431996484 container init 2e0dca804af5322de2a5648128d845a31ac67e6fc8796a57d13a1a9ab9ee5765 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-0-deactivate, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T01:52:59.054 INFO:journalctl@ceph.osd.0.smithi083.stdout:Sep 21 01:52:58 smithi083 podman[94187]: 2024-09-21 01:52:58.625621289 +0000 UTC m=+0.435621518 container start 2e0dca804af5322de2a5648128d845a31ac67e6fc8796a57d13a1a9ab9ee5765 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-0-deactivate, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-09-21T01:52:59.054 INFO:journalctl@ceph.osd.0.smithi083.stdout:Sep 21 01:52:58 smithi083 podman[94187]: 2024-09-21 01:52:58.696980599 +0000 UTC m=+0.506980830 container attach 2e0dca804af5322de2a5648128d845a31ac67e6fc8796a57d13a1a9ab9ee5765 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-0-deactivate, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True) 2024-09-21T01:52:59.054 INFO:journalctl@ceph.osd.0.smithi083.stdout:Sep 21 01:52:58 smithi083 podman[94187]: 2024-09-21 01:52:58.818378333 +0000 UTC m=+0.628378567 container died 2e0dca804af5322de2a5648128d845a31ac67e6fc8796a57d13a1a9ab9ee5765 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-0-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2) 2024-09-21T01:52:59.406 DEBUG:teuthology.orchestra.run.smithi083:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f7697ecc-77b8-11ef-baf5-efdc52797490@osd.0.service' 2024-09-21T01:52:59.446 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T01:52:59.446 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-09-21T01:52:59.446 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-09-21T01:52:59.446 DEBUG:teuthology.orchestra.run.smithi119:> sudo systemctl stop ceph-f7697ecc-77b8-11ef-baf5-efdc52797490@osd.1 2024-09-21T01:52:59.752 INFO:journalctl@ceph.osd.1.smithi119.stdout:Sep 21 01:52:59 smithi119 systemd[1]: Stopping Ceph osd.1 for f7697ecc-77b8-11ef-baf5-efdc52797490... 2024-09-21T01:53:00.217 INFO:journalctl@ceph.osd.1.smithi119.stdout:Sep 21 01:52:59 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-1[38376]: 2024-09-21T01:52:59.752+0000 7f231c1fd640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T01:53:00.218 INFO:journalctl@ceph.osd.1.smithi119.stdout:Sep 21 01:52:59 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-1[38376]: 2024-09-21T01:52:59.752+0000 7f231c1fd640 -1 osd.1 98 *** Got signal Terminated *** 2024-09-21T01:53:00.218 INFO:journalctl@ceph.osd.1.smithi119.stdout:Sep 21 01:52:59 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-1[38376]: 2024-09-21T01:52:59.752+0000 7f231c1fd640 -1 osd.1 98 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T01:53:05.552 INFO:journalctl@ceph.osd.1.smithi119.stdout:Sep 21 01:53:05 smithi119 podman[66347]: 2024-09-21 01:53:05.233087365 +0000 UTC m=+5.594058192 container died b76506a9fc03f21ce9d97f2fc1bb3084e2562494d10afb39a86b1b1dae7104ab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-1, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731) 2024-09-21T01:53:05.967 INFO:journalctl@ceph.osd.1.smithi119.stdout:Sep 21 01:53:05 smithi119 podman[66347]: 2024-09-21 01:53:05.552015398 +0000 UTC m=+5.912986259 container cleanup b76506a9fc03f21ce9d97f2fc1bb3084e2562494d10afb39a86b1b1dae7104ab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-1, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-09-21T01:53:05.968 INFO:journalctl@ceph.osd.1.smithi119.stdout:Sep 21 01:53:05 smithi119 bash[66347]: ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-1 2024-09-21T01:53:05.968 INFO:journalctl@ceph.osd.1.smithi119.stdout:Sep 21 01:53:05 smithi119 podman[66375]: 2024-09-21 01:53:05.795626478 +0000 UTC m=+0.563312233 container remove b76506a9fc03f21ce9d97f2fc1bb3084e2562494d10afb39a86b1b1dae7104ab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-1, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T01:53:06.474 INFO:journalctl@ceph.osd.1.smithi119.stdout:Sep 21 01:53:06 smithi119 podman[66464]: 2024-09-21 01:53:06.12291071 +0000 UTC m=+0.015955346 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T01:53:06.474 INFO:journalctl@ceph.osd.1.smithi119.stdout:Sep 21 01:53:06 smithi119 podman[66464]: 2024-09-21 01:53:06.229940511 +0000 UTC m=+0.122985130 container create ab9777d6d68b167a33e75a4386a490c6b2c6591cd1480b3b0763d329c7f8c8c4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-1-deactivate, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True) 2024-09-21T01:53:06.968 INFO:journalctl@ceph.osd.1.smithi119.stdout:Sep 21 01:53:06 smithi119 podman[66464]: 2024-09-21 01:53:06.474371112 +0000 UTC m=+0.367415730 container init ab9777d6d68b167a33e75a4386a490c6b2c6591cd1480b3b0763d329c7f8c8c4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-1-deactivate, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T01:53:06.968 INFO:journalctl@ceph.osd.1.smithi119.stdout:Sep 21 01:53:06 smithi119 podman[66464]: 2024-09-21 01:53:06.477800837 +0000 UTC m=+0.370845458 container start ab9777d6d68b167a33e75a4386a490c6b2c6591cd1480b3b0763d329c7f8c8c4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-1-deactivate, ceph=True, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-09-21T01:53:06.968 INFO:journalctl@ceph.osd.1.smithi119.stdout:Sep 21 01:53:06 smithi119 podman[66464]: 2024-09-21 01:53:06.582732578 +0000 UTC m=+0.475777208 container attach ab9777d6d68b167a33e75a4386a490c6b2c6591cd1480b3b0763d329c7f8c8c4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-1-deactivate, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-09-21T01:53:06.968 INFO:journalctl@ceph.osd.1.smithi119.stdout:Sep 21 01:53:06 smithi119 podman[66464]: 2024-09-21 01:53:06.670221641 +0000 UTC m=+0.563266267 container died ab9777d6d68b167a33e75a4386a490c6b2c6591cd1480b3b0763d329c7f8c8c4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-1-deactivate, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-21T01:53:07.366 DEBUG:teuthology.orchestra.run.smithi119:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f7697ecc-77b8-11ef-baf5-efdc52797490@osd.1.service' 2024-09-21T01:53:07.404 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T01:53:07.405 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-09-21T01:53:07.405 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-09-21T01:53:07.405 DEBUG:teuthology.orchestra.run.smithi142:> sudo systemctl stop ceph-f7697ecc-77b8-11ef-baf5-efdc52797490@osd.2 2024-09-21T01:53:07.714 INFO:journalctl@ceph.osd.2.smithi142.stdout:Sep 21 01:53:07 smithi142 systemd[1]: Stopping Ceph osd.2 for f7697ecc-77b8-11ef-baf5-efdc52797490... 2024-09-21T01:53:07.989 INFO:journalctl@ceph.osd.2.smithi142.stdout:Sep 21 01:53:07 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-2[39164]: 2024-09-21T01:53:07.939+0000 7fa1349ac640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T01:53:07.989 INFO:journalctl@ceph.osd.2.smithi142.stdout:Sep 21 01:53:07 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-2[39164]: 2024-09-21T01:53:07.939+0000 7fa1349ac640 -1 osd.2 98 *** Got signal Terminated *** 2024-09-21T01:53:07.989 INFO:journalctl@ceph.osd.2.smithi142.stdout:Sep 21 01:53:07 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-2[39164]: 2024-09-21T01:53:07.939+0000 7fa1349ac640 -1 osd.2 98 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T01:53:13.582 INFO:journalctl@ceph.osd.2.smithi142.stdout:Sep 21 01:53:13 smithi142 podman[67315]: 2024-09-21 01:53:13.290854886 +0000 UTC m=+5.687312408 container died 7a8837079d78093df31ce818599d1e8c1d1ad7bcba8d4bb6e8587d3fd79e3a3d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True) 2024-09-21T01:53:13.932 INFO:journalctl@ceph.osd.2.smithi142.stdout:Sep 21 01:53:13 smithi142 podman[67315]: 2024-09-21 01:53:13.672593904 +0000 UTC m=+6.069051415 container cleanup 7a8837079d78093df31ce818599d1e8c1d1ad7bcba8d4bb6e8587d3fd79e3a3d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-21T01:53:13.932 INFO:journalctl@ceph.osd.2.smithi142.stdout:Sep 21 01:53:13 smithi142 bash[67315]: ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-2 2024-09-21T01:53:14.215 INFO:journalctl@ceph.osd.2.smithi142.stdout:Sep 21 01:53:13 smithi142 podman[67342]: 2024-09-21 01:53:13.932389291 +0000 UTC m=+0.639656975 container remove 7a8837079d78093df31ce818599d1e8c1d1ad7bcba8d4bb6e8587d3fd79e3a3d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-2, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-09-21T01:53:14.636 INFO:journalctl@ceph.osd.2.smithi142.stdout:Sep 21 01:53:14 smithi142 podman[67433]: 2024-09-21 01:53:14.192763377 +0000 UTC m=+0.015500275 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T01:53:14.636 INFO:journalctl@ceph.osd.2.smithi142.stdout:Sep 21 01:53:14 smithi142 podman[67433]: 2024-09-21 01:53:14.308573353 +0000 UTC m=+0.131310235 container create 8b1dae140e5caedd443adc5f4b4f955f1514549029a03b47b560c208ea2d5d16 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-2-deactivate, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-09-21T01:53:14.636 INFO:journalctl@ceph.osd.2.smithi142.stdout:Sep 21 01:53:14 smithi142 podman[67433]: 2024-09-21 01:53:14.536260151 +0000 UTC m=+0.358997043 container init 8b1dae140e5caedd443adc5f4b4f955f1514549029a03b47b560c208ea2d5d16 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-2-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-21T01:53:14.636 INFO:journalctl@ceph.osd.2.smithi142.stdout:Sep 21 01:53:14 smithi142 podman[67433]: 2024-09-21 01:53:14.539510464 +0000 UTC m=+0.362247353 container start 8b1dae140e5caedd443adc5f4b4f955f1514549029a03b47b560c208ea2d5d16 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-2-deactivate, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T01:53:14.636 INFO:journalctl@ceph.osd.2.smithi142.stdout:Sep 21 01:53:14 smithi142 podman[67433]: 2024-09-21 01:53:14.636137297 +0000 UTC m=+0.458874196 container attach 8b1dae140e5caedd443adc5f4b4f955f1514549029a03b47b560c208ea2d5d16 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-2-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731) 2024-09-21T01:53:14.965 INFO:journalctl@ceph.osd.2.smithi142.stdout:Sep 21 01:53:14 smithi142 podman[67433]: 2024-09-21 01:53:14.734548398 +0000 UTC m=+0.557285291 container died 8b1dae140e5caedd443adc5f4b4f955f1514549029a03b47b560c208ea2d5d16 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-2-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2) 2024-09-21T01:53:15.467 DEBUG:teuthology.orchestra.run.smithi142:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f7697ecc-77b8-11ef-baf5-efdc52797490@osd.2.service' 2024-09-21T01:53:15.509 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T01:53:15.509 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-09-21T01:53:15.509 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-09-21T01:53:15.510 DEBUG:teuthology.orchestra.run.smithi083:> sudo systemctl stop ceph-f7697ecc-77b8-11ef-baf5-efdc52797490@osd.3 2024-09-21T01:53:15.804 INFO:journalctl@ceph.osd.3.smithi083.stdout:Sep 21 01:53:15 smithi083 systemd[1]: Stopping Ceph osd.3 for f7697ecc-77b8-11ef-baf5-efdc52797490... 2024-09-21T01:53:16.304 INFO:journalctl@ceph.osd.3.smithi083.stdout:Sep 21 01:53:15 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-3[54664]: 2024-09-21T01:53:15.828+0000 7ff195738640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T01:53:16.304 INFO:journalctl@ceph.osd.3.smithi083.stdout:Sep 21 01:53:15 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-3[54664]: 2024-09-21T01:53:15.828+0000 7ff195738640 -1 osd.3 98 *** Got signal Terminated *** 2024-09-21T01:53:16.304 INFO:journalctl@ceph.osd.3.smithi083.stdout:Sep 21 01:53:15 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-3[54664]: 2024-09-21T01:53:15.828+0000 7ff195738640 -1 osd.3 98 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T01:53:18.968 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:53:18 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:53:18.567+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:52.739060+0000 front 2024-09-21T01:52:52.738919+0000 (oldest deadline 2024-09-21T01:53:18.038843+0000) 2024-09-21T01:53:19.214 INFO:journalctl@ceph.osd.5.smithi142.stdout:Sep 21 01:53:18 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-5[45407]: 2024-09-21T01:53:18.893+0000 7f739d5c3640 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:54.526636+0000 front 2024-09-21T01:52:54.526664+0000 (oldest deadline 2024-09-21T01:53:18.026396+0000) 2024-09-21T01:53:19.554 INFO:journalctl@ceph.osd.3.smithi083.stdout:Sep 21 01:53:19 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-3[54664]: 2024-09-21T01:53:19.218+0000 7ff18dd1b640 -1 osd.3 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:55.918299+0000 front 2024-09-21T01:52:55.918406+0000 (oldest deadline 2024-09-21T01:53:18.218524+0000) 2024-09-21T01:53:19.714 INFO:journalctl@ceph.osd.8.smithi142.stdout:Sep 21 01:53:19 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-8[51832]: 2024-09-21T01:53:19.249+0000 7f95b1069640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:55.543069+0000 front 2024-09-21T01:52:55.543096+0000 (oldest deadline 2024-09-21T01:53:19.042967+0000) 2024-09-21T01:53:19.967 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:53:19 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:53:19.613+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:52.739060+0000 front 2024-09-21T01:52:52.738919+0000 (oldest deadline 2024-09-21T01:53:18.038843+0000) 2024-09-21T01:53:20.215 INFO:journalctl@ceph.osd.5.smithi142.stdout:Sep 21 01:53:19 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-5[45407]: 2024-09-21T01:53:19.854+0000 7f739d5c3640 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:54.526636+0000 front 2024-09-21T01:52:54.526664+0000 (oldest deadline 2024-09-21T01:53:18.026396+0000) 2024-09-21T01:53:20.553 INFO:journalctl@ceph.osd.3.smithi083.stdout:Sep 21 01:53:20 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-3[54664]: 2024-09-21T01:53:20.209+0000 7ff18dd1b640 -1 osd.3 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:55.918299+0000 front 2024-09-21T01:52:55.918406+0000 (oldest deadline 2024-09-21T01:53:18.218524+0000) 2024-09-21T01:53:20.715 INFO:journalctl@ceph.osd.8.smithi142.stdout:Sep 21 01:53:20 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-8[51832]: 2024-09-21T01:53:20.233+0000 7f95b1069640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:55.543069+0000 front 2024-09-21T01:52:55.543096+0000 (oldest deadline 2024-09-21T01:53:19.042967+0000) 2024-09-21T01:53:20.967 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:53:20 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:53:20.590+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:52.739060+0000 front 2024-09-21T01:52:52.738919+0000 (oldest deadline 2024-09-21T01:53:18.038843+0000) 2024-09-21T01:53:21.214 INFO:journalctl@ceph.osd.5.smithi142.stdout:Sep 21 01:53:20 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-5[45407]: 2024-09-21T01:53:20.833+0000 7f739d5c3640 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:54.526636+0000 front 2024-09-21T01:52:54.526664+0000 (oldest deadline 2024-09-21T01:53:18.026396+0000) 2024-09-21T01:53:21.537 INFO:journalctl@ceph.osd.3.smithi083.stdout:Sep 21 01:53:21 smithi083 podman[94290]: 2024-09-21 01:53:21.271024811 +0000 UTC m=+5.570992065 container died ffdc335f2d648665d8e23423f85433f64dfeedc73c88541fd969c8173345fbc8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-3, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, ceph=True) 2024-09-21T01:53:21.714 INFO:journalctl@ceph.osd.8.smithi142.stdout:Sep 21 01:53:21 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-8[51832]: 2024-09-21T01:53:21.261+0000 7f95b1069640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:55.543069+0000 front 2024-09-21T01:52:55.543096+0000 (oldest deadline 2024-09-21T01:53:19.042967+0000) 2024-09-21T01:53:21.804 INFO:journalctl@ceph.osd.3.smithi083.stdout:Sep 21 01:53:21 smithi083 podman[94290]: 2024-09-21 01:53:21.59544299 +0000 UTC m=+5.895410235 container cleanup ffdc335f2d648665d8e23423f85433f64dfeedc73c88541fd969c8173345fbc8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-3, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-21T01:53:21.804 INFO:journalctl@ceph.osd.3.smithi083.stdout:Sep 21 01:53:21 smithi083 bash[94290]: ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-3 2024-09-21T01:53:21.967 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:53:21 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:53:21.620+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:52.739060+0000 front 2024-09-21T01:52:52.738919+0000 (oldest deadline 2024-09-21T01:53:18.038843+0000) 2024-09-21T01:53:22.214 INFO:journalctl@ceph.osd.5.smithi142.stdout:Sep 21 01:53:21 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-5[45407]: 2024-09-21T01:53:21.794+0000 7f739d5c3640 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:54.526636+0000 front 2024-09-21T01:52:54.526664+0000 (oldest deadline 2024-09-21T01:53:18.026396+0000) 2024-09-21T01:53:22.215 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:53:21 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:53:21.842+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:55.996660+0000 front 2024-09-21T01:52:55.996645+0000 (oldest deadline 2024-09-21T01:53:21.296531+0000) 2024-09-21T01:53:22.240 INFO:journalctl@ceph.osd.3.smithi083.stdout:Sep 21 01:53:21 smithi083 podman[94318]: 2024-09-21 01:53:21.831553752 +0000 UTC m=+0.553992453 container remove ffdc335f2d648665d8e23423f85433f64dfeedc73c88541fd969c8173345fbc8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-3, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T01:53:22.525 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:53:22 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:53:22.240+0000 7fc210836640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:56.783488+0000 front 2024-09-21T01:52:56.783513+0000 (oldest deadline 2024-09-21T01:53:21.483559+0000) 2024-09-21T01:53:22.526 INFO:journalctl@ceph.osd.3.smithi083.stdout:Sep 21 01:53:22 smithi083 podman[94405]: 2024-09-21 01:53:22.166980311 +0000 UTC m=+0.015712155 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T01:53:22.526 INFO:journalctl@ceph.osd.3.smithi083.stdout:Sep 21 01:53:22 smithi083 podman[94405]: 2024-09-21 01:53:22.28160271 +0000 UTC m=+0.130334542 container create 206a3dc1d4e34fe3472d392db962dbf7f1ff02b0fb48a3b33b249e16efe0e075 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-3-deactivate, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=) 2024-09-21T01:53:22.714 INFO:journalctl@ceph.osd.8.smithi142.stdout:Sep 21 01:53:22 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-8[51832]: 2024-09-21T01:53:22.215+0000 7f95b1069640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:55.543069+0000 front 2024-09-21T01:52:55.543096+0000 (oldest deadline 2024-09-21T01:53:19.042967+0000) 2024-09-21T01:53:22.804 INFO:journalctl@ceph.osd.3.smithi083.stdout:Sep 21 01:53:22 smithi083 podman[94405]: 2024-09-21 01:53:22.525994222 +0000 UTC m=+0.374726066 container init 206a3dc1d4e34fe3472d392db962dbf7f1ff02b0fb48a3b33b249e16efe0e075 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-3-deactivate, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True) 2024-09-21T01:53:22.804 INFO:journalctl@ceph.osd.3.smithi083.stdout:Sep 21 01:53:22 smithi083 podman[94405]: 2024-09-21 01:53:22.529795752 +0000 UTC m=+0.378527586 container start 206a3dc1d4e34fe3472d392db962dbf7f1ff02b0fb48a3b33b249e16efe0e075 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-3-deactivate, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-09-21T01:53:22.804 INFO:journalctl@ceph.osd.3.smithi083.stdout:Sep 21 01:53:22 smithi083 podman[94405]: 2024-09-21 01:53:22.625983948 +0000 UTC m=+0.474715783 container attach 206a3dc1d4e34fe3472d392db962dbf7f1ff02b0fb48a3b33b249e16efe0e075 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-3-deactivate, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T01:53:22.804 INFO:journalctl@ceph.osd.3.smithi083.stdout:Sep 21 01:53:22 smithi083 podman[94405]: 2024-09-21 01:53:22.723096319 +0000 UTC m=+0.571828173 container died 206a3dc1d4e34fe3472d392db962dbf7f1ff02b0fb48a3b33b249e16efe0e075 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-3-deactivate, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2) 2024-09-21T01:53:22.968 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:53:22 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:53:22.667+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:52.739060+0000 front 2024-09-21T01:52:52.738919+0000 (oldest deadline 2024-09-21T01:53:18.038843+0000) 2024-09-21T01:53:23.176 INFO:journalctl@ceph.osd.5.smithi142.stdout:Sep 21 01:53:22 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-5[45407]: 2024-09-21T01:53:22.775+0000 7f739d5c3640 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:54.526636+0000 front 2024-09-21T01:52:54.526664+0000 (oldest deadline 2024-09-21T01:53:18.026396+0000) 2024-09-21T01:53:23.176 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:53:22 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:53:22.840+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:55.996660+0000 front 2024-09-21T01:52:55.996645+0000 (oldest deadline 2024-09-21T01:53:21.296531+0000) 2024-09-21T01:53:23.418 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:53:23 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:53:23.236+0000 7fc210836640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:56.783488+0000 front 2024-09-21T01:52:56.783513+0000 (oldest deadline 2024-09-21T01:53:21.483559+0000) 2024-09-21T01:53:23.446 DEBUG:teuthology.orchestra.run.smithi083:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f7697ecc-77b8-11ef-baf5-efdc52797490@osd.3.service' 2024-09-21T01:53:23.464 INFO:journalctl@ceph.osd.8.smithi142.stdout:Sep 21 01:53:23 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-8[51832]: 2024-09-21T01:53:23.176+0000 7f95b1069640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:55.543069+0000 front 2024-09-21T01:52:55.543096+0000 (oldest deadline 2024-09-21T01:53:19.042967+0000) 2024-09-21T01:53:23.483 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T01:53:23.484 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-09-21T01:53:23.484 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-09-21T01:53:23.484 DEBUG:teuthology.orchestra.run.smithi119:> sudo systemctl stop ceph-f7697ecc-77b8-11ef-baf5-efdc52797490@osd.4 2024-09-21T01:53:23.790 INFO:journalctl@ceph.osd.4.smithi119.stdout:Sep 21 01:53:23 smithi119 systemd[1]: Stopping Ceph osd.4 for f7697ecc-77b8-11ef-baf5-efdc52797490... 2024-09-21T01:53:23.790 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:53:23 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:53:23.705+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:52.739060+0000 front 2024-09-21T01:52:52.738919+0000 (oldest deadline 2024-09-21T01:53:18.038843+0000) 2024-09-21T01:53:24.210 INFO:journalctl@ceph.osd.5.smithi142.stdout:Sep 21 01:53:23 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-5[45407]: 2024-09-21T01:53:23.782+0000 7f739d5c3640 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:54.526636+0000 front 2024-09-21T01:52:54.526664+0000 (oldest deadline 2024-09-21T01:53:18.026396+0000) 2024-09-21T01:53:24.210 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:53:23 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:53:23.817+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:55.996660+0000 front 2024-09-21T01:52:55.996645+0000 (oldest deadline 2024-09-21T01:53:21.296531+0000) 2024-09-21T01:53:24.217 INFO:journalctl@ceph.osd.4.smithi119.stdout:Sep 21 01:53:23 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-4[44791]: 2024-09-21T01:53:23.788+0000 7f20db4c5640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T01:53:24.217 INFO:journalctl@ceph.osd.4.smithi119.stdout:Sep 21 01:53:23 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-4[44791]: 2024-09-21T01:53:23.788+0000 7f20db4c5640 -1 osd.4 98 *** Got signal Terminated *** 2024-09-21T01:53:24.217 INFO:journalctl@ceph.osd.4.smithi119.stdout:Sep 21 01:53:23 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-4[44791]: 2024-09-21T01:53:23.788+0000 7f20db4c5640 -1 osd.4 98 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T01:53:24.464 INFO:journalctl@ceph.osd.8.smithi142.stdout:Sep 21 01:53:24 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-8[51832]: 2024-09-21T01:53:24.209+0000 7f95b1069640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:55.543069+0000 front 2024-09-21T01:52:55.543096+0000 (oldest deadline 2024-09-21T01:53:19.042967+0000) 2024-09-21T01:53:24.553 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:53:24 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:53:24.279+0000 7fc210836640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:56.783488+0000 front 2024-09-21T01:52:56.783513+0000 (oldest deadline 2024-09-21T01:53:21.483559+0000) 2024-09-21T01:53:25.214 INFO:journalctl@ceph.osd.5.smithi142.stdout:Sep 21 01:53:24 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-5[45407]: 2024-09-21T01:53:24.736+0000 7f739d5c3640 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:54.526636+0000 front 2024-09-21T01:52:54.526664+0000 (oldest deadline 2024-09-21T01:53:18.026396+0000) 2024-09-21T01:53:25.215 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:53:24 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:53:24.803+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:55.996660+0000 front 2024-09-21T01:52:55.996645+0000 (oldest deadline 2024-09-21T01:53:21.296531+0000) 2024-09-21T01:53:25.218 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:53:24 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:53:24.737+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:52.739060+0000 front 2024-09-21T01:52:52.738919+0000 (oldest deadline 2024-09-21T01:53:18.038843+0000) 2024-09-21T01:53:25.554 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:53:25 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:53:25.253+0000 7fc210836640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:56.783488+0000 front 2024-09-21T01:52:56.783513+0000 (oldest deadline 2024-09-21T01:53:21.483559+0000) 2024-09-21T01:53:25.714 INFO:journalctl@ceph.osd.8.smithi142.stdout:Sep 21 01:53:25 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-8[51832]: 2024-09-21T01:53:25.236+0000 7f95b1069640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:55.543069+0000 front 2024-09-21T01:52:55.543096+0000 (oldest deadline 2024-09-21T01:53:19.042967+0000) 2024-09-21T01:53:26.053 INFO:journalctl@ceph.osd.6.smithi083.stdout:Sep 21 01:53:25 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-6[60956]: 2024-09-21T01:53:25.624+0000 7fc395e3d640 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:03.763137+0000 front 2024-09-21T01:53:03.763256+0000 (oldest deadline 2024-09-21T01:53:25.463021+0000) 2024-09-21T01:53:26.214 INFO:journalctl@ceph.osd.5.smithi142.stdout:Sep 21 01:53:25 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-5[45407]: 2024-09-21T01:53:25.729+0000 7f739d5c3640 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:54.526636+0000 front 2024-09-21T01:52:54.526664+0000 (oldest deadline 2024-09-21T01:53:18.026396+0000) 2024-09-21T01:53:26.214 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:53:25 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:53:25.834+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:55.996660+0000 front 2024-09-21T01:52:55.996645+0000 (oldest deadline 2024-09-21T01:53:21.296531+0000) 2024-09-21T01:53:26.217 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:53:25 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:53:25.720+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:52.739060+0000 front 2024-09-21T01:52:52.738919+0000 (oldest deadline 2024-09-21T01:53:18.038843+0000) 2024-09-21T01:53:26.553 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:53:26 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:53:26.284+0000 7fc210836640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:56.783488+0000 front 2024-09-21T01:52:56.783513+0000 (oldest deadline 2024-09-21T01:53:21.483559+0000) 2024-09-21T01:53:26.699 INFO:journalctl@ceph.osd.8.smithi142.stdout:Sep 21 01:53:26 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-8[51832]: 2024-09-21T01:53:26.278+0000 7f95b1069640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:55.543069+0000 front 2024-09-21T01:52:55.543096+0000 (oldest deadline 2024-09-21T01:53:19.042967+0000) 2024-09-21T01:53:26.964 INFO:journalctl@ceph.osd.5.smithi142.stdout:Sep 21 01:53:26 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-5[45407]: 2024-09-21T01:53:26.698+0000 7f739d5c3640 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:54.526636+0000 front 2024-09-21T01:52:54.526664+0000 (oldest deadline 2024-09-21T01:53:18.026396+0000) 2024-09-21T01:53:26.965 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:53:26 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:53:26.838+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:55.996660+0000 front 2024-09-21T01:52:55.996645+0000 (oldest deadline 2024-09-21T01:53:21.296531+0000) 2024-09-21T01:53:27.053 INFO:journalctl@ceph.osd.6.smithi083.stdout:Sep 21 01:53:26 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-6[60956]: 2024-09-21T01:53:26.643+0000 7fc395e3d640 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:03.763137+0000 front 2024-09-21T01:53:03.763256+0000 (oldest deadline 2024-09-21T01:53:25.463021+0000) 2024-09-21T01:53:27.218 INFO:journalctl@ceph.osd.7.smithi119.stdout:Sep 21 01:53:26 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-7[51223]: 2024-09-21T01:53:26.959+0000 7f38e1d98640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:04.415340+0000 front 2024-09-21T01:53:04.415508+0000 (oldest deadline 2024-09-21T01:53:26.715499+0000) 2024-09-21T01:53:27.218 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:53:26 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:53:26.754+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:52.739060+0000 front 2024-09-21T01:52:52.738919+0000 (oldest deadline 2024-09-21T01:53:18.038843+0000) 2024-09-21T01:53:27.218 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:53:26 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:53:26.754+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:03.740740+0000 front 2024-09-21T01:53:03.740797+0000 (oldest deadline 2024-09-21T01:53:26.040830+0000) 2024-09-21T01:53:27.551 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:53:27 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:53:27.296+0000 7fc210836640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:56.783488+0000 front 2024-09-21T01:52:56.783513+0000 (oldest deadline 2024-09-21T01:53:21.483559+0000) 2024-09-21T01:53:27.714 INFO:journalctl@ceph.osd.8.smithi142.stdout:Sep 21 01:53:27 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-8[51832]: 2024-09-21T01:53:27.304+0000 7f95b1069640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:55.543069+0000 front 2024-09-21T01:52:55.543096+0000 (oldest deadline 2024-09-21T01:53:19.042967+0000) 2024-09-21T01:53:27.803 INFO:journalctl@ceph.osd.6.smithi083.stdout:Sep 21 01:53:27 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-6[60956]: 2024-09-21T01:53:27.661+0000 7fc395e3d640 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:03.763137+0000 front 2024-09-21T01:53:03.763256+0000 (oldest deadline 2024-09-21T01:53:25.463021+0000) 2024-09-21T01:53:28.214 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:53:27 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:53:27.874+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:55.996660+0000 front 2024-09-21T01:52:55.996645+0000 (oldest deadline 2024-09-21T01:53:21.296531+0000) 2024-09-21T01:53:28.215 INFO:journalctl@ceph.osd.5.smithi142.stdout:Sep 21 01:53:27 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-5[45407]: 2024-09-21T01:53:27.737+0000 7f739d5c3640 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:54.526636+0000 front 2024-09-21T01:52:54.526664+0000 (oldest deadline 2024-09-21T01:53:18.026396+0000) 2024-09-21T01:53:28.215 INFO:journalctl@ceph.osd.5.smithi142.stdout:Sep 21 01:53:27 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-5[45407]: 2024-09-21T01:53:27.737+0000 7f739d5c3640 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:01.428159+0000 front 2024-09-21T01:53:01.427998+0000 (oldest deadline 2024-09-21T01:53:26.728078+0000) 2024-09-21T01:53:28.217 INFO:journalctl@ceph.osd.7.smithi119.stdout:Sep 21 01:53:27 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-7[51223]: 2024-09-21T01:53:27.940+0000 7f38e1d98640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:04.415340+0000 front 2024-09-21T01:53:04.415508+0000 (oldest deadline 2024-09-21T01:53:26.715499+0000) 2024-09-21T01:53:28.218 INFO:journalctl@ceph.osd.4.smithi119.stdout:Sep 21 01:53:27 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-4[44791]: 2024-09-21T01:53:27.881+0000 7f20d7ab0640 -1 osd.4 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:03.867069+0000 front 2024-09-21T01:53:03.867046+0000 (oldest deadline 2024-09-21T01:53:27.267770+0000) 2024-09-21T01:53:28.218 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:53:27 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:53:27.751+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:52.739060+0000 front 2024-09-21T01:52:52.738919+0000 (oldest deadline 2024-09-21T01:53:18.038843+0000) 2024-09-21T01:53:28.218 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:53:27 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:53:27.751+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:03.740740+0000 front 2024-09-21T01:53:03.740797+0000 (oldest deadline 2024-09-21T01:53:26.040830+0000) 2024-09-21T01:53:28.554 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:53:28 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:53:28.319+0000 7fc210836640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:56.783488+0000 front 2024-09-21T01:52:56.783513+0000 (oldest deadline 2024-09-21T01:53:21.483559+0000) 2024-09-21T01:53:28.554 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:53:28 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:53:28.319+0000 7fc210836640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:01.484146+0000 front 2024-09-21T01:53:01.484128+0000 (oldest deadline 2024-09-21T01:53:27.384161+0000) 2024-09-21T01:53:28.697 INFO:journalctl@ceph.osd.8.smithi142.stdout:Sep 21 01:53:28 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-8[51832]: 2024-09-21T01:53:28.329+0000 7f95b1069640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:55.543069+0000 front 2024-09-21T01:52:55.543096+0000 (oldest deadline 2024-09-21T01:53:19.042967+0000) 2024-09-21T01:53:28.964 INFO:journalctl@ceph.osd.5.smithi142.stdout:Sep 21 01:53:28 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-5[45407]: 2024-09-21T01:53:28.696+0000 7f739d5c3640 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:54.526636+0000 front 2024-09-21T01:52:54.526664+0000 (oldest deadline 2024-09-21T01:53:18.026396+0000) 2024-09-21T01:53:28.965 INFO:journalctl@ceph.osd.5.smithi142.stdout:Sep 21 01:53:28 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-5[45407]: 2024-09-21T01:53:28.696+0000 7f739d5c3640 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:01.428159+0000 front 2024-09-21T01:53:01.427998+0000 (oldest deadline 2024-09-21T01:53:26.728078+0000) 2024-09-21T01:53:28.965 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:53:28 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:53:28.852+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:55.996660+0000 front 2024-09-21T01:52:55.996645+0000 (oldest deadline 2024-09-21T01:53:21.296531+0000) 2024-09-21T01:53:28.965 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:53:28 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:53:28.852+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:03.597995+0000 front 2024-09-21T01:53:03.598011+0000 (oldest deadline 2024-09-21T01:53:28.297678+0000) 2024-09-21T01:53:29.053 INFO:journalctl@ceph.osd.6.smithi083.stdout:Sep 21 01:53:28 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-6[60956]: 2024-09-21T01:53:28.656+0000 7fc395e3d640 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:03.763137+0000 front 2024-09-21T01:53:03.763256+0000 (oldest deadline 2024-09-21T01:53:25.463021+0000) 2024-09-21T01:53:29.218 INFO:journalctl@ceph.osd.7.smithi119.stdout:Sep 21 01:53:28 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-7[51223]: 2024-09-21T01:53:28.989+0000 7f38e1d98640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:04.415340+0000 front 2024-09-21T01:53:04.415508+0000 (oldest deadline 2024-09-21T01:53:26.715499+0000) 2024-09-21T01:53:29.218 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:53:28 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:53:28.777+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:52.739060+0000 front 2024-09-21T01:52:52.738919+0000 (oldest deadline 2024-09-21T01:53:18.038843+0000) 2024-09-21T01:53:29.218 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:53:28 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:53:28.777+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:03.740740+0000 front 2024-09-21T01:53:03.740797+0000 (oldest deadline 2024-09-21T01:53:26.040830+0000) 2024-09-21T01:53:29.632 INFO:journalctl@ceph.osd.4.smithi119.stdout:Sep 21 01:53:29 smithi119 podman[66569]: 2024-09-21 01:53:29.336031908 +0000 UTC m=+5.657119456 container died 4d67c219db6c9be1546cd5fdca5afca506e32cb1bdd61e80808d772f3ed2576f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-4, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True) 2024-09-21T01:53:29.637 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:53:29 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:53:29.315+0000 7fc210836640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:56.783488+0000 front 2024-09-21T01:52:56.783513+0000 (oldest deadline 2024-09-21T01:53:21.483559+0000) 2024-09-21T01:53:29.637 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:53:29 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:53:29.315+0000 7fc210836640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:01.484146+0000 front 2024-09-21T01:53:01.484128+0000 (oldest deadline 2024-09-21T01:53:27.384161+0000) 2024-09-21T01:53:29.715 INFO:journalctl@ceph.osd.8.smithi142.stdout:Sep 21 01:53:29 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-8[51832]: 2024-09-21T01:53:29.298+0000 7f95b1069640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:55.543069+0000 front 2024-09-21T01:52:55.543096+0000 (oldest deadline 2024-09-21T01:53:19.042967+0000) 2024-09-21T01:53:29.946 INFO:journalctl@ceph.osd.4.smithi119.stdout:Sep 21 01:53:29 smithi119 podman[66569]: 2024-09-21 01:53:29.739680702 +0000 UTC m=+6.060768257 container cleanup 4d67c219db6c9be1546cd5fdca5afca506e32cb1bdd61e80808d772f3ed2576f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-4, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-09-21T01:53:29.946 INFO:journalctl@ceph.osd.4.smithi119.stdout:Sep 21 01:53:29 smithi119 bash[66569]: ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-4 2024-09-21T01:53:29.946 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:53:29 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:53:29.794+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:52.739060+0000 front 2024-09-21T01:52:52.738919+0000 (oldest deadline 2024-09-21T01:53:18.038843+0000) 2024-09-21T01:53:29.946 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:53:29 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:53:29.794+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:03.740740+0000 front 2024-09-21T01:53:03.740797+0000 (oldest deadline 2024-09-21T01:53:26.040830+0000) 2024-09-21T01:53:30.053 INFO:journalctl@ceph.osd.6.smithi083.stdout:Sep 21 01:53:29 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-6[60956]: 2024-09-21T01:53:29.637+0000 7fc395e3d640 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:03.763137+0000 front 2024-09-21T01:53:03.763256+0000 (oldest deadline 2024-09-21T01:53:25.463021+0000) 2024-09-21T01:53:30.214 INFO:journalctl@ceph.osd.5.smithi142.stdout:Sep 21 01:53:29 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-5[45407]: 2024-09-21T01:53:29.723+0000 7f739d5c3640 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:54.526636+0000 front 2024-09-21T01:52:54.526664+0000 (oldest deadline 2024-09-21T01:53:18.026396+0000) 2024-09-21T01:53:30.215 INFO:journalctl@ceph.osd.5.smithi142.stdout:Sep 21 01:53:29 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-5[45407]: 2024-09-21T01:53:29.723+0000 7f739d5c3640 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:01.428159+0000 front 2024-09-21T01:53:01.427998+0000 (oldest deadline 2024-09-21T01:53:26.728078+0000) 2024-09-21T01:53:30.215 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:53:29 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:53:29.836+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:55.996660+0000 front 2024-09-21T01:52:55.996645+0000 (oldest deadline 2024-09-21T01:53:21.296531+0000) 2024-09-21T01:53:30.215 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:53:29 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:53:29.836+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:03.597995+0000 front 2024-09-21T01:53:03.598011+0000 (oldest deadline 2024-09-21T01:53:28.297678+0000) 2024-09-21T01:53:30.217 INFO:journalctl@ceph.osd.4.smithi119.stdout:Sep 21 01:53:29 smithi119 podman[66585]: 2024-09-21 01:53:29.991520635 +0000 UTC m=+0.653882560 container remove 4d67c219db6c9be1546cd5fdca5afca506e32cb1bdd61e80808d772f3ed2576f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-4, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-09-21T01:53:30.217 INFO:journalctl@ceph.osd.7.smithi119.stdout:Sep 21 01:53:29 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-7[51223]: 2024-09-21T01:53:29.945+0000 7f38e1d98640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:04.415340+0000 front 2024-09-21T01:53:04.415508+0000 (oldest deadline 2024-09-21T01:53:26.715499+0000) 2024-09-21T01:53:30.553 INFO:journalctl@ceph.osd.4.smithi119.stdout:Sep 21 01:53:30 smithi119 podman[66672]: 2024-09-21 01:53:30.30072201 +0000 UTC m=+0.103418516 container create f98b78873ae81143844a2894981b73cf02dd64cf883f57913a176caa21e47cd7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-4-deactivate, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T01:53:30.553 INFO:journalctl@ceph.osd.4.smithi119.stdout:Sep 21 01:53:30 smithi119 podman[66672]: 2024-09-21 01:53:30.213484705 +0000 UTC m=+0.016181215 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T01:53:30.622 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:53:30 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:53:30.362+0000 7fc210836640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:56.783488+0000 front 2024-09-21T01:52:56.783513+0000 (oldest deadline 2024-09-21T01:53:21.483559+0000) 2024-09-21T01:53:30.622 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:53:30 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:53:30.362+0000 7fc210836640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:01.484146+0000 front 2024-09-21T01:53:01.484128+0000 (oldest deadline 2024-09-21T01:53:27.384161+0000) 2024-09-21T01:53:30.714 INFO:journalctl@ceph.osd.8.smithi142.stdout:Sep 21 01:53:30 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-8[51832]: 2024-09-21T01:53:30.275+0000 7f95b1069640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:55.543069+0000 front 2024-09-21T01:52:55.543096+0000 (oldest deadline 2024-09-21T01:53:19.042967+0000) 2024-09-21T01:53:30.803 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:53:30 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:53:30.802+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:52.739060+0000 front 2024-09-21T01:52:52.738919+0000 (oldest deadline 2024-09-21T01:53:18.038843+0000) 2024-09-21T01:53:30.804 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:53:30 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:53:30.802+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:03.740740+0000 front 2024-09-21T01:53:03.740797+0000 (oldest deadline 2024-09-21T01:53:26.040830+0000) 2024-09-21T01:53:30.804 INFO:journalctl@ceph.osd.4.smithi119.stdout:Sep 21 01:53:30 smithi119 podman[66672]: 2024-09-21 01:53:30.553584527 +0000 UTC m=+0.356281036 container init f98b78873ae81143844a2894981b73cf02dd64cf883f57913a176caa21e47cd7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-4-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-09-21T01:53:30.804 INFO:journalctl@ceph.osd.4.smithi119.stdout:Sep 21 01:53:30 smithi119 podman[66672]: 2024-09-21 01:53:30.557150252 +0000 UTC m=+0.359846753 container start f98b78873ae81143844a2894981b73cf02dd64cf883f57913a176caa21e47cd7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-4-deactivate, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-21T01:53:30.804 INFO:journalctl@ceph.osd.4.smithi119.stdout:Sep 21 01:53:30 smithi119 podman[66672]: 2024-09-21 01:53:30.653663603 +0000 UTC m=+0.456360125 container attach f98b78873ae81143844a2894981b73cf02dd64cf883f57913a176caa21e47cd7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-4-deactivate, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-09-21T01:53:30.804 INFO:journalctl@ceph.osd.4.smithi119.stdout:Sep 21 01:53:30 smithi119 podman[66672]: 2024-09-21 01:53:30.742167282 +0000 UTC m=+0.544863788 container died f98b78873ae81143844a2894981b73cf02dd64cf883f57913a176caa21e47cd7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-4-deactivate, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True) 2024-09-21T01:53:31.053 INFO:journalctl@ceph.osd.6.smithi083.stdout:Sep 21 01:53:30 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-6[60956]: 2024-09-21T01:53:30.622+0000 7fc395e3d640 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:03.763137+0000 front 2024-09-21T01:53:03.763256+0000 (oldest deadline 2024-09-21T01:53:25.463021+0000) 2024-09-21T01:53:31.214 INFO:journalctl@ceph.osd.5.smithi142.stdout:Sep 21 01:53:30 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-5[45407]: 2024-09-21T01:53:30.746+0000 7f739d5c3640 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:54.526636+0000 front 2024-09-21T01:52:54.526664+0000 (oldest deadline 2024-09-21T01:53:18.026396+0000) 2024-09-21T01:53:31.215 INFO:journalctl@ceph.osd.5.smithi142.stdout:Sep 21 01:53:30 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-5[45407]: 2024-09-21T01:53:30.746+0000 7f739d5c3640 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:01.428159+0000 front 2024-09-21T01:53:01.427998+0000 (oldest deadline 2024-09-21T01:53:26.728078+0000) 2024-09-21T01:53:31.215 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:53:30 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:53:30.813+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:55.996660+0000 front 2024-09-21T01:52:55.996645+0000 (oldest deadline 2024-09-21T01:53:21.296531+0000) 2024-09-21T01:53:31.215 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:53:30 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:53:30.813+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:03.597995+0000 front 2024-09-21T01:53:03.598011+0000 (oldest deadline 2024-09-21T01:53:28.297678+0000) 2024-09-21T01:53:31.217 INFO:journalctl@ceph.osd.7.smithi119.stdout:Sep 21 01:53:30 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-7[51223]: 2024-09-21T01:53:30.970+0000 7f38e1d98640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:04.415340+0000 front 2024-09-21T01:53:04.415508+0000 (oldest deadline 2024-09-21T01:53:26.715499+0000) 2024-09-21T01:53:31.346 DEBUG:teuthology.orchestra.run.smithi119:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f7697ecc-77b8-11ef-baf5-efdc52797490@osd.4.service' 2024-09-21T01:53:31.383 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T01:53:31.384 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-09-21T01:53:31.384 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-09-21T01:53:31.384 DEBUG:teuthology.orchestra.run.smithi142:> sudo systemctl stop ceph-f7697ecc-77b8-11ef-baf5-efdc52797490@osd.5 2024-09-21T01:53:31.692 INFO:journalctl@ceph.osd.5.smithi142.stdout:Sep 21 01:53:31 smithi142 systemd[1]: Stopping Ceph osd.5 for f7697ecc-77b8-11ef-baf5-efdc52797490... 2024-09-21T01:53:31.693 INFO:journalctl@ceph.osd.8.smithi142.stdout:Sep 21 01:53:31 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-8[51832]: 2024-09-21T01:53:31.278+0000 7f95b1069640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:55.543069+0000 front 2024-09-21T01:52:55.543096+0000 (oldest deadline 2024-09-21T01:53:19.042967+0000) 2024-09-21T01:53:31.804 INFO:journalctl@ceph.osd.6.smithi083.stdout:Sep 21 01:53:31 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-6[60956]: 2024-09-21T01:53:31.637+0000 7fc395e3d640 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:03.763137+0000 front 2024-09-21T01:53:03.763256+0000 (oldest deadline 2024-09-21T01:53:25.463021+0000) 2024-09-21T01:53:31.804 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:53:31 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:53:31.406+0000 7fc210836640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:56.783488+0000 front 2024-09-21T01:52:56.783513+0000 (oldest deadline 2024-09-21T01:53:21.483559+0000) 2024-09-21T01:53:31.804 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:53:31 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:53:31.406+0000 7fc210836640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:01.484146+0000 front 2024-09-21T01:53:01.484128+0000 (oldest deadline 2024-09-21T01:53:27.384161+0000) 2024-09-21T01:53:31.964 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:53:31 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:53:31.835+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:55.996660+0000 front 2024-09-21T01:52:55.996645+0000 (oldest deadline 2024-09-21T01:53:21.296531+0000) 2024-09-21T01:53:31.965 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:53:31 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:53:31.835+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:03.597995+0000 front 2024-09-21T01:53:03.598011+0000 (oldest deadline 2024-09-21T01:53:28.297678+0000) 2024-09-21T01:53:31.965 INFO:journalctl@ceph.osd.5.smithi142.stdout:Sep 21 01:53:31 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-5[45407]: 2024-09-21T01:53:31.692+0000 7f73a4fe0640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T01:53:31.965 INFO:journalctl@ceph.osd.5.smithi142.stdout:Sep 21 01:53:31 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-5[45407]: 2024-09-21T01:53:31.692+0000 7f73a4fe0640 -1 osd.5 98 *** Got signal Terminated *** 2024-09-21T01:53:31.965 INFO:journalctl@ceph.osd.5.smithi142.stdout:Sep 21 01:53:31 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-5[45407]: 2024-09-21T01:53:31.692+0000 7f73a4fe0640 -1 osd.5 98 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T01:53:31.965 INFO:journalctl@ceph.osd.5.smithi142.stdout:Sep 21 01:53:31 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-5[45407]: 2024-09-21T01:53:31.778+0000 7f739d5c3640 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:54.526636+0000 front 2024-09-21T01:52:54.526664+0000 (oldest deadline 2024-09-21T01:53:18.026396+0000) 2024-09-21T01:53:31.965 INFO:journalctl@ceph.osd.5.smithi142.stdout:Sep 21 01:53:31 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-5[45407]: 2024-09-21T01:53:31.778+0000 7f739d5c3640 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:01.428159+0000 front 2024-09-21T01:53:01.427998+0000 (oldest deadline 2024-09-21T01:53:26.728078+0000) 2024-09-21T01:53:32.218 INFO:journalctl@ceph.osd.7.smithi119.stdout:Sep 21 01:53:31 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-7[51223]: 2024-09-21T01:53:31.955+0000 7f38e1d98640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:04.415340+0000 front 2024-09-21T01:53:04.415508+0000 (oldest deadline 2024-09-21T01:53:26.715499+0000) 2024-09-21T01:53:32.218 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:53:31 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:53:31.803+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:52.739060+0000 front 2024-09-21T01:52:52.738919+0000 (oldest deadline 2024-09-21T01:53:18.038843+0000) 2024-09-21T01:53:32.218 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:53:31 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:53:31.803+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:03.740740+0000 front 2024-09-21T01:53:03.740797+0000 (oldest deadline 2024-09-21T01:53:26.040830+0000) 2024-09-21T01:53:32.714 INFO:journalctl@ceph.osd.8.smithi142.stdout:Sep 21 01:53:32 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-8[51832]: 2024-09-21T01:53:32.244+0000 7f95b1069640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:55.543069+0000 front 2024-09-21T01:52:55.543096+0000 (oldest deadline 2024-09-21T01:53:19.042967+0000) 2024-09-21T01:53:32.804 INFO:journalctl@ceph.osd.6.smithi083.stdout:Sep 21 01:53:32 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-6[60956]: 2024-09-21T01:53:32.646+0000 7fc395e3d640 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:03.763137+0000 front 2024-09-21T01:53:03.763256+0000 (oldest deadline 2024-09-21T01:53:25.463021+0000) 2024-09-21T01:53:32.804 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:53:32 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:53:32.418+0000 7fc210836640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:56.783488+0000 front 2024-09-21T01:52:56.783513+0000 (oldest deadline 2024-09-21T01:53:21.483559+0000) 2024-09-21T01:53:32.804 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:53:32 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:53:32.418+0000 7fc210836640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:01.484146+0000 front 2024-09-21T01:53:01.484128+0000 (oldest deadline 2024-09-21T01:53:27.384161+0000) 2024-09-21T01:53:33.215 INFO:journalctl@ceph.osd.5.smithi142.stdout:Sep 21 01:53:32 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-5[45407]: 2024-09-21T01:53:32.794+0000 7f739d5c3640 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:54.526636+0000 front 2024-09-21T01:52:54.526664+0000 (oldest deadline 2024-09-21T01:53:18.026396+0000) 2024-09-21T01:53:33.215 INFO:journalctl@ceph.osd.5.smithi142.stdout:Sep 21 01:53:32 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-5[45407]: 2024-09-21T01:53:32.795+0000 7f739d5c3640 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:01.428159+0000 front 2024-09-21T01:53:01.427998+0000 (oldest deadline 2024-09-21T01:53:26.728078+0000) 2024-09-21T01:53:33.215 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:53:32 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:53:32.883+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:55.996660+0000 front 2024-09-21T01:52:55.996645+0000 (oldest deadline 2024-09-21T01:53:21.296531+0000) 2024-09-21T01:53:33.215 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:53:32 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:53:32.883+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:03.597995+0000 front 2024-09-21T01:53:03.598011+0000 (oldest deadline 2024-09-21T01:53:28.297678+0000) 2024-09-21T01:53:33.217 INFO:journalctl@ceph.osd.7.smithi119.stdout:Sep 21 01:53:32 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-7[51223]: 2024-09-21T01:53:32.911+0000 7f38e1d98640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:04.415340+0000 front 2024-09-21T01:53:04.415508+0000 (oldest deadline 2024-09-21T01:53:26.715499+0000) 2024-09-21T01:53:33.218 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:53:32 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:53:32.844+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:52.739060+0000 front 2024-09-21T01:52:52.738919+0000 (oldest deadline 2024-09-21T01:53:18.038843+0000) 2024-09-21T01:53:33.218 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:53:32 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:53:32.844+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:03.740740+0000 front 2024-09-21T01:53:03.740797+0000 (oldest deadline 2024-09-21T01:53:26.040830+0000) 2024-09-21T01:53:33.714 INFO:journalctl@ceph.osd.8.smithi142.stdout:Sep 21 01:53:33 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-8[51832]: 2024-09-21T01:53:33.260+0000 7f95b1069640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:55.543069+0000 front 2024-09-21T01:52:55.543096+0000 (oldest deadline 2024-09-21T01:53:19.042967+0000) 2024-09-21T01:53:33.804 INFO:journalctl@ceph.osd.6.smithi083.stdout:Sep 21 01:53:33 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-6[60956]: 2024-09-21T01:53:33.656+0000 7fc395e3d640 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:03.763137+0000 front 2024-09-21T01:53:03.763256+0000 (oldest deadline 2024-09-21T01:53:25.463021+0000) 2024-09-21T01:53:33.804 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:53:33 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:53:33.434+0000 7fc210836640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:56.783488+0000 front 2024-09-21T01:52:56.783513+0000 (oldest deadline 2024-09-21T01:53:21.483559+0000) 2024-09-21T01:53:33.804 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:53:33 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:53:33.434+0000 7fc210836640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:01.484146+0000 front 2024-09-21T01:53:01.484128+0000 (oldest deadline 2024-09-21T01:53:27.384161+0000) 2024-09-21T01:53:34.214 INFO:journalctl@ceph.osd.5.smithi142.stdout:Sep 21 01:53:33 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-5[45407]: 2024-09-21T01:53:33.805+0000 7f739d5c3640 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:54.526636+0000 front 2024-09-21T01:52:54.526664+0000 (oldest deadline 2024-09-21T01:53:18.026396+0000) 2024-09-21T01:53:34.215 INFO:journalctl@ceph.osd.5.smithi142.stdout:Sep 21 01:53:33 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-5[45407]: 2024-09-21T01:53:33.805+0000 7f739d5c3640 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:01.428159+0000 front 2024-09-21T01:53:01.427998+0000 (oldest deadline 2024-09-21T01:53:26.728078+0000) 2024-09-21T01:53:34.215 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:53:33 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:53:33.911+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:55.996660+0000 front 2024-09-21T01:52:55.996645+0000 (oldest deadline 2024-09-21T01:53:21.296531+0000) 2024-09-21T01:53:34.215 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:53:33 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:53:33.911+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:03.597995+0000 front 2024-09-21T01:53:03.598011+0000 (oldest deadline 2024-09-21T01:53:28.297678+0000) 2024-09-21T01:53:34.217 INFO:journalctl@ceph.osd.7.smithi119.stdout:Sep 21 01:53:33 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-7[51223]: 2024-09-21T01:53:33.877+0000 7f38e1d98640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:04.415340+0000 front 2024-09-21T01:53:04.415508+0000 (oldest deadline 2024-09-21T01:53:26.715499+0000) 2024-09-21T01:53:34.217 INFO:journalctl@ceph.osd.7.smithi119.stdout:Sep 21 01:53:33 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-7[51223]: 2024-09-21T01:53:33.877+0000 7f38e1d98640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:12.417607+0000 front 2024-09-21T01:53:12.417588+0000 (oldest deadline 2024-09-21T01:53:33.517676+0000) 2024-09-21T01:53:34.218 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:53:33 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:53:33.866+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:52.739060+0000 front 2024-09-21T01:52:52.738919+0000 (oldest deadline 2024-09-21T01:53:18.038843+0000) 2024-09-21T01:53:34.218 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:53:33 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:53:33.866+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:03.740740+0000 front 2024-09-21T01:53:03.740797+0000 (oldest deadline 2024-09-21T01:53:26.040830+0000) 2024-09-21T01:53:34.714 INFO:journalctl@ceph.osd.8.smithi142.stdout:Sep 21 01:53:34 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-8[51832]: 2024-09-21T01:53:34.271+0000 7f95b1069640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:55.543069+0000 front 2024-09-21T01:52:55.543096+0000 (oldest deadline 2024-09-21T01:53:19.042967+0000) 2024-09-21T01:53:34.714 INFO:journalctl@ceph.osd.8.smithi142.stdout:Sep 21 01:53:34 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-8[51832]: 2024-09-21T01:53:34.271+0000 7f95b1069640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:09.545158+0000 front 2024-09-21T01:53:09.545113+0000 (oldest deadline 2024-09-21T01:53:33.645207+0000) 2024-09-21T01:53:34.803 INFO:journalctl@ceph.osd.6.smithi083.stdout:Sep 21 01:53:34 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-6[60956]: 2024-09-21T01:53:34.629+0000 7fc395e3d640 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:03.763137+0000 front 2024-09-21T01:53:03.763256+0000 (oldest deadline 2024-09-21T01:53:25.463021+0000) 2024-09-21T01:53:34.804 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:53:34 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:53:34.407+0000 7fc210836640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:56.783488+0000 front 2024-09-21T01:52:56.783513+0000 (oldest deadline 2024-09-21T01:53:21.483559+0000) 2024-09-21T01:53:34.804 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:53:34 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:53:34.407+0000 7fc210836640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:01.484146+0000 front 2024-09-21T01:53:01.484128+0000 (oldest deadline 2024-09-21T01:53:27.384161+0000) 2024-09-21T01:53:35.215 INFO:journalctl@ceph.osd.5.smithi142.stdout:Sep 21 01:53:34 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-5[45407]: 2024-09-21T01:53:34.845+0000 7f739d5c3640 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:54.526636+0000 front 2024-09-21T01:52:54.526664+0000 (oldest deadline 2024-09-21T01:53:18.026396+0000) 2024-09-21T01:53:35.216 INFO:journalctl@ceph.osd.5.smithi142.stdout:Sep 21 01:53:34 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-5[45407]: 2024-09-21T01:53:34.845+0000 7f739d5c3640 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:01.428159+0000 front 2024-09-21T01:53:01.427998+0000 (oldest deadline 2024-09-21T01:53:26.728078+0000) 2024-09-21T01:53:35.216 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:53:34 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:53:34.877+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:55.996660+0000 front 2024-09-21T01:52:55.996645+0000 (oldest deadline 2024-09-21T01:53:21.296531+0000) 2024-09-21T01:53:35.216 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:53:34 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:53:34.877+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:03.597995+0000 front 2024-09-21T01:53:03.598011+0000 (oldest deadline 2024-09-21T01:53:28.297678+0000) 2024-09-21T01:53:35.216 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:53:34 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:53:34.877+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:09.398667+0000 front 2024-09-21T01:53:09.398643+0000 (oldest deadline 2024-09-21T01:53:34.698854+0000) 2024-09-21T01:53:35.217 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:53:34 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:53:34.843+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:52.739060+0000 front 2024-09-21T01:52:52.738919+0000 (oldest deadline 2024-09-21T01:53:18.038843+0000) 2024-09-21T01:53:35.217 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:53:34 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:53:34.843+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:03.740740+0000 front 2024-09-21T01:53:03.740797+0000 (oldest deadline 2024-09-21T01:53:26.040830+0000) 2024-09-21T01:53:35.218 INFO:journalctl@ceph.osd.7.smithi119.stdout:Sep 21 01:53:34 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-7[51223]: 2024-09-21T01:53:34.903+0000 7f38e1d98640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:04.415340+0000 front 2024-09-21T01:53:04.415508+0000 (oldest deadline 2024-09-21T01:53:26.715499+0000) 2024-09-21T01:53:35.218 INFO:journalctl@ceph.osd.7.smithi119.stdout:Sep 21 01:53:34 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-7[51223]: 2024-09-21T01:53:34.903+0000 7f38e1d98640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:12.417607+0000 front 2024-09-21T01:53:12.417588+0000 (oldest deadline 2024-09-21T01:53:33.517676+0000) 2024-09-21T01:53:35.714 INFO:journalctl@ceph.osd.8.smithi142.stdout:Sep 21 01:53:35 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-8[51832]: 2024-09-21T01:53:35.299+0000 7f95b1069640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:55.543069+0000 front 2024-09-21T01:52:55.543096+0000 (oldest deadline 2024-09-21T01:53:19.042967+0000) 2024-09-21T01:53:35.715 INFO:journalctl@ceph.osd.8.smithi142.stdout:Sep 21 01:53:35 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-8[51832]: 2024-09-21T01:53:35.299+0000 7f95b1069640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:09.545158+0000 front 2024-09-21T01:53:09.545113+0000 (oldest deadline 2024-09-21T01:53:33.645207+0000) 2024-09-21T01:53:35.804 INFO:journalctl@ceph.osd.6.smithi083.stdout:Sep 21 01:53:35 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-6[60956]: 2024-09-21T01:53:35.618+0000 7fc395e3d640 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:03.763137+0000 front 2024-09-21T01:53:03.763256+0000 (oldest deadline 2024-09-21T01:53:25.463021+0000) 2024-09-21T01:53:35.804 INFO:journalctl@ceph.osd.6.smithi083.stdout:Sep 21 01:53:35 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-6[60956]: 2024-09-21T01:53:35.618+0000 7fc395e3d640 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:11.165400+0000 front 2024-09-21T01:53:11.165485+0000 (oldest deadline 2024-09-21T01:53:35.265322+0000) 2024-09-21T01:53:35.805 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:53:35 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:53:35.401+0000 7fc210836640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:56.783488+0000 front 2024-09-21T01:52:56.783513+0000 (oldest deadline 2024-09-21T01:53:21.483559+0000) 2024-09-21T01:53:35.805 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:53:35 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:53:35.401+0000 7fc210836640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:01.484146+0000 front 2024-09-21T01:53:01.484128+0000 (oldest deadline 2024-09-21T01:53:27.384161+0000) 2024-09-21T01:53:36.215 INFO:journalctl@ceph.osd.5.smithi142.stdout:Sep 21 01:53:35 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-5[45407]: 2024-09-21T01:53:35.847+0000 7f739d5c3640 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:54.526636+0000 front 2024-09-21T01:52:54.526664+0000 (oldest deadline 2024-09-21T01:53:18.026396+0000) 2024-09-21T01:53:36.215 INFO:journalctl@ceph.osd.5.smithi142.stdout:Sep 21 01:53:35 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-5[45407]: 2024-09-21T01:53:35.847+0000 7f739d5c3640 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:01.428159+0000 front 2024-09-21T01:53:01.427998+0000 (oldest deadline 2024-09-21T01:53:26.728078+0000) 2024-09-21T01:53:36.215 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:53:35 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:53:35.909+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:55.996660+0000 front 2024-09-21T01:52:55.996645+0000 (oldest deadline 2024-09-21T01:53:21.296531+0000) 2024-09-21T01:53:36.215 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:53:35 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:53:35.909+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:03.597995+0000 front 2024-09-21T01:53:03.598011+0000 (oldest deadline 2024-09-21T01:53:28.297678+0000) 2024-09-21T01:53:36.215 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:53:35 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:53:35.909+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:09.398667+0000 front 2024-09-21T01:53:09.398643+0000 (oldest deadline 2024-09-21T01:53:34.698854+0000) 2024-09-21T01:53:36.218 INFO:journalctl@ceph.osd.7.smithi119.stdout:Sep 21 01:53:35 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-7[51223]: 2024-09-21T01:53:35.921+0000 7f38e1d98640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:04.415340+0000 front 2024-09-21T01:53:04.415508+0000 (oldest deadline 2024-09-21T01:53:26.715499+0000) 2024-09-21T01:53:36.218 INFO:journalctl@ceph.osd.7.smithi119.stdout:Sep 21 01:53:35 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-7[51223]: 2024-09-21T01:53:35.921+0000 7f38e1d98640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:12.417607+0000 front 2024-09-21T01:53:12.417588+0000 (oldest deadline 2024-09-21T01:53:33.517676+0000) 2024-09-21T01:53:36.218 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:53:35 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:53:35.879+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:52.739060+0000 front 2024-09-21T01:52:52.738919+0000 (oldest deadline 2024-09-21T01:53:18.038843+0000) 2024-09-21T01:53:36.218 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:53:35 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:53:35.879+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:03.740740+0000 front 2024-09-21T01:53:03.740797+0000 (oldest deadline 2024-09-21T01:53:26.040830+0000) 2024-09-21T01:53:36.218 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:53:35 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:53:35.879+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:10.642164+0000 front 2024-09-21T01:53:10.642202+0000 (oldest deadline 2024-09-21T01:53:35.342361+0000) 2024-09-21T01:53:36.714 INFO:journalctl@ceph.osd.8.smithi142.stdout:Sep 21 01:53:36 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-8[51832]: 2024-09-21T01:53:36.323+0000 7f95b1069640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:55.543069+0000 front 2024-09-21T01:52:55.543096+0000 (oldest deadline 2024-09-21T01:53:19.042967+0000) 2024-09-21T01:53:36.715 INFO:journalctl@ceph.osd.8.smithi142.stdout:Sep 21 01:53:36 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-8[51832]: 2024-09-21T01:53:36.324+0000 7f95b1069640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:09.545158+0000 front 2024-09-21T01:53:09.545113+0000 (oldest deadline 2024-09-21T01:53:33.645207+0000) 2024-09-21T01:53:36.803 INFO:journalctl@ceph.osd.6.smithi083.stdout:Sep 21 01:53:36 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-6[60956]: 2024-09-21T01:53:36.632+0000 7fc395e3d640 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:03.763137+0000 front 2024-09-21T01:53:03.763256+0000 (oldest deadline 2024-09-21T01:53:25.463021+0000) 2024-09-21T01:53:36.803 INFO:journalctl@ceph.osd.6.smithi083.stdout:Sep 21 01:53:36 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-6[60956]: 2024-09-21T01:53:36.632+0000 7fc395e3d640 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:11.165400+0000 front 2024-09-21T01:53:11.165485+0000 (oldest deadline 2024-09-21T01:53:35.265322+0000) 2024-09-21T01:53:36.804 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:53:36 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:53:36.386+0000 7fc210836640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:56.783488+0000 front 2024-09-21T01:52:56.783513+0000 (oldest deadline 2024-09-21T01:53:21.483559+0000) 2024-09-21T01:53:36.804 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:53:36 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:53:36.386+0000 7fc210836640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:01.484146+0000 front 2024-09-21T01:53:01.484128+0000 (oldest deadline 2024-09-21T01:53:27.384161+0000) 2024-09-21T01:53:36.804 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:53:36 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:53:36.386+0000 7fc210836640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:10.786106+0000 front 2024-09-21T01:53:10.786293+0000 (oldest deadline 2024-09-21T01:53:36.086126+0000) 2024-09-21T01:53:37.208 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:53:36 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:53:36.930+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:55.996660+0000 front 2024-09-21T01:52:55.996645+0000 (oldest deadline 2024-09-21T01:53:21.296531+0000) 2024-09-21T01:53:37.208 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:53:36 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:53:36.930+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:03.597995+0000 front 2024-09-21T01:53:03.598011+0000 (oldest deadline 2024-09-21T01:53:28.297678+0000) 2024-09-21T01:53:37.208 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:53:36 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:53:36.930+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:09.398667+0000 front 2024-09-21T01:53:09.398643+0000 (oldest deadline 2024-09-21T01:53:34.698854+0000) 2024-09-21T01:53:37.218 INFO:journalctl@ceph.osd.7.smithi119.stdout:Sep 21 01:53:36 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-7[51223]: 2024-09-21T01:53:36.920+0000 7f38e1d98640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:04.415340+0000 front 2024-09-21T01:53:04.415508+0000 (oldest deadline 2024-09-21T01:53:26.715499+0000) 2024-09-21T01:53:37.218 INFO:journalctl@ceph.osd.7.smithi119.stdout:Sep 21 01:53:36 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-7[51223]: 2024-09-21T01:53:36.920+0000 7f38e1d98640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:12.417607+0000 front 2024-09-21T01:53:12.417588+0000 (oldest deadline 2024-09-21T01:53:33.517676+0000) 2024-09-21T01:53:37.218 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:53:36 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:53:36.889+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:52.739060+0000 front 2024-09-21T01:52:52.738919+0000 (oldest deadline 2024-09-21T01:53:18.038843+0000) 2024-09-21T01:53:37.218 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:53:36 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:53:36.889+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:03.740740+0000 front 2024-09-21T01:53:03.740797+0000 (oldest deadline 2024-09-21T01:53:26.040830+0000) 2024-09-21T01:53:37.218 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:53:36 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:53:36.889+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:10.642164+0000 front 2024-09-21T01:53:10.642202+0000 (oldest deadline 2024-09-21T01:53:35.342361+0000) 2024-09-21T01:53:37.460 INFO:journalctl@ceph.osd.5.smithi142.stdout:Sep 21 01:53:37 smithi142 podman[67536]: 2024-09-21 01:53:37.208259354 +0000 UTC m=+5.632659376 container died 94f494fdcca8c3fbeb285f81a9fdb3574b05204e7cb507ccdbd8228c62a87759 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-5, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-09-21T01:53:37.461 INFO:journalctl@ceph.osd.8.smithi142.stdout:Sep 21 01:53:37 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-8[51832]: 2024-09-21T01:53:37.298+0000 7f95b1069640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:55.543069+0000 front 2024-09-21T01:52:55.543096+0000 (oldest deadline 2024-09-21T01:53:19.042967+0000) 2024-09-21T01:53:37.461 INFO:journalctl@ceph.osd.8.smithi142.stdout:Sep 21 01:53:37 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-8[51832]: 2024-09-21T01:53:37.298+0000 7f95b1069640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:09.545158+0000 front 2024-09-21T01:53:09.545113+0000 (oldest deadline 2024-09-21T01:53:33.645207+0000) 2024-09-21T01:53:37.676 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:53:37 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:53:37.395+0000 7fc210836640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:56.783488+0000 front 2024-09-21T01:52:56.783513+0000 (oldest deadline 2024-09-21T01:53:21.483559+0000) 2024-09-21T01:53:37.677 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:53:37 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:53:37.395+0000 7fc210836640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:01.484146+0000 front 2024-09-21T01:53:01.484128+0000 (oldest deadline 2024-09-21T01:53:27.384161+0000) 2024-09-21T01:53:37.677 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:53:37 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:53:37.395+0000 7fc210836640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:10.786106+0000 front 2024-09-21T01:53:10.786293+0000 (oldest deadline 2024-09-21T01:53:36.086126+0000) 2024-09-21T01:53:37.714 INFO:journalctl@ceph.osd.5.smithi142.stdout:Sep 21 01:53:37 smithi142 podman[67536]: 2024-09-21 01:53:37.550642128 +0000 UTC m=+5.975042136 container cleanup 94f494fdcca8c3fbeb285f81a9fdb3574b05204e7cb507ccdbd8228c62a87759 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-5, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-09-21T01:53:37.714 INFO:journalctl@ceph.osd.5.smithi142.stdout:Sep 21 01:53:37 smithi142 bash[67536]: ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-5 2024-09-21T01:53:38.054 INFO:journalctl@ceph.osd.6.smithi083.stdout:Sep 21 01:53:37 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-6[60956]: 2024-09-21T01:53:37.676+0000 7fc395e3d640 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:03.763137+0000 front 2024-09-21T01:53:03.763256+0000 (oldest deadline 2024-09-21T01:53:25.463021+0000) 2024-09-21T01:53:38.054 INFO:journalctl@ceph.osd.6.smithi083.stdout:Sep 21 01:53:37 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-6[60956]: 2024-09-21T01:53:37.676+0000 7fc395e3d640 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:11.165400+0000 front 2024-09-21T01:53:11.165485+0000 (oldest deadline 2024-09-21T01:53:35.265322+0000) 2024-09-21T01:53:38.214 INFO:journalctl@ceph.osd.5.smithi142.stdout:Sep 21 01:53:37 smithi142 podman[67551]: 2024-09-21 01:53:37.877299446 +0000 UTC m=+0.671290095 container remove 94f494fdcca8c3fbeb285f81a9fdb3574b05204e7cb507ccdbd8228c62a87759 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-5, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T01:53:38.215 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:53:37 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:53:37.959+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:55.996660+0000 front 2024-09-21T01:52:55.996645+0000 (oldest deadline 2024-09-21T01:53:21.296531+0000) 2024-09-21T01:53:38.215 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:53:37 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:53:37.959+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:03.597995+0000 front 2024-09-21T01:53:03.598011+0000 (oldest deadline 2024-09-21T01:53:28.297678+0000) 2024-09-21T01:53:38.215 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:53:37 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:53:37.959+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:09.398667+0000 front 2024-09-21T01:53:09.398643+0000 (oldest deadline 2024-09-21T01:53:34.698854+0000) 2024-09-21T01:53:38.217 INFO:journalctl@ceph.osd.7.smithi119.stdout:Sep 21 01:53:37 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-7[51223]: 2024-09-21T01:53:37.908+0000 7f38e1d98640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:04.415340+0000 front 2024-09-21T01:53:04.415508+0000 (oldest deadline 2024-09-21T01:53:26.715499+0000) 2024-09-21T01:53:38.217 INFO:journalctl@ceph.osd.7.smithi119.stdout:Sep 21 01:53:37 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-7[51223]: 2024-09-21T01:53:37.908+0000 7f38e1d98640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:12.417607+0000 front 2024-09-21T01:53:12.417588+0000 (oldest deadline 2024-09-21T01:53:33.517676+0000) 2024-09-21T01:53:38.218 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:53:37 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:53:37.897+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:52.739060+0000 front 2024-09-21T01:52:52.738919+0000 (oldest deadline 2024-09-21T01:53:18.038843+0000) 2024-09-21T01:53:38.218 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:53:37 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:53:37.897+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:03.740740+0000 front 2024-09-21T01:53:03.740797+0000 (oldest deadline 2024-09-21T01:53:26.040830+0000) 2024-09-21T01:53:38.218 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:53:37 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:53:37.897+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:10.642164+0000 front 2024-09-21T01:53:10.642202+0000 (oldest deadline 2024-09-21T01:53:35.342361+0000) 2024-09-21T01:53:38.572 INFO:journalctl@ceph.osd.8.smithi142.stdout:Sep 21 01:53:38 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-8[51832]: 2024-09-21T01:53:38.262+0000 7f95b1069640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:55.543069+0000 front 2024-09-21T01:52:55.543096+0000 (oldest deadline 2024-09-21T01:53:19.042967+0000) 2024-09-21T01:53:38.572 INFO:journalctl@ceph.osd.8.smithi142.stdout:Sep 21 01:53:38 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-8[51832]: 2024-09-21T01:53:38.262+0000 7f95b1069640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:09.545158+0000 front 2024-09-21T01:53:09.545113+0000 (oldest deadline 2024-09-21T01:53:33.645207+0000) 2024-09-21T01:53:38.572 INFO:journalctl@ceph.osd.5.smithi142.stdout:Sep 21 01:53:38 smithi142 podman[67648]: 2024-09-21 01:53:38.136217329 +0000 UTC m=+0.018919598 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T01:53:38.573 INFO:journalctl@ceph.osd.5.smithi142.stdout:Sep 21 01:53:38 smithi142 podman[67648]: 2024-09-21 01:53:38.244828966 +0000 UTC m=+0.127531215 container create 745a3da6b60fa5c7fe97e261b7fecad91814e552b28d910a2ac9ec8adf057d48 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-5-deactivate, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T01:53:38.573 INFO:journalctl@ceph.osd.5.smithi142.stdout:Sep 21 01:53:38 smithi142 podman[67648]: 2024-09-21 01:53:38.472458896 +0000 UTC m=+0.355161162 container init 745a3da6b60fa5c7fe97e261b7fecad91814e552b28d910a2ac9ec8adf057d48 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-5-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, ceph=True, org.label-schema.vendor=CentOS) 2024-09-21T01:53:38.573 INFO:journalctl@ceph.osd.5.smithi142.stdout:Sep 21 01:53:38 smithi142 podman[67648]: 2024-09-21 01:53:38.475829626 +0000 UTC m=+0.358531880 container start 745a3da6b60fa5c7fe97e261b7fecad91814e552b28d910a2ac9ec8adf057d48 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-5-deactivate, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T01:53:38.573 INFO:journalctl@ceph.osd.5.smithi142.stdout:Sep 21 01:53:38 smithi142 podman[67648]: 2024-09-21 01:53:38.572518578 +0000 UTC m=+0.455220826 container attach 745a3da6b60fa5c7fe97e261b7fecad91814e552b28d910a2ac9ec8adf057d48 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-5-deactivate, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-21T01:53:38.686 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:53:38 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:53:38.397+0000 7fc210836640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:56.783488+0000 front 2024-09-21T01:52:56.783513+0000 (oldest deadline 2024-09-21T01:53:21.483559+0000) 2024-09-21T01:53:38.686 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:53:38 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:53:38.397+0000 7fc210836640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:01.484146+0000 front 2024-09-21T01:53:01.484128+0000 (oldest deadline 2024-09-21T01:53:27.384161+0000) 2024-09-21T01:53:38.686 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:53:38 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:53:38.397+0000 7fc210836640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:10.786106+0000 front 2024-09-21T01:53:10.786293+0000 (oldest deadline 2024-09-21T01:53:36.086126+0000) 2024-09-21T01:53:38.965 INFO:journalctl@ceph.osd.5.smithi142.stdout:Sep 21 01:53:38 smithi142 podman[67648]: 2024-09-21 01:53:38.665461713 +0000 UTC m=+0.548163976 container died 745a3da6b60fa5c7fe97e261b7fecad91814e552b28d910a2ac9ec8adf057d48 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-5-deactivate, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T01:53:39.054 INFO:journalctl@ceph.osd.6.smithi083.stdout:Sep 21 01:53:38 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-6[60956]: 2024-09-21T01:53:38.686+0000 7fc395e3d640 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:03.763137+0000 front 2024-09-21T01:53:03.763256+0000 (oldest deadline 2024-09-21T01:53:25.463021+0000) 2024-09-21T01:53:39.054 INFO:journalctl@ceph.osd.6.smithi083.stdout:Sep 21 01:53:38 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-6[60956]: 2024-09-21T01:53:38.686+0000 7fc395e3d640 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:11.165400+0000 front 2024-09-21T01:53:11.165485+0000 (oldest deadline 2024-09-21T01:53:35.265322+0000) 2024-09-21T01:53:39.217 INFO:journalctl@ceph.osd.7.smithi119.stdout:Sep 21 01:53:38 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-7[51223]: 2024-09-21T01:53:38.906+0000 7f38e1d98640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:04.415340+0000 front 2024-09-21T01:53:04.415508+0000 (oldest deadline 2024-09-21T01:53:26.715499+0000) 2024-09-21T01:53:39.218 INFO:journalctl@ceph.osd.7.smithi119.stdout:Sep 21 01:53:38 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-7[51223]: 2024-09-21T01:53:38.906+0000 7f38e1d98640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:12.417607+0000 front 2024-09-21T01:53:12.417588+0000 (oldest deadline 2024-09-21T01:53:33.517676+0000) 2024-09-21T01:53:39.218 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:53:38 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:53:38.944+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:52.739060+0000 front 2024-09-21T01:52:52.738919+0000 (oldest deadline 2024-09-21T01:53:18.038843+0000) 2024-09-21T01:53:39.218 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:53:38 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:53:38.944+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:03.740740+0000 front 2024-09-21T01:53:03.740797+0000 (oldest deadline 2024-09-21T01:53:26.040830+0000) 2024-09-21T01:53:39.218 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:53:38 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:53:38.944+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:10.642164+0000 front 2024-09-21T01:53:10.642202+0000 (oldest deadline 2024-09-21T01:53:35.342361+0000) 2024-09-21T01:53:39.267 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:53:38 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:53:38.965+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:55.996660+0000 front 2024-09-21T01:52:55.996645+0000 (oldest deadline 2024-09-21T01:53:21.296531+0000) 2024-09-21T01:53:39.267 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:53:38 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:53:38.965+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:03.597995+0000 front 2024-09-21T01:53:03.598011+0000 (oldest deadline 2024-09-21T01:53:28.297678+0000) 2024-09-21T01:53:39.267 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:53:38 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:53:38.965+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:09.398667+0000 front 2024-09-21T01:53:09.398643+0000 (oldest deadline 2024-09-21T01:53:34.698854+0000) 2024-09-21T01:53:39.299 DEBUG:teuthology.orchestra.run.smithi142:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f7697ecc-77b8-11ef-baf5-efdc52797490@osd.5.service' 2024-09-21T01:53:39.337 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T01:53:39.337 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-09-21T01:53:39.337 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-09-21T01:53:39.338 DEBUG:teuthology.orchestra.run.smithi083:> sudo systemctl stop ceph-f7697ecc-77b8-11ef-baf5-efdc52797490@osd.6 2024-09-21T01:53:39.658 INFO:journalctl@ceph.osd.6.smithi083.stdout:Sep 21 01:53:39 smithi083 systemd[1]: Stopping Ceph osd.6 for f7697ecc-77b8-11ef-baf5-efdc52797490... 2024-09-21T01:53:39.658 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:53:39 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:53:39.423+0000 7fc210836640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:56.783488+0000 front 2024-09-21T01:52:56.783513+0000 (oldest deadline 2024-09-21T01:53:21.483559+0000) 2024-09-21T01:53:39.658 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:53:39 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:53:39.423+0000 7fc210836640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:01.484146+0000 front 2024-09-21T01:53:01.484128+0000 (oldest deadline 2024-09-21T01:53:27.384161+0000) 2024-09-21T01:53:39.658 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:53:39 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:53:39.423+0000 7fc210836640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:10.786106+0000 front 2024-09-21T01:53:10.786293+0000 (oldest deadline 2024-09-21T01:53:36.086126+0000) 2024-09-21T01:53:39.714 INFO:journalctl@ceph.osd.8.smithi142.stdout:Sep 21 01:53:39 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-8[51832]: 2024-09-21T01:53:39.267+0000 7f95b1069640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:55.543069+0000 front 2024-09-21T01:52:55.543096+0000 (oldest deadline 2024-09-21T01:53:19.042967+0000) 2024-09-21T01:53:39.714 INFO:journalctl@ceph.osd.8.smithi142.stdout:Sep 21 01:53:39 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-8[51832]: 2024-09-21T01:53:39.267+0000 7f95b1069640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:09.545158+0000 front 2024-09-21T01:53:09.545113+0000 (oldest deadline 2024-09-21T01:53:33.645207+0000) 2024-09-21T01:53:40.053 INFO:journalctl@ceph.osd.6.smithi083.stdout:Sep 21 01:53:39 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-6[60956]: 2024-09-21T01:53:39.657+0000 7fc399852640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T01:53:40.054 INFO:journalctl@ceph.osd.6.smithi083.stdout:Sep 21 01:53:39 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-6[60956]: 2024-09-21T01:53:39.657+0000 7fc399852640 -1 osd.6 98 *** Got signal Terminated *** 2024-09-21T01:53:40.054 INFO:journalctl@ceph.osd.6.smithi083.stdout:Sep 21 01:53:39 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-6[60956]: 2024-09-21T01:53:39.657+0000 7fc399852640 -1 osd.6 98 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T01:53:40.054 INFO:journalctl@ceph.osd.6.smithi083.stdout:Sep 21 01:53:39 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-6[60956]: 2024-09-21T01:53:39.727+0000 7fc395e3d640 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:03.763137+0000 front 2024-09-21T01:53:03.763256+0000 (oldest deadline 2024-09-21T01:53:25.463021+0000) 2024-09-21T01:53:40.054 INFO:journalctl@ceph.osd.6.smithi083.stdout:Sep 21 01:53:39 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-6[60956]: 2024-09-21T01:53:39.727+0000 7fc395e3d640 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:11.165400+0000 front 2024-09-21T01:53:11.165485+0000 (oldest deadline 2024-09-21T01:53:35.265322+0000) 2024-09-21T01:53:40.214 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:53:39 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:53:39.934+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:55.996660+0000 front 2024-09-21T01:52:55.996645+0000 (oldest deadline 2024-09-21T01:53:21.296531+0000) 2024-09-21T01:53:40.215 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:53:39 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:53:39.934+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:03.597995+0000 front 2024-09-21T01:53:03.598011+0000 (oldest deadline 2024-09-21T01:53:28.297678+0000) 2024-09-21T01:53:40.215 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:53:39 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:53:39.934+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:09.398667+0000 front 2024-09-21T01:53:09.398643+0000 (oldest deadline 2024-09-21T01:53:34.698854+0000) 2024-09-21T01:53:40.217 INFO:journalctl@ceph.osd.7.smithi119.stdout:Sep 21 01:53:39 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-7[51223]: 2024-09-21T01:53:39.914+0000 7f38e1d98640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:04.415340+0000 front 2024-09-21T01:53:04.415508+0000 (oldest deadline 2024-09-21T01:53:26.715499+0000) 2024-09-21T01:53:40.217 INFO:journalctl@ceph.osd.7.smithi119.stdout:Sep 21 01:53:39 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-7[51223]: 2024-09-21T01:53:39.914+0000 7f38e1d98640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:12.417607+0000 front 2024-09-21T01:53:12.417588+0000 (oldest deadline 2024-09-21T01:53:33.517676+0000) 2024-09-21T01:53:40.218 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:53:39 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:53:39.900+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:52.739060+0000 front 2024-09-21T01:52:52.738919+0000 (oldest deadline 2024-09-21T01:53:18.038843+0000) 2024-09-21T01:53:40.218 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:53:39 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:53:39.900+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:03.740740+0000 front 2024-09-21T01:53:03.740797+0000 (oldest deadline 2024-09-21T01:53:26.040830+0000) 2024-09-21T01:53:40.218 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:53:39 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:53:39.900+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:10.642164+0000 front 2024-09-21T01:53:10.642202+0000 (oldest deadline 2024-09-21T01:53:35.342361+0000) 2024-09-21T01:53:40.714 INFO:journalctl@ceph.osd.8.smithi142.stdout:Sep 21 01:53:40 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-8[51832]: 2024-09-21T01:53:40.302+0000 7f95b1069640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:55.543069+0000 front 2024-09-21T01:52:55.543096+0000 (oldest deadline 2024-09-21T01:53:19.042967+0000) 2024-09-21T01:53:40.715 INFO:journalctl@ceph.osd.8.smithi142.stdout:Sep 21 01:53:40 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-8[51832]: 2024-09-21T01:53:40.302+0000 7f95b1069640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:09.545158+0000 front 2024-09-21T01:53:09.545113+0000 (oldest deadline 2024-09-21T01:53:33.645207+0000) 2024-09-21T01:53:40.772 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:53:40 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:53:40.473+0000 7fc210836640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:56.783488+0000 front 2024-09-21T01:52:56.783513+0000 (oldest deadline 2024-09-21T01:53:21.483559+0000) 2024-09-21T01:53:40.772 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:53:40 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:53:40.473+0000 7fc210836640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:01.484146+0000 front 2024-09-21T01:53:01.484128+0000 (oldest deadline 2024-09-21T01:53:27.384161+0000) 2024-09-21T01:53:40.772 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:53:40 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:53:40.473+0000 7fc210836640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:10.786106+0000 front 2024-09-21T01:53:10.786293+0000 (oldest deadline 2024-09-21T01:53:36.086126+0000) 2024-09-21T01:53:41.053 INFO:journalctl@ceph.osd.6.smithi083.stdout:Sep 21 01:53:40 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-6[60956]: 2024-09-21T01:53:40.771+0000 7fc395e3d640 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:03.763137+0000 front 2024-09-21T01:53:03.763256+0000 (oldest deadline 2024-09-21T01:53:25.463021+0000) 2024-09-21T01:53:41.054 INFO:journalctl@ceph.osd.6.smithi083.stdout:Sep 21 01:53:40 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-6[60956]: 2024-09-21T01:53:40.771+0000 7fc395e3d640 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:11.165400+0000 front 2024-09-21T01:53:11.165485+0000 (oldest deadline 2024-09-21T01:53:35.265322+0000) 2024-09-21T01:53:41.215 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:53:40 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:53:40.946+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:55.996660+0000 front 2024-09-21T01:52:55.996645+0000 (oldest deadline 2024-09-21T01:53:21.296531+0000) 2024-09-21T01:53:41.215 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:53:40 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:53:40.946+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:03.597995+0000 front 2024-09-21T01:53:03.598011+0000 (oldest deadline 2024-09-21T01:53:28.297678+0000) 2024-09-21T01:53:41.215 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:53:40 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:53:40.946+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:09.398667+0000 front 2024-09-21T01:53:09.398643+0000 (oldest deadline 2024-09-21T01:53:34.698854+0000) 2024-09-21T01:53:41.217 INFO:journalctl@ceph.osd.7.smithi119.stdout:Sep 21 01:53:40 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-7[51223]: 2024-09-21T01:53:40.893+0000 7f38e1d98640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:04.415340+0000 front 2024-09-21T01:53:04.415508+0000 (oldest deadline 2024-09-21T01:53:26.715499+0000) 2024-09-21T01:53:41.218 INFO:journalctl@ceph.osd.7.smithi119.stdout:Sep 21 01:53:40 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-7[51223]: 2024-09-21T01:53:40.893+0000 7f38e1d98640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:12.417607+0000 front 2024-09-21T01:53:12.417588+0000 (oldest deadline 2024-09-21T01:53:33.517676+0000) 2024-09-21T01:53:41.218 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:53:40 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:53:40.917+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:52.739060+0000 front 2024-09-21T01:52:52.738919+0000 (oldest deadline 2024-09-21T01:53:18.038843+0000) 2024-09-21T01:53:41.218 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:53:40 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:53:40.917+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:03.740740+0000 front 2024-09-21T01:53:03.740797+0000 (oldest deadline 2024-09-21T01:53:26.040830+0000) 2024-09-21T01:53:41.218 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:53:40 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:53:40.917+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:10.642164+0000 front 2024-09-21T01:53:10.642202+0000 (oldest deadline 2024-09-21T01:53:35.342361+0000) 2024-09-21T01:53:41.714 INFO:journalctl@ceph.osd.8.smithi142.stdout:Sep 21 01:53:41 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-8[51832]: 2024-09-21T01:53:41.284+0000 7f95b1069640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:55.543069+0000 front 2024-09-21T01:52:55.543096+0000 (oldest deadline 2024-09-21T01:53:19.042967+0000) 2024-09-21T01:53:41.715 INFO:journalctl@ceph.osd.8.smithi142.stdout:Sep 21 01:53:41 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-8[51832]: 2024-09-21T01:53:41.284+0000 7f95b1069640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:09.545158+0000 front 2024-09-21T01:53:09.545113+0000 (oldest deadline 2024-09-21T01:53:33.645207+0000) 2024-09-21T01:53:41.729 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:53:41 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:53:41.440+0000 7fc210836640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:56.783488+0000 front 2024-09-21T01:52:56.783513+0000 (oldest deadline 2024-09-21T01:53:21.483559+0000) 2024-09-21T01:53:41.729 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:53:41 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:53:41.440+0000 7fc210836640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:01.484146+0000 front 2024-09-21T01:53:01.484128+0000 (oldest deadline 2024-09-21T01:53:27.384161+0000) 2024-09-21T01:53:41.729 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:53:41 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:53:41.440+0000 7fc210836640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:10.786106+0000 front 2024-09-21T01:53:10.786293+0000 (oldest deadline 2024-09-21T01:53:36.086126+0000) 2024-09-21T01:53:42.053 INFO:journalctl@ceph.osd.6.smithi083.stdout:Sep 21 01:53:41 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-6[60956]: 2024-09-21T01:53:41.729+0000 7fc395e3d640 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:03.763137+0000 front 2024-09-21T01:53:03.763256+0000 (oldest deadline 2024-09-21T01:53:25.463021+0000) 2024-09-21T01:53:42.054 INFO:journalctl@ceph.osd.6.smithi083.stdout:Sep 21 01:53:41 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-6[60956]: 2024-09-21T01:53:41.729+0000 7fc395e3d640 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:11.165400+0000 front 2024-09-21T01:53:11.165485+0000 (oldest deadline 2024-09-21T01:53:35.265322+0000) 2024-09-21T01:53:42.215 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:53:41 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:53:41.962+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:55.996660+0000 front 2024-09-21T01:52:55.996645+0000 (oldest deadline 2024-09-21T01:53:21.296531+0000) 2024-09-21T01:53:42.215 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:53:41 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:53:41.962+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:03.597995+0000 front 2024-09-21T01:53:03.598011+0000 (oldest deadline 2024-09-21T01:53:28.297678+0000) 2024-09-21T01:53:42.215 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:53:41 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:53:41.962+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:09.398667+0000 front 2024-09-21T01:53:09.398643+0000 (oldest deadline 2024-09-21T01:53:34.698854+0000) 2024-09-21T01:53:42.217 INFO:journalctl@ceph.osd.7.smithi119.stdout:Sep 21 01:53:41 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-7[51223]: 2024-09-21T01:53:41.940+0000 7f38e1d98640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:04.415340+0000 front 2024-09-21T01:53:04.415508+0000 (oldest deadline 2024-09-21T01:53:26.715499+0000) 2024-09-21T01:53:42.218 INFO:journalctl@ceph.osd.7.smithi119.stdout:Sep 21 01:53:41 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-7[51223]: 2024-09-21T01:53:41.940+0000 7f38e1d98640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:12.417607+0000 front 2024-09-21T01:53:12.417588+0000 (oldest deadline 2024-09-21T01:53:33.517676+0000) 2024-09-21T01:53:42.218 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:53:41 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:53:41.900+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:52.739060+0000 front 2024-09-21T01:52:52.738919+0000 (oldest deadline 2024-09-21T01:53:18.038843+0000) 2024-09-21T01:53:42.218 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:53:41 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:53:41.900+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:03.740740+0000 front 2024-09-21T01:53:03.740797+0000 (oldest deadline 2024-09-21T01:53:26.040830+0000) 2024-09-21T01:53:42.218 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:53:41 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:53:41.900+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:10.642164+0000 front 2024-09-21T01:53:10.642202+0000 (oldest deadline 2024-09-21T01:53:35.342361+0000) 2024-09-21T01:53:42.218 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:53:41 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:53:41.900+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.83:6814 osd.3 since back 2024-09-21T01:53:20.043206+0000 front 2024-09-21T01:53:20.043253+0000 (oldest deadline 2024-09-21T01:53:41.643680+0000) 2024-09-21T01:53:42.687 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:53:42 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:53:42.429+0000 7fc210836640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:56.783488+0000 front 2024-09-21T01:52:56.783513+0000 (oldest deadline 2024-09-21T01:53:21.483559+0000) 2024-09-21T01:53:42.688 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:53:42 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:53:42.429+0000 7fc210836640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:01.484146+0000 front 2024-09-21T01:53:01.484128+0000 (oldest deadline 2024-09-21T01:53:27.384161+0000) 2024-09-21T01:53:42.688 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:53:42 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:53:42.429+0000 7fc210836640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:10.786106+0000 front 2024-09-21T01:53:10.786293+0000 (oldest deadline 2024-09-21T01:53:36.086126+0000) 2024-09-21T01:53:42.714 INFO:journalctl@ceph.osd.8.smithi142.stdout:Sep 21 01:53:42 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-8[51832]: 2024-09-21T01:53:42.289+0000 7f95b1069640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:55.543069+0000 front 2024-09-21T01:52:55.543096+0000 (oldest deadline 2024-09-21T01:53:19.042967+0000) 2024-09-21T01:53:42.715 INFO:journalctl@ceph.osd.8.smithi142.stdout:Sep 21 01:53:42 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-8[51832]: 2024-09-21T01:53:42.289+0000 7f95b1069640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:09.545158+0000 front 2024-09-21T01:53:09.545113+0000 (oldest deadline 2024-09-21T01:53:33.645207+0000) 2024-09-21T01:53:43.053 INFO:journalctl@ceph.osd.6.smithi083.stdout:Sep 21 01:53:42 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-6[60956]: 2024-09-21T01:53:42.687+0000 7fc395e3d640 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:03.763137+0000 front 2024-09-21T01:53:03.763256+0000 (oldest deadline 2024-09-21T01:53:25.463021+0000) 2024-09-21T01:53:43.054 INFO:journalctl@ceph.osd.6.smithi083.stdout:Sep 21 01:53:42 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-6[60956]: 2024-09-21T01:53:42.687+0000 7fc395e3d640 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:11.165400+0000 front 2024-09-21T01:53:11.165485+0000 (oldest deadline 2024-09-21T01:53:35.265322+0000) 2024-09-21T01:53:43.214 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:53:42 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:53:42.934+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:55.996660+0000 front 2024-09-21T01:52:55.996645+0000 (oldest deadline 2024-09-21T01:53:21.296531+0000) 2024-09-21T01:53:43.215 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:53:42 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:53:42.934+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:03.597995+0000 front 2024-09-21T01:53:03.598011+0000 (oldest deadline 2024-09-21T01:53:28.297678+0000) 2024-09-21T01:53:43.215 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:53:42 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:53:42.935+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:09.398667+0000 front 2024-09-21T01:53:09.398643+0000 (oldest deadline 2024-09-21T01:53:34.698854+0000) 2024-09-21T01:53:43.218 INFO:journalctl@ceph.osd.7.smithi119.stdout:Sep 21 01:53:42 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-7[51223]: 2024-09-21T01:53:42.939+0000 7f38e1d98640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:04.415340+0000 front 2024-09-21T01:53:04.415508+0000 (oldest deadline 2024-09-21T01:53:26.715499+0000) 2024-09-21T01:53:43.218 INFO:journalctl@ceph.osd.7.smithi119.stdout:Sep 21 01:53:42 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-7[51223]: 2024-09-21T01:53:42.939+0000 7f38e1d98640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:12.417607+0000 front 2024-09-21T01:53:12.417588+0000 (oldest deadline 2024-09-21T01:53:33.517676+0000) 2024-09-21T01:53:43.218 INFO:journalctl@ceph.osd.7.smithi119.stdout:Sep 21 01:53:42 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-7[51223]: 2024-09-21T01:53:42.939+0000 7f38e1d98640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.83:6814 osd.3 since back 2024-09-21T01:53:18.119496+0000 front 2024-09-21T01:53:18.119426+0000 (oldest deadline 2024-09-21T01:53:42.219313+0000) 2024-09-21T01:53:43.218 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:53:42 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:53:42.881+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:52.739060+0000 front 2024-09-21T01:52:52.738919+0000 (oldest deadline 2024-09-21T01:53:18.038843+0000) 2024-09-21T01:53:43.218 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:53:42 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:53:42.881+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:03.740740+0000 front 2024-09-21T01:53:03.740797+0000 (oldest deadline 2024-09-21T01:53:26.040830+0000) 2024-09-21T01:53:43.218 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:53:42 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:53:42.881+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:10.642164+0000 front 2024-09-21T01:53:10.642202+0000 (oldest deadline 2024-09-21T01:53:35.342361+0000) 2024-09-21T01:53:43.218 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:53:42 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:53:42.881+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.83:6814 osd.3 since back 2024-09-21T01:53:20.043206+0000 front 2024-09-21T01:53:20.043253+0000 (oldest deadline 2024-09-21T01:53:41.643680+0000) 2024-09-21T01:53:43.714 INFO:journalctl@ceph.osd.8.smithi142.stdout:Sep 21 01:53:43 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-8[51832]: 2024-09-21T01:53:43.264+0000 7f95b1069640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:55.543069+0000 front 2024-09-21T01:52:55.543096+0000 (oldest deadline 2024-09-21T01:53:19.042967+0000) 2024-09-21T01:53:43.715 INFO:journalctl@ceph.osd.8.smithi142.stdout:Sep 21 01:53:43 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-8[51832]: 2024-09-21T01:53:43.264+0000 7f95b1069640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:09.545158+0000 front 2024-09-21T01:53:09.545113+0000 (oldest deadline 2024-09-21T01:53:33.645207+0000) 2024-09-21T01:53:43.715 INFO:journalctl@ceph.osd.8.smithi142.stdout:Sep 21 01:53:43 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-8[51832]: 2024-09-21T01:53:43.264+0000 7f95b1069640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.83:6814 osd.3 since back 2024-09-21T01:53:20.447752+0000 front 2024-09-21T01:53:20.447618+0000 (oldest deadline 2024-09-21T01:53:42.747672+0000) 2024-09-21T01:53:43.804 INFO:journalctl@ceph.osd.6.smithi083.stdout:Sep 21 01:53:43 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-6[60956]: 2024-09-21T01:53:43.666+0000 7fc395e3d640 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:03.763137+0000 front 2024-09-21T01:53:03.763256+0000 (oldest deadline 2024-09-21T01:53:25.463021+0000) 2024-09-21T01:53:43.804 INFO:journalctl@ceph.osd.6.smithi083.stdout:Sep 21 01:53:43 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-6[60956]: 2024-09-21T01:53:43.666+0000 7fc395e3d640 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:11.165400+0000 front 2024-09-21T01:53:11.165485+0000 (oldest deadline 2024-09-21T01:53:35.265322+0000) 2024-09-21T01:53:43.804 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:53:43 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:53:43.432+0000 7fc210836640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:56.783488+0000 front 2024-09-21T01:52:56.783513+0000 (oldest deadline 2024-09-21T01:53:21.483559+0000) 2024-09-21T01:53:43.804 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:53:43 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:53:43.432+0000 7fc210836640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:01.484146+0000 front 2024-09-21T01:53:01.484128+0000 (oldest deadline 2024-09-21T01:53:27.384161+0000) 2024-09-21T01:53:43.804 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:53:43 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:53:43.432+0000 7fc210836640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:10.786106+0000 front 2024-09-21T01:53:10.786293+0000 (oldest deadline 2024-09-21T01:53:36.086126+0000) 2024-09-21T01:53:44.218 INFO:journalctl@ceph.osd.7.smithi119.stdout:Sep 21 01:53:43 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-7[51223]: 2024-09-21T01:53:43.926+0000 7f38e1d98640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:04.415340+0000 front 2024-09-21T01:53:04.415508+0000 (oldest deadline 2024-09-21T01:53:26.715499+0000) 2024-09-21T01:53:44.218 INFO:journalctl@ceph.osd.7.smithi119.stdout:Sep 21 01:53:43 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-7[51223]: 2024-09-21T01:53:43.927+0000 7f38e1d98640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:12.417607+0000 front 2024-09-21T01:53:12.417588+0000 (oldest deadline 2024-09-21T01:53:33.517676+0000) 2024-09-21T01:53:44.218 INFO:journalctl@ceph.osd.7.smithi119.stdout:Sep 21 01:53:43 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-7[51223]: 2024-09-21T01:53:43.927+0000 7f38e1d98640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.83:6814 osd.3 since back 2024-09-21T01:53:18.119496+0000 front 2024-09-21T01:53:18.119426+0000 (oldest deadline 2024-09-21T01:53:42.219313+0000) 2024-09-21T01:53:44.218 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:53:43 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:53:43.870+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:52.739060+0000 front 2024-09-21T01:52:52.738919+0000 (oldest deadline 2024-09-21T01:53:18.038843+0000) 2024-09-21T01:53:44.218 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:53:43 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:53:43.870+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:03.740740+0000 front 2024-09-21T01:53:03.740797+0000 (oldest deadline 2024-09-21T01:53:26.040830+0000) 2024-09-21T01:53:44.218 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:53:43 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:53:43.870+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:10.642164+0000 front 2024-09-21T01:53:10.642202+0000 (oldest deadline 2024-09-21T01:53:35.342361+0000) 2024-09-21T01:53:44.218 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:53:43 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:53:43.870+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.83:6814 osd.3 since back 2024-09-21T01:53:20.043206+0000 front 2024-09-21T01:53:20.043253+0000 (oldest deadline 2024-09-21T01:53:41.643680+0000) 2024-09-21T01:53:44.267 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:53:43 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:53:43.975+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:55.996660+0000 front 2024-09-21T01:52:55.996645+0000 (oldest deadline 2024-09-21T01:53:21.296531+0000) 2024-09-21T01:53:44.267 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:53:43 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:53:43.975+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:03.597995+0000 front 2024-09-21T01:53:03.598011+0000 (oldest deadline 2024-09-21T01:53:28.297678+0000) 2024-09-21T01:53:44.268 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:53:43 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:53:43.975+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:09.398667+0000 front 2024-09-21T01:53:09.398643+0000 (oldest deadline 2024-09-21T01:53:34.698854+0000) 2024-09-21T01:53:44.715 INFO:journalctl@ceph.osd.8.smithi142.stdout:Sep 21 01:53:44 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-8[51832]: 2024-09-21T01:53:44.267+0000 7f95b1069640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:55.543069+0000 front 2024-09-21T01:52:55.543096+0000 (oldest deadline 2024-09-21T01:53:19.042967+0000) 2024-09-21T01:53:44.715 INFO:journalctl@ceph.osd.8.smithi142.stdout:Sep 21 01:53:44 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-8[51832]: 2024-09-21T01:53:44.267+0000 7f95b1069640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:09.545158+0000 front 2024-09-21T01:53:09.545113+0000 (oldest deadline 2024-09-21T01:53:33.645207+0000) 2024-09-21T01:53:44.715 INFO:journalctl@ceph.osd.8.smithi142.stdout:Sep 21 01:53:44 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-8[51832]: 2024-09-21T01:53:44.267+0000 7f95b1069640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.83:6814 osd.3 since back 2024-09-21T01:53:20.447752+0000 front 2024-09-21T01:53:20.447618+0000 (oldest deadline 2024-09-21T01:53:42.747672+0000) 2024-09-21T01:53:44.803 INFO:journalctl@ceph.osd.6.smithi083.stdout:Sep 21 01:53:44 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-6[60956]: 2024-09-21T01:53:44.626+0000 7fc395e3d640 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:03.763137+0000 front 2024-09-21T01:53:03.763256+0000 (oldest deadline 2024-09-21T01:53:25.463021+0000) 2024-09-21T01:53:44.804 INFO:journalctl@ceph.osd.6.smithi083.stdout:Sep 21 01:53:44 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-6[60956]: 2024-09-21T01:53:44.626+0000 7fc395e3d640 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:11.165400+0000 front 2024-09-21T01:53:11.165485+0000 (oldest deadline 2024-09-21T01:53:35.265322+0000) 2024-09-21T01:53:44.804 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:53:44 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:53:44.456+0000 7fc210836640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:56.783488+0000 front 2024-09-21T01:52:56.783513+0000 (oldest deadline 2024-09-21T01:53:21.483559+0000) 2024-09-21T01:53:44.804 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:53:44 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:53:44.456+0000 7fc210836640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:01.484146+0000 front 2024-09-21T01:53:01.484128+0000 (oldest deadline 2024-09-21T01:53:27.384161+0000) 2024-09-21T01:53:44.804 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:53:44 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:53:44.456+0000 7fc210836640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:10.786106+0000 front 2024-09-21T01:53:10.786293+0000 (oldest deadline 2024-09-21T01:53:36.086126+0000) 2024-09-21T01:53:45.218 INFO:journalctl@ceph.osd.7.smithi119.stdout:Sep 21 01:53:44 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-7[51223]: 2024-09-21T01:53:44.934+0000 7f38e1d98640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:04.415340+0000 front 2024-09-21T01:53:04.415508+0000 (oldest deadline 2024-09-21T01:53:26.715499+0000) 2024-09-21T01:53:45.218 INFO:journalctl@ceph.osd.7.smithi119.stdout:Sep 21 01:53:44 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-7[51223]: 2024-09-21T01:53:44.934+0000 7f38e1d98640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:12.417607+0000 front 2024-09-21T01:53:12.417588+0000 (oldest deadline 2024-09-21T01:53:33.517676+0000) 2024-09-21T01:53:45.218 INFO:journalctl@ceph.osd.7.smithi119.stdout:Sep 21 01:53:44 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-7[51223]: 2024-09-21T01:53:44.934+0000 7f38e1d98640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.83:6814 osd.3 since back 2024-09-21T01:53:18.119496+0000 front 2024-09-21T01:53:18.119426+0000 (oldest deadline 2024-09-21T01:53:42.219313+0000) 2024-09-21T01:53:45.218 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:53:44 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:53:44.825+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:52.739060+0000 front 2024-09-21T01:52:52.738919+0000 (oldest deadline 2024-09-21T01:53:18.038843+0000) 2024-09-21T01:53:45.218 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:53:44 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:53:44.825+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:03.740740+0000 front 2024-09-21T01:53:03.740797+0000 (oldest deadline 2024-09-21T01:53:26.040830+0000) 2024-09-21T01:53:45.218 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:53:44 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:53:44.825+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:10.642164+0000 front 2024-09-21T01:53:10.642202+0000 (oldest deadline 2024-09-21T01:53:35.342361+0000) 2024-09-21T01:53:45.218 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:53:44 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:53:44.825+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.83:6814 osd.3 since back 2024-09-21T01:53:20.043206+0000 front 2024-09-21T01:53:20.043253+0000 (oldest deadline 2024-09-21T01:53:41.643680+0000) 2024-09-21T01:53:45.306 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:53:44 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:53:44.975+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:55.996660+0000 front 2024-09-21T01:52:55.996645+0000 (oldest deadline 2024-09-21T01:53:21.296531+0000) 2024-09-21T01:53:45.306 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:53:44 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:53:44.975+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:03.597995+0000 front 2024-09-21T01:53:03.598011+0000 (oldest deadline 2024-09-21T01:53:28.297678+0000) 2024-09-21T01:53:45.306 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:53:44 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:53:44.975+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:09.398667+0000 front 2024-09-21T01:53:09.398643+0000 (oldest deadline 2024-09-21T01:53:34.698854+0000) 2024-09-21T01:53:45.443 INFO:journalctl@ceph.osd.6.smithi083.stdout:Sep 21 01:53:45 smithi083 podman[94507]: 2024-09-21 01:53:45.158316756 +0000 UTC m=+5.625266629 container died a4300509e210b8eceb1f42b9d43d1a6b767d87cc10ce7d8b65753cba3e2885ad (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-6, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-21T01:53:45.714 INFO:journalctl@ceph.osd.8.smithi142.stdout:Sep 21 01:53:45 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-8[51832]: 2024-09-21T01:53:45.305+0000 7f95b1069640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:55.543069+0000 front 2024-09-21T01:52:55.543096+0000 (oldest deadline 2024-09-21T01:53:19.042967+0000) 2024-09-21T01:53:45.715 INFO:journalctl@ceph.osd.8.smithi142.stdout:Sep 21 01:53:45 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-8[51832]: 2024-09-21T01:53:45.305+0000 7f95b1069640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:09.545158+0000 front 2024-09-21T01:53:09.545113+0000 (oldest deadline 2024-09-21T01:53:33.645207+0000) 2024-09-21T01:53:45.715 INFO:journalctl@ceph.osd.8.smithi142.stdout:Sep 21 01:53:45 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-8[51832]: 2024-09-21T01:53:45.305+0000 7f95b1069640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.83:6814 osd.3 since back 2024-09-21T01:53:20.447752+0000 front 2024-09-21T01:53:20.447618+0000 (oldest deadline 2024-09-21T01:53:42.747672+0000) 2024-09-21T01:53:45.792 INFO:journalctl@ceph.osd.6.smithi083.stdout:Sep 21 01:53:45 smithi083 podman[94507]: 2024-09-21 01:53:45.541210415 +0000 UTC m=+6.008160287 container cleanup a4300509e210b8eceb1f42b9d43d1a6b767d87cc10ce7d8b65753cba3e2885ad (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-6, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_CLEAN=True) 2024-09-21T01:53:45.792 INFO:journalctl@ceph.osd.6.smithi083.stdout:Sep 21 01:53:45 smithi083 bash[94507]: ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-6 2024-09-21T01:53:45.792 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:53:45 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:53:45.443+0000 7fc210836640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:56.783488+0000 front 2024-09-21T01:52:56.783513+0000 (oldest deadline 2024-09-21T01:53:21.483559+0000) 2024-09-21T01:53:45.793 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:53:45 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:53:45.443+0000 7fc210836640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:01.484146+0000 front 2024-09-21T01:53:01.484128+0000 (oldest deadline 2024-09-21T01:53:27.384161+0000) 2024-09-21T01:53:45.793 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:53:45 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:53:45.443+0000 7fc210836640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:10.786106+0000 front 2024-09-21T01:53:10.786293+0000 (oldest deadline 2024-09-21T01:53:36.086126+0000) 2024-09-21T01:53:46.054 INFO:journalctl@ceph.osd.6.smithi083.stdout:Sep 21 01:53:45 smithi083 podman[94522]: 2024-09-21 01:53:45.792643935 +0000 UTC m=+0.627927576 container remove a4300509e210b8eceb1f42b9d43d1a6b767d87cc10ce7d8b65753cba3e2885ad (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-6, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2) 2024-09-21T01:53:46.218 INFO:journalctl@ceph.osd.7.smithi119.stdout:Sep 21 01:53:45 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-7[51223]: 2024-09-21T01:53:45.890+0000 7f38e1d98640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:04.415340+0000 front 2024-09-21T01:53:04.415508+0000 (oldest deadline 2024-09-21T01:53:26.715499+0000) 2024-09-21T01:53:46.218 INFO:journalctl@ceph.osd.7.smithi119.stdout:Sep 21 01:53:45 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-7[51223]: 2024-09-21T01:53:45.890+0000 7f38e1d98640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:12.417607+0000 front 2024-09-21T01:53:12.417588+0000 (oldest deadline 2024-09-21T01:53:33.517676+0000) 2024-09-21T01:53:46.218 INFO:journalctl@ceph.osd.7.smithi119.stdout:Sep 21 01:53:45 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-7[51223]: 2024-09-21T01:53:45.890+0000 7f38e1d98640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.83:6814 osd.3 since back 2024-09-21T01:53:18.119496+0000 front 2024-09-21T01:53:18.119426+0000 (oldest deadline 2024-09-21T01:53:42.219313+0000) 2024-09-21T01:53:46.218 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:53:45 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:53:45.799+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:52.739060+0000 front 2024-09-21T01:52:52.738919+0000 (oldest deadline 2024-09-21T01:53:18.038843+0000) 2024-09-21T01:53:46.218 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:53:45 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:53:45.799+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:03.740740+0000 front 2024-09-21T01:53:03.740797+0000 (oldest deadline 2024-09-21T01:53:26.040830+0000) 2024-09-21T01:53:46.218 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:53:45 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:53:45.799+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:10.642164+0000 front 2024-09-21T01:53:10.642202+0000 (oldest deadline 2024-09-21T01:53:35.342361+0000) 2024-09-21T01:53:46.219 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:53:45 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:53:45.799+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.83:6814 osd.3 since back 2024-09-21T01:53:20.043206+0000 front 2024-09-21T01:53:20.043253+0000 (oldest deadline 2024-09-21T01:53:41.643680+0000) 2024-09-21T01:53:46.314 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:53:45 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:53:45.983+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:55.996660+0000 front 2024-09-21T01:52:55.996645+0000 (oldest deadline 2024-09-21T01:53:21.296531+0000) 2024-09-21T01:53:46.314 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:53:45 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:53:45.983+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:03.597995+0000 front 2024-09-21T01:53:03.598011+0000 (oldest deadline 2024-09-21T01:53:28.297678+0000) 2024-09-21T01:53:46.314 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:53:45 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:53:45.983+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:09.398667+0000 front 2024-09-21T01:53:09.398643+0000 (oldest deadline 2024-09-21T01:53:34.698854+0000) 2024-09-21T01:53:46.362 INFO:journalctl@ceph.osd.6.smithi083.stdout:Sep 21 01:53:46 smithi083 podman[94612]: 2024-09-21 01:53:46.110234216 +0000 UTC m=+0.110785759 container create 3067795683a61e82a6bcfacb3b6f22096c666548495eb53e024e4df5fc9eefd2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-6-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-09-21T01:53:46.363 INFO:journalctl@ceph.osd.6.smithi083.stdout:Sep 21 01:53:46 smithi083 podman[94612]: 2024-09-21 01:53:46.015240376 +0000 UTC m=+0.015791926 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T01:53:46.715 INFO:journalctl@ceph.osd.8.smithi142.stdout:Sep 21 01:53:46 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-8[51832]: 2024-09-21T01:53:46.314+0000 7f95b1069640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:55.543069+0000 front 2024-09-21T01:52:55.543096+0000 (oldest deadline 2024-09-21T01:53:19.042967+0000) 2024-09-21T01:53:46.715 INFO:journalctl@ceph.osd.8.smithi142.stdout:Sep 21 01:53:46 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-8[51832]: 2024-09-21T01:53:46.314+0000 7f95b1069640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:09.545158+0000 front 2024-09-21T01:53:09.545113+0000 (oldest deadline 2024-09-21T01:53:33.645207+0000) 2024-09-21T01:53:46.715 INFO:journalctl@ceph.osd.8.smithi142.stdout:Sep 21 01:53:46 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-8[51832]: 2024-09-21T01:53:46.314+0000 7f95b1069640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.83:6814 osd.3 since back 2024-09-21T01:53:20.447752+0000 front 2024-09-21T01:53:20.447618+0000 (oldest deadline 2024-09-21T01:53:42.747672+0000) 2024-09-21T01:53:46.804 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:53:46 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:53:46.481+0000 7fc210836640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:56.783488+0000 front 2024-09-21T01:52:56.783513+0000 (oldest deadline 2024-09-21T01:53:21.483559+0000) 2024-09-21T01:53:46.804 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:53:46 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:53:46.481+0000 7fc210836640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:01.484146+0000 front 2024-09-21T01:53:01.484128+0000 (oldest deadline 2024-09-21T01:53:27.384161+0000) 2024-09-21T01:53:46.804 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:53:46 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:53:46.481+0000 7fc210836640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:10.786106+0000 front 2024-09-21T01:53:10.786293+0000 (oldest deadline 2024-09-21T01:53:36.086126+0000) 2024-09-21T01:53:46.804 INFO:journalctl@ceph.osd.6.smithi083.stdout:Sep 21 01:53:46 smithi083 podman[94612]: 2024-09-21 01:53:46.363195329 +0000 UTC m=+0.363746882 container init 3067795683a61e82a6bcfacb3b6f22096c666548495eb53e024e4df5fc9eefd2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-6-deactivate, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T01:53:46.804 INFO:journalctl@ceph.osd.6.smithi083.stdout:Sep 21 01:53:46 smithi083 podman[94612]: 2024-09-21 01:53:46.366394107 +0000 UTC m=+0.366945650 container start 3067795683a61e82a6bcfacb3b6f22096c666548495eb53e024e4df5fc9eefd2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-6-deactivate, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2) 2024-09-21T01:53:46.805 INFO:journalctl@ceph.osd.6.smithi083.stdout:Sep 21 01:53:46 smithi083 podman[94612]: 2024-09-21 01:53:46.463063329 +0000 UTC m=+0.463614887 container attach 3067795683a61e82a6bcfacb3b6f22096c666548495eb53e024e4df5fc9eefd2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-6-deactivate, GIT_CLEAN=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-09-21T01:53:46.805 INFO:journalctl@ceph.osd.6.smithi083.stdout:Sep 21 01:53:46 smithi083 podman[94612]: 2024-09-21 01:53:46.551563291 +0000 UTC m=+0.552114844 container died 3067795683a61e82a6bcfacb3b6f22096c666548495eb53e024e4df5fc9eefd2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-6-deactivate, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True) 2024-09-21T01:53:47.217 INFO:journalctl@ceph.osd.7.smithi119.stdout:Sep 21 01:53:46 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-7[51223]: 2024-09-21T01:53:46.895+0000 7f38e1d98640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:04.415340+0000 front 2024-09-21T01:53:04.415508+0000 (oldest deadline 2024-09-21T01:53:26.715499+0000) 2024-09-21T01:53:47.218 INFO:journalctl@ceph.osd.7.smithi119.stdout:Sep 21 01:53:46 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-7[51223]: 2024-09-21T01:53:46.895+0000 7f38e1d98640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:12.417607+0000 front 2024-09-21T01:53:12.417588+0000 (oldest deadline 2024-09-21T01:53:33.517676+0000) 2024-09-21T01:53:47.218 INFO:journalctl@ceph.osd.7.smithi119.stdout:Sep 21 01:53:46 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-7[51223]: 2024-09-21T01:53:46.895+0000 7f38e1d98640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.83:6814 osd.3 since back 2024-09-21T01:53:18.119496+0000 front 2024-09-21T01:53:18.119426+0000 (oldest deadline 2024-09-21T01:53:42.219313+0000) 2024-09-21T01:53:47.218 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:53:46 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:53:46.847+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:52.739060+0000 front 2024-09-21T01:52:52.738919+0000 (oldest deadline 2024-09-21T01:53:18.038843+0000) 2024-09-21T01:53:47.218 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:53:46 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:53:46.847+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:03.740740+0000 front 2024-09-21T01:53:03.740797+0000 (oldest deadline 2024-09-21T01:53:26.040830+0000) 2024-09-21T01:53:47.218 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:53:46 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:53:46.847+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:10.642164+0000 front 2024-09-21T01:53:10.642202+0000 (oldest deadline 2024-09-21T01:53:35.342361+0000) 2024-09-21T01:53:47.218 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:53:46 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:53:46.847+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.83:6814 osd.3 since back 2024-09-21T01:53:20.043206+0000 front 2024-09-21T01:53:20.043253+0000 (oldest deadline 2024-09-21T01:53:41.643680+0000) 2024-09-21T01:53:47.320 DEBUG:teuthology.orchestra.run.smithi083:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f7697ecc-77b8-11ef-baf5-efdc52797490@osd.6.service' 2024-09-21T01:53:47.322 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:53:46 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:53:46.981+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:55.996660+0000 front 2024-09-21T01:52:55.996645+0000 (oldest deadline 2024-09-21T01:53:21.296531+0000) 2024-09-21T01:53:47.322 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:53:46 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:53:46.981+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:03.597995+0000 front 2024-09-21T01:53:03.598011+0000 (oldest deadline 2024-09-21T01:53:28.297678+0000) 2024-09-21T01:53:47.322 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:53:46 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:53:46.981+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:09.398667+0000 front 2024-09-21T01:53:09.398643+0000 (oldest deadline 2024-09-21T01:53:34.698854+0000) 2024-09-21T01:53:47.361 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T01:53:47.362 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-09-21T01:53:47.362 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-09-21T01:53:47.362 DEBUG:teuthology.orchestra.run.smithi119:> sudo systemctl stop ceph-f7697ecc-77b8-11ef-baf5-efdc52797490@osd.7 2024-09-21T01:53:47.554 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:53:47 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:53:47.450+0000 7fc210836640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:56.783488+0000 front 2024-09-21T01:52:56.783513+0000 (oldest deadline 2024-09-21T01:53:21.483559+0000) 2024-09-21T01:53:47.554 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:53:47 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:53:47.450+0000 7fc210836640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:01.484146+0000 front 2024-09-21T01:53:01.484128+0000 (oldest deadline 2024-09-21T01:53:27.384161+0000) 2024-09-21T01:53:47.554 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:53:47 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:53:47.450+0000 7fc210836640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:10.786106+0000 front 2024-09-21T01:53:10.786293+0000 (oldest deadline 2024-09-21T01:53:36.086126+0000) 2024-09-21T01:53:47.554 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:53:47 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:53:47.450+0000 7fc210836640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.83:6814 osd.3 since back 2024-09-21T01:53:20.588096+0000 front 2024-09-21T01:53:20.588133+0000 (oldest deadline 2024-09-21T01:53:46.488248+0000) 2024-09-21T01:53:47.714 INFO:journalctl@ceph.osd.8.smithi142.stdout:Sep 21 01:53:47 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-8[51832]: 2024-09-21T01:53:47.321+0000 7f95b1069640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:55.543069+0000 front 2024-09-21T01:52:55.543096+0000 (oldest deadline 2024-09-21T01:53:19.042967+0000) 2024-09-21T01:53:47.715 INFO:journalctl@ceph.osd.8.smithi142.stdout:Sep 21 01:53:47 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-8[51832]: 2024-09-21T01:53:47.321+0000 7f95b1069640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:09.545158+0000 front 2024-09-21T01:53:09.545113+0000 (oldest deadline 2024-09-21T01:53:33.645207+0000) 2024-09-21T01:53:47.715 INFO:journalctl@ceph.osd.8.smithi142.stdout:Sep 21 01:53:47 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-8[51832]: 2024-09-21T01:53:47.321+0000 7f95b1069640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.83:6814 osd.3 since back 2024-09-21T01:53:20.447752+0000 front 2024-09-21T01:53:20.447618+0000 (oldest deadline 2024-09-21T01:53:42.747672+0000) 2024-09-21T01:53:47.717 INFO:journalctl@ceph.osd.7.smithi119.stdout:Sep 21 01:53:47 smithi119 systemd[1]: Stopping Ceph osd.7 for f7697ecc-77b8-11ef-baf5-efdc52797490... 2024-09-21T01:53:48.218 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:53:47 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:53:47.895+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:52.739060+0000 front 2024-09-21T01:52:52.738919+0000 (oldest deadline 2024-09-21T01:53:18.038843+0000) 2024-09-21T01:53:48.218 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:53:47 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:53:47.895+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:03.740740+0000 front 2024-09-21T01:53:03.740797+0000 (oldest deadline 2024-09-21T01:53:26.040830+0000) 2024-09-21T01:53:48.218 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:53:47 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:53:47.895+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:10.642164+0000 front 2024-09-21T01:53:10.642202+0000 (oldest deadline 2024-09-21T01:53:35.342361+0000) 2024-09-21T01:53:48.218 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:53:47 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:53:47.895+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.83:6814 osd.3 since back 2024-09-21T01:53:20.043206+0000 front 2024-09-21T01:53:20.043253+0000 (oldest deadline 2024-09-21T01:53:41.643680+0000) 2024-09-21T01:53:48.218 INFO:journalctl@ceph.osd.7.smithi119.stdout:Sep 21 01:53:47 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-7[51223]: 2024-09-21T01:53:47.784+0000 7f38e97b5640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T01:53:48.218 INFO:journalctl@ceph.osd.7.smithi119.stdout:Sep 21 01:53:47 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-7[51223]: 2024-09-21T01:53:47.784+0000 7f38e97b5640 -1 osd.7 98 *** Got signal Terminated *** 2024-09-21T01:53:48.219 INFO:journalctl@ceph.osd.7.smithi119.stdout:Sep 21 01:53:47 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-7[51223]: 2024-09-21T01:53:47.784+0000 7f38e97b5640 -1 osd.7 98 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T01:53:48.219 INFO:journalctl@ceph.osd.7.smithi119.stdout:Sep 21 01:53:47 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-7[51223]: 2024-09-21T01:53:47.861+0000 7f38e1d98640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:04.415340+0000 front 2024-09-21T01:53:04.415508+0000 (oldest deadline 2024-09-21T01:53:26.715499+0000) 2024-09-21T01:53:48.219 INFO:journalctl@ceph.osd.7.smithi119.stdout:Sep 21 01:53:47 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-7[51223]: 2024-09-21T01:53:47.861+0000 7f38e1d98640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:12.417607+0000 front 2024-09-21T01:53:12.417588+0000 (oldest deadline 2024-09-21T01:53:33.517676+0000) 2024-09-21T01:53:48.219 INFO:journalctl@ceph.osd.7.smithi119.stdout:Sep 21 01:53:47 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-7[51223]: 2024-09-21T01:53:47.861+0000 7f38e1d98640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.83:6814 osd.3 since back 2024-09-21T01:53:18.119496+0000 front 2024-09-21T01:53:18.119426+0000 (oldest deadline 2024-09-21T01:53:42.219313+0000) 2024-09-21T01:53:48.325 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:53:47 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:53:47.968+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:55.996660+0000 front 2024-09-21T01:52:55.996645+0000 (oldest deadline 2024-09-21T01:53:21.296531+0000) 2024-09-21T01:53:48.325 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:53:47 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:53:47.968+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:03.597995+0000 front 2024-09-21T01:53:03.598011+0000 (oldest deadline 2024-09-21T01:53:28.297678+0000) 2024-09-21T01:53:48.325 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:53:47 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:53:47.968+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:09.398667+0000 front 2024-09-21T01:53:09.398643+0000 (oldest deadline 2024-09-21T01:53:34.698854+0000) 2024-09-21T01:53:48.715 INFO:journalctl@ceph.osd.8.smithi142.stdout:Sep 21 01:53:48 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-8[51832]: 2024-09-21T01:53:48.324+0000 7f95b1069640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:55.543069+0000 front 2024-09-21T01:52:55.543096+0000 (oldest deadline 2024-09-21T01:53:19.042967+0000) 2024-09-21T01:53:48.715 INFO:journalctl@ceph.osd.8.smithi142.stdout:Sep 21 01:53:48 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-8[51832]: 2024-09-21T01:53:48.324+0000 7f95b1069640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:09.545158+0000 front 2024-09-21T01:53:09.545113+0000 (oldest deadline 2024-09-21T01:53:33.645207+0000) 2024-09-21T01:53:48.715 INFO:journalctl@ceph.osd.8.smithi142.stdout:Sep 21 01:53:48 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-8[51832]: 2024-09-21T01:53:48.324+0000 7f95b1069640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.83:6814 osd.3 since back 2024-09-21T01:53:20.447752+0000 front 2024-09-21T01:53:20.447618+0000 (oldest deadline 2024-09-21T01:53:42.747672+0000) 2024-09-21T01:53:48.804 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:53:48 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:53:48.418+0000 7fc210836640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:56.783488+0000 front 2024-09-21T01:52:56.783513+0000 (oldest deadline 2024-09-21T01:53:21.483559+0000) 2024-09-21T01:53:48.804 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:53:48 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:53:48.418+0000 7fc210836640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:01.484146+0000 front 2024-09-21T01:53:01.484128+0000 (oldest deadline 2024-09-21T01:53:27.384161+0000) 2024-09-21T01:53:48.804 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:53:48 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:53:48.418+0000 7fc210836640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:10.786106+0000 front 2024-09-21T01:53:10.786293+0000 (oldest deadline 2024-09-21T01:53:36.086126+0000) 2024-09-21T01:53:48.804 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:53:48 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:53:48.418+0000 7fc210836640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.83:6814 osd.3 since back 2024-09-21T01:53:20.588096+0000 front 2024-09-21T01:53:20.588133+0000 (oldest deadline 2024-09-21T01:53:46.488248+0000) 2024-09-21T01:53:49.214 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:53:48 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:53:48.965+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:55.996660+0000 front 2024-09-21T01:52:55.996645+0000 (oldest deadline 2024-09-21T01:53:21.296531+0000) 2024-09-21T01:53:49.214 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:53:48 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:53:48.965+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:03.597995+0000 front 2024-09-21T01:53:03.598011+0000 (oldest deadline 2024-09-21T01:53:28.297678+0000) 2024-09-21T01:53:49.215 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:53:48 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:53:48.965+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:09.398667+0000 front 2024-09-21T01:53:09.398643+0000 (oldest deadline 2024-09-21T01:53:34.698854+0000) 2024-09-21T01:53:49.217 INFO:journalctl@ceph.osd.7.smithi119.stdout:Sep 21 01:53:48 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-7[51223]: 2024-09-21T01:53:48.883+0000 7f38e1d98640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:04.415340+0000 front 2024-09-21T01:53:04.415508+0000 (oldest deadline 2024-09-21T01:53:26.715499+0000) 2024-09-21T01:53:49.218 INFO:journalctl@ceph.osd.7.smithi119.stdout:Sep 21 01:53:48 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-7[51223]: 2024-09-21T01:53:48.883+0000 7f38e1d98640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:12.417607+0000 front 2024-09-21T01:53:12.417588+0000 (oldest deadline 2024-09-21T01:53:33.517676+0000) 2024-09-21T01:53:49.218 INFO:journalctl@ceph.osd.7.smithi119.stdout:Sep 21 01:53:48 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-7[51223]: 2024-09-21T01:53:48.883+0000 7f38e1d98640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.83:6814 osd.3 since back 2024-09-21T01:53:18.119496+0000 front 2024-09-21T01:53:18.119426+0000 (oldest deadline 2024-09-21T01:53:42.219313+0000) 2024-09-21T01:53:49.218 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:53:48 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:53:48.906+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:52.739060+0000 front 2024-09-21T01:52:52.738919+0000 (oldest deadline 2024-09-21T01:53:18.038843+0000) 2024-09-21T01:53:49.218 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:53:48 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:53:48.906+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:03.740740+0000 front 2024-09-21T01:53:03.740797+0000 (oldest deadline 2024-09-21T01:53:26.040830+0000) 2024-09-21T01:53:49.218 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:53:48 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:53:48.906+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:10.642164+0000 front 2024-09-21T01:53:10.642202+0000 (oldest deadline 2024-09-21T01:53:35.342361+0000) 2024-09-21T01:53:49.218 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:53:48 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:53:48.906+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.83:6814 osd.3 since back 2024-09-21T01:53:20.043206+0000 front 2024-09-21T01:53:20.043253+0000 (oldest deadline 2024-09-21T01:53:41.643680+0000) 2024-09-21T01:53:49.714 INFO:journalctl@ceph.osd.8.smithi142.stdout:Sep 21 01:53:49 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-8[51832]: 2024-09-21T01:53:49.305+0000 7f95b1069640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:55.543069+0000 front 2024-09-21T01:52:55.543096+0000 (oldest deadline 2024-09-21T01:53:19.042967+0000) 2024-09-21T01:53:49.714 INFO:journalctl@ceph.osd.8.smithi142.stdout:Sep 21 01:53:49 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-8[51832]: 2024-09-21T01:53:49.305+0000 7f95b1069640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:09.545158+0000 front 2024-09-21T01:53:09.545113+0000 (oldest deadline 2024-09-21T01:53:33.645207+0000) 2024-09-21T01:53:49.715 INFO:journalctl@ceph.osd.8.smithi142.stdout:Sep 21 01:53:49 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-8[51832]: 2024-09-21T01:53:49.305+0000 7f95b1069640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.83:6814 osd.3 since back 2024-09-21T01:53:20.447752+0000 front 2024-09-21T01:53:20.447618+0000 (oldest deadline 2024-09-21T01:53:42.747672+0000) 2024-09-21T01:53:49.804 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:53:49 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:53:49.432+0000 7fc210836640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:56.783488+0000 front 2024-09-21T01:52:56.783513+0000 (oldest deadline 2024-09-21T01:53:21.483559+0000) 2024-09-21T01:53:49.804 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:53:49 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:53:49.432+0000 7fc210836640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:01.484146+0000 front 2024-09-21T01:53:01.484128+0000 (oldest deadline 2024-09-21T01:53:27.384161+0000) 2024-09-21T01:53:49.804 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:53:49 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:53:49.432+0000 7fc210836640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:10.786106+0000 front 2024-09-21T01:53:10.786293+0000 (oldest deadline 2024-09-21T01:53:36.086126+0000) 2024-09-21T01:53:49.804 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:53:49 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:53:49.432+0000 7fc210836640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.83:6814 osd.3 since back 2024-09-21T01:53:20.588096+0000 front 2024-09-21T01:53:20.588133+0000 (oldest deadline 2024-09-21T01:53:46.488248+0000) 2024-09-21T01:53:49.804 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:53:49 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:53:49.432+0000 7fc210836640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T01:53:26.488804+0000 front 2024-09-21T01:53:26.488731+0000 (oldest deadline 2024-09-21T01:53:49.388741+0000) 2024-09-21T01:53:50.215 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:53:49 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:53:49.955+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:55.996660+0000 front 2024-09-21T01:52:55.996645+0000 (oldest deadline 2024-09-21T01:53:21.296531+0000) 2024-09-21T01:53:50.215 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:53:49 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:53:49.955+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:03.597995+0000 front 2024-09-21T01:53:03.598011+0000 (oldest deadline 2024-09-21T01:53:28.297678+0000) 2024-09-21T01:53:50.215 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:53:49 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:53:49.955+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:09.398667+0000 front 2024-09-21T01:53:09.398643+0000 (oldest deadline 2024-09-21T01:53:34.698854+0000) 2024-09-21T01:53:50.217 INFO:journalctl@ceph.osd.7.smithi119.stdout:Sep 21 01:53:49 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-7[51223]: 2024-09-21T01:53:49.909+0000 7f38e1d98640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:04.415340+0000 front 2024-09-21T01:53:04.415508+0000 (oldest deadline 2024-09-21T01:53:26.715499+0000) 2024-09-21T01:53:50.217 INFO:journalctl@ceph.osd.7.smithi119.stdout:Sep 21 01:53:49 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-7[51223]: 2024-09-21T01:53:49.909+0000 7f38e1d98640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:12.417607+0000 front 2024-09-21T01:53:12.417588+0000 (oldest deadline 2024-09-21T01:53:33.517676+0000) 2024-09-21T01:53:50.217 INFO:journalctl@ceph.osd.7.smithi119.stdout:Sep 21 01:53:49 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-7[51223]: 2024-09-21T01:53:49.909+0000 7f38e1d98640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.83:6814 osd.3 since back 2024-09-21T01:53:18.119496+0000 front 2024-09-21T01:53:18.119426+0000 (oldest deadline 2024-09-21T01:53:42.219313+0000) 2024-09-21T01:53:50.218 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:53:49 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:53:49.876+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:52.739060+0000 front 2024-09-21T01:52:52.738919+0000 (oldest deadline 2024-09-21T01:53:18.038843+0000) 2024-09-21T01:53:50.218 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:53:49 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:53:49.876+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:03.740740+0000 front 2024-09-21T01:53:03.740797+0000 (oldest deadline 2024-09-21T01:53:26.040830+0000) 2024-09-21T01:53:50.218 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:53:49 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:53:49.876+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:10.642164+0000 front 2024-09-21T01:53:10.642202+0000 (oldest deadline 2024-09-21T01:53:35.342361+0000) 2024-09-21T01:53:50.218 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:53:49 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:53:49.876+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.83:6814 osd.3 since back 2024-09-21T01:53:20.043206+0000 front 2024-09-21T01:53:20.043253+0000 (oldest deadline 2024-09-21T01:53:41.643680+0000) 2024-09-21T01:53:50.715 INFO:journalctl@ceph.osd.8.smithi142.stdout:Sep 21 01:53:50 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-8[51832]: 2024-09-21T01:53:50.278+0000 7f95b1069640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:55.543069+0000 front 2024-09-21T01:52:55.543096+0000 (oldest deadline 2024-09-21T01:53:19.042967+0000) 2024-09-21T01:53:50.963 INFO:journalctl@ceph.osd.8.smithi142.stdout:Sep 21 01:53:50 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-8[51832]: 2024-09-21T01:53:50.278+0000 7f95b1069640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:09.545158+0000 front 2024-09-21T01:53:09.545113+0000 (oldest deadline 2024-09-21T01:53:33.645207+0000) 2024-09-21T01:53:50.963 INFO:journalctl@ceph.osd.8.smithi142.stdout:Sep 21 01:53:50 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-8[51832]: 2024-09-21T01:53:50.278+0000 7f95b1069640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.83:6814 osd.3 since back 2024-09-21T01:53:20.447752+0000 front 2024-09-21T01:53:20.447618+0000 (oldest deadline 2024-09-21T01:53:42.747672+0000) 2024-09-21T01:53:50.964 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:53:50 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:53:50.455+0000 7fc210836640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:56.783488+0000 front 2024-09-21T01:52:56.783513+0000 (oldest deadline 2024-09-21T01:53:21.483559+0000) 2024-09-21T01:53:50.964 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:53:50 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:53:50.455+0000 7fc210836640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:01.484146+0000 front 2024-09-21T01:53:01.484128+0000 (oldest deadline 2024-09-21T01:53:27.384161+0000) 2024-09-21T01:53:50.964 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:53:50 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:53:50.455+0000 7fc210836640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:10.786106+0000 front 2024-09-21T01:53:10.786293+0000 (oldest deadline 2024-09-21T01:53:36.086126+0000) 2024-09-21T01:53:50.964 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:53:50 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:53:50.455+0000 7fc210836640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.83:6814 osd.3 since back 2024-09-21T01:53:20.588096+0000 front 2024-09-21T01:53:20.588133+0000 (oldest deadline 2024-09-21T01:53:46.488248+0000) 2024-09-21T01:53:50.964 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:53:50 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:53:50.455+0000 7fc210836640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T01:53:26.488804+0000 front 2024-09-21T01:53:26.488731+0000 (oldest deadline 2024-09-21T01:53:49.388741+0000) 2024-09-21T01:53:51.214 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:53:50 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:53:50.940+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:55.996660+0000 front 2024-09-21T01:52:55.996645+0000 (oldest deadline 2024-09-21T01:53:21.296531+0000) 2024-09-21T01:53:51.215 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:53:50 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:53:50.940+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:03.597995+0000 front 2024-09-21T01:53:03.598011+0000 (oldest deadline 2024-09-21T01:53:28.297678+0000) 2024-09-21T01:53:51.215 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:53:50 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:53:50.940+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:09.398667+0000 front 2024-09-21T01:53:09.398643+0000 (oldest deadline 2024-09-21T01:53:34.698854+0000) 2024-09-21T01:53:51.217 INFO:journalctl@ceph.osd.7.smithi119.stdout:Sep 21 01:53:50 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-7[51223]: 2024-09-21T01:53:50.895+0000 7f38e1d98640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:04.415340+0000 front 2024-09-21T01:53:04.415508+0000 (oldest deadline 2024-09-21T01:53:26.715499+0000) 2024-09-21T01:53:51.218 INFO:journalctl@ceph.osd.7.smithi119.stdout:Sep 21 01:53:50 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-7[51223]: 2024-09-21T01:53:50.895+0000 7f38e1d98640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:12.417607+0000 front 2024-09-21T01:53:12.417588+0000 (oldest deadline 2024-09-21T01:53:33.517676+0000) 2024-09-21T01:53:51.218 INFO:journalctl@ceph.osd.7.smithi119.stdout:Sep 21 01:53:50 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-7[51223]: 2024-09-21T01:53:50.895+0000 7f38e1d98640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.83:6814 osd.3 since back 2024-09-21T01:53:18.119496+0000 front 2024-09-21T01:53:18.119426+0000 (oldest deadline 2024-09-21T01:53:42.219313+0000) 2024-09-21T01:53:51.218 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:53:50 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:53:50.837+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:52.739060+0000 front 2024-09-21T01:52:52.738919+0000 (oldest deadline 2024-09-21T01:53:18.038843+0000) 2024-09-21T01:53:51.218 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:53:50 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:53:50.837+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:03.740740+0000 front 2024-09-21T01:53:03.740797+0000 (oldest deadline 2024-09-21T01:53:26.040830+0000) 2024-09-21T01:53:51.218 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:53:50 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:53:50.837+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:10.642164+0000 front 2024-09-21T01:53:10.642202+0000 (oldest deadline 2024-09-21T01:53:35.342361+0000) 2024-09-21T01:53:51.218 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:53:50 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:53:50.837+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.83:6814 osd.3 since back 2024-09-21T01:53:20.043206+0000 front 2024-09-21T01:53:20.043253+0000 (oldest deadline 2024-09-21T01:53:41.643680+0000) 2024-09-21T01:53:51.218 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:53:50 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:53:50.837+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T01:53:27.445169+0000 front 2024-09-21T01:53:27.445227+0000 (oldest deadline 2024-09-21T01:53:50.345230+0000) 2024-09-21T01:53:51.714 INFO:journalctl@ceph.osd.8.smithi142.stdout:Sep 21 01:53:51 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-8[51832]: 2024-09-21T01:53:51.234+0000 7f95b1069640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:55.543069+0000 front 2024-09-21T01:52:55.543096+0000 (oldest deadline 2024-09-21T01:53:19.042967+0000) 2024-09-21T01:53:51.715 INFO:journalctl@ceph.osd.8.smithi142.stdout:Sep 21 01:53:51 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-8[51832]: 2024-09-21T01:53:51.234+0000 7f95b1069640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:09.545158+0000 front 2024-09-21T01:53:09.545113+0000 (oldest deadline 2024-09-21T01:53:33.645207+0000) 2024-09-21T01:53:51.715 INFO:journalctl@ceph.osd.8.smithi142.stdout:Sep 21 01:53:51 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-8[51832]: 2024-09-21T01:53:51.234+0000 7f95b1069640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.83:6814 osd.3 since back 2024-09-21T01:53:20.447752+0000 front 2024-09-21T01:53:20.447618+0000 (oldest deadline 2024-09-21T01:53:42.747672+0000) 2024-09-21T01:53:51.804 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:53:51 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:53:51.409+0000 7fc210836640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:56.783488+0000 front 2024-09-21T01:52:56.783513+0000 (oldest deadline 2024-09-21T01:53:21.483559+0000) 2024-09-21T01:53:51.804 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:53:51 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:53:51.409+0000 7fc210836640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:01.484146+0000 front 2024-09-21T01:53:01.484128+0000 (oldest deadline 2024-09-21T01:53:27.384161+0000) 2024-09-21T01:53:51.804 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:53:51 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:53:51.409+0000 7fc210836640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:10.786106+0000 front 2024-09-21T01:53:10.786293+0000 (oldest deadline 2024-09-21T01:53:36.086126+0000) 2024-09-21T01:53:51.804 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:53:51 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:53:51.409+0000 7fc210836640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.83:6814 osd.3 since back 2024-09-21T01:53:20.588096+0000 front 2024-09-21T01:53:20.588133+0000 (oldest deadline 2024-09-21T01:53:46.488248+0000) 2024-09-21T01:53:51.804 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:53:51 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:53:51.409+0000 7fc210836640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T01:53:26.488804+0000 front 2024-09-21T01:53:26.488731+0000 (oldest deadline 2024-09-21T01:53:49.388741+0000) 2024-09-21T01:53:52.199 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:53:51 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:53:51.944+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:55.996660+0000 front 2024-09-21T01:52:55.996645+0000 (oldest deadline 2024-09-21T01:53:21.296531+0000) 2024-09-21T01:53:52.200 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:53:51 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:53:51.944+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:03.597995+0000 front 2024-09-21T01:53:03.598011+0000 (oldest deadline 2024-09-21T01:53:28.297678+0000) 2024-09-21T01:53:52.200 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:53:51 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:53:51.944+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:09.398667+0000 front 2024-09-21T01:53:09.398643+0000 (oldest deadline 2024-09-21T01:53:34.698854+0000) 2024-09-21T01:53:52.200 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:53:51 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:53:51.944+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T01:53:26.400794+0000 front 2024-09-21T01:53:26.400993+0000 (oldest deadline 2024-09-21T01:53:51.100678+0000) 2024-09-21T01:53:52.217 INFO:journalctl@ceph.osd.7.smithi119.stdout:Sep 21 01:53:51 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-7[51223]: 2024-09-21T01:53:51.877+0000 7f38e1d98640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:04.415340+0000 front 2024-09-21T01:53:04.415508+0000 (oldest deadline 2024-09-21T01:53:26.715499+0000) 2024-09-21T01:53:52.217 INFO:journalctl@ceph.osd.7.smithi119.stdout:Sep 21 01:53:51 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-7[51223]: 2024-09-21T01:53:51.877+0000 7f38e1d98640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:12.417607+0000 front 2024-09-21T01:53:12.417588+0000 (oldest deadline 2024-09-21T01:53:33.517676+0000) 2024-09-21T01:53:52.218 INFO:journalctl@ceph.osd.7.smithi119.stdout:Sep 21 01:53:51 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-7[51223]: 2024-09-21T01:53:51.877+0000 7f38e1d98640 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.83:6814 osd.3 since back 2024-09-21T01:53:18.119496+0000 front 2024-09-21T01:53:18.119426+0000 (oldest deadline 2024-09-21T01:53:42.219313+0000) 2024-09-21T01:53:52.218 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:53:51 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:53:51.826+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:52.739060+0000 front 2024-09-21T01:52:52.738919+0000 (oldest deadline 2024-09-21T01:53:18.038843+0000) 2024-09-21T01:53:52.218 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:53:51 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:53:51.826+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:03.740740+0000 front 2024-09-21T01:53:03.740797+0000 (oldest deadline 2024-09-21T01:53:26.040830+0000) 2024-09-21T01:53:52.218 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:53:51 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:53:51.826+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:10.642164+0000 front 2024-09-21T01:53:10.642202+0000 (oldest deadline 2024-09-21T01:53:35.342361+0000) 2024-09-21T01:53:52.218 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:53:51 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:53:51.826+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.83:6814 osd.3 since back 2024-09-21T01:53:20.043206+0000 front 2024-09-21T01:53:20.043253+0000 (oldest deadline 2024-09-21T01:53:41.643680+0000) 2024-09-21T01:53:52.218 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:53:51 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:53:51.826+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T01:53:27.445169+0000 front 2024-09-21T01:53:27.445227+0000 (oldest deadline 2024-09-21T01:53:50.345230+0000) 2024-09-21T01:53:52.464 INFO:journalctl@ceph.osd.8.smithi142.stdout:Sep 21 01:53:52 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-8[51832]: 2024-09-21T01:53:52.199+0000 7f95b1069640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:55.543069+0000 front 2024-09-21T01:52:55.543096+0000 (oldest deadline 2024-09-21T01:53:19.042967+0000) 2024-09-21T01:53:52.465 INFO:journalctl@ceph.osd.8.smithi142.stdout:Sep 21 01:53:52 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-8[51832]: 2024-09-21T01:53:52.199+0000 7f95b1069640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:09.545158+0000 front 2024-09-21T01:53:09.545113+0000 (oldest deadline 2024-09-21T01:53:33.645207+0000) 2024-09-21T01:53:52.465 INFO:journalctl@ceph.osd.8.smithi142.stdout:Sep 21 01:53:52 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-8[51832]: 2024-09-21T01:53:52.199+0000 7f95b1069640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.83:6814 osd.3 since back 2024-09-21T01:53:20.447752+0000 front 2024-09-21T01:53:20.447618+0000 (oldest deadline 2024-09-21T01:53:42.747672+0000) 2024-09-21T01:53:52.804 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:53:52 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:53:52.429+0000 7fc210836640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:56.783488+0000 front 2024-09-21T01:52:56.783513+0000 (oldest deadline 2024-09-21T01:53:21.483559+0000) 2024-09-21T01:53:52.804 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:53:52 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:53:52.429+0000 7fc210836640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:01.484146+0000 front 2024-09-21T01:53:01.484128+0000 (oldest deadline 2024-09-21T01:53:27.384161+0000) 2024-09-21T01:53:52.804 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:53:52 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:53:52.429+0000 7fc210836640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:10.786106+0000 front 2024-09-21T01:53:10.786293+0000 (oldest deadline 2024-09-21T01:53:36.086126+0000) 2024-09-21T01:53:52.804 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:53:52 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:53:52.429+0000 7fc210836640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.83:6814 osd.3 since back 2024-09-21T01:53:20.588096+0000 front 2024-09-21T01:53:20.588133+0000 (oldest deadline 2024-09-21T01:53:46.488248+0000) 2024-09-21T01:53:52.804 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:53:52 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:53:52.429+0000 7fc210836640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T01:53:26.488804+0000 front 2024-09-21T01:53:26.488731+0000 (oldest deadline 2024-09-21T01:53:49.388741+0000) 2024-09-21T01:53:53.214 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:53:52 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:53:52.937+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:55.996660+0000 front 2024-09-21T01:52:55.996645+0000 (oldest deadline 2024-09-21T01:53:21.296531+0000) 2024-09-21T01:53:53.215 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:53:52 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:53:52.937+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:03.597995+0000 front 2024-09-21T01:53:03.598011+0000 (oldest deadline 2024-09-21T01:53:28.297678+0000) 2024-09-21T01:53:53.215 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:53:52 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:53:52.937+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:09.398667+0000 front 2024-09-21T01:53:09.398643+0000 (oldest deadline 2024-09-21T01:53:34.698854+0000) 2024-09-21T01:53:53.215 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:53:52 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:53:52.937+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T01:53:26.400794+0000 front 2024-09-21T01:53:26.400993+0000 (oldest deadline 2024-09-21T01:53:51.100678+0000) 2024-09-21T01:53:53.218 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:53:52 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:53:52.793+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:52.739060+0000 front 2024-09-21T01:52:52.738919+0000 (oldest deadline 2024-09-21T01:53:18.038843+0000) 2024-09-21T01:53:53.218 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:53:52 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:53:52.793+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:03.740740+0000 front 2024-09-21T01:53:03.740797+0000 (oldest deadline 2024-09-21T01:53:26.040830+0000) 2024-09-21T01:53:53.218 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:53:52 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:53:52.793+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:10.642164+0000 front 2024-09-21T01:53:10.642202+0000 (oldest deadline 2024-09-21T01:53:35.342361+0000) 2024-09-21T01:53:53.218 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:53:52 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:53:52.793+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.83:6814 osd.3 since back 2024-09-21T01:53:20.043206+0000 front 2024-09-21T01:53:20.043253+0000 (oldest deadline 2024-09-21T01:53:41.643680+0000) 2024-09-21T01:53:53.218 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:53:52 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:53:52.793+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T01:53:27.445169+0000 front 2024-09-21T01:53:27.445227+0000 (oldest deadline 2024-09-21T01:53:50.345230+0000) 2024-09-21T01:53:53.634 INFO:journalctl@ceph.osd.7.smithi119.stdout:Sep 21 01:53:53 smithi119 podman[66772]: 2024-09-21 01:53:53.337044755 +0000 UTC m=+5.784106536 container died dd93db1d3dd9a380d39ec08b08108140b27c5f433f09e2ace7df8291d71fdc22 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-7, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-21T01:53:53.714 INFO:journalctl@ceph.osd.8.smithi142.stdout:Sep 21 01:53:53 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-8[51832]: 2024-09-21T01:53:53.222+0000 7f95b1069640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:55.543069+0000 front 2024-09-21T01:52:55.543096+0000 (oldest deadline 2024-09-21T01:53:19.042967+0000) 2024-09-21T01:53:53.715 INFO:journalctl@ceph.osd.8.smithi142.stdout:Sep 21 01:53:53 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-8[51832]: 2024-09-21T01:53:53.222+0000 7f95b1069640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:09.545158+0000 front 2024-09-21T01:53:09.545113+0000 (oldest deadline 2024-09-21T01:53:33.645207+0000) 2024-09-21T01:53:53.715 INFO:journalctl@ceph.osd.8.smithi142.stdout:Sep 21 01:53:53 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-8[51832]: 2024-09-21T01:53:53.222+0000 7f95b1069640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.83:6814 osd.3 since back 2024-09-21T01:53:20.447752+0000 front 2024-09-21T01:53:20.447618+0000 (oldest deadline 2024-09-21T01:53:42.747672+0000) 2024-09-21T01:53:53.804 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:53:53 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:53:53.429+0000 7fc210836640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:56.783488+0000 front 2024-09-21T01:52:56.783513+0000 (oldest deadline 2024-09-21T01:53:21.483559+0000) 2024-09-21T01:53:53.804 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:53:53 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:53:53.429+0000 7fc210836640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:01.484146+0000 front 2024-09-21T01:53:01.484128+0000 (oldest deadline 2024-09-21T01:53:27.384161+0000) 2024-09-21T01:53:53.804 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:53:53 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:53:53.429+0000 7fc210836640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:10.786106+0000 front 2024-09-21T01:53:10.786293+0000 (oldest deadline 2024-09-21T01:53:36.086126+0000) 2024-09-21T01:53:53.804 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:53:53 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:53:53.429+0000 7fc210836640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.83:6814 osd.3 since back 2024-09-21T01:53:20.588096+0000 front 2024-09-21T01:53:20.588133+0000 (oldest deadline 2024-09-21T01:53:46.488248+0000) 2024-09-21T01:53:53.804 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:53:53 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:53:53.429+0000 7fc210836640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T01:53:26.488804+0000 front 2024-09-21T01:53:26.488731+0000 (oldest deadline 2024-09-21T01:53:49.388741+0000) 2024-09-21T01:53:53.902 INFO:journalctl@ceph.osd.7.smithi119.stdout:Sep 21 01:53:53 smithi119 podman[66772]: 2024-09-21 01:53:53.634332032 +0000 UTC m=+6.081393797 container cleanup dd93db1d3dd9a380d39ec08b08108140b27c5f433f09e2ace7df8291d71fdc22 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-7, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-09-21T01:53:53.902 INFO:journalctl@ceph.osd.7.smithi119.stdout:Sep 21 01:53:53 smithi119 bash[66772]: ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-7 2024-09-21T01:53:53.903 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:53:53 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:53:53.747+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:52.739060+0000 front 2024-09-21T01:52:52.738919+0000 (oldest deadline 2024-09-21T01:53:18.038843+0000) 2024-09-21T01:53:53.903 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:53:53 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:53:53.747+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:03.740740+0000 front 2024-09-21T01:53:03.740797+0000 (oldest deadline 2024-09-21T01:53:26.040830+0000) 2024-09-21T01:53:53.903 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:53:53 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:53:53.747+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:10.642164+0000 front 2024-09-21T01:53:10.642202+0000 (oldest deadline 2024-09-21T01:53:35.342361+0000) 2024-09-21T01:53:53.903 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:53:53 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:53:53.747+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.83:6814 osd.3 since back 2024-09-21T01:53:20.043206+0000 front 2024-09-21T01:53:20.043253+0000 (oldest deadline 2024-09-21T01:53:41.643680+0000) 2024-09-21T01:53:53.903 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:53:53 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:53:53.747+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T01:53:27.445169+0000 front 2024-09-21T01:53:27.445227+0000 (oldest deadline 2024-09-21T01:53:50.345230+0000) 2024-09-21T01:53:54.217 INFO:journalctl@ceph.osd.7.smithi119.stdout:Sep 21 01:53:53 smithi119 podman[66788]: 2024-09-21 01:53:53.902460793 +0000 UTC m=+0.565971745 container remove dd93db1d3dd9a380d39ec08b08108140b27c5f433f09e2ace7df8291d71fdc22 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-7, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2) 2024-09-21T01:53:54.255 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:53:53 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:53:53.981+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:55.996660+0000 front 2024-09-21T01:52:55.996645+0000 (oldest deadline 2024-09-21T01:53:21.296531+0000) 2024-09-21T01:53:54.255 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:53:53 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:53:53.981+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:03.597995+0000 front 2024-09-21T01:53:03.598011+0000 (oldest deadline 2024-09-21T01:53:28.297678+0000) 2024-09-21T01:53:54.255 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:53:53 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:53:53.981+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:09.398667+0000 front 2024-09-21T01:53:09.398643+0000 (oldest deadline 2024-09-21T01:53:34.698854+0000) 2024-09-21T01:53:54.255 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:53:53 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:53:53.981+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T01:53:26.400794+0000 front 2024-09-21T01:53:26.400993+0000 (oldest deadline 2024-09-21T01:53:51.100678+0000) 2024-09-21T01:53:54.589 INFO:journalctl@ceph.osd.7.smithi119.stdout:Sep 21 01:53:54 smithi119 podman[66872]: 2024-09-21 01:53:54.156880803 +0000 UTC m=+0.015929126 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T01:53:54.589 INFO:journalctl@ceph.osd.7.smithi119.stdout:Sep 21 01:53:54 smithi119 podman[66872]: 2024-09-21 01:53:54.270139849 +0000 UTC m=+0.129188200 container create 13bd40f1f6969214ba833f2a12965ddad5bc504d47901199da92f183297cb570 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-7-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-09-21T01:53:54.589 INFO:journalctl@ceph.osd.7.smithi119.stdout:Sep 21 01:53:54 smithi119 podman[66872]: 2024-09-21 01:53:54.49766046 +0000 UTC m=+0.356708769 container init 13bd40f1f6969214ba833f2a12965ddad5bc504d47901199da92f183297cb570 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-7-deactivate, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-09-21T01:53:54.589 INFO:journalctl@ceph.osd.7.smithi119.stdout:Sep 21 01:53:54 smithi119 podman[66872]: 2024-09-21 01:53:54.500799447 +0000 UTC m=+0.359847766 container start 13bd40f1f6969214ba833f2a12965ddad5bc504d47901199da92f183297cb570 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-7-deactivate, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T01:53:54.589 INFO:journalctl@ceph.osd.7.smithi119.stdout:Sep 21 01:53:54 smithi119 podman[66872]: 2024-09-21 01:53:54.589435279 +0000 UTC m=+0.448483603 container attach 13bd40f1f6969214ba833f2a12965ddad5bc504d47901199da92f183297cb570 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-7-deactivate, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_CLEAN=True) 2024-09-21T01:53:54.715 INFO:journalctl@ceph.osd.8.smithi142.stdout:Sep 21 01:53:54 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-8[51832]: 2024-09-21T01:53:54.255+0000 7f95b1069640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:55.543069+0000 front 2024-09-21T01:52:55.543096+0000 (oldest deadline 2024-09-21T01:53:19.042967+0000) 2024-09-21T01:53:54.715 INFO:journalctl@ceph.osd.8.smithi142.stdout:Sep 21 01:53:54 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-8[51832]: 2024-09-21T01:53:54.255+0000 7f95b1069640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:09.545158+0000 front 2024-09-21T01:53:09.545113+0000 (oldest deadline 2024-09-21T01:53:33.645207+0000) 2024-09-21T01:53:54.715 INFO:journalctl@ceph.osd.8.smithi142.stdout:Sep 21 01:53:54 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-8[51832]: 2024-09-21T01:53:54.255+0000 7f95b1069640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.83:6814 osd.3 since back 2024-09-21T01:53:20.447752+0000 front 2024-09-21T01:53:20.447618+0000 (oldest deadline 2024-09-21T01:53:42.747672+0000) 2024-09-21T01:53:54.803 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:53:54 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:53:54.397+0000 7fc210836640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:56.783488+0000 front 2024-09-21T01:52:56.783513+0000 (oldest deadline 2024-09-21T01:53:21.483559+0000) 2024-09-21T01:53:54.804 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:53:54 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:53:54.397+0000 7fc210836640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:01.484146+0000 front 2024-09-21T01:53:01.484128+0000 (oldest deadline 2024-09-21T01:53:27.384161+0000) 2024-09-21T01:53:54.804 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:53:54 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:53:54.397+0000 7fc210836640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:10.786106+0000 front 2024-09-21T01:53:10.786293+0000 (oldest deadline 2024-09-21T01:53:36.086126+0000) 2024-09-21T01:53:54.804 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:53:54 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:53:54.397+0000 7fc210836640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.83:6814 osd.3 since back 2024-09-21T01:53:20.588096+0000 front 2024-09-21T01:53:20.588133+0000 (oldest deadline 2024-09-21T01:53:46.488248+0000) 2024-09-21T01:53:54.804 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:53:54 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:53:54.397+0000 7fc210836640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T01:53:26.488804+0000 front 2024-09-21T01:53:26.488731+0000 (oldest deadline 2024-09-21T01:53:49.388741+0000) 2024-09-21T01:53:54.968 INFO:journalctl@ceph.osd.7.smithi119.stdout:Sep 21 01:53:54 smithi119 podman[66872]: 2024-09-21 01:53:54.692222935 +0000 UTC m=+0.551271256 container died 13bd40f1f6969214ba833f2a12965ddad5bc504d47901199da92f183297cb570 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-7-deactivate, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T01:53:54.968 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:53:54 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:53:54.768+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:52.739060+0000 front 2024-09-21T01:52:52.738919+0000 (oldest deadline 2024-09-21T01:53:18.038843+0000) 2024-09-21T01:53:54.968 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:53:54 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:53:54.768+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:03.740740+0000 front 2024-09-21T01:53:03.740797+0000 (oldest deadline 2024-09-21T01:53:26.040830+0000) 2024-09-21T01:53:54.968 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:53:54 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:53:54.768+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:10.642164+0000 front 2024-09-21T01:53:10.642202+0000 (oldest deadline 2024-09-21T01:53:35.342361+0000) 2024-09-21T01:53:54.968 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:53:54 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:53:54.768+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.83:6814 osd.3 since back 2024-09-21T01:53:20.043206+0000 front 2024-09-21T01:53:20.043253+0000 (oldest deadline 2024-09-21T01:53:41.643680+0000) 2024-09-21T01:53:54.968 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:53:54 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:53:54.768+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T01:53:27.445169+0000 front 2024-09-21T01:53:27.445227+0000 (oldest deadline 2024-09-21T01:53:50.345230+0000) 2024-09-21T01:53:55.389 DEBUG:teuthology.orchestra.run.smithi119:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f7697ecc-77b8-11ef-baf5-efdc52797490@osd.7.service' 2024-09-21T01:53:55.427 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T01:53:55.427 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-09-21T01:53:55.428 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-09-21T01:53:55.428 DEBUG:teuthology.orchestra.run.smithi142:> sudo systemctl stop ceph-f7697ecc-77b8-11ef-baf5-efdc52797490@osd.8 2024-09-21T01:53:55.455 INFO:journalctl@ceph.osd.8.smithi142.stdout:Sep 21 01:53:55 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-8[51832]: 2024-09-21T01:53:55.232+0000 7f95b1069640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:55.543069+0000 front 2024-09-21T01:52:55.543096+0000 (oldest deadline 2024-09-21T01:53:19.042967+0000) 2024-09-21T01:53:55.455 INFO:journalctl@ceph.osd.8.smithi142.stdout:Sep 21 01:53:55 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-8[51832]: 2024-09-21T01:53:55.232+0000 7f95b1069640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:09.545158+0000 front 2024-09-21T01:53:09.545113+0000 (oldest deadline 2024-09-21T01:53:33.645207+0000) 2024-09-21T01:53:55.455 INFO:journalctl@ceph.osd.8.smithi142.stdout:Sep 21 01:53:55 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-8[51832]: 2024-09-21T01:53:55.232+0000 7f95b1069640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.83:6814 osd.3 since back 2024-09-21T01:53:20.447752+0000 front 2024-09-21T01:53:20.447618+0000 (oldest deadline 2024-09-21T01:53:42.747672+0000) 2024-09-21T01:53:55.455 INFO:journalctl@ceph.osd.8.smithi142.stdout:Sep 21 01:53:55 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-8[51832]: 2024-09-21T01:53:55.232+0000 7f95b1069640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T01:53:28.449794+0000 front 2024-09-21T01:53:28.449935+0000 (oldest deadline 2024-09-21T01:53:54.349645+0000) 2024-09-21T01:53:55.455 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:53:55 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:53:55.020+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:55.996660+0000 front 2024-09-21T01:52:55.996645+0000 (oldest deadline 2024-09-21T01:53:21.296531+0000) 2024-09-21T01:53:55.455 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:53:55 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:53:55.020+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:03.597995+0000 front 2024-09-21T01:53:03.598011+0000 (oldest deadline 2024-09-21T01:53:28.297678+0000) 2024-09-21T01:53:55.455 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:53:55 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:53:55.020+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:09.398667+0000 front 2024-09-21T01:53:09.398643+0000 (oldest deadline 2024-09-21T01:53:34.698854+0000) 2024-09-21T01:53:55.455 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:53:55 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:53:55.020+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T01:53:26.400794+0000 front 2024-09-21T01:53:26.400993+0000 (oldest deadline 2024-09-21T01:53:51.100678+0000) 2024-09-21T01:53:55.714 INFO:journalctl@ceph.osd.8.smithi142.stdout:Sep 21 01:53:55 smithi142 systemd[1]: Stopping Ceph osd.8 for f7697ecc-77b8-11ef-baf5-efdc52797490... 2024-09-21T01:53:55.803 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:53:55 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:53:55.400+0000 7fc210836640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:56.783488+0000 front 2024-09-21T01:52:56.783513+0000 (oldest deadline 2024-09-21T01:53:21.483559+0000) 2024-09-21T01:53:55.804 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:53:55 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:53:55.400+0000 7fc210836640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:01.484146+0000 front 2024-09-21T01:53:01.484128+0000 (oldest deadline 2024-09-21T01:53:27.384161+0000) 2024-09-21T01:53:55.804 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:53:55 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:53:55.400+0000 7fc210836640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:10.786106+0000 front 2024-09-21T01:53:10.786293+0000 (oldest deadline 2024-09-21T01:53:36.086126+0000) 2024-09-21T01:53:55.804 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:53:55 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:53:55.400+0000 7fc210836640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.83:6814 osd.3 since back 2024-09-21T01:53:20.588096+0000 front 2024-09-21T01:53:20.588133+0000 (oldest deadline 2024-09-21T01:53:46.488248+0000) 2024-09-21T01:53:55.804 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:53:55 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:53:55.400+0000 7fc210836640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T01:53:26.488804+0000 front 2024-09-21T01:53:26.488731+0000 (oldest deadline 2024-09-21T01:53:49.388741+0000) 2024-09-21T01:53:55.967 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:53:55 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:53:55.800+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:52.739060+0000 front 2024-09-21T01:52:52.738919+0000 (oldest deadline 2024-09-21T01:53:18.038843+0000) 2024-09-21T01:53:55.968 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:53:55 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:53:55.800+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:03.740740+0000 front 2024-09-21T01:53:03.740797+0000 (oldest deadline 2024-09-21T01:53:26.040830+0000) 2024-09-21T01:53:55.968 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:53:55 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:53:55.800+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:10.642164+0000 front 2024-09-21T01:53:10.642202+0000 (oldest deadline 2024-09-21T01:53:35.342361+0000) 2024-09-21T01:53:55.968 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:53:55 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:53:55.800+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.83:6814 osd.3 since back 2024-09-21T01:53:20.043206+0000 front 2024-09-21T01:53:20.043253+0000 (oldest deadline 2024-09-21T01:53:41.643680+0000) 2024-09-21T01:53:55.968 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:53:55 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:53:55.800+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T01:53:27.445169+0000 front 2024-09-21T01:53:27.445227+0000 (oldest deadline 2024-09-21T01:53:50.345230+0000) 2024-09-21T01:53:55.996 INFO:journalctl@ceph.osd.8.smithi142.stdout:Sep 21 01:53:55 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-8[51832]: 2024-09-21T01:53:55.736+0000 7f95b4a7e640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T01:53:55.997 INFO:journalctl@ceph.osd.8.smithi142.stdout:Sep 21 01:53:55 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-8[51832]: 2024-09-21T01:53:55.736+0000 7f95b4a7e640 -1 osd.8 98 *** Got signal Terminated *** 2024-09-21T01:53:55.997 INFO:journalctl@ceph.osd.8.smithi142.stdout:Sep 21 01:53:55 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-8[51832]: 2024-09-21T01:53:55.736+0000 7f95b4a7e640 -1 osd.8 98 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T01:53:56.465 INFO:journalctl@ceph.osd.8.smithi142.stdout:Sep 21 01:53:56 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-8[51832]: 2024-09-21T01:53:56.211+0000 7f95b1069640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:55.543069+0000 front 2024-09-21T01:52:55.543096+0000 (oldest deadline 2024-09-21T01:53:19.042967+0000) 2024-09-21T01:53:56.466 INFO:journalctl@ceph.osd.8.smithi142.stdout:Sep 21 01:53:56 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-8[51832]: 2024-09-21T01:53:56.211+0000 7f95b1069640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:09.545158+0000 front 2024-09-21T01:53:09.545113+0000 (oldest deadline 2024-09-21T01:53:33.645207+0000) 2024-09-21T01:53:56.466 INFO:journalctl@ceph.osd.8.smithi142.stdout:Sep 21 01:53:56 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-8[51832]: 2024-09-21T01:53:56.211+0000 7f95b1069640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.83:6814 osd.3 since back 2024-09-21T01:53:20.447752+0000 front 2024-09-21T01:53:20.447618+0000 (oldest deadline 2024-09-21T01:53:42.747672+0000) 2024-09-21T01:53:56.466 INFO:journalctl@ceph.osd.8.smithi142.stdout:Sep 21 01:53:56 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-8[51832]: 2024-09-21T01:53:56.211+0000 7f95b1069640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T01:53:28.449794+0000 front 2024-09-21T01:53:28.449935+0000 (oldest deadline 2024-09-21T01:53:54.349645+0000) 2024-09-21T01:53:56.466 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:53:55 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:53:55.996+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:55.996660+0000 front 2024-09-21T01:52:55.996645+0000 (oldest deadline 2024-09-21T01:53:21.296531+0000) 2024-09-21T01:53:56.466 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:53:55 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:53:55.996+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:03.597995+0000 front 2024-09-21T01:53:03.598011+0000 (oldest deadline 2024-09-21T01:53:28.297678+0000) 2024-09-21T01:53:56.466 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:53:55 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:53:55.996+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:09.398667+0000 front 2024-09-21T01:53:09.398643+0000 (oldest deadline 2024-09-21T01:53:34.698854+0000) 2024-09-21T01:53:56.466 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:53:55 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:53:55.996+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T01:53:26.400794+0000 front 2024-09-21T01:53:26.400993+0000 (oldest deadline 2024-09-21T01:53:51.100678+0000) 2024-09-21T01:53:56.803 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:53:56 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:53:56.451+0000 7fc210836640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:56.783488+0000 front 2024-09-21T01:52:56.783513+0000 (oldest deadline 2024-09-21T01:53:21.483559+0000) 2024-09-21T01:53:56.804 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:53:56 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:53:56.451+0000 7fc210836640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:01.484146+0000 front 2024-09-21T01:53:01.484128+0000 (oldest deadline 2024-09-21T01:53:27.384161+0000) 2024-09-21T01:53:56.804 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:53:56 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:53:56.451+0000 7fc210836640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:10.786106+0000 front 2024-09-21T01:53:10.786293+0000 (oldest deadline 2024-09-21T01:53:36.086126+0000) 2024-09-21T01:53:56.804 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:53:56 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:53:56.451+0000 7fc210836640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.83:6814 osd.3 since back 2024-09-21T01:53:20.588096+0000 front 2024-09-21T01:53:20.588133+0000 (oldest deadline 2024-09-21T01:53:46.488248+0000) 2024-09-21T01:53:56.804 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:53:56 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:53:56.451+0000 7fc210836640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T01:53:26.488804+0000 front 2024-09-21T01:53:26.488731+0000 (oldest deadline 2024-09-21T01:53:49.388741+0000) 2024-09-21T01:53:56.968 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:53:56 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:53:56.793+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:52.739060+0000 front 2024-09-21T01:52:52.738919+0000 (oldest deadline 2024-09-21T01:53:18.038843+0000) 2024-09-21T01:53:56.968 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:53:56 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:53:56.793+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:03.740740+0000 front 2024-09-21T01:53:03.740797+0000 (oldest deadline 2024-09-21T01:53:26.040830+0000) 2024-09-21T01:53:56.968 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:53:56 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:53:56.793+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:10.642164+0000 front 2024-09-21T01:53:10.642202+0000 (oldest deadline 2024-09-21T01:53:35.342361+0000) 2024-09-21T01:53:56.968 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:53:56 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:53:56.793+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.83:6814 osd.3 since back 2024-09-21T01:53:20.043206+0000 front 2024-09-21T01:53:20.043253+0000 (oldest deadline 2024-09-21T01:53:41.643680+0000) 2024-09-21T01:53:56.968 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:53:56 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:53:56.793+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T01:53:27.445169+0000 front 2024-09-21T01:53:27.445227+0000 (oldest deadline 2024-09-21T01:53:50.345230+0000) 2024-09-21T01:53:57.464 INFO:journalctl@ceph.osd.8.smithi142.stdout:Sep 21 01:53:57 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-8[51832]: 2024-09-21T01:53:57.203+0000 7f95b1069640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:55.543069+0000 front 2024-09-21T01:52:55.543096+0000 (oldest deadline 2024-09-21T01:53:19.042967+0000) 2024-09-21T01:53:57.464 INFO:journalctl@ceph.osd.8.smithi142.stdout:Sep 21 01:53:57 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-8[51832]: 2024-09-21T01:53:57.203+0000 7f95b1069640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:09.545158+0000 front 2024-09-21T01:53:09.545113+0000 (oldest deadline 2024-09-21T01:53:33.645207+0000) 2024-09-21T01:53:57.465 INFO:journalctl@ceph.osd.8.smithi142.stdout:Sep 21 01:53:57 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-8[51832]: 2024-09-21T01:53:57.203+0000 7f95b1069640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.83:6814 osd.3 since back 2024-09-21T01:53:20.447752+0000 front 2024-09-21T01:53:20.447618+0000 (oldest deadline 2024-09-21T01:53:42.747672+0000) 2024-09-21T01:53:57.465 INFO:journalctl@ceph.osd.8.smithi142.stdout:Sep 21 01:53:57 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-8[51832]: 2024-09-21T01:53:57.203+0000 7f95b1069640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T01:53:28.449794+0000 front 2024-09-21T01:53:28.449935+0000 (oldest deadline 2024-09-21T01:53:54.349645+0000) 2024-09-21T01:53:57.465 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:53:57 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:53:57.005+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:55.996660+0000 front 2024-09-21T01:52:55.996645+0000 (oldest deadline 2024-09-21T01:53:21.296531+0000) 2024-09-21T01:53:57.465 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:53:57 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:53:57.005+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:03.597995+0000 front 2024-09-21T01:53:03.598011+0000 (oldest deadline 2024-09-21T01:53:28.297678+0000) 2024-09-21T01:53:57.465 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:53:57 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:53:57.005+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:09.398667+0000 front 2024-09-21T01:53:09.398643+0000 (oldest deadline 2024-09-21T01:53:34.698854+0000) 2024-09-21T01:53:57.465 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:53:57 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:53:57.005+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T01:53:26.400794+0000 front 2024-09-21T01:53:26.400993+0000 (oldest deadline 2024-09-21T01:53:51.100678+0000) 2024-09-21T01:53:57.803 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:53:57 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:53:57.461+0000 7fc210836640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:56.783488+0000 front 2024-09-21T01:52:56.783513+0000 (oldest deadline 2024-09-21T01:53:21.483559+0000) 2024-09-21T01:53:57.804 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:53:57 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:53:57.461+0000 7fc210836640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:01.484146+0000 front 2024-09-21T01:53:01.484128+0000 (oldest deadline 2024-09-21T01:53:27.384161+0000) 2024-09-21T01:53:57.804 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:53:57 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:53:57.461+0000 7fc210836640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:10.786106+0000 front 2024-09-21T01:53:10.786293+0000 (oldest deadline 2024-09-21T01:53:36.086126+0000) 2024-09-21T01:53:57.804 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:53:57 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:53:57.461+0000 7fc210836640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.83:6814 osd.3 since back 2024-09-21T01:53:20.588096+0000 front 2024-09-21T01:53:20.588133+0000 (oldest deadline 2024-09-21T01:53:46.488248+0000) 2024-09-21T01:53:57.804 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:53:57 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:53:57.461+0000 7fc210836640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T01:53:26.488804+0000 front 2024-09-21T01:53:26.488731+0000 (oldest deadline 2024-09-21T01:53:49.388741+0000) 2024-09-21T01:53:58.215 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:53:57 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:53:57.957+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:55.996660+0000 front 2024-09-21T01:52:55.996645+0000 (oldest deadline 2024-09-21T01:53:21.296531+0000) 2024-09-21T01:53:58.215 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:53:57 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:53:57.957+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:03.597995+0000 front 2024-09-21T01:53:03.598011+0000 (oldest deadline 2024-09-21T01:53:28.297678+0000) 2024-09-21T01:53:58.215 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:53:57 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:53:57.957+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:09.398667+0000 front 2024-09-21T01:53:09.398643+0000 (oldest deadline 2024-09-21T01:53:34.698854+0000) 2024-09-21T01:53:58.215 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:53:57 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:53:57.957+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T01:53:26.400794+0000 front 2024-09-21T01:53:26.400993+0000 (oldest deadline 2024-09-21T01:53:51.100678+0000) 2024-09-21T01:53:58.217 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:53:57 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:53:57.804+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:52.739060+0000 front 2024-09-21T01:52:52.738919+0000 (oldest deadline 2024-09-21T01:53:18.038843+0000) 2024-09-21T01:53:58.217 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:53:57 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:53:57.804+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:03.740740+0000 front 2024-09-21T01:53:03.740797+0000 (oldest deadline 2024-09-21T01:53:26.040830+0000) 2024-09-21T01:53:58.218 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:53:57 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:53:57.804+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:10.642164+0000 front 2024-09-21T01:53:10.642202+0000 (oldest deadline 2024-09-21T01:53:35.342361+0000) 2024-09-21T01:53:58.218 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:53:57 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:53:57.804+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.83:6814 osd.3 since back 2024-09-21T01:53:20.043206+0000 front 2024-09-21T01:53:20.043253+0000 (oldest deadline 2024-09-21T01:53:41.643680+0000) 2024-09-21T01:53:58.218 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:53:57 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:53:57.804+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T01:53:27.445169+0000 front 2024-09-21T01:53:27.445227+0000 (oldest deadline 2024-09-21T01:53:50.345230+0000) 2024-09-21T01:53:58.218 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:53:57 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:53:57.804+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.142:6812 osd.5 since back 2024-09-21T01:53:31.446412+0000 front 2024-09-21T01:53:31.446298+0000 (oldest deadline 2024-09-21T01:53:57.346061+0000) 2024-09-21T01:53:58.714 INFO:journalctl@ceph.osd.8.smithi142.stdout:Sep 21 01:53:58 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-8[51832]: 2024-09-21T01:53:58.245+0000 7f95b1069640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:55.543069+0000 front 2024-09-21T01:52:55.543096+0000 (oldest deadline 2024-09-21T01:53:19.042967+0000) 2024-09-21T01:53:58.714 INFO:journalctl@ceph.osd.8.smithi142.stdout:Sep 21 01:53:58 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-8[51832]: 2024-09-21T01:53:58.245+0000 7f95b1069640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:09.545158+0000 front 2024-09-21T01:53:09.545113+0000 (oldest deadline 2024-09-21T01:53:33.645207+0000) 2024-09-21T01:53:58.715 INFO:journalctl@ceph.osd.8.smithi142.stdout:Sep 21 01:53:58 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-8[51832]: 2024-09-21T01:53:58.245+0000 7f95b1069640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.83:6814 osd.3 since back 2024-09-21T01:53:20.447752+0000 front 2024-09-21T01:53:20.447618+0000 (oldest deadline 2024-09-21T01:53:42.747672+0000) 2024-09-21T01:53:58.715 INFO:journalctl@ceph.osd.8.smithi142.stdout:Sep 21 01:53:58 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-8[51832]: 2024-09-21T01:53:58.245+0000 7f95b1069640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T01:53:28.449794+0000 front 2024-09-21T01:53:28.449935+0000 (oldest deadline 2024-09-21T01:53:54.349645+0000) 2024-09-21T01:53:58.803 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:53:58 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:53:58.449+0000 7fc210836640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:56.783488+0000 front 2024-09-21T01:52:56.783513+0000 (oldest deadline 2024-09-21T01:53:21.483559+0000) 2024-09-21T01:53:58.804 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:53:58 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:53:58.449+0000 7fc210836640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:01.484146+0000 front 2024-09-21T01:53:01.484128+0000 (oldest deadline 2024-09-21T01:53:27.384161+0000) 2024-09-21T01:53:58.804 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:53:58 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:53:58.449+0000 7fc210836640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:10.786106+0000 front 2024-09-21T01:53:10.786293+0000 (oldest deadline 2024-09-21T01:53:36.086126+0000) 2024-09-21T01:53:58.804 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:53:58 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:53:58.449+0000 7fc210836640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.83:6814 osd.3 since back 2024-09-21T01:53:20.588096+0000 front 2024-09-21T01:53:20.588133+0000 (oldest deadline 2024-09-21T01:53:46.488248+0000) 2024-09-21T01:53:58.804 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:53:58 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:53:58.449+0000 7fc210836640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T01:53:26.488804+0000 front 2024-09-21T01:53:26.488731+0000 (oldest deadline 2024-09-21T01:53:49.388741+0000) 2024-09-21T01:53:59.217 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:53:58 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:53:58.775+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:52.739060+0000 front 2024-09-21T01:52:52.738919+0000 (oldest deadline 2024-09-21T01:53:18.038843+0000) 2024-09-21T01:53:59.218 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:53:58 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:53:58.775+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:03.740740+0000 front 2024-09-21T01:53:03.740797+0000 (oldest deadline 2024-09-21T01:53:26.040830+0000) 2024-09-21T01:53:59.218 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:53:58 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:53:58.775+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:10.642164+0000 front 2024-09-21T01:53:10.642202+0000 (oldest deadline 2024-09-21T01:53:35.342361+0000) 2024-09-21T01:53:59.218 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:53:58 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:53:58.775+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.83:6814 osd.3 since back 2024-09-21T01:53:20.043206+0000 front 2024-09-21T01:53:20.043253+0000 (oldest deadline 2024-09-21T01:53:41.643680+0000) 2024-09-21T01:53:59.218 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:53:58 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:53:58.775+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T01:53:27.445169+0000 front 2024-09-21T01:53:27.445227+0000 (oldest deadline 2024-09-21T01:53:50.345230+0000) 2024-09-21T01:53:59.218 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:53:58 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:53:58.775+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.142:6812 osd.5 since back 2024-09-21T01:53:31.446412+0000 front 2024-09-21T01:53:31.446298+0000 (oldest deadline 2024-09-21T01:53:57.346061+0000) 2024-09-21T01:53:59.265 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:53:59 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:53:59.000+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:55.996660+0000 front 2024-09-21T01:52:55.996645+0000 (oldest deadline 2024-09-21T01:53:21.296531+0000) 2024-09-21T01:53:59.265 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:53:59 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:53:59.000+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:03.597995+0000 front 2024-09-21T01:53:03.598011+0000 (oldest deadline 2024-09-21T01:53:28.297678+0000) 2024-09-21T01:53:59.265 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:53:59 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:53:59.000+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:09.398667+0000 front 2024-09-21T01:53:09.398643+0000 (oldest deadline 2024-09-21T01:53:34.698854+0000) 2024-09-21T01:53:59.265 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:53:59 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:53:59.000+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T01:53:26.400794+0000 front 2024-09-21T01:53:26.400993+0000 (oldest deadline 2024-09-21T01:53:51.100678+0000) 2024-09-21T01:53:59.265 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:53:59 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:53:59.000+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.142:6812 osd.5 since back 2024-09-21T01:53:34.601722+0000 front 2024-09-21T01:53:34.601778+0000 (oldest deadline 2024-09-21T01:53:58.101809+0000) 2024-09-21T01:53:59.714 INFO:journalctl@ceph.osd.8.smithi142.stdout:Sep 21 01:53:59 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-8[51832]: 2024-09-21T01:53:59.264+0000 7f95b1069640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:55.543069+0000 front 2024-09-21T01:52:55.543096+0000 (oldest deadline 2024-09-21T01:53:19.042967+0000) 2024-09-21T01:53:59.715 INFO:journalctl@ceph.osd.8.smithi142.stdout:Sep 21 01:53:59 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-8[51832]: 2024-09-21T01:53:59.264+0000 7f95b1069640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:09.545158+0000 front 2024-09-21T01:53:09.545113+0000 (oldest deadline 2024-09-21T01:53:33.645207+0000) 2024-09-21T01:53:59.715 INFO:journalctl@ceph.osd.8.smithi142.stdout:Sep 21 01:53:59 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-8[51832]: 2024-09-21T01:53:59.264+0000 7f95b1069640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.83:6814 osd.3 since back 2024-09-21T01:53:20.447752+0000 front 2024-09-21T01:53:20.447618+0000 (oldest deadline 2024-09-21T01:53:42.747672+0000) 2024-09-21T01:53:59.715 INFO:journalctl@ceph.osd.8.smithi142.stdout:Sep 21 01:53:59 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-8[51832]: 2024-09-21T01:53:59.264+0000 7f95b1069640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T01:53:28.449794+0000 front 2024-09-21T01:53:28.449935+0000 (oldest deadline 2024-09-21T01:53:54.349645+0000) 2024-09-21T01:53:59.804 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:53:59 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:53:59.428+0000 7fc210836640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:56.783488+0000 front 2024-09-21T01:52:56.783513+0000 (oldest deadline 2024-09-21T01:53:21.483559+0000) 2024-09-21T01:53:59.804 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:53:59 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:53:59.428+0000 7fc210836640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:01.484146+0000 front 2024-09-21T01:53:01.484128+0000 (oldest deadline 2024-09-21T01:53:27.384161+0000) 2024-09-21T01:53:59.804 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:53:59 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:53:59.428+0000 7fc210836640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:10.786106+0000 front 2024-09-21T01:53:10.786293+0000 (oldest deadline 2024-09-21T01:53:36.086126+0000) 2024-09-21T01:53:59.804 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:53:59 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:53:59.428+0000 7fc210836640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.83:6814 osd.3 since back 2024-09-21T01:53:20.588096+0000 front 2024-09-21T01:53:20.588133+0000 (oldest deadline 2024-09-21T01:53:46.488248+0000) 2024-09-21T01:53:59.804 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:53:59 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:53:59.428+0000 7fc210836640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T01:53:26.488804+0000 front 2024-09-21T01:53:26.488731+0000 (oldest deadline 2024-09-21T01:53:49.388741+0000) 2024-09-21T01:54:00.119 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:53:59 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:53:59.795+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:52.739060+0000 front 2024-09-21T01:52:52.738919+0000 (oldest deadline 2024-09-21T01:53:18.038843+0000) 2024-09-21T01:54:00.119 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:53:59 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:53:59.795+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:03.740740+0000 front 2024-09-21T01:53:03.740797+0000 (oldest deadline 2024-09-21T01:53:26.040830+0000) 2024-09-21T01:54:00.119 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:53:59 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:53:59.795+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:10.642164+0000 front 2024-09-21T01:53:10.642202+0000 (oldest deadline 2024-09-21T01:53:35.342361+0000) 2024-09-21T01:54:00.120 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:53:59 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:53:59.795+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.83:6814 osd.3 since back 2024-09-21T01:53:20.043206+0000 front 2024-09-21T01:53:20.043253+0000 (oldest deadline 2024-09-21T01:53:41.643680+0000) 2024-09-21T01:54:00.120 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:53:59 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:53:59.795+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T01:53:27.445169+0000 front 2024-09-21T01:53:27.445227+0000 (oldest deadline 2024-09-21T01:53:50.345230+0000) 2024-09-21T01:54:00.120 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:53:59 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:53:59.795+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.142:6812 osd.5 since back 2024-09-21T01:53:31.446412+0000 front 2024-09-21T01:53:31.446298+0000 (oldest deadline 2024-09-21T01:53:57.346061+0000) 2024-09-21T01:54:00.287 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:53:59 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:53:59.975+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:55.996660+0000 front 2024-09-21T01:52:55.996645+0000 (oldest deadline 2024-09-21T01:53:21.296531+0000) 2024-09-21T01:54:00.288 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:53:59 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:53:59.975+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:03.597995+0000 front 2024-09-21T01:53:03.598011+0000 (oldest deadline 2024-09-21T01:53:28.297678+0000) 2024-09-21T01:54:00.288 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:53:59 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:53:59.975+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:09.398667+0000 front 2024-09-21T01:53:09.398643+0000 (oldest deadline 2024-09-21T01:53:34.698854+0000) 2024-09-21T01:54:00.288 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:53:59 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:53:59.975+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T01:53:26.400794+0000 front 2024-09-21T01:53:26.400993+0000 (oldest deadline 2024-09-21T01:53:51.100678+0000) 2024-09-21T01:54:00.288 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:53:59 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:53:59.975+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.142:6812 osd.5 since back 2024-09-21T01:53:34.601722+0000 front 2024-09-21T01:53:34.601778+0000 (oldest deadline 2024-09-21T01:53:58.101809+0000) 2024-09-21T01:54:00.715 INFO:journalctl@ceph.osd.8.smithi142.stdout:Sep 21 01:54:00 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-8[51832]: 2024-09-21T01:54:00.286+0000 7f95b1069640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:55.543069+0000 front 2024-09-21T01:52:55.543096+0000 (oldest deadline 2024-09-21T01:53:19.042967+0000) 2024-09-21T01:54:00.715 INFO:journalctl@ceph.osd.8.smithi142.stdout:Sep 21 01:54:00 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-8[51832]: 2024-09-21T01:54:00.286+0000 7f95b1069640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:09.545158+0000 front 2024-09-21T01:53:09.545113+0000 (oldest deadline 2024-09-21T01:53:33.645207+0000) 2024-09-21T01:54:00.715 INFO:journalctl@ceph.osd.8.smithi142.stdout:Sep 21 01:54:00 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-8[51832]: 2024-09-21T01:54:00.286+0000 7f95b1069640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.83:6814 osd.3 since back 2024-09-21T01:53:20.447752+0000 front 2024-09-21T01:53:20.447618+0000 (oldest deadline 2024-09-21T01:53:42.747672+0000) 2024-09-21T01:54:00.715 INFO:journalctl@ceph.osd.8.smithi142.stdout:Sep 21 01:54:00 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-8[51832]: 2024-09-21T01:54:00.286+0000 7f95b1069640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T01:53:28.449794+0000 front 2024-09-21T01:53:28.449935+0000 (oldest deadline 2024-09-21T01:53:54.349645+0000) 2024-09-21T01:54:00.715 INFO:journalctl@ceph.osd.8.smithi142.stdout:Sep 21 01:54:00 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-8[51832]: 2024-09-21T01:54:00.286+0000 7f95b1069640 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.142:6812 osd.5 since back 2024-09-21T01:53:34.350101+0000 front 2024-09-21T01:53:34.350144+0000 (oldest deadline 2024-09-21T01:53:59.650194+0000) 2024-09-21T01:54:00.804 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:54:00 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:54:00.400+0000 7fc210836640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:56.783488+0000 front 2024-09-21T01:52:56.783513+0000 (oldest deadline 2024-09-21T01:53:21.483559+0000) 2024-09-21T01:54:00.804 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:54:00 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:54:00.400+0000 7fc210836640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:01.484146+0000 front 2024-09-21T01:53:01.484128+0000 (oldest deadline 2024-09-21T01:53:27.384161+0000) 2024-09-21T01:54:00.804 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:54:00 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:54:00.400+0000 7fc210836640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:10.786106+0000 front 2024-09-21T01:53:10.786293+0000 (oldest deadline 2024-09-21T01:53:36.086126+0000) 2024-09-21T01:54:00.804 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:54:00 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:54:00.400+0000 7fc210836640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.83:6814 osd.3 since back 2024-09-21T01:53:20.588096+0000 front 2024-09-21T01:53:20.588133+0000 (oldest deadline 2024-09-21T01:53:46.488248+0000) 2024-09-21T01:54:00.804 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:54:00 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:54:00.400+0000 7fc210836640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T01:53:26.488804+0000 front 2024-09-21T01:53:26.488731+0000 (oldest deadline 2024-09-21T01:53:49.388741+0000) 2024-09-21T01:54:01.215 INFO:journalctl@ceph.osd.8.smithi142.stdout:Sep 21 01:54:01 smithi142 podman[67754]: 2024-09-21 01:54:01.060417484 +0000 UTC m=+5.438577142 container died fcc540731cbc23ec1fcbf869a584d2bc3b60518aef73bb7dd41e962012c415af (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-8, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-09-21T01:54:01.215 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:54:00 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:54:00.962+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:55.996660+0000 front 2024-09-21T01:52:55.996645+0000 (oldest deadline 2024-09-21T01:53:21.296531+0000) 2024-09-21T01:54:01.215 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:54:00 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:54:00.962+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:03.597995+0000 front 2024-09-21T01:53:03.598011+0000 (oldest deadline 2024-09-21T01:53:28.297678+0000) 2024-09-21T01:54:01.215 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:54:00 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:54:00.962+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:09.398667+0000 front 2024-09-21T01:53:09.398643+0000 (oldest deadline 2024-09-21T01:53:34.698854+0000) 2024-09-21T01:54:01.215 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:54:00 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:54:00.962+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T01:53:26.400794+0000 front 2024-09-21T01:53:26.400993+0000 (oldest deadline 2024-09-21T01:53:51.100678+0000) 2024-09-21T01:54:01.215 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:54:00 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:54:00.962+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.142:6812 osd.5 since back 2024-09-21T01:53:34.601722+0000 front 2024-09-21T01:53:34.601778+0000 (oldest deadline 2024-09-21T01:53:58.101809+0000) 2024-09-21T01:54:01.218 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:54:00 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:54:00.838+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:52.739060+0000 front 2024-09-21T01:52:52.738919+0000 (oldest deadline 2024-09-21T01:53:18.038843+0000) 2024-09-21T01:54:01.218 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:54:00 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:54:00.838+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:03.740740+0000 front 2024-09-21T01:53:03.740797+0000 (oldest deadline 2024-09-21T01:53:26.040830+0000) 2024-09-21T01:54:01.218 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:54:00 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:54:00.838+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:10.642164+0000 front 2024-09-21T01:53:10.642202+0000 (oldest deadline 2024-09-21T01:53:35.342361+0000) 2024-09-21T01:54:01.218 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:54:00 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:54:00.838+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.83:6814 osd.3 since back 2024-09-21T01:53:20.043206+0000 front 2024-09-21T01:53:20.043253+0000 (oldest deadline 2024-09-21T01:53:41.643680+0000) 2024-09-21T01:54:01.218 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:54:00 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:54:00.838+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T01:53:27.445169+0000 front 2024-09-21T01:53:27.445227+0000 (oldest deadline 2024-09-21T01:53:50.345230+0000) 2024-09-21T01:54:01.218 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:54:00 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:54:00.838+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.142:6812 osd.5 since back 2024-09-21T01:53:31.446412+0000 front 2024-09-21T01:53:31.446298+0000 (oldest deadline 2024-09-21T01:53:57.346061+0000) 2024-09-21T01:54:01.680 INFO:journalctl@ceph.osd.8.smithi142.stdout:Sep 21 01:54:01 smithi142 podman[67754]: 2024-09-21 01:54:01.478255371 +0000 UTC m=+5.856415037 container cleanup fcc540731cbc23ec1fcbf869a584d2bc3b60518aef73bb7dd41e962012c415af (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-8, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T01:54:01.680 INFO:journalctl@ceph.osd.8.smithi142.stdout:Sep 21 01:54:01 smithi142 bash[67754]: ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-8 2024-09-21T01:54:01.804 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:54:01 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:54:01.357+0000 7fc210836640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:56.783488+0000 front 2024-09-21T01:52:56.783513+0000 (oldest deadline 2024-09-21T01:53:21.483559+0000) 2024-09-21T01:54:01.804 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:54:01 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:54:01.357+0000 7fc210836640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:01.484146+0000 front 2024-09-21T01:53:01.484128+0000 (oldest deadline 2024-09-21T01:53:27.384161+0000) 2024-09-21T01:54:01.804 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:54:01 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:54:01.357+0000 7fc210836640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:10.786106+0000 front 2024-09-21T01:53:10.786293+0000 (oldest deadline 2024-09-21T01:53:36.086126+0000) 2024-09-21T01:54:01.804 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:54:01 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:54:01.357+0000 7fc210836640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.83:6814 osd.3 since back 2024-09-21T01:53:20.588096+0000 front 2024-09-21T01:53:20.588133+0000 (oldest deadline 2024-09-21T01:53:46.488248+0000) 2024-09-21T01:54:01.804 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:54:01 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:54:01.357+0000 7fc210836640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T01:53:26.488804+0000 front 2024-09-21T01:53:26.488731+0000 (oldest deadline 2024-09-21T01:53:49.388741+0000) 2024-09-21T01:54:01.964 INFO:journalctl@ceph.osd.8.smithi142.stdout:Sep 21 01:54:01 smithi142 podman[67769]: 2024-09-21 01:54:01.679529142 +0000 UTC m=+0.619087466 container remove fcc540731cbc23ec1fcbf869a584d2bc3b60518aef73bb7dd41e962012c415af (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-8, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, GIT_CLEAN=True, ceph=True) 2024-09-21T01:54:02.217 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:54:01 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:54:01.822+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:52.739060+0000 front 2024-09-21T01:52:52.738919+0000 (oldest deadline 2024-09-21T01:53:18.038843+0000) 2024-09-21T01:54:02.218 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:54:01 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:54:01.822+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:03.740740+0000 front 2024-09-21T01:53:03.740797+0000 (oldest deadline 2024-09-21T01:53:26.040830+0000) 2024-09-21T01:54:02.218 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:54:01 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:54:01.822+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:10.642164+0000 front 2024-09-21T01:53:10.642202+0000 (oldest deadline 2024-09-21T01:53:35.342361+0000) 2024-09-21T01:54:02.218 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:54:01 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:54:01.822+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.83:6814 osd.3 since back 2024-09-21T01:53:20.043206+0000 front 2024-09-21T01:53:20.043253+0000 (oldest deadline 2024-09-21T01:53:41.643680+0000) 2024-09-21T01:54:02.218 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:54:01 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:54:01.822+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T01:53:27.445169+0000 front 2024-09-21T01:53:27.445227+0000 (oldest deadline 2024-09-21T01:53:50.345230+0000) 2024-09-21T01:54:02.218 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:54:01 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:54:01.822+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.142:6812 osd.5 since back 2024-09-21T01:53:31.446412+0000 front 2024-09-21T01:53:31.446298+0000 (oldest deadline 2024-09-21T01:53:57.346061+0000) 2024-09-21T01:54:02.341 INFO:journalctl@ceph.osd.8.smithi142.stdout:Sep 21 01:54:02 smithi142 podman[67859]: 2024-09-21 01:54:02.08013158 +0000 UTC m=+0.098697187 container create 4cefc97183c42546966b4fa208a3cf642706b2a2aaa1d3b4f6325660b04c902d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-8-deactivate, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True) 2024-09-21T01:54:02.341 INFO:journalctl@ceph.osd.8.smithi142.stdout:Sep 21 01:54:02 smithi142 podman[67859]: 2024-09-21 01:54:01.997313477 +0000 UTC m=+0.015879089 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T01:54:02.341 INFO:journalctl@ceph.osd.8.smithi142.stdout:Sep 21 01:54:02 smithi142 podman[67859]: 2024-09-21 01:54:02.341157546 +0000 UTC m=+0.359723163 container init 4cefc97183c42546966b4fa208a3cf642706b2a2aaa1d3b4f6325660b04c902d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-8-deactivate, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T01:54:02.341 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:54:02 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:54:02.000+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:55.996660+0000 front 2024-09-21T01:52:55.996645+0000 (oldest deadline 2024-09-21T01:53:21.296531+0000) 2024-09-21T01:54:02.341 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:54:02 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:54:02.000+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:03.597995+0000 front 2024-09-21T01:53:03.598011+0000 (oldest deadline 2024-09-21T01:53:28.297678+0000) 2024-09-21T01:54:02.341 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:54:02 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:54:02.000+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:09.398667+0000 front 2024-09-21T01:53:09.398643+0000 (oldest deadline 2024-09-21T01:53:34.698854+0000) 2024-09-21T01:54:02.341 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:54:02 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:54:02.000+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T01:53:26.400794+0000 front 2024-09-21T01:53:26.400993+0000 (oldest deadline 2024-09-21T01:53:51.100678+0000) 2024-09-21T01:54:02.341 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:54:02 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:54:02.000+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.142:6812 osd.5 since back 2024-09-21T01:53:34.601722+0000 front 2024-09-21T01:53:34.601778+0000 (oldest deadline 2024-09-21T01:53:58.101809+0000) 2024-09-21T01:54:02.715 INFO:journalctl@ceph.osd.8.smithi142.stdout:Sep 21 01:54:02 smithi142 podman[67859]: 2024-09-21 01:54:02.344540873 +0000 UTC m=+0.363106489 container start 4cefc97183c42546966b4fa208a3cf642706b2a2aaa1d3b4f6325660b04c902d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-8-deactivate, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T01:54:02.715 INFO:journalctl@ceph.osd.8.smithi142.stdout:Sep 21 01:54:02 smithi142 podman[67859]: 2024-09-21 01:54:02.441333299 +0000 UTC m=+0.459898916 container attach 4cefc97183c42546966b4fa208a3cf642706b2a2aaa1d3b4f6325660b04c902d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-8-deactivate, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=) 2024-09-21T01:54:02.715 INFO:journalctl@ceph.osd.8.smithi142.stdout:Sep 21 01:54:02 smithi142 podman[67859]: 2024-09-21 01:54:02.53202225 +0000 UTC m=+0.550587858 container died 4cefc97183c42546966b4fa208a3cf642706b2a2aaa1d3b4f6325660b04c902d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-8-deactivate, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-09-21T01:54:02.803 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:54:02 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:54:02.343+0000 7fc210836640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:56.783488+0000 front 2024-09-21T01:52:56.783513+0000 (oldest deadline 2024-09-21T01:53:21.483559+0000) 2024-09-21T01:54:02.804 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:54:02 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:54:02.343+0000 7fc210836640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:01.484146+0000 front 2024-09-21T01:53:01.484128+0000 (oldest deadline 2024-09-21T01:53:27.384161+0000) 2024-09-21T01:54:02.804 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:54:02 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:54:02.343+0000 7fc210836640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:10.786106+0000 front 2024-09-21T01:53:10.786293+0000 (oldest deadline 2024-09-21T01:53:36.086126+0000) 2024-09-21T01:54:02.804 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:54:02 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:54:02.343+0000 7fc210836640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.83:6814 osd.3 since back 2024-09-21T01:53:20.588096+0000 front 2024-09-21T01:53:20.588133+0000 (oldest deadline 2024-09-21T01:53:46.488248+0000) 2024-09-21T01:54:02.804 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:54:02 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:54:02.343+0000 7fc210836640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T01:53:26.488804+0000 front 2024-09-21T01:53:26.488731+0000 (oldest deadline 2024-09-21T01:53:49.388741+0000) 2024-09-21T01:54:02.804 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:54:02 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:54:02.343+0000 7fc210836640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.142:6812 osd.5 since back 2024-09-21T01:53:34.491131+0000 front 2024-09-21T01:53:34.490977+0000 (oldest deadline 2024-09-21T01:54:01.490933+0000) 2024-09-21T01:54:03.111 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:54:02 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:54:02.975+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:55.996660+0000 front 2024-09-21T01:52:55.996645+0000 (oldest deadline 2024-09-21T01:53:21.296531+0000) 2024-09-21T01:54:03.111 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:54:02 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:54:02.975+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:03.597995+0000 front 2024-09-21T01:53:03.598011+0000 (oldest deadline 2024-09-21T01:53:28.297678+0000) 2024-09-21T01:54:03.111 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:54:02 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:54:02.975+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:09.398667+0000 front 2024-09-21T01:53:09.398643+0000 (oldest deadline 2024-09-21T01:53:34.698854+0000) 2024-09-21T01:54:03.111 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:54:02 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:54:02.975+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T01:53:26.400794+0000 front 2024-09-21T01:53:26.400993+0000 (oldest deadline 2024-09-21T01:53:51.100678+0000) 2024-09-21T01:54:03.112 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:54:02 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:54:02.975+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.142:6812 osd.5 since back 2024-09-21T01:53:34.601722+0000 front 2024-09-21T01:53:34.601778+0000 (oldest deadline 2024-09-21T01:53:58.101809+0000) 2024-09-21T01:54:03.132 DEBUG:teuthology.orchestra.run.smithi142:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f7697ecc-77b8-11ef-baf5-efdc52797490@osd.8.service' 2024-09-21T01:54:03.213 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T01:54:03.213 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-09-21T01:54:03.213 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-09-21T01:54:03.213 DEBUG:teuthology.orchestra.run.smithi083:> sudo systemctl stop ceph-f7697ecc-77b8-11ef-baf5-efdc52797490@osd.9 2024-09-21T01:54:03.217 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:54:02 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:54:02.825+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:52.739060+0000 front 2024-09-21T01:52:52.738919+0000 (oldest deadline 2024-09-21T01:53:18.038843+0000) 2024-09-21T01:54:03.218 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:54:02 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:54:02.825+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:03.740740+0000 front 2024-09-21T01:53:03.740797+0000 (oldest deadline 2024-09-21T01:53:26.040830+0000) 2024-09-21T01:54:03.218 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:54:02 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:54:02.825+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:10.642164+0000 front 2024-09-21T01:53:10.642202+0000 (oldest deadline 2024-09-21T01:53:35.342361+0000) 2024-09-21T01:54:03.218 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:54:02 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:54:02.825+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.83:6814 osd.3 since back 2024-09-21T01:53:20.043206+0000 front 2024-09-21T01:53:20.043253+0000 (oldest deadline 2024-09-21T01:53:41.643680+0000) 2024-09-21T01:54:03.218 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:54:02 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:54:02.825+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T01:53:27.445169+0000 front 2024-09-21T01:53:27.445227+0000 (oldest deadline 2024-09-21T01:53:50.345230+0000) 2024-09-21T01:54:03.218 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:54:02 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:54:02.825+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.142:6812 osd.5 since back 2024-09-21T01:53:31.446412+0000 front 2024-09-21T01:53:31.446298+0000 (oldest deadline 2024-09-21T01:53:57.346061+0000) 2024-09-21T01:54:03.522 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:54:03 smithi083 systemd[1]: Stopping Ceph osd.9 for f7697ecc-77b8-11ef-baf5-efdc52797490... 2024-09-21T01:54:03.522 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:54:03 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:54:03.306+0000 7fc210836640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:56.783488+0000 front 2024-09-21T01:52:56.783513+0000 (oldest deadline 2024-09-21T01:53:21.483559+0000) 2024-09-21T01:54:03.522 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:54:03 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:54:03.306+0000 7fc210836640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:01.484146+0000 front 2024-09-21T01:53:01.484128+0000 (oldest deadline 2024-09-21T01:53:27.384161+0000) 2024-09-21T01:54:03.522 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:54:03 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:54:03.306+0000 7fc210836640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:10.786106+0000 front 2024-09-21T01:53:10.786293+0000 (oldest deadline 2024-09-21T01:53:36.086126+0000) 2024-09-21T01:54:03.522 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:54:03 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:54:03.306+0000 7fc210836640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.83:6814 osd.3 since back 2024-09-21T01:53:20.588096+0000 front 2024-09-21T01:53:20.588133+0000 (oldest deadline 2024-09-21T01:53:46.488248+0000) 2024-09-21T01:54:03.522 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:54:03 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:54:03.306+0000 7fc210836640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T01:53:26.488804+0000 front 2024-09-21T01:53:26.488731+0000 (oldest deadline 2024-09-21T01:53:49.388741+0000) 2024-09-21T01:54:03.522 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:54:03 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:54:03.306+0000 7fc210836640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.142:6812 osd.5 since back 2024-09-21T01:53:34.491131+0000 front 2024-09-21T01:53:34.490977+0000 (oldest deadline 2024-09-21T01:54:01.490933+0000) 2024-09-21T01:54:03.522 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:54:03 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:54:03.521+0000 7fc21424b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T01:54:03.522 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:54:03 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:54:03.521+0000 7fc21424b640 -1 osd.9 98 *** Got signal Terminated *** 2024-09-21T01:54:03.522 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:54:03 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:54:03.521+0000 7fc21424b640 -1 osd.9 98 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T01:54:04.218 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:54:03 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:54:03.854+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:52.739060+0000 front 2024-09-21T01:52:52.738919+0000 (oldest deadline 2024-09-21T01:53:18.038843+0000) 2024-09-21T01:54:04.218 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:54:03 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:54:03.854+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:03.740740+0000 front 2024-09-21T01:53:03.740797+0000 (oldest deadline 2024-09-21T01:53:26.040830+0000) 2024-09-21T01:54:04.218 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:54:03 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:54:03.854+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:10.642164+0000 front 2024-09-21T01:53:10.642202+0000 (oldest deadline 2024-09-21T01:53:35.342361+0000) 2024-09-21T01:54:04.218 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:54:03 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:54:03.854+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.83:6814 osd.3 since back 2024-09-21T01:53:20.043206+0000 front 2024-09-21T01:53:20.043253+0000 (oldest deadline 2024-09-21T01:53:41.643680+0000) 2024-09-21T01:54:04.218 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:54:03 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:54:03.854+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T01:53:27.445169+0000 front 2024-09-21T01:53:27.445227+0000 (oldest deadline 2024-09-21T01:53:50.345230+0000) 2024-09-21T01:54:04.218 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:54:03 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:54:03.854+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.142:6812 osd.5 since back 2024-09-21T01:53:31.446412+0000 front 2024-09-21T01:53:31.446298+0000 (oldest deadline 2024-09-21T01:53:57.346061+0000) 2024-09-21T01:54:04.346 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:54:03 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:54:03.977+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:55.996660+0000 front 2024-09-21T01:52:55.996645+0000 (oldest deadline 2024-09-21T01:53:21.296531+0000) 2024-09-21T01:54:04.346 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:54:03 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:54:03.977+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:03.597995+0000 front 2024-09-21T01:53:03.598011+0000 (oldest deadline 2024-09-21T01:53:28.297678+0000) 2024-09-21T01:54:04.346 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:54:03 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:54:03.977+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:09.398667+0000 front 2024-09-21T01:53:09.398643+0000 (oldest deadline 2024-09-21T01:53:34.698854+0000) 2024-09-21T01:54:04.346 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:54:03 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:54:03.977+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T01:53:26.400794+0000 front 2024-09-21T01:53:26.400993+0000 (oldest deadline 2024-09-21T01:53:51.100678+0000) 2024-09-21T01:54:04.346 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:54:03 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:54:03.977+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.142:6812 osd.5 since back 2024-09-21T01:53:34.601722+0000 front 2024-09-21T01:53:34.601778+0000 (oldest deadline 2024-09-21T01:53:58.101809+0000) 2024-09-21T01:54:04.554 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:54:04 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:54:04.271+0000 7fc210836640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:56.783488+0000 front 2024-09-21T01:52:56.783513+0000 (oldest deadline 2024-09-21T01:53:21.483559+0000) 2024-09-21T01:54:04.554 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:54:04 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:54:04.271+0000 7fc210836640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:01.484146+0000 front 2024-09-21T01:53:01.484128+0000 (oldest deadline 2024-09-21T01:53:27.384161+0000) 2024-09-21T01:54:04.554 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:54:04 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:54:04.271+0000 7fc210836640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:10.786106+0000 front 2024-09-21T01:53:10.786293+0000 (oldest deadline 2024-09-21T01:53:36.086126+0000) 2024-09-21T01:54:04.554 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:54:04 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:54:04.271+0000 7fc210836640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.83:6814 osd.3 since back 2024-09-21T01:53:20.588096+0000 front 2024-09-21T01:53:20.588133+0000 (oldest deadline 2024-09-21T01:53:46.488248+0000) 2024-09-21T01:54:04.554 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:54:04 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:54:04.271+0000 7fc210836640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T01:53:26.488804+0000 front 2024-09-21T01:53:26.488731+0000 (oldest deadline 2024-09-21T01:53:49.388741+0000) 2024-09-21T01:54:04.554 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:54:04 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:54:04.271+0000 7fc210836640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.142:6812 osd.5 since back 2024-09-21T01:53:34.491131+0000 front 2024-09-21T01:53:34.490977+0000 (oldest deadline 2024-09-21T01:54:01.490933+0000) 2024-09-21T01:54:05.215 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:54:04 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:54:04.960+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:55.996660+0000 front 2024-09-21T01:52:55.996645+0000 (oldest deadline 2024-09-21T01:53:21.296531+0000) 2024-09-21T01:54:05.215 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:54:04 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:54:04.960+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:03.597995+0000 front 2024-09-21T01:53:03.598011+0000 (oldest deadline 2024-09-21T01:53:28.297678+0000) 2024-09-21T01:54:05.215 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:54:04 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:54:04.960+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:09.398667+0000 front 2024-09-21T01:53:09.398643+0000 (oldest deadline 2024-09-21T01:53:34.698854+0000) 2024-09-21T01:54:05.215 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:54:04 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:54:04.960+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T01:53:26.400794+0000 front 2024-09-21T01:53:26.400993+0000 (oldest deadline 2024-09-21T01:53:51.100678+0000) 2024-09-21T01:54:05.215 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:54:04 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:54:04.960+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.142:6812 osd.5 since back 2024-09-21T01:53:34.601722+0000 front 2024-09-21T01:53:34.601778+0000 (oldest deadline 2024-09-21T01:53:58.101809+0000) 2024-09-21T01:54:05.217 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:54:04 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:54:04.852+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:52.739060+0000 front 2024-09-21T01:52:52.738919+0000 (oldest deadline 2024-09-21T01:53:18.038843+0000) 2024-09-21T01:54:05.218 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:54:04 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:54:04.852+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:03.740740+0000 front 2024-09-21T01:53:03.740797+0000 (oldest deadline 2024-09-21T01:53:26.040830+0000) 2024-09-21T01:54:05.218 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:54:04 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:54:04.852+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:10.642164+0000 front 2024-09-21T01:53:10.642202+0000 (oldest deadline 2024-09-21T01:53:35.342361+0000) 2024-09-21T01:54:05.218 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:54:04 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:54:04.852+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.83:6814 osd.3 since back 2024-09-21T01:53:20.043206+0000 front 2024-09-21T01:53:20.043253+0000 (oldest deadline 2024-09-21T01:53:41.643680+0000) 2024-09-21T01:54:05.218 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:54:04 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:54:04.852+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T01:53:27.445169+0000 front 2024-09-21T01:53:27.445227+0000 (oldest deadline 2024-09-21T01:53:50.345230+0000) 2024-09-21T01:54:05.218 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:54:04 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:54:04.852+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.142:6812 osd.5 since back 2024-09-21T01:53:31.446412+0000 front 2024-09-21T01:53:31.446298+0000 (oldest deadline 2024-09-21T01:53:57.346061+0000) 2024-09-21T01:54:05.554 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:54:05 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:54:05.272+0000 7fc210836640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:56.783488+0000 front 2024-09-21T01:52:56.783513+0000 (oldest deadline 2024-09-21T01:53:21.483559+0000) 2024-09-21T01:54:05.554 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:54:05 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:54:05.272+0000 7fc210836640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:01.484146+0000 front 2024-09-21T01:53:01.484128+0000 (oldest deadline 2024-09-21T01:53:27.384161+0000) 2024-09-21T01:54:05.554 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:54:05 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:54:05.272+0000 7fc210836640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:10.786106+0000 front 2024-09-21T01:53:10.786293+0000 (oldest deadline 2024-09-21T01:53:36.086126+0000) 2024-09-21T01:54:05.554 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:54:05 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:54:05.272+0000 7fc210836640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.83:6814 osd.3 since back 2024-09-21T01:53:20.588096+0000 front 2024-09-21T01:53:20.588133+0000 (oldest deadline 2024-09-21T01:53:46.488248+0000) 2024-09-21T01:54:05.554 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:54:05 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:54:05.272+0000 7fc210836640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T01:53:26.488804+0000 front 2024-09-21T01:53:26.488731+0000 (oldest deadline 2024-09-21T01:53:49.388741+0000) 2024-09-21T01:54:05.554 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:54:05 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:54:05.272+0000 7fc210836640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.142:6812 osd.5 since back 2024-09-21T01:53:34.491131+0000 front 2024-09-21T01:53:34.490977+0000 (oldest deadline 2024-09-21T01:54:01.490933+0000) 2024-09-21T01:54:06.214 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:54:05 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:54:05.937+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:55.996660+0000 front 2024-09-21T01:52:55.996645+0000 (oldest deadline 2024-09-21T01:53:21.296531+0000) 2024-09-21T01:54:06.215 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:54:05 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:54:05.937+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:03.597995+0000 front 2024-09-21T01:53:03.598011+0000 (oldest deadline 2024-09-21T01:53:28.297678+0000) 2024-09-21T01:54:06.215 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:54:05 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:54:05.937+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:09.398667+0000 front 2024-09-21T01:53:09.398643+0000 (oldest deadline 2024-09-21T01:53:34.698854+0000) 2024-09-21T01:54:06.215 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:54:05 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:54:05.937+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T01:53:26.400794+0000 front 2024-09-21T01:53:26.400993+0000 (oldest deadline 2024-09-21T01:53:51.100678+0000) 2024-09-21T01:54:06.215 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:54:05 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:54:05.937+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.142:6812 osd.5 since back 2024-09-21T01:53:34.601722+0000 front 2024-09-21T01:53:34.601778+0000 (oldest deadline 2024-09-21T01:53:58.101809+0000) 2024-09-21T01:54:06.217 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:54:05 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:54:05.812+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:52.739060+0000 front 2024-09-21T01:52:52.738919+0000 (oldest deadline 2024-09-21T01:53:18.038843+0000) 2024-09-21T01:54:06.218 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:54:05 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:54:05.812+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:03.740740+0000 front 2024-09-21T01:53:03.740797+0000 (oldest deadline 2024-09-21T01:53:26.040830+0000) 2024-09-21T01:54:06.218 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:54:05 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:54:05.812+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:10.642164+0000 front 2024-09-21T01:53:10.642202+0000 (oldest deadline 2024-09-21T01:53:35.342361+0000) 2024-09-21T01:54:06.218 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:54:05 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:54:05.812+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.83:6814 osd.3 since back 2024-09-21T01:53:20.043206+0000 front 2024-09-21T01:53:20.043253+0000 (oldest deadline 2024-09-21T01:53:41.643680+0000) 2024-09-21T01:54:06.218 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:54:05 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:54:05.812+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T01:53:27.445169+0000 front 2024-09-21T01:53:27.445227+0000 (oldest deadline 2024-09-21T01:53:50.345230+0000) 2024-09-21T01:54:06.218 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:54:05 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:54:05.812+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.142:6812 osd.5 since back 2024-09-21T01:53:31.446412+0000 front 2024-09-21T01:53:31.446298+0000 (oldest deadline 2024-09-21T01:53:57.346061+0000) 2024-09-21T01:54:06.554 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:54:06 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:54:06.260+0000 7fc210836640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:56.783488+0000 front 2024-09-21T01:52:56.783513+0000 (oldest deadline 2024-09-21T01:53:21.483559+0000) 2024-09-21T01:54:06.554 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:54:06 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:54:06.260+0000 7fc210836640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:01.484146+0000 front 2024-09-21T01:53:01.484128+0000 (oldest deadline 2024-09-21T01:53:27.384161+0000) 2024-09-21T01:54:06.554 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:54:06 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:54:06.260+0000 7fc210836640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:10.786106+0000 front 2024-09-21T01:53:10.786293+0000 (oldest deadline 2024-09-21T01:53:36.086126+0000) 2024-09-21T01:54:06.554 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:54:06 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:54:06.260+0000 7fc210836640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.83:6814 osd.3 since back 2024-09-21T01:53:20.588096+0000 front 2024-09-21T01:53:20.588133+0000 (oldest deadline 2024-09-21T01:53:46.488248+0000) 2024-09-21T01:54:06.554 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:54:06 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:54:06.260+0000 7fc210836640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T01:53:26.488804+0000 front 2024-09-21T01:53:26.488731+0000 (oldest deadline 2024-09-21T01:53:49.388741+0000) 2024-09-21T01:54:06.554 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:54:06 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:54:06.260+0000 7fc210836640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.142:6812 osd.5 since back 2024-09-21T01:53:34.491131+0000 front 2024-09-21T01:53:34.490977+0000 (oldest deadline 2024-09-21T01:54:01.490933+0000) 2024-09-21T01:54:07.214 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:54:06 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:54:06.934+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:55.996660+0000 front 2024-09-21T01:52:55.996645+0000 (oldest deadline 2024-09-21T01:53:21.296531+0000) 2024-09-21T01:54:07.215 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:54:06 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:54:06.934+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:03.597995+0000 front 2024-09-21T01:53:03.598011+0000 (oldest deadline 2024-09-21T01:53:28.297678+0000) 2024-09-21T01:54:07.215 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:54:06 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:54:06.934+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:09.398667+0000 front 2024-09-21T01:53:09.398643+0000 (oldest deadline 2024-09-21T01:53:34.698854+0000) 2024-09-21T01:54:07.215 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:54:06 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:54:06.934+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T01:53:26.400794+0000 front 2024-09-21T01:53:26.400993+0000 (oldest deadline 2024-09-21T01:53:51.100678+0000) 2024-09-21T01:54:07.215 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:54:06 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:54:06.934+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.142:6812 osd.5 since back 2024-09-21T01:53:34.601722+0000 front 2024-09-21T01:53:34.601778+0000 (oldest deadline 2024-09-21T01:53:58.101809+0000) 2024-09-21T01:54:07.215 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:54:06 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:54:06.934+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.83:6822 osd.6 since back 2024-09-21T01:53:44.503459+0000 front 2024-09-21T01:53:44.503434+0000 (oldest deadline 2024-09-21T01:54:06.203171+0000) 2024-09-21T01:54:07.218 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:54:06 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:54:06.776+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:52.739060+0000 front 2024-09-21T01:52:52.738919+0000 (oldest deadline 2024-09-21T01:53:18.038843+0000) 2024-09-21T01:54:07.218 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:54:06 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:54:06.776+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:03.740740+0000 front 2024-09-21T01:53:03.740797+0000 (oldest deadline 2024-09-21T01:53:26.040830+0000) 2024-09-21T01:54:07.218 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:54:06 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:54:06.776+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:10.642164+0000 front 2024-09-21T01:53:10.642202+0000 (oldest deadline 2024-09-21T01:53:35.342361+0000) 2024-09-21T01:54:07.218 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:54:06 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:54:06.776+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.83:6814 osd.3 since back 2024-09-21T01:53:20.043206+0000 front 2024-09-21T01:53:20.043253+0000 (oldest deadline 2024-09-21T01:53:41.643680+0000) 2024-09-21T01:54:07.218 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:54:06 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:54:06.776+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T01:53:27.445169+0000 front 2024-09-21T01:53:27.445227+0000 (oldest deadline 2024-09-21T01:53:50.345230+0000) 2024-09-21T01:54:07.218 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:54:06 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:54:06.776+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.142:6812 osd.5 since back 2024-09-21T01:53:31.446412+0000 front 2024-09-21T01:53:31.446298+0000 (oldest deadline 2024-09-21T01:53:57.346061+0000) 2024-09-21T01:54:07.554 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:54:07 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:54:07.234+0000 7fc210836640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:56.783488+0000 front 2024-09-21T01:52:56.783513+0000 (oldest deadline 2024-09-21T01:53:21.483559+0000) 2024-09-21T01:54:07.554 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:54:07 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:54:07.234+0000 7fc210836640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:01.484146+0000 front 2024-09-21T01:53:01.484128+0000 (oldest deadline 2024-09-21T01:53:27.384161+0000) 2024-09-21T01:54:07.554 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:54:07 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:54:07.234+0000 7fc210836640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:10.786106+0000 front 2024-09-21T01:53:10.786293+0000 (oldest deadline 2024-09-21T01:53:36.086126+0000) 2024-09-21T01:54:07.554 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:54:07 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:54:07.234+0000 7fc210836640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.83:6814 osd.3 since back 2024-09-21T01:53:20.588096+0000 front 2024-09-21T01:53:20.588133+0000 (oldest deadline 2024-09-21T01:53:46.488248+0000) 2024-09-21T01:54:07.554 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:54:07 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:54:07.234+0000 7fc210836640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T01:53:26.488804+0000 front 2024-09-21T01:53:26.488731+0000 (oldest deadline 2024-09-21T01:53:49.388741+0000) 2024-09-21T01:54:07.554 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:54:07 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:54:07.234+0000 7fc210836640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.142:6812 osd.5 since back 2024-09-21T01:53:34.491131+0000 front 2024-09-21T01:53:34.490977+0000 (oldest deadline 2024-09-21T01:54:01.490933+0000) 2024-09-21T01:54:08.215 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:54:07 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:54:07.943+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:55.996660+0000 front 2024-09-21T01:52:55.996645+0000 (oldest deadline 2024-09-21T01:53:21.296531+0000) 2024-09-21T01:54:08.215 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:54:07 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:54:07.943+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:03.597995+0000 front 2024-09-21T01:53:03.598011+0000 (oldest deadline 2024-09-21T01:53:28.297678+0000) 2024-09-21T01:54:08.215 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:54:07 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:54:07.943+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:09.398667+0000 front 2024-09-21T01:53:09.398643+0000 (oldest deadline 2024-09-21T01:53:34.698854+0000) 2024-09-21T01:54:08.215 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:54:07 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:54:07.943+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T01:53:26.400794+0000 front 2024-09-21T01:53:26.400993+0000 (oldest deadline 2024-09-21T01:53:51.100678+0000) 2024-09-21T01:54:08.215 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:54:07 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:54:07.943+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.142:6812 osd.5 since back 2024-09-21T01:53:34.601722+0000 front 2024-09-21T01:53:34.601778+0000 (oldest deadline 2024-09-21T01:53:58.101809+0000) 2024-09-21T01:54:08.215 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:54:07 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:54:07.943+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.83:6822 osd.6 since back 2024-09-21T01:53:44.503459+0000 front 2024-09-21T01:53:44.503434+0000 (oldest deadline 2024-09-21T01:54:06.203171+0000) 2024-09-21T01:54:08.217 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:54:07 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:54:07.783+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:52.739060+0000 front 2024-09-21T01:52:52.738919+0000 (oldest deadline 2024-09-21T01:53:18.038843+0000) 2024-09-21T01:54:08.217 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:54:07 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:54:07.783+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:03.740740+0000 front 2024-09-21T01:53:03.740797+0000 (oldest deadline 2024-09-21T01:53:26.040830+0000) 2024-09-21T01:54:08.218 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:54:07 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:54:07.783+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:10.642164+0000 front 2024-09-21T01:53:10.642202+0000 (oldest deadline 2024-09-21T01:53:35.342361+0000) 2024-09-21T01:54:08.218 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:54:07 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:54:07.783+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.83:6814 osd.3 since back 2024-09-21T01:53:20.043206+0000 front 2024-09-21T01:53:20.043253+0000 (oldest deadline 2024-09-21T01:53:41.643680+0000) 2024-09-21T01:54:08.218 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:54:07 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:54:07.783+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T01:53:27.445169+0000 front 2024-09-21T01:53:27.445227+0000 (oldest deadline 2024-09-21T01:53:50.345230+0000) 2024-09-21T01:54:08.218 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:54:07 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:54:07.783+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.142:6812 osd.5 since back 2024-09-21T01:53:31.446412+0000 front 2024-09-21T01:53:31.446298+0000 (oldest deadline 2024-09-21T01:53:57.346061+0000) 2024-09-21T01:54:08.554 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:54:08 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:54:08.184+0000 7fc210836640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:56.783488+0000 front 2024-09-21T01:52:56.783513+0000 (oldest deadline 2024-09-21T01:53:21.483559+0000) 2024-09-21T01:54:08.554 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:54:08 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:54:08.184+0000 7fc210836640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:01.484146+0000 front 2024-09-21T01:53:01.484128+0000 (oldest deadline 2024-09-21T01:53:27.384161+0000) 2024-09-21T01:54:08.554 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:54:08 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:54:08.184+0000 7fc210836640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:10.786106+0000 front 2024-09-21T01:53:10.786293+0000 (oldest deadline 2024-09-21T01:53:36.086126+0000) 2024-09-21T01:54:08.554 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:54:08 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:54:08.184+0000 7fc210836640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.83:6814 osd.3 since back 2024-09-21T01:53:20.588096+0000 front 2024-09-21T01:53:20.588133+0000 (oldest deadline 2024-09-21T01:53:46.488248+0000) 2024-09-21T01:54:08.554 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:54:08 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:54:08.184+0000 7fc210836640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T01:53:26.488804+0000 front 2024-09-21T01:53:26.488731+0000 (oldest deadline 2024-09-21T01:53:49.388741+0000) 2024-09-21T01:54:08.554 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:54:08 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9[67566]: 2024-09-21T01:54:08.184+0000 7fc210836640 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.142:6812 osd.5 since back 2024-09-21T01:53:34.491131+0000 front 2024-09-21T01:53:34.490977+0000 (oldest deadline 2024-09-21T01:54:01.490933+0000) 2024-09-21T01:54:09.146 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:54:08 smithi083 podman[94728]: 2024-09-21 01:54:08.885054882 +0000 UTC m=+5.476943294 container died 580e0b3cd949802fa7515d5ac9793e92653f53f1c6f8d67e626a59746b0d7078 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2) 2024-09-21T01:54:09.214 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:54:08 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:54:08.896+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:55.996660+0000 front 2024-09-21T01:52:55.996645+0000 (oldest deadline 2024-09-21T01:53:21.296531+0000) 2024-09-21T01:54:09.215 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:54:08 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:54:08.896+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:03.597995+0000 front 2024-09-21T01:53:03.598011+0000 (oldest deadline 2024-09-21T01:53:28.297678+0000) 2024-09-21T01:54:09.215 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:54:08 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:54:08.896+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:09.398667+0000 front 2024-09-21T01:53:09.398643+0000 (oldest deadline 2024-09-21T01:53:34.698854+0000) 2024-09-21T01:54:09.215 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:54:08 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:54:08.896+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T01:53:26.400794+0000 front 2024-09-21T01:53:26.400993+0000 (oldest deadline 2024-09-21T01:53:51.100678+0000) 2024-09-21T01:54:09.215 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:54:08 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:54:08.896+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.142:6812 osd.5 since back 2024-09-21T01:53:34.601722+0000 front 2024-09-21T01:53:34.601778+0000 (oldest deadline 2024-09-21T01:53:58.101809+0000) 2024-09-21T01:54:09.215 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:54:08 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:54:08.896+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.83:6822 osd.6 since back 2024-09-21T01:53:44.503459+0000 front 2024-09-21T01:53:44.503434+0000 (oldest deadline 2024-09-21T01:54:06.203171+0000) 2024-09-21T01:54:09.217 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:54:08 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:54:08.830+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:52.739060+0000 front 2024-09-21T01:52:52.738919+0000 (oldest deadline 2024-09-21T01:53:18.038843+0000) 2024-09-21T01:54:09.218 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:54:08 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:54:08.830+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:03.740740+0000 front 2024-09-21T01:53:03.740797+0000 (oldest deadline 2024-09-21T01:53:26.040830+0000) 2024-09-21T01:54:09.218 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:54:08 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:54:08.830+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:10.642164+0000 front 2024-09-21T01:53:10.642202+0000 (oldest deadline 2024-09-21T01:53:35.342361+0000) 2024-09-21T01:54:09.218 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:54:08 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:54:08.830+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.83:6814 osd.3 since back 2024-09-21T01:53:20.043206+0000 front 2024-09-21T01:53:20.043253+0000 (oldest deadline 2024-09-21T01:53:41.643680+0000) 2024-09-21T01:54:09.218 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:54:08 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:54:08.830+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T01:53:27.445169+0000 front 2024-09-21T01:53:27.445227+0000 (oldest deadline 2024-09-21T01:53:50.345230+0000) 2024-09-21T01:54:09.218 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:54:08 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:54:08.830+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.142:6812 osd.5 since back 2024-09-21T01:53:31.446412+0000 front 2024-09-21T01:53:31.446298+0000 (oldest deadline 2024-09-21T01:53:57.346061+0000) 2024-09-21T01:54:09.397 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:54:09 smithi083 podman[94728]: 2024-09-21 01:54:09.229240606 +0000 UTC m=+5.821129008 container cleanup 580e0b3cd949802fa7515d5ac9793e92653f53f1c6f8d67e626a59746b0d7078 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T01:54:09.397 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:54:09 smithi083 bash[94728]: ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9 2024-09-21T01:54:09.803 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:54:09 smithi083 podman[94745]: 2024-09-21 01:54:09.397062607 +0000 UTC m=+0.505455661 container remove 580e0b3cd949802fa7515d5ac9793e92653f53f1c6f8d67e626a59746b0d7078 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-09-21T01:54:10.108 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:54:09 smithi083 podman[94831]: 2024-09-21 01:54:09.831239452 +0000 UTC m=+0.108170339 container create 8094a7dcfc18b0ecfc9deb756f2f18bce514f4a42dbc7440c9268d2aa535ddf7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9-deactivate, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-09-21T01:54:10.108 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:54:09 smithi083 podman[94831]: 2024-09-21 01:54:09.739172739 +0000 UTC m=+0.016103635 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T01:54:10.108 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:54:10 smithi083 podman[94831]: 2024-09-21 01:54:10.050411545 +0000 UTC m=+0.327342446 container init 8094a7dcfc18b0ecfc9deb756f2f18bce514f4a42dbc7440c9268d2aa535ddf7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9-deactivate, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T01:54:10.108 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:54:10 smithi083 podman[94831]: 2024-09-21 01:54:10.053645011 +0000 UTC m=+0.330575900 container start 8094a7dcfc18b0ecfc9deb756f2f18bce514f4a42dbc7440c9268d2aa535ddf7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9-deactivate, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T01:54:10.109 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:54:10 smithi083 podman[94831]: 2024-09-21 01:54:10.108501842 +0000 UTC m=+0.385432737 container attach 8094a7dcfc18b0ecfc9deb756f2f18bce514f4a42dbc7440c9268d2aa535ddf7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9-deactivate, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-09-21T01:54:10.177 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:54:09 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:54:09.863+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:52.739060+0000 front 2024-09-21T01:52:52.738919+0000 (oldest deadline 2024-09-21T01:53:18.038843+0000) 2024-09-21T01:54:10.177 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:54:09 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:54:09.863+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:03.740740+0000 front 2024-09-21T01:53:03.740797+0000 (oldest deadline 2024-09-21T01:53:26.040830+0000) 2024-09-21T01:54:10.178 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:54:09 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:54:09.863+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:10.642164+0000 front 2024-09-21T01:53:10.642202+0000 (oldest deadline 2024-09-21T01:53:35.342361+0000) 2024-09-21T01:54:10.178 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:54:09 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:54:09.863+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.83:6814 osd.3 since back 2024-09-21T01:53:20.043206+0000 front 2024-09-21T01:53:20.043253+0000 (oldest deadline 2024-09-21T01:53:41.643680+0000) 2024-09-21T01:54:10.178 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:54:09 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:54:09.863+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T01:53:27.445169+0000 front 2024-09-21T01:53:27.445227+0000 (oldest deadline 2024-09-21T01:53:50.345230+0000) 2024-09-21T01:54:10.178 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:54:09 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:54:09.863+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.142:6812 osd.5 since back 2024-09-21T01:53:31.446412+0000 front 2024-09-21T01:53:31.446298+0000 (oldest deadline 2024-09-21T01:53:57.346061+0000) 2024-09-21T01:54:10.178 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:54:09 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:54:09.863+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.83:6822 osd.6 since back 2024-09-21T01:53:40.147571+0000 front 2024-09-21T01:53:40.147548+0000 (oldest deadline 2024-09-21T01:54:08.947937+0000) 2024-09-21T01:54:10.214 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:54:09 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:54:09.856+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:55.996660+0000 front 2024-09-21T01:52:55.996645+0000 (oldest deadline 2024-09-21T01:53:21.296531+0000) 2024-09-21T01:54:10.215 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:54:09 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:54:09.856+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:03.597995+0000 front 2024-09-21T01:53:03.598011+0000 (oldest deadline 2024-09-21T01:53:28.297678+0000) 2024-09-21T01:54:10.215 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:54:09 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:54:09.856+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:09.398667+0000 front 2024-09-21T01:53:09.398643+0000 (oldest deadline 2024-09-21T01:53:34.698854+0000) 2024-09-21T01:54:10.215 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:54:09 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:54:09.856+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T01:53:26.400794+0000 front 2024-09-21T01:53:26.400993+0000 (oldest deadline 2024-09-21T01:53:51.100678+0000) 2024-09-21T01:54:10.215 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:54:09 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:54:09.856+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.142:6812 osd.5 since back 2024-09-21T01:53:34.601722+0000 front 2024-09-21T01:53:34.601778+0000 (oldest deadline 2024-09-21T01:53:58.101809+0000) 2024-09-21T01:54:10.215 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:54:09 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:54:09.856+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.83:6822 osd.6 since back 2024-09-21T01:53:44.503459+0000 front 2024-09-21T01:53:44.503434+0000 (oldest deadline 2024-09-21T01:54:06.203171+0000) 2024-09-21T01:54:10.528 INFO:journalctl@ceph.osd.9.smithi083.stdout:Sep 21 01:54:10 smithi083 podman[94831]: 2024-09-21 01:54:10.248487162 +0000 UTC m=+0.525418065 container died 8094a7dcfc18b0ecfc9deb756f2f18bce514f4a42dbc7440c9268d2aa535ddf7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-9-deactivate, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T01:54:10.801 DEBUG:teuthology.orchestra.run.smithi083:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f7697ecc-77b8-11ef-baf5-efdc52797490@osd.9.service' 2024-09-21T01:54:10.842 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T01:54:10.842 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-09-21T01:54:10.842 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-09-21T01:54:10.842 DEBUG:teuthology.orchestra.run.smithi119:> sudo systemctl stop ceph-f7697ecc-77b8-11ef-baf5-efdc52797490@osd.10 2024-09-21T01:54:11.155 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:54:10 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:54:10.846+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:52.739060+0000 front 2024-09-21T01:52:52.738919+0000 (oldest deadline 2024-09-21T01:53:18.038843+0000) 2024-09-21T01:54:11.155 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:54:10 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:54:10.846+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:03.740740+0000 front 2024-09-21T01:53:03.740797+0000 (oldest deadline 2024-09-21T01:53:26.040830+0000) 2024-09-21T01:54:11.155 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:54:10 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:54:10.846+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:10.642164+0000 front 2024-09-21T01:53:10.642202+0000 (oldest deadline 2024-09-21T01:53:35.342361+0000) 2024-09-21T01:54:11.155 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:54:10 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:54:10.846+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.83:6814 osd.3 since back 2024-09-21T01:53:20.043206+0000 front 2024-09-21T01:53:20.043253+0000 (oldest deadline 2024-09-21T01:53:41.643680+0000) 2024-09-21T01:54:11.155 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:54:10 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:54:10.846+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T01:53:27.445169+0000 front 2024-09-21T01:53:27.445227+0000 (oldest deadline 2024-09-21T01:53:50.345230+0000) 2024-09-21T01:54:11.155 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:54:10 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:54:10.846+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.142:6812 osd.5 since back 2024-09-21T01:53:31.446412+0000 front 2024-09-21T01:53:31.446298+0000 (oldest deadline 2024-09-21T01:53:57.346061+0000) 2024-09-21T01:54:11.155 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:54:10 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:54:10.846+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.83:6822 osd.6 since back 2024-09-21T01:53:40.147571+0000 front 2024-09-21T01:53:40.147548+0000 (oldest deadline 2024-09-21T01:54:08.947937+0000) 2024-09-21T01:54:11.155 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:54:10 smithi119 systemd[1]: Stopping Ceph osd.10 for f7697ecc-77b8-11ef-baf5-efdc52797490... 2024-09-21T01:54:11.156 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:54:11 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:54:11.154+0000 7f7344e1c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T01:54:11.215 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:54:10 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:54:10.810+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:55.996660+0000 front 2024-09-21T01:52:55.996645+0000 (oldest deadline 2024-09-21T01:53:21.296531+0000) 2024-09-21T01:54:11.215 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:54:10 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:54:10.810+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:03.597995+0000 front 2024-09-21T01:53:03.598011+0000 (oldest deadline 2024-09-21T01:53:28.297678+0000) 2024-09-21T01:54:11.215 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:54:10 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:54:10.810+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:09.398667+0000 front 2024-09-21T01:53:09.398643+0000 (oldest deadline 2024-09-21T01:53:34.698854+0000) 2024-09-21T01:54:11.215 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:54:10 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:54:10.810+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T01:53:26.400794+0000 front 2024-09-21T01:53:26.400993+0000 (oldest deadline 2024-09-21T01:53:51.100678+0000) 2024-09-21T01:54:11.215 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:54:10 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:54:10.810+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.142:6812 osd.5 since back 2024-09-21T01:53:34.601722+0000 front 2024-09-21T01:53:34.601778+0000 (oldest deadline 2024-09-21T01:53:58.101809+0000) 2024-09-21T01:54:11.215 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:54:10 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:54:10.810+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.83:6822 osd.6 since back 2024-09-21T01:53:44.503459+0000 front 2024-09-21T01:53:44.503434+0000 (oldest deadline 2024-09-21T01:54:06.203171+0000) 2024-09-21T01:54:11.467 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:54:11 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:54:11.154+0000 7f7344e1c640 -1 osd.10 98 *** Got signal Terminated *** 2024-09-21T01:54:11.468 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:54:11 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:54:11.154+0000 7f7344e1c640 -1 osd.10 98 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T01:54:12.215 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:54:11 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:54:11.810+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:55.996660+0000 front 2024-09-21T01:52:55.996645+0000 (oldest deadline 2024-09-21T01:53:21.296531+0000) 2024-09-21T01:54:12.215 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:54:11 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:54:11.810+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:03.597995+0000 front 2024-09-21T01:53:03.598011+0000 (oldest deadline 2024-09-21T01:53:28.297678+0000) 2024-09-21T01:54:12.215 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:54:11 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:54:11.810+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:09.398667+0000 front 2024-09-21T01:53:09.398643+0000 (oldest deadline 2024-09-21T01:53:34.698854+0000) 2024-09-21T01:54:12.215 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:54:11 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:54:11.810+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T01:53:26.400794+0000 front 2024-09-21T01:53:26.400993+0000 (oldest deadline 2024-09-21T01:53:51.100678+0000) 2024-09-21T01:54:12.215 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:54:11 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:54:11.810+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.142:6812 osd.5 since back 2024-09-21T01:53:34.601722+0000 front 2024-09-21T01:53:34.601778+0000 (oldest deadline 2024-09-21T01:53:58.101809+0000) 2024-09-21T01:54:12.215 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:54:11 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:54:11.810+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.83:6822 osd.6 since back 2024-09-21T01:53:44.503459+0000 front 2024-09-21T01:53:44.503434+0000 (oldest deadline 2024-09-21T01:54:06.203171+0000) 2024-09-21T01:54:12.217 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:54:11 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:54:11.865+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:52.739060+0000 front 2024-09-21T01:52:52.738919+0000 (oldest deadline 2024-09-21T01:53:18.038843+0000) 2024-09-21T01:54:12.218 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:54:11 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:54:11.865+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:03.740740+0000 front 2024-09-21T01:53:03.740797+0000 (oldest deadline 2024-09-21T01:53:26.040830+0000) 2024-09-21T01:54:12.218 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:54:11 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:54:11.865+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:10.642164+0000 front 2024-09-21T01:53:10.642202+0000 (oldest deadline 2024-09-21T01:53:35.342361+0000) 2024-09-21T01:54:12.218 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:54:11 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:54:11.865+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.83:6814 osd.3 since back 2024-09-21T01:53:20.043206+0000 front 2024-09-21T01:53:20.043253+0000 (oldest deadline 2024-09-21T01:53:41.643680+0000) 2024-09-21T01:54:12.218 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:54:11 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:54:11.865+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T01:53:27.445169+0000 front 2024-09-21T01:53:27.445227+0000 (oldest deadline 2024-09-21T01:53:50.345230+0000) 2024-09-21T01:54:12.218 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:54:11 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:54:11.865+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.142:6812 osd.5 since back 2024-09-21T01:53:31.446412+0000 front 2024-09-21T01:53:31.446298+0000 (oldest deadline 2024-09-21T01:53:57.346061+0000) 2024-09-21T01:54:12.218 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:54:11 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:54:11.865+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.83:6822 osd.6 since back 2024-09-21T01:53:40.147571+0000 front 2024-09-21T01:53:40.147548+0000 (oldest deadline 2024-09-21T01:54:08.947937+0000) 2024-09-21T01:54:13.215 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:54:12 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:54:12.765+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:55.996660+0000 front 2024-09-21T01:52:55.996645+0000 (oldest deadline 2024-09-21T01:53:21.296531+0000) 2024-09-21T01:54:13.215 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:54:12 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:54:12.765+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:03.597995+0000 front 2024-09-21T01:53:03.598011+0000 (oldest deadline 2024-09-21T01:53:28.297678+0000) 2024-09-21T01:54:13.215 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:54:12 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:54:12.765+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:09.398667+0000 front 2024-09-21T01:53:09.398643+0000 (oldest deadline 2024-09-21T01:53:34.698854+0000) 2024-09-21T01:54:13.215 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:54:12 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:54:12.765+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T01:53:26.400794+0000 front 2024-09-21T01:53:26.400993+0000 (oldest deadline 2024-09-21T01:53:51.100678+0000) 2024-09-21T01:54:13.215 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:54:12 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:54:12.765+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.142:6812 osd.5 since back 2024-09-21T01:53:34.601722+0000 front 2024-09-21T01:53:34.601778+0000 (oldest deadline 2024-09-21T01:53:58.101809+0000) 2024-09-21T01:54:13.215 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:54:12 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:54:12.765+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.83:6822 osd.6 since back 2024-09-21T01:53:44.503459+0000 front 2024-09-21T01:53:44.503434+0000 (oldest deadline 2024-09-21T01:54:06.203171+0000) 2024-09-21T01:54:13.218 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:54:12 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:54:12.845+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:52.739060+0000 front 2024-09-21T01:52:52.738919+0000 (oldest deadline 2024-09-21T01:53:18.038843+0000) 2024-09-21T01:54:13.218 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:54:12 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:54:12.845+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:03.740740+0000 front 2024-09-21T01:53:03.740797+0000 (oldest deadline 2024-09-21T01:53:26.040830+0000) 2024-09-21T01:54:13.218 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:54:12 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:54:12.845+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:10.642164+0000 front 2024-09-21T01:53:10.642202+0000 (oldest deadline 2024-09-21T01:53:35.342361+0000) 2024-09-21T01:54:13.218 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:54:12 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:54:12.845+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.83:6814 osd.3 since back 2024-09-21T01:53:20.043206+0000 front 2024-09-21T01:53:20.043253+0000 (oldest deadline 2024-09-21T01:53:41.643680+0000) 2024-09-21T01:54:13.218 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:54:12 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:54:12.845+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T01:53:27.445169+0000 front 2024-09-21T01:53:27.445227+0000 (oldest deadline 2024-09-21T01:53:50.345230+0000) 2024-09-21T01:54:13.218 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:54:12 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:54:12.845+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.142:6812 osd.5 since back 2024-09-21T01:53:31.446412+0000 front 2024-09-21T01:53:31.446298+0000 (oldest deadline 2024-09-21T01:53:57.346061+0000) 2024-09-21T01:54:13.218 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:54:12 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:54:12.845+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.83:6822 osd.6 since back 2024-09-21T01:53:40.147571+0000 front 2024-09-21T01:53:40.147548+0000 (oldest deadline 2024-09-21T01:54:08.947937+0000) 2024-09-21T01:54:14.215 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:54:13 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:54:13.725+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:55.996660+0000 front 2024-09-21T01:52:55.996645+0000 (oldest deadline 2024-09-21T01:53:21.296531+0000) 2024-09-21T01:54:14.215 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:54:13 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:54:13.725+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:03.597995+0000 front 2024-09-21T01:53:03.598011+0000 (oldest deadline 2024-09-21T01:53:28.297678+0000) 2024-09-21T01:54:14.215 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:54:13 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:54:13.725+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:09.398667+0000 front 2024-09-21T01:53:09.398643+0000 (oldest deadline 2024-09-21T01:53:34.698854+0000) 2024-09-21T01:54:14.215 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:54:13 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:54:13.725+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T01:53:26.400794+0000 front 2024-09-21T01:53:26.400993+0000 (oldest deadline 2024-09-21T01:53:51.100678+0000) 2024-09-21T01:54:14.215 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:54:13 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:54:13.725+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.142:6812 osd.5 since back 2024-09-21T01:53:34.601722+0000 front 2024-09-21T01:53:34.601778+0000 (oldest deadline 2024-09-21T01:53:58.101809+0000) 2024-09-21T01:54:14.215 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:54:13 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:54:13.725+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.83:6822 osd.6 since back 2024-09-21T01:53:44.503459+0000 front 2024-09-21T01:53:44.503434+0000 (oldest deadline 2024-09-21T01:54:06.203171+0000) 2024-09-21T01:54:14.218 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:54:13 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:54:13.852+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:52.739060+0000 front 2024-09-21T01:52:52.738919+0000 (oldest deadline 2024-09-21T01:53:18.038843+0000) 2024-09-21T01:54:14.218 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:54:13 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:54:13.852+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:03.740740+0000 front 2024-09-21T01:53:03.740797+0000 (oldest deadline 2024-09-21T01:53:26.040830+0000) 2024-09-21T01:54:14.218 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:54:13 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:54:13.852+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:10.642164+0000 front 2024-09-21T01:53:10.642202+0000 (oldest deadline 2024-09-21T01:53:35.342361+0000) 2024-09-21T01:54:14.218 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:54:13 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:54:13.852+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.83:6814 osd.3 since back 2024-09-21T01:53:20.043206+0000 front 2024-09-21T01:53:20.043253+0000 (oldest deadline 2024-09-21T01:53:41.643680+0000) 2024-09-21T01:54:14.218 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:54:13 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:54:13.852+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T01:53:27.445169+0000 front 2024-09-21T01:53:27.445227+0000 (oldest deadline 2024-09-21T01:53:50.345230+0000) 2024-09-21T01:54:14.218 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:54:13 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:54:13.852+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.142:6812 osd.5 since back 2024-09-21T01:53:31.446412+0000 front 2024-09-21T01:53:31.446298+0000 (oldest deadline 2024-09-21T01:53:57.346061+0000) 2024-09-21T01:54:14.218 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:54:13 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:54:13.852+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.83:6822 osd.6 since back 2024-09-21T01:53:40.147571+0000 front 2024-09-21T01:53:40.147548+0000 (oldest deadline 2024-09-21T01:54:08.947937+0000) 2024-09-21T01:54:14.965 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:54:14 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:54:14.682+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:55.996660+0000 front 2024-09-21T01:52:55.996645+0000 (oldest deadline 2024-09-21T01:53:21.296531+0000) 2024-09-21T01:54:14.965 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:54:14 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:54:14.682+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:03.597995+0000 front 2024-09-21T01:53:03.598011+0000 (oldest deadline 2024-09-21T01:53:28.297678+0000) 2024-09-21T01:54:14.965 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:54:14 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:54:14.682+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:09.398667+0000 front 2024-09-21T01:53:09.398643+0000 (oldest deadline 2024-09-21T01:53:34.698854+0000) 2024-09-21T01:54:14.965 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:54:14 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:54:14.682+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T01:53:26.400794+0000 front 2024-09-21T01:53:26.400993+0000 (oldest deadline 2024-09-21T01:53:51.100678+0000) 2024-09-21T01:54:14.965 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:54:14 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:54:14.682+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.142:6812 osd.5 since back 2024-09-21T01:53:34.601722+0000 front 2024-09-21T01:53:34.601778+0000 (oldest deadline 2024-09-21T01:53:58.101809+0000) 2024-09-21T01:54:14.965 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:54:14 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:54:14.682+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.83:6822 osd.6 since back 2024-09-21T01:53:44.503459+0000 front 2024-09-21T01:53:44.503434+0000 (oldest deadline 2024-09-21T01:54:06.203171+0000) 2024-09-21T01:54:14.965 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:54:14 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:54:14.682+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.119:6820 osd.7 since back 2024-09-21T01:53:48.404672+0000 front 2024-09-21T01:53:48.404596+0000 (oldest deadline 2024-09-21T01:54:14.304608+0000) 2024-09-21T01:54:15.217 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:54:14 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:54:14.836+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:52.739060+0000 front 2024-09-21T01:52:52.738919+0000 (oldest deadline 2024-09-21T01:53:18.038843+0000) 2024-09-21T01:54:15.218 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:54:14 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:54:14.836+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:03.740740+0000 front 2024-09-21T01:53:03.740797+0000 (oldest deadline 2024-09-21T01:53:26.040830+0000) 2024-09-21T01:54:15.218 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:54:14 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:54:14.836+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:10.642164+0000 front 2024-09-21T01:53:10.642202+0000 (oldest deadline 2024-09-21T01:53:35.342361+0000) 2024-09-21T01:54:15.218 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:54:14 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:54:14.836+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.83:6814 osd.3 since back 2024-09-21T01:53:20.043206+0000 front 2024-09-21T01:53:20.043253+0000 (oldest deadline 2024-09-21T01:53:41.643680+0000) 2024-09-21T01:54:15.218 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:54:14 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:54:14.836+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T01:53:27.445169+0000 front 2024-09-21T01:53:27.445227+0000 (oldest deadline 2024-09-21T01:53:50.345230+0000) 2024-09-21T01:54:15.218 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:54:14 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:54:14.836+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.142:6812 osd.5 since back 2024-09-21T01:53:31.446412+0000 front 2024-09-21T01:53:31.446298+0000 (oldest deadline 2024-09-21T01:53:57.346061+0000) 2024-09-21T01:54:15.218 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:54:14 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:54:14.836+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.83:6822 osd.6 since back 2024-09-21T01:53:40.147571+0000 front 2024-09-21T01:53:40.147548+0000 (oldest deadline 2024-09-21T01:54:08.947937+0000) 2024-09-21T01:54:15.964 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:54:15 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:54:15.637+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:55.996660+0000 front 2024-09-21T01:52:55.996645+0000 (oldest deadline 2024-09-21T01:53:21.296531+0000) 2024-09-21T01:54:15.965 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:54:15 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:54:15.637+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:03.597995+0000 front 2024-09-21T01:53:03.598011+0000 (oldest deadline 2024-09-21T01:53:28.297678+0000) 2024-09-21T01:54:15.965 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:54:15 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:54:15.637+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:09.398667+0000 front 2024-09-21T01:53:09.398643+0000 (oldest deadline 2024-09-21T01:53:34.698854+0000) 2024-09-21T01:54:15.965 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:54:15 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:54:15.637+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T01:53:26.400794+0000 front 2024-09-21T01:53:26.400993+0000 (oldest deadline 2024-09-21T01:53:51.100678+0000) 2024-09-21T01:54:15.965 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:54:15 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:54:15.637+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.142:6812 osd.5 since back 2024-09-21T01:53:34.601722+0000 front 2024-09-21T01:53:34.601778+0000 (oldest deadline 2024-09-21T01:53:58.101809+0000) 2024-09-21T01:54:15.965 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:54:15 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:54:15.637+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.83:6822 osd.6 since back 2024-09-21T01:53:44.503459+0000 front 2024-09-21T01:53:44.503434+0000 (oldest deadline 2024-09-21T01:54:06.203171+0000) 2024-09-21T01:54:15.965 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:54:15 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:54:15.637+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.119:6820 osd.7 since back 2024-09-21T01:53:48.404672+0000 front 2024-09-21T01:53:48.404596+0000 (oldest deadline 2024-09-21T01:54:14.304608+0000) 2024-09-21T01:54:16.218 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:54:15 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:54:15.831+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:52.739060+0000 front 2024-09-21T01:52:52.738919+0000 (oldest deadline 2024-09-21T01:53:18.038843+0000) 2024-09-21T01:54:16.218 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:54:15 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:54:15.831+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:03.740740+0000 front 2024-09-21T01:53:03.740797+0000 (oldest deadline 2024-09-21T01:53:26.040830+0000) 2024-09-21T01:54:16.218 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:54:15 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:54:15.831+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:10.642164+0000 front 2024-09-21T01:53:10.642202+0000 (oldest deadline 2024-09-21T01:53:35.342361+0000) 2024-09-21T01:54:16.218 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:54:15 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:54:15.831+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.83:6814 osd.3 since back 2024-09-21T01:53:20.043206+0000 front 2024-09-21T01:53:20.043253+0000 (oldest deadline 2024-09-21T01:53:41.643680+0000) 2024-09-21T01:54:16.218 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:54:15 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:54:15.831+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T01:53:27.445169+0000 front 2024-09-21T01:53:27.445227+0000 (oldest deadline 2024-09-21T01:53:50.345230+0000) 2024-09-21T01:54:16.218 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:54:15 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:54:15.831+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.142:6812 osd.5 since back 2024-09-21T01:53:31.446412+0000 front 2024-09-21T01:53:31.446298+0000 (oldest deadline 2024-09-21T01:53:57.346061+0000) 2024-09-21T01:54:16.218 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:54:15 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10[57590]: 2024-09-21T01:54:15.831+0000 7f733d3ff640 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.83:6822 osd.6 since back 2024-09-21T01:53:40.147571+0000 front 2024-09-21T01:53:40.147548+0000 (oldest deadline 2024-09-21T01:54:08.947937+0000) 2024-09-21T01:54:16.771 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:54:16 smithi119 podman[66986]: 2024-09-21 01:54:16.518678756 +0000 UTC m=+5.482705990 container died 9b4b13535aceed0071a5d439941240ae8dce177688ff65a00d4357cbdf123502 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731) 2024-09-21T01:54:16.965 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:54:16 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:54:16.682+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:55.996660+0000 front 2024-09-21T01:52:55.996645+0000 (oldest deadline 2024-09-21T01:53:21.296531+0000) 2024-09-21T01:54:16.965 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:54:16 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:54:16.682+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:03.597995+0000 front 2024-09-21T01:53:03.598011+0000 (oldest deadline 2024-09-21T01:53:28.297678+0000) 2024-09-21T01:54:16.965 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:54:16 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:54:16.682+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:09.398667+0000 front 2024-09-21T01:53:09.398643+0000 (oldest deadline 2024-09-21T01:53:34.698854+0000) 2024-09-21T01:54:16.965 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:54:16 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:54:16.682+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T01:53:26.400794+0000 front 2024-09-21T01:53:26.400993+0000 (oldest deadline 2024-09-21T01:53:51.100678+0000) 2024-09-21T01:54:16.965 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:54:16 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:54:16.682+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.142:6812 osd.5 since back 2024-09-21T01:53:34.601722+0000 front 2024-09-21T01:53:34.601778+0000 (oldest deadline 2024-09-21T01:53:58.101809+0000) 2024-09-21T01:54:16.965 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:54:16 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:54:16.682+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.83:6822 osd.6 since back 2024-09-21T01:53:44.503459+0000 front 2024-09-21T01:53:44.503434+0000 (oldest deadline 2024-09-21T01:54:06.203171+0000) 2024-09-21T01:54:16.965 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:54:16 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:54:16.682+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.119:6820 osd.7 since back 2024-09-21T01:53:48.404672+0000 front 2024-09-21T01:53:48.404596+0000 (oldest deadline 2024-09-21T01:54:14.304608+0000) 2024-09-21T01:54:17.121 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:54:16 smithi119 podman[66986]: 2024-09-21 01:54:16.88704898 +0000 UTC m=+5.851076209 container cleanup 9b4b13535aceed0071a5d439941240ae8dce177688ff65a00d4357cbdf123502 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T01:54:17.121 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:54:16 smithi119 bash[66986]: ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10 2024-09-21T01:54:17.455 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:54:17 smithi119 podman[67001]: 2024-09-21 01:54:17.121565 +0000 UTC m=+0.599280879 container remove 9b4b13535aceed0071a5d439941240ae8dce177688ff65a00d4357cbdf123502 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2) 2024-09-21T01:54:17.718 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:54:17 smithi119 podman[67089]: 2024-09-21 01:54:17.35770136 +0000 UTC m=+0.015638181 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T01:54:17.718 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:54:17 smithi119 podman[67089]: 2024-09-21 01:54:17.455741834 +0000 UTC m=+0.113678652 container create 2ead6d1cc0751e6fb32ffc256a90f89fd1752633ad6c6877d46c9e2edb358e46 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_CLEAN=True) 2024-09-21T01:54:17.718 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:54:17 smithi119 podman[67089]: 2024-09-21 01:54:17.683325443 +0000 UTC m=+0.341262266 container init 2ead6d1cc0751e6fb32ffc256a90f89fd1752633ad6c6877d46c9e2edb358e46 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10-deactivate, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, GIT_CLEAN=True) 2024-09-21T01:54:17.718 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:54:17 smithi119 podman[67089]: 2024-09-21 01:54:17.686631953 +0000 UTC m=+0.344568772 container start 2ead6d1cc0751e6fb32ffc256a90f89fd1752633ad6c6877d46c9e2edb358e46 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-09-21T01:54:17.964 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:54:17 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:54:17.690+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:55.996660+0000 front 2024-09-21T01:52:55.996645+0000 (oldest deadline 2024-09-21T01:53:21.296531+0000) 2024-09-21T01:54:17.965 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:54:17 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:54:17.690+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:03.597995+0000 front 2024-09-21T01:53:03.598011+0000 (oldest deadline 2024-09-21T01:53:28.297678+0000) 2024-09-21T01:54:17.965 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:54:17 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:54:17.690+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:09.398667+0000 front 2024-09-21T01:53:09.398643+0000 (oldest deadline 2024-09-21T01:53:34.698854+0000) 2024-09-21T01:54:17.965 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:54:17 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:54:17.690+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T01:53:26.400794+0000 front 2024-09-21T01:53:26.400993+0000 (oldest deadline 2024-09-21T01:53:51.100678+0000) 2024-09-21T01:54:17.965 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:54:17 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:54:17.690+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.142:6812 osd.5 since back 2024-09-21T01:53:34.601722+0000 front 2024-09-21T01:53:34.601778+0000 (oldest deadline 2024-09-21T01:53:58.101809+0000) 2024-09-21T01:54:17.965 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:54:17 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:54:17.690+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.83:6822 osd.6 since back 2024-09-21T01:53:44.503459+0000 front 2024-09-21T01:53:44.503434+0000 (oldest deadline 2024-09-21T01:54:06.203171+0000) 2024-09-21T01:54:17.965 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:54:17 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:54:17.690+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.119:6820 osd.7 since back 2024-09-21T01:53:48.404672+0000 front 2024-09-21T01:53:48.404596+0000 (oldest deadline 2024-09-21T01:54:14.304608+0000) 2024-09-21T01:54:18.161 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:54:17 smithi119 podman[67089]: 2024-09-21 01:54:17.766534722 +0000 UTC m=+0.424471559 container attach 2ead6d1cc0751e6fb32ffc256a90f89fd1752633ad6c6877d46c9e2edb358e46 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10-deactivate, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-21T01:54:18.161 INFO:journalctl@ceph.osd.10.smithi119.stdout:Sep 21 01:54:17 smithi119 podman[67089]: 2024-09-21 01:54:17.874871428 +0000 UTC m=+0.532808245 container died 2ead6d1cc0751e6fb32ffc256a90f89fd1752633ad6c6877d46c9e2edb358e46 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-10-deactivate, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-21T01:54:18.469 DEBUG:teuthology.orchestra.run.smithi119:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f7697ecc-77b8-11ef-baf5-efdc52797490@osd.10.service' 2024-09-21T01:54:18.505 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T01:54:18.505 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-09-21T01:54:18.505 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-09-21T01:54:18.505 DEBUG:teuthology.orchestra.run.smithi142:> sudo systemctl stop ceph-f7697ecc-77b8-11ef-baf5-efdc52797490@osd.11 2024-09-21T01:54:18.822 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:54:18 smithi142 systemd[1]: Stopping Ceph osd.11 for f7697ecc-77b8-11ef-baf5-efdc52797490... 2024-09-21T01:54:18.822 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:54:18 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:54:18.732+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:55.996660+0000 front 2024-09-21T01:52:55.996645+0000 (oldest deadline 2024-09-21T01:53:21.296531+0000) 2024-09-21T01:54:18.822 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:54:18 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:54:18.732+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:03.597995+0000 front 2024-09-21T01:53:03.598011+0000 (oldest deadline 2024-09-21T01:53:28.297678+0000) 2024-09-21T01:54:18.822 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:54:18 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:54:18.732+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:09.398667+0000 front 2024-09-21T01:53:09.398643+0000 (oldest deadline 2024-09-21T01:53:34.698854+0000) 2024-09-21T01:54:18.822 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:54:18 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:54:18.732+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T01:53:26.400794+0000 front 2024-09-21T01:53:26.400993+0000 (oldest deadline 2024-09-21T01:53:51.100678+0000) 2024-09-21T01:54:18.822 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:54:18 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:54:18.732+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.142:6812 osd.5 since back 2024-09-21T01:53:34.601722+0000 front 2024-09-21T01:53:34.601778+0000 (oldest deadline 2024-09-21T01:53:58.101809+0000) 2024-09-21T01:54:18.822 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:54:18 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:54:18.732+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.83:6822 osd.6 since back 2024-09-21T01:53:44.503459+0000 front 2024-09-21T01:53:44.503434+0000 (oldest deadline 2024-09-21T01:54:06.203171+0000) 2024-09-21T01:54:18.822 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:54:18 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:54:18.732+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.119:6820 osd.7 since back 2024-09-21T01:53:48.404672+0000 front 2024-09-21T01:53:48.404596+0000 (oldest deadline 2024-09-21T01:54:14.304608+0000) 2024-09-21T01:54:18.822 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:54:18 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:54:18.820+0000 7fb20cb38640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T01:54:18.823 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:54:18 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:54:18.820+0000 7fb20cb38640 -1 osd.11 98 *** Got signal Terminated *** 2024-09-21T01:54:18.823 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:54:18 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:54:18.820+0000 7fb20cb38640 -1 osd.11 98 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T01:54:20.215 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:54:19 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:54:19.726+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:55.996660+0000 front 2024-09-21T01:52:55.996645+0000 (oldest deadline 2024-09-21T01:53:21.296531+0000) 2024-09-21T01:54:20.215 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:54:19 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:54:19.726+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:03.597995+0000 front 2024-09-21T01:53:03.598011+0000 (oldest deadline 2024-09-21T01:53:28.297678+0000) 2024-09-21T01:54:20.215 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:54:19 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:54:19.726+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:09.398667+0000 front 2024-09-21T01:53:09.398643+0000 (oldest deadline 2024-09-21T01:53:34.698854+0000) 2024-09-21T01:54:20.215 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:54:19 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:54:19.726+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T01:53:26.400794+0000 front 2024-09-21T01:53:26.400993+0000 (oldest deadline 2024-09-21T01:53:51.100678+0000) 2024-09-21T01:54:20.215 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:54:19 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:54:19.726+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.142:6812 osd.5 since back 2024-09-21T01:53:34.601722+0000 front 2024-09-21T01:53:34.601778+0000 (oldest deadline 2024-09-21T01:53:58.101809+0000) 2024-09-21T01:54:20.215 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:54:19 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:54:19.726+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.83:6822 osd.6 since back 2024-09-21T01:53:44.503459+0000 front 2024-09-21T01:53:44.503434+0000 (oldest deadline 2024-09-21T01:54:06.203171+0000) 2024-09-21T01:54:20.215 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:54:19 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:54:19.726+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.119:6820 osd.7 since back 2024-09-21T01:53:48.404672+0000 front 2024-09-21T01:53:48.404596+0000 (oldest deadline 2024-09-21T01:54:14.304608+0000) 2024-09-21T01:54:21.215 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:54:20 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:54:20.717+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:55.996660+0000 front 2024-09-21T01:52:55.996645+0000 (oldest deadline 2024-09-21T01:53:21.296531+0000) 2024-09-21T01:54:21.215 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:54:20 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:54:20.717+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:03.597995+0000 front 2024-09-21T01:53:03.598011+0000 (oldest deadline 2024-09-21T01:53:28.297678+0000) 2024-09-21T01:54:21.215 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:54:20 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:54:20.717+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:09.398667+0000 front 2024-09-21T01:53:09.398643+0000 (oldest deadline 2024-09-21T01:53:34.698854+0000) 2024-09-21T01:54:21.215 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:54:20 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:54:20.717+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T01:53:26.400794+0000 front 2024-09-21T01:53:26.400993+0000 (oldest deadline 2024-09-21T01:53:51.100678+0000) 2024-09-21T01:54:21.215 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:54:20 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:54:20.717+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.142:6812 osd.5 since back 2024-09-21T01:53:34.601722+0000 front 2024-09-21T01:53:34.601778+0000 (oldest deadline 2024-09-21T01:53:58.101809+0000) 2024-09-21T01:54:21.215 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:54:20 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:54:20.717+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.83:6822 osd.6 since back 2024-09-21T01:53:44.503459+0000 front 2024-09-21T01:53:44.503434+0000 (oldest deadline 2024-09-21T01:54:06.203171+0000) 2024-09-21T01:54:21.215 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:54:20 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:54:20.717+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.119:6820 osd.7 since back 2024-09-21T01:53:48.404672+0000 front 2024-09-21T01:53:48.404596+0000 (oldest deadline 2024-09-21T01:54:14.304608+0000) 2024-09-21T01:54:21.965 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:54:21 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:54:21.675+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:55.996660+0000 front 2024-09-21T01:52:55.996645+0000 (oldest deadline 2024-09-21T01:53:21.296531+0000) 2024-09-21T01:54:21.966 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:54:21 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:54:21.675+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:03.597995+0000 front 2024-09-21T01:53:03.598011+0000 (oldest deadline 2024-09-21T01:53:28.297678+0000) 2024-09-21T01:54:21.966 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:54:21 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:54:21.675+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:09.398667+0000 front 2024-09-21T01:53:09.398643+0000 (oldest deadline 2024-09-21T01:53:34.698854+0000) 2024-09-21T01:54:21.966 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:54:21 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:54:21.675+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T01:53:26.400794+0000 front 2024-09-21T01:53:26.400993+0000 (oldest deadline 2024-09-21T01:53:51.100678+0000) 2024-09-21T01:54:21.966 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:54:21 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:54:21.675+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.142:6812 osd.5 since back 2024-09-21T01:53:34.601722+0000 front 2024-09-21T01:53:34.601778+0000 (oldest deadline 2024-09-21T01:53:58.101809+0000) 2024-09-21T01:54:21.966 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:54:21 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:54:21.675+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.83:6822 osd.6 since back 2024-09-21T01:53:44.503459+0000 front 2024-09-21T01:53:44.503434+0000 (oldest deadline 2024-09-21T01:54:06.203171+0000) 2024-09-21T01:54:21.966 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:54:21 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:54:21.675+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.119:6820 osd.7 since back 2024-09-21T01:53:48.404672+0000 front 2024-09-21T01:53:48.404596+0000 (oldest deadline 2024-09-21T01:54:14.304608+0000) 2024-09-21T01:54:22.964 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:54:22 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:54:22.629+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:55.996660+0000 front 2024-09-21T01:52:55.996645+0000 (oldest deadline 2024-09-21T01:53:21.296531+0000) 2024-09-21T01:54:22.965 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:54:22 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:54:22.629+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:03.597995+0000 front 2024-09-21T01:53:03.598011+0000 (oldest deadline 2024-09-21T01:53:28.297678+0000) 2024-09-21T01:54:22.965 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:54:22 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:54:22.629+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:09.398667+0000 front 2024-09-21T01:53:09.398643+0000 (oldest deadline 2024-09-21T01:53:34.698854+0000) 2024-09-21T01:54:22.965 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:54:22 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:54:22.629+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T01:53:26.400794+0000 front 2024-09-21T01:53:26.400993+0000 (oldest deadline 2024-09-21T01:53:51.100678+0000) 2024-09-21T01:54:22.965 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:54:22 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:54:22.629+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.142:6812 osd.5 since back 2024-09-21T01:53:34.601722+0000 front 2024-09-21T01:53:34.601778+0000 (oldest deadline 2024-09-21T01:53:58.101809+0000) 2024-09-21T01:54:22.965 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:54:22 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:54:22.629+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.83:6822 osd.6 since back 2024-09-21T01:53:44.503459+0000 front 2024-09-21T01:53:44.503434+0000 (oldest deadline 2024-09-21T01:54:06.203171+0000) 2024-09-21T01:54:22.965 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:54:22 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:54:22.629+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.119:6820 osd.7 since back 2024-09-21T01:53:48.404672+0000 front 2024-09-21T01:53:48.404596+0000 (oldest deadline 2024-09-21T01:54:14.304608+0000) 2024-09-21T01:54:23.965 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:54:23 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:54:23.608+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.83:6806 osd.0 since back 2024-09-21T01:52:55.996660+0000 front 2024-09-21T01:52:55.996645+0000 (oldest deadline 2024-09-21T01:53:21.296531+0000) 2024-09-21T01:54:23.965 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:54:23 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:54:23.608+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.119:6804 osd.1 since back 2024-09-21T01:53:03.597995+0000 front 2024-09-21T01:53:03.598011+0000 (oldest deadline 2024-09-21T01:53:28.297678+0000) 2024-09-21T01:54:23.965 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:54:23 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:54:23.608+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.142:6804 osd.2 since back 2024-09-21T01:53:09.398667+0000 front 2024-09-21T01:53:09.398643+0000 (oldest deadline 2024-09-21T01:53:34.698854+0000) 2024-09-21T01:54:23.965 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:54:23 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:54:23.608+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.119:6812 osd.4 since back 2024-09-21T01:53:26.400794+0000 front 2024-09-21T01:53:26.400993+0000 (oldest deadline 2024-09-21T01:53:51.100678+0000) 2024-09-21T01:54:23.965 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:54:23 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:54:23.608+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.142:6812 osd.5 since back 2024-09-21T01:53:34.601722+0000 front 2024-09-21T01:53:34.601778+0000 (oldest deadline 2024-09-21T01:53:58.101809+0000) 2024-09-21T01:54:23.965 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:54:23 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:54:23.608+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.83:6822 osd.6 since back 2024-09-21T01:53:44.503459+0000 front 2024-09-21T01:53:44.503434+0000 (oldest deadline 2024-09-21T01:54:06.203171+0000) 2024-09-21T01:54:23.965 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:54:23 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11[58445]: 2024-09-21T01:54:23.608+0000 7fb209123640 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.119:6820 osd.7 since back 2024-09-21T01:53:48.404672+0000 front 2024-09-21T01:53:48.404596+0000 (oldest deadline 2024-09-21T01:54:14.304608+0000) 2024-09-21T01:54:24.545 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:54:24 smithi142 podman[67973]: 2024-09-21 01:54:24.227303295 +0000 UTC m=+5.522490852 container died b4934d3db0c5828b24795131e94dce88ab78c2bfdfba9344afcd8d2fedba96fc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2) 2024-09-21T01:54:24.546 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:54:24 smithi142 podman[67973]: 2024-09-21 01:54:24.545662268 +0000 UTC m=+5.840849810 container cleanup b4934d3db0c5828b24795131e94dce88ab78c2bfdfba9344afcd8d2fedba96fc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T01:54:24.964 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:54:24 smithi142 bash[67973]: ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11 2024-09-21T01:54:24.964 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:54:24 smithi142 podman[67988]: 2024-09-21 01:54:24.755471882 +0000 UTC m=+0.522069329 container remove b4934d3db0c5828b24795131e94dce88ab78c2bfdfba9344afcd8d2fedba96fc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-21T01:54:25.450 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:54:25 smithi142 podman[68078]: 2024-09-21 01:54:25.059103961 +0000 UTC m=+0.016012717 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T01:54:25.450 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:54:25 smithi142 podman[68078]: 2024-09-21 01:54:25.164758517 +0000 UTC m=+0.121667304 container create 1366dc47339d920706625d9e5751e09e4a0c8aacf46438d50395604ff805ba8e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11-deactivate, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T01:54:25.451 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:54:25 smithi142 podman[68078]: 2024-09-21 01:54:25.37532223 +0000 UTC m=+0.332230996 container init 1366dc47339d920706625d9e5751e09e4a0c8aacf46438d50395604ff805ba8e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11-deactivate, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T01:54:25.451 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:54:25 smithi142 podman[68078]: 2024-09-21 01:54:25.378705866 +0000 UTC m=+0.335614607 container start 1366dc47339d920706625d9e5751e09e4a0c8aacf46438d50395604ff805ba8e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11-deactivate, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-09-21T01:54:25.451 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:54:25 smithi142 podman[68078]: 2024-09-21 01:54:25.45012095 +0000 UTC m=+0.407029703 container attach 1366dc47339d920706625d9e5751e09e4a0c8aacf46438d50395604ff805ba8e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11-deactivate, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-09-21T01:54:25.715 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:54:25 smithi142 podman[68078]: 2024-09-21 01:54:25.570393989 +0000 UTC m=+0.527302736 container died 1366dc47339d920706625d9e5751e09e4a0c8aacf46438d50395604ff805ba8e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11-deactivate, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731) 2024-09-21T01:54:26.127 INFO:journalctl@ceph.osd.11.smithi142.stdout:Sep 21 01:54:26 smithi142 podman[68101]: 2024-09-21 01:54:26.103202138 +0000 UTC m=+0.527720705 container remove 1366dc47339d920706625d9e5751e09e4a0c8aacf46438d50395604ff805ba8e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-osd-11-deactivate, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731) 2024-09-21T01:54:26.132 DEBUG:teuthology.orchestra.run.smithi142:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f7697ecc-77b8-11ef-baf5-efdc52797490@osd.11.service' 2024-09-21T01:54:26.169 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T01:54:26.169 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-09-21T01:54:26.169 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-09-21T01:54:26.169 DEBUG:teuthology.orchestra.run.smithi083:> sudo systemctl stop ceph-f7697ecc-77b8-11ef-baf5-efdc52797490@mds.a 2024-09-21T01:54:26.473 INFO:journalctl@ceph.mds.a.smithi083.stdout:Sep 21 01:54:26 smithi083 systemd[1]: Stopping Ceph mds.a for f7697ecc-77b8-11ef-baf5-efdc52797490... 2024-09-21T01:54:26.803 INFO:journalctl@ceph.mds.a.smithi083.stdout:Sep 21 01:54:26 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mds-a[74146]: 2024-09-21T01:54:26.472+0000 7fa9cccad640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T01:54:26.803 INFO:journalctl@ceph.mds.a.smithi083.stdout:Sep 21 01:54:26 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mds-a[74146]: 2024-09-21T01:54:26.472+0000 7fa9cccad640 -1 mds.a *** got signal Terminated *** 2024-09-21T01:54:28.715 INFO:journalctl@ceph.mds.a.smithi083.stdout:Sep 21 01:54:28 smithi083 podman[94945]: 2024-09-21 01:54:28.449066969 +0000 UTC m=+2.071411510 container died 7a0c36cd773c7dca9a869a51c7f169cc2fc826ec5be50e67eff583e657783eaa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mds-a, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-09-21T01:54:28.973 INFO:journalctl@ceph.mds.a.smithi083.stdout:Sep 21 01:54:28 smithi083 podman[94945]: 2024-09-21 01:54:28.789149145 +0000 UTC m=+2.411493681 container cleanup 7a0c36cd773c7dca9a869a51c7f169cc2fc826ec5be50e67eff583e657783eaa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mds-a, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-21T01:54:28.973 INFO:journalctl@ceph.mds.a.smithi083.stdout:Sep 21 01:54:28 smithi083 bash[94945]: ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mds-a 2024-09-21T01:54:29.220 DEBUG:teuthology.orchestra.run.smithi083:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f7697ecc-77b8-11ef-baf5-efdc52797490@mds.a.service' 2024-09-21T01:54:29.242 INFO:journalctl@ceph.mds.a.smithi083.stdout:Sep 21 01:54:28 smithi083 podman[94958]: 2024-09-21 01:54:28.973634703 +0000 UTC m=+0.519501868 container remove 7a0c36cd773c7dca9a869a51c7f169cc2fc826ec5be50e67eff583e657783eaa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mds-a, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2) 2024-09-21T01:54:29.242 INFO:journalctl@ceph.mds.a.smithi083.stdout:Sep 21 01:54:29 smithi083 systemd[1]: ceph-f7697ecc-77b8-11ef-baf5-efdc52797490@mds.a.service: Deactivated successfully. 2024-09-21T01:54:29.242 INFO:journalctl@ceph.mds.a.smithi083.stdout:Sep 21 01:54:29 smithi083 systemd[1]: Stopped Ceph mds.a for f7697ecc-77b8-11ef-baf5-efdc52797490. 2024-09-21T01:54:29.242 INFO:journalctl@ceph.mds.a.smithi083.stdout:Sep 21 01:54:29 smithi083 systemd[1]: ceph-f7697ecc-77b8-11ef-baf5-efdc52797490@mds.a.service: Consumed 1.059s CPU time. 2024-09-21T01:54:29.254 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T01:54:29.254 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-09-21T01:54:29.254 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-09-21T01:54:29.255 DEBUG:teuthology.orchestra.run.smithi083:> sudo systemctl stop ceph-f7697ecc-77b8-11ef-baf5-efdc52797490@mds.d 2024-09-21T01:54:29.553 INFO:journalctl@ceph.mds.d.smithi083.stdout:Sep 21 01:54:29 smithi083 systemd[1]: Stopping Ceph mds.d for f7697ecc-77b8-11ef-baf5-efdc52797490... 2024-09-21T01:54:30.054 INFO:journalctl@ceph.mds.d.smithi083.stdout:Sep 21 01:54:29 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mds-d[73024]: 2024-09-21T01:54:29.575+0000 7f25e0bde640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T01:54:30.054 INFO:journalctl@ceph.mds.d.smithi083.stdout:Sep 21 01:54:29 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mds-d[73024]: 2024-09-21T01:54:29.575+0000 7f25e0bde640 -1 mds.d *** got signal Terminated *** 2024-09-21T01:54:33.693 INFO:journalctl@ceph.mds.d.smithi083.stdout:Sep 21 01:54:33 smithi083 podman[95067]: 2024-09-21 01:54:33.418837389 +0000 UTC m=+3.944640448 container died 0362213760c23ab75f8d4380746d4bb0891727f0567ab0416d15c191b06ab8eb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mds-d, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-21T01:54:34.053 INFO:journalctl@ceph.mds.d.smithi083.stdout:Sep 21 01:54:33 smithi083 podman[95067]: 2024-09-21 01:54:33.776473086 +0000 UTC m=+4.302276137 container cleanup 0362213760c23ab75f8d4380746d4bb0891727f0567ab0416d15c191b06ab8eb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mds-d, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-09-21T01:54:34.054 INFO:journalctl@ceph.mds.d.smithi083.stdout:Sep 21 01:54:33 smithi083 bash[95067]: ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mds-d 2024-09-21T01:54:34.348 DEBUG:teuthology.orchestra.run.smithi083:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f7697ecc-77b8-11ef-baf5-efdc52797490@mds.d.service' 2024-09-21T01:54:34.379 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T01:54:34.379 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-09-21T01:54:34.380 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-09-21T01:54:34.380 DEBUG:teuthology.orchestra.run.smithi083:> sudo systemctl stop ceph-f7697ecc-77b8-11ef-baf5-efdc52797490@mds.g 2024-09-21T01:54:34.804 INFO:journalctl@ceph.mds.g.smithi083.stdout:Sep 21 01:54:34 smithi083 systemd[1]: Stopping Ceph mds.g for f7697ecc-77b8-11ef-baf5-efdc52797490... 2024-09-21T01:54:34.804 INFO:journalctl@ceph.mds.g.smithi083.stdout:Sep 21 01:54:34 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mds-g[73764]: 2024-09-21T01:54:34.686+0000 7f9769038640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T01:54:34.804 INFO:journalctl@ceph.mds.g.smithi083.stdout:Sep 21 01:54:34 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mds-g[73764]: 2024-09-21T01:54:34.686+0000 7f9769038640 -1 mds.g *** got signal Terminated *** 2024-09-21T01:54:37.081 INFO:journalctl@ceph.mds.g.smithi083.stdout:Sep 21 01:54:36 smithi083 podman[95188]: 2024-09-21 01:54:36.823124977 +0000 UTC m=+2.227486168 container died 916c01e0c41057f9bbaf94125d16f4ba8b47c57137fb3f01c57dcb61306b3e6a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mds-g, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T01:54:37.423 INFO:journalctl@ceph.mds.g.smithi083.stdout:Sep 21 01:54:37 smithi083 podman[95188]: 2024-09-21 01:54:37.180078067 +0000 UTC m=+2.584439293 container cleanup 916c01e0c41057f9bbaf94125d16f4ba8b47c57137fb3f01c57dcb61306b3e6a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mds-g, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-09-21T01:54:37.423 INFO:journalctl@ceph.mds.g.smithi083.stdout:Sep 21 01:54:37 smithi083 bash[95188]: ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mds-g 2024-09-21T01:54:37.561 DEBUG:teuthology.orchestra.run.smithi083:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f7697ecc-77b8-11ef-baf5-efdc52797490@mds.g.service' 2024-09-21T01:54:37.592 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T01:54:37.592 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-09-21T01:54:37.592 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-09-21T01:54:37.592 DEBUG:teuthology.orchestra.run.smithi083:> sudo systemctl stop ceph-f7697ecc-77b8-11ef-baf5-efdc52797490@mds.j 2024-09-21T01:54:38.054 INFO:journalctl@ceph.mds.j.smithi083.stdout:Sep 21 01:54:37 smithi083 systemd[1]: Stopping Ceph mds.j for f7697ecc-77b8-11ef-baf5-efdc52797490... 2024-09-21T01:54:38.054 INFO:journalctl@ceph.mds.j.smithi083.stdout:Sep 21 01:54:37 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mds-j[72639]: 2024-09-21T01:54:37.900+0000 7f8cc6758640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T01:54:38.054 INFO:journalctl@ceph.mds.j.smithi083.stdout:Sep 21 01:54:37 smithi083 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mds-j[72639]: 2024-09-21T01:54:37.900+0000 7f8cc6758640 -1 mds.j *** got signal Terminated *** 2024-09-21T01:54:41.984 INFO:journalctl@ceph.mds.j.smithi083.stdout:Sep 21 01:54:41 smithi083 podman[95309]: 2024-09-21 01:54:41.732624176 +0000 UTC m=+3.916055490 container died d15b41d88073d285d4ddac8fdd3b07b21d1954a719f2132c33ca76b031920f9b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mds-j, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2) 2024-09-21T01:54:42.304 INFO:journalctl@ceph.mds.j.smithi083.stdout:Sep 21 01:54:42 smithi083 podman[95309]: 2024-09-21 01:54:42.083730911 +0000 UTC m=+4.267162215 container cleanup d15b41d88073d285d4ddac8fdd3b07b21d1954a719f2132c33ca76b031920f9b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mds-j, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-21T01:54:42.304 INFO:journalctl@ceph.mds.j.smithi083.stdout:Sep 21 01:54:42 smithi083 bash[95309]: ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mds-j 2024-09-21T01:54:42.496 DEBUG:teuthology.orchestra.run.smithi083:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f7697ecc-77b8-11ef-baf5-efdc52797490@mds.j.service' 2024-09-21T01:54:42.527 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T01:54:42.527 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-09-21T01:54:42.527 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-09-21T01:54:42.527 DEBUG:teuthology.orchestra.run.smithi119:> sudo systemctl stop ceph-f7697ecc-77b8-11ef-baf5-efdc52797490@mds.b 2024-09-21T01:54:42.820 INFO:journalctl@ceph.mds.b.smithi119.stdout:Sep 21 01:54:42 smithi119 systemd[1]: Stopping Ceph mds.b for f7697ecc-77b8-11ef-baf5-efdc52797490... 2024-09-21T01:54:43.076 INFO:journalctl@ceph.mds.b.smithi119.stdout:Sep 21 01:54:42 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mds-b[62910]: 2024-09-21T01:54:42.819+0000 7fd43d631640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T01:54:43.076 INFO:journalctl@ceph.mds.b.smithi119.stdout:Sep 21 01:54:42 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mds-b[62910]: 2024-09-21T01:54:42.819+0000 7fd43d631640 -1 mds.b *** got signal Terminated *** 2024-09-21T01:54:47.146 INFO:journalctl@ceph.mds.b.smithi119.stdout:Sep 21 01:54:46 smithi119 podman[67193]: 2024-09-21 01:54:46.836703632 +0000 UTC m=+4.121215239 container died 13a7f0fdc45c8a56ad820582decdb2d427a512169199d67a0e538926450c1aaa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mds-b, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , ceph=True) 2024-09-21T01:54:47.454 INFO:journalctl@ceph.mds.b.smithi119.stdout:Sep 21 01:54:47 smithi119 podman[67193]: 2024-09-21 01:54:47.236474631 +0000 UTC m=+4.520986225 container cleanup 13a7f0fdc45c8a56ad820582decdb2d427a512169199d67a0e538926450c1aaa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mds-b, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-21T01:54:47.454 INFO:journalctl@ceph.mds.b.smithi119.stdout:Sep 21 01:54:47 smithi119 bash[67193]: ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mds-b 2024-09-21T01:54:47.590 DEBUG:teuthology.orchestra.run.smithi119:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f7697ecc-77b8-11ef-baf5-efdc52797490@mds.b.service' 2024-09-21T01:54:47.624 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T01:54:47.625 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-09-21T01:54:47.625 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-09-21T01:54:47.625 DEBUG:teuthology.orchestra.run.smithi119:> sudo systemctl stop ceph-f7697ecc-77b8-11ef-baf5-efdc52797490@mds.e 2024-09-21T01:54:47.717 INFO:journalctl@ceph.mds.e.smithi119.stdout:Sep 21 01:54:47 smithi119 systemd[1]: Stopping Ceph mds.e for f7697ecc-77b8-11ef-baf5-efdc52797490... 2024-09-21T01:54:48.217 INFO:journalctl@ceph.mds.e.smithi119.stdout:Sep 21 01:54:47 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mds-e[62363]: 2024-09-21T01:54:47.948+0000 7fdc37d30640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T01:54:48.218 INFO:journalctl@ceph.mds.e.smithi119.stdout:Sep 21 01:54:47 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mds-e[62363]: 2024-09-21T01:54:47.948+0000 7fdc37d30640 -1 mds.e *** got signal Terminated *** 2024-09-21T01:54:52.217 INFO:journalctl@ceph.mds.e.smithi119.stdout:Sep 21 01:54:51 smithi119 podman[67324]: 2024-09-21 01:54:51.954886278 +0000 UTC m=+4.112830037 container died c478ffa752086d26ae404d35f35254ad2b4ec6a12633617ba31b09326b9e50f7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mds-e, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T01:54:52.558 INFO:journalctl@ceph.mds.e.smithi119.stdout:Sep 21 01:54:52 smithi119 podman[67324]: 2024-09-21 01:54:52.357029524 +0000 UTC m=+4.514973272 container cleanup c478ffa752086d26ae404d35f35254ad2b4ec6a12633617ba31b09326b9e50f7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mds-e, org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T01:54:52.558 INFO:journalctl@ceph.mds.e.smithi119.stdout:Sep 21 01:54:52 smithi119 bash[67324]: ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mds-e 2024-09-21T01:54:52.688 DEBUG:teuthology.orchestra.run.smithi119:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f7697ecc-77b8-11ef-baf5-efdc52797490@mds.e.service' 2024-09-21T01:54:52.720 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T01:54:52.720 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-09-21T01:54:52.720 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-09-21T01:54:52.720 DEBUG:teuthology.orchestra.run.smithi119:> sudo systemctl stop ceph-f7697ecc-77b8-11ef-baf5-efdc52797490@mds.h 2024-09-21T01:54:52.968 INFO:journalctl@ceph.mds.h.smithi119.stdout:Sep 21 01:54:52 smithi119 systemd[1]: Stopping Ceph mds.h for f7697ecc-77b8-11ef-baf5-efdc52797490... 2024-09-21T01:54:53.467 INFO:journalctl@ceph.mds.h.smithi119.stdout:Sep 21 01:54:53 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mds-h[62632]: 2024-09-21T01:54:53.061+0000 7f472e2f2640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T01:54:53.468 INFO:journalctl@ceph.mds.h.smithi119.stdout:Sep 21 01:54:53 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mds-h[62632]: 2024-09-21T01:54:53.061+0000 7f472e2f2640 -1 mds.h *** got signal Terminated *** 2024-09-21T01:54:56.103 INFO:journalctl@ceph.mds.h.smithi119.stdout:Sep 21 01:54:55 smithi119 podman[67445]: 2024-09-21 01:54:55.781323258 +0000 UTC m=+2.845516588 container died 774eb2d30891599d03e60601a9a334b92c5a31f220353945bf97b9d61f5b4f87 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mds-h, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-21T01:54:56.470 INFO:journalctl@ceph.mds.h.smithi119.stdout:Sep 21 01:54:56 smithi119 podman[67445]: 2024-09-21 01:54:56.102433627 +0000 UTC m=+3.166626987 container cleanup 774eb2d30891599d03e60601a9a334b92c5a31f220353945bf97b9d61f5b4f87 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mds-h, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-09-21T01:54:56.470 INFO:journalctl@ceph.mds.h.smithi119.stdout:Sep 21 01:54:56 smithi119 bash[67445]: ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mds-h 2024-09-21T01:54:56.470 INFO:journalctl@ceph.mds.h.smithi119.stdout:Sep 21 01:54:56 smithi119 podman[67457]: 2024-09-21 01:54:56.31220759 +0000 UTC m=+0.524921733 container remove 774eb2d30891599d03e60601a9a334b92c5a31f220353945bf97b9d61f5b4f87 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mds-h, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T01:54:56.536 DEBUG:teuthology.orchestra.run.smithi119:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f7697ecc-77b8-11ef-baf5-efdc52797490@mds.h.service' 2024-09-21T01:54:56.568 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T01:54:56.568 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-09-21T01:54:56.569 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-09-21T01:54:56.569 DEBUG:teuthology.orchestra.run.smithi119:> sudo systemctl stop ceph-f7697ecc-77b8-11ef-baf5-efdc52797490@mds.k 2024-09-21T01:54:56.898 INFO:journalctl@ceph.mds.k.smithi119.stdout:Sep 21 01:54:56 smithi119 systemd[1]: Stopping Ceph mds.k for f7697ecc-77b8-11ef-baf5-efdc52797490... 2024-09-21T01:54:57.217 INFO:journalctl@ceph.mds.k.smithi119.stdout:Sep 21 01:54:56 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mds-k[62082]: 2024-09-21T01:54:56.898+0000 7f3e33088640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T01:54:57.218 INFO:journalctl@ceph.mds.k.smithi119.stdout:Sep 21 01:54:56 smithi119 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mds-k[62082]: 2024-09-21T01:54:56.898+0000 7f3e33088640 -1 mds.k *** got signal Terminated *** 2024-09-21T01:54:58.599 INFO:journalctl@ceph.mds.k.smithi119.stdout:Sep 21 01:54:58 smithi119 podman[67569]: 2024-09-21 01:54:58.340339106 +0000 UTC m=+1.542179836 container died cba2f40bb2335a07e732bdbe6decac242985d16970f89abb1d19b149cb039b1d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mds-k, ceph=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-09-21T01:54:58.968 INFO:journalctl@ceph.mds.k.smithi119.stdout:Sep 21 01:54:58 smithi119 podman[67569]: 2024-09-21 01:54:58.681555824 +0000 UTC m=+1.883396553 container cleanup cba2f40bb2335a07e732bdbe6decac242985d16970f89abb1d19b149cb039b1d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mds-k, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-09-21T01:54:58.968 INFO:journalctl@ceph.mds.k.smithi119.stdout:Sep 21 01:54:58 smithi119 bash[67569]: ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mds-k 2024-09-21T01:54:58.968 INFO:journalctl@ceph.mds.k.smithi119.stdout:Sep 21 01:54:58 smithi119 podman[67581]: 2024-09-21 01:54:58.815787718 +0000 UTC m=+0.474614951 container remove cba2f40bb2335a07e732bdbe6decac242985d16970f89abb1d19b149cb039b1d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mds-k, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T01:54:59.028 DEBUG:teuthology.orchestra.run.smithi119:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f7697ecc-77b8-11ef-baf5-efdc52797490@mds.k.service' 2024-09-21T01:54:59.059 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T01:54:59.060 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-09-21T01:54:59.060 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-09-21T01:54:59.060 DEBUG:teuthology.orchestra.run.smithi142:> sudo systemctl stop ceph-f7697ecc-77b8-11ef-baf5-efdc52797490@mds.c 2024-09-21T01:54:59.353 INFO:journalctl@ceph.mds.c.smithi142.stdout:Sep 21 01:54:59 smithi142 systemd[1]: Stopping Ceph mds.c for f7697ecc-77b8-11ef-baf5-efdc52797490... 2024-09-21T01:54:59.611 INFO:journalctl@ceph.mds.c.smithi142.stdout:Sep 21 01:54:59 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mds-c[63527]: 2024-09-21T01:54:59.352+0000 7f66426cd640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T01:54:59.611 INFO:journalctl@ceph.mds.c.smithi142.stdout:Sep 21 01:54:59 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mds-c[63527]: 2024-09-21T01:54:59.352+0000 7f66426cd640 -1 mds.c *** got signal Terminated *** 2024-09-21T01:55:01.361 INFO:journalctl@ceph.mds.c.smithi142.stdout:Sep 21 01:55:01 smithi142 podman[68181]: 2024-09-21 01:55:01.093519788 +0000 UTC m=+1.840823278 container died 98e7d6abd2f896e49169529501ab1894466d97aebc8eb0b733372c1f8f994abd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mds-c, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T01:55:01.711 INFO:journalctl@ceph.mds.c.smithi142.stdout:Sep 21 01:55:01 smithi142 podman[68181]: 2024-09-21 01:55:01.451917124 +0000 UTC m=+2.199220613 container cleanup 98e7d6abd2f896e49169529501ab1894466d97aebc8eb0b733372c1f8f994abd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mds-c, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T01:55:01.711 INFO:journalctl@ceph.mds.c.smithi142.stdout:Sep 21 01:55:01 smithi142 bash[68181]: ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mds-c 2024-09-21T01:55:01.887 DEBUG:teuthology.orchestra.run.smithi142:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f7697ecc-77b8-11ef-baf5-efdc52797490@mds.c.service' 2024-09-21T01:55:01.924 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T01:55:01.924 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-09-21T01:55:01.924 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-09-21T01:55:01.924 DEBUG:teuthology.orchestra.run.smithi142:> sudo systemctl stop ceph-f7697ecc-77b8-11ef-baf5-efdc52797490@mds.f 2024-09-21T01:55:02.239 INFO:journalctl@ceph.mds.f.smithi142.stdout:Sep 21 01:55:02 smithi142 systemd[1]: Stopping Ceph mds.f for f7697ecc-77b8-11ef-baf5-efdc52797490... 2024-09-21T01:55:02.714 INFO:journalctl@ceph.mds.f.smithi142.stdout:Sep 21 01:55:02 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mds-f[63258]: 2024-09-21T01:55:02.238+0000 7f39be035640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T01:55:02.715 INFO:journalctl@ceph.mds.f.smithi142.stdout:Sep 21 01:55:02 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mds-f[63258]: 2024-09-21T01:55:02.238+0000 7f39be035640 -1 mds.f *** got signal Terminated *** 2024-09-21T01:55:06.514 INFO:journalctl@ceph.mds.f.smithi142.stdout:Sep 21 01:55:06 smithi142 podman[68314]: 2024-09-21 01:55:06.252783325 +0000 UTC m=+4.112379436 container died fd9589afba7ff91daa815b13c37ad0168a2e7958dcefa8eb90df034f5b6439df (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mds-f, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS) 2024-09-21T01:55:06.839 INFO:journalctl@ceph.mds.f.smithi142.stdout:Sep 21 01:55:06 smithi142 podman[68314]: 2024-09-21 01:55:06.588313443 +0000 UTC m=+4.447909553 container cleanup fd9589afba7ff91daa815b13c37ad0168a2e7958dcefa8eb90df034f5b6439df (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mds-f, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=) 2024-09-21T01:55:06.839 INFO:journalctl@ceph.mds.f.smithi142.stdout:Sep 21 01:55:06 smithi142 bash[68314]: ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mds-f 2024-09-21T01:55:07.065 DEBUG:teuthology.orchestra.run.smithi142:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f7697ecc-77b8-11ef-baf5-efdc52797490@mds.f.service' 2024-09-21T01:55:07.097 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T01:55:07.097 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-09-21T01:55:07.097 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-09-21T01:55:07.098 DEBUG:teuthology.orchestra.run.smithi142:> sudo systemctl stop ceph-f7697ecc-77b8-11ef-baf5-efdc52797490@mds.i 2024-09-21T01:55:07.434 INFO:journalctl@ceph.mds.i.smithi142.stdout:Sep 21 01:55:07 smithi142 systemd[1]: Stopping Ceph mds.i for f7697ecc-77b8-11ef-baf5-efdc52797490... 2024-09-21T01:55:07.714 INFO:journalctl@ceph.mds.i.smithi142.stdout:Sep 21 01:55:07 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mds-i[63810]: 2024-09-21T01:55:07.432+0000 7fa0d8f8b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T01:55:07.714 INFO:journalctl@ceph.mds.i.smithi142.stdout:Sep 21 01:55:07 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mds-i[63810]: 2024-09-21T01:55:07.432+0000 7fa0d8f8b640 -1 mds.i *** got signal Terminated *** 2024-09-21T01:55:11.368 INFO:journalctl@ceph.mds.i.smithi142.stdout:Sep 21 01:55:11 smithi142 podman[68434]: 2024-09-21 01:55:11.080607658 +0000 UTC m=+3.763597134 container died 5a605597b7bd67439d2644f000dcd27e6edc8a60b9b0f2705ef49b9fbc3f8ef9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mds-i, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-09-21T01:55:11.701 INFO:journalctl@ceph.mds.i.smithi142.stdout:Sep 21 01:55:11 smithi142 podman[68434]: 2024-09-21 01:55:11.467255433 +0000 UTC m=+4.150244910 container cleanup 5a605597b7bd67439d2644f000dcd27e6edc8a60b9b0f2705ef49b9fbc3f8ef9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mds-i, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-09-21T01:55:11.701 INFO:journalctl@ceph.mds.i.smithi142.stdout:Sep 21 01:55:11 smithi142 bash[68434]: ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mds-i 2024-09-21T01:55:11.832 DEBUG:teuthology.orchestra.run.smithi142:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f7697ecc-77b8-11ef-baf5-efdc52797490@mds.i.service' 2024-09-21T01:55:11.864 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T01:55:11.864 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-09-21T01:55:11.864 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-09-21T01:55:11.864 DEBUG:teuthology.orchestra.run.smithi142:> sudo systemctl stop ceph-f7697ecc-77b8-11ef-baf5-efdc52797490@mds.l 2024-09-21T01:55:11.964 INFO:journalctl@ceph.mds.l.smithi142.stdout:Sep 21 01:55:11 smithi142 systemd[1]: Stopping Ceph mds.l for f7697ecc-77b8-11ef-baf5-efdc52797490... 2024-09-21T01:55:12.465 INFO:journalctl@ceph.mds.l.smithi142.stdout:Sep 21 01:55:12 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mds-l[62987]: 2024-09-21T01:55:12.162+0000 7fd758096640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T01:55:12.465 INFO:journalctl@ceph.mds.l.smithi142.stdout:Sep 21 01:55:12 smithi142 ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mds-l[62987]: 2024-09-21T01:55:12.162+0000 7fd758096640 -1 mds.l *** got signal Terminated *** 2024-09-21T01:55:16.036 INFO:journalctl@ceph.mds.l.smithi142.stdout:Sep 21 01:55:15 smithi142 podman[68554]: 2024-09-21 01:55:15.778679778 +0000 UTC m=+3.703970024 container died 884e269293142c40a9fca2720d5c02f5a42d2249855542d912046cd83fe735b5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mds-l, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T01:55:16.387 INFO:journalctl@ceph.mds.l.smithi142.stdout:Sep 21 01:55:16 smithi142 podman[68554]: 2024-09-21 01:55:16.137096486 +0000 UTC m=+4.062386714 container cleanup 884e269293142c40a9fca2720d5c02f5a42d2249855542d912046cd83fe735b5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mds-l, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-09-21T01:55:16.388 INFO:journalctl@ceph.mds.l.smithi142.stdout:Sep 21 01:55:16 smithi142 bash[68554]: ceph-f7697ecc-77b8-11ef-baf5-efdc52797490-mds-l 2024-09-21T01:55:16.550 DEBUG:teuthology.orchestra.run.smithi142:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f7697ecc-77b8-11ef-baf5-efdc52797490@mds.l.service' 2024-09-21T01:55:16.581 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T01:55:16.581 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-09-21T01:55:16.582 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 --force --keep-logs 2024-09-21T01:55:16.785 INFO:teuthology.orchestra.run.smithi083.stdout:Deleting cluster with fsid: f7697ecc-77b8-11ef-baf5-efdc52797490 2024-09-21T01:55:19.204 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 --force --keep-logs 2024-09-21T01:55:19.411 INFO:teuthology.orchestra.run.smithi119.stdout:Deleting cluster with fsid: f7697ecc-77b8-11ef-baf5-efdc52797490 2024-09-21T01:55:21.851 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 --force --keep-logs 2024-09-21T01:55:22.052 INFO:teuthology.orchestra.run.smithi142.stdout:Deleting cluster with fsid: f7697ecc-77b8-11ef-baf5-efdc52797490 2024-09-21T01:55:24.360 DEBUG:teuthology.orchestra.run.smithi083:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T01:55:24.394 DEBUG:teuthology.orchestra.run.smithi119:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T01:55:24.428 DEBUG:teuthology.orchestra.run.smithi142:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T01:55:24.455 INFO:tasks.cephadm:Archiving crash dumps... 2024-09-21T01:55:24.457 DEBUG:teuthology.misc:Transferring archived files from smithi083:/var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/crash to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913381/remote/smithi083/crash 2024-09-21T01:55:24.458 DEBUG:teuthology.orchestra.run.smithi083:> sudo tar c -f - -C /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/crash -- . 2024-09-21T01:55:24.501 INFO:teuthology.orchestra.run.smithi083.stderr:tar: /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/crash: Cannot open: No such file or directory 2024-09-21T01:55:24.501 INFO:teuthology.orchestra.run.smithi083.stderr:tar: Error is not recoverable: exiting now 2024-09-21T01:55:24.503 DEBUG:teuthology.misc:Transferring archived files from smithi119:/var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/crash to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913381/remote/smithi119/crash 2024-09-21T01:55:24.504 DEBUG:teuthology.orchestra.run.smithi119:> sudo tar c -f - -C /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/crash -- . 2024-09-21T01:55:24.582 INFO:teuthology.orchestra.run.smithi119.stderr:tar: /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/crash: Cannot open: No such file or directory 2024-09-21T01:55:24.583 INFO:teuthology.orchestra.run.smithi119.stderr:tar: Error is not recoverable: exiting now 2024-09-21T01:55:24.585 DEBUG:teuthology.misc:Transferring archived files from smithi142:/var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/crash to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913381/remote/smithi142/crash 2024-09-21T01:55:24.586 DEBUG:teuthology.orchestra.run.smithi142:> sudo tar c -f - -C /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/crash -- . 2024-09-21T01:55:24.698 INFO:teuthology.orchestra.run.smithi142.stderr:tar: /var/lib/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/crash: Cannot open: No such file or directory 2024-09-21T01:55:24.698 INFO:teuthology.orchestra.run.smithi142.stderr:tar: Error is not recoverable: exiting now 2024-09-21T01:55:24.700 INFO:tasks.cephadm:Checking cluster log for badness... 2024-09-21T01:55:24.700 DEBUG:teuthology.orchestra.run.smithi083:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v 'fs.*is degraded' | egrep -v 'filesystem is degraded' | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v 'filesystem is offline' | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v 'insufficient standby MDS daemons available' | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | head -n 1 2024-09-21T01:55:24.735 INFO:tasks.cephadm:Compressing logs... 2024-09-21T01:55:24.736 DEBUG:teuthology.orchestra.run.smithi083:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-21T01:55:24.779 DEBUG:teuthology.orchestra.run.smithi119:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-21T01:55:24.781 DEBUG:teuthology.orchestra.run.smithi142:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-21T01:55:24.802 INFO:teuthology.orchestra.run.smithi083.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-09-21T01:55:24.802 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.log 2024-09-21T01:55:24.803 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/ceph-osd.0.log 2024-09-21T01:55:24.803 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/ceph-osd.9.log 2024-09-21T01:55:24.803 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.log: gzip -5 --verbose -- /var/log/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/ceph-volume.log 2024-09-21T01:55:24.804 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/ceph-osd.0.log: /var/log/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/ceph-osd.9.log: gzip -5 --verbose -- /var/log/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/ceph.audit.log 2024-09-21T01:55:24.806 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/ceph-mds.a.log 2024-09-21T01:55:24.806 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/ceph.cephadm.log 2024-09-21T01:55:24.806 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/ceph-mds.a.log: gzip -5 92.5% -- replaced with /var/log/ceph/ceph-client.admin.log.gz 2024-09-21T01:55:24.806 INFO:teuthology.orchestra.run.smithi083.stderr: --verbose -- /var/log/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/ceph-mon.a.log 2024-09-21T01:55:24.806 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/ceph-mds.g.log 2024-09-21T01:55:24.809 INFO:teuthology.orchestra.run.smithi083.stderr: 84.4% -- replaced with /var/log/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/ceph.cephadm.log.gz 2024-09-21T01:55:24.809 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/ceph-osd.6.log 2024-09-21T01:55:24.809 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/ceph.log 2024-09-21T01:55:24.809 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/ceph-osd.6.log: /var/log/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/ceph-mds.g.log: 90.1% -- replaced with /var/log/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/ceph.audit.log.gz 2024-09-21T01:55:24.810 INFO:teuthology.orchestra.run.smithi142.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/ceph-volume.log 2024-09-21T01:55:24.810 INFO:teuthology.orchestra.run.smithi142.stderr:: No such file or directory 2024-09-21T01:55:24.810 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/ceph.audit.log 2024-09-21T01:55:24.810 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/ceph-mds.i.log 2024-09-21T01:55:24.810 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/ceph-volume.log: /var/log/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/ceph-mon.c.log 2024-09-21T01:55:24.810 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/ceph.cephadm.log 2024-09-21T01:55:24.810 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/ceph-osd.11.log 2024-09-21T01:55:24.810 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/ceph-osd.2.log 2024-09-21T01:55:24.810 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/ceph-osd.11.log: 81.8% -- replaced with /var/log/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/ceph.cephadm.log.gz 2024-09-21T01:55:24.810 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/ceph-osd.5.log 2024-09-21T01:55:24.811 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/ceph.log 2024-09-21T01:55:24.811 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/ceph-mds.l.log 2024-09-21T01:55:24.811 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/ceph-osd.5.log: 90.2% -- replaced with /var/log/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/ceph.audit.log.gz 2024-09-21T01:55:24.811 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/ceph.log: 87.7% -- replaced with /var/log/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/ceph.log.gz 2024-09-21T01:55:24.812 INFO:teuthology.orchestra.run.smithi083.stderr: 95.0% -- replaced with /var/log/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/ceph-mds.a.log.gz 2024-09-21T01:55:24.812 INFO:teuthology.orchestra.run.smithi119.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/ceph-osd.10.log 2024-09-21T01:55:24.812 INFO:teuthology.orchestra.run.smithi119.stderr:: No such file or directory 2024-09-21T01:55:24.813 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/ceph-osd.1.log 2024-09-21T01:55:24.813 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/ceph-osd.10.log: gzip -5 --verbose -- /var/log/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/ceph-osd.7.log 2024-09-21T01:55:24.813 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/ceph-volume.log 2024-09-21T01:55:24.813 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/ceph-mds.b.log 2024-09-21T01:55:24.817 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/ceph-osd.8.log 2024-09-21T01:55:24.817 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/ceph-mds.l.log: gzip -5 --verbose -- /var/log/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/ceph-mgr.z.log 2024-09-21T01:55:24.817 INFO:teuthology.orchestra.run.smithi083.stderr: 95.0% -- replaced with /var/log/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/ceph-mds.g.log.gz 2024-09-21T01:55:24.817 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/ceph-mds.d.log 2024-09-21T01:55:24.817 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/ceph.log: gzip -5 --verbose -- /var/log/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/ceph-mgr.x.log 2024-09-21T01:55:24.817 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/ceph-mds.j.log 2024-09-21T01:55:24.818 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/ceph-mgr.x.log: 87.7% -- replaced with /var/log/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/ceph.log.gz 2024-09-21T01:55:24.821 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/ceph-mds.k.log 2024-09-21T01:55:24.821 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/ceph-osd.4.log/var/log/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/ceph-mds.b.log: 2024-09-21T01:55:24.821 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/ceph-mds.k.log: gzip -5 --verbose -- /var/log/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/ceph.audit.log 2024-09-21T01:55:24.821 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/ceph.cephadm.log 2024-09-21T01:55:24.821 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/ceph.audit.log: 90.2% -- replaced with /var/log/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/ceph.audit.log.gz 2024-09-21T01:55:24.821 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/ceph-mgr.y.log 2024-09-21T01:55:24.821 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/ceph.cephadm.log: 81.8% -- replaced with /var/log/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/ceph.cephadm.log.gz 2024-09-21T01:55:24.821 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/ceph.log 2024-09-21T01:55:24.821 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/ceph-mgr.y.log: 95.0% -- replaced with /var/log/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/ceph-mds.k.log.gz 2024-09-21T01:55:24.821 INFO:teuthology.orchestra.run.smithi083.stderr: 91.1% -- replaced with /var/log/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/ceph-volume.log.gz 2024-09-21T01:55:24.822 INFO:teuthology.orchestra.run.smithi083.stderr: 95.1% -- replaced with /var/log/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/ceph-mds.d.log.gz 2024-09-21T01:55:24.823 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/ceph-osd.8.log: 91.0% -- replaced with /var/log/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/ceph-volume.log.gz 2024-09-21T01:55:24.823 INFO:teuthology.orchestra.run.smithi142.stderr: 95.1% -- replaced with /var/log/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/ceph-mds.l.log.gz 2024-09-21T01:55:24.823 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/ceph-mds.c.log 2024-09-21T01:55:24.823 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/ceph-mgr.z.log: gzip -5 --verbose -- /var/log/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/ceph-mds.f.log 2024-09-21T01:55:24.823 INFO:teuthology.orchestra.run.smithi119.stderr: 90.9% -- replaced with /var/log/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/ceph-volume.log.gz 2024-09-21T01:55:24.823 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/ceph-mds.h.log 2024-09-21T01:55:24.824 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/ceph.log: gzip -5 --verbose -- /var/log/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/ceph-mon.b.log 2024-09-21T01:55:24.825 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/ceph-mds.h.log: 92.5% -- replaced with /var/log/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/ceph-mgr.y.log.gz 2024-09-21T01:55:24.825 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/ceph-mds.e.log 2024-09-21T01:55:24.826 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/ceph-mon.b.log: 87.7% -- replaced with /var/log/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/ceph.log.gz 2024-09-21T01:55:24.827 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-21T01:55:24.830 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/ceph-osd.3.log 2024-09-21T01:55:24.830 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/ceph-mds.j.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.log 2024-09-21T01:55:24.830 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-21T01:55:24.830 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/ceph-mds.c.log: 94.9% 92.6% -- replaced with /var/log/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/ceph-mgr.z.log.gz 2024-09-21T01:55:24.830 INFO:teuthology.orchestra.run.smithi142.stderr: -- replaced with /var/log/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/ceph-mds.c.log.gz 2024-09-21T01:55:24.830 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-21T01:55:24.830 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/ceph-mds.f.log: /var/log/ceph/cephadm.log: 92.1% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-21T01:55:24.831 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/ceph-mds.e.log: 94.9% -- replaced with /var/log/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/ceph-mds.h.log.gz 2024-09-21T01:55:24.834 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.0.log: 95.1% -- replaced with /var/log/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/ceph-mds.j.log.gz 2024-09-21T01:55:24.835 INFO:teuthology.orchestra.run.smithi142.stderr: 95.0% -- replaced with /var/log/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/ceph-mds.f.log.gz 2024-09-21T01:55:24.835 INFO:teuthology.orchestra.run.smithi119.stderr: 94.9% -- replaced with /var/log/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/ceph-mds.e.log.gz 2024-09-21T01:55:24.836 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/cephadm.log: 91.9% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-21T01:55:24.840 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/cephadm.log: 93.2% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-21T01:55:25.170 INFO:teuthology.orchestra.run.smithi083.stderr: 90.3% -- replaced with /var/log/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/ceph-mgr.x.log.gz 2024-09-21T01:55:25.192 INFO:teuthology.orchestra.run.smithi142.stderr: 91.9% -- replaced with /var/log/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/ceph-mon.c.log.gz 2024-09-21T01:55:25.202 INFO:teuthology.orchestra.run.smithi119.stderr: 91.9% -- replaced with /var/log/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/ceph-mon.b.log.gz 2024-09-21T01:55:25.310 INFO:teuthology.orchestra.run.smithi142.stderr: 95.6% -- replaced with /var/log/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/ceph-mds.i.log.gz 2024-09-21T01:55:25.977 INFO:teuthology.orchestra.run.smithi083.stderr: 90.4% -- replaced with /var/log/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/ceph-mon.a.log.gz 2024-09-21T01:55:26.279 INFO:teuthology.orchestra.run.smithi142.stderr: 92.2% -- replaced with /var/log/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/ceph-osd.8.log.gz 2024-09-21T01:55:26.367 INFO:teuthology.orchestra.run.smithi142.stderr: 92.1% -- replaced with /var/log/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/ceph-osd.11.log.gz 2024-09-21T01:55:26.418 INFO:teuthology.orchestra.run.smithi083.stderr: 92.2% -- replaced with /var/log/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/ceph-osd.0.log.gz 2024-09-21T01:55:26.694 INFO:teuthology.orchestra.run.smithi119.stderr: 92.4% -- replaced with /var/log/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/ceph-osd.4.log.gz 2024-09-21T01:55:26.833 INFO:teuthology.orchestra.run.smithi119.stderr: 92.7% -- replaced with /var/log/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/ceph-osd.1.log.gz 2024-09-21T01:55:26.977 INFO:teuthology.orchestra.run.smithi119.stderr: 92.7% -- replaced with /var/log/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/ceph-osd.7.log.gz 2024-09-21T01:55:27.036 INFO:teuthology.orchestra.run.smithi083.stderr: 92.1% -- replaced with /var/log/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/ceph-osd.6.log.gz 2024-09-21T01:55:27.356 INFO:teuthology.orchestra.run.smithi142.stderr: 92.8% -- replaced with /var/log/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/ceph-osd.2.log.gz 2024-09-21T01:55:27.373 INFO:teuthology.orchestra.run.smithi083.stderr: 92.7% -- replaced with /var/log/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/ceph-osd.3.log.gz 2024-09-21T01:55:27.531 INFO:teuthology.orchestra.run.smithi119.stderr: 92.4% -- replaced with /var/log/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/ceph-osd.10.log.gz 2024-09-21T01:55:27.541 INFO:teuthology.orchestra.run.smithi083.stderr: 92.2% -- replaced with /var/log/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/ceph-osd.9.log.gz 2024-09-21T01:55:28.411 INFO:teuthology.orchestra.run.smithi142.stderr: 93.9% -- replaced with /var/log/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/ceph-osd.5.log.gz 2024-09-21T01:55:28.435 INFO:teuthology.orchestra.run.smithi142.stderr: 2024-09-21T01:55:28.435 INFO:teuthology.orchestra.run.smithi142.stderr:real 0m3.617s 2024-09-21T01:55:28.435 INFO:teuthology.orchestra.run.smithi142.stderr:user 0m9.745s 2024-09-21T01:55:28.435 INFO:teuthology.orchestra.run.smithi142.stderr:sys 0m0.378s 2024-09-21T01:55:29.394 INFO:teuthology.orchestra.run.smithi119.stderr: 93.6% -- replaced with /var/log/ceph/f7697ecc-77b8-11ef-baf5-efdc52797490/ceph-mds.b.log.gz 2024-09-21T01:55:29.396 INFO:teuthology.orchestra.run.smithi119.stderr: 2024-09-21T01:55:29.396 INFO:teuthology.orchestra.run.smithi119.stderr:real 0m4.600s 2024-09-21T01:55:29.396 INFO:teuthology.orchestra.run.smithi119.stderr:user 0m13.386s 2024-09-21T01:55:29.396 INFO:teuthology.orchestra.run.smithi119.stderr:sys 0m0.435s 2024-09-21T01:55:56.724 INFO:teuthology.orchestra.run.smithi083.stderr: 97.2% -- replaced with /var/log/ceph/ceph-client.0.log.gz 2024-09-21T01:55:56.726 INFO:teuthology.orchestra.run.smithi083.stderr: 2024-09-21T01:55:56.726 INFO:teuthology.orchestra.run.smithi083.stderr:real 0m31.934s 2024-09-21T01:55:56.726 INFO:teuthology.orchestra.run.smithi083.stderr:user 0m40.918s 2024-09-21T01:55:56.726 INFO:teuthology.orchestra.run.smithi083.stderr:sys 0m1.642s 2024-09-21T01:55:56.727 INFO:tasks.cephadm:Archiving logs... 2024-09-21T01:55:56.727 DEBUG:teuthology.misc:Transferring archived files from smithi083:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913381/remote/smithi083/log 2024-09-21T01:55:56.728 DEBUG:teuthology.orchestra.run.smithi083:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-21T01:56:00.765 DEBUG:teuthology.misc:Transferring archived files from smithi119:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913381/remote/smithi119/log 2024-09-21T01:56:00.766 DEBUG:teuthology.orchestra.run.smithi119:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-21T01:56:02.558 DEBUG:teuthology.misc:Transferring archived files from smithi142:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913381/remote/smithi142/log 2024-09-21T01:56:02.558 DEBUG:teuthology.orchestra.run.smithi142:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-21T01:56:04.026 INFO:tasks.cephadm:Removing cluster... 2024-09-21T01:56:04.026 DEBUG:teuthology.orchestra.run.smithi083:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 --force 2024-09-21T01:56:04.230 INFO:teuthology.orchestra.run.smithi083.stdout:Deleting cluster with fsid: f7697ecc-77b8-11ef-baf5-efdc52797490 2024-09-21T01:56:04.493 DEBUG:teuthology.orchestra.run.smithi119:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 --force 2024-09-21T01:56:04.700 INFO:teuthology.orchestra.run.smithi119.stdout:Deleting cluster with fsid: f7697ecc-77b8-11ef-baf5-efdc52797490 2024-09-21T01:56:05.001 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid f7697ecc-77b8-11ef-baf5-efdc52797490 --force 2024-09-21T01:56:05.203 INFO:teuthology.orchestra.run.smithi142.stdout:Deleting cluster with fsid: f7697ecc-77b8-11ef-baf5-efdc52797490 2024-09-21T01:56:05.470 INFO:tasks.cephadm:Removing cephadm ... 2024-09-21T01:56:05.471 DEBUG:teuthology.orchestra.run.smithi083:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-21T01:56:05.493 DEBUG:teuthology.orchestra.run.smithi119:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-21T01:56:05.512 DEBUG:teuthology.orchestra.run.smithi142:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-21T01:56:05.532 INFO:tasks.cephadm:Teardown complete 2024-09-21T01:56:05.532 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-21T01:56:05.555 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-21T01:56:05.556 DEBUG:teuthology.orchestra.run.smithi083:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-21T01:56:05.560 DEBUG:teuthology.orchestra.run.smithi119:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-21T01:56:05.567 DEBUG:teuthology.orchestra.run.smithi142:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-21T01:56:05.681 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-21T01:56:05.695 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-21T01:56:05.696 DEBUG:teuthology.orchestra.run.smithi083:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T01:56:05.699 DEBUG:teuthology.orchestra.run.smithi119:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T01:56:05.703 DEBUG:teuthology.orchestra.run.smithi142:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T01:56:05.714 INFO:teuthology.orchestra.run.smithi083.stderr:bash: line 1: ntpq: command not found 2024-09-21T01:56:05.717 INFO:teuthology.orchestra.run.smithi119.stderr:bash: line 1: ntpq: command not found 2024-09-21T01:56:05.718 INFO:teuthology.orchestra.run.smithi142.stderr:bash: line 1: ntpq: command not found 2024-09-21T01:56:05.719 INFO:teuthology.orchestra.run.smithi083.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T01:56:05.719 INFO:teuthology.orchestra.run.smithi083.stdout:=============================================================================== 2024-09-21T01:56:05.719 INFO:teuthology.orchestra.run.smithi083.stdout:^* hv01.front.sepia.ceph.com 3 7 377 5 +186us[ +242us] +/- 55ms 2024-09-21T01:56:05.719 INFO:teuthology.orchestra.run.smithi083.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 5 -911us[ -854us] +/- 65ms 2024-09-21T01:56:05.719 INFO:teuthology.orchestra.run.smithi083.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 7 +716us[ +773us] +/- 74ms 2024-09-21T01:56:05.720 INFO:teuthology.orchestra.run.smithi083.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T01:56:05.722 INFO:teuthology.orchestra.run.smithi119.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T01:56:05.723 INFO:teuthology.orchestra.run.smithi119.stdout:=============================================================================== 2024-09-21T01:56:05.723 INFO:teuthology.orchestra.run.smithi119.stdout:^* hv01.front.sepia.ceph.com 3 6 377 3 +205us[ +200us] +/- 55ms 2024-09-21T01:56:05.723 INFO:teuthology.orchestra.run.smithi119.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 2 -892us[ -892us] +/- 65ms 2024-09-21T01:56:05.723 INFO:teuthology.orchestra.run.smithi119.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 5 +744us[ +740us] +/- 74ms 2024-09-21T01:56:05.723 INFO:teuthology.orchestra.run.smithi119.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T01:56:05.725 INFO:teuthology.orchestra.run.smithi142.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T01:56:05.725 INFO:teuthology.orchestra.run.smithi142.stdout:=============================================================================== 2024-09-21T01:56:05.726 INFO:teuthology.orchestra.run.smithi142.stdout:^* hv01.front.sepia.ceph.com 3 6 377 7 +205us[ +205us] +/- 55ms 2024-09-21T01:56:05.726 INFO:teuthology.orchestra.run.smithi142.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 6 -875us[ -875us] +/- 65ms 2024-09-21T01:56:05.726 INFO:teuthology.orchestra.run.smithi142.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 5 +747us[ +747us] +/- 75ms 2024-09-21T01:56:05.726 INFO:teuthology.orchestra.run.smithi142.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T01:56:05.726 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-21T01:56:05.741 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-21T01:56:05.742 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-21T01:56:05.755 DEBUG:teuthology.orchestra.run.smithi083:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-21T01:56:05.845 DEBUG:teuthology.orchestra.run.smithi119:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-21T01:56:05.914 DEBUG:teuthology.orchestra.run.smithi142:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-21T01:56:05.979 DEBUG:teuthology.orchestra.run.smithi083:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T01:56:06.009 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T01:56:06.010 DEBUG:teuthology.orchestra.run.smithi119:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T01:56:06.038 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T01:56:06.038 DEBUG:teuthology.orchestra.run.smithi142:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T01:56:06.065 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T01:56:06.066 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-21T01:56:06.076 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-21T01:56:06.122 INFO:teuthology.task.internal:Duration was 1924.793469 seconds 2024-09-21T01:56:06.122 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-21T01:56:06.132 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-21T01:56:06.132 DEBUG:teuthology.orchestra.run.smithi083:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-21T01:56:06.134 DEBUG:teuthology.orchestra.run.smithi119:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-21T01:56:06.136 DEBUG:teuthology.orchestra.run.smithi142:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-21T01:56:06.173 INFO:teuthology.orchestra.run.smithi083.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T01:56:06.174 INFO:teuthology.orchestra.run.smithi119.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T01:56:06.175 INFO:teuthology.orchestra.run.smithi142.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T01:56:06.507 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-21T01:56:06.507 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi083.front.sepia.ceph.com 2024-09-21T01:56:06.508 DEBUG:teuthology.orchestra.run.smithi083:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-21T01:56:06.533 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi119.front.sepia.ceph.com 2024-09-21T01:56:06.533 DEBUG:teuthology.orchestra.run.smithi119:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-21T01:56:06.571 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi142.front.sepia.ceph.com 2024-09-21T01:56:06.572 DEBUG:teuthology.orchestra.run.smithi142:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-21T01:56:06.604 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-21T01:56:06.604 DEBUG:teuthology.orchestra.run.smithi083:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-21T01:56:06.607 DEBUG:teuthology.orchestra.run.smithi119:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-21T01:56:06.614 DEBUG:teuthology.orchestra.run.smithi142:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-21T01:56:06.671 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-21T01:56:06.671 DEBUG:teuthology.orchestra.run.smithi083:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-21T01:56:06.679 DEBUG:teuthology.orchestra.run.smithi119:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-21T01:56:06.681 DEBUG:teuthology.orchestra.run.smithi142:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-21T01:56:07.277 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-21T01:56:07.288 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-21T01:56:07.288 DEBUG:teuthology.orchestra.run.smithi083:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-21T01:56:07.313 DEBUG:teuthology.orchestra.run.smithi119:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-21T01:56:07.338 DEBUG:teuthology.orchestra.run.smithi142:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-21T01:56:07.364 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-21T01:56:07.374 DEBUG:teuthology.orchestra.run.smithi083:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-21T01:56:07.376 DEBUG:teuthology.orchestra.run.smithi119:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-21T01:56:07.381 DEBUG:teuthology.orchestra.run.smithi142:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-21T01:56:07.397 INFO:teuthology.orchestra.run.smithi083.stdout:kernel.core_pattern = core 2024-09-21T01:56:07.402 INFO:teuthology.orchestra.run.smithi119.stdout:kernel.core_pattern = core 2024-09-21T01:56:07.427 INFO:teuthology.orchestra.run.smithi142.stdout:kernel.core_pattern = core 2024-09-21T01:56:07.449 DEBUG:teuthology.orchestra.run.smithi083:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-21T01:56:07.466 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T01:56:07.466 DEBUG:teuthology.orchestra.run.smithi119:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-21T01:56:07.480 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T01:56:07.481 DEBUG:teuthology.orchestra.run.smithi142:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-21T01:56:07.503 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T01:56:07.503 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-21T01:56:07.518 INFO:teuthology.task.internal:Transferring archived files... 2024-09-21T01:56:07.518 DEBUG:teuthology.misc:Transferring archived files from smithi083:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913381/remote/smithi083 2024-09-21T01:56:07.519 DEBUG:teuthology.orchestra.run.smithi083:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-21T01:56:07.566 DEBUG:teuthology.misc:Transferring archived files from smithi119:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913381/remote/smithi119 2024-09-21T01:56:07.567 DEBUG:teuthology.orchestra.run.smithi119:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-21T01:56:07.602 DEBUG:teuthology.misc:Transferring archived files from smithi142:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913381/remote/smithi142 2024-09-21T01:56:07.603 DEBUG:teuthology.orchestra.run.smithi142:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-21T01:56:07.637 INFO:teuthology.task.internal:Removing archive directory... 2024-09-21T01:56:07.637 DEBUG:teuthology.orchestra.run.smithi083:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-21T01:56:07.640 DEBUG:teuthology.orchestra.run.smithi119:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-21T01:56:07.643 DEBUG:teuthology.orchestra.run.smithi142:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-21T01:56:07.688 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-21T01:56:07.706 INFO:teuthology.task.internal:Not uploading archives. 2024-09-21T01:56:07.706 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-21T01:56:07.716 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-21T01:56:07.716 DEBUG:teuthology.orchestra.run.smithi083:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-21T01:56:07.718 DEBUG:teuthology.orchestra.run.smithi119:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-21T01:56:07.720 DEBUG:teuthology.orchestra.run.smithi142:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-21T01:56:07.731 INFO:teuthology.orchestra.run.smithi083.stdout: 265324 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 21 01:56 /home/ubuntu/cephtest 2024-09-21T01:56:07.732 INFO:teuthology.orchestra.run.smithi119.stdout: 265972 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 21 01:56 /home/ubuntu/cephtest 2024-09-21T01:56:07.743 INFO:teuthology.orchestra.run.smithi142.stdout: 265324 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 21 01:56 /home/ubuntu/cephtest 2024-09-21T01:56:07.744 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-21T01:56:07.755 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-21T01:56:07.779 INFO:teuthology.run:Summary data: description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/fuse objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/1 standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/no 5-quiesce/with-quiesce 6-workunit/direct_io}} duration: 1924.793468952179 flavor: default owner: scheduled_pdonnell@teuthology success: true 2024-09-21T01:56:07.780 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-21T01:56:07.851 INFO:teuthology.run:pass